-- Logs begin at Tue 2022-08-30 03:23:16 UTC, end at Tue 2022-08-30 06:08:31 UTC. -- Aug 30 03:56:58.382559 n-d-820368-36 systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 03:56:58.392187 n-d-820368-36 devstack@keystone.service[82086]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 03:56:58 2022] *** Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: nodename: n-d-820368-36 Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: machine: x86_64 Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: clock source: unix Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: pcre jit disabled Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: detected number of CPU cores: 4 Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: current working directory: / Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: detected binary path: /usr/bin/uwsgi-core Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: your processes number limit is 47680 Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: your memory page size is 4096 bytes Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: detected max file descriptor number: 2048 Aug 30 03:56:58.394549 n-d-820368-36 devstack@keystone.service[82086]: lock engine: pthread robust mutexes Aug 30 03:56:58.395900 n-d-820368-36 devstack@keystone.service[82086]: thunder lock: enabled Aug 30 03:56:58.395900 n-d-820368-36 devstack@keystone.service[82086]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 03:56:58.395900 n-d-820368-36 devstack@keystone.service[82086]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 03:56:58.433700 n-d-820368-36 devstack@keystone.service[82086]: Python main interpreter initialized at 0x55d0a7a3a9c0 Aug 30 03:56:58.433700 n-d-820368-36 devstack@keystone.service[82086]: python threads support enabled Aug 30 03:56:58.433700 n-d-820368-36 devstack@keystone.service[82086]: your server socket listen backlog is limited to 100 connections Aug 30 03:56:58.433700 n-d-820368-36 devstack@keystone.service[82086]: your mercy for graceful operations on workers is 90 seconds Aug 30 03:56:58.434086 n-d-820368-36 devstack@keystone.service[82086]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 03:56:58.434164 n-d-820368-36 devstack@keystone.service[82086]: *** Operational MODE: preforking *** Aug 30 03:56:58.434440 n-d-820368-36 devstack@keystone.service[82086]: *** uWSGI is running in multiple interpreter mode *** Aug 30 03:56:58.434440 n-d-820368-36 devstack@keystone.service[82086]: spawned uWSGI master process (pid: 82086) Aug 30 03:56:58.434644 n-d-820368-36 systemd[1]: Started Devstack devstack@keystone.service. Aug 30 03:56:58.435334 n-d-820368-36 devstack@keystone.service[82086]: spawned uWSGI worker 1 (pid: 82098, cores: 1) Aug 30 03:56:58.435487 n-d-820368-36 devstack@keystone.service[82086]: spawned uWSGI worker 2 (pid: 82099, cores: 1) Aug 30 03:56:58.437903 n-d-820368-36 devstack@keystone.service[82086]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 03:57:02.687744 n-d-820368-36 devstack@keystone.service[82099]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:57:02.687744 n-d-820368-36 devstack@keystone.service[82099]: from cryptography.utils import int_from_bytes Aug 30 03:57:02.688586 n-d-820368-36 devstack@keystone.service[82099]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:57:02.688586 n-d-820368-36 devstack@keystone.service[82099]: from cryptography.utils import int_from_bytes Aug 30 03:57:02.689216 n-d-820368-36 devstack@keystone.service[82098]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:57:02.689216 n-d-820368-36 devstack@keystone.service[82098]: from cryptography.utils import int_from_bytes Aug 30 03:57:02.689729 n-d-820368-36 devstack@keystone.service[82098]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:57:02.689729 n-d-820368-36 devstack@keystone.service[82098]: from cryptography.utils import int_from_bytes Aug 30 03:57:02.738302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 03:57:02.738523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 03:57:02.738612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] command line args: [] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 03:57:02.738916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 03:57:02.739049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ================================================================================ {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 03:57:02.739323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 03:57:02.739467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] admin_token = **** {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.739545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 03:57:02.739606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] config_dir = [] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.739669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] command line args: [] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 03:57:02.739733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.739928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] config_source = [] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.740023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 03:57:02.740097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] debug = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.740168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ================================================================================ {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 03:57:02.740244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.740480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] admin_token = **** {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.740551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] config_dir = [] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.740615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.741648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.741797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.741960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] config_source = [] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.742097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.742221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] debug = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.742346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.742480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.742635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] list_limit = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.742729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.742858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] log_config_append = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.742997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.743085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.743198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.743319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] log_dir = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.743319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] log_file = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.743577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.743664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.743787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] list_limit = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.743787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] log_config_append = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.743965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.744051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.744123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.744229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] log_dir = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.744313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.744431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] log_file = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.744512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.744585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.744699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.744774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.744928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.745015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.745099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.745222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.745299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.745411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.745492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.745617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.745742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.745835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.745929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] publish_errors = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.746977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] publish_errors = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] standard_threads = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.747929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] use_journal = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] use_json = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] standard_threads = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] use_stderr = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] use_syslog = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.748866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.749045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.749128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] use_journal = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.749206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.749277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] use_json = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.749347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] use_stderr = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.749422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.749494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] use_syslog = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.749570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.749723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:02.749898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.749994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.750077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.750208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.750308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.750488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.750613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.750691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.750762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.750961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.751103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.751191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.751266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.751431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.751566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.751648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.751731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.751895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.752028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.752109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.752181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.752368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.752521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.752615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.752690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.752996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.753085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.753158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.753241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.753390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.753515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.753594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.753750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.753912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.754093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.754172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.754246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.754323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.754506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.754645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.754726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.754800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.754965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.755100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.755180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.755272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.755391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.755480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.755642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.755767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.755922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.756014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.756096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.756169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.756333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.756458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.756538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.756629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.756779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.756865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.757016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.757099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.757249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.757345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.757493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.757576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.757718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.757802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.757985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.758085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.758197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.758286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.758437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.758520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.758664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.758759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.758893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.758976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.759118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.759206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.759347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.759513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.759590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.759667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.759794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.759883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.760024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.760212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.760212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.760348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.760457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.760540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.760700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.760792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.760934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.761015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.761162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.761242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.761389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.761478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.761619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.761700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.761852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.761993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.762071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.762155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.762312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.762391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.762536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.762623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.762772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.762850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.763002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.763085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.763235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.763313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.763460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.763538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.763703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.763788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.763938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.764074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.764184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.764274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.764388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.764460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.764691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.764841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.764841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.765110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.765195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.765295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.765360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.765425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.765632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.765783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.765783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.766097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.766225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.766349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.766474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.766603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.766741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.766866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.766998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.767127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.767255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.767379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.767514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.767753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.767894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.768027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.768156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.768287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.768433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.768568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.768696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.768845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.768926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.769089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.769221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.769304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.769430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.769561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.769648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.769765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.769912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.769994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.769994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.770102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.770283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.770415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.770549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.770667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.770795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.770917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.770917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.771158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.771364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.771485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.771608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.771742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.771862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.772003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.772136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.772269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.772393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.772514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.772635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.772758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.772889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.773943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] auth.external = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.774998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] auth.password = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.775069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] auth.external = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.775140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] auth.token = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.775220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.775294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.775373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.775443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.775586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.775713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.775795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] auth.password = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.775912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.776001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] auth.token = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.776148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.776274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.776393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.776550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.776628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.776704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.776881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] credential.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.777025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.777109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.777198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.777350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.777477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.777568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.777645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.777821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.777995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] credential.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.778081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.778156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.778313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.778440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.778520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.778610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.778765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.778851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.778997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.779082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.779229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.779321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.779478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.779562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.779729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.779814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.779968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.780061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.780220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.780304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.780470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.780554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.780704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] federation.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.780797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.780921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.781006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.781164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.781243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.781407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.781495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.781634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.781714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] federation.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.781897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.781979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.782137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.782231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.782383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.782461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.782614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.782692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.782861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.782942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.783092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.783171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.783335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.783414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.783567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.783647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.783809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.783888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.784227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.784321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.784477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.784554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.784627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.784798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.784929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.785039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.785129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.785284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.785363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.785521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.785663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.785758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.785941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.786026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.786177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.786263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.786409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.786502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.786640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.786721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.786883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.786964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.787131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.787218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.787376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.787456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.787602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.787679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.787854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.787933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.788104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.788185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.788341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.788418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.788576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.788656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.788805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.788890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.789039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.789118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.789267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.789345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.789511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.789590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.789750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.789828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.790008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.790088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.790244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.790326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.790481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.790568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.790721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.790801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.790963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.791043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.791209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.791289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.791441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.791522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.791682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.791761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.791911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.791990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.792145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.792224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.792372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.792453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.792606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.792685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.792837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.792927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.793075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.793154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.793306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.793384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.793540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.793628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.793774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.793852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.794037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.794118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.794265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.794358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.794496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.794605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.794739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.794821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.795355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.795464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.795464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.795602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.795674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.795746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.795746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.795892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.795967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.796039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.796481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.796560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.796633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.796715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.796790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.796863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.796935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.797990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.798142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.798222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.798371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.798464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.799942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.800994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.801162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.801255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.801398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.801477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.801632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.801711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.801866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.801991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.802120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.802200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.802355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.802433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.802599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.802686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.802832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.802910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.803063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.803141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.803298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.803386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.803539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.803616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.803773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.803851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.803999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.804085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.804231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.804309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.804467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] resource.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.804593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.804713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.804838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.804955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.805071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.805188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.805309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.805433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.805551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] resource.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.805678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.805800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.805930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.806069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.806174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.806305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.806407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.806554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.806639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.806807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.806886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] role.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.807061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.807148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] role.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.807289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.807376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.807512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.807601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.807757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.807836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.807993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] role.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.808073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.808235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.808321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] role.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.808462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.808540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.808969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.809970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.810135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.810215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.810379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.810469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.810613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.810787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.810870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.811021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.811100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.811267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.811348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.811839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.811932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.812006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.812079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.812482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.812576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.812658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.812732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.813978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.814050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.814134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.814209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.814281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.814351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.814465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.814581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.814706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.814816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.814927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.815041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.815131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] token.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.815248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.815468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.815592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.815699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.815792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.815912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.816027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.816148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.816257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.816375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.816483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] token.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.816612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.816690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.816877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.817021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.817142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.817274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.817404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.817514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.817606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.817683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.817755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.817827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.818002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.818130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.818268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.818379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.818514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.818604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.818763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.818903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.818995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.819079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.819237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.819363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.819444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.819518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.connection = **** {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.819701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.819879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.820010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.820140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.820269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.820388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.820388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.820549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.820624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.820707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.connection = **** {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.820854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.820981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.821061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.821136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.821306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.821485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.821610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.821734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.821848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.822025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.822025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.822196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.822274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.822346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.822455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.822544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.822710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.822849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.822934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.823042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.823155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.823263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.823379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.823511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.823624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.823739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.823819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 03:57:02.823893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.824072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.824303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.824542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.824772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:02.824897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 03:57:02.854044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.854260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.854335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.854414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.854493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.854571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.862935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.863065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.891138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.891291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.891364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.891427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.944832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.945533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.993932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.994179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.994323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:02.994478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.151973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.152247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.152387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.152481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.152738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.152867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.152954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.153024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.153228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.153465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.153675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.153856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.176335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.176487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.176573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.176674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.176810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.176895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.176972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.177047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.177175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.177254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.177385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.177520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.177597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.177681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.188495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.188939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.201649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.201922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.202065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.202172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.202253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.202328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.202402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.202567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.202708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.202793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.202868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.202944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.203017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82098) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.203143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82099) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 03:57:03.220556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.220752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 03:57:03.221064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.221200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.221377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 03:57:03.221546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 03:57:03.221546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.221800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.221948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.222072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 03:57:03.222206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.222329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.222452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.222576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.222906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.223176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.232276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.232563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.232708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.232845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.233006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.233128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.233272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.233566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.240202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.240944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.243094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.243377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.243658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.243941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.244221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.244345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.244446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.244524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.244738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.244862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.245007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.245153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.245227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.245305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.245521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.245614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.245797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.245943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.246123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.246504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.246773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.247043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.268490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.269600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.270032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.270316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.271096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.271376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.274829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.275117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.275398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.275984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.276265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.276540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.281826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.282137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.282820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.283110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.286324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.286677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.286976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.287230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.287325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.287520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.287612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.287799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.288134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.288417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.288699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.288963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.289238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.289724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.290043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.290342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.306047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.306335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.306540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.306822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.310215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.310663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.313306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.313604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.313849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.314165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.318019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.318591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.321135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.321690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.324249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.324548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.324832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.324950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.325126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.325258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.325393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.325508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.325711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.325829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.326016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.326293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.342077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.342373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.342502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.342639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.342827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.342976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.343146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.343272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.350058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.350191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.351606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.351938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.353130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.353401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.353667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.354040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.356044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.356326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.356720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.356914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.356997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.357277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.357536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.357640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.358033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.358353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.368517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.368800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.369176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.369456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.369737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.370019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.370143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.370306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.370427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.370586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.370868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.371154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.371441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.371735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.385726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.387312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.388639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.390327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.391740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.392929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.393158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.394680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.394834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.395006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.395325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.396164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.396448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.396735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.401655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.403221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.403562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.405040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.406152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.406442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.406723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.406994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.407922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.408194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.408476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.408770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.414830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.415128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.415403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.416718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.417009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.417288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.422229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82099) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.422506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.422786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.423058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.423325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.423600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.423870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.424126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.424398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.424677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.424885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82098) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 03:57:03.425118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.425342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.425524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.425524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.425781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.425957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82099) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.426086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.426305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.426633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.426957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.427271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.427590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.427919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.428232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.428536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.428840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.429155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82098) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 03:57:03.459730 n-d-820368-36 devstack@keystone.service[82099]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d0a7a3a9c0 pid: 82099 (default app) Aug 30 03:57:03.463115 n-d-820368-36 devstack@keystone.service[82098]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d0a7a3a9c0 pid: 82098 (default app) Aug 30 03:57:03.463271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1d738-5897-41c4-b17e-7003ff7b6c09 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:03.463483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1d738-5897-41c4-b17e-7003ff7b6c09 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:03.463752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1d738-5897-41c4-b17e-7003ff7b6c09 None None] PATH_INFO: `/v3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:03.468278 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Tue Aug 30 03:57:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:10.181932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65941858-c28a-487b-be32-3713e79cdc41 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:10.182632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65941858-c28a-487b-be32-3713e79cdc41 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:10.182632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65941858-c28a-487b-be32-3713e79cdc41 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:10.186802 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:10.192531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:10.193062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:10.193062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:10.263557 n-d-820368-36 devstack@keystone.service[82099]: INFO dbcounter [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] Registered counter for database keystone Aug 30 03:57:10.283195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG oslo_db.sqlalchemy.engines [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:57:10.290232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writer thread running {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:57:10.471643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG passlib.handlers.bcrypt [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82099) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 03:57:10.471966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG passlib.handlers.bcrypt [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82099) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 03:57:10.530776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:10.532401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:10.666124 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 03:57:11.189830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65941858-c28a-487b-be32-3713e79cdc41 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:11.259388 n-d-820368-36 devstack@keystone.service[82098]: INFO dbcounter [None req-65941858-c28a-487b-be32-3713e79cdc41 None None] Registered counter for database keystone Aug 30 03:57:11.281336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG oslo_db.sqlalchemy.engines [None req-65941858-c28a-487b-be32-3713e79cdc41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:57:11.288486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writer thread running {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:57:11.412105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65941858-c28a-487b-be32-3713e79cdc41 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:11.416913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d49273-0b55-4604-8433-963459ec9ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:11.417565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d49273-0b55-4604-8433-963459ec9ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:11.417838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d49273-0b55-4604-8433-963459ec9ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:11.418141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d49273-0b55-4604-8433-963459ec9ca2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:11.427093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d49273-0b55-4604-8433-963459ec9ca2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:11.479515 n-d-820368-36 devstack@keystone.service[82098]: WARNING keystone.common.rbac_enforcer.enforcer [None req-05d49273-0b55-4604-8433-963459ec9ca2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 03:57:11.479728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d49273-0b55-4604-8433-963459ec9ca2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:11.490394 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Aug 30 03:57:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 03:57:11.496808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:11.511970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdd1d3-02fc-44ab-bbda-2db6f19ed53c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:11.516964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce205b3-34bf-4f0b-a3b1-65bdab52530e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:11.518153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce205b3-34bf-4f0b-a3b1-65bdab52530e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:11.518391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce205b3-34bf-4f0b-a3b1-65bdab52530e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:11.518681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce205b3-34bf-4f0b-a3b1-65bdab52530e admin admin] PATH_INFO: `/v3/projects/3494f9474e30444f9b9f701899a3224a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:11.520406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce205b3-34bf-4f0b-a3b1-65bdab52530e admin admin] RBAC: Authorizing `identity:get_project(project_id=3494f9474e30444f9b9f701899a3224a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:11.572523 n-d-820368-36 devstack@keystone.service[82099]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0ce205b3-34bf-4f0b-a3b1-65bdab52530e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 03:57:11.572886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce205b3-34bf-4f0b-a3b1-65bdab52530e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:11.577663 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Aug 30 03:57:11 2022] GET /identity/v3/projects/3494f9474e30444f9b9f701899a3224a => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:13.462066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458b9c3-c692-4e83-9476-efc5404763c3 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:13.462643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458b9c3-c692-4e83-9476-efc5404763c3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:13.462643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458b9c3-c692-4e83-9476-efc5404763c3 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:13.466757 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:13.473031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dc62b-8cc8-424e-9bf3-fb596b6f345a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:13.473560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dc62b-8cc8-424e-9bf3-fb596b6f345a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:13.473560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735dc62b-8cc8-424e-9bf3-fb596b6f345a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:13.495459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-735dc62b-8cc8-424e-9bf3-fb596b6f345a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:13.497021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-735dc62b-8cc8-424e-9bf3-fb596b6f345a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:13.506305 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 03:57:13.774339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458b9c3-c692-4e83-9476-efc5404763c3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:13.788226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458b9c3-c692-4e83-9476-efc5404763c3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:13.792933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910bd1c-4da7-4654-ba99-eb92b911e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:13.793540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910bd1c-4da7-4654-ba99-eb92b911e72a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:13.793814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910bd1c-4da7-4654-ba99-eb92b911e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:13.794107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910bd1c-4da7-4654-ba99-eb92b911e72a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:13.803039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910bd1c-4da7-4654-ba99-eb92b911e72a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:13.804819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910bd1c-4da7-4654-ba99-eb92b911e72a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:13.813733 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Aug 30 03:57:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 03:57:13.819828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dc62b-8cc8-424e-9bf3-fb596b6f345a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:13.829167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735dc62b-8cc8-424e-9bf3-fb596b6f345a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:13.834271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fccdf-8000-4b2b-881c-3755b4189f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:13.834905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fccdf-8000-4b2b-881c-3755b4189f6f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:13.835179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fccdf-8000-4b2b-881c-3755b4189f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:13.835446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fccdf-8000-4b2b-881c-3755b4189f6f admin admin] PATH_INFO: `/v3/users/ad96c68450db4b7c8c97facc17fd8c89` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:13.836774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fccdf-8000-4b2b-881c-3755b4189f6f admin admin] RBAC: Authorizing `identity:get_user(user_id=ad96c68450db4b7c8c97facc17fd8c89)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:13.838650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fccdf-8000-4b2b-881c-3755b4189f6f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:13.840204 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Aug 30 03:57:13 2022] GET /identity/v3/users/ad96c68450db4b7c8c97facc17fd8c89 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:15.815891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272baa-0bdf-4191-9ae8-4d4519211116 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:15.816484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272baa-0bdf-4191-9ae8-4d4519211116 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:15.816484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272baa-0bdf-4191-9ae8-4d4519211116 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:15.817806 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:57:15.823683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617fa0a-8f75-4aa7-b6ab-3473dd8d404c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:15.824134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617fa0a-8f75-4aa7-b6ab-3473dd8d404c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:15.824327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617fa0a-8f75-4aa7-b6ab-3473dd8d404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:15.843880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b617fa0a-8f75-4aa7-b6ab-3473dd8d404c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:15.845064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b617fa0a-8f75-4aa7-b6ab-3473dd8d404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:15.878924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1197f-0359-4ffa-9564-5a4c02e2e076 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:15.879295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1197f-0359-4ffa-9564-5a4c02e2e076 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:15.879547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1197f-0359-4ffa-9564-5a4c02e2e076 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:15.880886 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:57:15.887882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aaa45-6c55-4d09-b71d-d7bf7429925e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:15.888255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aaa45-6c55-4d09-b71d-d7bf7429925e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:15.888651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aaa45-6c55-4d09-b71d-d7bf7429925e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:15.933090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG passlib.handlers.bcrypt [None req-618aaa45-6c55-4d09-b71d-d7bf7429925e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82098) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 03:57:15.933547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG passlib.handlers.bcrypt [None req-618aaa45-6c55-4d09-b71d-d7bf7429925e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82098) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 03:57:15.939140 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:15.983481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-618aaa45-6c55-4d09-b71d-d7bf7429925e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:15.985115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-618aaa45-6c55-4d09-b71d-d7bf7429925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:16.090342 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:16.351366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617fa0a-8f75-4aa7-b6ab-3473dd8d404c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:16.376527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:16.407166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aaa45-6c55-4d09-b71d-d7bf7429925e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:16.462688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617fa0a-8f75-4aa7-b6ab-3473dd8d404c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:16.499778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1df0ba-6d34-456d-8116-d746a4f0c4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:16.500667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1df0ba-6d34-456d-8116-d746a4f0c4ab None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:16.500939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1df0ba-6d34-456d-8116-d746a4f0c4ab None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:16.501211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1df0ba-6d34-456d-8116-d746a4f0c4ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:16.529603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aaa45-6c55-4d09-b71d-d7bf7429925e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:16.532431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:16.572808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcb6c0-5274-480c-a47b-9c56cfd86359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:16.574449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb6c0-5274-480c-a47b-9c56cfd86359 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:16.574891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb6c0-5274-480c-a47b-9c56cfd86359 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:16.575324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dcb6c0-5274-480c-a47b-9c56cfd86359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:16.577167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1df0ba-6d34-456d-8116-d746a4f0c4ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:16.579689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1df0ba-6d34-456d-8116-d746a4f0c4ab None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:16.594562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dcb6c0-5274-480c-a47b-9c56cfd86359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-74dcb6c0-5274-480c-a47b-9c56cfd86359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:16.609722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:16.610701 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:16.611544 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 8/14] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:57:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:57:16.617358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:16.620829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcb6c0-5274-480c-a47b-9c56cfd86359 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:16.703358 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 7/15] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:16.709439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1df0ba-6d34-456d-8116-d746a4f0c4ab None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:16.731372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dcb6c0-5274-480c-a47b-9c56cfd86359 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:16.772651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bdb6b-7b5a-4a05-b1d4-47448f4c9249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:16.773272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bdb6b-7b5a-4a05-b1d4-47448f4c9249 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:16.773544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bdb6b-7b5a-4a05-b1d4-47448f4c9249 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:16.773812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bdb6b-7b5a-4a05-b1d4-47448f4c9249 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:16.774514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bdb6b-7b5a-4a05-b1d4-47448f4c9249 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:16.774813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bdb6b-7b5a-4a05-b1d4-47448f4c9249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:16.776265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bdb6b-7b5a-4a05-b1d4-47448f4c9249 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:16.789226 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:16.796603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bdb6b-7b5a-4a05-b1d4-47448f4c9249 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:16.816044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1df0ba-6d34-456d-8116-d746a4f0c4ab None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:16.823803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:16.841364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:16.854947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d3a8-5975-4e94-bc80-f4ca96275ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:16.855591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d3a8-5975-4e94-bc80-f4ca96275ac5 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:16.855870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d3a8-5975-4e94-bc80-f4ca96275ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:16.856139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557d3a8-5975-4e94-bc80-f4ca96275ac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:16.867342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557d3a8-5975-4e94-bc80-f4ca96275ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:16.868805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557d3a8-5975-4e94-bc80-f4ca96275ac5 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-1557d3a8-5975-4e94-bc80-f4ca96275ac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:57:16.887179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:16.888257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:57:16.889217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:57:16.889217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:57:16.889217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:16.889217 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 8/17] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:57:16.894119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d3a8-5975-4e94-bc80-f4ca96275ac5 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:16.901462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bdb6b-7b5a-4a05-b1d4-47448f4c9249 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:16.936852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d6253-7c12-4fcb-a13a-62975a465852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:16.937486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6253-7c12-4fcb-a13a-62975a465852 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:16.937784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6253-7c12-4fcb-a13a-62975a465852 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:16.938077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d6253-7c12-4fcb-a13a-62975a465852 None admin] PATH_INFO: `/v3/users/ad96c68450db4b7c8c97facc17fd8c89` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:16.939619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d6253-7c12-4fcb-a13a-62975a465852 None admin] RBAC: Authorizing `identity:get_user(user_id=ad96c68450db4b7c8c97facc17fd8c89)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:16.941075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d6253-7c12-4fcb-a13a-62975a465852 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:16.943026 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:16 2022] GET /identity/v3/users/ad96c68450db4b7c8c97facc17fd8c89 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:16.948601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d6253-7c12-4fcb-a13a-62975a465852 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:17.002016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557d3a8-5975-4e94-bc80-f4ca96275ac5 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:17.043161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752ee24-ea18-4072-aa13-1537e7ca8c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:17.043771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752ee24-ea18-4072-aa13-1537e7ca8c3d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:17.044043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752ee24-ea18-4072-aa13-1537e7ca8c3d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:17.044309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752ee24-ea18-4072-aa13-1537e7ca8c3d None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:17.045063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752ee24-ea18-4072-aa13-1537e7ca8c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:17.045217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752ee24-ea18-4072-aa13-1537e7ca8c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:17.046673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a752ee24-ea18-4072-aa13-1537e7ca8c3d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:17.050467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:17.057544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d6253-7c12-4fcb-a13a-62975a465852 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:17.065798 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:17.092330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddef7b-4fb4-47e7-ac2a-0bae91b47cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:17.093359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddef7b-4fb4-47e7-ac2a-0bae91b47cda None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:17.093627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddef7b-4fb4-47e7-ac2a-0bae91b47cda None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:17.093921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddef7b-4fb4-47e7-ac2a-0bae91b47cda None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:17.095118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddef7b-4fb4-47e7-ac2a-0bae91b47cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:17.096614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddef7b-4fb4-47e7-ac2a-0bae91b47cda None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:17.098411 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:17.104929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752ee24-ea18-4072-aa13-1537e7ca8c3d None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:17.143539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:17.219030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752ee24-ea18-4072-aa13-1537e7ca8c3d None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:17.255646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772e8bc-b6a5-4810-af77-1014418ab46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:17.256269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772e8bc-b6a5-4810-af77-1014418ab46f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:17.256549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772e8bc-b6a5-4810-af77-1014418ab46f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:17.256820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772e8bc-b6a5-4810-af77-1014418ab46f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:17.257560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772e8bc-b6a5-4810-af77-1014418ab46f None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.domain.id=default, user.id=ad96c68450db4b7c8c97facc17fd8c89) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:17.257912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772e8bc-b6a5-4810-af77-1014418ab46f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:17.259391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772e8bc-b6a5-4810-af77-1014418ab46f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:17.266466 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Aug 30 03:57:17 2022] GET /identity/v3/role_assignments?user.id=ad96c68450db4b7c8c97facc17fd8c89&scope.domain.id=default&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:19.317131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d48a81-6d1b-4fe5-bae2-60e1a12e7a8b None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:19.317649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d48a81-6d1b-4fe5-bae2-60e1a12e7a8b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:19.317649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d48a81-6d1b-4fe5-bae2-60e1a12e7a8b None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:19.319117 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:19.324535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f675477-c7f8-44aa-a9f7-b9148b461e03 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:19.324939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f675477-c7f8-44aa-a9f7-b9148b461e03 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:19.325076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f675477-c7f8-44aa-a9f7-b9148b461e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:19.358882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9f675477-c7f8-44aa-a9f7-b9148b461e03 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:19.360351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9f675477-c7f8-44aa-a9f7-b9148b461e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:19.443007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 03:57:19.495659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4759d-5799-406f-bcec-5e3a36664987 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:19.496082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4759d-5799-406f-bcec-5e3a36664987 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:19.496453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4759d-5799-406f-bcec-5e3a36664987 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:19.498172 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:19.503716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4959-9c88-46e8-b653-9fdb4b5eb2cd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:19.504064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4959-9c88-46e8-b653-9fdb4b5eb2cd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:19.504339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4959-9c88-46e8-b653-9fdb4b5eb2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:19.530110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3a0c4959-9c88-46e8-b653-9fdb4b5eb2cd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:19.531319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3a0c4959-9c88-46e8-b653-9fdb4b5eb2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:19.556854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:19.618890 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 12/25] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:19.714431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17980c5b-0fc3-4a22-bf1e-5087d7136d5b None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:19.714702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17980c5b-0fc3-4a22-bf1e-5087d7136d5b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:19.715207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17980c5b-0fc3-4a22-bf1e-5087d7136d5b None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:19.716789 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 14/26] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:19.722506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228c80d-b731-4dd4-a7fa-2d0205d96b09 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:19.723035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228c80d-b731-4dd4-a7fa-2d0205d96b09 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:19.723545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7228c80d-b731-4dd4-a7fa-2d0205d96b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:19.742720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7228c80d-b731-4dd4-a7fa-2d0205d96b09 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:19.744188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7228c80d-b731-4dd4-a7fa-2d0205d96b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:19.815231 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:19.880794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17980c5b-0fc3-4a22-bf1e-5087d7136d5b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:19.985437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17980c5b-0fc3-4a22-bf1e-5087d7136d5b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:20.023629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc71ba7-6133-4b21-8d31-b56f053e675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:20.024622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc71ba7-6133-4b21-8d31-b56f053e675a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:20.025113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc71ba7-6133-4b21-8d31-b56f053e675a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:20.025592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc71ba7-6133-4b21-8d31-b56f053e675a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:20.040749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc71ba7-6133-4b21-8d31-b56f053e675a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-8bc71ba7-6133-4b21-8d31-b56f053e675a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:20.046435 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:20.047371 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:20.048124 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:20.050814 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 15/28] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:57:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:20.056294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228c80d-b731-4dd4-a7fa-2d0205d96b09 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:20.103706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fc7d-55bb-4865-9c48-a9647bedeb8e None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:20.104316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fc7d-55bb-4865-9c48-a9647bedeb8e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:20.104769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240fc7d-55bb-4865-9c48-a9647bedeb8e None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:20.106395 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 16/29] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:57:20.113067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2980b5-a9f2-45f1-81bf-a27ec735452f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:20.113708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2980b5-a9f2-45f1-81bf-a27ec735452f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:20.114434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2980b5-a9f2-45f1-81bf-a27ec735452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:20.133665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ad2980b5-a9f2-45f1-81bf-a27ec735452f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:20.135269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ad2980b5-a9f2-45f1-81bf-a27ec735452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:20.155292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:20.195530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:20.210118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7228c80d-b731-4dd4-a7fa-2d0205d96b09 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:20.226084 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 17/30] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:20.227616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2980b5-a9f2-45f1-81bf-a27ec735452f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:20.269386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d47ae-c7ee-4e9d-b935-2abc52ecc144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:20.270091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d47ae-c7ee-4e9d-b935-2abc52ecc144 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:20.270450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d47ae-c7ee-4e9d-b935-2abc52ecc144 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:20.270723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d47ae-c7ee-4e9d-b935-2abc52ecc144 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:20.271400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d47ae-c7ee-4e9d-b935-2abc52ecc144 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:20.271701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d47ae-c7ee-4e9d-b935-2abc52ecc144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:20.273185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d47ae-c7ee-4e9d-b935-2abc52ecc144 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:20.302096 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 14/31] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:20.302956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d47ae-c7ee-4e9d-b935-2abc52ecc144 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:20.345463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2980b5-a9f2-45f1-81bf-a27ec735452f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:20.386112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1f6c3-c48d-4c3e-a597-a6170b1be366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:20.387322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1f6c3-c48d-4c3e-a597-a6170b1be366 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:20.387792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1f6c3-c48d-4c3e-a597-a6170b1be366 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:20.388262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1f6c3-c48d-4c3e-a597-a6170b1be366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:20.410114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1f6c3-c48d-4c3e-a597-a6170b1be366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:20.412195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c1f6c3-c48d-4c3e-a597-a6170b1be366 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-94c1f6c3-c48d-4c3e-a597-a6170b1be366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:57:20.431170 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:20.432067 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:57:20.432866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:57:20.432866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:57:20.432866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:20.435204 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 18/32] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:20.436309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1f6c3-c48d-4c3e-a597-a6170b1be366 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:20.441312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:20.513823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d47ae-c7ee-4e9d-b935-2abc52ecc144 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:20.548281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1f6c3-c48d-4c3e-a597-a6170b1be366 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:20.550567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5adccf-6a10-4877-b5d9-9775359b20ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:20.551220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5adccf-6a10-4877-b5d9-9775359b20ef None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:20.551635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5adccf-6a10-4877-b5d9-9775359b20ef None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:20.551857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5adccf-6a10-4877-b5d9-9775359b20ef None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:20.552609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5adccf-6a10-4877-b5d9-9775359b20ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:20.554065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5adccf-6a10-4877-b5d9-9775359b20ef None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:20.600482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166986b-25c3-4f51-a8d5-c5a0a3c8c1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:20.601507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166986b-25c3-4f51-a8d5-c5a0a3c8c1f8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:20.602007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166986b-25c3-4f51-a8d5-c5a0a3c8c1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:20.602478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166986b-25c3-4f51-a8d5-c5a0a3c8c1f8 None admin] PATH_INFO: `/v3/users/ad96c68450db4b7c8c97facc17fd8c89` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:20.603883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166986b-25c3-4f51-a8d5-c5a0a3c8c1f8 None admin] RBAC: Authorizing `identity:get_user(user_id=ad96c68450db4b7c8c97facc17fd8c89)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:20.605656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166986b-25c3-4f51-a8d5-c5a0a3c8c1f8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:20.607831 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 19/33] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:20 2022] GET /identity/v3/users/ad96c68450db4b7c8c97facc17fd8c89 => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:20.608842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166986b-25c3-4f51-a8d5-c5a0a3c8c1f8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:20.685775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:20.712717 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 15/34] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Aug 30 03:57:20 2022] POST /identity/v3/roles => generated 219 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:20.714306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5adccf-6a10-4877-b5d9-9775359b20ef None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:20.721198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166986b-25c3-4f51-a8d5-c5a0a3c8c1f8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:20.730925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:20.782507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ce1aa-ab96-4206-8319-47487deefc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:20.783150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ce1aa-ab96-4206-8319-47487deefc53 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:20.783432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ce1aa-ab96-4206-8319-47487deefc53 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:20.783703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ce1aa-ab96-4206-8319-47487deefc53 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:20.784386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ce1aa-ab96-4206-8319-47487deefc53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:20.784761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ce1aa-ab96-4206-8319-47487deefc53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:20.786608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ce1aa-ab96-4206-8319-47487deefc53 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:20.814007 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 20/35] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:20.819051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ce1aa-ab96-4206-8319-47487deefc53 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:20.855546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5adccf-6a10-4877-b5d9-9775359b20ef None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:20.902453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac8a54-0638-41aa-9b2c-49f6f9693d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:20.904384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8a54-0638-41aa-9b2c-49f6f9693d62 None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:20.904665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8a54-0638-41aa-9b2c-49f6f9693d62 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:20.904933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8a54-0638-41aa-9b2c-49f6f9693d62 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:20.905614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac8a54-0638-41aa-9b2c-49f6f9693d62 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:20.907205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac8a54-0638-41aa-9b2c-49f6f9693d62 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:20.932440 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 16/36] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Aug 30 03:57:20 2022] POST /identity/v3/roles => generated 225 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:20.934116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81329023-6044-4cfd-a3f8-bb614afd6cca None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:20.934571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81329023-6044-4cfd-a3f8-bb614afd6cca None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:20.935055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81329023-6044-4cfd-a3f8-bb614afd6cca None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:20.936587 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 17/37] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:20.937573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81329023-6044-4cfd-a3f8-bb614afd6cca None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:20.947590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ce1aa-ab96-4206-8319-47487deefc53 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:20.995008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:21.002328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe220ea-d25b-42fb-8ffe-40cca5465bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:21.002995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe220ea-d25b-42fb-8ffe-40cca5465bf8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:21.003369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe220ea-d25b-42fb-8ffe-40cca5465bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:21.003640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe220ea-d25b-42fb-8ffe-40cca5465bf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:21.004991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe220ea-d25b-42fb-8ffe-40cca5465bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:21.006945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe220ea-d25b-42fb-8ffe-40cca5465bf8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:21.009028 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 21/38] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:21.010514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4e8fb-f6a0-41bd-8f86-cbdc4c9c1115 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:21.010800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4e8fb-f6a0-41bd-8f86-cbdc4c9c1115 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:21.011123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4e8fb-f6a0-41bd-8f86-cbdc4c9c1115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:21.028678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:21.033759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-77b4e8fb-f6a0-41bd-8f86-cbdc4c9c1115 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:21.035023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-77b4e8fb-f6a0-41bd-8f86-cbdc4c9c1115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:21.065545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81329023-6044-4cfd-a3f8-bb614afd6cca None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:21.103404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd97dd-dd3e-4474-91e1-5c25ff3e013f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:21.104032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd97dd-dd3e-4474-91e1-5c25ff3e013f None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:21.104313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd97dd-dd3e-4474-91e1-5c25ff3e013f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:21.104583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd97dd-dd3e-4474-91e1-5c25ff3e013f None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:21.105244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd97dd-dd3e-4474-91e1-5c25ff3e013f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:21.106759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd97dd-dd3e-4474-91e1-5c25ff3e013f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:21.116265 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 22/39] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:21.117189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4e8fb-f6a0-41bd-8f86-cbdc4c9c1115 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:21.142159 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 18/40] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:57:20 2022] POST /identity/v3/projects => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:21.231980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4e8fb-f6a0-41bd-8f86-cbdc4c9c1115 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:21.266037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:21.270758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b899f9-9906-42e2-804a-7a48eb0b3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:21.271595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b899f9-9906-42e2-804a-7a48eb0b3d1c None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:21.271878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b899f9-9906-42e2-804a-7a48eb0b3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:21.272149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b899f9-9906-42e2-804a-7a48eb0b3d1c None admin] PATH_INFO: `/v3/domains/default/users/ad96c68450db4b7c8c97facc17fd8c89/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:21.274226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b899f9-9906-42e2-804a-7a48eb0b3d1c None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ad96c68450db4b7c8c97facc17fd8c89, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:21.275742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b899f9-9906-42e2-804a-7a48eb0b3d1c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:21.331266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c2661-482e-415e-9b40-dbdbc5d4b052 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:21.331883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c2661-482e-415e-9b40-dbdbc5d4b052 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:21.332342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c2661-482e-415e-9b40-dbdbc5d4b052 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:21.334130 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 19/41] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:57:21.339643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57592b61-cccf-4b84-871e-5ef648f15c55 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:21.340165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57592b61-cccf-4b84-871e-5ef648f15c55 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:21.340629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57592b61-cccf-4b84-871e-5ef648f15c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:21.360557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-57592b61-cccf-4b84-871e-5ef648f15c55 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:21.362110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-57592b61-cccf-4b84-871e-5ef648f15c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:21.405891 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 23/42] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Aug 30 03:57:21 2022] PUT /identity/v3/domains/default/users/ad96c68450db4b7c8c97facc17fd8c89/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:57:21.408544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b899f9-9906-42e2-804a-7a48eb0b3d1c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:21.445304 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 20/43] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:21.531420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b899f9-9906-42e2-804a-7a48eb0b3d1c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:21.573722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf355d-b8cc-40c7-9b1f-a56174e44c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:21.574387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf355d-b8cc-40c7-9b1f-a56174e44c5b None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:21.574671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf355d-b8cc-40c7-9b1f-a56174e44c5b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:21.574955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf355d-b8cc-40c7-9b1f-a56174e44c5b None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:21.575636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf355d-b8cc-40c7-9b1f-a56174e44c5b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:21.577252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf355d-b8cc-40c7-9b1f-a56174e44c5b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:21.597909 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 24/44] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Aug 30 03:57:21 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 03:57:21.711131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57592b61-cccf-4b84-871e-5ef648f15c55 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:21.882868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:21.937454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57592b61-cccf-4b84-871e-5ef648f15c55 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:21.973022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9a427-2693-4a28-9967-202ba5a5c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:21.973696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9a427-2693-4a28-9967-202ba5a5c8da None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:21.974005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9a427-2693-4a28-9967-202ba5a5c8da None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:21.974273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9a427-2693-4a28-9967-202ba5a5c8da None admin] PATH_INFO: `/v3/domains/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:21.975442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9a427-2693-4a28-9967-202ba5a5c8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:21.976922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c9a427-2693-4a28-9967-202ba5a5c8da None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:21.978562 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 21/45] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:21.984518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf355d-b8cc-40c7-9b1f-a56174e44c5b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:22.035458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:22.088961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf355d-b8cc-40c7-9b1f-a56174e44c5b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:22.124255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3594a8c-0384-4524-bace-eabcceb8c864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:22.124880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3594a8c-0384-4524-bace-eabcceb8c864 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:22.125161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3594a8c-0384-4524-bace-eabcceb8c864 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:22.125433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3594a8c-0384-4524-bace-eabcceb8c864 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:22.126118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3594a8c-0384-4524-bace-eabcceb8c864 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:22.127591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3594a8c-0384-4524-bace-eabcceb8c864 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:22.157560 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 25/46] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:57:21 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:23.338034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433933-28b6-4004-b6ee-9f39e305f8af None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:23.338580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433933-28b6-4004-b6ee-9f39e305f8af None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:23.338580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433933-28b6-4004-b6ee-9f39e305f8af None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:23.340076 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 22/47] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:23.345589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb47ed-3351-4065-b543-e6e266b5e453 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:23.346015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb47ed-3351-4065-b543-e6e266b5e453 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:23.346285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb47ed-3351-4065-b543-e6e266b5e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:23.366752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d7bb47ed-3351-4065-b543-e6e266b5e453 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:23.368344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d7bb47ed-3351-4065-b543-e6e266b5e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:23.436238 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 26/48] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:23.699186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16433933-28b6-4004-b6ee-9f39e305f8af None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:23.800810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16433933-28b6-4004-b6ee-9f39e305f8af None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:23.820819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:23.837548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c70e9a-3364-4252-a4f2-e2a9888da82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:23.838238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c70e9a-3364-4252-a4f2-e2a9888da82f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:23.838512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c70e9a-3364-4252-a4f2-e2a9888da82f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:23.838780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c70e9a-3364-4252-a4f2-e2a9888da82f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:23.850636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c70e9a-3364-4252-a4f2-e2a9888da82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-f6c70e9a-3364-4252-a4f2-e2a9888da82f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:23.856952 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:23.857970 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:23.858768 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 23/49] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:57:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:23.865378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb47ed-3351-4065-b543-e6e266b5e453 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:23.897658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:23.967824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb47ed-3351-4065-b543-e6e266b5e453 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:24.003802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247d0c-0aea-4322-b6d5-2b6cbb6b9b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:24.004425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247d0c-0aea-4322-b6d5-2b6cbb6b9b13 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:24.004705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247d0c-0aea-4322-b6d5-2b6cbb6b9b13 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:24.005006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247d0c-0aea-4322-b6d5-2b6cbb6b9b13 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:24.005795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247d0c-0aea-4322-b6d5-2b6cbb6b9b13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:24.006126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247d0c-0aea-4322-b6d5-2b6cbb6b9b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:24.007522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247d0c-0aea-4322-b6d5-2b6cbb6b9b13 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:24.015628 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 27/50] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:24.021650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c70e9a-3364-4252-a4f2-e2a9888da82f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:24.030020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842035e-900c-465a-82bf-5a73b07e7137 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:24.030311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842035e-900c-465a-82bf-5a73b07e7137 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:24.030576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842035e-900c-465a-82bf-5a73b07e7137 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:24.031958 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 28/51] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:24.037354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2229cd5-2f70-4ac9-85ca-8e24adcb400a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:24.037644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2229cd5-2f70-4ac9-85ca-8e24adcb400a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:24.037954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2229cd5-2f70-4ac9-85ca-8e24adcb400a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:24.057162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b2229cd5-2f70-4ac9-85ca-8e24adcb400a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:24.058427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b2229cd5-2f70-4ac9-85ca-8e24adcb400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:24.124749 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 29/52] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:24.125276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c70e9a-3364-4252-a4f2-e2a9888da82f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:24.159798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb03af-792a-41d6-a63a-5827166028e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:24.160350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb03af-792a-41d6-a63a-5827166028e7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:24.160624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb03af-792a-41d6-a63a-5827166028e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:24.160888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb03af-792a-41d6-a63a-5827166028e7 None admin] PATH_INFO: `/v3/users/ad96c68450db4b7c8c97facc17fd8c89` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:24.162403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb03af-792a-41d6-a63a-5827166028e7 None admin] RBAC: Authorizing `identity:get_user(user_id=ad96c68450db4b7c8c97facc17fd8c89)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:24.163942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb03af-792a-41d6-a63a-5827166028e7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:24.165551 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 24/53] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:24 2022] GET /identity/v3/users/ad96c68450db4b7c8c97facc17fd8c89 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:24.171232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2229cd5-2f70-4ac9-85ca-8e24adcb400a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:24.196817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:24.276616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2229cd5-2f70-4ac9-85ca-8e24adcb400a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:24.311467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff50564-583f-467c-9756-87e94f46be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:24.312096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff50564-583f-467c-9756-87e94f46be10 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:24.312370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff50564-583f-467c-9756-87e94f46be10 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:24.312635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff50564-583f-467c-9756-87e94f46be10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:24.313786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff50564-583f-467c-9756-87e94f46be10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:24.315261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff50564-583f-467c-9756-87e94f46be10 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:24.317038 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 30/54] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:24.322819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb03af-792a-41d6-a63a-5827166028e7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:24.372734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:24.388505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff50564-583f-467c-9756-87e94f46be10 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:24.424632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb03af-792a-41d6-a63a-5827166028e7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:24.461639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b98ed-bfc8-4b67-8d7b-f5164dd53d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:24.462286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b98ed-bfc8-4b67-8d7b-f5164dd53d3e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:24.462567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b98ed-bfc8-4b67-8d7b-f5164dd53d3e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:24.462832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b98ed-bfc8-4b67-8d7b-f5164dd53d3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:24.463582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b98ed-bfc8-4b67-8d7b-f5164dd53d3e None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.domain.id=default, user.id=ad96c68450db4b7c8c97facc17fd8c89) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:24.463904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b98ed-bfc8-4b67-8d7b-f5164dd53d3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:24.465405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b98ed-bfc8-4b67-8d7b-f5164dd53d3e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:24.472606 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 25/55] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Aug 30 03:57:24 2022] GET /identity/v3/role_assignments?user.id=ad96c68450db4b7c8c97facc17fd8c89&scope.domain.id=default&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:24.606264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:24.617737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff50564-583f-467c-9756-87e94f46be10 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:24.662842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d7036-aeeb-4846-9bea-9e91c5260e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:24.663491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d7036-aeeb-4846-9bea-9e91c5260e3b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:24.663770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d7036-aeeb-4846-9bea-9e91c5260e3b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:24.664039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d7036-aeeb-4846-9bea-9e91c5260e3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:24.665210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d7036-aeeb-4846-9bea-9e91c5260e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:24.666708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d7036-aeeb-4846-9bea-9e91c5260e3b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:24.668290 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 31/56] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:24.674178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b98ed-bfc8-4b67-8d7b-f5164dd53d3e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:24.785535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b98ed-bfc8-4b67-8d7b-f5164dd53d3e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:24.798003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:24.820275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f33949-c423-4cd6-87ff-73ad89dc5cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:24.820878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33949-c423-4cd6-87ff-73ad89dc5cab None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:24.821158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33949-c423-4cd6-87ff-73ad89dc5cab None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:24.821428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f33949-c423-4cd6-87ff-73ad89dc5cab None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:24.822113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f33949-c423-4cd6-87ff-73ad89dc5cab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:24.823587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f33949-c423-4cd6-87ff-73ad89dc5cab None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:24.862048 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 26/57] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Aug 30 03:57:24 2022] POST /identity/v3/projects => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:26.773422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31380ae9-2a7c-47db-9313-2eb17539f5f6 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:26.773990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31380ae9-2a7c-47db-9313-2eb17539f5f6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:26.773990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31380ae9-2a7c-47db-9313-2eb17539f5f6 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:26.775349 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 32/58] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:26.781617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23915a8-3244-4a3a-a164-0ffbf62b75f8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:26.782081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23915a8-3244-4a3a-a164-0ffbf62b75f8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:26.782206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23915a8-3244-4a3a-a164-0ffbf62b75f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:26.804709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a23915a8-3244-4a3a-a164-0ffbf62b75f8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:26.805946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a23915a8-3244-4a3a-a164-0ffbf62b75f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:26.877196 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 27/59] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:27.155464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31380ae9-2a7c-47db-9313-2eb17539f5f6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:27.266409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31380ae9-2a7c-47db-9313-2eb17539f5f6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:27.303490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa175a3-5b49-490c-ba7f-b1ad6077a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:27.304125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa175a3-5b49-490c-ba7f-b1ad6077a171 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:27.304402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa175a3-5b49-490c-ba7f-b1ad6077a171 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:27.304673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa175a3-5b49-490c-ba7f-b1ad6077a171 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:27.305932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa175a3-5b49-490c-ba7f-b1ad6077a171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:27.307408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa175a3-5b49-490c-ba7f-b1ad6077a171 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:27.308981 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 33/60] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:27.318132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23915a8-3244-4a3a-a164-0ffbf62b75f8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:27.423051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:27.432174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23915a8-3244-4a3a-a164-0ffbf62b75f8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:27.475109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85610388-d1fa-49a2-aa50-61ab9be0ebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:27.475714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610388-d1fa-49a2-aa50-61ab9be0ebe5 None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:27.475991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610388-d1fa-49a2-aa50-61ab9be0ebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:27.476256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610388-d1fa-49a2-aa50-61ab9be0ebe5 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:27.476907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85610388-d1fa-49a2-aa50-61ab9be0ebe5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:27.478406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85610388-d1fa-49a2-aa50-61ab9be0ebe5 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:27.506280 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 28/61] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:57:27 2022] POST /identity/v3/users => generated 275 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:30.596156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f3ed-2dbb-459f-8ea7-f33c5d347573 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:30.596678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f3ed-2dbb-459f-8ea7-f33c5d347573 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:30.596678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60f3ed-2dbb-459f-8ea7-f33c5d347573 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:30.598059 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 34/62] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:30.603523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf0ba5-b67e-427f-9352-ba5a79e354b3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:30.603920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf0ba5-b67e-427f-9352-ba5a79e354b3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:30.604100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baf0ba5-b67e-427f-9352-ba5a79e354b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:30.630858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8baf0ba5-b67e-427f-9352-ba5a79e354b3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:30.632107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8baf0ba5-b67e-427f-9352-ba5a79e354b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:30.735907 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 29/63] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:30.908618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce76d8-6960-4449-9cda-afa6282c3c1a None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:30.908815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce76d8-6960-4449-9cda-afa6282c3c1a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:30.909324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce76d8-6960-4449-9cda-afa6282c3c1a None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:30.910908 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 35/64] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:30.916622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e7685-6321-4d57-aca8-d49f8a47c54b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:30.917177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e7685-6321-4d57-aca8-d49f8a47c54b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:30.917639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e7685-6321-4d57-aca8-d49f8a47c54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:30.942916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-865e7685-6321-4d57-aca8-d49f8a47c54b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:30.944507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-865e7685-6321-4d57-aca8-d49f8a47c54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:31.036278 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 30/65] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:31.148240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce76d8-6960-4449-9cda-afa6282c3c1a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:31.184397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:31.246549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b300eb-4000-4615-95e2-b37b56b135ee None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.247180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b300eb-4000-4615-95e2-b37b56b135ee None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.247662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b300eb-4000-4615-95e2-b37b56b135ee None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.249224 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 31/66] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:57:31.254638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff04318-1763-408f-a391-7d9479559677 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.255152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff04318-1763-408f-a391-7d9479559677 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.255615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff04318-1763-408f-a391-7d9479559677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.280505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cff04318-1763-408f-a391-7d9479559677 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:31.280505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cff04318-1763-408f-a391-7d9479559677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:31.282687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce76d8-6960-4449-9cda-afa6282c3c1a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:31.290221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:31.327827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8fee-6faa-4b65-b88e-05cc1407721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:31.328480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8fee-6faa-4b65-b88e-05cc1407721c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.328759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8fee-6faa-4b65-b88e-05cc1407721c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.329033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8fee-6faa-4b65-b88e-05cc1407721c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.347890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a8fee-6faa-4b65-b88e-05cc1407721c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-302a8fee-6faa-4b65-b88e-05cc1407721c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:31.353022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:31.354072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:31.354842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:31.357010 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 36/67] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:57:31.363339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8fee-6faa-4b65-b88e-05cc1407721c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:31.401972 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 32/68] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:31.402676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff04318-1763-408f-a391-7d9479559677 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:31.457736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:31.471617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8fee-6faa-4b65-b88e-05cc1407721c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:31.511123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3d938-b296-47eb-bce4-30cf83c74fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:31.511746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d938-b296-47eb-bce4-30cf83c74fa3 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.512015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d938-b296-47eb-bce4-30cf83c74fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.512283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3d938-b296-47eb-bce4-30cf83c74fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.512949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d938-b296-47eb-bce4-30cf83c74fa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:31.513248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d938-b296-47eb-bce4-30cf83c74fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:31.515132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3d938-b296-47eb-bce4-30cf83c74fa3 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:31.523847 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 37/69] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:31.524800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb142e-3a82-42a3-8fc8-899a5f823070 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.525087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb142e-3a82-42a3-8fc8-899a5f823070 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.525364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb142e-3a82-42a3-8fc8-899a5f823070 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.531256 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 38/70] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:31.531256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49848d50-af66-4422-9be0-e5b3ddda42be None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.531256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49848d50-af66-4422-9be0-e5b3ddda42be None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.531256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49848d50-af66-4422-9be0-e5b3ddda42be None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.531256 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 39/71] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:31.533950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff04318-1763-408f-a391-7d9479559677 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:31.534446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e19eb7-80ae-4e68-aaf8-8830989c33d4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.534734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e19eb7-80ae-4e68-aaf8-8830989c33d4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.535009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e19eb7-80ae-4e68-aaf8-8830989c33d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.553982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f0e19eb7-80ae-4e68-aaf8-8830989c33d4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:31.555183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f0e19eb7-80ae-4e68-aaf8-8830989c33d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:31.571944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1bdb0-91f4-45b5-ad3a-025fa4fd4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:31.572696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1bdb0-91f4-45b5-ad3a-025fa4fd4baf None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.572982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1bdb0-91f4-45b5-ad3a-025fa4fd4baf None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.573250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1bdb0-91f4-45b5-ad3a-025fa4fd4baf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.583760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:31.587943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1bdb0-91f4-45b5-ad3a-025fa4fd4baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-8ea1bdb0-91f4-45b5-ad3a-025fa4fd4baf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:31.595168 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:31.596051 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:31.596800 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 33/72] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:57:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:31.599256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1bdb0-91f4-45b5-ad3a-025fa4fd4baf None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:31.628950 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 40/73] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:31.638405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081f5e7-9e2e-4812-955f-114195427a1f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.638405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081f5e7-9e2e-4812-955f-114195427a1f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.638405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081f5e7-9e2e-4812-955f-114195427a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.659821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f081f5e7-9e2e-4812-955f-114195427a1f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:31.661413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f081f5e7-9e2e-4812-955f-114195427a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:31.718156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1bdb0-91f4-45b5-ad3a-025fa4fd4baf None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:31.732227 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 41/74] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:31.733164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081f5e7-9e2e-4812-955f-114195427a1f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:31.755160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:31.762985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794a81-b0f7-4294-ad53-8a6cf0a736a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:31.763981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794a81-b0f7-4294-ad53-8a6cf0a736a5 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.764578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794a81-b0f7-4294-ad53-8a6cf0a736a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.764929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794a81-b0f7-4294-ad53-8a6cf0a736a5 None admin] PATH_INFO: `/v3/users/cfee50d53ea3488497dcd29cd28b652c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.780771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e794a81-b0f7-4294-ad53-8a6cf0a736a5 None admin] RBAC: Authorizing `identity:get_user(user_id=cfee50d53ea3488497dcd29cd28b652c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:31.782593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e794a81-b0f7-4294-ad53-8a6cf0a736a5 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:31.784530 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 34/75] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:31 2022] GET /identity/v3/users/cfee50d53ea3488497dcd29cd28b652c => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:31.785561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794a81-b0f7-4294-ad53-8a6cf0a736a5 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:31.856820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:31.867262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081f5e7-9e2e-4812-955f-114195427a1f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:31.900819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794a81-b0f7-4294-ad53-8a6cf0a736a5 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:31.903170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0c331-e1d7-449b-9c4b-54ebcc26da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:31.903791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0c331-e1d7-449b-9c4b-54ebcc26da57 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.904068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0c331-e1d7-449b-9c4b-54ebcc26da57 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.904335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0c331-e1d7-449b-9c4b-54ebcc26da57 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.905012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0c331-e1d7-449b-9c4b-54ebcc26da57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:31.905306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0c331-e1d7-449b-9c4b-54ebcc26da57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:31.906723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0c331-e1d7-449b-9c4b-54ebcc26da57 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:31.915242 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 42/76] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:31.916049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0c331-e1d7-449b-9c4b-54ebcc26da57 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:31.943774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebf48f-c578-4866-9b19-12066a923466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:31.945145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebf48f-c578-4866-9b19-12066a923466 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:31.945687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebf48f-c578-4866-9b19-12066a923466 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:31.946156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeebf48f-c578-4866-9b19-12066a923466 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:31.959620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeebf48f-c578-4866-9b19-12066a923466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-aeebf48f-c578-4866-9b19-12066a923466 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:31.964467 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:31.965282 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 35/77] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:31.966425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebf48f-c578-4866-9b19-12066a923466 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.002080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:32.032692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0c331-e1d7-449b-9c4b-54ebcc26da57 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:32.066892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8615b-6d1c-4e35-a40f-d3669e62c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:32.067250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeebf48f-c578-4866-9b19-12066a923466 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:32.067506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8615b-6d1c-4e35-a40f-d3669e62c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:32.067786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8615b-6d1c-4e35-a40f-d3669e62c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:32.068055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8615b-6d1c-4e35-a40f-d3669e62c9e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:32.085627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:32.103402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0434f1-9049-472f-8806-68dff92a2e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:32.104035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0434f1-9049-472f-8806-68dff92a2e76 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:32.104309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0434f1-9049-472f-8806-68dff92a2e76 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:32.104574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0434f1-9049-472f-8806-68dff92a2e76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:32.105697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0434f1-9049-472f-8806-68dff92a2e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:32.107198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0434f1-9049-472f-8806-68dff92a2e76 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:32.108744 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 36/78] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:32.110739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0434f1-9049-472f-8806-68dff92a2e76 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.137273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8615b-6d1c-4e35-a40f-d3669e62c9e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:32.138956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8615b-6d1c-4e35-a40f-d3669e62c9e9 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:32.205037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:32.207531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0434f1-9049-472f-8806-68dff92a2e76 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:32.235528 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 43/79] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:32.236562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8615b-6d1c-4e35-a40f-d3669e62c9e9 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.247383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065472d-89b0-430a-b497-a0971dd64c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:32.248396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065472d-89b0-430a-b497-a0971dd64c2a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:32.248671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065472d-89b0-430a-b497-a0971dd64c2a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:32.248982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065472d-89b0-430a-b497-a0971dd64c2a None admin] PATH_INFO: `/v3/users/ad96c68450db4b7c8c97facc17fd8c89` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:32.250438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065472d-89b0-430a-b497-a0971dd64c2a None admin] RBAC: Authorizing `identity:get_user(user_id=ad96c68450db4b7c8c97facc17fd8c89)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:32.251897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065472d-89b0-430a-b497-a0971dd64c2a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:32.253529 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 37/80] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:32 2022] GET /identity/v3/users/ad96c68450db4b7c8c97facc17fd8c89 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:32.254259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065472d-89b0-430a-b497-a0971dd64c2a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.309475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:32.339698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8615b-6d1c-4e35-a40f-d3669e62c9e9 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:32.355848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065472d-89b0-430a-b497-a0971dd64c2a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:32.374745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72150-8bdb-491f-a41f-c87905c12e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:32.375388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72150-8bdb-491f-a41f-c87905c12e27 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:32.375649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72150-8bdb-491f-a41f-c87905c12e27 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:32.375916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72150-8bdb-491f-a41f-c87905c12e27 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:32.376590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72150-8bdb-491f-a41f-c87905c12e27 None admin] RBAC: Adding query filter params (name=member) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:32.376885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72150-8bdb-491f-a41f-c87905c12e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:32.378322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72150-8bdb-491f-a41f-c87905c12e27 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:32.386660 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 44/81] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:32.387444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72150-8bdb-491f-a41f-c87905c12e27 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.392872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe85b2c-e0d6-475a-a891-cad271e0183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:32.393522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe85b2c-e0d6-475a-a891-cad271e0183e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:32.393806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe85b2c-e0d6-475a-a891-cad271e0183e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:32.394114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe85b2c-e0d6-475a-a891-cad271e0183e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:32.404989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe85b2c-e0d6-475a-a891-cad271e0183e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-abe85b2c-e0d6-475a-a891-cad271e0183e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:32.409888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:32.410898 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 38/82] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:57:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:32.411824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe85b2c-e0d6-475a-a891-cad271e0183e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.424977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:32.489642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72150-8bdb-491f-a41f-c87905c12e27 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:32.510882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe85b2c-e0d6-475a-a891-cad271e0183e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:32.521982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0d372-1ac8-4e1d-932b-c31d6422f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:32.522810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0d372-1ac8-4e1d-932b-c31d6422f989 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:32.523095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0d372-1ac8-4e1d-932b-c31d6422f989 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:32.523368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0d372-1ac8-4e1d-932b-c31d6422f989 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:32.524022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0d372-1ac8-4e1d-932b-c31d6422f989 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:32.524640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:32.525478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0d372-1ac8-4e1d-932b-c31d6422f989 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:32.544881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468f67d-7de5-41fd-800f-f01953c5ea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:32.545496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468f67d-7de5-41fd-800f-f01953c5ea45 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:32.545777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468f67d-7de5-41fd-800f-f01953c5ea45 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:32.546083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468f67d-7de5-41fd-800f-f01953c5ea45 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:32.547241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468f67d-7de5-41fd-800f-f01953c5ea45 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:32.548692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468f67d-7de5-41fd-800f-f01953c5ea45 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:32.550371 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 39/83] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:32 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:32.551132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468f67d-7de5-41fd-800f-f01953c5ea45 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.553207 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 45/84] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:57:32 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:32.554762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0d372-1ac8-4e1d-932b-c31d6422f989 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.681409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468f67d-7de5-41fd-800f-f01953c5ea45 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:32.682295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:32.698064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0d372-1ac8-4e1d-932b-c31d6422f989 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:32.722269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a36f4-211f-4942-b996-6e0fc67930fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:32.723487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a36f4-211f-4942-b996-6e0fc67930fc None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:32.723898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a36f4-211f-4942-b996-6e0fc67930fc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:32.724302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a36f4-211f-4942-b996-6e0fc67930fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:32.744670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23767eb-4755-48a7-bc58-dfa8f7187186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:32.745317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23767eb-4755-48a7-bc58-dfa8f7187186 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:32.745595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23767eb-4755-48a7-bc58-dfa8f7187186 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:32.745865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23767eb-4755-48a7-bc58-dfa8f7187186 None admin] PATH_INFO: `/v3/users/cfee50d53ea3488497dcd29cd28b652c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:32.747054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23767eb-4755-48a7-bc58-dfa8f7187186 None admin] RBAC: Authorizing `identity:get_user(user_id=cfee50d53ea3488497dcd29cd28b652c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:32.748526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23767eb-4755-48a7-bc58-dfa8f7187186 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:32.755775 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 46/85] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:32 2022] GET /identity/v3/users/cfee50d53ea3488497dcd29cd28b652c => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:32.755775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23767eb-4755-48a7-bc58-dfa8f7187186 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.787797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:32.813844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a36f4-211f-4942-b996-6e0fc67930fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:32.815516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a36f4-211f-4942-b996-6e0fc67930fc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:32.881031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23767eb-4755-48a7-bc58-dfa8f7187186 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:32.922486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53897fe5-d05e-4136-bb16-ced325808a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:32.923109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897fe5-d05e-4136-bb16-ced325808a35 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:32.923385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897fe5-d05e-4136-bb16-ced325808a35 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:32.923654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53897fe5-d05e-4136-bb16-ced325808a35 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:32.924859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53897fe5-d05e-4136-bb16-ced325808a35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:32.925162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53897fe5-d05e-4136-bb16-ced325808a35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:32.926862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53897fe5-d05e-4136-bb16-ced325808a35 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:32.937923 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 47/86] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:57:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:32.938781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53897fe5-d05e-4136-bb16-ced325808a35 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.939829 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 40/87] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:32.940955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a36f4-211f-4942-b996-6e0fc67930fc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:32.973357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:33.035362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:33.062681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a36f4-211f-4942-b996-6e0fc67930fc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:33.067341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53897fe5-d05e-4136-bb16-ced325808a35 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:33.105761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeaa05-f93a-4aea-b1d6-0e231b1a0fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:33.106603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeaa05-f93a-4aea-b1d6-0e231b1a0fa9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:33.106976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeaa05-f93a-4aea-b1d6-0e231b1a0fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:33.107255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eeaa05-f93a-4aea-b1d6-0e231b1a0fa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:33.109325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d1b66-8211-43ee-957f-7708828a6400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:33.110038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d1b66-8211-43ee-957f-7708828a6400 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:33.110490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d1b66-8211-43ee-957f-7708828a6400 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:33.110761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d1b66-8211-43ee-957f-7708828a6400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:33.112340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d1b66-8211-43ee-957f-7708828a6400 None admin] RBAC: Adding query filter params (role.id=4d5ba4daa0e84cf89f3bc5854a124660, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2, user.id=cfee50d53ea3488497dcd29cd28b652c) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:33.112650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d1b66-8211-43ee-957f-7708828a6400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:33.114140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d1b66-8211-43ee-957f-7708828a6400 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:33.123668 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 48/88] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:32 2022] GET /identity/v3/role_assignments?user.id=cfee50d53ea3488497dcd29cd28b652c&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:33.124503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d1b66-8211-43ee-957f-7708828a6400 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:33.235644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:33.251404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eeaa05-f93a-4aea-b1d6-0e231b1a0fa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:33.253180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eeaa05-f93a-4aea-b1d6-0e231b1a0fa9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:33.266900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d1b66-8211-43ee-957f-7708828a6400 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:33.318325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b57e1b-aae8-4c8a-bc07-b1f3745d938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:33.318960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57e1b-aae8-4c8a-bc07-b1f3745d938d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:33.319257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57e1b-aae8-4c8a-bc07-b1f3745d938d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:33.319748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b57e1b-aae8-4c8a-bc07-b1f3745d938d None admin] PATH_INFO: `/v3/users/cfee50d53ea3488497dcd29cd28b652c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:33.321326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b57e1b-aae8-4c8a-bc07-b1f3745d938d None admin] RBAC: Authorizing `identity:get_user(user_id=cfee50d53ea3488497dcd29cd28b652c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:33.322849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b57e1b-aae8-4c8a-bc07-b1f3745d938d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:33.324980 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 49/89] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:33 2022] GET /identity/v3/users/cfee50d53ea3488497dcd29cd28b652c => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:33.325757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b57e1b-aae8-4c8a-bc07-b1f3745d938d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:33.395335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:33.434842 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 41/90] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:33.435758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeaa05-f93a-4aea-b1d6-0e231b1a0fa9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:33.484268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b57e1b-aae8-4c8a-bc07-b1f3745d938d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:33.526799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0f9ac-ba74-407f-8f8c-045e11264495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:33.527449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0f9ac-ba74-407f-8f8c-045e11264495 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:33.527733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0f9ac-ba74-407f-8f8c-045e11264495 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:33.528008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0f9ac-ba74-407f-8f8c-045e11264495 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:33.529164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0f9ac-ba74-407f-8f8c-045e11264495 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:33.530669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0f9ac-ba74-407f-8f8c-045e11264495 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:33.532678 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 50/91] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:33 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:33.533532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0f9ac-ba74-407f-8f8c-045e11264495 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:33.538540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eeaa05-f93a-4aea-b1d6-0e231b1a0fa9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:33.555978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:33.584662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63637e-2b66-4009-a759-54173fe713a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:33.585199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63637e-2b66-4009-a759-54173fe713a8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:33.585479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63637e-2b66-4009-a759-54173fe713a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:33.585748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63637e-2b66-4009-a759-54173fe713a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:33.636735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:33.657131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63637e-2b66-4009-a759-54173fe713a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:33.658650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63637e-2b66-4009-a759-54173fe713a8 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:33.703435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0f9ac-ba74-407f-8f8c-045e11264495 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:33.761240 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 42/92] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:33.762132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63637e-2b66-4009-a759-54173fe713a8 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:33.768098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c493d43-b1ab-42c7-a0a9-5c47762b3c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:33.768769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c493d43-b1ab-42c7-a0a9-5c47762b3c28 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:33.769050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c493d43-b1ab-42c7-a0a9-5c47762b3c28 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:33.769325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c493d43-b1ab-42c7-a0a9-5c47762b3c28 None admin] PATH_INFO: `/v3/projects/be11f06df3fc4c1a86acb605a6a14548` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:33.770512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c493d43-b1ab-42c7-a0a9-5c47762b3c28 None admin] RBAC: Authorizing `identity:get_project(project_id=be11f06df3fc4c1a86acb605a6a14548)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:33.772013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c493d43-b1ab-42c7-a0a9-5c47762b3c28 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:33.782310 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 51/93] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:33 2022] GET /identity/v3/projects/be11f06df3fc4c1a86acb605a6a14548 => generated 312 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:33.783382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c493d43-b1ab-42c7-a0a9-5c47762b3c28 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:33.845526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:33.864795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63637e-2b66-4009-a759-54173fe713a8 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:33.894303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:33.905116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25272081-f0c9-4ddc-8878-17ed249ff652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:33.905738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25272081-f0c9-4ddc-8878-17ed249ff652 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:33.906038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25272081-f0c9-4ddc-8878-17ed249ff652 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:33.906304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25272081-f0c9-4ddc-8878-17ed249ff652 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:33.907041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25272081-f0c9-4ddc-8878-17ed249ff652 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2, user.id=ad96c68450db4b7c8c97facc17fd8c89) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:33.907345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25272081-f0c9-4ddc-8878-17ed249ff652 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:33.908823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25272081-f0c9-4ddc-8878-17ed249ff652 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:33.916762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c493d43-b1ab-42c7-a0a9-5c47762b3c28 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:33.921636 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 43/94] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:33 2022] GET /identity/v3/role_assignments?user.id=ad96c68450db4b7c8c97facc17fd8c89&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:33.922288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25272081-f0c9-4ddc-8878-17ed249ff652 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:33.989518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25887c7a-c18f-4d24-9b84-5589f84f52ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:33.990202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25887c7a-c18f-4d24-9b84-5589f84f52ed None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:33.990476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25887c7a-c18f-4d24-9b84-5589f84f52ed None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:33.990742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25887c7a-c18f-4d24-9b84-5589f84f52ed None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:33.992348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25887c7a-c18f-4d24-9b84-5589f84f52ed None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:33.993821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25887c7a-c18f-4d24-9b84-5589f84f52ed None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:33.995781 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 52/95] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:33 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:34.004033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25887c7a-c18f-4d24-9b84-5589f84f52ed None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:34.113928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25272081-f0c9-4ddc-8878-17ed249ff652 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:34.149242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25887c7a-c18f-4d24-9b84-5589f84f52ed None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:34.185713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc128c5-8a2d-4825-8436-95a410858fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:34.186409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc128c5-8a2d-4825-8436-95a410858fb2 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:34.186687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc128c5-8a2d-4825-8436-95a410858fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:34.186955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc128c5-8a2d-4825-8436-95a410858fb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:34.187798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc128c5-8a2d-4825-8436-95a410858fb2 None admin] RBAC: Adding query filter params (role.id=4d5ba4daa0e84cf89f3bc5854a124660, scope.project.id=be11f06df3fc4c1a86acb605a6a14548, user.id=cfee50d53ea3488497dcd29cd28b652c) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:34.188110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc128c5-8a2d-4825-8436-95a410858fb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:34.189682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc128c5-8a2d-4825-8436-95a410858fb2 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:34.200746 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 44/96] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:33 2022] GET /identity/v3/role_assignments?user.id=cfee50d53ea3488497dcd29cd28b652c&scope.project.id=be11f06df3fc4c1a86acb605a6a14548&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:34.210701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87187adb-89ad-4364-9d4f-5f7dbac749ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:34.211351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187adb-89ad-4364-9d4f-5f7dbac749ae None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:34.211628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187adb-89ad-4364-9d4f-5f7dbac749ae None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:34.211896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87187adb-89ad-4364-9d4f-5f7dbac749ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:34.212649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87187adb-89ad-4364-9d4f-5f7dbac749ae None admin] RBAC: Adding query filter params (role.id=c8196760d5404ccf95f4bccb62c5a1a3, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2, user.id=cfee50d53ea3488497dcd29cd28b652c) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:34.212960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87187adb-89ad-4364-9d4f-5f7dbac749ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:34.214496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87187adb-89ad-4364-9d4f-5f7dbac749ae None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:34.221626 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 53/97] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:34 2022] GET /identity/v3/role_assignments?user.id=cfee50d53ea3488497dcd29cd28b652c&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=c8196760d5404ccf95f4bccb62c5a1a3 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:35.142110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619b85-235e-4aa0-8b47-461288368640 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:35.142652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619b85-235e-4aa0-8b47-461288368640 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:35.142652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619b85-235e-4aa0-8b47-461288368640 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:35.144009 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 45/98] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:35.163834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc80342-e90c-4753-bd57-945557760b28 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:35.164340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc80342-e90c-4753-bd57-945557760b28 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:35.164410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc80342-e90c-4753-bd57-945557760b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:35.190888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3fc80342-e90c-4753-bd57-945557760b28 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:35.192090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3fc80342-e90c-4753-bd57-945557760b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:35.213027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:35.281096 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 54/99] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:35.356164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e17b8-622d-42d8-beec-19c36884b409 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:35.356507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e17b8-622d-42d8-beec-19c36884b409 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:35.356723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e17b8-622d-42d8-beec-19c36884b409 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:35.358458 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 46/100] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:35.371613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84e02d-72ad-4f5a-941c-83dc692e5608 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:35.371899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84e02d-72ad-4f5a-941c-83dc692e5608 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:35.372169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84e02d-72ad-4f5a-941c-83dc692e5608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:35.402969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9f84e02d-72ad-4f5a-941c-83dc692e5608 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:35.404085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9f84e02d-72ad-4f5a-941c-83dc692e5608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:35.500201 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 55/101] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:35.535884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddd7b2-9fd5-4c1e-9c47-d1a05c4b64e1 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:35.536184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddd7b2-9fd5-4c1e-9c47-d1a05c4b64e1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:35.536433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddd7b2-9fd5-4c1e-9c47-d1a05c4b64e1 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:35.537932 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 47/102] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:35.543401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce52f8a-d169-4077-b6be-9dca53c98393 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:35.543705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce52f8a-d169-4077-b6be-9dca53c98393 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:35.543967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce52f8a-d169-4077-b6be-9dca53c98393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:35.572530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cce52f8a-d169-4077-b6be-9dca53c98393 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:35.573787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cce52f8a-d169-4077-b6be-9dca53c98393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:35.671707 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 56/103] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 30 03:57:35.737602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddd7b2-9fd5-4c1e-9c47-d1a05c4b64e1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:35.753448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:35.877800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce52f8a-d169-4077-b6be-9dca53c98393 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:35.884265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddd7b2-9fd5-4c1e-9c47-d1a05c4b64e1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:35.902423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:35.923889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ee3ee-2f8f-40a3-96d1-d0eef5ad1898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:35.924872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ee3ee-2f8f-40a3-96d1-d0eef5ad1898 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:35.925280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ee3ee-2f8f-40a3-96d1-d0eef5ad1898 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:35.925565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ee3ee-2f8f-40a3-96d1-d0eef5ad1898 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:35.937417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ee3ee-2f8f-40a3-96d1-d0eef5ad1898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-7d9ee3ee-2f8f-40a3-96d1-d0eef5ad1898 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:35.943345 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:35.945736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:35.947656 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 48/104] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:35.953912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ee3ee-2f8f-40a3-96d1-d0eef5ad1898 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:36.029624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:36.068871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ee3ee-2f8f-40a3-96d1-d0eef5ad1898 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:36.071409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce52f8a-d169-4077-b6be-9dca53c98393 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:36.106402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740317b-376e-4922-9d3e-c10345234733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:36.107024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740317b-376e-4922-9d3e-c10345234733 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:36.107303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740317b-376e-4922-9d3e-c10345234733 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:36.107572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740317b-376e-4922-9d3e-c10345234733 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:36.108244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740317b-376e-4922-9d3e-c10345234733 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:36.108546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740317b-376e-4922-9d3e-c10345234733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:36.109977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740317b-376e-4922-9d3e-c10345234733 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:36.119683 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 49/105] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:36.125583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740317b-376e-4922-9d3e-c10345234733 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:36.149589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08180f15-f765-42b3-9ad6-95325abd3833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:36.150622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180f15-f765-42b3-9ad6-95325abd3833 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:36.151096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180f15-f765-42b3-9ad6-95325abd3833 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:36.151510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180f15-f765-42b3-9ad6-95325abd3833 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:36.153635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08180f15-f765-42b3-9ad6-95325abd3833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:36.155380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08180f15-f765-42b3-9ad6-95325abd3833 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:36.157234 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 57/106] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:36.179863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08180f15-f765-42b3-9ad6-95325abd3833 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:36.240504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740317b-376e-4922-9d3e-c10345234733 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:36.273338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:36.278689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaad113-6e2f-4c38-a965-8faba907e672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:36.279371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad113-6e2f-4c38-a965-8faba907e672 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:36.279601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad113-6e2f-4c38-a965-8faba907e672 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:36.280032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad113-6e2f-4c38-a965-8faba907e672 None admin] PATH_INFO: `/v3/users/1b89e41f004f470d941c5f63d923f2f4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:36.294836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaad113-6e2f-4c38-a965-8faba907e672 None admin] RBAC: Authorizing `identity:get_user(user_id=1b89e41f004f470d941c5f63d923f2f4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:36.296507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaad113-6e2f-4c38-a965-8faba907e672 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:36.298406 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 50/107] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:36 2022] GET /identity/v3/users/1b89e41f004f470d941c5f63d923f2f4 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:36.299336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaad113-6e2f-4c38-a965-8faba907e672 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:36.360598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:36.403962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaad113-6e2f-4c38-a965-8faba907e672 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:36.406140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08180f15-f765-42b3-9ad6-95325abd3833 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:36.438229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8117b8b-f073-4097-81c9-03d98427eaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:36.438792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8117b8b-f073-4097-81c9-03d98427eaa0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:36.439070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8117b8b-f073-4097-81c9-03d98427eaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:36.439342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8117b8b-f073-4097-81c9-03d98427eaa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:36.449787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8117b8b-f073-4097-81c9-03d98427eaa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-d8117b8b-f073-4097-81c9-03d98427eaa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:36.454704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:36.455592 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:36.456423 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 51/108] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:36.457048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8117b8b-f073-4097-81c9-03d98427eaa0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:36.471166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c719d-d131-4be5-9145-f68102ff2699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:36.471804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c719d-d131-4be5-9145-f68102ff2699 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:36.472083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c719d-d131-4be5-9145-f68102ff2699 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:36.472353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c719d-d131-4be5-9145-f68102ff2699 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:36.473027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c719d-d131-4be5-9145-f68102ff2699 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:36.474530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c719d-d131-4be5-9145-f68102ff2699 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:36.530012 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 58/109] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:57:36 2022] POST /identity/v3/projects => generated 302 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 03:57:36.530904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c719d-d131-4be5-9145-f68102ff2699 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:36.569449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:36.676006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8117b8b-f073-4097-81c9-03d98427eaa0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:36.720114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c719d-d131-4be5-9145-f68102ff2699 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:36.754408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:36.763434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c9d9c-6e60-4caf-93ff-c954035c3e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:36.764078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c9d9c-6e60-4caf-93ff-c954035c3e90 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:36.764476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c9d9c-6e60-4caf-93ff-c954035c3e90 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:36.764754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c9d9c-6e60-4caf-93ff-c954035c3e90 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:36.765589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c9d9c-6e60-4caf-93ff-c954035c3e90 None admin] RBAC: Adding query filter params (name=member) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:36.770037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c9d9c-6e60-4caf-93ff-c954035c3e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:36.771929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c9d9c-6e60-4caf-93ff-c954035c3e90 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:36.787537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8e43-f79f-4bdf-9478-162bc9c62380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:36.788316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8e43-f79f-4bdf-9478-162bc9c62380 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:36.788597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8e43-f79f-4bdf-9478-162bc9c62380 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:36.788964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8e43-f79f-4bdf-9478-162bc9c62380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:36.789309 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 59/110] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:36.795337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c9d9c-6e60-4caf-93ff-c954035c3e90 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:36.883498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c8e43-f79f-4bdf-9478-162bc9c62380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:36.885028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c8e43-f79f-4bdf-9478-162bc9c62380 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:36.953005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c9d9c-6e60-4caf-93ff-c954035c3e90 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:36.954280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:36.992684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa95761-811a-4dd0-b5ca-5200b9bfb8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:36.993257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa95761-811a-4dd0-b5ca-5200b9bfb8fb None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:36.993536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa95761-811a-4dd0-b5ca-5200b9bfb8fb None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:36.993806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa95761-811a-4dd0-b5ca-5200b9bfb8fb None admin] PATH_INFO: `/v3/users/cfee50d53ea3488497dcd29cd28b652c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:36.995016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa95761-811a-4dd0-b5ca-5200b9bfb8fb None admin] RBAC: Authorizing `identity:get_user(user_id=cfee50d53ea3488497dcd29cd28b652c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:36.995123 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 52/111] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:36.996369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6c21b-547b-4bb4-82f6-ffeefccc4681 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:36.996651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6c21b-547b-4bb4-82f6-ffeefccc4681 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:36.996751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa95761-811a-4dd0-b5ca-5200b9bfb8fb None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:36.996919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6c21b-547b-4bb4-82f6-ffeefccc4681 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:36.998208 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 53/112] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:36.998313 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 60/113] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:36 2022] GET /identity/v3/users/cfee50d53ea3488497dcd29cd28b652c => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:37.006976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6c21b-547b-4bb4-82f6-ffeefccc4681 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:37.007431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf882-a58a-4c0b-9d96-52f1c12d3fd2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.007720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf882-a58a-4c0b-9d96-52f1c12d3fd2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.008077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faf882-a58a-4c0b-9d96-52f1c12d3fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:37.028567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a4faf882-a58a-4c0b-9d96-52f1c12d3fd2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:37.030170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a4faf882-a58a-4c0b-9d96-52f1c12d3fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:37.095913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:37.107837 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 61/114] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:37.108883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faf882-a58a-4c0b-9d96-52f1c12d3fd2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:37.130596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6c21b-547b-4bb4-82f6-ffeefccc4681 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:37.195192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2edb43-ce40-4166-b15c-00ba47520cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:37.195844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2edb43-ce40-4166-b15c-00ba47520cba None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.196121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2edb43-ce40-4166-b15c-00ba47520cba None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.196391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2edb43-ce40-4166-b15c-00ba47520cba None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:37.202626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2edb43-ce40-4166-b15c-00ba47520cba None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:37.204117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2edb43-ce40-4166-b15c-00ba47520cba None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:37.206233 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 54/115] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:37 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:37.207399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8542f-c349-4467-ac9d-4552f1996ac8 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.207573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8542f-c349-4467-ac9d-4552f1996ac8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.207826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8542f-c349-4467-ac9d-4552f1996ac8 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:37.209192 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 55/116] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:37.211667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faf882-a58a-4c0b-9d96-52f1c12d3fd2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:37.213790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8542f-c349-4467-ac9d-4552f1996ac8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:37.248666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e379f3-0575-447a-91bf-04910ddad105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:37.249234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e379f3-0575-447a-91bf-04910ddad105 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.249513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e379f3-0575-447a-91bf-04910ddad105 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.249781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e379f3-0575-447a-91bf-04910ddad105 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:37.250337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:37.251162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e379f3-0575-447a-91bf-04910ddad105 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:37.252547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e379f3-0575-447a-91bf-04910ddad105 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:37.254437 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 62/117] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:37 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:37.259272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4175311-c0fb-419d-86ab-24436aa111d0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.259555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4175311-c0fb-419d-86ab-24436aa111d0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.259831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4175311-c0fb-419d-86ab-24436aa111d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:37.279725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b4175311-c0fb-419d-86ab-24436aa111d0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:37.280920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b4175311-c0fb-419d-86ab-24436aa111d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:37.335946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:37.350806 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 63/118] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:37.351890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4175311-c0fb-419d-86ab-24436aa111d0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:37.379163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8542f-c349-4467-ac9d-4552f1996ac8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:37.434509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e671f8d-4601-47ca-9c18-609dc426febe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:37.435528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671f8d-4601-47ca-9c18-609dc426febe None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.436126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671f8d-4601-47ca-9c18-609dc426febe None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.436678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e671f8d-4601-47ca-9c18-609dc426febe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:37.437651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e671f8d-4601-47ca-9c18-609dc426febe None admin] RBAC: Adding query filter params (role.id=d2025de3cdb4448182f82d37b6cff368, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2, user.id=1b89e41f004f470d941c5f63d923f2f4) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:37.438210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e671f8d-4601-47ca-9c18-609dc426febe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:37.440035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e671f8d-4601-47ca-9c18-609dc426febe None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:37.451919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4175311-c0fb-419d-86ab-24436aa111d0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:37.452632 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 56/119] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:37 2022] GET /identity/v3/role_assignments?user.id=1b89e41f004f470d941c5f63d923f2f4&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=d2025de3cdb4448182f82d37b6cff368 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:37.454557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622846da-fbe7-4fba-a79f-c761f60b3b6d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.455131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622846da-fbe7-4fba-a79f-c761f60b3b6d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.455611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622846da-fbe7-4fba-a79f-c761f60b3b6d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:37.457537 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 57/120] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:37.466960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622846da-fbe7-4fba-a79f-c761f60b3b6d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:37.490840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840a945-b906-40bd-9213-638bb0b7fd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:37.492055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a945-b906-40bd-9213-638bb0b7fd33 None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.492055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a945-b906-40bd-9213-638bb0b7fd33 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.492236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a945-b906-40bd-9213-638bb0b7fd33 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/users/cfee50d53ea3488497dcd29cd28b652c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:37.497167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840a945-b906-40bd-9213-638bb0b7fd33 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5d4bfa4cff4361bc012412584b0fb2, user_id=cfee50d53ea3488497dcd29cd28b652c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:37.498973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840a945-b906-40bd-9213-638bb0b7fd33 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:37.518992 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 64/121] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:57:37 2022] PUT /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/users/cfee50d53ea3488497dcd29cd28b652c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:57:37.529935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540d54c-10d5-4e05-ab06-5055b7b29109 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.529935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540d54c-10d5-4e05-ab06-5055b7b29109 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.529935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540d54c-10d5-4e05-ab06-5055b7b29109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:37.558782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d540d54c-10d5-4e05-ab06-5055b7b29109 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:37.559237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d540d54c-10d5-4e05-ab06-5055b7b29109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:37.630268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:37.667691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:37.689348 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 65/122] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:37.697904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540d54c-10d5-4e05-ab06-5055b7b29109 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:37.727683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622846da-fbe7-4fba-a79f-c761f60b3b6d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:37.806462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82584e55-3460-46e1-a8e2-f8199c653b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:37.807251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82584e55-3460-46e1-a8e2-f8199c653b57 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.807556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82584e55-3460-46e1-a8e2-f8199c653b57 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.807910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82584e55-3460-46e1-a8e2-f8199c653b57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:37.828651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82584e55-3460-46e1-a8e2-f8199c653b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-82584e55-3460-46e1-a8e2-f8199c653b57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:37.834122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:37.835130 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:37.836818 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 58/123] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:37.841669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82584e55-3460-46e1-a8e2-f8199c653b57 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:37.885102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540d54c-10d5-4e05-ab06-5055b7b29109 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:37.957182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82584e55-3460-46e1-a8e2-f8199c653b57 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:37.995020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db1a29-8759-40be-b989-b41c84e640d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:37.995701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1a29-8759-40be-b989-b41c84e640d8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:37.995985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1a29-8759-40be-b989-b41c84e640d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:37.996262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1a29-8759-40be-b989-b41c84e640d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:38.000627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4981d9-d7db-4056-9fac-57ce2186c9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:38.001251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4981d9-d7db-4056-9fac-57ce2186c9b1 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:38.001527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4981d9-d7db-4056-9fac-57ce2186c9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:38.001802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4981d9-d7db-4056-9fac-57ce2186c9b1 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:38.002514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4981d9-d7db-4056-9fac-57ce2186c9b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:38.003199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4981d9-d7db-4056-9fac-57ce2186c9b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:38.004648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4981d9-d7db-4056-9fac-57ce2186c9b1 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:38.014894 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 59/124] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:38.021125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4981d9-d7db-4056-9fac-57ce2186c9b1 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:38.026068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:38.030629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db1a29-8759-40be-b989-b41c84e640d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-49db1a29-8759-40be-b989-b41c84e640d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:38.035774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:38.036679 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:38.037866 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 66/125] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:57:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:38.046986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db1a29-8759-40be-b989-b41c84e640d8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:38.137992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4981d9-d7db-4056-9fac-57ce2186c9b1 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:38.174904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c0e29-3561-44a9-8aa0-3f78af9ac19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:38.175550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0e29-3561-44a9-8aa0-3f78af9ac19e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:38.175826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0e29-3561-44a9-8aa0-3f78af9ac19e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:38.176095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c0e29-3561-44a9-8aa0-3f78af9ac19e None admin] PATH_INFO: `/v3/users/cfee50d53ea3488497dcd29cd28b652c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:38.177230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c0e29-3561-44a9-8aa0-3f78af9ac19e None admin] RBAC: Authorizing `identity:get_user(user_id=cfee50d53ea3488497dcd29cd28b652c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:38.178901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c0e29-3561-44a9-8aa0-3f78af9ac19e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:38.180700 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 60/126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:38 2022] GET /identity/v3/users/cfee50d53ea3488497dcd29cd28b652c => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:38.181498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c0e29-3561-44a9-8aa0-3f78af9ac19e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:38.199060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:38.262287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:38.297908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c0e29-3561-44a9-8aa0-3f78af9ac19e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:38.326953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db1a29-8759-40be-b989-b41c84e640d8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:38.339562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3641f6c-8629-4d7b-adc6-d8698580e0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:38.340509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3641f6c-8629-4d7b-adc6-d8698580e0df None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:38.340792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3641f6c-8629-4d7b-adc6-d8698580e0df None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:38.341062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3641f6c-8629-4d7b-adc6-d8698580e0df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:38.355059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3641f6c-8629-4d7b-adc6-d8698580e0df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-c3641f6c-8629-4d7b-adc6-d8698580e0df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:38.362778 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:38.363724 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 61/127] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:57:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:38.368554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3641f6c-8629-4d7b-adc6-d8698580e0df None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:38.383618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe572934-5c6c-49d5-9f76-361c9b6cca39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:38.384700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe572934-5c6c-49d5-9f76-361c9b6cca39 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:38.385196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe572934-5c6c-49d5-9f76-361c9b6cca39 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:38.385679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe572934-5c6c-49d5-9f76-361c9b6cca39 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:38.386608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe572934-5c6c-49d5-9f76-361c9b6cca39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:38.387099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe572934-5c6c-49d5-9f76-361c9b6cca39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:38.390005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe572934-5c6c-49d5-9f76-361c9b6cca39 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:38.410928 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 67/128] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:38.414298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe572934-5c6c-49d5-9f76-361c9b6cca39 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:38.538340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3641f6c-8629-4d7b-adc6-d8698580e0df None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:38.569962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:38.579160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc3f5-c6ce-4d34-ab15-724b0930f426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:38.581895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc3f5-c6ce-4d34-ab15-724b0930f426 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:38.582574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc3f5-c6ce-4d34-ab15-724b0930f426 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:38.583203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cc3f5-c6ce-4d34-ab15-724b0930f426 None admin] PATH_INFO: `/v3/projects/be11f06df3fc4c1a86acb605a6a14548` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:38.586098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cc3f5-c6ce-4d34-ab15-724b0930f426 None admin] RBAC: Authorizing `identity:get_project(project_id=be11f06df3fc4c1a86acb605a6a14548)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:38.588852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cc3f5-c6ce-4d34-ab15-724b0930f426 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:38.594216 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 62/129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:38 2022] GET /identity/v3/projects/be11f06df3fc4c1a86acb605a6a14548 => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:38.597291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc3f5-c6ce-4d34-ab15-724b0930f426 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:38.621505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:38.626061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe572934-5c6c-49d5-9f76-361c9b6cca39 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:38.726763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531b60c-4b78-4d26-aaf2-77bee11998c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:38.727323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531b60c-4b78-4d26-aaf2-77bee11998c0 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:38.727605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531b60c-4b78-4d26-aaf2-77bee11998c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:38.727874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531b60c-4b78-4d26-aaf2-77bee11998c0 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:38.728554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531b60c-4b78-4d26-aaf2-77bee11998c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:38.728856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531b60c-4b78-4d26-aaf2-77bee11998c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:38.730307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531b60c-4b78-4d26-aaf2-77bee11998c0 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:38.744377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cc3f5-c6ce-4d34-ab15-724b0930f426 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:38.748992 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 68/130] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:57:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:38.753732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531b60c-4b78-4d26-aaf2-77bee11998c0 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:38.786951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48297d8-34a0-4f2d-b9ac-3fbd0da86d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:38.788090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48297d8-34a0-4f2d-b9ac-3fbd0da86d89 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:38.788878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48297d8-34a0-4f2d-b9ac-3fbd0da86d89 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:38.789429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48297d8-34a0-4f2d-b9ac-3fbd0da86d89 None admin] PATH_INFO: `/v3/users/ad96c68450db4b7c8c97facc17fd8c89` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:38.790849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48297d8-34a0-4f2d-b9ac-3fbd0da86d89 None admin] RBAC: Authorizing `identity:get_user(user_id=ad96c68450db4b7c8c97facc17fd8c89)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:38.792535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48297d8-34a0-4f2d-b9ac-3fbd0da86d89 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:38.794902 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 63/131] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:38 2022] GET /identity/v3/users/ad96c68450db4b7c8c97facc17fd8c89 => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:38.796071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48297d8-34a0-4f2d-b9ac-3fbd0da86d89 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:38.871195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:38.914112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48297d8-34a0-4f2d-b9ac-3fbd0da86d89 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:38.954133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163fe64-db3e-44ab-9443-d7580c1b3fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:38.955237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163fe64-db3e-44ab-9443-d7580c1b3fcd None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:38.955817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163fe64-db3e-44ab-9443-d7580c1b3fcd None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:38.956296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163fe64-db3e-44ab-9443-d7580c1b3fcd None admin] PATH_INFO: `/v3/users/cfee50d53ea3488497dcd29cd28b652c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:38.957967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163fe64-db3e-44ab-9443-d7580c1b3fcd None admin] RBAC: Authorizing `identity:get_user(user_id=cfee50d53ea3488497dcd29cd28b652c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:38.959867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163fe64-db3e-44ab-9443-d7580c1b3fcd None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:38.962602 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 64/132] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:38 2022] GET /identity/v3/users/cfee50d53ea3488497dcd29cd28b652c => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:38.963830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163fe64-db3e-44ab-9443-d7580c1b3fcd None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:39.003952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531b60c-4b78-4d26-aaf2-77bee11998c0 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:39.079638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917325e-4deb-4745-9a0e-d74c57373797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:39.080565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917325e-4deb-4745-9a0e-d74c57373797 None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:39.080892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917325e-4deb-4745-9a0e-d74c57373797 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:39.081159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917325e-4deb-4745-9a0e-d74c57373797 None admin] PATH_INFO: `/v3/projects/be11f06df3fc4c1a86acb605a6a14548/users/cfee50d53ea3488497dcd29cd28b652c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:39.085516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163fe64-db3e-44ab-9443-d7580c1b3fcd None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:39.087166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917325e-4deb-4745-9a0e-d74c57373797 None admin] RBAC: Authorizing `identity:create_grant(project_id=be11f06df3fc4c1a86acb605a6a14548, user_id=cfee50d53ea3488497dcd29cd28b652c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:39.089307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917325e-4deb-4745-9a0e-d74c57373797 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:39.120339 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 69/133] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:57:38 2022] PUT /identity/v3/projects/be11f06df3fc4c1a86acb605a6a14548/users/cfee50d53ea3488497dcd29cd28b652c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:57:39.121213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917325e-4deb-4745-9a0e-d74c57373797 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:39.126640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10ad5e-06ef-4216-9dec-0d909d078694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:39.127672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10ad5e-06ef-4216-9dec-0d909d078694 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:39.128190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10ad5e-06ef-4216-9dec-0d909d078694 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:39.128654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c10ad5e-06ef-4216-9dec-0d909d078694 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:39.130173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10ad5e-06ef-4216-9dec-0d909d078694 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:39.132224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c10ad5e-06ef-4216-9dec-0d909d078694 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:39.134249 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 65/134] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:38 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:39.140923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10ad5e-06ef-4216-9dec-0d909d078694 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:39.168769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:39.174183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:39.268029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c10ad5e-06ef-4216-9dec-0d909d078694 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:39.306804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb99b6-ed9a-4fc8-8839-f4cf9a7763dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:39.307847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb99b6-ed9a-4fc8-8839-f4cf9a7763dc None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:39.308342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb99b6-ed9a-4fc8-8839-f4cf9a7763dc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:39.308834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb99b6-ed9a-4fc8-8839-f4cf9a7763dc None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/users/ad96c68450db4b7c8c97facc17fd8c89/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:39.311275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb99b6-ed9a-4fc8-8839-f4cf9a7763dc None admin] RBAC: Authorizing `identity:create_grant(project_id=db5d4bfa4cff4361bc012412584b0fb2, user_id=ad96c68450db4b7c8c97facc17fd8c89, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:39.312933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb99b6-ed9a-4fc8-8839-f4cf9a7763dc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:39.320992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917325e-4deb-4745-9a0e-d74c57373797 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:39.329970 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 66/135] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:57:39 2022] PUT /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/users/ad96c68450db4b7c8c97facc17fd8c89/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 03:57:39.366705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f667782-1d87-4c62-a327-dc1b3633cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:39.367654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f667782-1d87-4c62-a327-dc1b3633cf60 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:39.367934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f667782-1d87-4c62-a327-dc1b3633cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:39.368201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f667782-1d87-4c62-a327-dc1b3633cf60 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:39.369375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f667782-1d87-4c62-a327-dc1b3633cf60 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:39.371275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f667782-1d87-4c62-a327-dc1b3633cf60 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:39.373036 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 70/136] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:39 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:39.379378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb99b6-ed9a-4fc8-8839-f4cf9a7763dc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:39.472673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:39.519324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb99b6-ed9a-4fc8-8839-f4cf9a7763dc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:39.557844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968d15f-a5cc-4a2d-a480-8fa1bcdb98df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:39.558570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968d15f-a5cc-4a2d-a480-8fa1bcdb98df None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:39.558851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968d15f-a5cc-4a2d-a480-8fa1bcdb98df None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:39.559129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968d15f-a5cc-4a2d-a480-8fa1bcdb98df None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/users/cfee50d53ea3488497dcd29cd28b652c/roles/c8196760d5404ccf95f4bccb62c5a1a3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:39.561768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968d15f-a5cc-4a2d-a480-8fa1bcdb98df None admin] RBAC: Authorizing `identity:create_grant(project_id=db5d4bfa4cff4361bc012412584b0fb2, user_id=cfee50d53ea3488497dcd29cd28b652c, role_id=c8196760d5404ccf95f4bccb62c5a1a3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:39.563325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2968d15f-a5cc-4a2d-a480-8fa1bcdb98df None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:39.581488 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 67/137] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:57:39 2022] PUT /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/users/cfee50d53ea3488497dcd29cd28b652c/roles/c8196760d5404ccf95f4bccb62c5a1a3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:57:39.684695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570056a-c25a-4029-8050-379a6a742982 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:39.685012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570056a-c25a-4029-8050-379a6a742982 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:39.685324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570056a-c25a-4029-8050-379a6a742982 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:39.686931 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 71/138] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:39.692981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3b9b0-aeac-4f02-9003-00edc8a16fce None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:39.693271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3b9b0-aeac-4f02-9003-00edc8a16fce None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:39.693593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3b9b0-aeac-4f02-9003-00edc8a16fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:39.722696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8fe3b9b0-aeac-4f02-9003-00edc8a16fce None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:39.724624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8fe3b9b0-aeac-4f02-9003-00edc8a16fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:39.811804 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 68/139] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:39.979555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5d050-e3c2-47a5-8d2e-706e1af16dc7 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:39.979924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5d050-e3c2-47a5-8d2e-706e1af16dc7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:39.980114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5d050-e3c2-47a5-8d2e-706e1af16dc7 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:39.981450 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 72/140] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:39.986931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d5f9d-cba4-4adb-ad98-aab0a4e1bb95 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:39.987222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d5f9d-cba4-4adb-ad98-aab0a4e1bb95 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:39.987496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d5f9d-cba4-4adb-ad98-aab0a4e1bb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:40.014989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9c0d5f9d-cba4-4adb-ad98-aab0a4e1bb95 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:40.017435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c0d5f9d-cba4-4adb-ad98-aab0a4e1bb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:40.017678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a458cea-a5b1-488f-b67c-20d9a6f5d4a8 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:40.017980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a458cea-a5b1-488f-b67c-20d9a6f5d4a8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:40.018252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a458cea-a5b1-488f-b67c-20d9a6f5d4a8 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:40.019612 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 73/141] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:57:40.025012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96fdbe-c038-40ea-9521-f6d50d08656a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:40.025559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96fdbe-c038-40ea-9521-f6d50d08656a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:40.026048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96fdbe-c038-40ea-9521-f6d50d08656a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:40.059438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2d96fdbe-c038-40ea-9521-f6d50d08656a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:40.061411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2d96fdbe-c038-40ea-9521-f6d50d08656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:40.107761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:40.148421 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 69/142] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:40.200218 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 74/143] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:40.244174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d5f9d-cba4-4adb-ad98-aab0a4e1bb95 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:40.359220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d5f9d-cba4-4adb-ad98-aab0a4e1bb95 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:40.405454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02425ee-f7e2-4707-bf13-1650508df57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:40.406521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02425ee-f7e2-4707-bf13-1650508df57f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:40.407004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02425ee-f7e2-4707-bf13-1650508df57f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:40.407471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02425ee-f7e2-4707-bf13-1650508df57f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:40.414980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02425ee-f7e2-4707-bf13-1650508df57f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:40.416774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02425ee-f7e2-4707-bf13-1650508df57f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:40.418660 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 70/144] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:40.426979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96fdbe-c038-40ea-9521-f6d50d08656a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:40.469086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:40.570022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96fdbe-c038-40ea-9521-f6d50d08656a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:40.608517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0d3e2-bd24-4b5d-875e-20af15b6b646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:40.609136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d3e2-bd24-4b5d-875e-20af15b6b646 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:40.609466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d3e2-bd24-4b5d-875e-20af15b6b646 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:40.609677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d3e2-bd24-4b5d-875e-20af15b6b646 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:40.610358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0d3e2-bd24-4b5d-875e-20af15b6b646 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:40.611811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0d3e2-bd24-4b5d-875e-20af15b6b646 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:40.640806 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 75/145] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:57:40 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:40.699080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02425ee-f7e2-4707-bf13-1650508df57f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:40.709960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0d3e2-bd24-4b5d-875e-20af15b6b646 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:40.779697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:40.796914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:40.823850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0d3e2-bd24-4b5d-875e-20af15b6b646 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:40.863621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb768-2603-497e-93f7-4dffbdf348c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:40.864611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb768-2603-497e-93f7-4dffbdf348c1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:40.865068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb768-2603-497e-93f7-4dffbdf348c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:40.865576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbb768-2603-497e-93f7-4dffbdf348c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:40.878337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbb768-2603-497e-93f7-4dffbdf348c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-67dbb768-2603-497e-93f7-4dffbdf348c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:40.885249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:40.886265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:57:40.887080 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:40.889765 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 76/146] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:40.895374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb768-2603-497e-93f7-4dffbdf348c1 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:40.912363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02425ee-f7e2-4707-bf13-1650508df57f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:40.963359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fdaac-bb49-4719-af38-cab234674d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:40.964005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fdaac-bb49-4719-af38-cab234674d7a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:40.964278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fdaac-bb49-4719-af38-cab234674d7a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:40.964541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fdaac-bb49-4719-af38-cab234674d7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:40.982721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fdaac-bb49-4719-af38-cab234674d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-ac7fdaac-bb49-4719-af38-cab234674d7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:40.990336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:40.991208 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:40.992036 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 71/147] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:40.998497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fdaac-bb49-4719-af38-cab234674d7a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:41.066695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbb768-2603-497e-93f7-4dffbdf348c1 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:41.110866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244ab79-1896-4748-b726-719dab9e9c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:41.111871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244ab79-1896-4748-b726-719dab9e9c7a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:41.112348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244ab79-1896-4748-b726-719dab9e9c7a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:41.112813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244ab79-1896-4748-b726-719dab9e9c7a None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:41.113744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244ab79-1896-4748-b726-719dab9e9c7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:41.114435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244ab79-1896-4748-b726-719dab9e9c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:41.116396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244ab79-1896-4748-b726-719dab9e9c7a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:41.127643 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 77/148] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:41.127959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:41.133228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244ab79-1896-4748-b726-719dab9e9c7a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:41.228228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fdaac-bb49-4719-af38-cab234674d7a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:41.248454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244ab79-1896-4748-b726-719dab9e9c7a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:41.263995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:41.290102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5e7a-8072-41ae-8d67-1455d795c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:41.291369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5e7a-8072-41ae-8d67-1455d795c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:41.291846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5e7a-8072-41ae-8d67-1455d795c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:41.292499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5e7a-8072-41ae-8d67-1455d795c8e8 None admin] PATH_INFO: `/v3/users/1b89e41f004f470d941c5f63d923f2f4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:41.294121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e5e7a-8072-41ae-8d67-1455d795c8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=1b89e41f004f470d941c5f63d923f2f4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:41.295773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e5e7a-8072-41ae-8d67-1455d795c8e8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:41.297984 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 78/149] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:41 2022] GET /identity/v3/users/1b89e41f004f470d941c5f63d923f2f4 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:41.304173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5e7a-8072-41ae-8d67-1455d795c8e8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:41.323481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db928e73-c4d0-44e2-bd80-4d7070c5c92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:41.325415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db928e73-c4d0-44e2-bd80-4d7070c5c92d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:41.327620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db928e73-c4d0-44e2-bd80-4d7070c5c92d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:41.328107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db928e73-c4d0-44e2-bd80-4d7070c5c92d None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:41.328993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db928e73-c4d0-44e2-bd80-4d7070c5c92d None admin] RBAC: Adding query filter params (name=member) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:41.330028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db928e73-c4d0-44e2-bd80-4d7070c5c92d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:41.333813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db928e73-c4d0-44e2-bd80-4d7070c5c92d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:41.352771 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 72/150] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:41.358933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db928e73-c4d0-44e2-bd80-4d7070c5c92d None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:41.413088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:41.463275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5e7a-8072-41ae-8d67-1455d795c8e8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:41.504870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9572f7-c841-4063-8ec4-3b3f9c84fe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:41.506067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9572f7-c841-4063-8ec4-3b3f9c84fe10 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:41.506559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9572f7-c841-4063-8ec4-3b3f9c84fe10 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:41.507035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9572f7-c841-4063-8ec4-3b3f9c84fe10 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:41.508945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9572f7-c841-4063-8ec4-3b3f9c84fe10 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:41.510736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9572f7-c841-4063-8ec4-3b3f9c84fe10 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:41.512771 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 79/151] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:41 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:41.518684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9572f7-c841-4063-8ec4-3b3f9c84fe10 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:41.645697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9572f7-c841-4063-8ec4-3b3f9c84fe10 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:41.672123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db928e73-c4d0-44e2-bd80-4d7070c5c92d None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:41.692588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0186e13-c558-4083-ab44-c027aea91450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:41.693622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0186e13-c558-4083-ab44-c027aea91450 None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:41.694153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0186e13-c558-4083-ab44-c027aea91450 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:41.694664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0186e13-c558-4083-ab44-c027aea91450 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/users/1b89e41f004f470d941c5f63d923f2f4/roles/d2025de3cdb4448182f82d37b6cff368` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:41.697431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0186e13-c558-4083-ab44-c027aea91450 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5d4bfa4cff4361bc012412584b0fb2, user_id=1b89e41f004f470d941c5f63d923f2f4, role_id=d2025de3cdb4448182f82d37b6cff368)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:41.699657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0186e13-c558-4083-ab44-c027aea91450 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:41.704497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:41.717392 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 80/152] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:57:41 2022] PUT /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/users/1b89e41f004f470d941c5f63d923f2f4/roles/d2025de3cdb4448182f82d37b6cff368 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:57:41.774783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1ea68-1cd5-4429-b56c-e0b2ee546b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:41.775473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ea68-1cd5-4429-b56c-e0b2ee546b15 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:41.775758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ea68-1cd5-4429-b56c-e0b2ee546b15 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:41.776038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1ea68-1cd5-4429-b56c-e0b2ee546b15 None admin] PATH_INFO: `/v3/users/cfee50d53ea3488497dcd29cd28b652c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:41.777427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1ea68-1cd5-4429-b56c-e0b2ee546b15 None admin] RBAC: Authorizing `identity:get_user(user_id=cfee50d53ea3488497dcd29cd28b652c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:41.779101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1ea68-1cd5-4429-b56c-e0b2ee546b15 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:41.781946 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 73/153] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:41 2022] GET /identity/v3/users/cfee50d53ea3488497dcd29cd28b652c => generated 275 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:41.788223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0186e13-c558-4083-ab44-c027aea91450 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:41.936957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0186e13-c558-4083-ab44-c027aea91450 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:41.978358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bfde4-b3de-4db4-94cc-365c67dcec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:41.979377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bfde4-b3de-4db4-94cc-365c67dcec8e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:41.979841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bfde4-b3de-4db4-94cc-365c67dcec8e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:41.980305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bfde4-b3de-4db4-94cc-365c67dcec8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:42.055883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:42.067694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bfde4-b3de-4db4-94cc-365c67dcec8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:42.069490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bfde4-b3de-4db4-94cc-365c67dcec8e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:42.120318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a2b34-4332-4800-8f29-a2279ca7c10f None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:42.120650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a2b34-4332-4800-8f29-a2279ca7c10f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:42.120868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6a2b34-4332-4800-8f29-a2279ca7c10f None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:42.122286 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 74/154] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:42.132855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe73bd-cc36-4c11-8191-b60c231bc5ad None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:42.133123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe73bd-cc36-4c11-8191-b60c231bc5ad None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:42.133422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe73bd-cc36-4c11-8191-b60c231bc5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:42.174103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a1fe73bd-cc36-4c11-8191-b60c231bc5ad None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:42.175377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a1fe73bd-cc36-4c11-8191-b60c231bc5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:42.207031 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 81/155] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:42.208238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a56cae-0b9b-44af-b3c2-55cc710909c4 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:42.208544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a56cae-0b9b-44af-b3c2-55cc710909c4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:42.208766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a56cae-0b9b-44af-b3c2-55cc710909c4 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:42.210044 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 82/156] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:42.214482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a56cae-0b9b-44af-b3c2-55cc710909c4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:42.257119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:42.311328 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 75/157] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:42.312735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7217e47-11f4-45fe-8fcd-2d960e5ef0bd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:42.313042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7217e47-11f4-45fe-8fcd-2d960e5ef0bd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:42.313316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7217e47-11f4-45fe-8fcd-2d960e5ef0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:42.338350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:42.343257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a56cae-0b9b-44af-b3c2-55cc710909c4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:42.354949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e7217e47-11f4-45fe-8fcd-2d960e5ef0bd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:42.356184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e7217e47-11f4-45fe-8fcd-2d960e5ef0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:42.391303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e229-ff2b-4455-84b6-27c70f426bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:42.391953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e229-ff2b-4455-84b6-27c70f426bd9 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:42.392221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e229-ff2b-4455-84b6-27c70f426bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:42.392482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e229-ff2b-4455-84b6-27c70f426bd9 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:42.394417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3e229-ff2b-4455-84b6-27c70f426bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:42.395872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3e229-ff2b-4455-84b6-27c70f426bd9 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:42.400799 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 83/158] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:42 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:42.406965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e229-ff2b-4455-84b6-27c70f426bd9 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:42.499335 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 76/159] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:42.539428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e229-ff2b-4455-84b6-27c70f426bd9 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:42.582589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764576f-552b-43c8-9643-926de8daa617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:42.583217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764576f-552b-43c8-9643-926de8daa617 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:42.583491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764576f-552b-43c8-9643-926de8daa617 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:42.583817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764576f-552b-43c8-9643-926de8daa617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:42.584552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764576f-552b-43c8-9643-926de8daa617 None admin] RBAC: Adding query filter params (role.id=4d5ba4daa0e84cf89f3bc5854a124660, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2, user.id=cfee50d53ea3488497dcd29cd28b652c) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:42.584897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764576f-552b-43c8-9643-926de8daa617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:42.586545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764576f-552b-43c8-9643-926de8daa617 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:42.593147 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 84/160] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:42 2022] GET /identity/v3/role_assignments?user.id=cfee50d53ea3488497dcd29cd28b652c&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:42.731563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d0b8e-4cdb-4692-8cf7-cf6c95cbd5ff None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:42.732532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d0b8e-4cdb-4692-8cf7-cf6c95cbd5ff None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:42.732995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d0b8e-4cdb-4692-8cf7-cf6c95cbd5ff None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:42.734582 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 77/161] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:42.740237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a11ae-f991-4411-9e7e-d3fe6ea42eaf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:42.740631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a11ae-f991-4411-9e7e-d3fe6ea42eaf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:42.740800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a11ae-f991-4411-9e7e-d3fe6ea42eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:42.763120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cd0a11ae-f991-4411-9e7e-d3fe6ea42eaf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:42.764300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cd0a11ae-f991-4411-9e7e-d3fe6ea42eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:42.774224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d0b8e-4cdb-4692-8cf7-cf6c95cbd5ff None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:42.796942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:42.881007 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 85/162] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:42.948353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d0b8e-4cdb-4692-8cf7-cf6c95cbd5ff None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:42.950187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:42.966894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a11ae-f991-4411-9e7e-d3fe6ea42eaf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:43.001528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425a951-b924-4d4c-af70-e09c667eaa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:43.002199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425a951-b924-4d4c-af70-e09c667eaa5f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:43.002453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425a951-b924-4d4c-af70-e09c667eaa5f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:43.002717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425a951-b924-4d4c-af70-e09c667eaa5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:43.022656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425a951-b924-4d4c-af70-e09c667eaa5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-7425a951-b924-4d4c-af70-e09c667eaa5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:43.028493 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:43.029366 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:43.030280 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 78/163] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:57:43.050441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425a951-b924-4d4c-af70-e09c667eaa5f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:43.117379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a11ae-f991-4411-9e7e-d3fe6ea42eaf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:43.174538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadca81-2046-40c6-9444-dc912540dda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:43.175725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadca81-2046-40c6-9444-dc912540dda6 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:43.176205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadca81-2046-40c6-9444-dc912540dda6 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:43.176671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cadca81-2046-40c6-9444-dc912540dda6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:43.191495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cadca81-2046-40c6-9444-dc912540dda6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:43.195956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425a951-b924-4d4c-af70-e09c667eaa5f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-0cadca81-2046-40c6-9444-dc912540dda6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:43.197638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:43.198530 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:43.199291 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:43.210355 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 86/164] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:57:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:43.211829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadca81-2046-40c6-9444-dc912540dda6 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:43.246737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:43.247750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c8e8-b492-47a4-bb62-6f3a254166f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:43.254737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c8e8-b492-47a4-bb62-6f3a254166f0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:43.255079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c8e8-b492-47a4-bb62-6f3a254166f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:43.255289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c8e8-b492-47a4-bb62-6f3a254166f0 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:43.256000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c8e8-b492-47a4-bb62-6f3a254166f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:43.256303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c8e8-b492-47a4-bb62-6f3a254166f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:43.258607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c8e8-b492-47a4-bb62-6f3a254166f0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:43.267961 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 79/165] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:43.279000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c8e8-b492-47a4-bb62-6f3a254166f0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:43.326605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:43.352845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cadca81-2046-40c6-9444-dc912540dda6 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:43.402267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda9236-85cc-44a3-93f9-2a8c6c523aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:43.403011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda9236-85cc-44a3-93f9-2a8c6c523aea None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:43.403281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda9236-85cc-44a3-93f9-2a8c6c523aea None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:43.403565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda9236-85cc-44a3-93f9-2a8c6c523aea None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:43.404217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda9236-85cc-44a3-93f9-2a8c6c523aea None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:43.404537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda9236-85cc-44a3-93f9-2a8c6c523aea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:43.406062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda9236-85cc-44a3-93f9-2a8c6c523aea None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:43.415155 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 87/166] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:43.420610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda9236-85cc-44a3-93f9-2a8c6c523aea None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:43.461104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c8e8-b492-47a4-bb62-6f3a254166f0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:43.531649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e0c0e-b6a5-4cd9-a7b1-b7d575b1df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:43.532211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e0c0e-b6a5-4cd9-a7b1-b7d575b1df7e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:43.532484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e0c0e-b6a5-4cd9-a7b1-b7d575b1df7e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:43.532751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e0c0e-b6a5-4cd9-a7b1-b7d575b1df7e None admin] PATH_INFO: `/v3/users/cfee50d53ea3488497dcd29cd28b652c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:43.537518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:43.537715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e0c0e-b6a5-4cd9-a7b1-b7d575b1df7e None admin] RBAC: Authorizing `identity:get_user(user_id=cfee50d53ea3488497dcd29cd28b652c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:43.539518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e0c0e-b6a5-4cd9-a7b1-b7d575b1df7e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:43.542213 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 80/167] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:43 2022] GET /identity/v3/users/cfee50d53ea3488497dcd29cd28b652c => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:43.543080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e0c0e-b6a5-4cd9-a7b1-b7d575b1df7e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:43.575194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda9236-85cc-44a3-93f9-2a8c6c523aea None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:43.628047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23947d-569c-4181-a362-4c4d9ac5eeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:43.628702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23947d-569c-4181-a362-4c4d9ac5eeea None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:43.628976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23947d-569c-4181-a362-4c4d9ac5eeea None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:43.629241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23947d-569c-4181-a362-4c4d9ac5eeea None admin] PATH_INFO: `/v3/users/ad96c68450db4b7c8c97facc17fd8c89` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:43.631367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23947d-569c-4181-a362-4c4d9ac5eeea None admin] RBAC: Authorizing `identity:get_user(user_id=ad96c68450db4b7c8c97facc17fd8c89)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:43.633364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23947d-569c-4181-a362-4c4d9ac5eeea None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:43.640067 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 88/168] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:43 2022] GET /identity/v3/users/ad96c68450db4b7c8c97facc17fd8c89 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:43.640935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23947d-569c-4181-a362-4c4d9ac5eeea None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:43.716358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:43.733749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e0c0e-b6a5-4cd9-a7b1-b7d575b1df7e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:43.807207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab2180-7a65-4484-80a0-c2f7e45a7bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:43.807870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab2180-7a65-4484-80a0-c2f7e45a7bd7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:43.808152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab2180-7a65-4484-80a0-c2f7e45a7bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:43.808425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab2180-7a65-4484-80a0-c2f7e45a7bd7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:43.813774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23947d-569c-4181-a362-4c4d9ac5eeea None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:43.864340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab2180-7a65-4484-80a0-c2f7e45a7bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:43.868959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773881-8bed-43cd-b1df-d7bd1db96b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:43.869589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773881-8bed-43cd-b1df-d7bd1db96b3a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:43.869855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773881-8bed-43cd-b1df-d7bd1db96b3a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:43.870142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773881-8bed-43cd-b1df-d7bd1db96b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-a7ab2180-7a65-4484-80a0-c2f7e45a7bd7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:43.882852 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:43.883870 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:43.884675 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:43.887625 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 81/169] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:57:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:43.892358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab2180-7a65-4484-80a0-c2f7e45a7bd7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:43.915678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:44.021352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8773881-8bed-43cd-b1df-d7bd1db96b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:44.022897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8773881-8bed-43cd-b1df-d7bd1db96b3a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:44.132272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab2180-7a65-4484-80a0-c2f7e45a7bd7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:44.186605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b085ec-5e33-4b7f-b4f8-71236fdd60aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:44.187236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b085ec-5e33-4b7f-b4f8-71236fdd60aa None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:44.187513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b085ec-5e33-4b7f-b4f8-71236fdd60aa None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:44.187784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b085ec-5e33-4b7f-b4f8-71236fdd60aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:44.230261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:44.295747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b085ec-5e33-4b7f-b4f8-71236fdd60aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:44.295747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b085ec-5e33-4b7f-b4f8-71236fdd60aa None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:44.309087 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 89/170] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:44.310009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773881-8bed-43cd-b1df-d7bd1db96b3a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:44.463290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:44.504932 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 82/171] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:44.505611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b085ec-5e33-4b7f-b4f8-71236fdd60aa None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:44.592263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773881-8bed-43cd-b1df-d7bd1db96b3a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:44.596943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:44.633748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0645ca-fb1b-4b55-9ac9-e0512d3b5ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:44.634769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0645ca-fb1b-4b55-9ac9-e0512d3b5ce2 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:44.635257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0645ca-fb1b-4b55-9ac9-e0512d3b5ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:44.635719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0645ca-fb1b-4b55-9ac9-e0512d3b5ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:44.636591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0645ca-fb1b-4b55-9ac9-e0512d3b5ce2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:44.637095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0645ca-fb1b-4b55-9ac9-e0512d3b5ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:44.638717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0645ca-fb1b-4b55-9ac9-e0512d3b5ce2 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:44.648823 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 90/172] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:57:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:44.650395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0645ca-fb1b-4b55-9ac9-e0512d3b5ce2 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:44.703358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b085ec-5e33-4b7f-b4f8-71236fdd60aa None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:44.774024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0645ca-fb1b-4b55-9ac9-e0512d3b5ce2 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:44.779639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c6f19-9ba1-427c-8769-8cfdba086bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:44.780297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c6f19-9ba1-427c-8769-8cfdba086bb5 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:44.780565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c6f19-9ba1-427c-8769-8cfdba086bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:44.780825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c6f19-9ba1-427c-8769-8cfdba086bb5 None admin] PATH_INFO: `/v3/projects/be11f06df3fc4c1a86acb605a6a14548` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:44.785365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:44.786584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c6f19-9ba1-427c-8769-8cfdba086bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=be11f06df3fc4c1a86acb605a6a14548)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:44.788172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c6f19-9ba1-427c-8769-8cfdba086bb5 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:44.789821 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 83/173] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:44 2022] GET /identity/v3/projects/be11f06df3fc4c1a86acb605a6a14548 => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:44.791038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6321-4884-4c74-b62b-8a0c84fb597b None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:44.791316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6321-4884-4c74-b62b-8a0c84fb597b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:44.791586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6321-4884-4c74-b62b-8a0c84fb597b None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:44.793070 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 84/174] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:44.793855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb6321-4884-4c74-b62b-8a0c84fb597b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:44.817169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b7f15-aaaf-4e6c-9d5d-8846cdb7b4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:44.818238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b7f15-aaaf-4e6c-9d5d-8846cdb7b4bd None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:44.818711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b7f15-aaaf-4e6c-9d5d-8846cdb7b4bd None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:44.819203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b7f15-aaaf-4e6c-9d5d-8846cdb7b4bd None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:44.820689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b7f15-aaaf-4e6c-9d5d-8846cdb7b4bd None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:44.822535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b7f15-aaaf-4e6c-9d5d-8846cdb7b4bd None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:44.824407 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 91/175] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:44 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:44.825865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4fcd6-5434-478e-af1d-65ff3de345f5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:44.826375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4fcd6-5434-478e-af1d-65ff3de345f5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:44.826845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4fcd6-5434-478e-af1d-65ff3de345f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:44.846529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f8c4fcd6-5434-478e-af1d-65ff3de345f5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:44.848049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f8c4fcd6-5434-478e-af1d-65ff3de345f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:44.920387 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 92/176] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:44.921844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4fcd6-5434-478e-af1d-65ff3de345f5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:45.034392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4fcd6-5434-478e-af1d-65ff3de345f5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:45.043214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:45.074706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96e716-a8e4-4447-9bc7-14744b1dca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:45.075717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96e716-a8e4-4447-9bc7-14744b1dca7d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.076190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96e716-a8e4-4447-9bc7-14744b1dca7d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.076649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96e716-a8e4-4447-9bc7-14744b1dca7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.077590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96e716-a8e4-4447-9bc7-14744b1dca7d None admin] RBAC: Adding query filter params (role.id=4d5ba4daa0e84cf89f3bc5854a124660, scope.project.id=be11f06df3fc4c1a86acb605a6a14548, user.id=cfee50d53ea3488497dcd29cd28b652c) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:45.078153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96e716-a8e4-4447-9bc7-14744b1dca7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:45.079907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96e716-a8e4-4447-9bc7-14744b1dca7d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:45.086827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 93/177] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:44 2022] GET /identity/v3/role_assignments?user.id=cfee50d53ea3488497dcd29cd28b652c&scope.project.id=be11f06df3fc4c1a86acb605a6a14548&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:45.087961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96e716-a8e4-4447-9bc7-14744b1dca7d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:45.088094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb6321-4884-4c74-b62b-8a0c84fb597b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:45.119988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:45.148320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b06d03-893d-4c16-bafc-7bd9f6976397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:45.148824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06d03-893d-4c16-bafc-7bd9f6976397 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.149032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06d03-893d-4c16-bafc-7bd9f6976397 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.149275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06d03-893d-4c16-bafc-7bd9f6976397 None admin] PATH_INFO: `/v3/users/cfee50d53ea3488497dcd29cd28b652c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.154632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b06d03-893d-4c16-bafc-7bd9f6976397 None admin] RBAC: Authorizing `identity:get_user(user_id=cfee50d53ea3488497dcd29cd28b652c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:45.156127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b06d03-893d-4c16-bafc-7bd9f6976397 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:45.158143 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 85/178] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:44 2022] GET /identity/v3/users/cfee50d53ea3488497dcd29cd28b652c => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:45.163967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b06d03-893d-4c16-bafc-7bd9f6976397 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:45.206427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96e716-a8e4-4447-9bc7-14744b1dca7d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:45.259115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf002a8-9fa9-404f-bfe3-aa26c7019be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:45.260103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf002a8-9fa9-404f-bfe3-aa26c7019be8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.260611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf002a8-9fa9-404f-bfe3-aa26c7019be8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.261143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf002a8-9fa9-404f-bfe3-aa26c7019be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.262115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf002a8-9fa9-404f-bfe3-aa26c7019be8 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2, user.id=ad96c68450db4b7c8c97facc17fd8c89) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:45.262616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf002a8-9fa9-404f-bfe3-aa26c7019be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:45.264271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf002a8-9fa9-404f-bfe3-aa26c7019be8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:45.277141 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 94/179] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:45 2022] GET /identity/v3/role_assignments?user.id=ad96c68450db4b7c8c97facc17fd8c89&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:45.318376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b06d03-893d-4c16-bafc-7bd9f6976397 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:45.376065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd09f02-a87c-4a82-baab-7246a1750d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:45.376704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09f02-a87c-4a82-baab-7246a1750d40 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.376981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09f02-a87c-4a82-baab-7246a1750d40 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.377248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09f02-a87c-4a82-baab-7246a1750d40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.438275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807882-5abb-4318-a9c4-efe39a3fd5a3 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.438897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807882-5abb-4318-a9c4-efe39a3fd5a3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.439363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b807882-5abb-4318-a9c4-efe39a3fd5a3 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.445039 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 95/180] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:57:45.454548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4959505-7ac9-4435-8a98-fcfee9dd03db None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.455211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4959505-7ac9-4435-8a98-fcfee9dd03db None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.455689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4959505-7ac9-4435-8a98-fcfee9dd03db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.472957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:45.488162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f4959505-7ac9-4435-8a98-fcfee9dd03db None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:45.489751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f4959505-7ac9-4435-8a98-fcfee9dd03db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:45.494531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd09f02-a87c-4a82-baab-7246a1750d40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:45.496109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd09f02-a87c-4a82-baab-7246a1750d40 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:45.536350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:45.602696 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 96/181] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:45.603481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4959505-7ac9-4435-8a98-fcfee9dd03db None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:45.626300 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 86/182] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 03:57:45.633488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd09f02-a87c-4a82-baab-7246a1750d40 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:45.731141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:45.736828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4959505-7ac9-4435-8a98-fcfee9dd03db None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:45.746477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd09f02-a87c-4a82-baab-7246a1750d40 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:45.778954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7c447-d81d-4d62-ad1e-e546983ec8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:45.779828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c447-d81d-4d62-ad1e-e546983ec8c1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.780243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c447-d81d-4d62-ad1e-e546983ec8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.780822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7c447-d81d-4d62-ad1e-e546983ec8c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.781896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e8fbb-9f54-4a16-b98b-c56d6315a001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:45.782525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e8fbb-9f54-4a16-b98b-c56d6315a001 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.782800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e8fbb-9f54-4a16-b98b-c56d6315a001 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.783067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e8fbb-9f54-4a16-b98b-c56d6315a001 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.784182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e8fbb-9f54-4a16-b98b-c56d6315a001 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:45.785659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e8fbb-9f54-4a16-b98b-c56d6315a001 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:45.787319 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 87/183] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:45 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:45.793164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7c447-d81d-4d62-ad1e-e546983ec8c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:45.793398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eef5d-e0a9-490a-9b0a-73101ada8dc1 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.793682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eef5d-e0a9-490a-9b0a-73101ada8dc1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.793972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eef5d-e0a9-490a-9b0a-73101ada8dc1 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.795349 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 88/184] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:45.796196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1ade9-0623-4566-9ebb-41a77861504e None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.796471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1ade9-0623-4566-9ebb-41a77861504e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.796738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1ade9-0623-4566-9ebb-41a77861504e None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.801813 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 89/185] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:45.801813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1ade9-0623-4566-9ebb-41a77861504e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-acd7c447-d81d-4d62-ad1e-e546983ec8c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:45.804310 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:45.805215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:45.806058 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 97/186] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:57:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:45.807210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3566-f9d8-44f7-8d6c-175f7b4d9573 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.807490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3566-f9d8-44f7-8d6c-175f7b4d9573 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.807763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b3566-f9d8-44f7-8d6c-175f7b4d9573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.830138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3b2b3566-f9d8-44f7-8d6c-175f7b4d9573 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:45.831336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3b2b3566-f9d8-44f7-8d6c-175f7b4d9573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:45.850188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:45.905699 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 98/187] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:45.906912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61acd3d-7df9-4964-8167-fadd495fa868 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.907196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61acd3d-7df9-4964-8167-fadd495fa868 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.907466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61acd3d-7df9-4964-8167-fadd495fa868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.915294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1ade9-0623-4566-9ebb-41a77861504e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:45.927043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d61acd3d-7df9-4964-8167-fadd495fa868 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:45.928273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d61acd3d-7df9-4964-8167-fadd495fa868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:45.950093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316609d7-0407-4c68-b4c5-e121e505b878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:45.950705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316609d7-0407-4c68-b4c5-e121e505b878 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:45.950948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316609d7-0407-4c68-b4c5-e121e505b878 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:45.951239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316609d7-0407-4c68-b4c5-e121e505b878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:45.951966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316609d7-0407-4c68-b4c5-e121e505b878 None admin] RBAC: Adding query filter params (role.id=c8196760d5404ccf95f4bccb62c5a1a3, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2, user.id=cfee50d53ea3488497dcd29cd28b652c) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:45.952263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316609d7-0407-4c68-b4c5-e121e505b878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:45.953718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316609d7-0407-4c68-b4c5-e121e505b878 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:45.967228 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 90/188] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:45 2022] GET /identity/v3/role_assignments?user.id=cfee50d53ea3488497dcd29cd28b652c&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=c8196760d5404ccf95f4bccb62c5a1a3 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:45.967228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316609d7-0407-4c68-b4c5-e121e505b878 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:45.998736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:46.020727 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 99/189] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:46.021948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61acd3d-7df9-4964-8167-fadd495fa868 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:46.152488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316609d7-0407-4c68-b4c5-e121e505b878 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:46.183448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:46.201318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61acd3d-7df9-4964-8167-fadd495fa868 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:46.202597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab874b-c51a-4d84-b24c-0fed132e921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:46.203222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab874b-c51a-4d84-b24c-0fed132e921c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:46.203496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab874b-c51a-4d84-b24c-0fed132e921c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:46.203766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab874b-c51a-4d84-b24c-0fed132e921c None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:46.204442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab874b-c51a-4d84-b24c-0fed132e921c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:46.204742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab874b-c51a-4d84-b24c-0fed132e921c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:46.206165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab874b-c51a-4d84-b24c-0fed132e921c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:46.216954 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 91/190] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:46.222880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab874b-c51a-4d84-b24c-0fed132e921c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:46.239154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed37e98-e586-4bf0-be41-20c2096cb2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:46.239793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed37e98-e586-4bf0-be41-20c2096cb2c6 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:46.240064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed37e98-e586-4bf0-be41-20c2096cb2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:46.240329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed37e98-e586-4bf0-be41-20c2096cb2c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:46.252851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed37e98-e586-4bf0-be41-20c2096cb2c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-3ed37e98-e586-4bf0-be41-20c2096cb2c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:46.257854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:46.258761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:46.259571 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 100/191] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:46.260215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed37e98-e586-4bf0-be41-20c2096cb2c6 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:46.320011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:46.343049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab874b-c51a-4d84-b24c-0fed132e921c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:46.375564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed37e98-e586-4bf0-be41-20c2096cb2c6 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:46.377000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102f3d2-cf26-4a3c-a8c7-f81c5f3e9582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:46.377558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f3d2-cf26-4a3c-a8c7-f81c5f3e9582 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:46.377840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f3d2-cf26-4a3c-a8c7-f81c5f3e9582 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:46.378163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102f3d2-cf26-4a3c-a8c7-f81c5f3e9582 None admin] PATH_INFO: `/v3/users/114d4ef1c482491699d91a1a4823ea7e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:46.398482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102f3d2-cf26-4a3c-a8c7-f81c5f3e9582 None admin] RBAC: Authorizing `identity:get_user(user_id=114d4ef1c482491699d91a1a4823ea7e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:46.399974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102f3d2-cf26-4a3c-a8c7-f81c5f3e9582 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:46.401926 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 92/192] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:46 2022] GET /identity/v3/users/114d4ef1c482491699d91a1a4823ea7e => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:46.402520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102f3d2-cf26-4a3c-a8c7-f81c5f3e9582 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:46.410034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79067fcd-1aed-4fbd-927b-384f575776c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:46.410678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79067fcd-1aed-4fbd-927b-384f575776c4 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:46.410951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79067fcd-1aed-4fbd-927b-384f575776c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:46.411217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79067fcd-1aed-4fbd-927b-384f575776c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:46.412327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79067fcd-1aed-4fbd-927b-384f575776c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:46.413772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79067fcd-1aed-4fbd-927b-384f575776c4 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:46.415588 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 101/193] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:46.416341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79067fcd-1aed-4fbd-927b-384f575776c4 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:46.430627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:46.501642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102f3d2-cf26-4a3c-a8c7-f81c5f3e9582 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:46.516756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79067fcd-1aed-4fbd-927b-384f575776c4 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:46.537290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ea4ea-3641-4e18-972d-849ba679bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:46.537932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ea4ea-3641-4e18-972d-849ba679bd75 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:46.538208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ea4ea-3641-4e18-972d-849ba679bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:46.538479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ea4ea-3641-4e18-972d-849ba679bd75 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:46.539383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ea4ea-3641-4e18-972d-849ba679bd75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:46.539689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ea4ea-3641-4e18-972d-849ba679bd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:46.542799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ea4ea-3641-4e18-972d-849ba679bd75 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:46.550354 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 93/194] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:46.551150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ea4ea-3641-4e18-972d-849ba679bd75 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:46.555534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:46.556068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b57da-a5ff-41e1-898e-cd94eebc9cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:46.557118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b57da-a5ff-41e1-898e-cd94eebc9cbe None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:46.557118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b57da-a5ff-41e1-898e-cd94eebc9cbe None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:46.557310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b57da-a5ff-41e1-898e-cd94eebc9cbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:46.568415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b57da-a5ff-41e1-898e-cd94eebc9cbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-941b57da-a5ff-41e1-898e-cd94eebc9cbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:46.573409 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:46.574377 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:46.575164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 102/195] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:57:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:46.575801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b57da-a5ff-41e1-898e-cd94eebc9cbe None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:46.651635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:46.659139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ea4ea-3641-4e18-972d-849ba679bd75 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:46.681629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b57da-a5ff-41e1-898e-cd94eebc9cbe None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:46.694147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994e247-bf18-4b98-91ef-f8ef6d9b0e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:46.694757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994e247-bf18-4b98-91ef-f8ef6d9b0e6e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:46.695030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994e247-bf18-4b98-91ef-f8ef6d9b0e6e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:46.695329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994e247-bf18-4b98-91ef-f8ef6d9b0e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:46.715124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d92039-fa63-4b28-8ce0-4fe57473ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:46.715722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d92039-fa63-4b28-8ce0-4fe57473ba9b None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:46.715993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d92039-fa63-4b28-8ce0-4fe57473ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:46.716257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d92039-fa63-4b28-8ce0-4fe57473ba9b None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:46.716902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d92039-fa63-4b28-8ce0-4fe57473ba9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:46.718396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d92039-fa63-4b28-8ce0-4fe57473ba9b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:46.739850 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 103/196] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:57:46 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:46.740663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d92039-fa63-4b28-8ce0-4fe57473ba9b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:46.778735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994e247-bf18-4b98-91ef-f8ef6d9b0e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:46.780171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994e247-bf18-4b98-91ef-f8ef6d9b0e6e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:46.782496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:46.861332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d92039-fa63-4b28-8ce0-4fe57473ba9b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:46.893422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:46.898709 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 94/197] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:46.903006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994e247-bf18-4b98-91ef-f8ef6d9b0e6e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:46.906550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819d295-987a-4267-aa67-3027f4a77470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:46.907919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819d295-987a-4267-aa67-3027f4a77470 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:46.907919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819d295-987a-4267-aa67-3027f4a77470 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:46.908974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819d295-987a-4267-aa67-3027f4a77470 None admin] PATH_INFO: `/v3/users/1b89e41f004f470d941c5f63d923f2f4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:46.911155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819d295-987a-4267-aa67-3027f4a77470 None admin] RBAC: Authorizing `identity:get_user(user_id=1b89e41f004f470d941c5f63d923f2f4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:46.912620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b819d295-987a-4267-aa67-3027f4a77470 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:46.916142 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 104/198] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:46 2022] GET /identity/v3/users/1b89e41f004f470d941c5f63d923f2f4 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:46.917914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819d295-987a-4267-aa67-3027f4a77470 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:47.033861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994e247-bf18-4b98-91ef-f8ef6d9b0e6e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:47.036582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:47.055961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819d295-987a-4267-aa67-3027f4a77470 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:47.079906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445f597-a2ad-4912-a146-7cff4ca5bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:47.080526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445f597-a2ad-4912-a146-7cff4ca5bf5a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:47.080803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445f597-a2ad-4912-a146-7cff4ca5bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:47.081068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445f597-a2ad-4912-a146-7cff4ca5bf5a None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:47.081749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445f597-a2ad-4912-a146-7cff4ca5bf5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:47.082083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445f597-a2ad-4912-a146-7cff4ca5bf5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:47.083473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445f597-a2ad-4912-a146-7cff4ca5bf5a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:47.093991 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 95/199] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:57:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:47.094836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445f597-a2ad-4912-a146-7cff4ca5bf5a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:47.096647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcec047-eec9-40ef-8d0c-2d50b1caa732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:47.097293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcec047-eec9-40ef-8d0c-2d50b1caa732 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:47.097568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcec047-eec9-40ef-8d0c-2d50b1caa732 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:47.097975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcec047-eec9-40ef-8d0c-2d50b1caa732 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:47.099197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcec047-eec9-40ef-8d0c-2d50b1caa732 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:47.100646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcec047-eec9-40ef-8d0c-2d50b1caa732 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:47.103065 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 105/200] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:46 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:47.103255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcec047-eec9-40ef-8d0c-2d50b1caa732 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:47.188243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:47.217070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445f597-a2ad-4912-a146-7cff4ca5bf5a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:47.242794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcec047-eec9-40ef-8d0c-2d50b1caa732 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:47.252682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3601b-3571-4908-a51d-78fddeb241a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:47.253300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3601b-3571-4908-a51d-78fddeb241a9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:47.253575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3601b-3571-4908-a51d-78fddeb241a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:47.253842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3601b-3571-4908-a51d-78fddeb241a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:47.284750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759e574-b590-4122-b990-fa434d22b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:47.285367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759e574-b590-4122-b990-fa434d22b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:47.285691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759e574-b590-4122-b990-fa434d22b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:47.285987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0759e574-b590-4122-b990-fa434d22b1b0 None admin] PATH_INFO: `/v3/users/114d4ef1c482491699d91a1a4823ea7e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:47.287132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759e574-b590-4122-b990-fa434d22b1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=114d4ef1c482491699d91a1a4823ea7e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:47.288577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0759e574-b590-4122-b990-fa434d22b1b0 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:47.288988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:47.290719 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 106/201] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:47 2022] GET /identity/v3/users/114d4ef1c482491699d91a1a4823ea7e => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:47.291617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759e574-b590-4122-b990-fa434d22b1b0 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:47.338153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3601b-3571-4908-a51d-78fddeb241a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:47.340551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3601b-3571-4908-a51d-78fddeb241a9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:47.402187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0759e574-b590-4122-b990-fa434d22b1b0 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:47.438802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:47.445378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd0f10-7cf7-41d5-9d91-3bb7d055c0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:47.447127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd0f10-7cf7-41d5-9d91-3bb7d055c0f1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:47.447743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd0f10-7cf7-41d5-9d91-3bb7d055c0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:47.448870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd0f10-7cf7-41d5-9d91-3bb7d055c0f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:47.450670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd0f10-7cf7-41d5-9d91-3bb7d055c0f1 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22, user.id=114d4ef1c482491699d91a1a4823ea7e) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:47.451482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd0f10-7cf7-41d5-9d91-3bb7d055c0f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:47.455314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd0f10-7cf7-41d5-9d91-3bb7d055c0f1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:47.463208 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 107/202] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:47 2022] GET /identity/v3/role_assignments?user.id=114d4ef1c482491699d91a1a4823ea7e&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:47.464305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd0f10-7cf7-41d5-9d91-3bb7d055c0f1 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:47.491727 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 96/203] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:47.501564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3601b-3571-4908-a51d-78fddeb241a9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:47.617057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd0f10-7cf7-41d5-9d91-3bb7d055c0f1 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:47.659585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c493e-4299-462e-a94b-af1600943733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:47.660882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c493e-4299-462e-a94b-af1600943733 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:47.661296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c493e-4299-462e-a94b-af1600943733 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:47.661698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c493e-4299-462e-a94b-af1600943733 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:47.735173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:47.738370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:47.746665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c493e-4299-462e-a94b-af1600943733 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:47.749172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c493e-4299-462e-a94b-af1600943733 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:47.844020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3601b-3571-4908-a51d-78fddeb241a9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:47.873015 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 108/204] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:47.883093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c493e-4299-462e-a94b-af1600943733 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:47.919616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3cf44-8f64-4195-abf9-9f04b31501f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:47.920265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3cf44-8f64-4195-abf9-9f04b31501f7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:47.920530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3cf44-8f64-4195-abf9-9f04b31501f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:47.920788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3cf44-8f64-4195-abf9-9f04b31501f7 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:47.922853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3cf44-8f64-4195-abf9-9f04b31501f7 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:47.924332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb3cf44-8f64-4195-abf9-9f04b31501f7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:47.926005 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 97/205] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:47 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:47.932395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3cf44-8f64-4195-abf9-9f04b31501f7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:48.042253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:48.055880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c493e-4299-462e-a94b-af1600943733 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:48.102796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3cf44-8f64-4195-abf9-9f04b31501f7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:48.120730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97265-eb6e-4298-adcf-d934a1f9b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:48.121379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97265-eb6e-4298-adcf-d934a1f9b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:48.121651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97265-eb6e-4298-adcf-d934a1f9b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:48.121930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97265-eb6e-4298-adcf-d934a1f9b6b3 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:48.123244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97265-eb6e-4298-adcf-d934a1f9b6b3 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:48.124644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97265-eb6e-4298-adcf-d934a1f9b6b3 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:48.126349 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 109/206] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:47 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:48.132731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97265-eb6e-4298-adcf-d934a1f9b6b3 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:48.161207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:48.170355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c341e-50d8-437c-8e51-a7959498cc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:48.170980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c341e-50d8-437c-8e51-a7959498cc2a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:48.171255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c341e-50d8-437c-8e51-a7959498cc2a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:48.171521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c341e-50d8-437c-8e51-a7959498cc2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:48.172271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c341e-50d8-437c-8e51-a7959498cc2a None admin] RBAC: Adding query filter params (role.id=d2025de3cdb4448182f82d37b6cff368, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2, user.id=1b89e41f004f470d941c5f63d923f2f4) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:48.172575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c341e-50d8-437c-8e51-a7959498cc2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:48.174066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c341e-50d8-437c-8e51-a7959498cc2a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:48.185761 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 98/207] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:47 2022] GET /identity/v3/role_assignments?user.id=1b89e41f004f470d941c5f63d923f2f4&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=d2025de3cdb4448182f82d37b6cff368 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:48.290458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97265-eb6e-4298-adcf-d934a1f9b6b3 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:48.341528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa677b8e-3fb4-4609-a42d-9d53bc34bc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:48.342190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa677b8e-3fb4-4609-a42d-9d53bc34bc71 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:48.342468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa677b8e-3fb4-4609-a42d-9d53bc34bc71 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:48.342736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa677b8e-3fb4-4609-a42d-9d53bc34bc71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:48.343485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa677b8e-3fb4-4609-a42d-9d53bc34bc71 None admin] RBAC: Adding query filter params (role.id=c8196760d5404ccf95f4bccb62c5a1a3, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22, user.id=114d4ef1c482491699d91a1a4823ea7e) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:48.343792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa677b8e-3fb4-4609-a42d-9d53bc34bc71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:48.345274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa677b8e-3fb4-4609-a42d-9d53bc34bc71 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:48.357466 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 110/208] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:48 2022] GET /identity/v3/role_assignments?user.id=114d4ef1c482491699d91a1a4823ea7e&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=c8196760d5404ccf95f4bccb62c5a1a3 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:48.960808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a429c-c5b6-44d2-9f5f-929a906dcd5b None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:48.962178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a429c-c5b6-44d2-9f5f-929a906dcd5b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:48.962178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a429c-c5b6-44d2-9f5f-929a906dcd5b None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:48.962896 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 99/209] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:48.969151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993890a6-7185-479d-a135-7f93cd466950 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:48.969570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993890a6-7185-479d-a135-7f93cd466950 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:48.969754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993890a6-7185-479d-a135-7f93cd466950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:48.991687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-993890a6-7185-479d-a135-7f93cd466950 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:48.993281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-993890a6-7185-479d-a135-7f93cd466950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:49.014996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a74d-6ed8-43a4-b9d7-b9a7f18b391e None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:49.015295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a74d-6ed8-43a4-b9d7-b9a7f18b391e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:49.015532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a74d-6ed8-43a4-b9d7-b9a7f18b391e None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:49.016880 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 100/210] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:49.017547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:49.022169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838097e6-fcf5-4399-ab85-9d3e98eb61b2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:49.022448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838097e6-fcf5-4399-ab85-9d3e98eb61b2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:49.022717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838097e6-fcf5-4399-ab85-9d3e98eb61b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:49.041501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-838097e6-fcf5-4399-ab85-9d3e98eb61b2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:49.042713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-838097e6-fcf5-4399-ab85-9d3e98eb61b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:49.064370 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 111/211] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:49.113071 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 101/212] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:49.336777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993890a6-7185-479d-a135-7f93cd466950 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:49.383990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838097e6-fcf5-4399-ab85-9d3e98eb61b2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:49.450931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993890a6-7185-479d-a135-7f93cd466950 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:49.498023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838097e6-fcf5-4399-ab85-9d3e98eb61b2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:49.501042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653349-38eb-4d13-b296-65841f739ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:49.501716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653349-38eb-4d13-b296-65841f739ec8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:49.502025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653349-38eb-4d13-b296-65841f739ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:49.502300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653349-38eb-4d13-b296-65841f739ec8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:49.503462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82653349-38eb-4d13-b296-65841f739ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:49.505161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82653349-38eb-4d13-b296-65841f739ec8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:49.507426 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 112/213] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:49.513227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653349-38eb-4d13-b296-65841f739ec8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:49.535129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:49.543811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:49.547857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a2764-bdbe-43f4-b599-2bb0e18801c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:49.548842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a2764-bdbe-43f4-b599-2bb0e18801c0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:49.549131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a2764-bdbe-43f4-b599-2bb0e18801c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:49.549404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a2764-bdbe-43f4-b599-2bb0e18801c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:49.562718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a2764-bdbe-43f4-b599-2bb0e18801c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-101a2764-bdbe-43f4-b599-2bb0e18801c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:49.567791 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:49.568643 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:49.569427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:49.570047 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 102/214] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:49.576458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a2764-bdbe-43f4-b599-2bb0e18801c0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:49.638279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653349-38eb-4d13-b296-65841f739ec8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:49.681387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7e74d-3d5e-43f1-956a-50c45ea5f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:49.682049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7e74d-3d5e-43f1-956a-50c45ea5f171 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:49.682303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7e74d-3d5e-43f1-956a-50c45ea5f171 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:49.682570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7e74d-3d5e-43f1-956a-50c45ea5f171 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:49.683226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7e74d-3d5e-43f1-956a-50c45ea5f171 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:49.684675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7e74d-3d5e-43f1-956a-50c45ea5f171 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:49.697229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a2764-bdbe-43f4-b599-2bb0e18801c0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:49.709009 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 113/215] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:57:49 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:49.716269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2aa75-b1c7-4f13-83dc-104e4525df6d None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:49.716949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2aa75-b1c7-4f13-83dc-104e4525df6d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:49.717413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2aa75-b1c7-4f13-83dc-104e4525df6d None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:49.720202 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 114/216] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:49.726247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f58a1-bbfb-42e2-bf8d-82774b15f7fd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:49.726556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f58a1-bbfb-42e2-bf8d-82774b15f7fd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:49.726891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f58a1-bbfb-42e2-bf8d-82774b15f7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:49.740387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214412-8389-4e36-a3a3-3499768b6198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:49.742220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214412-8389-4e36-a3a3-3499768b6198 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:49.742911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214412-8389-4e36-a3a3-3499768b6198 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:49.743488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d214412-8389-4e36-a3a3-3499768b6198 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:49.744393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214412-8389-4e36-a3a3-3499768b6198 None admin] RBAC: Adding query filter params (name=member) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:49.744862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214412-8389-4e36-a3a3-3499768b6198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:49.746613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d214412-8389-4e36-a3a3-3499768b6198 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:49.747601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-197f58a1-bbfb-42e2-bf8d-82774b15f7fd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:49.749010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-197f58a1-bbfb-42e2-bf8d-82774b15f7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:49.758996 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 103/217] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:49.765857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214412-8389-4e36-a3a3-3499768b6198 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:49.836195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:49.846302 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 115/218] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:49.899984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d214412-8389-4e36-a3a3-3499768b6198 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:49.934940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbabd7-4fc9-43a1-8bb3-d8d626270411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:49.935587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbabd7-4fc9-43a1-8bb3-d8d626270411 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:49.935863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbabd7-4fc9-43a1-8bb3-d8d626270411 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:49.936133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbabd7-4fc9-43a1-8bb3-d8d626270411 None admin] PATH_INFO: `/v3/users/3b469fea15e54df2bd5fca784a1ecc32` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:49.952263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbabd7-4fc9-43a1-8bb3-d8d626270411 None admin] RBAC: Authorizing `identity:get_user(user_id=3b469fea15e54df2bd5fca784a1ecc32)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:49.953764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbabd7-4fc9-43a1-8bb3-d8d626270411 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:49.955794 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 104/219] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:49 2022] GET /identity/v3/users/3b469fea15e54df2bd5fca784a1ecc32 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:49.962199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f58a1-bbfb-42e2-bf8d-82774b15f7fd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:49.978714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:50.072238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f58a1-bbfb-42e2-bf8d-82774b15f7fd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:50.110028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645df117-cd87-4ba2-af9c-b7b07e5e99dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:50.110660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645df117-cd87-4ba2-af9c-b7b07e5e99dd None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:50.110937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645df117-cd87-4ba2-af9c-b7b07e5e99dd None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:50.111234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645df117-cd87-4ba2-af9c-b7b07e5e99dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:50.115320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbabd7-4fc9-43a1-8bb3-d8d626270411 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:50.186753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645df117-cd87-4ba2-af9c-b7b07e5e99dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:50.188462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645df117-cd87-4ba2-af9c-b7b07e5e99dd None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:50.205138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:50.256539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbabd7-4fc9-43a1-8bb3-d8d626270411 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:50.267444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:50.303336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a16833-b9f0-4cbc-bf2a-a9a36942a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:50.303987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16833-b9f0-4cbc-bf2a-a9a36942a037 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:50.304508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16833-b9f0-4cbc-bf2a-a9a36942a037 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:50.304789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a16833-b9f0-4cbc-bf2a-a9a36942a037 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:50.320827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 116/220] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:50.322843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645df117-cd87-4ba2-af9c-b7b07e5e99dd None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:50.323709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a16833-b9f0-4cbc-bf2a-a9a36942a037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-54a16833-b9f0-4cbc-bf2a-a9a36942a037 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:50.334065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:50.335169 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:50.336360 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:50.338362 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 105/221] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:57:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:57:50.350912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a16833-b9f0-4cbc-bf2a-a9a36942a037 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:50.442182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645df117-cd87-4ba2-af9c-b7b07e5e99dd None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:50.456616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:50.480869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2b3d9-e64a-4c9f-ab5f-00a68a9ab30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:50.481520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b3d9-e64a-4c9f-ab5f-00a68a9ab30d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:50.481790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b3d9-e64a-4c9f-ab5f-00a68a9ab30d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:50.482085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b3d9-e64a-4c9f-ab5f-00a68a9ab30d None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:50.483314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2b3d9-e64a-4c9f-ab5f-00a68a9ab30d None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:50.484891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2b3d9-e64a-4c9f-ab5f-00a68a9ab30d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:50.487025 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 117/222] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:50 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:50.488304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afd7cc-c80f-4c2d-9ed8-957bd474e657 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:50.488682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afd7cc-c80f-4c2d-9ed8-957bd474e657 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:50.489072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1afd7cc-c80f-4c2d-9ed8-957bd474e657 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:50.490426 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 118/223] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:50.495996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afd7cc-c80f-4c2d-9ed8-957bd474e657 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:50.509642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a16833-b9f0-4cbc-bf2a-a9a36942a037 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:50.553335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505b689-f6be-4c6f-b987-34fd93f8fc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:50.554115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b689-f6be-4c6f-b987-34fd93f8fc25 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:50.554513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b689-f6be-4c6f-b987-34fd93f8fc25 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:50.554784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505b689-f6be-4c6f-b987-34fd93f8fc25 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:50.556029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505b689-f6be-4c6f-b987-34fd93f8fc25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:50.556330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505b689-f6be-4c6f-b987-34fd93f8fc25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:50.558439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505b689-f6be-4c6f-b987-34fd93f8fc25 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:50.569704 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 106/224] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:50.571188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed646f-c386-4de7-ac57-6dcf493e1f77 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:50.571479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed646f-c386-4de7-ac57-6dcf493e1f77 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:50.571753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed646f-c386-4de7-ac57-6dcf493e1f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:50.594175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-61ed646f-c386-4de7-ac57-6dcf493e1f77 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:50.596230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-61ed646f-c386-4de7-ac57-6dcf493e1f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:50.611340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1afd7cc-c80f-4c2d-9ed8-957bd474e657 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:50.626450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:50.657543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d99ae9-4e9d-4f8b-948d-4de4a5655b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:50.658682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99ae9-4e9d-4f8b-948d-4de4a5655b5e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:50.659225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99ae9-4e9d-4f8b-948d-4de4a5655b5e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:50.659725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99ae9-4e9d-4f8b-948d-4de4a5655b5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:50.660575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d99ae9-4e9d-4f8b-948d-4de4a5655b5e None admin] RBAC: Adding query filter params (role.id=4d5ba4daa0e84cf89f3bc5854a124660, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22, user.id=3b469fea15e54df2bd5fca784a1ecc32) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:50.660989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d99ae9-4e9d-4f8b-948d-4de4a5655b5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:50.663226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d99ae9-4e9d-4f8b-948d-4de4a5655b5e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:50.670847 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 119/225] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:50 2022] GET /identity/v3/role_assignments?user.id=3b469fea15e54df2bd5fca784a1ecc32&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:50.672395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d99ae9-4e9d-4f8b-948d-4de4a5655b5e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:50.689440 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 107/226] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:50.744470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:50.805836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d99ae9-4e9d-4f8b-948d-4de4a5655b5e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:50.849798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cb4ab-c1b4-45e6-ad12-5ac5d4c6cc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:50.850748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cb4ab-c1b4-45e6-ad12-5ac5d4c6cc8b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:50.851165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cb4ab-c1b4-45e6-ad12-5ac5d4c6cc8b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:50.851638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cb4ab-c1b4-45e6-ad12-5ac5d4c6cc8b None admin] PATH_INFO: `/v3/users/114d4ef1c482491699d91a1a4823ea7e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:50.857111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cb4ab-c1b4-45e6-ad12-5ac5d4c6cc8b None admin] RBAC: Authorizing `identity:get_user(user_id=114d4ef1c482491699d91a1a4823ea7e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:50.858821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cb4ab-c1b4-45e6-ad12-5ac5d4c6cc8b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:50.860731 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 120/227] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:50 2022] GET /identity/v3/users/114d4ef1c482491699d91a1a4823ea7e => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:50.866643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed646f-c386-4de7-ac57-6dcf493e1f77 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:50.989728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed646f-c386-4de7-ac57-6dcf493e1f77 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:51.024950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02e5dd-4aa5-4480-b7b0-029377375476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:51.025571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02e5dd-4aa5-4480-b7b0-029377375476 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:51.025861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02e5dd-4aa5-4480-b7b0-029377375476 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:51.026220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02e5dd-4aa5-4480-b7b0-029377375476 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:51.027460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02e5dd-4aa5-4480-b7b0-029377375476 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:51.029227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02e5dd-4aa5-4480-b7b0-029377375476 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:51.031421 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 108/228] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:50 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:51.037222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cb4ab-c1b4-45e6-ad12-5ac5d4c6cc8b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:51.136372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02e5dd-4aa5-4480-b7b0-029377375476 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:51.170533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cb4ab-c1b4-45e6-ad12-5ac5d4c6cc8b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:51.181386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:51.185711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:51.214569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee148c56-9820-4bfe-b861-ad51f64fbd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:51.215319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee148c56-9820-4bfe-b861-ad51f64fbd15 None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:51.215596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee148c56-9820-4bfe-b861-ad51f64fbd15 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:51.215870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee148c56-9820-4bfe-b861-ad51f64fbd15 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/users/114d4ef1c482491699d91a1a4823ea7e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:51.218832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee148c56-9820-4bfe-b861-ad51f64fbd15 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf221b7c1217437ea1cbdbda8e46ed22, user_id=114d4ef1c482491699d91a1a4823ea7e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:51.221935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee148c56-9820-4bfe-b861-ad51f64fbd15 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:51.247183 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 121/229] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:57:51 2022] PUT /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/users/114d4ef1c482491699d91a1a4823ea7e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:57:51.293962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02e5dd-4aa5-4480-b7b0-029377375476 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:51.333706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e819f3-c788-442d-911c-7d3e979b2a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:51.334404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e819f3-c788-442d-911c-7d3e979b2a9e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:51.334673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e819f3-c788-442d-911c-7d3e979b2a9e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:51.334984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e819f3-c788-442d-911c-7d3e979b2a9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:51.350381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e819f3-c788-442d-911c-7d3e979b2a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-18e819f3-c788-442d-911c-7d3e979b2a9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:51.355718 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:51.356661 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:51.357440 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 109/230] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:57:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:57:51.363062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee148c56-9820-4bfe-b861-ad51f64fbd15 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:51.489363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee148c56-9820-4bfe-b861-ad51f64fbd15 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:51.527527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06198b0a-a6ff-4f0e-8735-f1ada4d3783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:51.528196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06198b0a-a6ff-4f0e-8735-f1ada4d3783a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:51.528470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06198b0a-a6ff-4f0e-8735-f1ada4d3783a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:51.528737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06198b0a-a6ff-4f0e-8735-f1ada4d3783a None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:51.529399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06198b0a-a6ff-4f0e-8735-f1ada4d3783a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:51.529694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06198b0a-a6ff-4f0e-8735-f1ada4d3783a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:51.531119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06198b0a-a6ff-4f0e-8735-f1ada4d3783a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:51.546009 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 122/231] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:57:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:51.551839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e819f3-c788-442d-911c-7d3e979b2a9e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:51.658065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:51.676048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e819f3-c788-442d-911c-7d3e979b2a9e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:51.721842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae77e18-4682-4f5d-9fc7-28e111c48a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:51.722502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77e18-4682-4f5d-9fc7-28e111c48a2d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:51.722775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77e18-4682-4f5d-9fc7-28e111c48a2d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:51.723039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae77e18-4682-4f5d-9fc7-28e111c48a2d None admin] PATH_INFO: `/v3/users/114d4ef1c482491699d91a1a4823ea7e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:51.726555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae77e18-4682-4f5d-9fc7-28e111c48a2d None admin] RBAC: Authorizing `identity:get_user(user_id=114d4ef1c482491699d91a1a4823ea7e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:51.728139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae77e18-4682-4f5d-9fc7-28e111c48a2d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:51.729720 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 110/232] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:51 2022] GET /identity/v3/users/114d4ef1c482491699d91a1a4823ea7e => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:51.735397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06198b0a-a6ff-4f0e-8735-f1ada4d3783a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:51.787413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:51.876641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06198b0a-a6ff-4f0e-8735-f1ada4d3783a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:51.916921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f3e9a-b0a8-4217-975c-27638c924d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:51.917577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3e9a-b0a8-4217-975c-27638c924d8f None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:51.917858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3e9a-b0a8-4217-975c-27638c924d8f None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:51.918155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3e9a-b0a8-4217-975c-27638c924d8f None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:51.919313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3e9a-b0a8-4217-975c-27638c924d8f None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:51.920766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3e9a-b0a8-4217-975c-27638c924d8f None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:51.922453 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 123/233] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:51 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:51.931086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae77e18-4682-4f5d-9fc7-28e111c48a2d None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:52.078310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae77e18-4682-4f5d-9fc7-28e111c48a2d None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:52.127781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fccb85-a9e1-4283-946f-578fa0ae6e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:52.128793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fccb85-a9e1-4283-946f-578fa0ae6e3c None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:52.129270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fccb85-a9e1-4283-946f-578fa0ae6e3c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:52.129735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fccb85-a9e1-4283-946f-578fa0ae6e3c None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/users/114d4ef1c482491699d91a1a4823ea7e/roles/c8196760d5404ccf95f4bccb62c5a1a3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:52.132150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fccb85-a9e1-4283-946f-578fa0ae6e3c None admin] RBAC: Authorizing `identity:create_grant(project_id=bf221b7c1217437ea1cbdbda8e46ed22, user_id=114d4ef1c482491699d91a1a4823ea7e, role_id=c8196760d5404ccf95f4bccb62c5a1a3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:52.134210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fccb85-a9e1-4283-946f-578fa0ae6e3c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:52.151777 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 111/234] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:57:51 2022] PUT /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/users/114d4ef1c482491699d91a1a4823ea7e/roles/c8196760d5404ccf95f4bccb62c5a1a3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:57:52.208655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fec07-5b47-46d9-b5ee-b001991b19db None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:52.209194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fec07-5b47-46d9-b5ee-b001991b19db None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:52.209432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fec07-5b47-46d9-b5ee-b001991b19db None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:52.210774 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 124/235] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:52.216928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e692a7-2c72-4b67-9b1f-6d7727240739 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:52.217625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e692a7-2c72-4b67-9b1f-6d7727240739 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:52.218113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e692a7-2c72-4b67-9b1f-6d7727240739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:52.238292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c8e692a7-2c72-4b67-9b1f-6d7727240739 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:52.239901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c8e692a7-2c72-4b67-9b1f-6d7727240739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:52.251486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:52.314790 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 112/236] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:52.606824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1607f00-fc89-4ef7-8294-69163c554f00 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:52.607358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1607f00-fc89-4ef7-8294-69163c554f00 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:52.607836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1607f00-fc89-4ef7-8294-69163c554f00 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:52.609827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 125/237] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:52.616007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63564-d4ea-4295-a4a6-4d64d3ed0c4f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:52.616442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63564-d4ea-4295-a4a6-4d64d3ed0c4f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:52.616812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63564-d4ea-4295-a4a6-4d64d3ed0c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:52.630126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1607f00-fc89-4ef7-8294-69163c554f00 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:52.648153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c3f63564-d4ea-4295-a4a6-4d64d3ed0c4f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:52.649824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c3f63564-d4ea-4295-a4a6-4d64d3ed0c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:52.744037 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 113/238] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:52.796396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1607f00-fc89-4ef7-8294-69163c554f00 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:52.798557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:52.837851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e5dac-217e-4fdf-854e-d39c1fb44207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:52.838514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5dac-217e-4fdf-854e-d39c1fb44207 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:52.838790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5dac-217e-4fdf-854e-d39c1fb44207 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:52.839069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5dac-217e-4fdf-854e-d39c1fb44207 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:52.854041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e5dac-217e-4fdf-854e-d39c1fb44207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-2e5e5dac-217e-4fdf-854e-d39c1fb44207 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:52.859105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:52.859976 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:52.860768 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 126/239] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:52.866197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63564-d4ea-4295-a4a6-4d64d3ed0c4f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:52.943576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:52.969940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63564-d4ea-4295-a4a6-4d64d3ed0c4f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:53.006711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490314dd-8d73-4ec7-8353-3a71a3025cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:53.007330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490314dd-8d73-4ec7-8353-3a71a3025cd4 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.007604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490314dd-8d73-4ec7-8353-3a71a3025cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.007868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490314dd-8d73-4ec7-8353-3a71a3025cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:53.009106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490314dd-8d73-4ec7-8353-3a71a3025cd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:53.009419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490314dd-8d73-4ec7-8353-3a71a3025cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:53.010841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490314dd-8d73-4ec7-8353-3a71a3025cd4 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:53.019502 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 114/240] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:53.025518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e5dac-217e-4fdf-854e-d39c1fb44207 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:53.074003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490314dd-8d73-4ec7-8353-3a71a3025cd4 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:53.193353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e5dac-217e-4fdf-854e-d39c1fb44207 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:53.235107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81cca95-b1ba-47f8-b00b-6b3f67c69db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:53.235748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cca95-b1ba-47f8-b00b-6b3f67c69db5 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.236036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cca95-b1ba-47f8-b00b-6b3f67c69db5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.236260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81cca95-b1ba-47f8-b00b-6b3f67c69db5 None admin] PATH_INFO: `/v3/users/5f806413c52243df871d9b4816304dde` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:53.243654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490314dd-8d73-4ec7-8353-3a71a3025cd4 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:53.252512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cca95-b1ba-47f8-b00b-6b3f67c69db5 None admin] RBAC: Authorizing `identity:get_user(user_id=5f806413c52243df871d9b4816304dde)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:53.254194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81cca95-b1ba-47f8-b00b-6b3f67c69db5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:53.261224 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 127/241] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:53 2022] GET /identity/v3/users/5f806413c52243df871d9b4816304dde => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:53.262551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359867a-04a4-4aca-aa85-c4f537d70bb6 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.262829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359867a-04a4-4aca-aa85-c4f537d70bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.263098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359867a-04a4-4aca-aa85-c4f537d70bb6 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:53.264358 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 128/242] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:53.265040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359867a-04a4-4aca-aa85-c4f537d70bb6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:53.281936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6a973-7d4b-4c03-a9e0-d7e542dd8daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:53.282901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6a973-7d4b-4c03-a9e0-d7e542dd8daa None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.283404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6a973-7d4b-4c03-a9e0-d7e542dd8daa None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.283882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6a973-7d4b-4c03-a9e0-d7e542dd8daa None admin] PATH_INFO: `/v3/domains/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:53.285186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6a973-7d4b-4c03-a9e0-d7e542dd8daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:53.286881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6a973-7d4b-4c03-a9e0-d7e542dd8daa None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:53.288665 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 115/243] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:53.290171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf01c3-d672-4913-a3b2-fdd3368666e4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.290654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf01c3-d672-4913-a3b2-fdd3368666e4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.291132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf01c3-d672-4913-a3b2-fdd3368666e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:53.298468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:53.299716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:53.313306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cdcf01c3-d672-4913-a3b2-fdd3368666e4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:53.314831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cdcf01c3-d672-4913-a3b2-fdd3368666e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:53.379452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359867a-04a4-4aca-aa85-c4f537d70bb6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:53.388234 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 116/244] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:53.389476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf01c3-d672-4913-a3b2-fdd3368666e4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:53.439151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe7903-49f6-4169-9a1a-ee05d6ebd221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:53.439775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe7903-49f6-4169-9a1a-ee05d6ebd221 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.440048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe7903-49f6-4169-9a1a-ee05d6ebd221 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.440369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe7903-49f6-4169-9a1a-ee05d6ebd221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:53.498248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf01c3-d672-4913-a3b2-fdd3368666e4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:53.535774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117e964-2048-4215-870c-9f25ec24cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:53.536863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117e964-2048-4215-870c-9f25ec24cd5b None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.537350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117e964-2048-4215-870c-9f25ec24cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.537826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117e964-2048-4215-870c-9f25ec24cd5b None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:53.538820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117e964-2048-4215-870c-9f25ec24cd5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:53.540948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b117e964-2048-4215-870c-9f25ec24cd5b None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:53.549774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:53.562984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe7903-49f6-4169-9a1a-ee05d6ebd221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:53.564528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe7903-49f6-4169-9a1a-ee05d6ebd221 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:53.572903 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 117/245] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:57:53 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:53.616540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:53.655745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c03f3-eba3-41fb-b8f3-84461e843d02 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.656077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c03f3-eba3-41fb-b8f3-84461e843d02 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.656296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c03f3-eba3-41fb-b8f3-84461e843d02 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:53.657927 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 118/246] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:57:53.662860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf2ab-805a-4e03-b766-c3cb5665315c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.663140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf2ab-805a-4e03-b766-c3cb5665315c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.663415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaf2ab-805a-4e03-b766-c3cb5665315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:53.687573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5eaaf2ab-805a-4e03-b766-c3cb5665315c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:53.688799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5eaaf2ab-805a-4e03-b766-c3cb5665315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:53.750581 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 129/247] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:53.755993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe7903-49f6-4169-9a1a-ee05d6ebd221 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:53.813389 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 119/248] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:53.841369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf2ab-805a-4e03-b766-c3cb5665315c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:53.886581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe7903-49f6-4169-9a1a-ee05d6ebd221 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:53.908073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:53.924126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad67af-8fd2-474d-9e3a-e4e816693c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:53.924764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad67af-8fd2-474d-9e3a-e4e816693c86 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.925037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad67af-8fd2-474d-9e3a-e4e816693c86 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.925301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad67af-8fd2-474d-9e3a-e4e816693c86 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:53.926451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad67af-8fd2-474d-9e3a-e4e816693c86 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:53.928077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad67af-8fd2-474d-9e3a-e4e816693c86 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:53.930098 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 130/249] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:53 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:53.936056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad67af-8fd2-474d-9e3a-e4e816693c86 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:53.954889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaf2ab-805a-4e03-b766-c3cb5665315c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:53.979292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:53.998087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809f574-cba0-4305-b1e6-1c18e29ee944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:53.998607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809f574-cba0-4305-b1e6-1c18e29ee944 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:53.999290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809f574-cba0-4305-b1e6-1c18e29ee944 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:53.999290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809f574-cba0-4305-b1e6-1c18e29ee944 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.014845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809f574-cba0-4305-b1e6-1c18e29ee944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-c809f574-cba0-4305-b1e6-1c18e29ee944 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:54.020150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:54.021034 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:54.021822 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:54.027364 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 120/250] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:57:54.028294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809f574-cba0-4305-b1e6-1c18e29ee944 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:54.052612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad67af-8fd2-474d-9e3a-e4e816693c86 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:54.094249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54813c50-c718-48a0-973b-5a30e53cf9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:54.095212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54813c50-c718-48a0-973b-5a30e53cf9ae None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.095675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54813c50-c718-48a0-973b-5a30e53cf9ae None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.096122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54813c50-c718-48a0-973b-5a30e53cf9ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.097445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54813c50-c718-48a0-973b-5a30e53cf9ae None admin] RBAC: Adding query filter params (role.id=d2025de3cdb4448182f82d37b6cff368, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22, user.id=5f806413c52243df871d9b4816304dde) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:54.097974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54813c50-c718-48a0-973b-5a30e53cf9ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:54.099611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54813c50-c718-48a0-973b-5a30e53cf9ae None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:54.109998 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 131/251] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:53 2022] GET /identity/v3/role_assignments?user.id=5f806413c52243df871d9b4816304dde&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=d2025de3cdb4448182f82d37b6cff368 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:54.136849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54813c50-c718-48a0-973b-5a30e53cf9ae None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:54.143896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809f574-cba0-4305-b1e6-1c18e29ee944 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:54.195323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0434367-76fa-4f36-916b-7f5555112d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:54.195977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434367-76fa-4f36-916b-7f5555112d0b None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.197274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434367-76fa-4f36-916b-7f5555112d0b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.197588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434367-76fa-4f36-916b-7f5555112d0b None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.198340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0434367-76fa-4f36-916b-7f5555112d0b None admin] RBAC: Adding query filter params (name=member) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:54.198643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0434367-76fa-4f36-916b-7f5555112d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:54.200148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0434367-76fa-4f36-916b-7f5555112d0b None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:54.215491 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 121/252] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:54.218710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:54.223931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0434367-76fa-4f36-916b-7f5555112d0b None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:54.286085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54813c50-c718-48a0-973b-5a30e53cf9ae None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:54.286609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:54.326674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db759305-4f6d-4fd3-bf2a-eef930dd4d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:54.327560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db759305-4f6d-4fd3-bf2a-eef930dd4d4f None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.327686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db759305-4f6d-4fd3-bf2a-eef930dd4d4f None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.327847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db759305-4f6d-4fd3-bf2a-eef930dd4d4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.343760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db759305-4f6d-4fd3-bf2a-eef930dd4d4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-db759305-4f6d-4fd3-bf2a-eef930dd4d4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:54.349373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:54.350313 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:57:54.351094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:54.352227 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 132/253] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:54.354010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0434367-76fa-4f36-916b-7f5555112d0b None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:54.362947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db759305-4f6d-4fd3-bf2a-eef930dd4d4f None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:54.398366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574dec1-59ba-4c05-b4b0-995e59d8b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:54.399378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574dec1-59ba-4c05-b4b0-995e59d8b2cc None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.399978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574dec1-59ba-4c05-b4b0-995e59d8b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.400388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574dec1-59ba-4c05-b4b0-995e59d8b2cc None admin] PATH_INFO: `/v3/users/3b469fea15e54df2bd5fca784a1ecc32` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.402387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574dec1-59ba-4c05-b4b0-995e59d8b2cc None admin] RBAC: Authorizing `identity:get_user(user_id=3b469fea15e54df2bd5fca784a1ecc32)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:54.404153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574dec1-59ba-4c05-b4b0-995e59d8b2cc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:54.407087 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 122/254] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:54 2022] GET /identity/v3/users/3b469fea15e54df2bd5fca784a1ecc32 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:54.413169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574dec1-59ba-4c05-b4b0-995e59d8b2cc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:54.484097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db759305-4f6d-4fd3-bf2a-eef930dd4d4f None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:54.499351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:54.521556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404bc72-fdec-4c44-933e-d0d9b41d3201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:54.522587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404bc72-fdec-4c44-933e-d0d9b41d3201 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.523072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404bc72-fdec-4c44-933e-d0d9b41d3201 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.523538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404bc72-fdec-4c44-933e-d0d9b41d3201 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.524428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404bc72-fdec-4c44-933e-d0d9b41d3201 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:54.524915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404bc72-fdec-4c44-933e-d0d9b41d3201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:54.525149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574dec1-59ba-4c05-b4b0-995e59d8b2cc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:54.526720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404bc72-fdec-4c44-933e-d0d9b41d3201 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:54.538523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:54.540210 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 133/255] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:54.541582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118dfc9-c7e2-4122-8812-2ac2b787c5c9 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.541861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118dfc9-c7e2-4122-8812-2ac2b787c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.545970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118dfc9-c7e2-4122-8812-2ac2b787c5c9 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.547479 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 134/256] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:54.548074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118dfc9-c7e2-4122-8812-2ac2b787c5c9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:54.568578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f774eb0-1653-4727-8559-55711bd3befa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:54.569223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f774eb0-1653-4727-8559-55711bd3befa None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.569512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f774eb0-1653-4727-8559-55711bd3befa None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.569834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f774eb0-1653-4727-8559-55711bd3befa None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.570911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f774eb0-1653-4727-8559-55711bd3befa None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:54.572646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f774eb0-1653-4727-8559-55711bd3befa None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:54.574446 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 123/257] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:54 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:54.575573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ae924-8b51-45f2-a2d6-373fa7ec29db None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.575849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ae924-8b51-45f2-a2d6-373fa7ec29db None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.576117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ae924-8b51-45f2-a2d6-373fa7ec29db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.600184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-520ae924-8b51-45f2-a2d6-373fa7ec29db None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:54.601373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-520ae924-8b51-45f2-a2d6-373fa7ec29db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:54.675360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118dfc9-c7e2-4122-8812-2ac2b787c5c9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:54.688640 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 124/258] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:54.689707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ae924-8b51-45f2-a2d6-373fa7ec29db None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:54.716236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb69f0-ca16-47fa-a2dc-480be46ca603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:54.717253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb69f0-ca16-47fa-a2dc-480be46ca603 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.717795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb69f0-ca16-47fa-a2dc-480be46ca603 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.718308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb69f0-ca16-47fa-a2dc-480be46ca603 None admin] PATH_INFO: `/v3/users/114d4ef1c482491699d91a1a4823ea7e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.719667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb69f0-ca16-47fa-a2dc-480be46ca603 None admin] RBAC: Authorizing `identity:get_user(user_id=114d4ef1c482491699d91a1a4823ea7e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:54.721749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb69f0-ca16-47fa-a2dc-480be46ca603 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:54.723700 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 135/259] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:54 2022] GET /identity/v3/users/114d4ef1c482491699d91a1a4823ea7e => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:54.729992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb69f0-ca16-47fa-a2dc-480be46ca603 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:54.775212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:54.834894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb69f0-ca16-47fa-a2dc-480be46ca603 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:54.871014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ae924-8b51-45f2-a2d6-373fa7ec29db None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:54.871480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87170ed-537d-4ef9-a8bf-20584b9be737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:54.872345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87170ed-537d-4ef9-a8bf-20584b9be737 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.872817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87170ed-537d-4ef9-a8bf-20584b9be737 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.873299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87170ed-537d-4ef9-a8bf-20584b9be737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.891252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:54.948276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87170ed-537d-4ef9-a8bf-20584b9be737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:54.950392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87170ed-537d-4ef9-a8bf-20584b9be737 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:54.960396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff7ca-fe7b-48f5-ab17-ed7305d8f9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:54.961093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff7ca-fe7b-48f5-ab17-ed7305d8f9a2 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:54.961365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff7ca-fe7b-48f5-ab17-ed7305d8f9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:54.961698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ff7ca-fe7b-48f5-ab17-ed7305d8f9a2 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/users/3b469fea15e54df2bd5fca784a1ecc32/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:54.967147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff7ca-fe7b-48f5-ab17-ed7305d8f9a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf221b7c1217437ea1cbdbda8e46ed22, user_id=3b469fea15e54df2bd5fca784a1ecc32, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:54.968617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ff7ca-fe7b-48f5-ab17-ed7305d8f9a2 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:55.004296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:55.032400 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 125/260] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:57:54 2022] PUT /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/users/3b469fea15e54df2bd5fca784a1ecc32/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:57:55.067152 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 136/261] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 03:57:55.073485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff7ca-fe7b-48f5-ab17-ed7305d8f9a2 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:55.218104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ff7ca-fe7b-48f5-ab17-ed7305d8f9a2 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:55.235446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87170ed-537d-4ef9-a8bf-20584b9be737 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:55.301219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd481370-06fe-4c37-a562-69c11bad4da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:55.302619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd481370-06fe-4c37-a562-69c11bad4da0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:55.308459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd481370-06fe-4c37-a562-69c11bad4da0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:55.309003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd481370-06fe-4c37-a562-69c11bad4da0 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:55.310478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd481370-06fe-4c37-a562-69c11bad4da0 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:55.312184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd481370-06fe-4c37-a562-69c11bad4da0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:55.317033 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 126/262] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:55 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:55.332280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd481370-06fe-4c37-a562-69c11bad4da0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:55.405782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:55.465798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87170ed-537d-4ef9-a8bf-20584b9be737 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:55.533899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f73bb-df2b-4a57-9011-38cc1f5337f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:55.534459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f73bb-df2b-4a57-9011-38cc1f5337f8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:55.534770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f73bb-df2b-4a57-9011-38cc1f5337f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:55.535004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f73bb-df2b-4a57-9011-38cc1f5337f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:55.546520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd481370-06fe-4c37-a562-69c11bad4da0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:55.558081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f73bb-df2b-4a57-9011-38cc1f5337f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-933f73bb-df2b-4a57-9011-38cc1f5337f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:55.564846 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:55.565742 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:55.566553 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 137/263] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:57:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:55.572120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f73bb-df2b-4a57-9011-38cc1f5337f8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:55.576638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:55.614304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c77be-e7c6-47f6-9989-7a24f6d22c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:55.614931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c77be-e7c6-47f6-9989-7a24f6d22c33 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:55.616556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c77be-e7c6-47f6-9989-7a24f6d22c33 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:55.617039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c77be-e7c6-47f6-9989-7a24f6d22c33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:55.618229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c77be-e7c6-47f6-9989-7a24f6d22c33 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22, user.id=114d4ef1c482491699d91a1a4823ea7e) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:55.618550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c77be-e7c6-47f6-9989-7a24f6d22c33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:55.620788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c77be-e7c6-47f6-9989-7a24f6d22c33 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:55.641427 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 127/264] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:55 2022] GET /identity/v3/role_assignments?user.id=114d4ef1c482491699d91a1a4823ea7e&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:55.738989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f73bb-df2b-4a57-9011-38cc1f5337f8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:55.789166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6d2ba-2aaf-4d93-a7bf-857c01ccfc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:55.789803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6d2ba-2aaf-4d93-a7bf-857c01ccfc36 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:55.790103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6d2ba-2aaf-4d93-a7bf-857c01ccfc36 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:55.790429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6d2ba-2aaf-4d93-a7bf-857c01ccfc36 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:55.791423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6d2ba-2aaf-4d93-a7bf-857c01ccfc36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:55.791723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6d2ba-2aaf-4d93-a7bf-857c01ccfc36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:55.793213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6d2ba-2aaf-4d93-a7bf-857c01ccfc36 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:55.809536 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 138/265] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:57:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:55.815178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c77be-e7c6-47f6-9989-7a24f6d22c33 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:55.927874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:55.931362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c77be-e7c6-47f6-9989-7a24f6d22c33 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:55.973860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656e200-e268-4520-8245-ed15f143e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:55.974531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656e200-e268-4520-8245-ed15f143e7cc None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:55.974809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656e200-e268-4520-8245-ed15f143e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:55.975081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656e200-e268-4520-8245-ed15f143e7cc None admin] PATH_INFO: `/v3/users/114d4ef1c482491699d91a1a4823ea7e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:55.976223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656e200-e268-4520-8245-ed15f143e7cc None admin] RBAC: Authorizing `identity:get_user(user_id=114d4ef1c482491699d91a1a4823ea7e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:55.977766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656e200-e268-4520-8245-ed15f143e7cc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:55.979795 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 128/266] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:55 2022] GET /identity/v3/users/114d4ef1c482491699d91a1a4823ea7e => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:55.985798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6d2ba-2aaf-4d93-a7bf-857c01ccfc36 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:56.063395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:56.112595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6d2ba-2aaf-4d93-a7bf-857c01ccfc36 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:56.160734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81d774-5171-489e-8dab-6131866dcef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:56.161726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81d774-5171-489e-8dab-6131866dcef9 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:56.162262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81d774-5171-489e-8dab-6131866dcef9 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:56.162719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81d774-5171-489e-8dab-6131866dcef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:56.264370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81d774-5171-489e-8dab-6131866dcef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:56.266260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81d774-5171-489e-8dab-6131866dcef9 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:56.362013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:56.417951 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 139/267] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 03:57:56.423979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656e200-e268-4520-8245-ed15f143e7cc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:56.574127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656e200-e268-4520-8245-ed15f143e7cc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:56.622914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f5183-efd9-4a70-bfa3-a15589820348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:56.623469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f5183-efd9-4a70-bfa3-a15589820348 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:56.623743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f5183-efd9-4a70-bfa3-a15589820348 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:56.624006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f5183-efd9-4a70-bfa3-a15589820348 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:56.630562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f5183-efd9-4a70-bfa3-a15589820348 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:56.632032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f5183-efd9-4a70-bfa3-a15589820348 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:56.633683 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 129/268] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:56 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:56.640240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81d774-5171-489e-8dab-6131866dcef9 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:56.805910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81d774-5171-489e-8dab-6131866dcef9 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:56.853320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0e930-d5f1-4ea5-9bca-86236ae65d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:56.854256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0e930-d5f1-4ea5-9bca-86236ae65d29 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:56.854672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0e930-d5f1-4ea5-9bca-86236ae65d29 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:56.855138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0e930-d5f1-4ea5-9bca-86236ae65d29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:56.856009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0e930-d5f1-4ea5-9bca-86236ae65d29 None admin] RBAC: Adding query filter params (role.id=c8196760d5404ccf95f4bccb62c5a1a3, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22, user.id=114d4ef1c482491699d91a1a4823ea7e) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:56.856454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0e930-d5f1-4ea5-9bca-86236ae65d29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:56.858075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0e930-d5f1-4ea5-9bca-86236ae65d29 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:56.865159 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 140/269] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:56 2022] GET /identity/v3/role_assignments?user.id=114d4ef1c482491699d91a1a4823ea7e&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=c8196760d5404ccf95f4bccb62c5a1a3 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:56.904870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a479d-dec2-43ec-bf2b-9c0d3050550d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:56.905223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a479d-dec2-43ec-bf2b-9c0d3050550d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:56.905600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a479d-dec2-43ec-bf2b-9c0d3050550d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:56.907528 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 130/270] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:56.913643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7315b5-fbec-4a42-b133-ec9d67cd7dff None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:56.914260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7315b5-fbec-4a42-b133-ec9d67cd7dff None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:56.914720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7315b5-fbec-4a42-b133-ec9d67cd7dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:56.939797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fa7315b5-fbec-4a42-b133-ec9d67cd7dff None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:56.941358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fa7315b5-fbec-4a42-b133-ec9d67cd7dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:56.977301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:57.035290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e503-a707-4ef8-9029-08fa77575231 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:57.036176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e503-a707-4ef8-9029-08fa77575231 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:57.036978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e503-a707-4ef8-9029-08fa77575231 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:57.039515 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 131/271] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:57.044338 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 141/272] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:57.046020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d420307-7c0b-483f-83fd-b5175f2811ef None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:57.046300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d420307-7c0b-483f-83fd-b5175f2811ef None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:57.046564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d420307-7c0b-483f-83fd-b5175f2811ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:57.072447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811c798-4ccb-41d2-8e8f-f742b4b565a3 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:57.072765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811c798-4ccb-41d2-8e8f-f742b4b565a3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:57.072985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811c798-4ccb-41d2-8e8f-f742b4b565a3 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:57.074428 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 142/273] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:57:57.079878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362489-ec64-4791-ae8f-f8bb377bd07f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:57.080148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362489-ec64-4791-ae8f-f8bb377bd07f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:57.080419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b362489-ec64-4791-ae8f-f8bb377bd07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:57.087495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9d420307-7c0b-483f-83fd-b5175f2811ef None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:57.089914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9d420307-7c0b-483f-83fd-b5175f2811ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:57.100356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4b362489-ec64-4791-ae8f-f8bb377bd07f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:57.101637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4b362489-ec64-4791-ae8f-f8bb377bd07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:57.131050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:57.187023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 132/274] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:57.209259 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 143/275] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:57:57.346005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d420307-7c0b-483f-83fd-b5175f2811ef None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:57.466752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d420307-7c0b-483f-83fd-b5175f2811ef None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:57.489727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362489-ec64-4791-ae8f-f8bb377bd07f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:57.509181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b67d2b-c823-4378-8a82-64e373d747c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:57.509181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b67d2b-c823-4378-8a82-64e373d747c4 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:57.509181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b67d2b-c823-4378-8a82-64e373d747c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:57.509181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b67d2b-c823-4378-8a82-64e373d747c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:57.510485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b67d2b-c823-4378-8a82-64e373d747c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:57.511968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b67d2b-c823-4378-8a82-64e373d747c4 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:57.513810 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 133/276] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:57:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:57.517698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b67d2b-c823-4378-8a82-64e373d747c4 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:57.552522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:57.602373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:57.615043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b362489-ec64-4791-ae8f-f8bb377bd07f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:57.622840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b67d2b-c823-4378-8a82-64e373d747c4 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:57.649611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ef4f0-67f9-480e-b559-abc553121458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:57.650565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ef4f0-67f9-480e-b559-abc553121458 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:57.650842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ef4f0-67f9-480e-b559-abc553121458 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:57.651101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ef4f0-67f9-480e-b559-abc553121458 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:57.661622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ef4f0-67f9-480e-b559-abc553121458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:57.662477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72398acc-5e89-4e0b-bf46-251a622d3a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:57.663116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72398acc-5e89-4e0b-bf46-251a622d3a4e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:57.663418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72398acc-5e89-4e0b-bf46-251a622d3a4e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:57.663683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72398acc-5e89-4e0b-bf46-251a622d3a4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-a96ef4f0-67f9-480e-b559-abc553121458 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:57.666987 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:57.667848 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:57:57.668634 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 144/277] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:57:57.669276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ef4f0-67f9-480e-b559-abc553121458 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:57.683162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72398acc-5e89-4e0b-bf46-251a622d3a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-72398acc-5e89-4e0b-bf46-251a622d3a4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:57.688200 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:57.689091 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:57.689917 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 134/278] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:57:57.695258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72398acc-5e89-4e0b-bf46-251a622d3a4e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:57.779236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ef4f0-67f9-480e-b559-abc553121458 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:57.802017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:57.809124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72398acc-5e89-4e0b-bf46-251a622d3a4e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:57.814945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17574c0-7c0e-4ad6-b7fa-fba88bd5eeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:57.815562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17574c0-7c0e-4ad6-b7fa-fba88bd5eeff None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:57.815830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17574c0-7c0e-4ad6-b7fa-fba88bd5eeff None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:57.816092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17574c0-7c0e-4ad6-b7fa-fba88bd5eeff None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:57.816738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17574c0-7c0e-4ad6-b7fa-fba88bd5eeff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:57.818643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17574c0-7c0e-4ad6-b7fa-fba88bd5eeff None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:57.841906 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 145/279] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:57:57 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:57:57.841906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17574c0-7c0e-4ad6-b7fa-fba88bd5eeff None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:57.845524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:57.848200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc325e6-bc1a-4da2-b4f7-d3d5f4a90dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:57.848884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc325e6-bc1a-4da2-b4f7-d3d5f4a90dd0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:57.849157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc325e6-bc1a-4da2-b4f7-d3d5f4a90dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:57.849486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc325e6-bc1a-4da2-b4f7-d3d5f4a90dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:57.850175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc325e6-bc1a-4da2-b4f7-d3d5f4a90dd0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:57.850475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc325e6-bc1a-4da2-b4f7-d3d5f4a90dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:57.852007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc325e6-bc1a-4da2-b4f7-d3d5f4a90dd0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:57.861806 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 135/280] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:57.863309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc16c-e66f-4813-b8fc-fdb49c410ce6 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:57.863598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc16c-e66f-4813-b8fc-fdb49c410ce6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:57.863867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fc16c-e66f-4813-b8fc-fdb49c410ce6 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:57.865374 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 136/281] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:57:57.870819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fc16c-e66f-4813-b8fc-fdb49c410ce6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:57.966617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17574c0-7c0e-4ad6-b7fa-fba88bd5eeff None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:57.987745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fc16c-e66f-4813-b8fc-fdb49c410ce6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:58.013098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c457b9-dc1a-4eec-98c8-e0002ff79e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:58.013738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c457b9-dc1a-4eec-98c8-e0002ff79e70 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:58.014022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c457b9-dc1a-4eec-98c8-e0002ff79e70 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:58.014352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c457b9-dc1a-4eec-98c8-e0002ff79e70 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:58.015135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c457b9-dc1a-4eec-98c8-e0002ff79e70 None admin] RBAC: Adding query filter params (name=member) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:58.015432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c457b9-dc1a-4eec-98c8-e0002ff79e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:58.016918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c457b9-dc1a-4eec-98c8-e0002ff79e70 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:58.026977 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 146/282] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:58.027690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786dda3-0340-4044-8973-a91d63060821 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:58.027970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786dda3-0340-4044-8973-a91d63060821 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:58.029960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786dda3-0340-4044-8973-a91d63060821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:58.032291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41b03-1235-4596-bb2b-90fd5802d938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:58.032946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41b03-1235-4596-bb2b-90fd5802d938 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:58.033226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41b03-1235-4596-bb2b-90fd5802d938 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:58.033495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41b03-1235-4596-bb2b-90fd5802d938 None admin] PATH_INFO: `/v3/users/5f806413c52243df871d9b4816304dde` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:58.034744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41b03-1235-4596-bb2b-90fd5802d938 None admin] RBAC: Authorizing `identity:get_user(user_id=5f806413c52243df871d9b4816304dde)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:58.036254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41b03-1235-4596-bb2b-90fd5802d938 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:58.041954 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 137/283] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:57 2022] GET /identity/v3/users/5f806413c52243df871d9b4816304dde => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:58.041954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41b03-1235-4596-bb2b-90fd5802d938 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:58.050663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3786dda3-0340-4044-8973-a91d63060821 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:57:58.051868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3786dda3-0340-4044-8973-a91d63060821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:57:58.071087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:58.127295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:58.137419 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 147/284] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:57:58.138547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786dda3-0340-4044-8973-a91d63060821 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:58.171976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41b03-1235-4596-bb2b-90fd5802d938 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:58.217036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e5668-155f-43a1-9936-254d2839e68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:58.218759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5668-155f-43a1-9936-254d2839e68f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:58.219240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5668-155f-43a1-9936-254d2839e68f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:58.219707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5668-155f-43a1-9936-254d2839e68f None admin] PATH_INFO: `/v3/users/66b1de7a273340c4a35496eff01055a6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:58.239702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e5668-155f-43a1-9936-254d2839e68f None admin] RBAC: Authorizing `identity:get_user(user_id=66b1de7a273340c4a35496eff01055a6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:58.242120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e5668-155f-43a1-9936-254d2839e68f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:58.244852 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 138/285] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:58 2022] GET /identity/v3/users/66b1de7a273340c4a35496eff01055a6 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:58.252488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e5668-155f-43a1-9936-254d2839e68f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:58.271387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786dda3-0340-4044-8973-a91d63060821 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:58.329352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3531-1e1b-48d5-af59-4c17cced629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:58.330028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3531-1e1b-48d5-af59-4c17cced629b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:58.330301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3531-1e1b-48d5-af59-4c17cced629b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:58.330567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3531-1e1b-48d5-af59-4c17cced629b None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:58.333346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3531-1e1b-48d5-af59-4c17cced629b None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:58.334832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3531-1e1b-48d5-af59-4c17cced629b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:58.336501 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 148/286] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:58 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:58.342488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3531-1e1b-48d5-af59-4c17cced629b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:58.413269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:58.442850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:58.459176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e5668-155f-43a1-9936-254d2839e68f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:58.510405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3531-1e1b-48d5-af59-4c17cced629b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:58.520895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da484109-2304-4b27-ba31-f8feaf06759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:58.522479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da484109-2304-4b27-ba31-f8feaf06759e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:58.522938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da484109-2304-4b27-ba31-f8feaf06759e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:58.523661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da484109-2304-4b27-ba31-f8feaf06759e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:58.525091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da484109-2304-4b27-ba31-f8feaf06759e None admin] RBAC: Adding query filter params (role.id=4d5ba4daa0e84cf89f3bc5854a124660, user.id=66b1de7a273340c4a35496eff01055a6, scope.system=all) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:58.525620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da484109-2304-4b27-ba31-f8feaf06759e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:58.527981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da484109-2304-4b27-ba31-f8feaf06759e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:58.534917 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 139/287] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Aug 30 03:57:58 2022] GET /identity/v3/role_assignments?user.id=66b1de7a273340c4a35496eff01055a6&scope.system=all&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:58.535897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da484109-2304-4b27-ba31-f8feaf06759e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:58.567073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488790bb-93d0-4120-91df-711b9ab4f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:58.567948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488790bb-93d0-4120-91df-711b9ab4f6db None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:58.568322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488790bb-93d0-4120-91df-711b9ab4f6db None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:58.568711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488790bb-93d0-4120-91df-711b9ab4f6db None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/users/5f806413c52243df871d9b4816304dde/roles/d2025de3cdb4448182f82d37b6cff368` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:58.575841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488790bb-93d0-4120-91df-711b9ab4f6db None admin] RBAC: Authorizing `identity:create_grant(project_id=bf221b7c1217437ea1cbdbda8e46ed22, user_id=5f806413c52243df871d9b4816304dde, role_id=d2025de3cdb4448182f82d37b6cff368)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:58.577541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488790bb-93d0-4120-91df-711b9ab4f6db None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:58.616660 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 149/288] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:57:58 2022] PUT /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/users/5f806413c52243df871d9b4816304dde/roles/d2025de3cdb4448182f82d37b6cff368 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:57:58.672575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da484109-2304-4b27-ba31-f8feaf06759e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:58.720262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292edc6-01aa-4812-8591-2dc39c9a484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:58.721366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292edc6-01aa-4812-8591-2dc39c9a484e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:58.722373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292edc6-01aa-4812-8591-2dc39c9a484e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:58.722848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292edc6-01aa-4812-8591-2dc39c9a484e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:58.738903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292edc6-01aa-4812-8591-2dc39c9a484e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-7292edc6-01aa-4812-8591-2dc39c9a484e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:57:58.744290 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:57:58.745734 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:57:58.747268 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 140/289] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:57:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:57:58.754736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488790bb-93d0-4120-91df-711b9ab4f6db None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:58.871169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488790bb-93d0-4120-91df-711b9ab4f6db None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:58.904403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:58.916771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a41108-0482-4c66-8867-8785fbe74396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:58.917813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41108-0482-4c66-8867-8785fbe74396 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:58.918142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41108-0482-4c66-8867-8785fbe74396 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:58.918476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41108-0482-4c66-8867-8785fbe74396 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:58.919164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a41108-0482-4c66-8867-8785fbe74396 None admin] RBAC: Adding query filter params (name=member) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:58.919467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a41108-0482-4c66-8867-8785fbe74396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:58.920849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a41108-0482-4c66-8867-8785fbe74396 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:58.930424 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 150/290] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:57:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:57:58.936963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292edc6-01aa-4812-8591-2dc39c9a484e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:58.947331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:59.048408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292edc6-01aa-4812-8591-2dc39c9a484e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:59.085937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec902-075e-4f44-ab7a-4ba645f268f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:59.086586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec902-075e-4f44-ab7a-4ba645f268f7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:59.086862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec902-075e-4f44-ab7a-4ba645f268f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:59.087197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec902-075e-4f44-ab7a-4ba645f268f7 None admin] PATH_INFO: `/v3/users/3b469fea15e54df2bd5fca784a1ecc32` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:59.088991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec902-075e-4f44-ab7a-4ba645f268f7 None admin] RBAC: Authorizing `identity:get_user(user_id=3b469fea15e54df2bd5fca784a1ecc32)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:59.090557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec902-075e-4f44-ab7a-4ba645f268f7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:59.092450 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 141/291] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:57:58 2022] GET /identity/v3/users/3b469fea15e54df2bd5fca784a1ecc32 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:59.098851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a41108-0482-4c66-8867-8785fbe74396 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:59.243085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a41108-0482-4c66-8867-8785fbe74396 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:59.284516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540fe15-47cc-45ad-9efd-3368ffc8bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:59.285141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540fe15-47cc-45ad-9efd-3368ffc8bf79 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:59.285465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540fe15-47cc-45ad-9efd-3368ffc8bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:59.285738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540fe15-47cc-45ad-9efd-3368ffc8bf79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:59.362803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:59.377972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540fe15-47cc-45ad-9efd-3368ffc8bf79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:59.379442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540fe15-47cc-45ad-9efd-3368ffc8bf79 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:59.499047 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 151/292] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:57:59.504939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec902-075e-4f44-ab7a-4ba645f268f7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:59.618233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:59.645807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec902-075e-4f44-ab7a-4ba645f268f7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:59.682981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e9c2b8-615b-4fd1-90d8-99d2237de627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:59.683741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9c2b8-615b-4fd1-90d8-99d2237de627 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:59.684023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9c2b8-615b-4fd1-90d8-99d2237de627 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:59.684294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9c2b8-615b-4fd1-90d8-99d2237de627 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:59.685428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9c2b8-615b-4fd1-90d8-99d2237de627 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:59.687032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e9c2b8-615b-4fd1-90d8-99d2237de627 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:59.688987 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 142/293] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:57:59 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:57:59.694981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540fe15-47cc-45ad-9efd-3368ffc8bf79 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:57:59.818933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:57:59.848379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540fe15-47cc-45ad-9efd-3368ffc8bf79 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:57:59.903599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64466398-1a6a-4656-89e3-2c137eea51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:57:59.904221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64466398-1a6a-4656-89e3-2c137eea51b3 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:57:59.904497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64466398-1a6a-4656-89e3-2c137eea51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:57:59.904765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64466398-1a6a-4656-89e3-2c137eea51b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:57:59.905552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64466398-1a6a-4656-89e3-2c137eea51b3 None admin] RBAC: Adding query filter params (role.id=4d5ba4daa0e84cf89f3bc5854a124660, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22, user.id=3b469fea15e54df2bd5fca784a1ecc32) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:57:59.905858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64466398-1a6a-4656-89e3-2c137eea51b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:57:59.907319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64466398-1a6a-4656-89e3-2c137eea51b3 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:57:59.919066 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 152/294] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:57:59 2022] GET /identity/v3/role_assignments?user.id=3b469fea15e54df2bd5fca784a1ecc32&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:00.288340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c89219-0903-4527-b1e0-31a8acb41793 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:00.288692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c89219-0903-4527-b1e0-31a8acb41793 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:00.288976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c89219-0903-4527-b1e0-31a8acb41793 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:00.291289 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 143/295] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:00.296446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0a1f-dc7c-4059-bab9-998a2270297c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:00.296736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0a1f-dc7c-4059-bab9-998a2270297c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:00.297011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b0a1f-dc7c-4059-bab9-998a2270297c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:00.323753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ef6b0a1f-dc7c-4059-bab9-998a2270297c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:00.325307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ef6b0a1f-dc7c-4059-bab9-998a2270297c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:00.332648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145168-cf1d-4f7a-bec3-f26b73302a38 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:00.332938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145168-cf1d-4f7a-bec3-f26b73302a38 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:00.333194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e145168-cf1d-4f7a-bec3-f26b73302a38 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:00.334598 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 144/296] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:00.342307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b1434-e827-44b9-a7fb-21c2f2f0d563 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:00.342973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b1434-e827-44b9-a7fb-21c2f2f0d563 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:00.343439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b1434-e827-44b9-a7fb-21c2f2f0d563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:00.363174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8c0b1434-e827-44b9-a7fb-21c2f2f0d563 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:00.364687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8c0b1434-e827-44b9-a7fb-21c2f2f0d563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:00.426296 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 153/297] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:00.454275 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 145/298] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:00.705710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b0a1f-dc7c-4059-bab9-998a2270297c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:00.735023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b1434-e827-44b9-a7fb-21c2f2f0d563 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:00.793250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:00.812773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:00.815244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b0a1f-dc7c-4059-bab9-998a2270297c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:00.845702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b1434-e827-44b9-a7fb-21c2f2f0d563 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:00.852748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dcc52-b783-4962-8225-767939315c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:00.853932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dcc52-b783-4962-8225-767939315c34 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:00.854147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dcc52-b783-4962-8225-767939315c34 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:00.854422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dcc52-b783-4962-8225-767939315c34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:00.855553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dcc52-b783-4962-8225-767939315c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:00.857014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dcc52-b783-4962-8225-767939315c34 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:00.858790 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 154/299] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:00.859747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef304-22eb-48b1-b397-19ac3d74d9b2 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:00.860023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef304-22eb-48b1-b397-19ac3d74d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:00.860285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef304-22eb-48b1-b397-19ac3d74d9b2 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:00.861579 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 155/300] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:00.866207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdef304-22eb-48b1-b397-19ac3d74d9b2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:00.887821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e78ea-a4e0-4246-9360-417f48ea9a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:00.888669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e78ea-a4e0-4246-9360-417f48ea9a93 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:00.889019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e78ea-a4e0-4246-9360-417f48ea9a93 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:00.889373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e78ea-a4e0-4246-9360-417f48ea9a93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:00.902822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e78ea-a4e0-4246-9360-417f48ea9a93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-e97e78ea-a4e0-4246-9360-417f48ea9a93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:00.907720 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:00.908590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:58:00.909376 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:00.913668 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 146/301] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:00.914918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75591455-d0a8-4601-a61a-4a5756174211 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:00.915176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75591455-d0a8-4601-a61a-4a5756174211 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:00.915483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75591455-d0a8-4601-a61a-4a5756174211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:00.933646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-75591455-d0a8-4601-a61a-4a5756174211 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:00.934862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-75591455-d0a8-4601-a61a-4a5756174211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:00.976224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdef304-22eb-48b1-b397-19ac3d74d9b2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:01.009154 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 147/302] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:01.010940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75591455-d0a8-4601-a61a-4a5756174211 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:01.012300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b527-5c07-44e3-b538-1d1cf3dd87dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:01.012993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b527-5c07-44e3-b538-1d1cf3dd87dc None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:01.013335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b527-5c07-44e3-b538-1d1cf3dd87dc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:01.013674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b527-5c07-44e3-b538-1d1cf3dd87dc None admin] PATH_INFO: `/v3/groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:01.014728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21b527-5c07-44e3-b538-1d1cf3dd87dc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:01.017236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21b527-5c07-44e3-b538-1d1cf3dd87dc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:01.042066 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 156/303] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Aug 30 03:58:00 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:58:01.093528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:01.145198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75591455-d0a8-4601-a61a-4a5756174211 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:01.184480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5143d-10d7-422b-9157-2d8800f1b6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:01.185503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5143d-10d7-422b-9157-2d8800f1b6cc None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:01.186013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5143d-10d7-422b-9157-2d8800f1b6cc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:01.186478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5143d-10d7-422b-9157-2d8800f1b6cc None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:01.187387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5143d-10d7-422b-9157-2d8800f1b6cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:01.187888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5143d-10d7-422b-9157-2d8800f1b6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:01.189585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5143d-10d7-422b-9157-2d8800f1b6cc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:01.200181 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 148/304] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:01.206056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b527-5c07-44e3-b538-1d1cf3dd87dc None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:01.219314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:01.292701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5143d-10d7-422b-9157-2d8800f1b6cc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:01.325688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b527-5c07-44e3-b538-1d1cf3dd87dc None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:01.364604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c019bf9-8774-4834-baf5-22547e01b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:01.365248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c019bf9-8774-4834-baf5-22547e01b679 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:01.365520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c019bf9-8774-4834-baf5-22547e01b679 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:01.365790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c019bf9-8774-4834-baf5-22547e01b679 None admin] PATH_INFO: `/v3/users/2e27a848539d4d289eb5409f6205b871` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:01.379841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c019bf9-8774-4834-baf5-22547e01b679 None admin] RBAC: Authorizing `identity:get_user(user_id=2e27a848539d4d289eb5409f6205b871)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:01.381323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c019bf9-8774-4834-baf5-22547e01b679 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:01.383039 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 157/305] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:58:01 2022] GET /identity/v3/users/2e27a848539d4d289eb5409f6205b871 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:01.388248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13af7c0-769d-4f10-a962-be2e66a957bd None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:01.388248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13af7c0-769d-4f10-a962-be2e66a957bd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:01.388248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13af7c0-769d-4f10-a962-be2e66a957bd None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:01.388248 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 158/306] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:01.389016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13af7c0-769d-4f10-a962-be2e66a957bd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:01.414464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5143d-10d7-422b-9157-2d8800f1b6cc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:01.440600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:01.452813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056defd9-86a0-49f8-b55a-856d0c539aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:01.453454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056defd9-86a0-49f8-b55a-856d0c539aba None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:01.453728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056defd9-86a0-49f8-b55a-856d0c539aba None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:01.454030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056defd9-86a0-49f8-b55a-856d0c539aba None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:01.463462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:01.464183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056defd9-86a0-49f8-b55a-856d0c539aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-056defd9-86a0-49f8-b55a-856d0c539aba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:01.469239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:01.470242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:01.471065 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 149/307] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:01.471720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b2dc8-9674-4669-a69e-72814e5105e5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:01.472785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b2dc8-9674-4669-a69e-72814e5105e5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:01.472785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b2dc8-9674-4669-a69e-72814e5105e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:01.492647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f00b2dc8-9674-4669-a69e-72814e5105e5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:01.494101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f00b2dc8-9674-4669-a69e-72814e5105e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:01.506023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13af7c0-769d-4f10-a962-be2e66a957bd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:01.543005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af717-7662-4493-8e7b-05b0c921d8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:01.543620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af717-7662-4493-8e7b-05b0c921d8cc None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:01.543891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af717-7662-4493-8e7b-05b0c921d8cc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:01.544161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4af717-7662-4493-8e7b-05b0c921d8cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:01.544887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4af717-7662-4493-8e7b-05b0c921d8cc None admin] RBAC: Adding query filter params (role.id=d2025de3cdb4448182f82d37b6cff368, user.id=2e27a848539d4d289eb5409f6205b871, scope.system=all) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:01.545193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4af717-7662-4493-8e7b-05b0c921d8cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:01.546662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4af717-7662-4493-8e7b-05b0c921d8cc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:01.551684 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 159/308] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Aug 30 03:58:01 2022] GET /identity/v3/role_assignments?user.id=2e27a848539d4d289eb5409f6205b871&scope.system=all&role.id=d2025de3cdb4448182f82d37b6cff368 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:01.562980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af717-7662-4493-8e7b-05b0c921d8cc None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:01.569934 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 150/309] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:01.687328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4af717-7662-4493-8e7b-05b0c921d8cc None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:01.718654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:01.725421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a249a-4308-4c0c-8d8a-e22ad4738a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:01.726283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a249a-4308-4c0c-8d8a-e22ad4738a84 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:01.726698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a249a-4308-4c0c-8d8a-e22ad4738a84 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:01.727128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a249a-4308-4c0c-8d8a-e22ad4738a84 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:01.727952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a249a-4308-4c0c-8d8a-e22ad4738a84 None admin] RBAC: Adding query filter params (name=member) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:01.728397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a249a-4308-4c0c-8d8a-e22ad4738a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:01.730020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a249a-4308-4c0c-8d8a-e22ad4738a84 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:01.738751 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 160/310] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:01.744933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b2dc8-9674-4669-a69e-72814e5105e5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:01.849465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b2dc8-9674-4669-a69e-72814e5105e5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:01.864042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:01.879621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a249a-4308-4c0c-8d8a-e22ad4738a84 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:01.890545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edefa9-3836-42ec-8220-9a4b984d3958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:01.891193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edefa9-3836-42ec-8220-9a4b984d3958 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:01.891471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edefa9-3836-42ec-8220-9a4b984d3958 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:01.891742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edefa9-3836-42ec-8220-9a4b984d3958 None admin] PATH_INFO: `/v3/users/66b1de7a273340c4a35496eff01055a6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:01.892870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edefa9-3836-42ec-8220-9a4b984d3958 None admin] RBAC: Authorizing `identity:get_user(user_id=66b1de7a273340c4a35496eff01055a6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:01.894379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edefa9-3836-42ec-8220-9a4b984d3958 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:01.900848 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 151/311] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:58:01 2022] GET /identity/v3/users/66b1de7a273340c4a35496eff01055a6 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:01.902951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edefa9-3836-42ec-8220-9a4b984d3958 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:02.029917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edefa9-3836-42ec-8220-9a4b984d3958 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:02.046427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a249a-4308-4c0c-8d8a-e22ad4738a84 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:02.066281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09423419-c87c-4455-bd2c-c8d04f88c185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:02.067046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09423419-c87c-4455-bd2c-c8d04f88c185 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:02.067326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09423419-c87c-4455-bd2c-c8d04f88c185 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:02.067598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09423419-c87c-4455-bd2c-c8d04f88c185 None admin] PATH_INFO: `/v3/system/users/66b1de7a273340c4a35496eff01055a6/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:02.069213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09423419-c87c-4455-bd2c-c8d04f88c185 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=66b1de7a273340c4a35496eff01055a6, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:02.070680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09423419-c87c-4455-bd2c-c8d04f88c185 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:02.084575 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 152/312] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Aug 30 03:58:01 2022] PUT /identity/v3/system/users/66b1de7a273340c4a35496eff01055a6/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 03:58:02.090176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9e928-7779-4353-937f-7e4fc4f00308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:02.090934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9e928-7779-4353-937f-7e4fc4f00308 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:02.091277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9e928-7779-4353-937f-7e4fc4f00308 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:02.091611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9e928-7779-4353-937f-7e4fc4f00308 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:02.110164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9e928-7779-4353-937f-7e4fc4f00308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-18e9e928-7779-4353-937f-7e4fc4f00308 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:02.116202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:02.117134 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:02.118392 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 161/313] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:02.125022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09423419-c87c-4455-bd2c-c8d04f88c185 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:02.184806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:02.253372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09423419-c87c-4455-bd2c-c8d04f88c185 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:02.292985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aec86b-2d5f-4a62-89b1-3f137dc32d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:02.294088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec86b-2d5f-4a62-89b1-3f137dc32d3f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:02.294556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec86b-2d5f-4a62-89b1-3f137dc32d3f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:02.295020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec86b-2d5f-4a62-89b1-3f137dc32d3f None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:02.296216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aec86b-2d5f-4a62-89b1-3f137dc32d3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:02.296727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aec86b-2d5f-4a62-89b1-3f137dc32d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:02.299267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aec86b-2d5f-4a62-89b1-3f137dc32d3f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:02.310060 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 153/314] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:02.315346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9e928-7779-4353-937f-7e4fc4f00308 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:02.388200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:02.443977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9e928-7779-4353-937f-7e4fc4f00308 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:02.479793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a080a27-ea18-4b52-8168-bbc238332e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:02.480441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a080a27-ea18-4b52-8168-bbc238332e99 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:02.480718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a080a27-ea18-4b52-8168-bbc238332e99 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:02.480988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a080a27-ea18-4b52-8168-bbc238332e99 None admin] PATH_INFO: `/v3/users/5f806413c52243df871d9b4816304dde` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:02.482171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a080a27-ea18-4b52-8168-bbc238332e99 None admin] RBAC: Authorizing `identity:get_user(user_id=5f806413c52243df871d9b4816304dde)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:02.483697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a080a27-ea18-4b52-8168-bbc238332e99 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:02.485694 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 162/315] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:58:02 2022] GET /identity/v3/users/5f806413c52243df871d9b4816304dde => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:02.491542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aec86b-2d5f-4a62-89b1-3f137dc32d3f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:02.595975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aec86b-2d5f-4a62-89b1-3f137dc32d3f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:02.606281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:02.631887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d93e8e-0781-4227-af79-5868da674d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:02.632518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d93e8e-0781-4227-af79-5868da674d08 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:02.632799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d93e8e-0781-4227-af79-5868da674d08 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:02.633069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d93e8e-0781-4227-af79-5868da674d08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:02.703750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d93e8e-0781-4227-af79-5868da674d08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:02.705311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d93e8e-0781-4227-af79-5868da674d08 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:02.813658 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 154/316] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:02.819683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a080a27-ea18-4b52-8168-bbc238332e99 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:02.930331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a080a27-ea18-4b52-8168-bbc238332e99 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:02.951542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:02.972084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35643f79-7064-4963-b53c-27e04b0d758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:02.973084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643f79-7064-4963-b53c-27e04b0d758a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:02.973356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643f79-7064-4963-b53c-27e04b0d758a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:02.973620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35643f79-7064-4963-b53c-27e04b0d758a None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:02.974787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35643f79-7064-4963-b53c-27e04b0d758a None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:02.976237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35643f79-7064-4963-b53c-27e04b0d758a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:02.978323 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 163/317] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:02 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:02.984461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d93e8e-0781-4227-af79-5868da674d08 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:02.998248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:03.088078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d93e8e-0781-4227-af79-5868da674d08 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:03.106949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c5557-e27c-48af-8e7f-eb10485ccf20 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:03.107256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c5557-e27c-48af-8e7f-eb10485ccf20 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:03.107500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c5557-e27c-48af-8e7f-eb10485ccf20 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:03.109127 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 164/318] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:03.114107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3850-7020-4c5e-ae4e-560c84fc2c6e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:03.114387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3850-7020-4c5e-ae4e-560c84fc2c6e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:03.114655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3850-7020-4c5e-ae4e-560c84fc2c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:03.122886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9989e-9cc4-4209-88be-68c03396bbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:03.123596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9989e-9cc4-4209-88be-68c03396bbfa None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:03.123860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9989e-9cc4-4209-88be-68c03396bbfa None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:03.124126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9989e-9cc4-4209-88be-68c03396bbfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:03.124911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9989e-9cc4-4209-88be-68c03396bbfa None admin] RBAC: Adding query filter params (role.id=d2025de3cdb4448182f82d37b6cff368, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22, user.id=5f806413c52243df871d9b4816304dde) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:03.125214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9989e-9cc4-4209-88be-68c03396bbfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:03.126691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9989e-9cc4-4209-88be-68c03396bbfa None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:03.132996 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 155/319] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:02 2022] GET /identity/v3/role_assignments?user.id=5f806413c52243df871d9b4816304dde&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=d2025de3cdb4448182f82d37b6cff368 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:03.136794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a6dc3850-7020-4c5e-ae4e-560c84fc2c6e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:03.138065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a6dc3850-7020-4c5e-ae4e-560c84fc2c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:03.223490 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 165/320] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:03.493348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9989e-9cc4-4209-88be-68c03396bbfa None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:03.571013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:03.602329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9989e-9cc4-4209-88be-68c03396bbfa None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:03.638998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72366-35b6-4401-ad85-8502ea221ba4 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:03.639283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72366-35b6-4401-ad85-8502ea221ba4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:03.639552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72366-35b6-4401-ad85-8502ea221ba4 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:03.641171 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 166/321] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:03.642097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99018889-11b6-4498-8d47-5251a931290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:03.642750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99018889-11b6-4498-8d47-5251a931290a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:03.643041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99018889-11b6-4498-8d47-5251a931290a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:03.643312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99018889-11b6-4498-8d47-5251a931290a None admin] PATH_INFO: `/v3/domains/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:03.644467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99018889-11b6-4498-8d47-5251a931290a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:03.645986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99018889-11b6-4498-8d47-5251a931290a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:03.646272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aafa3-c717-4289-bacb-45d724d7b619 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:03.646756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aafa3-c717-4289-bacb-45d724d7b619 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:03.647211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aafa3-c717-4289-bacb-45d724d7b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:03.647546 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 156/322] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:03.652985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99018889-11b6-4498-8d47-5251a931290a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:03.666399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-548aafa3-c717-4289-bacb-45d724d7b619 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:03.667925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-548aafa3-c717-4289-bacb-45d724d7b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:03.743303 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 167/323] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:03.762818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99018889-11b6-4498-8d47-5251a931290a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:03.798069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074032a-f9fa-4816-b853-30b6cc28383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:03.798683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074032a-f9fa-4816-b853-30b6cc28383f None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:03.798957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074032a-f9fa-4816-b853-30b6cc28383f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:03.799222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074032a-f9fa-4816-b853-30b6cc28383f None admin] PATH_INFO: `/v3/groups` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:03.799868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074032a-f9fa-4816-b853-30b6cc28383f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:03.801336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074032a-f9fa-4816-b853-30b6cc28383f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:03.817925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:03.830467 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 157/324] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Aug 30 03:58:03 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:58:04.007710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aafa3-c717-4289-bacb-45d724d7b619 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:04.058554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:04.117352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aafa3-c717-4289-bacb-45d724d7b619 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:04.142591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4f3c-72e6-4e22-b366-07aed7e548f5 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:04.142895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4f3c-72e6-4e22-b366-07aed7e548f5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:04.143148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4f3c-72e6-4e22-b366-07aed7e548f5 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:04.144488 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 158/325] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:04.149906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1282e7-a0a8-4c74-8a54-173507d6dc6c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:04.150330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1282e7-a0a8-4c74-8a54-173507d6dc6c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:04.150785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1282e7-a0a8-4c74-8a54-173507d6dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:04.154321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f697b2-d29a-4abc-af01-ced73c0c811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:04.155341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f697b2-d29a-4abc-af01-ced73c0c811c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:04.155341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f697b2-d29a-4abc-af01-ced73c0c811c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:04.155539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f697b2-d29a-4abc-af01-ced73c0c811c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:04.168375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f697b2-d29a-4abc-af01-ced73c0c811c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:04.172340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-db1282e7-a0a8-4c74-8a54-173507d6dc6c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-78f697b2-d29a-4abc-af01-ced73c0c811c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:04.172700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:04.173545 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:58:04.174594 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:04.175179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-db1282e7-a0a8-4c74-8a54-173507d6dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:04.175247 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 168/326] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:04.181670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f697b2-d29a-4abc-af01-ced73c0c811c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:04.255025 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 159/327] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:04.308092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f697b2-d29a-4abc-af01-ced73c0c811c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:04.318227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:04.348556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312dc5-50cf-414f-b5cf-85def66dd7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:04.349172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312dc5-50cf-414f-b5cf-85def66dd7d6 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:04.349444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312dc5-50cf-414f-b5cf-85def66dd7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:04.349706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312dc5-50cf-414f-b5cf-85def66dd7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:04.350405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66312dc5-50cf-414f-b5cf-85def66dd7d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:04.350703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66312dc5-50cf-414f-b5cf-85def66dd7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:04.352074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66312dc5-50cf-414f-b5cf-85def66dd7d6 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:04.364374 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 169/328] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:04.366881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1282e7-a0a8-4c74-8a54-173507d6dc6c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:04.485680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1282e7-a0a8-4c74-8a54-173507d6dc6c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:04.518617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:04.525138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60a05d-c795-437a-9e9e-b670d923cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:04.526824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60a05d-c795-437a-9e9e-b670d923cf69 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:04.527305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60a05d-c795-437a-9e9e-b670d923cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:04.527795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60a05d-c795-437a-9e9e-b670d923cf69 None admin] PATH_INFO: `/v3/users/2e27a848539d4d289eb5409f6205b871` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:04.529152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60a05d-c795-437a-9e9e-b670d923cf69 None admin] RBAC: Authorizing `identity:get_user(user_id=2e27a848539d4d289eb5409f6205b871)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:04.530911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60a05d-c795-437a-9e9e-b670d923cf69 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:04.533102 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 160/329] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:58:04 2022] GET /identity/v3/users/2e27a848539d4d289eb5409f6205b871 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:04.538727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312dc5-50cf-414f-b5cf-85def66dd7d6 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:04.552916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60a05d-c795-437a-9e9e-b670d923cf69 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:04.682904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312dc5-50cf-414f-b5cf-85def66dd7d6 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:04.683104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60a05d-c795-437a-9e9e-b670d923cf69 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:04.723057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a89b72-4622-4add-b34e-eb6cc74ff3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:04.723722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a89b72-4622-4add-b34e-eb6cc74ff3c9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:04.723997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a89b72-4622-4add-b34e-eb6cc74ff3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:04.724263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a89b72-4622-4add-b34e-eb6cc74ff3c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:04.730162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424c2bd-9f14-4693-94d4-31357c34c134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:04.731284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424c2bd-9f14-4693-94d4-31357c34c134 None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:04.731938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424c2bd-9f14-4693-94d4-31357c34c134 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:04.732409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424c2bd-9f14-4693-94d4-31357c34c134 None admin] PATH_INFO: `/v3/system/users/2e27a848539d4d289eb5409f6205b871/roles/d2025de3cdb4448182f82d37b6cff368` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:04.734386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424c2bd-9f14-4693-94d4-31357c34c134 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2e27a848539d4d289eb5409f6205b871, role_id=d2025de3cdb4448182f82d37b6cff368)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:04.735407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a89b72-4622-4add-b34e-eb6cc74ff3c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:04.736440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a424c2bd-9f14-4693-94d4-31357c34c134 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-a4a89b72-4622-4add-b34e-eb6cc74ff3c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:04.741000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:04.741943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:04.742753 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 161/330] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:04.749089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a89b72-4622-4add-b34e-eb6cc74ff3c9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:04.756628 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 170/331] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Aug 30 03:58:04 2022] PUT /identity/v3/system/users/2e27a848539d4d289eb5409f6205b871/roles/d2025de3cdb4448182f82d37b6cff368 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:58:04.824710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:04.873570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a89b72-4622-4add-b34e-eb6cc74ff3c9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:04.911318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76343fa-7020-41ea-b25f-847795a7596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:04.911867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76343fa-7020-41ea-b25f-847795a7596e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:04.912144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76343fa-7020-41ea-b25f-847795a7596e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:04.912410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76343fa-7020-41ea-b25f-847795a7596e None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:04.913092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76343fa-7020-41ea-b25f-847795a7596e None admin] RBAC: Adding query filter params (name=member) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:04.913395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76343fa-7020-41ea-b25f-847795a7596e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:04.914849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76343fa-7020-41ea-b25f-847795a7596e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:04.925201 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 162/332] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:04.931237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424c2bd-9f14-4693-94d4-31357c34c134 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:04.978453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:05.052920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424c2bd-9f14-4693-94d4-31357c34c134 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:05.093157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbe14f-8435-4b93-9cc8-eb185139bf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:05.093823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbe14f-8435-4b93-9cc8-eb185139bf4b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:05.095236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbe14f-8435-4b93-9cc8-eb185139bf4b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:05.095236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbe14f-8435-4b93-9cc8-eb185139bf4b None admin] PATH_INFO: `/v3/users/66b1de7a273340c4a35496eff01055a6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:05.098653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbe14f-8435-4b93-9cc8-eb185139bf4b None admin] RBAC: Authorizing `identity:get_user(user_id=66b1de7a273340c4a35496eff01055a6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:05.100150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbe14f-8435-4b93-9cc8-eb185139bf4b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:05.102129 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 171/333] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:58:04 2022] GET /identity/v3/users/66b1de7a273340c4a35496eff01055a6 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:05.109110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76343fa-7020-41ea-b25f-847795a7596e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:05.250394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76343fa-7020-41ea-b25f-847795a7596e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:05.273456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:05.288421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e46bc6-0e85-4898-b29d-15c9a07c4b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:05.289538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e46bc6-0e85-4898-b29d-15c9a07c4b4f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:05.290189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e46bc6-0e85-4898-b29d-15c9a07c4b4f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:05.290931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e46bc6-0e85-4898-b29d-15c9a07c4b4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:05.291680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e46bc6-0e85-4898-b29d-15c9a07c4b4f None admin] RBAC: Adding query filter params (role.id=4d5ba4daa0e84cf89f3bc5854a124660, user.id=66b1de7a273340c4a35496eff01055a6, scope.system=all) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:05.291989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e46bc6-0e85-4898-b29d-15c9a07c4b4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:05.293443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e46bc6-0e85-4898-b29d-15c9a07c4b4f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:05.305671 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 163/334] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Aug 30 03:58:05 2022] GET /identity/v3/role_assignments?user.id=66b1de7a273340c4a35496eff01055a6&scope.system=all&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:06.081491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537ee53-189a-4c40-b3b0-572864605ec9 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:06.082072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537ee53-189a-4c40-b3b0-572864605ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:06.082072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537ee53-189a-4c40-b3b0-572864605ec9 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:06.083638 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 172/335] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:06.089190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf5407-d0e6-4573-8127-345a2a726021 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:06.089623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf5407-d0e6-4573-8127-345a2a726021 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:06.089814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf5407-d0e6-4573-8127-345a2a726021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:06.110593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-dcdf5407-d0e6-4573-8127-345a2a726021 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:06.111782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dcdf5407-d0e6-4573-8127-345a2a726021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:06.189187 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 164/336] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:06.605209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537ee53-189a-4c40-b3b0-572864605ec9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:06.750928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537ee53-189a-4c40-b3b0-572864605ec9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:06.752565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:06.757412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ff44-848c-49fa-84b7-22a229e816aa None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:06.758032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ff44-848c-49fa-84b7-22a229e816aa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:06.758490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253ff44-848c-49fa-84b7-22a229e816aa None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:06.760355 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 165/337] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:06.770370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b48e5-223a-48ca-bc13-1e3bd34a9f86 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:06.770940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b48e5-223a-48ca-bc13-1e3bd34a9f86 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:06.771542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b48e5-223a-48ca-bc13-1e3bd34a9f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:06.794038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-784b48e5-223a-48ca-bc13-1e3bd34a9f86 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:06.795572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-784b48e5-223a-48ca-bc13-1e3bd34a9f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:06.799020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d5591-f7d3-4634-b80f-90993d39e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:06.799678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5591-f7d3-4634-b80f-90993d39e052 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:06.799954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5591-f7d3-4634-b80f-90993d39e052 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:06.800225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5591-f7d3-4634-b80f-90993d39e052 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:06.826594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d5591-f7d3-4634-b80f-90993d39e052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-471d5591-f7d3-4634-b80f-90993d39e052 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:06.833311 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:06.834252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:06.835023 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:06.840943 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 173/338] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:06.846127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d5591-f7d3-4634-b80f-90993d39e052 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:06.915465 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 166/339] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:07.001128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d5591-f7d3-4634-b80f-90993d39e052 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:07.037725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87726650-f258-47ff-9a96-2f2810a3cc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:07.038763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726650-f258-47ff-9a96-2f2810a3cc12 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:07.039243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726650-f258-47ff-9a96-2f2810a3cc12 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:07.039694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87726650-f258-47ff-9a96-2f2810a3cc12 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:07.040607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87726650-f258-47ff-9a96-2f2810a3cc12 None admin] RBAC: Adding query filter params (name=member) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:07.041138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87726650-f258-47ff-9a96-2f2810a3cc12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:07.042752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87726650-f258-47ff-9a96-2f2810a3cc12 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:07.051919 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 174/340] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:07.057670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b48e5-223a-48ca-bc13-1e3bd34a9f86 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:07.114280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:07.193550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b48e5-223a-48ca-bc13-1e3bd34a9f86 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:07.230262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d826863-ed13-440b-8173-d6ab988715f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:07.230876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d826863-ed13-440b-8173-d6ab988715f3 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:07.231148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d826863-ed13-440b-8173-d6ab988715f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:07.231415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d826863-ed13-440b-8173-d6ab988715f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:07.329990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d826863-ed13-440b-8173-d6ab988715f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:07.329990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d826863-ed13-440b-8173-d6ab988715f3 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:07.382582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:07.472186 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 167/341] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 03:58:07.478490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87726650-f258-47ff-9a96-2f2810a3cc12 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:07.504183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf023f0-60c7-4189-8eb0-f8ef58dd9d25 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:07.504522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf023f0-60c7-4189-8eb0-f8ef58dd9d25 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:07.513403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf023f0-60c7-4189-8eb0-f8ef58dd9d25 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:07.518480 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 168/342] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:07 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:07.524987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cd31f-93a2-4e92-81e1-0ccfaf79e7ad None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:07.525589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cd31f-93a2-4e92-81e1-0ccfaf79e7ad None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:07.526018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cd31f-93a2-4e92-81e1-0ccfaf79e7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:07.558043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:07.575042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-465cd31f-93a2-4e92-81e1-0ccfaf79e7ad None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:07.579678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-465cd31f-93a2-4e92-81e1-0ccfaf79e7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:07.676940 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 169/343] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:07.681007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cd31f-93a2-4e92-81e1-0ccfaf79e7ad None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:07.767501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:07.791551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87726650-f258-47ff-9a96-2f2810a3cc12 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:07.806739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cd31f-93a2-4e92-81e1-0ccfaf79e7ad None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:07.855118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e7ea3-f77b-4370-8fa8-6c493e7ac9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:07.856137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e7ea3-f77b-4370-8fa8-6c493e7ac9b5 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:07.856662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e7ea3-f77b-4370-8fa8-6c493e7ac9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:07.857129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e7ea3-f77b-4370-8fa8-6c493e7ac9b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:07.869335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bacae-404d-4d80-87aa-d2d432574f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:07.870720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bacae-404d-4d80-87aa-d2d432574f11 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:07.871223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bacae-404d-4d80-87aa-d2d432574f11 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:07.871692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bacae-404d-4d80-87aa-d2d432574f11 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:07.871860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e7ea3-f77b-4370-8fa8-6c493e7ac9b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:07.873216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bacae-404d-4d80-87aa-d2d432574f11 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:07.874898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bacae-404d-4d80-87aa-d2d432574f11 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-2f5e7ea3-f77b-4370-8fa8-6c493e7ac9b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:07.876877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:07.877761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:07.878588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:07.879180 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 170/345] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:58:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:07.879706 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 175/345] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:07 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:07.882202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e7ea3-f77b-4370-8fa8-6c493e7ac9b5 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:07.884761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bacae-404d-4d80-87aa-d2d432574f11 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:08.048380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:08.055421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e7ea3-f77b-4370-8fa8-6c493e7ac9b5 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:08.064943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bacae-404d-4d80-87aa-d2d432574f11 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:08.089968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:08.092914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f653b71-76de-493f-8ee7-7c4ce06ac520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:08.093628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f653b71-76de-493f-8ee7-7c4ce06ac520 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:08.093894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f653b71-76de-493f-8ee7-7c4ce06ac520 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:08.094170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f653b71-76de-493f-8ee7-7c4ce06ac520 None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:08.102793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f653b71-76de-493f-8ee7-7c4ce06ac520 None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:08.104420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f653b71-76de-493f-8ee7-7c4ce06ac520 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:08.109143 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 171/346] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:07 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:08.109387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d3bc6-84a8-42aa-a879-c8ee56462ba4 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:08.109614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d3bc6-84a8-42aa-a879-c8ee56462ba4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:08.109909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d3bc6-84a8-42aa-a879-c8ee56462ba4 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:08.112919 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 172/347] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:08.114782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d3bc6-84a8-42aa-a879-c8ee56462ba4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:08.126760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835d362-5c77-44b1-9fc0-c8f63c3bf866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:08.127749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d362-5c77-44b1-9fc0-c8f63c3bf866 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:08.128218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d362-5c77-44b1-9fc0-c8f63c3bf866 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:08.128676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835d362-5c77-44b1-9fc0-c8f63c3bf866 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:08.129539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835d362-5c77-44b1-9fc0-c8f63c3bf866 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:08.130077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835d362-5c77-44b1-9fc0-c8f63c3bf866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:08.131652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835d362-5c77-44b1-9fc0-c8f63c3bf866 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:08.143858 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 176/348] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:08.145111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835d362-5c77-44b1-9fc0-c8f63c3bf866 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:08.231878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d3bc6-84a8-42aa-a879-c8ee56462ba4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:08.268216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835d362-5c77-44b1-9fc0-c8f63c3bf866 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:08.269216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0efaa-8f4f-468f-9d60-b36cd278a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:08.269904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0efaa-8f4f-468f-9d60-b36cd278a796 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:08.270201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0efaa-8f4f-468f-9d60-b36cd278a796 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:08.270470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0efaa-8f4f-468f-9d60-b36cd278a796 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:08.271304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0efaa-8f4f-468f-9d60-b36cd278a796 None admin] RBAC: Adding query filter params (group.id=5a4a061b111442cbb357bbe71593a71c, role.id=4d5ba4daa0e84cf89f3bc5854a124660, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:08.271609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0efaa-8f4f-468f-9d60-b36cd278a796 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:08.273164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0efaa-8f4f-468f-9d60-b36cd278a796 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:08.280725 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 173/349] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 03:58:08 2022] GET /identity/v3/role_assignments?group.id=5a4a061b111442cbb357bbe71593a71c&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:08.282174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267cd87-0603-4a13-9c39-675f6ec30d4e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:08.282456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267cd87-0603-4a13-9c39-675f6ec30d4e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:08.282729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267cd87-0603-4a13-9c39-675f6ec30d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:08.303078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6267cd87-0603-4a13-9c39-675f6ec30d4e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:08.304318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6267cd87-0603-4a13-9c39-675f6ec30d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:08.314226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89469237-abf6-43bc-8f2c-5389466ec18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:08.315259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89469237-abf6-43bc-8f2c-5389466ec18d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:08.315750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89469237-abf6-43bc-8f2c-5389466ec18d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:08.316570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89469237-abf6-43bc-8f2c-5389466ec18d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:08.331610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89469237-abf6-43bc-8f2c-5389466ec18d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-89469237-abf6-43bc-8f2c-5389466ec18d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:08.340113 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:08.341098 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 03:58:08.341957 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:08.343660 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 177/350] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:08.344046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89469237-abf6-43bc-8f2c-5389466ec18d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:08.364947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:08.374346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:08.391037 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 174/351] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:08.397938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267cd87-0603-4a13-9c39-675f6ec30d4e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:08.499952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89469237-abf6-43bc-8f2c-5389466ec18d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:08.578793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d88ba-e605-48a7-8ae2-81bdcfdf54ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:08.579344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d88ba-e605-48a7-8ae2-81bdcfdf54ec None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:08.579618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d88ba-e605-48a7-8ae2-81bdcfdf54ec None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:08.579885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d88ba-e605-48a7-8ae2-81bdcfdf54ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:08.612286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267cd87-0603-4a13-9c39-675f6ec30d4e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:08.656202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e914c5-7677-4818-b10f-bcb67aa282ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:08.656921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e914c5-7677-4818-b10f-bcb67aa282ce None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:08.657196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e914c5-7677-4818-b10f-bcb67aa282ce None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:08.657469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e914c5-7677-4818-b10f-bcb67aa282ce None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:08.658206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e914c5-7677-4818-b10f-bcb67aa282ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:08.658506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e914c5-7677-4818-b10f-bcb67aa282ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:08.659906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e914c5-7677-4818-b10f-bcb67aa282ce None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:08.664690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d88ba-e605-48a7-8ae2-81bdcfdf54ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:08.667651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d88ba-e605-48a7-8ae2-81bdcfdf54ec None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:08.669775 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 175/352] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:08.675284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea79806-0ede-4911-8bc0-3be00ce488ac None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:08.675572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea79806-0ede-4911-8bc0-3be00ce488ac None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:08.675847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea79806-0ede-4911-8bc0-3be00ce488ac None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:08.677444 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 176/353] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:08.685639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cb0cf-fc58-4b12-b14f-442fe73fc795 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:08.685639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cb0cf-fc58-4b12-b14f-442fe73fc795 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:08.685639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cb0cf-fc58-4b12-b14f-442fe73fc795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:08.694877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:08.722158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-110cb0cf-fc58-4b12-b14f-442fe73fc795 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:08.723997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-110cb0cf-fc58-4b12-b14f-442fe73fc795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:08.781297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:08.811876 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 177/354] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:08.812749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cb0cf-fc58-4b12-b14f-442fe73fc795 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:08.813688 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 178/355] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:08.814740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d88ba-e605-48a7-8ae2-81bdcfdf54ec None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:08.967156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cb0cf-fc58-4b12-b14f-442fe73fc795 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:08.989912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d88ba-e605-48a7-8ae2-81bdcfdf54ec None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:09.009756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bdd22-1284-4f29-bbd3-e22d16bb5d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:09.010284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:09.010471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bdd22-1284-4f29-bbd3-e22d16bb5d71 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.010753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bdd22-1284-4f29-bbd3-e22d16bb5d71 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.011024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bdd22-1284-4f29-bbd3-e22d16bb5d71 None admin] PATH_INFO: `/v3/users/2e27a848539d4d289eb5409f6205b871` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.015845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bdd22-1284-4f29-bbd3-e22d16bb5d71 None admin] RBAC: Authorizing `identity:get_user(user_id=2e27a848539d4d289eb5409f6205b871)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:09.017338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bdd22-1284-4f29-bbd3-e22d16bb5d71 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:09.019181 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 178/356] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:58:08 2022] GET /identity/v3/users/2e27a848539d4d289eb5409f6205b871 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:09.019782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bdd22-1284-4f29-bbd3-e22d16bb5d71 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:09.044271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b548e29-7d59-46e4-8ddc-93d3af51fd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:09.044912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b548e29-7d59-46e4-8ddc-93d3af51fd87 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.045186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b548e29-7d59-46e4-8ddc-93d3af51fd87 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.045459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b548e29-7d59-46e4-8ddc-93d3af51fd87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.062729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b548e29-7d59-46e4-8ddc-93d3af51fd87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-8b548e29-7d59-46e4-8ddc-93d3af51fd87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:09.070467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:09.071376 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:09.072178 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 179/357] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:09.073356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2696b4-583f-4b72-8166-da20f8416322 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.073676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2696b4-583f-4b72-8166-da20f8416322 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.073996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2696b4-583f-4b72-8166-da20f8416322 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.075271 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 180/358] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:09.075981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2696b4-583f-4b72-8166-da20f8416322 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:09.083454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:09.140356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bdd22-1284-4f29-bbd3-e22d16bb5d71 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:09.178914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ccfec-df82-45de-a1fe-2827a6a8fc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:09.179968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ccfec-df82-45de-a1fe-2827a6a8fc36 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.180444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ccfec-df82-45de-a1fe-2827a6a8fc36 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.180903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ccfec-df82-45de-a1fe-2827a6a8fc36 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.182393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ccfec-df82-45de-a1fe-2827a6a8fc36 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:09.184066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ccfec-df82-45de-a1fe-2827a6a8fc36 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:09.185966 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 179/359] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:09 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:09.186926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ccfec-df82-45de-a1fe-2827a6a8fc36 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:09.216454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2696b4-583f-4b72-8166-da20f8416322 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:09.264766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863f518-9cdf-44eb-9094-108b651f15dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:09.265315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863f518-9cdf-44eb-9094-108b651f15dd None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.265588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863f518-9cdf-44eb-9094-108b651f15dd None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.265944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863f518-9cdf-44eb-9094-108b651f15dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.266689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863f518-9cdf-44eb-9094-108b651f15dd None admin] RBAC: Adding query filter params (role.id=d2025de3cdb4448182f82d37b6cff368, user.id=2e27a848539d4d289eb5409f6205b871, scope.system=all) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:09.266998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863f518-9cdf-44eb-9094-108b651f15dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:09.268604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c863f518-9cdf-44eb-9094-108b651f15dd None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:09.285443 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 181/360] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Aug 30 03:58:09 2022] GET /identity/v3/role_assignments?user.id=2e27a848539d4d289eb5409f6205b871&scope.system=all&role.id=d2025de3cdb4448182f82d37b6cff368 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:09.287016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd174-d844-4531-9949-da4cc612b6b8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.287125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd174-d844-4531-9949-da4cc612b6b8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.288456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd174-d844-4531-9949-da4cc612b6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.308724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-17ecd174-d844-4531-9949-da4cc612b6b8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:09.310002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-17ecd174-d844-4531-9949-da4cc612b6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:09.315843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ccfec-df82-45de-a1fe-2827a6a8fc36 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:09.339478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:09.344499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:09.362027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fccd89-a6cd-411a-9baa-ff19a358ac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:09.362651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fccd89-a6cd-411a-9baa-ff19a358ac62 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.363288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fccd89-a6cd-411a-9baa-ff19a358ac62 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.363559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fccd89-a6cd-411a-9baa-ff19a358ac62 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.364551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fccd89-a6cd-411a-9baa-ff19a358ac62 None admin] RBAC: Adding query filter params (name=member) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:09.364858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fccd89-a6cd-411a-9baa-ff19a358ac62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:09.366643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fccd89-a6cd-411a-9baa-ff19a358ac62 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:09.379421 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 180/361] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:09.380418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fccd89-a6cd-411a-9baa-ff19a358ac62 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:09.389708 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 182/362] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:09.391967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecd174-d844-4531-9949-da4cc612b6b8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:09.510900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fccd89-a6cd-411a-9baa-ff19a358ac62 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:09.511617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecd174-d844-4531-9949-da4cc612b6b8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:09.552015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21611a-98eb-459b-be0d-b8d34a1c0815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:09.552924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21611a-98eb-459b-be0d-b8d34a1c0815 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.553204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21611a-98eb-459b-be0d-b8d34a1c0815 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.553472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21611a-98eb-459b-be0d-b8d34a1c0815 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.560590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76379ca7-484d-4f18-aee5-674e8c176094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:09.561354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76379ca7-484d-4f18-aee5-674e8c176094 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.561781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76379ca7-484d-4f18-aee5-674e8c176094 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.562197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76379ca7-484d-4f18-aee5-674e8c176094 None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.563425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76379ca7-484d-4f18-aee5-674e8c176094 None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:09.564973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76379ca7-484d-4f18-aee5-674e8c176094 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:09.565981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21611a-98eb-459b-be0d-b8d34a1c0815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:09.566797 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 181/363] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:09 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:09.568265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76379ca7-484d-4f18-aee5-674e8c176094 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-1a21611a-98eb-459b-be0d-b8d34a1c0815 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:09.571210 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:09.572084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:09.574446 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 183/364] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:58:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:09.575930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21611a-98eb-459b-be0d-b8d34a1c0815 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:09.606263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:09.632227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:09.699178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21611a-98eb-459b-be0d-b8d34a1c0815 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:09.706600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76379ca7-484d-4f18-aee5-674e8c176094 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:09.751796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddf57f-29a5-4567-8b4c-7efc08852db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:09.752592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf57f-29a5-4567-8b4c-7efc08852db1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.752964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf57f-29a5-4567-8b4c-7efc08852db1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.753331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf57f-29a5-4567-8b4c-7efc08852db1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.754216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddf57f-29a5-4567-8b4c-7efc08852db1 None admin] RBAC: Adding query filter params (group.id=5a4a061b111442cbb357bbe71593a71c, role.id=c8196760d5404ccf95f4bccb62c5a1a3, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:09.754623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddf57f-29a5-4567-8b4c-7efc08852db1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:09.756250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ddf57f-29a5-4567-8b4c-7efc08852db1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:09.757451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ca2da-4e7f-43c7-a0ae-0a7c6e619d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:09.758101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ca2da-4e7f-43c7-a0ae-0a7c6e619d51 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.758380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ca2da-4e7f-43c7-a0ae-0a7c6e619d51 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.758704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ca2da-4e7f-43c7-a0ae-0a7c6e619d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.763144 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 184/365] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 03:58:09 2022] GET /identity/v3/role_assignments?group.id=5a4a061b111442cbb357bbe71593a71c&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=c8196760d5404ccf95f4bccb62c5a1a3 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:09.764130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddf57f-29a5-4567-8b4c-7efc08852db1 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:09.855243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ca2da-4e7f-43c7-a0ae-0a7c6e619d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:09.856534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ca2da-4e7f-43c7-a0ae-0a7c6e619d51 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:09.866320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:09.895518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddf57f-29a5-4567-8b4c-7efc08852db1 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:09.920969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:09.941833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9d31a-bbde-42df-beb3-7a80af6ecf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:09.943202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d31a-bbde-42df-beb3-7a80af6ecf0d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:09.943674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d31a-bbde-42df-beb3-7a80af6ecf0d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:09.943855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9d31a-bbde-42df-beb3-7a80af6ecf0d None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:09.944494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9d31a-bbde-42df-beb3-7a80af6ecf0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:09.944797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9d31a-bbde-42df-beb3-7a80af6ecf0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:09.946198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9d31a-bbde-42df-beb3-7a80af6ecf0d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:09.955222 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 185/366] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:09.956050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9d31a-bbde-42df-beb3-7a80af6ecf0d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:09.987499 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 182/367] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:09.988899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ca2da-4e7f-43c7-a0ae-0a7c6e619d51 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:10.073973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9d31a-bbde-42df-beb3-7a80af6ecf0d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:10.116580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89090ea4-0df1-43ba-afa4-b26d43f99931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:10.117133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89090ea4-0df1-43ba-afa4-b26d43f99931 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:10.117408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89090ea4-0df1-43ba-afa4-b26d43f99931 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:10.117675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89090ea4-0df1-43ba-afa4-b26d43f99931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:10.118524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ca2da-4e7f-43c7-a0ae-0a7c6e619d51 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:10.129642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89090ea4-0df1-43ba-afa4-b26d43f99931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-89090ea4-0df1-43ba-afa4-b26d43f99931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:10.135163 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:10.136342 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:10.137236 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:10.138044 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 186/368] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:10.138372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89090ea4-0df1-43ba-afa4-b26d43f99931 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:10.151269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:10.168490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801f58-2ee1-4711-9539-071907ae464f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:10.170380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801f58-2ee1-4711-9539-071907ae464f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:10.170890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801f58-2ee1-4711-9539-071907ae464f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:10.171292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26801f58-2ee1-4711-9539-071907ae464f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:10.191695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:10.259483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26801f58-2ee1-4711-9539-071907ae464f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:10.260437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89090ea4-0df1-43ba-afa4-b26d43f99931 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:10.261304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26801f58-2ee1-4711-9539-071907ae464f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:10.302172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b3aa3-9b48-4f76-b659-93f28ba0d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:10.307530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b3aa3-9b48-4f76-b659-93f28ba0d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:10.307530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b3aa3-9b48-4f76-b659-93f28ba0d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:10.307530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b3aa3-9b48-4f76-b659-93f28ba0d0f1 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:10.308819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b3aa3-9b48-4f76-b659-93f28ba0d0f1 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:10.310587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b3aa3-9b48-4f76-b659-93f28ba0d0f1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:10.312424 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 187/369] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:10 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:10.313402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b3aa3-9b48-4f76-b659-93f28ba0d0f1 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:10.387397 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 183/370] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:10.388701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801f58-2ee1-4711-9539-071907ae464f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:10.401340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:10.429602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b3aa3-9b48-4f76-b659-93f28ba0d0f1 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:10.439976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:10.469088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6457ef-8606-48aa-9267-e091536b4c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:10.469764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6457ef-8606-48aa-9267-e091536b4c78 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:10.470078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6457ef-8606-48aa-9267-e091536b4c78 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:10.470337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6457ef-8606-48aa-9267-e091536b4c78 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:10.471014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6457ef-8606-48aa-9267-e091536b4c78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:10.471314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6457ef-8606-48aa-9267-e091536b4c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:10.472710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6457ef-8606-48aa-9267-e091536b4c78 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:10.482996 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 188/371] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:10.483916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6457ef-8606-48aa-9267-e091536b4c78 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:10.501732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26801f58-2ee1-4711-9539-071907ae464f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:10.536768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd58982-93cd-4f0c-82b1-726978a66af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:10.537789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd58982-93cd-4f0c-82b1-726978a66af1 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:10.538284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd58982-93cd-4f0c-82b1-726978a66af1 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:10.538773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd58982-93cd-4f0c-82b1-726978a66af1 None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:10.540122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd58982-93cd-4f0c-82b1-726978a66af1 None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:10.541796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd58982-93cd-4f0c-82b1-726978a66af1 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:10.543620 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 184/372] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:10 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:10.544700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd58982-93cd-4f0c-82b1-726978a66af1 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:10.595658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6457ef-8606-48aa-9267-e091536b4c78 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:10.634668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17982263-909e-4a7b-8e6f-653315e18d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:10.635361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982263-909e-4a7b-8e6f-653315e18d23 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:10.635862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982263-909e-4a7b-8e6f-653315e18d23 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:10.636135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17982263-909e-4a7b-8e6f-653315e18d23 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:10.637672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17982263-909e-4a7b-8e6f-653315e18d23 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:10.639008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17982263-909e-4a7b-8e6f-653315e18d23 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:10.645923 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 189/373] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:10 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:10.645923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17982263-909e-4a7b-8e6f-653315e18d23 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:10.651818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd58982-93cd-4f0c-82b1-726978a66af1 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:10.652900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:10.665238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:10.687825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03af82-ea35-4b61-a1d2-f6854ca0a3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:10.688075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03af82-ea35-4b61-a1d2-f6854ca0a3db None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:10.688210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03af82-ea35-4b61-a1d2-f6854ca0a3db None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:10.688476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03af82-ea35-4b61-a1d2-f6854ca0a3db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:10.758482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03af82-ea35-4b61-a1d2-f6854ca0a3db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:10.759789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17982263-909e-4a7b-8e6f-653315e18d23 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:10.760147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03af82-ea35-4b61-a1d2-f6854ca0a3db None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:10.802503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159133db-9ba5-4812-b83a-20c1a3c0ef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:10.803365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159133db-9ba5-4812-b83a-20c1a3c0ef9b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:10.803782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159133db-9ba5-4812-b83a-20c1a3c0ef9b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:10.804198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159133db-9ba5-4812-b83a-20c1a3c0ef9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:10.804927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159133db-9ba5-4812-b83a-20c1a3c0ef9b None admin] RBAC: Adding query filter params (group.id=5a4a061b111442cbb357bbe71593a71c, role.id=4d5ba4daa0e84cf89f3bc5854a124660, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:10.805232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159133db-9ba5-4812-b83a-20c1a3c0ef9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:10.807242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159133db-9ba5-4812-b83a-20c1a3c0ef9b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:10.819066 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 190/374] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 03:58:10 2022] GET /identity/v3/role_assignments?group.id=5a4a061b111442cbb357bbe71593a71c&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:10.819066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159133db-9ba5-4812-b83a-20c1a3c0ef9b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:10.890915 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 185/375] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:10.892544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520db8e-1f53-4820-9e2d-2560fd9527ae None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:10.893004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520db8e-1f53-4820-9e2d-2560fd9527ae None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:10.893266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520db8e-1f53-4820-9e2d-2560fd9527ae None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:10.894664 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 186/376] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:10.898918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520db8e-1f53-4820-9e2d-2560fd9527ae None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:10.917377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:10.920358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:10.975788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159133db-9ba5-4812-b83a-20c1a3c0ef9b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:11.018701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7c2e1-9205-4bc7-bfc6-f60beb09ed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:11.019504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7c2e1-9205-4bc7-bfc6-f60beb09ed1b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:11.019786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7c2e1-9205-4bc7-bfc6-f60beb09ed1b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:11.020053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7c2e1-9205-4bc7-bfc6-f60beb09ed1b None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:11.021321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7c2e1-9205-4bc7-bfc6-f60beb09ed1b None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:11.023011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7c2e1-9205-4bc7-bfc6-f60beb09ed1b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:11.025033 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 191/377] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:10 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:11.030663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6a01b-b05b-4350-8834-724e2bb57ef1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:11.030873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520db8e-1f53-4820-9e2d-2560fd9527ae None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:11.030975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6a01b-b05b-4350-8834-724e2bb57ef1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:11.031194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6a01b-b05b-4350-8834-724e2bb57ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:11.053536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fed6a01b-b05b-4350-8834-724e2bb57ef1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:11.054765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fed6a01b-b05b-4350-8834-724e2bb57ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:11.077240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe25946-f5d5-4ac8-87ee-9c7f4a3f4975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:11.078162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe25946-f5d5-4ac8-87ee-9c7f4a3f4975 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:11.078577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe25946-f5d5-4ac8-87ee-9c7f4a3f4975 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:11.079479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe25946-f5d5-4ac8-87ee-9c7f4a3f4975 None admin] PATH_INFO: `/v3/projects/3494f9474e30444f9b9f701899a3224a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:11.081023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe25946-f5d5-4ac8-87ee-9c7f4a3f4975 None admin] RBAC: Authorizing `identity:get_project(project_id=3494f9474e30444f9b9f701899a3224a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:11.083573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe25946-f5d5-4ac8-87ee-9c7f4a3f4975 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:11.086500 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 187/378] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:10 2022] GET /identity/v3/projects/3494f9474e30444f9b9f701899a3224a => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:11.087412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe25946-f5d5-4ac8-87ee-9c7f4a3f4975 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:11.150235 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 192/379] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:11.150843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6a01b-b05b-4350-8834-724e2bb57ef1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:11.252822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:11.256770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:11.289855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6a01b-b05b-4350-8834-724e2bb57ef1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:11.312155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe25946-f5d5-4ac8-87ee-9c7f4a3f4975 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:11.333019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5694-a906-4076-9919-e4deda9cb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:11.333672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5694-a906-4076-9919-e4deda9cb24e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:11.334011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5694-a906-4076-9919-e4deda9cb24e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:11.334283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a5694-a906-4076-9919-e4deda9cb24e None admin] PATH_INFO: `/v3/groups/a0afc89b402f4d5dba5b133883b7bcdb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:11.349043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a5694-a906-4076-9919-e4deda9cb24e None admin] RBAC: Authorizing `identity:get_group(group_id=a0afc89b402f4d5dba5b133883b7bcdb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:11.353388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a5694-a906-4076-9919-e4deda9cb24e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:11.355162 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 193/380] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:11 2022] GET /identity/v3/groups/a0afc89b402f4d5dba5b133883b7bcdb => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:11.362215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5694-a906-4076-9919-e4deda9cb24e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:11.383696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad45973-0859-46c6-a834-919ebb337709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:11.384310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad45973-0859-46c6-a834-919ebb337709 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:11.384587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad45973-0859-46c6-a834-919ebb337709 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:11.384892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad45973-0859-46c6-a834-919ebb337709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:11.385638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad45973-0859-46c6-a834-919ebb337709 None admin] RBAC: Adding query filter params (group.id=5a4a061b111442cbb357bbe71593a71c, role.id=c8196760d5404ccf95f4bccb62c5a1a3, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:11.385966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad45973-0859-46c6-a834-919ebb337709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:11.387538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad45973-0859-46c6-a834-919ebb337709 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:11.396255 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 188/381] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 03:58:11 2022] GET /identity/v3/role_assignments?group.id=5a4a061b111442cbb357bbe71593a71c&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=c8196760d5404ccf95f4bccb62c5a1a3 => generated 260 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:11.534852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a5694-a906-4076-9919-e4deda9cb24e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:11.574906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:11.580537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc8e50-9014-4ea7-8737-218cbd4176a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:11.581368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc8e50-9014-4ea7-8737-218cbd4176a0 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:11.581803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc8e50-9014-4ea7-8737-218cbd4176a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:11.582241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc8e50-9014-4ea7-8737-218cbd4176a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:11.583198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc8e50-9014-4ea7-8737-218cbd4176a0 None admin] RBAC: Adding query filter params (group.id=a0afc89b402f4d5dba5b133883b7bcdb, role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=3494f9474e30444f9b9f701899a3224a) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:11.583677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc8e50-9014-4ea7-8737-218cbd4176a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:11.591456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc8e50-9014-4ea7-8737-218cbd4176a0 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:11.598416 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 194/382] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 03:58:11 2022] GET /identity/v3/role_assignments?group.id=a0afc89b402f4d5dba5b133883b7bcdb&scope.project.id=3494f9474e30444f9b9f701899a3224a&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 260 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:11.632816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad45973-0859-46c6-a834-919ebb337709 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:11.749236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad45973-0859-46c6-a834-919ebb337709 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:11.786310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36bc2a-0bbe-42f3-97ce-bcea3aff4ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:11.786957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36bc2a-0bbe-42f3-97ce-bcea3aff4ab3 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:11.787229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36bc2a-0bbe-42f3-97ce-bcea3aff4ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:11.787492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36bc2a-0bbe-42f3-97ce-bcea3aff4ab3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:11.799392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36bc2a-0bbe-42f3-97ce-bcea3aff4ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3d36bc2a-0bbe-42f3-97ce-bcea3aff4ab3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:11.804532 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:11.805510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:11.806371 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 189/383] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:11.816070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc8e50-9014-4ea7-8737-218cbd4176a0 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:11.943223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc8e50-9014-4ea7-8737-218cbd4176a0 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:11.987807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e716c-3780-4fc5-b77a-c37e3a0c6e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:11.988429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e716c-3780-4fc5-b77a-c37e3a0c6e7b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:11.988700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e716c-3780-4fc5-b77a-c37e3a0c6e7b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:11.988968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e716c-3780-4fc5-b77a-c37e3a0c6e7b None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:11.989636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e716c-3780-4fc5-b77a-c37e3a0c6e7b None admin] RBAC: Adding query filter params (name=member) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:11.989963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e716c-3780-4fc5-b77a-c37e3a0c6e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:11.991346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e716c-3780-4fc5-b77a-c37e3a0c6e7b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:12.002591 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 195/384] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:12.007848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36bc2a-0bbe-42f3-97ce-bcea3aff4ab3 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:12.012463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:12.052827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27df95b-746d-42cb-af3e-b771214b3266 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:12.053124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27df95b-746d-42cb-af3e-b771214b3266 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:12.053292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27df95b-746d-42cb-af3e-b771214b3266 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:12.055949 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 196/385] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:12.060888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccbeb-f231-49c4-8104-1cfee0243ff0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:12.061165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccbeb-f231-49c4-8104-1cfee0243ff0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:12.061436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccbeb-f231-49c4-8104-1cfee0243ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:12.080889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1beccbeb-f231-49c4-8104-1cfee0243ff0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:12.082908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1beccbeb-f231-49c4-8104-1cfee0243ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:12.160472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36bc2a-0bbe-42f3-97ce-bcea3aff4ab3 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:12.175844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:12.199254 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 197/386] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:12.211991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec66c9-3bd9-4073-8b87-17b748bb6dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:12.212638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec66c9-3bd9-4073-8b87-17b748bb6dd9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:12.212909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec66c9-3bd9-4073-8b87-17b748bb6dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:12.213175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec66c9-3bd9-4073-8b87-17b748bb6dd9 None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:12.214512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec66c9-3bd9-4073-8b87-17b748bb6dd9 None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:12.215979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec66c9-3bd9-4073-8b87-17b748bb6dd9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:12.217985 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 190/387] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:12 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:12.223122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beccbeb-f231-49c4-8104-1cfee0243ff0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:12.339112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beccbeb-f231-49c4-8104-1cfee0243ff0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:12.377918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e634dc7-d066-407f-b20e-7fec843c8635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:12.378570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e634dc7-d066-407f-b20e-7fec843c8635 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:12.378900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e634dc7-d066-407f-b20e-7fec843c8635 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:12.379176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e634dc7-d066-407f-b20e-7fec843c8635 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:12.380295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e634dc7-d066-407f-b20e-7fec843c8635 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:12.381736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e634dc7-d066-407f-b20e-7fec843c8635 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:12.383765 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 198/388] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:12 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:12.389545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec66c9-3bd9-4073-8b87-17b748bb6dd9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:12.463659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:12.500250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec66c9-3bd9-4073-8b87-17b748bb6dd9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:12.534683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca29f78-0c2d-48f5-8552-8e36ddc60151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:12.535347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29f78-0c2d-48f5-8552-8e36ddc60151 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:12.535618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29f78-0c2d-48f5-8552-8e36ddc60151 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:12.535888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca29f78-0c2d-48f5-8552-8e36ddc60151 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/groups/5a4a061b111442cbb357bbe71593a71c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:12.537811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca29f78-0c2d-48f5-8552-8e36ddc60151 None admin] RBAC: Authorizing `identity:create_grant(project_id=db5d4bfa4cff4361bc012412584b0fb2, group_id=5a4a061b111442cbb357bbe71593a71c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:12.539283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca29f78-0c2d-48f5-8552-8e36ddc60151 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:12.563801 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 191/389] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Aug 30 03:58:12 2022] PUT /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/groups/5a4a061b111442cbb357bbe71593a71c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:58:12.565983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e634dc7-d066-407f-b20e-7fec843c8635 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:12.662741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:12.717136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e634dc7-d066-407f-b20e-7fec843c8635 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:12.759472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fc075-9582-414b-b7b7-4b176c5135eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:12.760141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fc075-9582-414b-b7b7-4b176c5135eb None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:12.760449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fc075-9582-414b-b7b7-4b176c5135eb None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:12.760730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fc075-9582-414b-b7b7-4b176c5135eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:12.775929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fc075-9582-414b-b7b7-4b176c5135eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-124fc075-9582-414b-b7b7-4b176c5135eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:12.781084 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:12.782071 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:12.782884 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 199/390] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:58:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:12.791136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca29f78-0c2d-48f5-8552-8e36ddc60151 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:12.934382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca29f78-0c2d-48f5-8552-8e36ddc60151 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:12.971377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:12.976869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d7745-78e2-4838-95db-0f5d0d7325c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:12.977546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d7745-78e2-4838-95db-0f5d0d7325c5 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:12.977838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d7745-78e2-4838-95db-0f5d0d7325c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:12.978139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d7745-78e2-4838-95db-0f5d0d7325c5 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:12.982688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d7745-78e2-4838-95db-0f5d0d7325c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:12.983048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d7745-78e2-4838-95db-0f5d0d7325c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:12.984481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d7745-78e2-4838-95db-0f5d0d7325c5 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:12.994504 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 192/391] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:13.000405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fc075-9582-414b-b7b7-4b176c5135eb None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:13.141114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fc075-9582-414b-b7b7-4b176c5135eb None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:13.166230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:13.185994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa9d92-2ac5-4746-b0f5-268d938b7c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:13.186561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa9d92-2ac5-4746-b0f5-268d938b7c89 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:13.186838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa9d92-2ac5-4746-b0f5-268d938b7c89 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:13.187106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa9d92-2ac5-4746-b0f5-268d938b7c89 None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:13.188247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa9d92-2ac5-4746-b0f5-268d938b7c89 None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:13.189700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa9d92-2ac5-4746-b0f5-268d938b7c89 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:13.191659 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 200/392] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:12 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:13.197519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d7745-78e2-4838-95db-0f5d0d7325c5 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:13.333458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6141d-0213-447e-a1ed-5c6207d5397c None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:13.333786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6141d-0213-447e-a1ed-5c6207d5397c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:13.334037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6141d-0213-447e-a1ed-5c6207d5397c None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:13.335381 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 201/393] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:13.343550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe167f3-61ff-443c-8e31-75dd02f7f0f9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:13.343821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe167f3-61ff-443c-8e31-75dd02f7f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:13.344088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe167f3-61ff-443c-8e31-75dd02f7f0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:13.366941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7fe167f3-61ff-443c-8e31-75dd02f7f0f9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:13.368090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d7745-78e2-4838-95db-0f5d0d7325c5 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:13.368692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7fe167f3-61ff-443c-8e31-75dd02f7f0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:13.406326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b632a2f-a47c-4b84-ada4-eedf7082fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:13.406959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b632a2f-a47c-4b84-ada4-eedf7082fe6c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:13.407406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b632a2f-a47c-4b84-ada4-eedf7082fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:13.407928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b632a2f-a47c-4b84-ada4-eedf7082fe6c None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:13.409166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b632a2f-a47c-4b84-ada4-eedf7082fe6c None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:13.410647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b632a2f-a47c-4b84-ada4-eedf7082fe6c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:13.414852 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 193/394] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:13 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:13.419064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b632a2f-a47c-4b84-ada4-eedf7082fe6c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:13.456470 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 202/395] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:13.487732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:13.530182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b632a2f-a47c-4b84-ada4-eedf7082fe6c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:13.568985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b9473-5a7f-405b-9aa9-b4e9fc266f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:13.570003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b9473-5a7f-405b-9aa9-b4e9fc266f4f None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:13.570446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b9473-5a7f-405b-9aa9-b4e9fc266f4f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:13.570910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b9473-5a7f-405b-9aa9-b4e9fc266f4f None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/groups/5a4a061b111442cbb357bbe71593a71c/roles/c8196760d5404ccf95f4bccb62c5a1a3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:13.573220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b9473-5a7f-405b-9aa9-b4e9fc266f4f None admin] RBAC: Authorizing `identity:create_grant(project_id=db5d4bfa4cff4361bc012412584b0fb2, group_id=5a4a061b111442cbb357bbe71593a71c, role_id=c8196760d5404ccf95f4bccb62c5a1a3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:13.574891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b9473-5a7f-405b-9aa9-b4e9fc266f4f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:13.593383 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 194/396] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Aug 30 03:58:13 2022] PUT /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2/groups/5a4a061b111442cbb357bbe71593a71c/roles/c8196760d5404ccf95f4bccb62c5a1a3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 03:58:13.941521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe167f3-61ff-443c-8e31-75dd02f7f0f9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:14.062438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe167f3-61ff-443c-8e31-75dd02f7f0f9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:14.083032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:14.085314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017ebd0-8f70-4637-83b1-2295dee73cb2 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:14.085831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017ebd0-8f70-4637-83b1-2295dee73cb2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:14.086353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017ebd0-8f70-4637-83b1-2295dee73cb2 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:14.088154 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 195/397] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:14.101920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ecf1-9d51-4d2a-b74d-37a46a08f73e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:14.102506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ecf1-9d51-4d2a-b74d-37a46a08f73e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:14.102962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6ecf1-9d51-4d2a-b74d-37a46a08f73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:14.117587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1cb11-2108-456b-aa2c-24dc48bbd31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:14.118354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1cb11-2108-456b-aa2c-24dc48bbd31b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:14.118623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1cb11-2108-456b-aa2c-24dc48bbd31b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:14.118880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1cb11-2108-456b-aa2c-24dc48bbd31b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:14.142221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1cb11-2108-456b-aa2c-24dc48bbd31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:14.143763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0ee6ecf1-9d51-4d2a-b74d-37a46a08f73e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:14.144972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0ee6ecf1-9d51-4d2a-b74d-37a46a08f73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-7ed1cb11-2108-456b-aa2c-24dc48bbd31b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:14.151873 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:14.152769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:14.153542 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:14.159384 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 203/398] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:14.165174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1cb11-2108-456b-aa2c-24dc48bbd31b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:14.271964 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 196/399] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:14.345019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1cb11-2108-456b-aa2c-24dc48bbd31b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:14.386948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7e12e-ddb1-4b5b-9b28-bd8a327df896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:14.387564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e12e-ddb1-4b5b-9b28-bd8a327df896 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:14.387833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e12e-ddb1-4b5b-9b28-bd8a327df896 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:14.388097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7e12e-ddb1-4b5b-9b28-bd8a327df896 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:14.388758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e12e-ddb1-4b5b-9b28-bd8a327df896 None admin] RBAC: Adding query filter params (name=member) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:14.389049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e12e-ddb1-4b5b-9b28-bd8a327df896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:14.390516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7e12e-ddb1-4b5b-9b28-bd8a327df896 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:14.402602 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 204/400] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:14.407765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6ecf1-9d51-4d2a-b74d-37a46a08f73e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:14.431540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299371-33ce-4e9e-b779-32b2f103d972 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:14.431869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299371-33ce-4e9e-b779-32b2f103d972 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:14.432153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299371-33ce-4e9e-b779-32b2f103d972 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:14.434472 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 205/401] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:14.439771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149b97-3a15-4cc9-861e-ec78b7af86e0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:14.440047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149b97-3a15-4cc9-861e-ec78b7af86e0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:14.440312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4149b97-3a15-4cc9-861e-ec78b7af86e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:14.471669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e4149b97-3a15-4cc9-861e-ec78b7af86e0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:14.473279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e4149b97-3a15-4cc9-861e-ec78b7af86e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:14.498741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:14.524158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:14.588595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6ecf1-9d51-4d2a-b74d-37a46a08f73e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:14.595534 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 206/402] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:14.635318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967f150-83c1-4262-a243-65f9a370b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:14.636603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967f150-83c1-4262-a243-65f9a370b603 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:14.637080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967f150-83c1-4262-a243-65f9a370b603 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:14.637518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967f150-83c1-4262-a243-65f9a370b603 None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:14.639113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967f150-83c1-4262-a243-65f9a370b603 None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:14.640343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967f150-83c1-4262-a243-65f9a370b603 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:14.642115 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 197/403] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:14 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:14.648200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4149b97-3a15-4cc9-861e-ec78b7af86e0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:14.662439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967f150-83c1-4262-a243-65f9a370b603 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:14.789198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4149b97-3a15-4cc9-861e-ec78b7af86e0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:14.822634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967f150-83c1-4262-a243-65f9a370b603 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:14.857705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:14.860352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf2314-a293-406e-aac4-2fbd56256206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:14.864858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf2314-a293-406e-aac4-2fbd56256206 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:14.864858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf2314-a293-406e-aac4-2fbd56256206 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:14.864858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf2314-a293-406e-aac4-2fbd56256206 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:14.864858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf2314-a293-406e-aac4-2fbd56256206 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:14.865992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf2314-a293-406e-aac4-2fbd56256206 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:14.870373 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 207/404] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:14 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:14.875314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf2314-a293-406e-aac4-2fbd56256206 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:14.892363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b09f11-c8cd-4e77-b172-9f6407088913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:14.892363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09f11-c8cd-4e77-b172-9f6407088913 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:14.892363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09f11-c8cd-4e77-b172-9f6407088913 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:14.892363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b09f11-c8cd-4e77-b172-9f6407088913 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:14.914834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b09f11-c8cd-4e77-b172-9f6407088913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-69b09f11-c8cd-4e77-b172-9f6407088913 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:14.921832 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:14.922827 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:14.923614 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 198/405] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:58:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:14.924265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b09f11-c8cd-4e77-b172-9f6407088913 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:14.931695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:15.017952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf2314-a293-406e-aac4-2fbd56256206 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:15.071995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b09f11-c8cd-4e77-b172-9f6407088913 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:15.072168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112cd43-4616-493f-84fe-eff9ee60b7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:15.072831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112cd43-4616-493f-84fe-eff9ee60b7be None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:15.073149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112cd43-4616-493f-84fe-eff9ee60b7be None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:15.073416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112cd43-4616-493f-84fe-eff9ee60b7be None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/groups/5a4a061b111442cbb357bbe71593a71c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:15.077598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112cd43-4616-493f-84fe-eff9ee60b7be None admin] RBAC: Authorizing `identity:create_grant(project_id=bf221b7c1217437ea1cbdbda8e46ed22, group_id=5a4a061b111442cbb357bbe71593a71c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:15.078099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112cd43-4616-493f-84fe-eff9ee60b7be None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:15.101652 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 208/406] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Aug 30 03:58:14 2022] PUT /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/groups/5a4a061b111442cbb357bbe71593a71c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 03:58:15.102542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112cd43-4616-493f-84fe-eff9ee60b7be None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:15.143687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee1fd3-1a9a-4d20-b0a5-9b5d6773778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:15.144727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee1fd3-1a9a-4d20-b0a5-9b5d6773778d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:15.145379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee1fd3-1a9a-4d20-b0a5-9b5d6773778d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:15.145967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee1fd3-1a9a-4d20-b0a5-9b5d6773778d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:15.175030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee1fd3-1a9a-4d20-b0a5-9b5d6773778d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-c7ee1fd3-1a9a-4d20-b0a5-9b5d6773778d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:15.180789 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:15.181707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:15.182632 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:15.189607 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 199/407] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:15.190937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288578df-e20d-4622-a3a7-55db59e5941f None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:15.191216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288578df-e20d-4622-a3a7-55db59e5941f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:15.191487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288578df-e20d-4622-a3a7-55db59e5941f None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:15.198031 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 200/408] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:15.200656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288578df-e20d-4622-a3a7-55db59e5941f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:15.236467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112cd43-4616-493f-84fe-eff9ee60b7be None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:15.248171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:15.261719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:15.289837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8336174-2a86-4e81-bd57-0a3ee03be8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:15.290498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8336174-2a86-4e81-bd57-0a3ee03be8c4 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:15.290779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8336174-2a86-4e81-bd57-0a3ee03be8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:15.291065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8336174-2a86-4e81-bd57-0a3ee03be8c4 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:15.291728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8336174-2a86-4e81-bd57-0a3ee03be8c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:15.292072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8336174-2a86-4e81-bd57-0a3ee03be8c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:15.295873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8336174-2a86-4e81-bd57-0a3ee03be8c4 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:15.307087 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 209/409] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:15.308871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bca6a7-79e2-4e8d-be65-521bf07b8496 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:15.309153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bca6a7-79e2-4e8d-be65-521bf07b8496 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:15.309423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bca6a7-79e2-4e8d-be65-521bf07b8496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:15.338040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e1bca6a7-79e2-4e8d-be65-521bf07b8496 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:15.339280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e1bca6a7-79e2-4e8d-be65-521bf07b8496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:15.344654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288578df-e20d-4622-a3a7-55db59e5941f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:15.391789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882200-797c-41f9-88d7-197f9236a4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:15.392407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882200-797c-41f9-88d7-197f9236a4c8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:15.392685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882200-797c-41f9-88d7-197f9236a4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:15.392951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882200-797c-41f9-88d7-197f9236a4c8 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:15.393680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882200-797c-41f9-88d7-197f9236a4c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:15.394094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882200-797c-41f9-88d7-197f9236a4c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:15.395543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882200-797c-41f9-88d7-197f9236a4c8 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:15.407009 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 201/410] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:15.407867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882200-797c-41f9-88d7-197f9236a4c8 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:15.432212 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 210/411] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:15.433758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bca6a7-79e2-4e8d-be65-521bf07b8496 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:15.581534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882200-797c-41f9-88d7-197f9236a4c8 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:15.583481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:15.621401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b23fe3-0a01-4862-a236-e99358cdb2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:15.622001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b23fe3-0a01-4862-a236-e99358cdb2f5 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:15.622278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b23fe3-0a01-4862-a236-e99358cdb2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:15.622545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b23fe3-0a01-4862-a236-e99358cdb2f5 None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:15.623663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b23fe3-0a01-4862-a236-e99358cdb2f5 None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:15.625714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b23fe3-0a01-4862-a236-e99358cdb2f5 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:15.627855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:15.628005 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 202/412] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:15 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:15.634421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b23fe3-0a01-4862-a236-e99358cdb2f5 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:15.652761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bca6a7-79e2-4e8d-be65-521bf07b8496 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:15.713174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622de6-45cd-49f0-865d-74097577add9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:15.713912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622de6-45cd-49f0-865d-74097577add9 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:15.714344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622de6-45cd-49f0-865d-74097577add9 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:15.714615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622de6-45cd-49f0-865d-74097577add9 None admin] PATH_INFO: `/v3/groups/a0afc89b402f4d5dba5b133883b7bcdb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:15.716265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68622de6-45cd-49f0-865d-74097577add9 None admin] RBAC: Authorizing `identity:get_group(group_id=a0afc89b402f4d5dba5b133883b7bcdb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:15.717805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68622de6-45cd-49f0-865d-74097577add9 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:15.724734 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 211/413] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:15 2022] GET /identity/v3/groups/a0afc89b402f4d5dba5b133883b7bcdb => generated 229 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:15.726384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622de6-45cd-49f0-865d-74097577add9 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:15.807116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b23fe3-0a01-4862-a236-e99358cdb2f5 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:15.850469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622de6-45cd-49f0-865d-74097577add9 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:15.857904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b92f73-07f5-4abc-899f-d1b577676b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:15.858695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b92f73-07f5-4abc-899f-d1b577676b80 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:15.859402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b92f73-07f5-4abc-899f-d1b577676b80 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:15.859736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b92f73-07f5-4abc-899f-d1b577676b80 None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:15.861308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b92f73-07f5-4abc-899f-d1b577676b80 None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:15.863166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b92f73-07f5-4abc-899f-d1b577676b80 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:15.865908 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 203/414] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:15 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:15.866946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b92f73-07f5-4abc-899f-d1b577676b80 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:15.892008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecc429-93b1-4998-b6b4-a3eda3c71b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:15.892564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecc429-93b1-4998-b6b4-a3eda3c71b3b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:15.892839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecc429-93b1-4998-b6b4-a3eda3c71b3b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:15.893107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecc429-93b1-4998-b6b4-a3eda3c71b3b None admin] PATH_INFO: `/v3/projects/3494f9474e30444f9b9f701899a3224a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:15.894272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecc429-93b1-4998-b6b4-a3eda3c71b3b None admin] RBAC: Authorizing `identity:get_project(project_id=3494f9474e30444f9b9f701899a3224a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:15.895728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecc429-93b1-4998-b6b4-a3eda3c71b3b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:15.897827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 212/415] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:15 2022] GET /identity/v3/projects/3494f9474e30444f9b9f701899a3224a => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:15.898686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecc429-93b1-4998-b6b4-a3eda3c71b3b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:15.916702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:15.925596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:15.983172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b92f73-07f5-4abc-899f-d1b577676b80 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:16.018799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b9fde-94d9-4a3b-9d2b-abdb43f21feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:16.019538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b9fde-94d9-4a3b-9d2b-abdb43f21feb None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:16.019815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b9fde-94d9-4a3b-9d2b-abdb43f21feb None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:16.020085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b9fde-94d9-4a3b-9d2b-abdb43f21feb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:16.031294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b9fde-94d9-4a3b-9d2b-abdb43f21feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:16.032075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecc429-93b1-4998-b6b4-a3eda3c71b3b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-e90b9fde-94d9-4a3b-9d2b-abdb43f21feb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:16.036867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:16.039004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 204/416] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:16.040877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b9fde-94d9-4a3b-9d2b-abdb43f21feb None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:16.080600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996c9f7-00aa-4b04-ac70-e770b5811a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:16.081268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996c9f7-00aa-4b04-ac70-e770b5811a0c None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:16.081543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996c9f7-00aa-4b04-ac70-e770b5811a0c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:16.081810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996c9f7-00aa-4b04-ac70-e770b5811a0c None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/groups/5a4a061b111442cbb357bbe71593a71c/roles/c8196760d5404ccf95f4bccb62c5a1a3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:16.084134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996c9f7-00aa-4b04-ac70-e770b5811a0c None admin] RBAC: Authorizing `identity:create_grant(project_id=bf221b7c1217437ea1cbdbda8e46ed22, group_id=5a4a061b111442cbb357bbe71593a71c, role_id=c8196760d5404ccf95f4bccb62c5a1a3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:16.085659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996c9f7-00aa-4b04-ac70-e770b5811a0c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:16.101867 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 213/417] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Aug 30 03:58:15 2022] PUT /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22/groups/5a4a061b111442cbb357bbe71593a71c/roles/c8196760d5404ccf95f4bccb62c5a1a3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:58:16.102959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996c9f7-00aa-4b04-ac70-e770b5811a0c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:16.178674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:16.183170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b9fde-94d9-4a3b-9d2b-abdb43f21feb None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:16.208206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:16.225956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7531dc2-73f9-4ad0-9c35-b807b434e490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:16.226670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531dc2-73f9-4ad0-9c35-b807b434e490 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:16.226943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531dc2-73f9-4ad0-9c35-b807b434e490 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:16.227212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531dc2-73f9-4ad0-9c35-b807b434e490 None admin] PATH_INFO: `/v3/projects/3494f9474e30444f9b9f701899a3224a/groups/a0afc89b402f4d5dba5b133883b7bcdb/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:16.229589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7531dc2-73f9-4ad0-9c35-b807b434e490 None admin] RBAC: Authorizing `identity:create_grant(project_id=3494f9474e30444f9b9f701899a3224a, group_id=a0afc89b402f4d5dba5b133883b7bcdb, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:16.231178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7531dc2-73f9-4ad0-9c35-b807b434e490 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:16.237541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996c9f7-00aa-4b04-ac70-e770b5811a0c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:16.249267 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 205/418] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Aug 30 03:58:16 2022] PUT /identity/v3/projects/3494f9474e30444f9b9f701899a3224a/groups/a0afc89b402f4d5dba5b133883b7bcdb/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:58:16.251117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719650f-98d5-4625-8695-b7f52c00e537 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:16.251515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719650f-98d5-4625-8695-b7f52c00e537 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:16.251924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719650f-98d5-4625-8695-b7f52c00e537 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:16.254017 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 206/419] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:16.259806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bed621-c6de-466f-b979-de2b8aaf2d36 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:16.260132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bed621-c6de-466f-b979-de2b8aaf2d36 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:16.260352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bed621-c6de-466f-b979-de2b8aaf2d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:16.303644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c4bed621-c6de-466f-b979-de2b8aaf2d36 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:16.307418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c4bed621-c6de-466f-b979-de2b8aaf2d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:16.315017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7175a-13f3-479e-8ad4-c3cc3eee1250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:16.315941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7175a-13f3-479e-8ad4-c3cc3eee1250 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:16.316399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7175a-13f3-479e-8ad4-c3cc3eee1250 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:16.316852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7175a-13f3-479e-8ad4-c3cc3eee1250 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:16.318163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7175a-13f3-479e-8ad4-c3cc3eee1250 None admin] RBAC: Adding query filter params (name=member) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:16.318677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7175a-13f3-479e-8ad4-c3cc3eee1250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:16.321250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7175a-13f3-479e-8ad4-c3cc3eee1250 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:16.335691 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 214/420] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:16.342730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7175a-13f3-479e-8ad4-c3cc3eee1250 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:16.412321 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 207/421] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:16.482131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7175a-13f3-479e-8ad4-c3cc3eee1250 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:16.517604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2ea25-3adc-4664-a3ab-e7e34fbf615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:16.518252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2ea25-3adc-4664-a3ab-e7e34fbf615b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:16.518529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2ea25-3adc-4664-a3ab-e7e34fbf615b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:16.518797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2ea25-3adc-4664-a3ab-e7e34fbf615b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:16.534188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:16.598221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2ea25-3adc-4664-a3ab-e7e34fbf615b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:16.600046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2ea25-3adc-4664-a3ab-e7e34fbf615b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:16.694072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bed621-c6de-466f-b979-de2b8aaf2d36 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:16.708367 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 215/422] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 03:58:16.714420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2ea25-3adc-4664-a3ab-e7e34fbf615b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:16.762347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:16.817425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2ea25-3adc-4664-a3ab-e7e34fbf615b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:16.860290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:16.863292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3296454-a87c-4ed1-90f5-df9443f901c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:16.864231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3296454-a87c-4ed1-90f5-df9443f901c8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:16.864681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3296454-a87c-4ed1-90f5-df9443f901c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:16.865125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3296454-a87c-4ed1-90f5-df9443f901c8 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:16.866662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3296454-a87c-4ed1-90f5-df9443f901c8 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:16.869655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3296454-a87c-4ed1-90f5-df9443f901c8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:16.871994 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 216/423] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:16 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:16.877674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3296454-a87c-4ed1-90f5-df9443f901c8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:16.882514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bed621-c6de-466f-b979-de2b8aaf2d36 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:16.941749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d93c1f-68e1-41e2-95e0-266a7c017307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:16.942542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d93c1f-68e1-41e2-95e0-266a7c017307 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:16.942874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d93c1f-68e1-41e2-95e0-266a7c017307 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:16.943287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d93c1f-68e1-41e2-95e0-266a7c017307 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:16.962344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d93c1f-68e1-41e2-95e0-266a7c017307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-29d93c1f-68e1-41e2-95e0-266a7c017307 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:16.967798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:16.968824 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:16.969629 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:16.975746 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 208/424] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:58:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:16.981795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d93c1f-68e1-41e2-95e0-266a7c017307 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:16.992840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3296454-a87c-4ed1-90f5-df9443f901c8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:17.007594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:17.037573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f139f6-b7a5-4f0d-ae31-a3bb8ae41fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:17.040431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f139f6-b7a5-4f0d-ae31-a3bb8ae41fe2 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:17.041213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f139f6-b7a5-4f0d-ae31-a3bb8ae41fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:17.046271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f139f6-b7a5-4f0d-ae31-a3bb8ae41fe2 None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:17.047543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f139f6-b7a5-4f0d-ae31-a3bb8ae41fe2 None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:17.049013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f139f6-b7a5-4f0d-ae31-a3bb8ae41fe2 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:17.050798 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 217/425] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:16 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:17.056647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f139f6-b7a5-4f0d-ae31-a3bb8ae41fe2 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:17.175258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d93c1f-68e1-41e2-95e0-266a7c017307 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:17.235759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c75e6-94c1-497f-9bff-000c8a97a358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:17.236385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c75e6-94c1-497f-9bff-000c8a97a358 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:17.236656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c75e6-94c1-497f-9bff-000c8a97a358 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:17.236920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c75e6-94c1-497f-9bff-000c8a97a358 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:17.237803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c75e6-94c1-497f-9bff-000c8a97a358 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:17.237928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c75e6-94c1-497f-9bff-000c8a97a358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:17.243562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5c75e6-94c1-497f-9bff-000c8a97a358 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:17.254346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f139f6-b7a5-4f0d-ae31-a3bb8ae41fe2 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:17.256671 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 209/426] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:17.262927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c75e6-94c1-497f-9bff-000c8a97a358 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:17.283542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:17.296347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607824-f0ae-48fc-8f1b-322d7f176885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:17.297289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607824-f0ae-48fc-8f1b-322d7f176885 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:17.297778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607824-f0ae-48fc-8f1b-322d7f176885 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:17.298280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607824-f0ae-48fc-8f1b-322d7f176885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:17.299217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607824-f0ae-48fc-8f1b-322d7f176885 None admin] RBAC: Adding query filter params (group.id=5a4a061b111442cbb357bbe71593a71c, role.id=4d5ba4daa0e84cf89f3bc5854a124660, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:17.299622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607824-f0ae-48fc-8f1b-322d7f176885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:17.301401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607824-f0ae-48fc-8f1b-322d7f176885 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:17.308637 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 218/427] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 03:58:17 2022] GET /identity/v3/role_assignments?group.id=5a4a061b111442cbb357bbe71593a71c&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 611 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:17.315517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f094fd-3019-4fb1-a6db-a5eb4b4fd233 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:17.315964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f094fd-3019-4fb1-a6db-a5eb4b4fd233 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:17.316489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f094fd-3019-4fb1-a6db-a5eb4b4fd233 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:17.318311 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 219/428] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:17.323987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc8aa2-efae-4f37-9097-7ad11793f543 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:17.324385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc8aa2-efae-4f37-9097-7ad11793f543 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:17.324733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc8aa2-efae-4f37-9097-7ad11793f543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:17.359001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-73cc8aa2-efae-4f37-9097-7ad11793f543 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:17.360472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-73cc8aa2-efae-4f37-9097-7ad11793f543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:17.394331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c75e6-94c1-497f-9bff-000c8a97a358 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:17.447877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:17.479157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b17990-39cb-4029-957c-75b9c1ed2e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:17.479748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17990-39cb-4029-957c-75b9c1ed2e61 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:17.480026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17990-39cb-4029-957c-75b9c1ed2e61 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:17.480295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b17990-39cb-4029-957c-75b9c1ed2e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:17.490754 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 220/429] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:17.582792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b17990-39cb-4029-957c-75b9c1ed2e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:17.584191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b17990-39cb-4029-957c-75b9c1ed2e61 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:17.598629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:17.710339 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 210/430] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:17.716011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc8aa2-efae-4f37-9097-7ad11793f543 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:17.805571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b17990-39cb-4029-957c-75b9c1ed2e61 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:17.841297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc8aa2-efae-4f37-9097-7ad11793f543 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:17.888591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a7c8f-557d-47ad-96d0-855e79ef8991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:17.889388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a7c8f-557d-47ad-96d0-855e79ef8991 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:17.889667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a7c8f-557d-47ad-96d0-855e79ef8991 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:17.889961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a7c8f-557d-47ad-96d0-855e79ef8991 None admin] PATH_INFO: `/v3/projects/db5d4bfa4cff4361bc012412584b0fb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:17.891131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a7c8f-557d-47ad-96d0-855e79ef8991 None admin] RBAC: Authorizing `identity:get_project(project_id=db5d4bfa4cff4361bc012412584b0fb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:17.892733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a7c8f-557d-47ad-96d0-855e79ef8991 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:17.894908 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 221/431] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:17 2022] GET /identity/v3/projects/db5d4bfa4cff4361bc012412584b0fb2 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:17.900257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a7c8f-557d-47ad-96d0-855e79ef8991 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:17.937189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b17990-39cb-4029-957c-75b9c1ed2e61 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:17.951478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:17.956850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:17.984187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9159668-75ec-40b1-87ca-e65151f36795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:17.984835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159668-75ec-40b1-87ca-e65151f36795 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:17.985110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159668-75ec-40b1-87ca-e65151f36795 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:17.985376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159668-75ec-40b1-87ca-e65151f36795 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.000288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9159668-75ec-40b1-87ca-e65151f36795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-b9159668-75ec-40b1-87ca-e65151f36795 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:18.005248 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:18.006179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:18.006981 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 211/432] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:18.013296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9159668-75ec-40b1-87ca-e65151f36795 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:18.038837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a7c8f-557d-47ad-96d0-855e79ef8991 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:18.083097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758c736-5ab3-4453-b03d-3827fdc7b952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:18.083741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758c736-5ab3-4453-b03d-3827fdc7b952 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:18.084020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758c736-5ab3-4453-b03d-3827fdc7b952 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:18.084290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758c736-5ab3-4453-b03d-3827fdc7b952 None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.085449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758c736-5ab3-4453-b03d-3827fdc7b952 None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:18.086942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758c736-5ab3-4453-b03d-3827fdc7b952 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:18.088847 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 222/433] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:17 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:18.096849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758c736-5ab3-4453-b03d-3827fdc7b952 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:18.146808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9159668-75ec-40b1-87ca-e65151f36795 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:18.200322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec2188-b98f-4bae-a556-863c99a9765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:18.201070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec2188-b98f-4bae-a556-863c99a9765a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:18.201352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec2188-b98f-4bae-a556-863c99a9765a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:18.201620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec2188-b98f-4bae-a556-863c99a9765a None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.202449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec2188-b98f-4bae-a556-863c99a9765a None admin] RBAC: Adding query filter params (name=member) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:18.202749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec2188-b98f-4bae-a556-863c99a9765a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:18.204222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec2188-b98f-4bae-a556-863c99a9765a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:18.218202 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 212/434] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:58:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:18.219902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec2188-b98f-4bae-a556-863c99a9765a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:18.222335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758c736-5ab3-4453-b03d-3827fdc7b952 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:18.234862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:18.256372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:18.265199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d46186-e679-4032-8d42-371278c7141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:18.266082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d46186-e679-4032-8d42-371278c7141e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:18.266499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d46186-e679-4032-8d42-371278c7141e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:18.267002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d46186-e679-4032-8d42-371278c7141e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.267877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d46186-e679-4032-8d42-371278c7141e None admin] RBAC: Adding query filter params (group.id=5a4a061b111442cbb357bbe71593a71c, role.id=c8196760d5404ccf95f4bccb62c5a1a3, scope.project.id=db5d4bfa4cff4361bc012412584b0fb2) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:18.268351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d46186-e679-4032-8d42-371278c7141e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:18.270190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d46186-e679-4032-8d42-371278c7141e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:18.277396 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 223/435] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 03:58:18 2022] GET /identity/v3/role_assignments?group.id=5a4a061b111442cbb357bbe71593a71c&scope.project.id=db5d4bfa4cff4361bc012412584b0fb2&role.id=c8196760d5404ccf95f4bccb62c5a1a3 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:18.339815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec2188-b98f-4bae-a556-863c99a9765a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:18.378508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea27fee-5ac7-41c9-ac24-b2d8a157dbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:18.379055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea27fee-5ac7-41c9-ac24-b2d8a157dbf7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:18.379333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea27fee-5ac7-41c9-ac24-b2d8a157dbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:18.379672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea27fee-5ac7-41c9-ac24-b2d8a157dbf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.451464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea27fee-5ac7-41c9-ac24-b2d8a157dbf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:18.452944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea27fee-5ac7-41c9-ac24-b2d8a157dbf7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:18.484696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:18.565311 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 213/436] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 03:58:18.571540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d46186-e679-4032-8d42-371278c7141e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:18.633662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c2e46-0679-413d-a772-82c7468fa926 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:18.633833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c2e46-0679-413d-a772-82c7468fa926 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:18.636757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c2e46-0679-413d-a772-82c7468fa926 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.636757 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 214/437] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:18.642417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d9288-fa01-4185-b8b8-616b9cab22c4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:18.642685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d9288-fa01-4185-b8b8-616b9cab22c4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:18.642962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d9288-fa01-4185-b8b8-616b9cab22c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.667015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a58d9288-fa01-4185-b8b8-616b9cab22c4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:18.668294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a58d9288-fa01-4185-b8b8-616b9cab22c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:18.692936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d46186-e679-4032-8d42-371278c7141e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:18.736342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3ce7d-0536-443c-9080-5ec54ff42f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:18.737121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ce7d-0536-443c-9080-5ec54ff42f3e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:18.737299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ce7d-0536-443c-9080-5ec54ff42f3e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:18.737515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ce7d-0536-443c-9080-5ec54ff42f3e None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.738683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3ce7d-0536-443c-9080-5ec54ff42f3e None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:18.740137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3ce7d-0536-443c-9080-5ec54ff42f3e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:18.741762 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 224/438] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:18 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:18.742905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170085cf-41f7-4de8-b2cd-67638ac764a6 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:18.743181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170085cf-41f7-4de8-b2cd-67638ac764a6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:18.743447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170085cf-41f7-4de8-b2cd-67638ac764a6 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.745709 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 215/439] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:18.745833 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 225/440] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:18.751447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d9288-fa01-4185-b8b8-616b9cab22c4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:18.751948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840d333-d4f3-40c6-94e5-f75bf29d70c4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:18.752158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840d333-d4f3-40c6-94e5-f75bf29d70c4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:18.752411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840d333-d4f3-40c6-94e5-f75bf29d70c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.771169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2840d333-d4f3-40c6-94e5-f75bf29d70c4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:18.772350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2840d333-d4f3-40c6-94e5-f75bf29d70c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:18.808538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:18.815687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:18.841790 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 226/441] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:18.858549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d9288-fa01-4185-b8b8-616b9cab22c4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:18.892768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83952-d701-445d-b44f-ea5d97eb6ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:18.893319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83952-d701-445d-b44f-ea5d97eb6ebe None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:18.893588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83952-d701-445d-b44f-ea5d97eb6ebe None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:18.893852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83952-d701-445d-b44f-ea5d97eb6ebe None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:18.894974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c83952-d701-445d-b44f-ea5d97eb6ebe None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:18.896428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c83952-d701-445d-b44f-ea5d97eb6ebe None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:18.898156 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 216/442] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:18 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:18.904063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840d333-d4f3-40c6-94e5-f75bf29d70c4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.004859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840d333-d4f3-40c6-94e5-f75bf29d70c4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:19.013010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83952-d701-445d-b44f-ea5d97eb6ebe None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.040768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a681c4-7106-45a1-9897-149c0ce11351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:19.041372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a681c4-7106-45a1-9897-149c0ce11351 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:19.041636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a681c4-7106-45a1-9897-149c0ce11351 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:19.041920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a681c4-7106-45a1-9897-149c0ce11351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:19.042675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a681c4-7106-45a1-9897-149c0ce11351 None admin] RBAC: Adding query filter params (group.id=5a4a061b111442cbb357bbe71593a71c, role.id=4d5ba4daa0e84cf89f3bc5854a124660, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:19.042974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a681c4-7106-45a1-9897-149c0ce11351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:19.044389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a681c4-7106-45a1-9897-149c0ce11351 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:19.050321 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 227/443] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 03:58:18 2022] GET /identity/v3/role_assignments?group.id=5a4a061b111442cbb357bbe71593a71c&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=4d5ba4daa0e84cf89f3bc5854a124660 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:19.127010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83952-d701-445d-b44f-ea5d97eb6ebe None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:19.132342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a681c4-7106-45a1-9897-149c0ce11351 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.160116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:19.166435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9da6-34a9-45a1-acb3-5953bd761302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:19.167102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9da6-34a9-45a1-acb3-5953bd761302 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:19.167690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9da6-34a9-45a1-acb3-5953bd761302 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:19.167690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b9da6-34a9-45a1-acb3-5953bd761302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:19.180071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b9da6-34a9-45a1-acb3-5953bd761302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:19.182157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-093b9da6-34a9-45a1-acb3-5953bd761302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:19.185933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:19.186858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:19.187648 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 217/444] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:19.195019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9da6-34a9-45a1-acb3-5953bd761302 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.270608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a681c4-7106-45a1-9897-149c0ce11351 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:19.311149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23d68f-37e3-4d59-a396-07321571f01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:19.311788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23d68f-37e3-4d59-a396-07321571f01e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:19.312057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23d68f-37e3-4d59-a396-07321571f01e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:19.312319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a23d68f-37e3-4d59-a396-07321571f01e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:19.312439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b9da6-34a9-45a1-acb3-5953bd761302 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:19.325861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a23d68f-37e3-4d59-a396-07321571f01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-7a23d68f-37e3-4d59-a396-07321571f01e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:19.331270 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:19.332152 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:19.332962 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 228/445] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:19.338470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23d68f-37e3-4d59-a396-07321571f01e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.350195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050a501-11c8-4620-a204-f9263796981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:19.350809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050a501-11c8-4620-a204-f9263796981c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:19.351083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050a501-11c8-4620-a204-f9263796981c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:19.351347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050a501-11c8-4620-a204-f9263796981c None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:19.352149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050a501-11c8-4620-a204-f9263796981c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:19.352443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050a501-11c8-4620-a204-f9263796981c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:19.353866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050a501-11c8-4620-a204-f9263796981c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:19.362789 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 218/446] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:19.369242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050a501-11c8-4620-a204-f9263796981c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.430793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:19.454459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:19.460746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a23d68f-37e3-4d59-a396-07321571f01e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:19.478218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050a501-11c8-4620-a204-f9263796981c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:19.494039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4222f-2cb7-4d62-89c7-4ef18b318a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:19.494659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4222f-2cb7-4d62-89c7-4ef18b318a63 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:19.494930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4222f-2cb7-4d62-89c7-4ef18b318a63 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:19.495196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4222f-2cb7-4d62-89c7-4ef18b318a63 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:19.495919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4222f-2cb7-4d62-89c7-4ef18b318a63 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:19.496213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4222f-2cb7-4d62-89c7-4ef18b318a63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:19.497600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4222f-2cb7-4d62-89c7-4ef18b318a63 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:19.505287 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 229/447] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:19.510215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd5a5b-8bd0-46e3-9a79-988694287c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:19.510820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd5a5b-8bd0-46e3-9a79-988694287c4f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:19.510920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4222f-2cb7-4d62-89c7-4ef18b318a63 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.511189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd5a5b-8bd0-46e3-9a79-988694287c4f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:19.511454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd5a5b-8bd0-46e3-9a79-988694287c4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:19.584727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd5a5b-8bd0-46e3-9a79-988694287c4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:19.586227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd5a5b-8bd0-46e3-9a79-988694287c4f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:19.611412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4222f-2cb7-4d62-89c7-4ef18b318a63 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:19.637654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:19.649069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e879939-e085-40e4-9cca-9c69310d949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:19.649688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e879939-e085-40e4-9cca-9c69310d949e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:19.649990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e879939-e085-40e4-9cca-9c69310d949e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:19.650256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e879939-e085-40e4-9cca-9c69310d949e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:19.677822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:19.685333 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 219/448] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:19.691059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd5a5b-8bd0-46e3-9a79-988694287c4f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.719302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e879939-e085-40e4-9cca-9c69310d949e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:19.720779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e879939-e085-40e4-9cca-9c69310d949e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:19.788010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd5a5b-8bd0-46e3-9a79-988694287c4f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:19.819024 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 230/449] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 03:58:19.820820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99385c2c-95df-4417-926f-13cb381376f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:19.821450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385c2c-95df-4417-926f-13cb381376f7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:19.821724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385c2c-95df-4417-926f-13cb381376f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:19.822026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99385c2c-95df-4417-926f-13cb381376f7 None admin] PATH_INFO: `/v3/projects/3494f9474e30444f9b9f701899a3224a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:19.823141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99385c2c-95df-4417-926f-13cb381376f7 None admin] RBAC: Authorizing `identity:get_project(project_id=3494f9474e30444f9b9f701899a3224a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:19.824714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99385c2c-95df-4417-926f-13cb381376f7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:19.824881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e879939-e085-40e4-9cca-9c69310d949e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.830821 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 220/450] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/projects/3494f9474e30444f9b9f701899a3224a => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:19.831728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99385c2c-95df-4417-926f-13cb381376f7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.853338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:19.882509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:19.924980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e879939-e085-40e4-9cca-9c69310d949e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:19.932857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99385c2c-95df-4417-926f-13cb381376f7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:19.962605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d69040-2ea5-4b0f-9a82-a688a04d4c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:19.963151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d69040-2ea5-4b0f-9a82-a688a04d4c5a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:19.963420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d69040-2ea5-4b0f-9a82-a688a04d4c5a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:19.963683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d69040-2ea5-4b0f-9a82-a688a04d4c5a None admin] PATH_INFO: `/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:19.964916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d69040-2ea5-4b0f-9a82-a688a04d4c5a None admin] RBAC: Authorizing `identity:get_project(project_id=bf221b7c1217437ea1cbdbda8e46ed22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:19.966388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d69040-2ea5-4b0f-9a82-a688a04d4c5a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:19.968006 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 231/451] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/projects/bf221b7c1217437ea1cbdbda8e46ed22 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:19.973565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d69040-2ea5-4b0f-9a82-a688a04d4c5a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:19.974582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a60182-5481-4e17-ade2-3facdd6d0b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:19.975209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a60182-5481-4e17-ade2-3facdd6d0b85 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:19.975476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a60182-5481-4e17-ade2-3facdd6d0b85 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:19.975731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a60182-5481-4e17-ade2-3facdd6d0b85 None admin] PATH_INFO: `/v3/groups/a0afc89b402f4d5dba5b133883b7bcdb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:19.976907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a60182-5481-4e17-ade2-3facdd6d0b85 None admin] RBAC: Authorizing `identity:get_group(group_id=a0afc89b402f4d5dba5b133883b7bcdb)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:19.978863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a60182-5481-4e17-ade2-3facdd6d0b85 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:19.980593 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 221/452] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/groups/a0afc89b402f4d5dba5b133883b7bcdb => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:19.986455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a60182-5481-4e17-ade2-3facdd6d0b85 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:20.070805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d69040-2ea5-4b0f-9a82-a688a04d4c5a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:20.071411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:20.083525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a60182-5481-4e17-ade2-3facdd6d0b85 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:20.097241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:20.106922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af54202-e0ba-4463-b277-cbeba2a99c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:20.107560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54202-e0ba-4463-b277-cbeba2a99c02 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:20.107835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54202-e0ba-4463-b277-cbeba2a99c02 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:20.108088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af54202-e0ba-4463-b277-cbeba2a99c02 None admin] PATH_INFO: `/v3/groups/5a4a061b111442cbb357bbe71593a71c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:20.109200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af54202-e0ba-4463-b277-cbeba2a99c02 None admin] RBAC: Authorizing `identity:get_group(group_id=5a4a061b111442cbb357bbe71593a71c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:20.110657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af54202-e0ba-4463-b277-cbeba2a99c02 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:20.112196 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 232/453] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/groups/5a4a061b111442cbb357bbe71593a71c => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:20.117897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d0418-acac-4b4c-a7c2-a6bcc170b79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:20.118056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af54202-e0ba-4463-b277-cbeba2a99c02 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:20.118519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d0418-acac-4b4c-a7c2-a6bcc170b79b None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:20.118791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d0418-acac-4b4c-a7c2-a6bcc170b79b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:20.119055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d0418-acac-4b4c-a7c2-a6bcc170b79b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:20.119780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d0418-acac-4b4c-a7c2-a6bcc170b79b None admin] RBAC: Adding query filter params (group.id=a0afc89b402f4d5dba5b133883b7bcdb, role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=3494f9474e30444f9b9f701899a3224a) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:20.120077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d0418-acac-4b4c-a7c2-a6bcc170b79b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:20.121515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d0418-acac-4b4c-a7c2-a6bcc170b79b None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:20.127535 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 222/454] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 03:58:19 2022] GET /identity/v3/role_assignments?group.id=a0afc89b402f4d5dba5b133883b7bcdb&scope.project.id=3494f9474e30444f9b9f701899a3224a&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:20.228412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af54202-e0ba-4463-b277-cbeba2a99c02 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:20.265234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce1937-2f15-4f92-9944-05d0715b7593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:20.265837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1937-2f15-4f92-9944-05d0715b7593 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:20.266139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1937-2f15-4f92-9944-05d0715b7593 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:20.266400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce1937-2f15-4f92-9944-05d0715b7593 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:20.267127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce1937-2f15-4f92-9944-05d0715b7593 None admin] RBAC: Adding query filter params (group.id=5a4a061b111442cbb357bbe71593a71c, role.id=c8196760d5404ccf95f4bccb62c5a1a3, scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:20.267415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce1937-2f15-4f92-9944-05d0715b7593 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:20.268849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce1937-2f15-4f92-9944-05d0715b7593 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:20.274878 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 233/455] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 03:58:20 2022] GET /identity/v3/role_assignments?group.id=5a4a061b111442cbb357bbe71593a71c&scope.project.id=bf221b7c1217437ea1cbdbda8e46ed22&role.id=c8196760d5404ccf95f4bccb62c5a1a3 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:22.733109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72987944-50bd-4156-980f-c2834aa55f7f None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:22.733638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72987944-50bd-4156-980f-c2834aa55f7f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:22.733638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72987944-50bd-4156-980f-c2834aa55f7f None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:22.735283 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 223/456] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:22.740811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d6c97-9e31-440c-8ac7-c00c8653dbe2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:22.741285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d6c97-9e31-440c-8ac7-c00c8653dbe2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:22.741383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d6c97-9e31-440c-8ac7-c00c8653dbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:22.760111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-297d6c97-9e31-440c-8ac7-c00c8653dbe2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:22.761330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-297d6c97-9e31-440c-8ac7-c00c8653dbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:22.828065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:22.850265 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 234/457] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:23.213357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72987944-50bd-4156-980f-c2834aa55f7f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:23.329710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6746-842f-495e-8ae4-aa26980dd1b4 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:23.330104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6746-842f-495e-8ae4-aa26980dd1b4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:23.330376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6746-842f-495e-8ae4-aa26980dd1b4 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:23.332050 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 235/458] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:23.351592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72987944-50bd-4156-980f-c2834aa55f7f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:23.351779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79015e42-b5bf-4d29-9df4-6f5d3bbd4ec3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:23.351985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79015e42-b5bf-4d29-9df4-6f5d3bbd4ec3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:23.352203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79015e42-b5bf-4d29-9df4-6f5d3bbd4ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:23.384610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-79015e42-b5bf-4d29-9df4-6f5d3bbd4ec3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:23.386060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-79015e42-b5bf-4d29-9df4-6f5d3bbd4ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:23.400243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c91816-c3ec-4ffd-abe2-924d3ba80193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:23.401294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91816-c3ec-4ffd-abe2-924d3ba80193 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:23.401723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91816-c3ec-4ffd-abe2-924d3ba80193 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:23.402159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c91816-c3ec-4ffd-abe2-924d3ba80193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:23.417981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c91816-c3ec-4ffd-abe2-924d3ba80193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:23.420127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c91816-c3ec-4ffd-abe2-924d3ba80193 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-d4c91816-c3ec-4ffd-abe2-924d3ba80193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:23.442510 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:23.443881 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:23.445456 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:23.445456 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:23.445456 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:23.445456 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 224/459] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:23.445727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6788-361e-4fb5-adab-c7456c523778 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:23.450675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6788-361e-4fb5-adab-c7456c523778 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:23.450675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe6788-361e-4fb5-adab-c7456c523778 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:23.450675 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 225/460] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:23.452622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe6788-361e-4fb5-adab-c7456c523778 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:23.458845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:23.479289 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 236/461] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:23.480868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650399e3-dd1e-4c68-921f-dc7c24207aaf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:23.481191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650399e3-dd1e-4c68-921f-dc7c24207aaf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:23.481499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650399e3-dd1e-4c68-921f-dc7c24207aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:23.513898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-650399e3-dd1e-4c68-921f-dc7c24207aaf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:23.513898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-650399e3-dd1e-4c68-921f-dc7c24207aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:23.589220 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 237/462] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:23.590541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe6788-361e-4fb5-adab-c7456c523778 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:23.590759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c565ca-4d37-4d5c-a125-bfea9cea7f44 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:23.591046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c565ca-4d37-4d5c-a125-bfea9cea7f44 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:23.591315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c565ca-4d37-4d5c-a125-bfea9cea7f44 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:23.597803 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 238/463] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:23.611028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e90c30-4baa-4106-949b-01e7bff29a0f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:23.611028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e90c30-4baa-4106-949b-01e7bff29a0f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:23.611028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e90c30-4baa-4106-949b-01e7bff29a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:23.628904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-23e90c30-4baa-4106-949b-01e7bff29a0f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:23.630459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-23e90c30-4baa-4106-949b-01e7bff29a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:23.668597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc03db-c768-4787-84a6-c854d1a4de05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:23.669222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc03db-c768-4787-84a6-c854d1a4de05 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:23.669497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc03db-c768-4787-84a6-c854d1a4de05 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:23.669770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc03db-c768-4787-84a6-c854d1a4de05 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:23.670561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc03db-c768-4787-84a6-c854d1a4de05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:23.670921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc03db-c768-4787-84a6-c854d1a4de05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:23.672493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc03db-c768-4787-84a6-c854d1a4de05 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:23.685024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:23.703971 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 226/464] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:23.709907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc03db-c768-4787-84a6-c854d1a4de05 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:23.723114 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 239/465] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:23.764179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e90c30-4baa-4106-949b-01e7bff29a0f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:23.801970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:23.870885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc03db-c768-4787-84a6-c854d1a4de05 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:23.936944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad04e4-025c-4f5c-9834-686c3c1e0a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:23.937557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad04e4-025c-4f5c-9834-686c3c1e0a89 None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:23.937829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad04e4-025c-4f5c-9834-686c3c1e0a89 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:23.938110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad04e4-025c-4f5c-9834-686c3c1e0a89 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:23.938762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad04e4-025c-4f5c-9834-686c3c1e0a89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:23.940224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad04e4-025c-4f5c-9834-686c3c1e0a89 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:23.954407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e90c30-4baa-4106-949b-01e7bff29a0f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:23.972153 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 227/466] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:58:23 2022] POST /identity/v3/users => generated 246 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:58:23.976856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad04e4-025c-4f5c-9834-686c3c1e0a89 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:24.019050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106b38-2c73-4c6f-b93c-340ea8ac2707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:24.019620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106b38-2c73-4c6f-b93c-340ea8ac2707 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.019889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106b38-2c73-4c6f-b93c-340ea8ac2707 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.020149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24106b38-2c73-4c6f-b93c-340ea8ac2707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.035567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24106b38-2c73-4c6f-b93c-340ea8ac2707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:24.037153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24106b38-2c73-4c6f-b93c-340ea8ac2707 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-24106b38-2c73-4c6f-b93c-340ea8ac2707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:24.054317 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:24.055280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:24.056128 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:24.056128 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:24.056128 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:24.060732 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 240/467] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:24.061741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106b38-2c73-4c6f-b93c-340ea8ac2707 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:24.096276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:24.118301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad04e4-025c-4f5c-9834-686c3c1e0a89 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:24.142583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:24.162154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f22d28-372b-4495-9202-1ce8ab2a2e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:24.163133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f22d28-372b-4495-9202-1ce8ab2a2e8a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.163586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f22d28-372b-4495-9202-1ce8ab2a2e8a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.164026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f22d28-372b-4495-9202-1ce8ab2a2e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.179200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f22d28-372b-4495-9202-1ce8ab2a2e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:24.180491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f22d28-372b-4495-9202-1ce8ab2a2e8a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:24.198371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24106b38-2c73-4c6f-b93c-340ea8ac2707 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-11f22d28-372b-4495-9202-1ce8ab2a2e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:24.199457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:24.200399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:24.201239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:24.201239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:24.201239 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:24.201239 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 228/468] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:24.202948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f22d28-372b-4495-9202-1ce8ab2a2e8a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:24.244835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f5f1-a750-4d3b-8707-7f8bb0ffb278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:24.245608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f5f1-a750-4d3b-8707-7f8bb0ffb278 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.245964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f5f1-a750-4d3b-8707-7f8bb0ffb278 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.246322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037f5f1-a750-4d3b-8707-7f8bb0ffb278 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.261787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037f5f1-a750-4d3b-8707-7f8bb0ffb278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:24.264551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037f5f1-a750-4d3b-8707-7f8bb0ffb278 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-1037f5f1-a750-4d3b-8707-7f8bb0ffb278 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:24.280764 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:24.281770 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:24.282661 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:24.282661 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:24.282661 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:24.282661 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 241/469] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:24.282661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f5f1-a750-4d3b-8707-7f8bb0ffb278 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:24.333326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f22d28-372b-4495-9202-1ce8ab2a2e8a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:24.368353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f4a81-a64e-4ccb-80a1-48b85f1b4fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:24.369235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4a81-a64e-4ccb-80a1-48b85f1b4fd1 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.369650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4a81-a64e-4ccb-80a1-48b85f1b4fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.370071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f4a81-a64e-4ccb-80a1-48b85f1b4fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.370914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f4a81-a64e-4ccb-80a1-48b85f1b4fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:24.371226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f4a81-a64e-4ccb-80a1-48b85f1b4fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:24.371840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:24.372955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f4a81-a64e-4ccb-80a1-48b85f1b4fd1 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:24.385685 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 229/470] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:24.391584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3cde-5dab-4868-899c-d4349b0e7741 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.391848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3cde-5dab-4868-899c-d4349b0e7741 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.392118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a3cde-5dab-4868-899c-d4349b0e7741 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.393536 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 230/471] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:24.394421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a3cde-5dab-4868-899c-d4349b0e7741 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:24.398682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037f5f1-a750-4d3b-8707-7f8bb0ffb278 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:24.426327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:24.438269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bd5c6-a6c0-40d9-899b-166145fff6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:24.438900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd5c6-a6c0-40d9-899b-166145fff6bc None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.439551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd5c6-a6c0-40d9-899b-166145fff6bc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.439823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd5c6-a6c0-40d9-899b-166145fff6bc None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.440799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bd5c6-a6c0-40d9-899b-166145fff6bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:24.441108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bd5c6-a6c0-40d9-899b-166145fff6bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:24.442705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bd5c6-a6c0-40d9-899b-166145fff6bc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:24.457604 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 242/472] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:24.458498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bd5c6-a6c0-40d9-899b-166145fff6bc None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:24.500948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a3cde-5dab-4868-899c-d4349b0e7741 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:24.537964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546f1b3-5ca7-4fe2-a7e7-6a080424528d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:24.538569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f1b3-5ca7-4fe2-a7e7-6a080424528d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.538840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f1b3-5ca7-4fe2-a7e7-6a080424528d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.539084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f1b3-5ca7-4fe2-a7e7-6a080424528d None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.540145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546f1b3-5ca7-4fe2-a7e7-6a080424528d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:24.540444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546f1b3-5ca7-4fe2-a7e7-6a080424528d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:24.542197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546f1b3-5ca7-4fe2-a7e7-6a080424528d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:24.554633 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 231/473] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:24.561572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170b995-e203-4c5f-83c1-f268b99d6e43 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.561572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170b995-e203-4c5f-83c1-f268b99d6e43 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.561572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170b995-e203-4c5f-83c1-f268b99d6e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.574123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bd5c6-a6c0-40d9-899b-166145fff6bc None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:24.580286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1170b995-e203-4c5f-83c1-f268b99d6e43 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:24.581595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1170b995-e203-4c5f-83c1-f268b99d6e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:24.613703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fae1c-a394-4b99-94cd-18436a20d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:24.614667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fae1c-a394-4b99-94cd-18436a20d1c5 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.614939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fae1c-a394-4b99-94cd-18436a20d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.615203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fae1c-a394-4b99-94cd-18436a20d1c5 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.615850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fae1c-a394-4b99-94cd-18436a20d1c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:24.617325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9fae1c-a394-4b99-94cd-18436a20d1c5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:24.634932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:24.642509 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 243/474] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:58:24 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:58:24.643348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fae1c-a394-4b99-94cd-18436a20d1c5 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:24.679352 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 232/475] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:24.680607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170b995-e203-4c5f-83c1-f268b99d6e43 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:24.743329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:24.836828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fae1c-a394-4b99-94cd-18436a20d1c5 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:24.871810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170b995-e203-4c5f-83c1-f268b99d6e43 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:24.886267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a0e14-593a-4043-b313-10fbdf305502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:24.887965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0e14-593a-4043-b313-10fbdf305502 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.888389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0e14-593a-4043-b313-10fbdf305502 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.889057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a0e14-593a-4043-b313-10fbdf305502 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.889851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a0e14-593a-4043-b313-10fbdf305502 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:24.892105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a0e14-593a-4043-b313-10fbdf305502 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:24.918231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9400f6-b9c5-4e85-9a63-eb2adc17c75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:24.918949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9400f6-b9c5-4e85-9a63-eb2adc17c75c None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:24.919329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9400f6-b9c5-4e85-9a63-eb2adc17c75c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:24.919659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9400f6-b9c5-4e85-9a63-eb2adc17c75c None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:24.920385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9400f6-b9c5-4e85-9a63-eb2adc17c75c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:24.921951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9400f6-b9c5-4e85-9a63-eb2adc17c75c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:24.923946 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 244/476] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:58:24 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:58:24.956597 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 233/477] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:58:24 2022] POST /identity/v3/users => generated 249 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:58:24.964588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a0e14-593a-4043-b313-10fbdf305502 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:25.036186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:25.091002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a0e14-593a-4043-b313-10fbdf305502 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:25.133457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f980cc-3207-48a9-97f5-7f56f47c0c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:25.134511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f980cc-3207-48a9-97f5-7f56f47c0c4d None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:25.134992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f980cc-3207-48a9-97f5-7f56f47c0c4d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:25.135473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f980cc-3207-48a9-97f5-7f56f47c0c4d None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:25.136362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f980cc-3207-48a9-97f5-7f56f47c0c4d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:25.138161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f980cc-3207-48a9-97f5-7f56f47c0c4d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:25.147653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.sql.core [None req-e7f980cc-3207-48a9-97f5-7f56f47c0c4d None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 03:58:25.147653 n-d-820368-36 devstack@keystone.service[82098]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 03:58:25.147653 n-d-820368-36 devstack@keystone.service[82098]: [parameters: {'id': '8f1ad6b7684043179ba878915783249b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 03:58:25.147653 n-d-820368-36 devstack@keystone.service[82098]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82098) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-e7f980cc-3207-48a9-97f5-7f56f47c0c4d None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application conn.query(q) Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result.read() Aug 30 03:58:25.163815 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 03:58:25.164767 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application next(self.gen) Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application yield resource Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application next(self.gen) Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise self.value Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application session.commit() Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 03:58:25.165707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.session.flush() Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application compat.raise_( Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 03:58:25.166655 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:58:25.167550 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application conn.query(q) Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result.read() Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:58:25.168442 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [parameters: {'id': '8f1ad6b7684043179ba878915783249b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:25.169239 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 03:58:25.171837 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:25.174123 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 245/478] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Aug 30 03:58:24 2022] POST /identity/v3/roles => generated 144 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:25.174305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9400f6-b9c5-4e85-9a63-eb2adc17c75c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:25.261275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:25.287509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9400f6-b9c5-4e85-9a63-eb2adc17c75c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:25.323285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef45674-f4aa-4b4b-8767-87b29d4e166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:25.323926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45674-f4aa-4b4b-8767-87b29d4e166b None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:25.324195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45674-f4aa-4b4b-8767-87b29d4e166b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:25.324536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef45674-f4aa-4b4b-8767-87b29d4e166b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:25.335801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef45674-f4aa-4b4b-8767-87b29d4e166b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-bef45674-f4aa-4b4b-8767-87b29d4e166b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:25.341554 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:25.342435 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:25.343233 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 234/479] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:58:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:25.348400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f980cc-3207-48a9-97f5-7f56f47c0c4d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:25.538159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f980cc-3207-48a9-97f5-7f56f47c0c4d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:25.562384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:25.592179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac58fd9-8fad-4492-93e9-57ee61985d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:25.592720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac58fd9-8fad-4492-93e9-57ee61985d9d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:25.592991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac58fd9-8fad-4492-93e9-57ee61985d9d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:25.593260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac58fd9-8fad-4492-93e9-57ee61985d9d None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:25.593970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac58fd9-8fad-4492-93e9-57ee61985d9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:25.594272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac58fd9-8fad-4492-93e9-57ee61985d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:25.595667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac58fd9-8fad-4492-93e9-57ee61985d9d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:25.609912 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 246/480] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:26.154375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17b3dc-e100-4e03-84cf-7e66e6def737 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:26.154901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17b3dc-e100-4e03-84cf-7e66e6def737 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:26.154901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe17b3dc-e100-4e03-84cf-7e66e6def737 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:26.156712 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 235/481] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:26.161858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2e1ee-24b3-42cb-b091-e888048d7ab6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:26.162338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2e1ee-24b3-42cb-b091-e888048d7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:26.162415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2e1ee-24b3-42cb-b091-e888048d7ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:26.190995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e4b2e1ee-24b3-42cb-b091-e888048d7ab6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:26.192289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e4b2e1ee-24b3-42cb-b091-e888048d7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:26.280791 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 247/482] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:26.735346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17b3dc-e100-4e03-84cf-7e66e6def737 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:26.846474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe17b3dc-e100-4e03-84cf-7e66e6def737 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:26.881535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42a2b6-ca18-4bad-aa6e-6d9a8a2dc345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:26.882214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42a2b6-ca18-4bad-aa6e-6d9a8a2dc345 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:26.882538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42a2b6-ca18-4bad-aa6e-6d9a8a2dc345 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:26.882810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42a2b6-ca18-4bad-aa6e-6d9a8a2dc345 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:26.890697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:26.895357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42a2b6-ca18-4bad-aa6e-6d9a8a2dc345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-da42a2b6-ca18-4bad-aa6e-6d9a8a2dc345 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:26.900184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:26.901057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:26.901835 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 236/483] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:26.910988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2e1ee-24b3-42cb-b091-e888048d7ab6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:27.050748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2e1ee-24b3-42cb-b091-e888048d7ab6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:27.072032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:27.105116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d2d2d-1459-4c11-a9e7-73c6e79362e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:27.105734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d2d2d-1459-4c11-a9e7-73c6e79362e0 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.106060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d2d2d-1459-4c11-a9e7-73c6e79362e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.106304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d2d2d-1459-4c11-a9e7-73c6e79362e0 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.106981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d2d2d-1459-4c11-a9e7-73c6e79362e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:27.107275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d2d2d-1459-4c11-a9e7-73c6e79362e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:27.108644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d2d2d-1459-4c11-a9e7-73c6e79362e0 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:27.121399 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 248/484] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:27.126985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42a2b6-ca18-4bad-aa6e-6d9a8a2dc345 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:27.145108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b85e-8847-44b1-9d5b-81a579393a9f None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.145384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b85e-8847-44b1-9d5b-81a579393a9f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.145533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6b85e-8847-44b1-9d5b-81a579393a9f None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.147316 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 249/485] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:27.152219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78941-37cc-4bcf-9f25-e0aaafd0e3bc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.152498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78941-37cc-4bcf-9f25-e0aaafd0e3bc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.152793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78941-37cc-4bcf-9f25-e0aaafd0e3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.186478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-59d78941-37cc-4bcf-9f25-e0aaafd0e3bc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:27.187744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-59d78941-37cc-4bcf-9f25-e0aaafd0e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:27.242201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42a2b6-ca18-4bad-aa6e-6d9a8a2dc345 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:27.287184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c03cc9-67cf-4b9f-b8ff-080f596db667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:27.287831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03cc9-67cf-4b9f-b8ff-080f596db667 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.288096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03cc9-67cf-4b9f-b8ff-080f596db667 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.288448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c03cc9-67cf-4b9f-b8ff-080f596db667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.311560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c03cc9-67cf-4b9f-b8ff-080f596db667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:27.313101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c03cc9-67cf-4b9f-b8ff-080f596db667 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-54c03cc9-67cf-4b9f-b8ff-080f596db667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:27.340874 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:27.343060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:27.345037 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:27.345037 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:27.345037 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:27.345037 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 237/486] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:27.349069 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 250/487] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:27.350178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c03cc9-67cf-4b9f-b8ff-080f596db667 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:27.401671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:27.450670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd150-b1d6-4712-b9b6-08a506c1ef6a None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.451046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd150-b1d6-4712-b9b6-08a506c1ef6a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.451199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bd150-b1d6-4712-b9b6-08a506c1ef6a None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.452735 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 251/488] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:27.458300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21932-cc4b-46b8-a121-10606df049a6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.458579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21932-cc4b-46b8-a121-10606df049a6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.458849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc21932-cc4b-46b8-a121-10606df049a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.461611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c03cc9-67cf-4b9f-b8ff-080f596db667 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:27.478904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8fc21932-cc4b-46b8-a121-10606df049a6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:27.481906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8fc21932-cc4b-46b8-a121-10606df049a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:27.543437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaaa3d-cd5f-443d-8b1c-993b2d383e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:27.544284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaaa3d-cd5f-443d-8b1c-993b2d383e09 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.544580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaaa3d-cd5f-443d-8b1c-993b2d383e09 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.544838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaaa3d-cd5f-443d-8b1c-993b2d383e09 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.545617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaaa3d-cd5f-443d-8b1c-993b2d383e09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:27.545937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaaa3d-cd5f-443d-8b1c-993b2d383e09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:27.547600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaaa3d-cd5f-443d-8b1c-993b2d383e09 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:27.563440 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 238/489] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:27.568878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaaa3d-cd5f-443d-8b1c-993b2d383e09 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:27.641544 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 252/490] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:27.680258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43568b35-3205-452f-a98c-c2f71a4f78f0 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.680258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43568b35-3205-452f-a98c-c2f71a4f78f0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.680258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43568b35-3205-452f-a98c-c2f71a4f78f0 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.681647 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 253/491] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:27.691234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fa72f-74dd-481e-9f10-0e5828f91cbf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.691634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fa72f-74dd-481e-9f10-0e5828f91cbf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.691999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fa72f-74dd-481e-9f10-0e5828f91cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.696267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaaa3d-cd5f-443d-8b1c-993b2d383e09 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:27.709513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:27.736615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb5362-618d-44e2-813d-6237ca1502da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:27.737484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb5362-618d-44e2-813d-6237ca1502da None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.737976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb5362-618d-44e2-813d-6237ca1502da None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.738154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-298fa72f-74dd-481e-9f10-0e5828f91cbf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:27.738587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb5362-618d-44e2-813d-6237ca1502da None admin] PATH_INFO: `/v3/users/nova` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.739700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-298fa72f-74dd-481e-9f10-0e5828f91cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:27.746460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb5362-618d-44e2-813d-6237ca1502da None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:27.749140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb5362-618d-44e2-813d-6237ca1502da None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-c5bb5362-618d-44e2-813d-6237ca1502da None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:27.764587 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:27.765719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:27.766861 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:27.766861 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:27.766861 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:27.766861 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:27.766861 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:27.766861 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:27.766861 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:27.766861 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:27.766861 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:27.766861 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:27.769561 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 239/492] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 03:58:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:27.775299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb5362-618d-44e2-813d-6237ca1502da None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:27.816563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:27.895316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb5362-618d-44e2-813d-6237ca1502da None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:27.903802 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 254/493] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:27.904879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fa72f-74dd-481e-9f10-0e5828f91cbf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:27.948086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1258d2-7a0a-4512-803b-9a15b898a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:27.949383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1258d2-7a0a-4512-803b-9a15b898a626 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:27.949982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1258d2-7a0a-4512-803b-9a15b898a626 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:27.950389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1258d2-7a0a-4512-803b-9a15b898a626 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:27.952068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1258d2-7a0a-4512-803b-9a15b898a626 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:27.952825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1258d2-7a0a-4512-803b-9a15b898a626 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:27.955150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1258d2-7a0a-4512-803b-9a15b898a626 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:28.009793 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 240/494] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 03:58:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:28.010986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1258d2-7a0a-4512-803b-9a15b898a626 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:28.011663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fa72f-74dd-481e-9f10-0e5828f91cbf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.045478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:28.052454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3d064-3ea6-49cb-be89-97292ffc6d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.053333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d064-3ea6-49cb-be89-97292ffc6d4b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.054055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d064-3ea6-49cb-be89-97292ffc6d4b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.054568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d064-3ea6-49cb-be89-97292ffc6d4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.065802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3d064-3ea6-49cb-be89-97292ffc6d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-8bd3d064-3ea6-49cb-be89-97292ffc6d4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:28.071022 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:28.072086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:28.073079 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 255/495] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:28.073837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3d064-3ea6-49cb-be89-97292ffc6d4b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:28.108029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:28.154300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1258d2-7a0a-4512-803b-9a15b898a626 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.192400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd539be-a01b-4510-a550-91b79c7af944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.193044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd539be-a01b-4510-a550-91b79c7af944 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.193302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd539be-a01b-4510-a550-91b79c7af944 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.193568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd539be-a01b-4510-a550-91b79c7af944 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.197836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3d064-3ea6-49cb-be89-97292ffc6d4b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.204850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd539be-a01b-4510-a550-91b79c7af944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3bd539be-a01b-4510-a550-91b79c7af944 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:28.209575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:28.210573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:28.211384 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 241/496] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:28.212043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd539be-a01b-4510-a550-91b79c7af944 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:28.241033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfcd5b-a2b0-4677-9fa9-fced9fa3ae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.241655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfcd5b-a2b0-4677-9fa9-fced9fa3ae75 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.241965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfcd5b-a2b0-4677-9fa9-fced9fa3ae75 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.242237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfcd5b-a2b0-4677-9fa9-fced9fa3ae75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.303435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:28.310815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfcd5b-a2b0-4677-9fa9-fced9fa3ae75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:28.312394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfcd5b-a2b0-4677-9fa9-fced9fa3ae75 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:28.317397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd539be-a01b-4510-a550-91b79c7af944 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.334862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:28.350344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf06d83-4c7c-41c6-a73a-09c67013fb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.350949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06d83-4c7c-41c6-a73a-09c67013fb61 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.351223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06d83-4c7c-41c6-a73a-09c67013fb61 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.351485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06d83-4c7c-41c6-a73a-09c67013fb61 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.352142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf06d83-4c7c-41c6-a73a-09c67013fb61 None admin] RBAC: Adding query filter params (name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:28.352435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf06d83-4c7c-41c6-a73a-09c67013fb61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:28.353865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf06d83-4c7c-41c6-a73a-09c67013fb61 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:28.362085 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 242/497] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:28.364023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf06d83-4c7c-41c6-a73a-09c67013fb61 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:28.411494 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 256/498] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:28.412361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfcd5b-a2b0-4677-9fa9-fced9fa3ae75 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:28.464078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf06d83-4c7c-41c6-a73a-09c67013fb61 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.498091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77c2e8-a794-40de-8703-29f0b037c092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.498719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77c2e8-a794-40de-8703-29f0b037c092 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.498989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77c2e8-a794-40de-8703-29f0b037c092 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.499259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77c2e8-a794-40de-8703-29f0b037c092 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.509284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77c2e8-a794-40de-8703-29f0b037c092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3b77c2e8-a794-40de-8703-29f0b037c092 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:28.514489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:28.515465 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:28.516284 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 243/499] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:28.517265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d8ad-49f3-48c8-8fde-039d5955907e None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.517265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d8ad-49f3-48c8-8fde-039d5955907e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.517397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfcd5b-a2b0-4677-9fa9-fced9fa3ae75 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.517477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7d8ad-49f3-48c8-8fde-039d5955907e None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.518594 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 244/500] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:28.519126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7d8ad-49f3-48c8-8fde-039d5955907e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:28.532274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:28.546809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:28.558706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00981e-ad14-46d4-b978-096c0d91a1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.559374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00981e-ad14-46d4-b978-096c0d91a1c9 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.559645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00981e-ad14-46d4-b978-096c0d91a1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.559908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00981e-ad14-46d4-b978-096c0d91a1c9 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.560569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00981e-ad14-46d4-b978-096c0d91a1c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:28.560860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00981e-ad14-46d4-b978-096c0d91a1c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:28.562254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00981e-ad14-46d4-b978-096c0d91a1c9 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:28.570658 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 257/501] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:28.571463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00981e-ad14-46d4-b978-096c0d91a1c9 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:28.625554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7d8ad-49f3-48c8-8fde-039d5955907e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.659042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a9b85-6b56-4f8a-a66b-06e42a03c543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.659667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9b85-6b56-4f8a-a66b-06e42a03c543 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.659939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9b85-6b56-4f8a-a66b-06e42a03c543 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.660262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a9b85-6b56-4f8a-a66b-06e42a03c543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.670546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a9b85-6b56-4f8a-a66b-06e42a03c543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:28.671995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a9b85-6b56-4f8a-a66b-06e42a03c543 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:28.679765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00981e-ad14-46d4-b978-096c0d91a1c9 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-8c0a9b85-6b56-4f8a-a66b-06e42a03c543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:28.690829 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:28.691785 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:28.692918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:28.692918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:28.692918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:28.692918 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 245/502] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:28.693299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a9b85-6b56-4f8a-a66b-06e42a03c543 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:28.720129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824333f-25b3-45a7-a96a-1d3b71069cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.720812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824333f-25b3-45a7-a96a-1d3b71069cd1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.721094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824333f-25b3-45a7-a96a-1d3b71069cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.721365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824333f-25b3-45a7-a96a-1d3b71069cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.732923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824333f-25b3-45a7-a96a-1d3b71069cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:28.734422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824333f-25b3-45a7-a96a-1d3b71069cd1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-6824333f-25b3-45a7-a96a-1d3b71069cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:28.749290 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:28.750263 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:28.751120 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:28.751120 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:28.751120 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:28.751120 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 258/503] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:28.751867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95aceb-bdb5-40b1-a01d-51ae8d3b01aa None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.752145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95aceb-bdb5-40b1-a01d-51ae8d3b01aa None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.752411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95aceb-bdb5-40b1-a01d-51ae8d3b01aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.757568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:28.770585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5c95aceb-bdb5-40b1-a01d-51ae8d3b01aa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:28.771761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5c95aceb-bdb5-40b1-a01d-51ae8d3b01aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:28.801034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a9b85-6b56-4f8a-a66b-06e42a03c543 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.801468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:28.836933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561d074-19e5-4ec8-a2fc-b51fc3e6a4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.837543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561d074-19e5-4ec8-a2fc-b51fc3e6a4de None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.837813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561d074-19e5-4ec8-a2fc-b51fc3e6a4de None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.838106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561d074-19e5-4ec8-a2fc-b51fc3e6a4de None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.838776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561d074-19e5-4ec8-a2fc-b51fc3e6a4de None admin] RBAC: Adding query filter params (name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:28.839070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561d074-19e5-4ec8-a2fc-b51fc3e6a4de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:28.840593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561d074-19e5-4ec8-a2fc-b51fc3e6a4de None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:28.841399 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 259/504] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:28.841945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95aceb-bdb5-40b1-a01d-51ae8d3b01aa None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:28.849231 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 246/505] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:28.850483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561d074-19e5-4ec8-a2fc-b51fc3e6a4de None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:28.960308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561d074-19e5-4ec8-a2fc-b51fc3e6a4de None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.960513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95aceb-bdb5-40b1-a01d-51ae8d3b01aa None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:28.985853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:28.997557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6d9a-3516-4609-9f7f-9c1351fb853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.998246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6d9a-3516-4609-9f7f-9c1351fb853f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.998518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6d9a-3516-4609-9f7f-9c1351fb853f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.998726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7d7cb-6e9e-4b87-8e3c-6554addba694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:28.998835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6d9a-3516-4609-9f7f-9c1351fb853f None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:28.999372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7d7cb-6e9e-4b87-8e3c-6554addba694 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:28.999465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd6d9a-3516-4609-9f7f-9c1351fb853f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:28.999646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7d7cb-6e9e-4b87-8e3c-6554addba694 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:28.999736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd6d9a-3516-4609-9f7f-9c1351fb853f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:28.999913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7d7cb-6e9e-4b87-8e3c-6554addba694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.001123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd6d9a-3516-4609-9f7f-9c1351fb853f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.010473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7d7cb-6e9e-4b87-8e3c-6554addba694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.011936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb7d7cb-6e9e-4b87-8e3c-6554addba694 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.017632 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 247/506] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:29.017632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6d9a-3516-4609-9f7f-9c1351fb853f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-0cb7d7cb-6e9e-4b87-8e3c-6554addba694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:29.033286 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:29.034280 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:29.035141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:29.035141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:29.035141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:29.035141 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 260/507] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:29.035724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7d7cb-6e9e-4b87-8e3c-6554addba694 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.056387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:29.127325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6d9a-3516-4609-9f7f-9c1351fb853f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.143103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7d7cb-6e9e-4b87-8e3c-6554addba694 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.161621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445933-51d2-4838-af6e-871d6cc622bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.162249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445933-51d2-4838-af6e-871d6cc622bc None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.162492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445933-51d2-4838-af6e-871d6cc622bc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.162751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445933-51d2-4838-af6e-871d6cc622bc None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.163386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91445933-51d2-4838-af6e-871d6cc622bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:29.163675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91445933-51d2-4838-af6e-871d6cc622bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.165060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91445933-51d2-4838-af6e-871d6cc622bc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.176227 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 248/508] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:29.176990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445933-51d2-4838-af6e-871d6cc622bc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.178261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5fb95-5039-486d-9614-8a58a8017480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.179080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5fb95-5039-486d-9614-8a58a8017480 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.179518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5fb95-5039-486d-9614-8a58a8017480 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.179788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5fb95-5039-486d-9614-8a58a8017480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.191539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5fb95-5039-486d-9614-8a58a8017480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.193021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5fb95-5039-486d-9614-8a58a8017480 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-65a5fb95-5039-486d-9614-8a58a8017480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:29.207629 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:29.209112 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:29.209988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:29.209988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:29.209988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:29.209988 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 261/509] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:29.209988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5fb95-5039-486d-9614-8a58a8017480 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.228767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:29.279616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:29.288111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445933-51d2-4838-af6e-871d6cc622bc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.312497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5fb95-5039-486d-9614-8a58a8017480 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.321445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9907ddf-7a9e-4627-aa1c-9b98a3ea5768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.322185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9907ddf-7a9e-4627-aa1c-9b98a3ea5768 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.322523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9907ddf-7a9e-4627-aa1c-9b98a3ea5768 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.322907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9907ddf-7a9e-4627-aa1c-9b98a3ea5768 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.330886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9907ddf-7a9e-4627-aa1c-9b98a3ea5768 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.332344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9907ddf-7a9e-4627-aa1c-9b98a3ea5768 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-d9907ddf-7a9e-4627-aa1c-9b98a3ea5768 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:29.343581 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:29.344515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 249/510] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:29.345386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9907ddf-7a9e-4627-aa1c-9b98a3ea5768 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.351738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e82cf-25c3-4c0e-8481-920d334ecc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.352369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e82cf-25c3-4c0e-8481-920d334ecc6d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.352645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e82cf-25c3-4c0e-8481-920d334ecc6d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.352909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e82cf-25c3-4c0e-8481-920d334ecc6d None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.353559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e82cf-25c3-4c0e-8481-920d334ecc6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:29.353859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e82cf-25c3-4c0e-8481-920d334ecc6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.355400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e82cf-25c3-4c0e-8481-920d334ecc6d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.368081 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 262/511] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:29.368897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e82cf-25c3-4c0e-8481-920d334ecc6d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.454998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9907ddf-7a9e-4627-aa1c-9b98a3ea5768 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.457582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:29.467678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e82cf-25c3-4c0e-8481-920d334ecc6d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.490954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e627a4-24f4-4bf1-a491-67c85054342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.491578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e627a4-24f4-4bf1-a491-67c85054342d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.491845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e627a4-24f4-4bf1-a491-67c85054342d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.492112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e627a4-24f4-4bf1-a491-67c85054342d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.496966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:29.503022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e627a4-24f4-4bf1-a491-67c85054342d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.503526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95443d0-6a7c-4430-89b3-42993c604092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.504167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95443d0-6a7c-4430-89b3-42993c604092 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.504440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95443d0-6a7c-4430-89b3-42993c604092 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.504532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e627a4-24f4-4bf1-a491-67c85054342d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.504703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95443d0-6a7c-4430-89b3-42993c604092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.511844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95443d0-6a7c-4430-89b3-42993c604092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.513442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95443d0-6a7c-4430-89b3-42993c604092 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-77e627a4-24f4-4bf1-a491-67c85054342d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:29.518416 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:29.519395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:29.520257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:29.520257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:29.520257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:29.520257 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 250/512] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:29.520257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e627a4-24f4-4bf1-a491-67c85054342d None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-e95443d0-6a7c-4430-89b3-42993c604092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:29.527101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:29.528331 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:29.529423 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:29.529423 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:29.529423 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:29.529423 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:29.529423 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:29.529423 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:29.529423 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:29.529423 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:29.529423 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 263/513] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:29.530898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95443d0-6a7c-4430-89b3-42993c604092 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.624478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e627a4-24f4-4bf1-a491-67c85054342d None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.632532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95443d0-6a7c-4430-89b3-42993c604092 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.658959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e80c33-e0db-4b43-878e-4235cab72570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.659563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80c33-e0db-4b43-878e-4235cab72570 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.659835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80c33-e0db-4b43-878e-4235cab72570 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.660095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e80c33-e0db-4b43-878e-4235cab72570 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.660727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e80c33-e0db-4b43-878e-4235cab72570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:29.661023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e80c33-e0db-4b43-878e-4235cab72570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.662460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e80c33-e0db-4b43-878e-4235cab72570 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.671830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde18501-ba93-4f90-b840-2f1674590585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.672445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde18501-ba93-4f90-b840-2f1674590585 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.672717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde18501-ba93-4f90-b840-2f1674590585 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.672979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde18501-ba93-4f90-b840-2f1674590585 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.673708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde18501-ba93-4f90-b840-2f1674590585 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:29.674043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde18501-ba93-4f90-b840-2f1674590585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.674221 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 251/514] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:29.675021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e80c33-e0db-4b43-878e-4235cab72570 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.676022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde18501-ba93-4f90-b840-2f1674590585 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.694472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:29.713800 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 264/515] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:29.714675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde18501-ba93-4f90-b840-2f1674590585 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.764780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:29.782829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e80c33-e0db-4b43-878e-4235cab72570 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.822340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde18501-ba93-4f90-b840-2f1674590585 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.822642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd3fb-c204-49bc-beb3-2b478b58fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.823281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd3fb-c204-49bc-beb3-2b478b58fb41 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.823554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd3fb-c204-49bc-beb3-2b478b58fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.823819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd3fb-c204-49bc-beb3-2b478b58fb41 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.831834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fd3fb-c204-49bc-beb3-2b478b58fb41 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.833327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fd3fb-c204-49bc-beb3-2b478b58fb41 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-929fd3fb-c204-49bc-beb3-2b478b58fb41 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:29.845909 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:29.846893 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 252/516] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:29.847797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd3fb-c204-49bc-beb3-2b478b58fb41 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.862521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5601d-7817-4118-9c1a-f12ad14488a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.863196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5601d-7817-4118-9c1a-f12ad14488a5 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.863465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5601d-7817-4118-9c1a-f12ad14488a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.863723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5601d-7817-4118-9c1a-f12ad14488a5 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.864367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5601d-7817-4118-9c1a-f12ad14488a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:29.864660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5601d-7817-4118-9c1a-f12ad14488a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.866065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5601d-7817-4118-9c1a-f12ad14488a5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:29.878015 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 265/517] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:29.878748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5601d-7817-4118-9c1a-f12ad14488a5 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:29.932481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:29.959310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd3fb-c204-49bc-beb3-2b478b58fb41 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.981912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5601d-7817-4118-9c1a-f12ad14488a5 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:29.991784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:29.994077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb19a6-93df-451f-a6ff-b8f1a73ddb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:29.994691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb19a6-93df-451f-a6ff-b8f1a73ddb5f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:29.994995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb19a6-93df-451f-a6ff-b8f1a73ddb5f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:29.995262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb19a6-93df-451f-a6ff-b8f1a73ddb5f None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:29.995956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb19a6-93df-451f-a6ff-b8f1a73ddb5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:29.996253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb19a6-93df-451f-a6ff-b8f1a73ddb5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:29.997786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb19a6-93df-451f-a6ff-b8f1a73ddb5f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:30.015022 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 253/518] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:30.020176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb19a6-93df-451f-a6ff-b8f1a73ddb5f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:30.020289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535eaf8-9366-4d52-b4cf-df152506a3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:30.020289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535eaf8-9366-4d52-b4cf-df152506a3fc None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:30.020460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535eaf8-9366-4d52-b4cf-df152506a3fc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:30.020590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535eaf8-9366-4d52-b4cf-df152506a3fc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:30.029284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535eaf8-9366-4d52-b4cf-df152506a3fc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:30.030791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535eaf8-9366-4d52-b4cf-df152506a3fc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-6535eaf8-9366-4d52-b4cf-df152506a3fc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:30.043340 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:30.044451 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:30.045628 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 266/519] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:30.046685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535eaf8-9366-4d52-b4cf-df152506a3fc None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:30.125574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb19a6-93df-451f-a6ff-b8f1a73ddb5f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:30.154203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535eaf8-9366-4d52-b4cf-df152506a3fc None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:30.165223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474e28-cd35-40dc-95ea-18f5a3195a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:30.166169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474e28-cd35-40dc-95ea-18f5a3195a18 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:30.166592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474e28-cd35-40dc-95ea-18f5a3195a18 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:30.167024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30474e28-cd35-40dc-95ea-18f5a3195a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:30.172037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:30.190078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f464d3-0119-4ed2-a9b2-839c2a7e4f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:30.190724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f464d3-0119-4ed2-a9b2-839c2a7e4f59 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:30.190997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f464d3-0119-4ed2-a9b2-839c2a7e4f59 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:30.191259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f464d3-0119-4ed2-a9b2-839c2a7e4f59 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:30.191990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f464d3-0119-4ed2-a9b2-839c2a7e4f59 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:30.192293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f464d3-0119-4ed2-a9b2-839c2a7e4f59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:30.194144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f464d3-0119-4ed2-a9b2-839c2a7e4f59 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:30.213379 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 267/520] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Aug 30 03:58:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:30.214386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f464d3-0119-4ed2-a9b2-839c2a7e4f59 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:30.245126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:30.249198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30474e28-cd35-40dc-95ea-18f5a3195a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:30.250741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30474e28-cd35-40dc-95ea-18f5a3195a18 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:30.320082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f464d3-0119-4ed2-a9b2-839c2a7e4f59 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:30.354104 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 254/521] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:30.354957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474e28-cd35-40dc-95ea-18f5a3195a18 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:30.357664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5ac0c-aaef-4a70-be5b-07e284628b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:30.358487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5ac0c-aaef-4a70-be5b-07e284628b75 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:30.358760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5ac0c-aaef-4a70-be5b-07e284628b75 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:30.359027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5ac0c-aaef-4a70-be5b-07e284628b75 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:30.359683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5ac0c-aaef-4a70-be5b-07e284628b75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:30.361147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5ac0c-aaef-4a70-be5b-07e284628b75 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:30.383256 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 268/522] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:58:30 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:58:30.384092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5ac0c-aaef-4a70-be5b-07e284628b75 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:30.396790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:30.487640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:30.504414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30474e28-cd35-40dc-95ea-18f5a3195a18 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:30.517131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5ac0c-aaef-4a70-be5b-07e284628b75 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:30.547925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b246d-00ce-4164-a40a-92cf8a6de046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:30.548996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b246d-00ce-4164-a40a-92cf8a6de046 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:30.548996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b246d-00ce-4164-a40a-92cf8a6de046 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:30.548996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b246d-00ce-4164-a40a-92cf8a6de046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:30.549758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b246d-00ce-4164-a40a-92cf8a6de046 None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d3a99d39337841849b3e2efe48ebe53c) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:30.550089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b246d-00ce-4164-a40a-92cf8a6de046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:30.551555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b246d-00ce-4164-a40a-92cf8a6de046 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:30.558200 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 255/523] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:30 2022] GET /identity/v3/role_assignments?user.id=d3a99d39337841849b3e2efe48ebe53c&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:30.559249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b246d-00ce-4164-a40a-92cf8a6de046 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:30.566269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f73d7-17f1-4fb8-b814-fad56a036656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:30.567619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f73d7-17f1-4fb8-b814-fad56a036656 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:30.567756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f73d7-17f1-4fb8-b814-fad56a036656 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:30.569445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f73d7-17f1-4fb8-b814-fad56a036656 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:30.571085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f73d7-17f1-4fb8-b814-fad56a036656 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:30.571484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f73d7-17f1-4fb8-b814-fad56a036656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:30.573158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f73d7-17f1-4fb8-b814-fad56a036656 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:30.605287 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 269/524] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 03:58:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:30.605909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f73d7-17f1-4fb8-b814-fad56a036656 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:30.765543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b246d-00ce-4164-a40a-92cf8a6de046 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:30.770246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:30.801147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f73d7-17f1-4fb8-b814-fad56a036656 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:30.822245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f95ad3-2556-4108-b3ae-9e0e57d9a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:30.823082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f95ad3-2556-4108-b3ae-9e0e57d9a629 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:30.823543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f95ad3-2556-4108-b3ae-9e0e57d9a629 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:30.823992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f95ad3-2556-4108-b3ae-9e0e57d9a629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:30.873422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72be8f6-ba85-4f89-93ac-ed5029ffb6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:30.875127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be8f6-ba85-4f89-93ac-ed5029ffb6ea None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:30.876169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be8f6-ba85-4f89-93ac-ed5029ffb6ea None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:30.877181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72be8f6-ba85-4f89-93ac-ed5029ffb6ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:30.894181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:30.898862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72be8f6-ba85-4f89-93ac-ed5029ffb6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:30.902867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72be8f6-ba85-4f89-93ac-ed5029ffb6ea None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-a72be8f6-ba85-4f89-93ac-ed5029ffb6ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:30.931769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:30.933508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:30.935227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:30.935227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:30.935227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:30.938348 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 270/525] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:30.940110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72be8f6-ba85-4f89-93ac-ed5029ffb6ea None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:30.953137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f95ad3-2556-4108-b3ae-9e0e57d9a629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:30.956126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f95ad3-2556-4108-b3ae-9e0e57d9a629 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:31.117782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72be8f6-ba85-4f89-93ac-ed5029ffb6ea None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:31.148190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:31.156561 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 256/526] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:31.159178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f95ad3-2556-4108-b3ae-9e0e57d9a629 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:31.175726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c4585-1293-4e0a-9394-8348995a3e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:31.176951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c4585-1293-4e0a-9394-8348995a3e07 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:31.177252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c4585-1293-4e0a-9394-8348995a3e07 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:31.177707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c4585-1293-4e0a-9394-8348995a3e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:31.276375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:31.292810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c4585-1293-4e0a-9394-8348995a3e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:31.296040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c4585-1293-4e0a-9394-8348995a3e07 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:31.356489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f95ad3-2556-4108-b3ae-9e0e57d9a629 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:31.412904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02b40e-1cec-4fd6-af67-37dd906523f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:31.413745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b40e-1cec-4fd6-af67-37dd906523f8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:31.414252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b40e-1cec-4fd6-af67-37dd906523f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:31.414701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02b40e-1cec-4fd6-af67-37dd906523f8 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:31.415788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02b40e-1cec-4fd6-af67-37dd906523f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:31.416296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02b40e-1cec-4fd6-af67-37dd906523f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:31.418736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02b40e-1cec-4fd6-af67-37dd906523f8 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:31.442328 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 257/527] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:31.443778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02b40e-1cec-4fd6-af67-37dd906523f8 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:31.490388 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 271/528] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:31.492249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c4585-1293-4e0a-9394-8348995a3e07 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:31.554738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:31.625817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02b40e-1cec-4fd6-af67-37dd906523f8 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:31.669462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:31.689542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c4585-1293-4e0a-9394-8348995a3e07 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:31.693867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc27fae-920e-46f0-85d9-e7dc619dec86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:31.695211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc27fae-920e-46f0-85d9-e7dc619dec86 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:31.695970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc27fae-920e-46f0-85d9-e7dc619dec86 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:31.696655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc27fae-920e-46f0-85d9-e7dc619dec86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:31.714641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc27fae-920e-46f0-85d9-e7dc619dec86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:31.717977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc27fae-920e-46f0-85d9-e7dc619dec86 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6dc27fae-920e-46f0-85d9-e7dc619dec86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:31.743694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:31.744695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:31.745654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:31.745654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:31.745654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:31.749303 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 258/529] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:31.750991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc27fae-920e-46f0-85d9-e7dc619dec86 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:31.758102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f296a-1944-4b15-8cd1-7d76b36658b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:31.758424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f296a-1944-4b15-8cd1-7d76b36658b8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:31.758876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f296a-1944-4b15-8cd1-7d76b36658b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:31.759336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f296a-1944-4b15-8cd1-7d76b36658b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:31.773730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f296a-1944-4b15-8cd1-7d76b36658b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:31.776152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f296a-1944-4b15-8cd1-7d76b36658b8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-533f296a-1944-4b15-8cd1-7d76b36658b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:31.798156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:31.799781 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:31.801351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:31.801351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:31.801351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:31.801351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:31.801351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:31.801351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:31.801351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:31.801351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:31.806104 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 272/530] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:31.807352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f296a-1944-4b15-8cd1-7d76b36658b8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:31.932370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc27fae-920e-46f0-85d9-e7dc619dec86 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:31.955102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:31.979503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f296a-1944-4b15-8cd1-7d76b36658b8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:31.992847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ef584-0634-4de0-a40c-fa68aa67e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:31.994290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ef584-0634-4de0-a40c-fa68aa67e86a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:31.995029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ef584-0634-4de0-a40c-fa68aa67e86a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:31.995721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ef584-0634-4de0-a40c-fa68aa67e86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.015148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ef584-0634-4de0-a40c-fa68aa67e86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:32.018121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ef584-0634-4de0-a40c-fa68aa67e86a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:32.041864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a2ea-5cfb-48b0-974a-392540e53fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:32.042859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a2ea-5cfb-48b0-974a-392540e53fb4 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.043318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a2ea-5cfb-48b0-974a-392540e53fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.043771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a2ea-5cfb-48b0-974a-392540e53fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.045185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64a2ea-5cfb-48b0-974a-392540e53fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:32.045678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64a2ea-5cfb-48b0-974a-392540e53fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-4a9ef584-0634-4de0-a40c-fa68aa67e86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:32.047616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:32.049546 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:32.051223 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:32.051223 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:32.051223 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:32.051526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64a2ea-5cfb-48b0-974a-392540e53fb4 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:32.054159 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 259/531] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:32.055795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ef584-0634-4de0-a40c-fa68aa67e86a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:32.078553 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 273/532] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:32.086980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a2ea-5cfb-48b0-974a-392540e53fb4 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:32.114229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:32.219947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ef584-0634-4de0-a40c-fa68aa67e86a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:32.246855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a2ea-5cfb-48b0-974a-392540e53fb4 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:32.257310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0365ebd-fd4f-46d4-a532-4604a9643541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:32.258300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0365ebd-fd4f-46d4-a532-4604a9643541 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.258774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0365ebd-fd4f-46d4-a532-4604a9643541 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.259240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0365ebd-fd4f-46d4-a532-4604a9643541 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.260137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0365ebd-fd4f-46d4-a532-4604a9643541 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:32.260673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0365ebd-fd4f-46d4-a532-4604a9643541 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:32.262407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0365ebd-fd4f-46d4-a532-4604a9643541 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:32.276360 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 260/533] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:32.277573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0365ebd-fd4f-46d4-a532-4604a9643541 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:32.295269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d496d9-e18a-4e60-95b9-29ac8861a2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:32.295966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d496d9-e18a-4e60-95b9-29ac8861a2d8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.296158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d496d9-e18a-4e60-95b9-29ac8861a2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.296420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d496d9-e18a-4e60-95b9-29ac8861a2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.297074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d496d9-e18a-4e60-95b9-29ac8861a2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:32.297368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d496d9-e18a-4e60-95b9-29ac8861a2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:32.298885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d496d9-e18a-4e60-95b9-29ac8861a2d8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:32.308657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:32.316674 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 274/534] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:32.318302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d496d9-e18a-4e60-95b9-29ac8861a2d8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:32.391140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0365ebd-fd4f-46d4-a532-4604a9643541 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:32.393012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:32.424344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d496d9-e18a-4e60-95b9-29ac8861a2d8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:32.428298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35a2fa-e286-42b6-8b67-ec491ee2a4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:32.429182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a2fa-e286-42b6-8b67-ec491ee2a4f8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.429658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a2fa-e286-42b6-8b67-ec491ee2a4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.430167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a2fa-e286-42b6-8b67-ec491ee2a4f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.438192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35a2fa-e286-42b6-8b67-ec491ee2a4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:32.440085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35a2fa-e286-42b6-8b67-ec491ee2a4f8 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-aa35a2fa-e286-42b6-8b67-ec491ee2a4f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:32.452841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:32.453745 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:32.455199 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:32.455199 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:32.455199 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:32.455199 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:32.455199 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:32.455199 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:32.455199 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:32.455199 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:32.455199 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 261/535] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:32.455199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35a2fa-e286-42b6-8b67-ec491ee2a4f8 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:32.463235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b55d0c-8bcb-451e-ae59-743bfaecc6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:32.463858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b55d0c-8bcb-451e-ae59-743bfaecc6bc None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.464647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b55d0c-8bcb-451e-ae59-743bfaecc6bc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.464924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b55d0c-8bcb-451e-ae59-743bfaecc6bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.465662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b55d0c-8bcb-451e-ae59-743bfaecc6bc None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=0d31eed8c74549f8b8c6bb5aaa6bee98) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:32.466047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b55d0c-8bcb-451e-ae59-743bfaecc6bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:32.467868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b55d0c-8bcb-451e-ae59-743bfaecc6bc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:32.474513 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 275/536] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:32 2022] GET /identity/v3/role_assignments?user.id=0d31eed8c74549f8b8c6bb5aaa6bee98&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:32.475943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa652d-3088-4659-8127-0403daa2399b None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.476277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa652d-3088-4659-8127-0403daa2399b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.476546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa652d-3088-4659-8127-0403daa2399b None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.477868 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 276/537] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:32.482761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa652d-3088-4659-8127-0403daa2399b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:32.563165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:32.585548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35a2fa-e286-42b6-8b67-ec491ee2a4f8 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:32.628011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa652d-3088-4659-8127-0403daa2399b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:32.632016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f94e4-87bf-4263-bf46-3119d34f574f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:32.632661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f94e4-87bf-4263-bf46-3119d34f574f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.632934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f94e4-87bf-4263-bf46-3119d34f574f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.633199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f94e4-87bf-4263-bf46-3119d34f574f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.641161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f94e4-87bf-4263-bf46-3119d34f574f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:32.642683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f94e4-87bf-4263-bf46-3119d34f574f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-bd7f94e4-87bf-4263-bf46-3119d34f574f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:32.655843 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:32.656806 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:32.657638 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:32.657638 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:32.657638 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:32.657638 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:32.657638 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:32.657638 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:32.657638 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:32.657638 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:32.657638 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 262/538] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:32.658703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9924f-1f9a-4a42-a9a3-2695b3135d12 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.658703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9924f-1f9a-4a42-a9a3-2695b3135d12 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.658871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9924f-1f9a-4a42-a9a3-2695b3135d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.671687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda9568-09a2-4cc1-b6d3-369fc6d3c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:32.672325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda9568-09a2-4cc1-b6d3-369fc6d3c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.672578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda9568-09a2-4cc1-b6d3-369fc6d3c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.672840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda9568-09a2-4cc1-b6d3-369fc6d3c1f0 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.673529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda9568-09a2-4cc1-b6d3-369fc6d3c1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:32.673829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda9568-09a2-4cc1-b6d3-369fc6d3c1f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:32.675306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda9568-09a2-4cc1-b6d3-369fc6d3c1f0 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:32.680664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-09c9924f-1f9a-4a42-a9a3-2695b3135d12 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:32.680664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-09c9924f-1f9a-4a42-a9a3-2695b3135d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:32.688518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:32.702666 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 277/539] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:32.702666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b406ec-8459-4130-82e3-4855da9ecec3 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.702666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b406ec-8459-4130-82e3-4855da9ecec3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.702666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b406ec-8459-4130-82e3-4855da9ecec3 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.702666 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 278/540] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:32.702666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b406ec-8459-4130-82e3-4855da9ecec3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:32.757106 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 263/541] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:32.757891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9924f-1f9a-4a42-a9a3-2695b3135d12 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:32.816496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b406ec-8459-4130-82e3-4855da9ecec3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:32.854365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13526814-98aa-49dd-bc47-f449c63036fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:32.855449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13526814-98aa-49dd-bc47-f449c63036fb None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.855877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13526814-98aa-49dd-bc47-f449c63036fb None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.856145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13526814-98aa-49dd-bc47-f449c63036fb None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.857023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13526814-98aa-49dd-bc47-f449c63036fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:32.857578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13526814-98aa-49dd-bc47-f449c63036fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:32.859071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13526814-98aa-49dd-bc47-f449c63036fb None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:32.861658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:32.874411 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 279/542] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:32.875799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32ca9-7db5-4cce-8c87-5147668e79a0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.876081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32ca9-7db5-4cce-8c87-5147668e79a0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.876350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c32ca9-7db5-4cce-8c87-5147668e79a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.896678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9924f-1f9a-4a42-a9a3-2695b3135d12 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:32.896863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b9c32ca9-7db5-4cce-8c87-5147668e79a0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:32.898036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b9c32ca9-7db5-4cce-8c87-5147668e79a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:32.944010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965a720-3863-4d92-89e5-fab0b83dc729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:32.945411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a720-3863-4d92-89e5-fab0b83dc729 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:32.946154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a720-3863-4d92-89e5-fab0b83dc729 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:32.946615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965a720-3863-4d92-89e5-fab0b83dc729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:32.947799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965a720-3863-4d92-89e5-fab0b83dc729 None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=e7fbaf173ad846c6a5cb818ea09c9197) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:32.948732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965a720-3863-4d92-89e5-fab0b83dc729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:32.951094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965a720-3863-4d92-89e5-fab0b83dc729 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:32.952129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:32.960586 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 264/543] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:32 2022] GET /identity/v3/role_assignments?user.id=e7fbaf173ad846c6a5cb818ea09c9197&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:32.961822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965a720-3863-4d92-89e5-fab0b83dc729 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:32.991298 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 280/544] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:33.076029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965a720-3863-4d92-89e5-fab0b83dc729 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:33.077605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c32ca9-7db5-4cce-8c87-5147668e79a0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:33.125520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0588ca2-e080-4be8-885a-3d9a4083362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:33.126561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0588ca2-e080-4be8-885a-3d9a4083362e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:33.127036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0588ca2-e080-4be8-885a-3d9a4083362e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:33.127525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0588ca2-e080-4be8-885a-3d9a4083362e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:33.129230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0588ca2-e080-4be8-885a-3d9a4083362e None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=38a84e3c6a2d4c0ab3a00851e555330a) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:33.129819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0588ca2-e080-4be8-885a-3d9a4083362e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:33.132077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0588ca2-e080-4be8-885a-3d9a4083362e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:33.141205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 265/545] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:32 2022] GET /identity/v3/role_assignments?user.id=38a84e3c6a2d4c0ab3a00851e555330a&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:33.210388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c32ca9-7db5-4cce-8c87-5147668e79a0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:33.251909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8123a3-2f06-4841-94e6-60f7fb79c13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:33.252949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8123a3-2f06-4841-94e6-60f7fb79c13c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:33.253426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8123a3-2f06-4841-94e6-60f7fb79c13c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:33.254027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8123a3-2f06-4841-94e6-60f7fb79c13c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:33.266752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8123a3-2f06-4841-94e6-60f7fb79c13c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-eb8123a3-2f06-4841-94e6-60f7fb79c13c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:33.272132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:33.273034 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:33.273826 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:33.276638 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 281/546] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:33.282680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0588ca2-e080-4be8-885a-3d9a4083362e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:33.285860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:33.349781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8123a3-2f06-4841-94e6-60f7fb79c13c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:33.415631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:33.422931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0588ca2-e080-4be8-885a-3d9a4083362e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:33.462783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325c48-8980-450f-a68c-10c1e35a8f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:33.463784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325c48-8980-450f-a68c-10c1e35a8f1c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:33.464286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325c48-8980-450f-a68c-10c1e35a8f1c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:33.464746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325c48-8980-450f-a68c-10c1e35a8f1c None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:33.465609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325c48-8980-450f-a68c-10c1e35a8f1c None admin] RBAC: Adding query filter params (name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:33.466166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325c48-8980-450f-a68c-10c1e35a8f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:33.468011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf325c48-8980-450f-a68c-10c1e35a8f1c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:33.477835 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 266/547] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:33.486998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325c48-8980-450f-a68c-10c1e35a8f1c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:33.527311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8123a3-2f06-4841-94e6-60f7fb79c13c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:33.599011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344aca0-3580-46f3-9c9e-2fc763d90529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:33.600224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344aca0-3580-46f3-9c9e-2fc763d90529 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:33.604741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344aca0-3580-46f3-9c9e-2fc763d90529 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:33.605288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344aca0-3580-46f3-9c9e-2fc763d90529 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:33.629431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:33.639822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344aca0-3580-46f3-9c9e-2fc763d90529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-2344aca0-3580-46f3-9c9e-2fc763d90529 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:33.652105 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:33.653094 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:33.653999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:33.657403 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 282/548] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:33.664800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344aca0-3580-46f3-9c9e-2fc763d90529 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:33.722818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325c48-8980-450f-a68c-10c1e35a8f1c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:33.767579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c08da-56db-4511-801f-b9148afa8309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:33.768518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c08da-56db-4511-801f-b9148afa8309 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:33.768798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c08da-56db-4511-801f-b9148afa8309 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:33.769218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c08da-56db-4511-801f-b9148afa8309 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:33.781173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c08da-56db-4511-801f-b9148afa8309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:33.782689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c08da-56db-4511-801f-b9148afa8309 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-332c08da-56db-4511-801f-b9148afa8309 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:33.799269 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:33.800798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:33.801800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:33.801800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:33.801800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:33.801800 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 267/549] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:33.806832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c08da-56db-4511-801f-b9148afa8309 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:33.867670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344aca0-3580-46f3-9c9e-2fc763d90529 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:33.884935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:33.933392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a424f1-105f-429d-baff-bb38e43ddac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:33.934044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a424f1-105f-429d-baff-bb38e43ddac6 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:33.934315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a424f1-105f-429d-baff-bb38e43ddac6 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:33.934585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a424f1-105f-429d-baff-bb38e43ddac6 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:33.935571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a424f1-105f-429d-baff-bb38e43ddac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:33.936016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a424f1-105f-429d-baff-bb38e43ddac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:33.937521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a424f1-105f-429d-baff-bb38e43ddac6 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:33.946367 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 283/550] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:33.952225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a424f1-105f-429d-baff-bb38e43ddac6 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:33.999937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c08da-56db-4511-801f-b9148afa8309 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:34.036020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:34.072075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35121c-5250-4369-bfe9-af274cf75732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:34.072702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35121c-5250-4369-bfe9-af274cf75732 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:34.072977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35121c-5250-4369-bfe9-af274cf75732 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:34.073239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a35121c-5250-4369-bfe9-af274cf75732 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:34.073904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35121c-5250-4369-bfe9-af274cf75732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:34.074208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35121c-5250-4369-bfe9-af274cf75732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:34.075977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a35121c-5250-4369-bfe9-af274cf75732 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:34.107051 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 268/551] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:34.111478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35121c-5250-4369-bfe9-af274cf75732 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:34.149951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a424f1-105f-429d-baff-bb38e43ddac6 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:34.248370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a35121c-5250-4369-bfe9-af274cf75732 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:34.251198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f589aee-ed92-41b8-a519-5aa9bc3d1686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:34.251860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f589aee-ed92-41b8-a519-5aa9bc3d1686 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:34.252130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f589aee-ed92-41b8-a519-5aa9bc3d1686 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:34.252396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f589aee-ed92-41b8-a519-5aa9bc3d1686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:34.279148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f589aee-ed92-41b8-a519-5aa9bc3d1686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:34.280942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f589aee-ed92-41b8-a519-5aa9bc3d1686 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:34.286350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c991f47-0646-46ba-9383-e14f36102247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:34.287030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c991f47-0646-46ba-9383-e14f36102247 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:34.287305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c991f47-0646-46ba-9383-e14f36102247 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:34.287569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c991f47-0646-46ba-9383-e14f36102247 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:34.295363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c991f47-0646-46ba-9383-e14f36102247 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:34.296902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c991f47-0646-46ba-9383-e14f36102247 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-2c991f47-0646-46ba-9383-e14f36102247 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:34.309320 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:34.310753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:34.312278 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 269/552] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-8f589aee-ed92-41b8-a519-5aa9bc3d1686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:34.315334 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:34.317055 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:34.318151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:34.318151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:34.318151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:34.318151 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 284/553] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:34.318832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c991f47-0646-46ba-9383-e14f36102247 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:34.324598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f589aee-ed92-41b8-a519-5aa9bc3d1686 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:34.367668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:34.390233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:34.480335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c991f47-0646-46ba-9383-e14f36102247 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:34.494388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f589aee-ed92-41b8-a519-5aa9bc3d1686 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:34.535576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c7c61-5f66-4a06-a79d-0e05c51573b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:34.536564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7c61-5f66-4a06-a79d-0e05c51573b6 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:34.538071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7c61-5f66-4a06-a79d-0e05c51573b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:34.538617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c7c61-5f66-4a06-a79d-0e05c51573b6 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:34.539836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c7c61-5f66-4a06-a79d-0e05c51573b6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:34.541162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c7c61-5f66-4a06-a79d-0e05c51573b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:34.543661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c7c61-5f66-4a06-a79d-0e05c51573b6 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:34.561262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964dbcd-ff3f-43c6-b950-fca42f5ac3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:34.562267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964dbcd-ff3f-43c6-b950-fca42f5ac3b8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:34.563447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964dbcd-ff3f-43c6-b950-fca42f5ac3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:34.564016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5964dbcd-ff3f-43c6-b950-fca42f5ac3b8 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:34.564978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964dbcd-ff3f-43c6-b950-fca42f5ac3b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:34.566425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964dbcd-ff3f-43c6-b950-fca42f5ac3b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:34.571313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5964dbcd-ff3f-43c6-b950-fca42f5ac3b8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:34.581986 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 270/554] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 03:58:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:34.584102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151d9c2-890d-4e23-b752-dfe3bea0b956 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:34.584576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151d9c2-890d-4e23-b752-dfe3bea0b956 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:34.585129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151d9c2-890d-4e23-b752-dfe3bea0b956 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:34.586801 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 271/555] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:34.588120 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 285/556] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:34.589055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151d9c2-890d-4e23-b752-dfe3bea0b956 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:34.594826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964dbcd-ff3f-43c6-b950-fca42f5ac3b8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:34.683646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:34.706649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5964dbcd-ff3f-43c6-b950-fca42f5ac3b8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:34.708734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:34.718183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151d9c2-890d-4e23-b752-dfe3bea0b956 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:34.742789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654145-f14b-4199-9d12-186bd6f4b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:34.743516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654145-f14b-4199-9d12-186bd6f4b989 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:34.743882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654145-f14b-4199-9d12-186bd6f4b989 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:34.744244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654145-f14b-4199-9d12-186bd6f4b989 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:34.752000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd654145-f14b-4199-9d12-186bd6f4b989 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:34.753596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd654145-f14b-4199-9d12-186bd6f4b989 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:34.757243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93d65c-3e01-4755-b550-a5377813e2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:34.758056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93d65c-3e01-4755-b550-a5377813e2f6 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:34.758491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93d65c-3e01-4755-b550-a5377813e2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:34.758892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93d65c-3e01-4755-b550-a5377813e2f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-dd654145-f14b-4199-9d12-186bd6f4b989 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:34.766854 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:34.768539 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:34.769508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:34.769508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:34.769508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:34.769508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:34.769508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:34.769508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:34.769508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:34.769508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:34.769508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:34.769508 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:34.770081 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 286/557] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 03:58:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:34.771207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b6fc-295d-4730-89a2-9ebdb4125759 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:34.771547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b6fc-295d-4730-89a2-9ebdb4125759 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:34.771878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196b6fc-295d-4730-89a2-9ebdb4125759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:34.790597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6196b6fc-295d-4730-89a2-9ebdb4125759 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:34.791885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6196b6fc-295d-4730-89a2-9ebdb4125759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:34.854139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93d65c-3e01-4755-b550-a5377813e2f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:34.855963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93d65c-3e01-4755-b550-a5377813e2f6 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:34.875336 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 287/558] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:34.876505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196b6fc-295d-4730-89a2-9ebdb4125759 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:34.956611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:34.965221 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 272/559] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:34.969359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:34.971685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93d65c-3e01-4755-b550-a5377813e2f6 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:35.035481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196b6fc-295d-4730-89a2-9ebdb4125759 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:35.099791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95352d90-fc75-4821-8cd0-7010d42af03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:35.100412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95352d90-fc75-4821-8cd0-7010d42af03a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.101125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95352d90-fc75-4821-8cd0-7010d42af03a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.101386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95352d90-fc75-4821-8cd0-7010d42af03a None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.102142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95352d90-fc75-4821-8cd0-7010d42af03a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:35.102439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95352d90-fc75-4821-8cd0-7010d42af03a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:35.103948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95352d90-fc75-4821-8cd0-7010d42af03a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:35.137040 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 288/560] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 03:58:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:35.142492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95352d90-fc75-4821-8cd0-7010d42af03a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:35.142919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93d65c-3e01-4755-b550-a5377813e2f6 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:35.198383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ded02-2900-47d7-bfd1-4bc9a935ced0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:35.199029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ded02-2900-47d7-bfd1-4bc9a935ced0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.199307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ded02-2900-47d7-bfd1-4bc9a935ced0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.199571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ded02-2900-47d7-bfd1-4bc9a935ced0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.210918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ded02-2900-47d7-bfd1-4bc9a935ced0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:35.212460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770ded02-2900-47d7-bfd1-4bc9a935ced0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-770ded02-2900-47d7-bfd1-4bc9a935ced0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:35.229860 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:35.230946 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:35.231916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:35.231916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:35.231916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:35.231916 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 273/561] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:35.233934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ded02-2900-47d7-bfd1-4bc9a935ced0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:35.278370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95352d90-fc75-4821-8cd0-7010d42af03a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:35.281684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:35.307979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:35.316551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98269f-d08b-4c39-9767-281b87fe9945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:35.317191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98269f-d08b-4c39-9767-281b87fe9945 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.317461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98269f-d08b-4c39-9767-281b87fe9945 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.317728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98269f-d08b-4c39-9767-281b87fe9945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.328472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98269f-d08b-4c39-9767-281b87fe9945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:35.329938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98269f-d08b-4c39-9767-281b87fe9945 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:35.343427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ded02-2900-47d7-bfd1-4bc9a935ced0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-fc98269f-d08b-4c39-9767-281b87fe9945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:35.347527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:35.348475 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:35.349999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:35.349999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:35.349999 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:35.349999 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 289/562] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:35.349999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98269f-d08b-4c39-9767-281b87fe9945 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:35.384436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f66f42-8d47-432d-90e2-3f3fa0e4a575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:35.385060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f66f42-8d47-432d-90e2-3f3fa0e4a575 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.385341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f66f42-8d47-432d-90e2-3f3fa0e4a575 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.385605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f66f42-8d47-432d-90e2-3f3fa0e4a575 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.396997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f66f42-8d47-432d-90e2-3f3fa0e4a575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-17f66f42-8d47-432d-90e2-3f3fa0e4a575 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:35.402348 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:35.403273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 274/563] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:35.404880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf9dff-d942-4d43-909c-49453f396151 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.405633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf9dff-d942-4d43-909c-49453f396151 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.405633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf9dff-d942-4d43-909c-49453f396151 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.406736 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 275/564] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:35.407429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf9dff-d942-4d43-909c-49453f396151 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:35.473546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98269f-d08b-4c39-9767-281b87fe9945 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:35.509385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a08f0f-59fb-400d-907d-9db3d32b678d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:35.510026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a08f0f-59fb-400d-907d-9db3d32b678d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.510289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a08f0f-59fb-400d-907d-9db3d32b678d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.510571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a08f0f-59fb-400d-907d-9db3d32b678d None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.511207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a08f0f-59fb-400d-907d-9db3d32b678d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:35.511505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a08f0f-59fb-400d-907d-9db3d32b678d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:35.512866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a08f0f-59fb-400d-907d-9db3d32b678d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:35.519550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf9dff-d942-4d43-909c-49453f396151 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:35.524593 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 290/565] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:35.525828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8d7f-6abc-4436-bc51-cf0c8b2f7844 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.526144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8d7f-6abc-4436-bc51-cf0c8b2f7844 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.526882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d8d7f-6abc-4436-bc51-cf0c8b2f7844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.526988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:35.545587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cf6d8d7f-6abc-4436-bc51-cf0c8b2f7844 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:35.546839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cf6d8d7f-6abc-4436-bc51-cf0c8b2f7844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:35.554072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e34168-1993-4ce1-8bed-a4e403c5d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:35.554696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e34168-1993-4ce1-8bed-a4e403c5d576 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.554968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e34168-1993-4ce1-8bed-a4e403c5d576 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.555232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e34168-1993-4ce1-8bed-a4e403c5d576 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.555868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e34168-1993-4ce1-8bed-a4e403c5d576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:35.556162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e34168-1993-4ce1-8bed-a4e403c5d576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:35.557528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e34168-1993-4ce1-8bed-a4e403c5d576 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:35.569705 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 276/566] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:35.570493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e34168-1993-4ce1-8bed-a4e403c5d576 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:35.587004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:35.620369 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 291/567] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:35.621694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c17322-7262-4935-9d06-911feebe2fd9 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.622000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c17322-7262-4935-9d06-911feebe2fd9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.622274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c17322-7262-4935-9d06-911feebe2fd9 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.623980 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 292/568] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:35.624689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c17322-7262-4935-9d06-911feebe2fd9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:35.681154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e34168-1993-4ce1-8bed-a4e403c5d576 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:35.716273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504ddbf-c3fe-432c-9432-1b6a1be8438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:35.716898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504ddbf-c3fe-432c-9432-1b6a1be8438c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.717254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504ddbf-c3fe-432c-9432-1b6a1be8438c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.717427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504ddbf-c3fe-432c-9432-1b6a1be8438c None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.718397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504ddbf-c3fe-432c-9432-1b6a1be8438c None admin] RBAC: Adding query filter params (name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:35.718691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504ddbf-c3fe-432c-9432-1b6a1be8438c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:35.720070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504ddbf-c3fe-432c-9432-1b6a1be8438c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:35.728403 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 277/569] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:35.729289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504ddbf-c3fe-432c-9432-1b6a1be8438c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:35.748657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c17322-7262-4935-9d06-911feebe2fd9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:35.758101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:35.787359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a174f-da4e-4891-92e2-b9850e01e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:35.788093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a174f-da4e-4891-92e2-b9850e01e783 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.788368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a174f-da4e-4891-92e2-b9850e01e783 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.788632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a174f-da4e-4891-92e2-b9850e01e783 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.796299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a174f-da4e-4891-92e2-b9850e01e783 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:35.797511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a174f-da4e-4891-92e2-b9850e01e783 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-7d5a174f-da4e-4891-92e2-b9850e01e783 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:35.808795 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:35.809728 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:35.811213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:35.811213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:35.811213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:35.811213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:35.811213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:35.811213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:35.811213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:35.811213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:35.811213 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 293/570] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:35.811711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4149-453b-4eb9-8985-f4593068b757 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.811711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4149-453b-4eb9-8985-f4593068b757 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.811843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4149-453b-4eb9-8985-f4593068b757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.829701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-22bd4149-453b-4eb9-8985-f4593068b757 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:35.830861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-22bd4149-453b-4eb9-8985-f4593068b757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:35.843701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504ddbf-c3fe-432c-9432-1b6a1be8438c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:35.855854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:35.879174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc891fb6-8139-470d-8b22-16fd2b4fcaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:35.879803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc891fb6-8139-470d-8b22-16fd2b4fcaa4 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:35.880077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc891fb6-8139-470d-8b22-16fd2b4fcaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:35.880342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc891fb6-8139-470d-8b22-16fd2b4fcaa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:35.887504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc891fb6-8139-470d-8b22-16fd2b4fcaa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:35.889233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc891fb6-8139-470d-8b22-16fd2b4fcaa4 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-cc891fb6-8139-470d-8b22-16fd2b4fcaa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:35.900529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:35.901419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:35.902377 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:35.902377 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:35.902377 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:35.902377 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:35.902377 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:35.902377 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:35.902377 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:35.902377 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:35.902812 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 294/571] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:35.903310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd4149-453b-4eb9-8985-f4593068b757 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:35.907039 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 278/572] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:35.908065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc891fb6-8139-470d-8b22-16fd2b4fcaa4 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.004981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:36.012895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd4149-453b-4eb9-8985-f4593068b757 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.020444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc891fb6-8139-470d-8b22-16fd2b4fcaa4 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.048983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106021f-0d48-46c5-b199-bc5fb15d0dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.049617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106021f-0d48-46c5-b199-bc5fb15d0dd7 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.049915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106021f-0d48-46c5-b199-bc5fb15d0dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.050344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106021f-0d48-46c5-b199-bc5fb15d0dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.055491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62b8b2-b477-4577-9015-df67e09b28b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.056103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62b8b2-b477-4577-9015-df67e09b28b4 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.056379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62b8b2-b477-4577-9015-df67e09b28b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.057051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62b8b2-b477-4577-9015-df67e09b28b4 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.057758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62b8b2-b477-4577-9015-df67e09b28b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:36.058464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62b8b2-b477-4577-9015-df67e09b28b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:36.059956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62b8b2-b477-4577-9015-df67e09b28b4 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:36.060091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106021f-0d48-46c5-b199-bc5fb15d0dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:36.061467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106021f-0d48-46c5-b199-bc5fb15d0dd7 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:36.077953 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 279/573] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:36.077953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62b8b2-b477-4577-9015-df67e09b28b4 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-9106021f-0d48-46c5-b199-bc5fb15d0dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:36.078186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:36.079054 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:36.080006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:36.080006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:36.080006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:36.080006 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 295/574] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:36.080006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106021f-0d48-46c5-b199-bc5fb15d0dd7 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.095223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:36.182218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106021f-0d48-46c5-b199-bc5fb15d0dd7 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.186282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62b8b2-b477-4577-9015-df67e09b28b4 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.215658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cc837-aec4-470c-a8f3-3e950167fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.216334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cc837-aec4-470c-a8f3-3e950167fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.216662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cc837-aec4-470c-a8f3-3e950167fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.216916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cc837-aec4-470c-a8f3-3e950167fbd8 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.217603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cc837-aec4-470c-a8f3-3e950167fbd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:36.217933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cc837-aec4-470c-a8f3-3e950167fbd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:36.219388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cc837-aec4-470c-a8f3-3e950167fbd8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:36.222354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eabcc3-e515-4d1f-a3d0-3e5383533262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.222999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eabcc3-e515-4d1f-a3d0-3e5383533262 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.223275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eabcc3-e515-4d1f-a3d0-3e5383533262 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.223543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eabcc3-e515-4d1f-a3d0-3e5383533262 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.231872 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 296/575] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:36.232673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cc837-aec4-470c-a8f3-3e950167fbd8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.235070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eabcc3-e515-4d1f-a3d0-3e5383533262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-39eabcc3-e515-4d1f-a3d0-3e5383533262 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:36.239933 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:36.241016 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 280/576] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:36.242136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eabcc3-e515-4d1f-a3d0-3e5383533262 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.252992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:36.304079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:36.333395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cc837-aec4-470c-a8f3-3e950167fbd8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.339915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eabcc3-e515-4d1f-a3d0-3e5383533262 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.366899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766c2b3-76c9-4a56-8118-cbf6d5f24928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.367492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766c2b3-76c9-4a56-8118-cbf6d5f24928 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.367769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766c2b3-76c9-4a56-8118-cbf6d5f24928 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.368029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766c2b3-76c9-4a56-8118-cbf6d5f24928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.368749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766c2b3-76c9-4a56-8118-cbf6d5f24928 None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d9592051e6894c86a699ca2074a32079) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:36.369048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766c2b3-76c9-4a56-8118-cbf6d5f24928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:36.370532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766c2b3-76c9-4a56-8118-cbf6d5f24928 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:36.374721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e295c20-b24f-4707-aacc-6eb7e64ea288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.375325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295c20-b24f-4707-aacc-6eb7e64ea288 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.375596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295c20-b24f-4707-aacc-6eb7e64ea288 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.375861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295c20-b24f-4707-aacc-6eb7e64ea288 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.376504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e295c20-b24f-4707-aacc-6eb7e64ea288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:36.376591 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 297/577] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:36 2022] GET /identity/v3/role_assignments?user.id=d9592051e6894c86a699ca2074a32079&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:36.376799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e295c20-b24f-4707-aacc-6eb7e64ea288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:36.377434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766c2b3-76c9-4a56-8118-cbf6d5f24928 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.378400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e295c20-b24f-4707-aacc-6eb7e64ea288 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:36.391684 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 281/578] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:36.392674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e295c20-b24f-4707-aacc-6eb7e64ea288 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.473523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:36.504375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766c2b3-76c9-4a56-8118-cbf6d5f24928 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.512404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e295c20-b24f-4707-aacc-6eb7e64ea288 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.546691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148ce4d-136c-4b98-88f3-91b587a35380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.547429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148ce4d-136c-4b98-88f3-91b587a35380 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.547699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148ce4d-136c-4b98-88f3-91b587a35380 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.547962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148ce4d-136c-4b98-88f3-91b587a35380 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.550421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8cda-22db-4d71-bfb1-dddd9890cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.551088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8cda-22db-4d71-bfb1-dddd9890cdaf None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.551363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8cda-22db-4d71-bfb1-dddd9890cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.551481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:36.551635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8cda-22db-4d71-bfb1-dddd9890cdaf None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d3a99d39337841849b3e2efe48ebe53c/roles/a212b3b588c542cca718d55760a48f1f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.561318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148ce4d-136c-4b98-88f3-91b587a35380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-1148ce4d-136c-4b98-88f3-91b587a35380 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:36.566995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:36.567940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:36.568787 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:36.569423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b8cda-22db-4d71-bfb1-dddd9890cdaf None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=d3a99d39337841849b3e2efe48ebe53c, role_id=a212b3b588c542cca718d55760a48f1f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:36.569423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b8cda-22db-4d71-bfb1-dddd9890cdaf None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:36.571336 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 298/579] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:36.572408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148ce4d-136c-4b98-88f3-91b587a35380 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.586592 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 282/580] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:58:36 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d3a99d39337841849b3e2efe48ebe53c/roles/a212b3b588c542cca718d55760a48f1f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:58:36.587695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8cda-22db-4d71-bfb1-dddd9890cdaf None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.714348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148ce4d-136c-4b98-88f3-91b587a35380 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.747106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8cda-22db-4d71-bfb1-dddd9890cdaf None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.758919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377a95e-32d3-4b9d-89f3-fc56f59373fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.759633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377a95e-32d3-4b9d-89f3-fc56f59373fd None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.759912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377a95e-32d3-4b9d-89f3-fc56f59373fd None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.760178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377a95e-32d3-4b9d-89f3-fc56f59373fd None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.760858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377a95e-32d3-4b9d-89f3-fc56f59373fd None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:36.761153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377a95e-32d3-4b9d-89f3-fc56f59373fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:36.762570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377a95e-32d3-4b9d-89f3-fc56f59373fd None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:36.769943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:36.775763 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 299/581] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:36.777266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377a95e-32d3-4b9d-89f3-fc56f59373fd None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.794501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6708db-e83d-4b98-98d7-776f697edfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.795143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6708db-e83d-4b98-98d7-776f697edfa1 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.795415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6708db-e83d-4b98-98d7-776f697edfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.796122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6708db-e83d-4b98-98d7-776f697edfa1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.803447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6708db-e83d-4b98-98d7-776f697edfa1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:36.804928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6708db-e83d-4b98-98d7-776f697edfa1 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6a6708db-e83d-4b98-98d7-776f697edfa1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:36.820597 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:36.821698 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:36.822684 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:36.822684 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:36.822684 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:36.822684 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:36.822684 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:36.822684 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:36.822684 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:36.822684 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:36.822684 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 03:58:36.822684 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:36.826124 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 283/582] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:36.827017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6708db-e83d-4b98-98d7-776f697edfa1 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.857746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:36.913929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377a95e-32d3-4b9d-89f3-fc56f59373fd None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.944620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6708db-e83d-4b98-98d7-776f697edfa1 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:36.957288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6cb07-e27e-44c1-8619-2fefe6d1913d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.957935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6cb07-e27e-44c1-8619-2fefe6d1913d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.958285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6cb07-e27e-44c1-8619-2fefe6d1913d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.958475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6cb07-e27e-44c1-8619-2fefe6d1913d None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.959145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6cb07-e27e-44c1-8619-2fefe6d1913d None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:36.959443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6cb07-e27e-44c1-8619-2fefe6d1913d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:36.960909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6cb07-e27e-44c1-8619-2fefe6d1913d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:36.977132 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 300/583] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:36.978395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6cb07-e27e-44c1-8619-2fefe6d1913d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:36.985402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a0240-fa0a-40f1-9d03-f3d7ac057f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:36.986292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a0240-fa0a-40f1-9d03-f3d7ac057f7a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:36.986705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a0240-fa0a-40f1-9d03-f3d7ac057f7a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:36.987106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a0240-fa0a-40f1-9d03-f3d7ac057f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:36.998979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a0240-fa0a-40f1-9d03-f3d7ac057f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.000716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a0240-fa0a-40f1-9d03-f3d7ac057f7a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-cb7a0240-fa0a-40f1-9d03-f3d7ac057f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:37.015950 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:37.017119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:37.018187 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:37.018187 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:37.018187 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:37.019895 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 284/584] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:37.020870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a0240-fa0a-40f1-9d03-f3d7ac057f7a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:37.052475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:37.097787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6cb07-e27e-44c1-8619-2fefe6d1913d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:37.119458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:37.129222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a0240-fa0a-40f1-9d03-f3d7ac057f7a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:37.135588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d86c-1c7b-42bc-9cf8-e034486264c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:37.136208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d86c-1c7b-42bc-9cf8-e034486264c0 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:37.136477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d86c-1c7b-42bc-9cf8-e034486264c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:37.136740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004d86c-1c7b-42bc-9cf8-e034486264c0 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:37.137470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004d86c-1c7b-42bc-9cf8-e034486264c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:37.137769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004d86c-1c7b-42bc-9cf8-e034486264c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.139539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3004d86c-1c7b-42bc-9cf8-e034486264c0 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:37.159955 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 301/585] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 03:58:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:37.164008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d86c-1c7b-42bc-9cf8-e034486264c0 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:37.179134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c6d0-1eb1-4268-86be-ea1dee09d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:37.180342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c6d0-1eb1-4268-86be-ea1dee09d20f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:37.180802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c6d0-1eb1-4268-86be-ea1dee09d20f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:37.181251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c6d0-1eb1-4268-86be-ea1dee09d20f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:37.195745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c6d0-1eb1-4268-86be-ea1dee09d20f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.197684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c6d0-1eb1-4268-86be-ea1dee09d20f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-9f09c6d0-1eb1-4268-86be-ea1dee09d20f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:37.214453 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:37.215430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:37.216353 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:37.216353 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:37.216353 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:37.220222 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 285/586] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:37.221183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c6d0-1eb1-4268-86be-ea1dee09d20f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:37.285148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3004d86c-1c7b-42bc-9cf8-e034486264c0 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:37.308715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:37.326840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3856c1a-483a-43c0-919b-e0ed11e7f6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:37.327465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856c1a-483a-43c0-919b-e0ed11e7f6cb None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:37.327740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856c1a-483a-43c0-919b-e0ed11e7f6cb None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:37.328008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856c1a-483a-43c0-919b-e0ed11e7f6cb None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:37.328657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3856c1a-483a-43c0-919b-e0ed11e7f6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:37.328964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3856c1a-483a-43c0-919b-e0ed11e7f6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.333214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3856c1a-483a-43c0-919b-e0ed11e7f6cb None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:37.333340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c6d0-1eb1-4268-86be-ea1dee09d20f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:37.347637 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 302/587] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:37.347637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3856c1a-483a-43c0-919b-e0ed11e7f6cb None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:37.373513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cbbfb-3926-4c22-ae4e-5b1ca1faa6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:37.374526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cbbfb-3926-4c22-ae4e-5b1ca1faa6b7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:37.374993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cbbfb-3926-4c22-ae4e-5b1ca1faa6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:37.375446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cbbfb-3926-4c22-ae4e-5b1ca1faa6b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:37.386565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cbbfb-3926-4c22-ae4e-5b1ca1faa6b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.388450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cbbfb-3926-4c22-ae4e-5b1ca1faa6b7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:37.395263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-7a4cbbfb-3926-4c22-ae4e-5b1ca1faa6b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:37.404466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:37.405427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:37.406333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:37.406333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:37.406333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:37.408402 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 286/588] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:37.409388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cbbfb-3926-4c22-ae4e-5b1ca1faa6b7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:37.479608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3856c1a-483a-43c0-919b-e0ed11e7f6cb None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:37.525506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cbbfb-3926-4c22-ae4e-5b1ca1faa6b7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:37.529084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50a1bb-13a1-4102-84d0-7f289bb9d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:37.530485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50a1bb-13a1-4102-84d0-7f289bb9d613 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:37.530977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50a1bb-13a1-4102-84d0-7f289bb9d613 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:37.531438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50a1bb-13a1-4102-84d0-7f289bb9d613 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:37.532274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50a1bb-13a1-4102-84d0-7f289bb9d613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:37.533491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50a1bb-13a1-4102-84d0-7f289bb9d613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.535546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50a1bb-13a1-4102-84d0-7f289bb9d613 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:37.553075 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 303/589] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:37.554867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50a1bb-13a1-4102-84d0-7f289bb9d613 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:37.562534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a2ba1-95fb-47db-84d4-6a3fb1025d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:37.563243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a2ba1-95fb-47db-84d4-6a3fb1025d99 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:37.563612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a2ba1-95fb-47db-84d4-6a3fb1025d99 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:37.563941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a2ba1-95fb-47db-84d4-6a3fb1025d99 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:37.566309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:37.574020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a2ba1-95fb-47db-84d4-6a3fb1025d99 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.575614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a2ba1-95fb-47db-84d4-6a3fb1025d99 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-494a2ba1-95fb-47db-84d4-6a3fb1025d99 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:37.588184 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:37.589278 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:37.590253 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:37.590253 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:37.590253 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:37.590253 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:37.590253 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:37.590253 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:37.590253 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:37.590253 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:37.590253 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 03:58:37.590253 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:37.594421 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 287/590] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:37.595534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a2ba1-95fb-47db-84d4-6a3fb1025d99 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:37.696900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:37.700931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50a1bb-13a1-4102-84d0-7f289bb9d613 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:37.726725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a2ba1-95fb-47db-84d4-6a3fb1025d99 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:37.738752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f9bf-4fca-41c3-b7e3-9dca7123f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:37.739536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f9bf-4fca-41c3-b7e3-9dca7123f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:37.740213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f9bf-4fca-41c3-b7e3-9dca7123f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:37.740213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f9bf-4fca-41c3-b7e3-9dca7123f3b6 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:37.740956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4f9bf-4fca-41c3-b7e3-9dca7123f3b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:37.741344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4f9bf-4fca-41c3-b7e3-9dca7123f3b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.743037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4f9bf-4fca-41c3-b7e3-9dca7123f3b6 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:37.755893 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 304/591] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:37.756946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f9bf-4fca-41c3-b7e3-9dca7123f3b6 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:37.772265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa67d0-8270-48d0-ac3c-5dd316fdb3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:37.773151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa67d0-8270-48d0-ac3c-5dd316fdb3ce None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:37.773773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa67d0-8270-48d0-ac3c-5dd316fdb3ce None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:37.774260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa67d0-8270-48d0-ac3c-5dd316fdb3ce None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:37.789129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa67d0-8270-48d0-ac3c-5dd316fdb3ce None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.791694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa67d0-8270-48d0-ac3c-5dd316fdb3ce None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-90fa67d0-8270-48d0-ac3c-5dd316fdb3ce None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:37.808212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:37.809430 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:37.810674 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:37.810674 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:37.810674 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:37.810674 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:37.810674 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:37.810674 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:37.810674 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:37.810674 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:37.810674 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 03:58:37.810674 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:37.813627 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 288/592] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:37.814916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa67d0-8270-48d0-ac3c-5dd316fdb3ce None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:37.875689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f9bf-4fca-41c3-b7e3-9dca7123f3b6 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:37.882381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:37.919180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520240bc-e1a6-4f25-85f8-e3a1c93a7d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:37.920244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520240bc-e1a6-4f25-85f8-e3a1c93a7d8a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:37.920991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520240bc-e1a6-4f25-85f8-e3a1c93a7d8a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:37.921407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520240bc-e1a6-4f25-85f8-e3a1c93a7d8a None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:37.922555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520240bc-e1a6-4f25-85f8-e3a1c93a7d8a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:37.923057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520240bc-e1a6-4f25-85f8-e3a1c93a7d8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.925340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520240bc-e1a6-4f25-85f8-e3a1c93a7d8a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:37.929810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa67d0-8270-48d0-ac3c-5dd316fdb3ce None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:37.945909 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 305/593] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Aug 30 03:58:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:37.951701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520240bc-e1a6-4f25-85f8-e3a1c93a7d8a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:37.971260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:37.975409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebf192-3e27-406f-9c9d-b5e860e5b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:37.977828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf192-3e27-406f-9c9d-b5e860e5b743 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:37.978274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf192-3e27-406f-9c9d-b5e860e5b743 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:37.978938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf192-3e27-406f-9c9d-b5e860e5b743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:37.989927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebf192-3e27-406f-9c9d-b5e860e5b743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:37.992033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebf192-3e27-406f-9c9d-b5e860e5b743 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-d2ebf192-3e27-406f-9c9d-b5e860e5b743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:38.007606 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:38.008733 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:38.009844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:38.009844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:38.009844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:38.009844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:38.009844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:38.009844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:38.009844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:38.009844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:38.012266 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 289/594] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:38.014158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebf192-3e27-406f-9c9d-b5e860e5b743 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:38.085049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520240bc-e1a6-4f25-85f8-e3a1c93a7d8a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:38.122578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d63d15-fa25-47e8-a011-60ac0568d730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:38.123532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d63d15-fa25-47e8-a011-60ac0568d730 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.123894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d63d15-fa25-47e8-a011-60ac0568d730 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.124250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d63d15-fa25-47e8-a011-60ac0568d730 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.125076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d63d15-fa25-47e8-a011-60ac0568d730 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:38.125469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d63d15-fa25-47e8-a011-60ac0568d730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:38.127034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d63d15-fa25-47e8-a011-60ac0568d730 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:38.146910 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 306/595] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 03:58:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:38.147899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d63d15-fa25-47e8-a011-60ac0568d730 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:38.155346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebf192-3e27-406f-9c9d-b5e860e5b743 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:38.176226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:38.206391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c87400-d76e-4cac-b266-7c67a05e281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:38.207577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c87400-d76e-4cac-b266-7c67a05e281c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.208082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c87400-d76e-4cac-b266-7c67a05e281c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.208712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c87400-d76e-4cac-b266-7c67a05e281c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.225654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c87400-d76e-4cac-b266-7c67a05e281c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:38.227906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c87400-d76e-4cac-b266-7c67a05e281c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:38.229856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-e9c87400-d76e-4cac-b266-7c67a05e281c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:38.250389 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:38.251607 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:38.252753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:38.252753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:38.252753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:38.254957 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 290/596] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:38.256167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c87400-d76e-4cac-b266-7c67a05e281c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:38.262442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d63d15-fa25-47e8-a011-60ac0568d730 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:38.302528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049f504-8114-4669-9697-6fa3b72bc71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:38.303286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049f504-8114-4669-9697-6fa3b72bc71e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.303734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049f504-8114-4669-9697-6fa3b72bc71e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.304094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049f504-8114-4669-9697-6fa3b72bc71e None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.304940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049f504-8114-4669-9697-6fa3b72bc71e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:38.305378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049f504-8114-4669-9697-6fa3b72bc71e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:38.307619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049f504-8114-4669-9697-6fa3b72bc71e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:38.320888 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 307/597] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:38.321738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049f504-8114-4669-9697-6fa3b72bc71e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:38.381697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c87400-d76e-4cac-b266-7c67a05e281c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:38.416585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242b858-28d9-46b6-a31b-e36d13d16c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:38.417674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b858-28d9-46b6-a31b-e36d13d16c7f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.417974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b858-28d9-46b6-a31b-e36d13d16c7f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.418379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242b858-28d9-46b6-a31b-e36d13d16c7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.428758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049f504-8114-4669-9697-6fa3b72bc71e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:38.428895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242b858-28d9-46b6-a31b-e36d13d16c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:38.430454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242b858-28d9-46b6-a31b-e36d13d16c7f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-a242b858-28d9-46b6-a31b-e36d13d16c7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:38.444634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:38.445704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:38.446957 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:38.446957 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:38.446957 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:38.446957 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 291/598] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:38.447185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608a07-8994-4550-8536-7e9deb5863a6 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.447638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608a07-8994-4550-8536-7e9deb5863a6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.448023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608a07-8994-4550-8536-7e9deb5863a6 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.453955 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 292/599] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:38.453955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608a07-8994-4550-8536-7e9deb5863a6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:38.474411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d14456-16b4-4476-aa10-03537fccc483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:38.475092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:38.475327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14456-16b4-4476-aa10-03537fccc483 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.475580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14456-16b4-4476-aa10-03537fccc483 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.475847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14456-16b4-4476-aa10-03537fccc483 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.477038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d14456-16b4-4476-aa10-03537fccc483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:38.477519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d14456-16b4-4476-aa10-03537fccc483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:38.479157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d14456-16b4-4476-aa10-03537fccc483 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:38.481189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:38.498799 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 308/600] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:38.499762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d14456-16b4-4476-aa10-03537fccc483 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:38.564064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608a07-8994-4550-8536-7e9deb5863a6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:38.598841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51559039-ffc7-4b7c-ac00-08314cb39e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:38.599483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51559039-ffc7-4b7c-ac00-08314cb39e16 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.599760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51559039-ffc7-4b7c-ac00-08314cb39e16 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.600026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51559039-ffc7-4b7c-ac00-08314cb39e16 None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/0d31eed8c74549f8b8c6bb5aaa6bee98/roles/a212b3b588c542cca718d55760a48f1f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.607153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d14456-16b4-4476-aa10-03537fccc483 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:38.615633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51559039-ffc7-4b7c-ac00-08314cb39e16 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=0d31eed8c74549f8b8c6bb5aaa6bee98, role_id=a212b3b588c542cca718d55760a48f1f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:38.617096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51559039-ffc7-4b7c-ac00-08314cb39e16 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:38.632173 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 293/601] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:58:38 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/0d31eed8c74549f8b8c6bb5aaa6bee98/roles/a212b3b588c542cca718d55760a48f1f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:58:38.633943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e2d09-1919-4ec5-b480-09ad457037d0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.634440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e2d09-1919-4ec5-b480-09ad457037d0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.634915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e2d09-1919-4ec5-b480-09ad457037d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.656624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c30e2d09-1919-4ec5-b480-09ad457037d0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:38.657962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c30e2d09-1919-4ec5-b480-09ad457037d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:38.665158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218fcb2-fa99-4dee-b9e0-b1752de4c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:38.665794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218fcb2-fa99-4dee-b9e0-b1752de4c647 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.666116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218fcb2-fa99-4dee-b9e0-b1752de4c647 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.666378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218fcb2-fa99-4dee-b9e0-b1752de4c647 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.667127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218fcb2-fa99-4dee-b9e0-b1752de4c647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:38.667343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218fcb2-fa99-4dee-b9e0-b1752de4c647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:38.668762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218fcb2-fa99-4dee-b9e0-b1752de4c647 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:38.687153 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 309/602] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:38.687153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218fcb2-fa99-4dee-b9e0-b1752de4c647 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:38.736694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:38.743890 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 294/603] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:38.745471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a1e90-6b02-4191-a96d-4986b323e015 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.750192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a1e90-6b02-4191-a96d-4986b323e015 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.750192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a1e90-6b02-4191-a96d-4986b323e015 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.750192 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 295/604] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:38.750192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a1e90-6b02-4191-a96d-4986b323e015 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:38.767597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:38.826434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218fcb2-fa99-4dee-b9e0-b1752de4c647 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:38.874240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8343ab-cb4e-406c-97ad-eaa125a51e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:38.875544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8343ab-cb4e-406c-97ad-eaa125a51e62 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.876045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8343ab-cb4e-406c-97ad-eaa125a51e62 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.876618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8343ab-cb4e-406c-97ad-eaa125a51e62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.883018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a1e90-6b02-4191-a96d-4986b323e015 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:38.885203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8343ab-cb4e-406c-97ad-eaa125a51e62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:38.887453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8343ab-cb4e-406c-97ad-eaa125a51e62 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-0c8343ab-cb4e-406c-97ad-eaa125a51e62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:38.903800 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:38.904889 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:38.905992 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:38.905992 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:38.905992 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:38.905992 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:38.905992 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:38.905992 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:38.905992 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:38.905992 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:38.908483 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 310/605] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:38.910286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249891-e19e-462c-97a3-17277edbe82d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.910717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249891-e19e-462c-97a3-17277edbe82d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.911116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52249891-e19e-462c-97a3-17277edbe82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.929821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3e45-197e-45b6-9a99-de1e33a075b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:38.930668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3e45-197e-45b6-9a99-de1e33a075b8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:38.931094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3e45-197e-45b6-9a99-de1e33a075b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:38.931468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3e45-197e-45b6-9a99-de1e33a075b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:38.933384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-52249891-e19e-462c-97a3-17277edbe82d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:38.934801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-52249891-e19e-462c-97a3-17277edbe82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:38.939521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3e45-197e-45b6-9a99-de1e33a075b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:38.941140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3e45-197e-45b6-9a99-de1e33a075b8 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-dbeb3e45-197e-45b6-9a99-de1e33a075b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:38.953101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:38.954274 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:38.955362 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:38.955362 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:38.955362 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:38.955362 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:38.955362 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:38.955362 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:38.955362 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:38.955362 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:38.956277 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 296/606] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:38.957142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3e45-197e-45b6-9a99-de1e33a075b8 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.012079 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 311/607] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:39.013324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249891-e19e-462c-97a3-17277edbe82d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.022285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:39.061148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3e45-197e-45b6-9a99-de1e33a075b8 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:39.065215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:39.096528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7485-77f9-4fe9-875e-1712708f4c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:39.097238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7485-77f9-4fe9-875e-1712708f4c84 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:39.097588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7485-77f9-4fe9-875e-1712708f4c84 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:39.098003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7485-77f9-4fe9-875e-1712708f4c84 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:39.098771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d7485-77f9-4fe9-875e-1712708f4c84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:39.099144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d7485-77f9-4fe9-875e-1712708f4c84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:39.100669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d7485-77f9-4fe9-875e-1712708f4c84 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:39.119756 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 297/608] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:39.120553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7485-77f9-4fe9-875e-1712708f4c84 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.126176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52249891-e19e-462c-97a3-17277edbe82d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:39.171998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974493e-0b6f-4c42-b713-e07b4ba4715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:39.173122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974493e-0b6f-4c42-b713-e07b4ba4715a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:39.173626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974493e-0b6f-4c42-b713-e07b4ba4715a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:39.174218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974493e-0b6f-4c42-b713-e07b4ba4715a None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:39.175116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974493e-0b6f-4c42-b713-e07b4ba4715a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:39.175608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974493e-0b6f-4c42-b713-e07b4ba4715a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:39.177566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974493e-0b6f-4c42-b713-e07b4ba4715a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:39.191417 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 312/609] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:39.192578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974493e-0b6f-4c42-b713-e07b4ba4715a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.227708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7485-77f9-4fe9-875e-1712708f4c84 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:39.245079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:39.262339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650aa1e-8e9f-4620-b995-0d4159adef91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:39.263498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650aa1e-8e9f-4620-b995-0d4159adef91 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:39.263784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650aa1e-8e9f-4620-b995-0d4159adef91 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:39.264055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650aa1e-8e9f-4620-b995-0d4159adef91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:39.276382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650aa1e-8e9f-4620-b995-0d4159adef91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-9650aa1e-8e9f-4620-b995-0d4159adef91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:39.282570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:39.283577 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:39.284449 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:39.288707 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 298/610] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:39.289514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650aa1e-8e9f-4620-b995-0d4159adef91 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.309293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974493e-0b6f-4c42-b713-e07b4ba4715a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:39.311875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:39.344608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9aa80-debe-4c2e-9d1a-2128f8d1b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:39.345311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9aa80-debe-4c2e-9d1a-2128f8d1b7cd None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:39.345589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9aa80-debe-4c2e-9d1a-2128f8d1b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:39.345855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9aa80-debe-4c2e-9d1a-2128f8d1b7cd None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/e7fbaf173ad846c6a5cb818ea09c9197/roles/a212b3b588c542cca718d55760a48f1f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:39.361057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9aa80-debe-4c2e-9d1a-2128f8d1b7cd None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=e7fbaf173ad846c6a5cb818ea09c9197, role_id=a212b3b588c542cca718d55760a48f1f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:39.362535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9aa80-debe-4c2e-9d1a-2128f8d1b7cd None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:39.381980 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 313/611] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:58:39 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/e7fbaf173ad846c6a5cb818ea09c9197/roles/a212b3b588c542cca718d55760a48f1f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:58:39.383113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9aa80-debe-4c2e-9d1a-2128f8d1b7cd None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.414019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650aa1e-8e9f-4620-b995-0d4159adef91 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:39.455208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bee23b-60a7-4b43-81c1-91eee3e62841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:39.456881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bee23b-60a7-4b43-81c1-91eee3e62841 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:39.457634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bee23b-60a7-4b43-81c1-91eee3e62841 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:39.458181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bee23b-60a7-4b43-81c1-91eee3e62841 None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/38a84e3c6a2d4c0ab3a00851e555330a/roles/a212b3b588c542cca718d55760a48f1f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:39.482592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bee23b-60a7-4b43-81c1-91eee3e62841 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=38a84e3c6a2d4c0ab3a00851e555330a, role_id=a212b3b588c542cca718d55760a48f1f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:39.485292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bee23b-60a7-4b43-81c1-91eee3e62841 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:39.494708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9aa80-debe-4c2e-9d1a-2128f8d1b7cd None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:39.509936 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 299/612] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:58:39 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/38a84e3c6a2d4c0ab3a00851e555330a/roles/a212b3b588c542cca718d55760a48f1f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:58:39.510574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bee23b-60a7-4b43-81c1-91eee3e62841 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.548033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:39.551755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d353d-eb7a-40ca-b4a2-d51f55997796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:39.552395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d353d-eb7a-40ca-b4a2-d51f55997796 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:39.552672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d353d-eb7a-40ca-b4a2-d51f55997796 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:39.552941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d353d-eb7a-40ca-b4a2-d51f55997796 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:39.553626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d353d-eb7a-40ca-b4a2-d51f55997796 None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:39.553953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d353d-eb7a-40ca-b4a2-d51f55997796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:39.556629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d353d-eb7a-40ca-b4a2-d51f55997796 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:39.567377 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 314/613] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:39.574187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d353d-eb7a-40ca-b4a2-d51f55997796 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.603183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:39.639908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bee23b-60a7-4b43-81c1-91eee3e62841 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:39.682986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0a02c-bf6f-416f-b4a0-fdd682c4f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:39.683727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0a02c-bf6f-416f-b4a0-fdd682c4f62b None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:39.684003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0a02c-bf6f-416f-b4a0-fdd682c4f62b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:39.684271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0a02c-bf6f-416f-b4a0-fdd682c4f62b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:39.692764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d353d-eb7a-40ca-b4a2-d51f55997796 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:39.697641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0a02c-bf6f-416f-b4a0-fdd682c4f62b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-4ee0a02c-bf6f-416f-b4a0-fdd682c4f62b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:39.703165 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:39.704154 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:39.704973 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 300/614] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:39.725884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0a02c-bf6f-416f-b4a0-fdd682c4f62b None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.744107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7225e6-b478-48d9-83c0-449bd107cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:39.744773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7225e6-b478-48d9-83c0-449bd107cc72 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:39.745048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7225e6-b478-48d9-83c0-449bd107cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:39.745326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7225e6-b478-48d9-83c0-449bd107cc72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:39.757366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7225e6-b478-48d9-83c0-449bd107cc72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:39.758869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7225e6-b478-48d9-83c0-449bd107cc72 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-1b7225e6-b478-48d9-83c0-449bd107cc72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:39.777384 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:39.779351 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:39.780491 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:39.780491 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:39.780491 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:39.780491 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 315/615] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:39.787050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7225e6-b478-48d9-83c0-449bd107cc72 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.861738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:39.865900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:39.879706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0a02c-bf6f-416f-b4a0-fdd682c4f62b None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:39.908352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7225e6-b478-48d9-83c0-449bd107cc72 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:39.930433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df155a76-ec59-4199-99d3-f94fd56c8d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:39.931050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df155a76-ec59-4199-99d3-f94fd56c8d17 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:39.931331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df155a76-ec59-4199-99d3-f94fd56c8d17 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:39.931611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df155a76-ec59-4199-99d3-f94fd56c8d17 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:39.932281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df155a76-ec59-4199-99d3-f94fd56c8d17 None admin] RBAC: Adding query filter params (name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:39.933127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df155a76-ec59-4199-99d3-f94fd56c8d17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:39.934857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df155a76-ec59-4199-99d3-f94fd56c8d17 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:39.946196 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 301/616] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:39.953936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df155a76-ec59-4199-99d3-f94fd56c8d17 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:39.954728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cebc6e-6930-4934-afe5-248763a0be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:39.955594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cebc6e-6930-4934-afe5-248763a0be51 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:39.956068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cebc6e-6930-4934-afe5-248763a0be51 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:39.956520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cebc6e-6930-4934-afe5-248763a0be51 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:39.957591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cebc6e-6930-4934-afe5-248763a0be51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:39.958996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cebc6e-6930-4934-afe5-248763a0be51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:39.960611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cebc6e-6930-4934-afe5-248763a0be51 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:39.980724 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 316/617] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:39.990125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cebc6e-6930-4934-afe5-248763a0be51 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:40.139241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cebc6e-6930-4934-afe5-248763a0be51 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:40.143851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df155a76-ec59-4199-99d3-f94fd56c8d17 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:40.184627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098f7a5-5c1d-459b-8bd0-ceeefd94ae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:40.185856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f7a5-5c1d-459b-8bd0-ceeefd94ae54 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:40.186354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f7a5-5c1d-459b-8bd0-ceeefd94ae54 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:40.186810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f7a5-5c1d-459b-8bd0-ceeefd94ae54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:40.198445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098f7a5-5c1d-459b-8bd0-ceeefd94ae54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:40.200231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098f7a5-5c1d-459b-8bd0-ceeefd94ae54 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:40.207918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3098f7a5-5c1d-459b-8bd0-ceeefd94ae54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:40.215773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:40.216803 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:40.217937 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:40.217937 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:40.217937 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:40.220012 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 302/618] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:40.225449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098f7a5-5c1d-459b-8bd0-ceeefd94ae54 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:40.228779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:40.231623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64236f2f-35fe-4c68-a508-978a8df325b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:40.231832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64236f2f-35fe-4c68-a508-978a8df325b8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:40.232076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64236f2f-35fe-4c68-a508-978a8df325b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:40.232470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64236f2f-35fe-4c68-a508-978a8df325b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:40.251002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64236f2f-35fe-4c68-a508-978a8df325b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:40.252465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64236f2f-35fe-4c68-a508-978a8df325b8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-64236f2f-35fe-4c68-a508-978a8df325b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:40.279464 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:40.280613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:40.281747 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 317/619] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:40.289253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64236f2f-35fe-4c68-a508-978a8df325b8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:40.381669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098f7a5-5c1d-459b-8bd0-ceeefd94ae54 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:40.424668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64236f2f-35fe-4c68-a508-978a8df325b8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:40.456121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0eff-10cd-486e-b5fa-e16c425961a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:40.457338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0eff-10cd-486e-b5fa-e16c425961a9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:40.458877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0eff-10cd-486e-b5fa-e16c425961a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:40.459389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90b0eff-10cd-486e-b5fa-e16c425961a9 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:40.461006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0eff-10cd-486e-b5fa-e16c425961a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:40.464215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0eff-10cd-486e-b5fa-e16c425961a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:40.465830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90b0eff-10cd-486e-b5fa-e16c425961a9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:40.489405 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 303/620] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:40.490936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bc4d6-b6cb-4969-9f07-bc8dd19cdcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:40.491783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bc4d6-b6cb-4969-9f07-bc8dd19cdcb5 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:40.492270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bc4d6-b6cb-4969-9f07-bc8dd19cdcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:40.492724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bc4d6-b6cb-4969-9f07-bc8dd19cdcb5 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:40.493745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bc4d6-b6cb-4969-9f07-bc8dd19cdcb5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:40.494258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bc4d6-b6cb-4969-9f07-bc8dd19cdcb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:40.494573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0eff-10cd-486e-b5fa-e16c425961a9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:40.496304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bc4d6-b6cb-4969-9f07-bc8dd19cdcb5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:40.516995 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 318/621] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 03:58:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:40.523517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bc4d6-b6cb-4969-9f07-bc8dd19cdcb5 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:40.577208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:40.636725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:40.662383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bc4d6-b6cb-4969-9f07-bc8dd19cdcb5 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:40.700848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8f289-cd00-4b68-a6c9-ed64ad46642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:40.702542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8f289-cd00-4b68-a6c9-ed64ad46642e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:40.703569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8f289-cd00-4b68-a6c9-ed64ad46642e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:40.704193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8f289-cd00-4b68-a6c9-ed64ad46642e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:40.715838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90b0eff-10cd-486e-b5fa-e16c425961a9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:40.717415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8f289-cd00-4b68-a6c9-ed64ad46642e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:40.719514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8f289-cd00-4b68-a6c9-ed64ad46642e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-d8d8f289-cd00-4b68-a6c9-ed64ad46642e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:40.744963 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:40.745995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:40.746895 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:40.746895 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:40.746895 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:40.746895 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 319/622] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:40.752946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8f289-cd00-4b68-a6c9-ed64ad46642e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:40.778316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210aad6-a232-4f52-a3b2-e477efa4c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:40.780662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210aad6-a232-4f52-a3b2-e477efa4c06f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:40.781846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210aad6-a232-4f52-a3b2-e477efa4c06f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:40.782241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210aad6-a232-4f52-a3b2-e477efa4c06f None admin] PATH_INFO: `/v3/users/nova` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:40.799382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210aad6-a232-4f52-a3b2-e477efa4c06f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:40.801008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210aad6-a232-4f52-a3b2-e477efa4c06f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3210aad6-a232-4f52-a3b2-e477efa4c06f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:40.822823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:40.824023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:40.825192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:40.825192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:40.825192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:40.825192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:40.825192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:40.825192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:40.825192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:40.825192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:40.825192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:40.825192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:40.835945 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 304/623] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 03:58:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:40.844022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210aad6-a232-4f52-a3b2-e477efa4c06f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:40.914270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:40.917192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8f289-cd00-4b68-a6c9-ed64ad46642e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:40.953459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234baf5-1240-42c6-8c78-599ec957d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:40.954098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234baf5-1240-42c6-8c78-599ec957d885 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:40.954369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234baf5-1240-42c6-8c78-599ec957d885 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:40.954646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234baf5-1240-42c6-8c78-599ec957d885 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:40.955272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234baf5-1240-42c6-8c78-599ec957d885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:40.955565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234baf5-1240-42c6-8c78-599ec957d885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:40.957294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234baf5-1240-42c6-8c78-599ec957d885 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:40.970073 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 320/624] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:40.974700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210aad6-a232-4f52-a3b2-e477efa4c06f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:40.975776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820922a-95dc-4fba-b2d9-e50c51df7eb7 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:40.976055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820922a-95dc-4fba-b2d9-e50c51df7eb7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:40.976762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820922a-95dc-4fba-b2d9-e50c51df7eb7 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:40.979233 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 321/625] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:40.979448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820922a-95dc-4fba-b2d9-e50c51df7eb7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:41.004691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:41.018689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a2250-1a01-4ee5-afdb-0a2c1835efb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:41.019647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a2250-1a01-4ee5-afdb-0a2c1835efb7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.020106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a2250-1a01-4ee5-afdb-0a2c1835efb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.020551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a2250-1a01-4ee5-afdb-0a2c1835efb7 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.021569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a2250-1a01-4ee5-afdb-0a2c1835efb7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:41.022105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a2250-1a01-4ee5-afdb-0a2c1835efb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:41.023745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a2250-1a01-4ee5-afdb-0a2c1835efb7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:41.048122 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 305/626] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 03:58:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:41.048122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a034030-00cc-4264-bd6a-4d4def7e2fa1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.048122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a034030-00cc-4264-bd6a-4d4def7e2fa1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.048122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a034030-00cc-4264-bd6a-4d4def7e2fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.065726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7a034030-00cc-4264-bd6a-4d4def7e2fa1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:41.067096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7a034030-00cc-4264-bd6a-4d4def7e2fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:41.107446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820922a-95dc-4fba-b2d9-e50c51df7eb7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:41.142188 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 306/627] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:41.143732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a034030-00cc-4264-bd6a-4d4def7e2fa1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:41.151577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f77707-f428-44e7-9c8d-8f72328e1968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:41.152296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f77707-f428-44e7-9c8d-8f72328e1968 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.152675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f77707-f428-44e7-9c8d-8f72328e1968 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.153087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f77707-f428-44e7-9c8d-8f72328e1968 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.161169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f77707-f428-44e7-9c8d-8f72328e1968 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:41.162772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f77707-f428-44e7-9c8d-8f72328e1968 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-70f77707-f428-44e7-9c8d-8f72328e1968 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:41.175267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:41.176198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:41.177208 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:41.177208 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:41.177208 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:41.177208 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:41.177208 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:41.177208 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:41.177208 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:41.177208 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:41.177208 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 322/628] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:41.182143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f77707-f428-44e7-9c8d-8f72328e1968 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:41.204040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:41.265240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a034030-00cc-4264-bd6a-4d4def7e2fa1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:41.279051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:41.304094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f77707-f428-44e7-9c8d-8f72328e1968 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:41.305005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3b37-fa94-4cd8-8e68-813041184662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:41.305628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3b37-fa94-4cd8-8e68-813041184662 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.305929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3b37-fa94-4cd8-8e68-813041184662 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.306205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3b37-fa94-4cd8-8e68-813041184662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.344143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210e11-4a8a-4f5b-b250-aacc542d7191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:41.344758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210e11-4a8a-4f5b-b250-aacc542d7191 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.345032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210e11-4a8a-4f5b-b250-aacc542d7191 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.345300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210e11-4a8a-4f5b-b250-aacc542d7191 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.346047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e210e11-4a8a-4f5b-b250-aacc542d7191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:41.346351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e210e11-4a8a-4f5b-b250-aacc542d7191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:41.347861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e210e11-4a8a-4f5b-b250-aacc542d7191 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:41.361528 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 323/629] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:41.367419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210e11-4a8a-4f5b-b250-aacc542d7191 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:41.385675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba3b37-fa94-4cd8-8e68-813041184662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:41.387920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba3b37-fa94-4cd8-8e68-813041184662 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:41.503275 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 307/630] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:41.511655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:41.513684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3b37-fa94-4cd8-8e68-813041184662 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:41.530748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:41.551497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e210e11-4a8a-4f5b-b250-aacc542d7191 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:41.588039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593183e6-3374-4d08-8ddf-2ddf2fc4b094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:41.588718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593183e6-3374-4d08-8ddf-2ddf2fc4b094 None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.588995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593183e6-3374-4d08-8ddf-2ddf2fc4b094 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.589565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593183e6-3374-4d08-8ddf-2ddf2fc4b094 None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d9592051e6894c86a699ca2074a32079/roles/a212b3b588c542cca718d55760a48f1f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.605620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593183e6-3374-4d08-8ddf-2ddf2fc4b094 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=d9592051e6894c86a699ca2074a32079, role_id=a212b3b588c542cca718d55760a48f1f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:41.607335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593183e6-3374-4d08-8ddf-2ddf2fc4b094 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:41.624752 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 324/631] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:58:41 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d9592051e6894c86a699ca2074a32079/roles/a212b3b588c542cca718d55760a48f1f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:58:41.626101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593183e6-3374-4d08-8ddf-2ddf2fc4b094 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:41.632605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3b37-fa94-4cd8-8e68-813041184662 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:41.709354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0abd17-e6d6-4356-960e-5b300bacf8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:41.710518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0abd17-e6d6-4356-960e-5b300bacf8f3 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.711000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0abd17-e6d6-4356-960e-5b300bacf8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.711488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0abd17-e6d6-4356-960e-5b300bacf8f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.735512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0abd17-e6d6-4356-960e-5b300bacf8f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:41.738168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0abd17-e6d6-4356-960e-5b300bacf8f3 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-4a0abd17-e6d6-4356-960e-5b300bacf8f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:41.755980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:41.757064 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:41.758008 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:41.758008 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:41.758008 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:41.758179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593183e6-3374-4d08-8ddf-2ddf2fc4b094 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:41.760818 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 308/632] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:41.762437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706071c4-c366-46de-a2bb-7b261acd3ef8 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.762997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706071c4-c366-46de-a2bb-7b261acd3ef8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.763464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706071c4-c366-46de-a2bb-7b261acd3ef8 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.769739 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 309/633] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:41.771135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706071c4-c366-46de-a2bb-7b261acd3ef8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:41.798357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:41.809159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8195c-a750-4fdc-8d2d-d451e9281d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:41.810363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8195c-a750-4fdc-8d2d-d451e9281d72 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.811566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8195c-a750-4fdc-8d2d-d451e9281d72 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.811832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8195c-a750-4fdc-8d2d-d451e9281d72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.828763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8195c-a750-4fdc-8d2d-d451e9281d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-f2b8195c-a750-4fdc-8d2d-d451e9281d72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:41.833988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:41.834959 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:41.835802 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 325/634] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:41.836496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2d7cb-8a38-494e-ac8c-3fb2d5c02dcb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.836572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2d7cb-8a38-494e-ac8c-3fb2d5c02dcb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.837406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2d7cb-8a38-494e-ac8c-3fb2d5c02dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.858264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:41.861656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ffe2d7cb-8a38-494e-ac8c-3fb2d5c02dcb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:41.862985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ffe2d7cb-8a38-494e-ac8c-3fb2d5c02dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:41.906277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706071c4-c366-46de-a2bb-7b261acd3ef8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:41.943412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d652ebd-2496-46f4-9aa7-fa866ee6f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:41.944220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d652ebd-2496-46f4-9aa7-fa866ee6f646 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:41.944554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d652ebd-2496-46f4-9aa7-fa866ee6f646 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:41.944968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d652ebd-2496-46f4-9aa7-fa866ee6f646 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:41.945682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d652ebd-2496-46f4-9aa7-fa866ee6f646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:41.946084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d652ebd-2496-46f4-9aa7-fa866ee6f646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:41.947875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d652ebd-2496-46f4-9aa7-fa866ee6f646 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:41.950264 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 326/635] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:41.951451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2d7cb-8a38-494e-ac8c-3fb2d5c02dcb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:41.974088 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 310/636] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:41.981070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d652ebd-2496-46f4-9aa7-fa866ee6f646 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:42.066405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2d7cb-8a38-494e-ac8c-3fb2d5c02dcb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:42.086255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:42.087953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d652ebd-2496-46f4-9aa7-fa866ee6f646 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:42.104091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0757334a-2db3-44f3-9a41-68ff064ef5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:42.104772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757334a-2db3-44f3-9a41-68ff064ef5eb None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.105119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757334a-2db3-44f3-9a41-68ff064ef5eb None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.105454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0757334a-2db3-44f3-9a41-68ff064ef5eb None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.106216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757334a-2db3-44f3-9a41-68ff064ef5eb None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:42.106653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757334a-2db3-44f3-9a41-68ff064ef5eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:42.108061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0757334a-2db3-44f3-9a41-68ff064ef5eb None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:42.116714 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 327/637] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:42.117520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:42.123003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accc0c2-e597-4f04-b5ba-7d08d0625d18 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.123307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accc0c2-e597-4f04-b5ba-7d08d0625d18 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.123619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4accc0c2-e597-4f04-b5ba-7d08d0625d18 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.125331 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 328/638] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:42.126488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accc0c2-e597-4f04-b5ba-7d08d0625d18 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:42.132170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f0521-1c3f-466d-b079-cf4b36d4255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:42.133066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0521-1c3f-466d-b079-cf4b36d4255d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.133553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0521-1c3f-466d-b079-cf4b36d4255d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.134043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f0521-1c3f-466d-b079-cf4b36d4255d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.141797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f0521-1c3f-466d-b079-cf4b36d4255d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:42.143550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f0521-1c3f-466d-b079-cf4b36d4255d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-da8f0521-1c3f-466d-b079-cf4b36d4255d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:42.157014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:42.158212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:42.159142 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:42.159142 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:42.159142 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:42.159142 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:42.159142 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:42.159142 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:42.159142 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:42.159142 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:42.161438 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 311/639] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:42.162822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e3147-2dfa-4cfd-ba1d-49056624932b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.163286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e3147-2dfa-4cfd-ba1d-49056624932b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.163735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e3147-2dfa-4cfd-ba1d-49056624932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.187370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-915e3147-2dfa-4cfd-ba1d-49056624932b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:42.189425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-915e3147-2dfa-4cfd-ba1d-49056624932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:42.246415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4accc0c2-e597-4f04-b5ba-7d08d0625d18 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:42.277863 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 312/640] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:42.279090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e3147-2dfa-4cfd-ba1d-49056624932b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:42.287746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a748-da73-437d-a160-b1a37e8f8797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:42.288589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a748-da73-437d-a160-b1a37e8f8797 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.289029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a748-da73-437d-a160-b1a37e8f8797 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.289453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e29a748-da73-437d-a160-b1a37e8f8797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.302849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29a748-da73-437d-a160-b1a37e8f8797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:42.305619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e29a748-da73-437d-a160-b1a37e8f8797 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-6e29a748-da73-437d-a160-b1a37e8f8797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:42.322089 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:42.323072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:42.323967 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:42.323967 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:42.323967 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:42.323967 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 329/641] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:42.324718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a748-da73-437d-a160-b1a37e8f8797 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:42.360001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:42.412419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e3147-2dfa-4cfd-ba1d-49056624932b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:42.429852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:42.435617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e29a748-da73-437d-a160-b1a37e8f8797 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:42.456385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d6552-a819-4041-8824-52bceb8aae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:42.457132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6552-a819-4041-8824-52bceb8aae38 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.457500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6552-a819-4041-8824-52bceb8aae38 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.457907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d6552-a819-4041-8824-52bceb8aae38 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.459200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d6552-a819-4041-8824-52bceb8aae38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:42.459604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d6552-a819-4041-8824-52bceb8aae38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:42.461411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d6552-a819-4041-8824-52bceb8aae38 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:42.480600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721d0fa-3383-4601-9cf0-8e6d48576416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:42.480600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721d0fa-3383-4601-9cf0-8e6d48576416 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.480600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721d0fa-3383-4601-9cf0-8e6d48576416 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.480600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721d0fa-3383-4601-9cf0-8e6d48576416 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.481454 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 313/642] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:42.482657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d6552-a819-4041-8824-52bceb8aae38 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:42.491343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c721d0fa-3383-4601-9cf0-8e6d48576416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-c721d0fa-3383-4601-9cf0-8e6d48576416 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:42.497638 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:42.499167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:42.500250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:42.505984 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 330/643] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:42.507014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721d0fa-3383-4601-9cf0-8e6d48576416 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:42.602863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d6552-a819-4041-8824-52bceb8aae38 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:42.604713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:42.615624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721d0fa-3383-4601-9cf0-8e6d48576416 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:42.639448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bff9c4-20a1-4404-bc40-167e35f49259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:42.640272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bff9c4-20a1-4404-bc40-167e35f49259 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.640552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bff9c4-20a1-4404-bc40-167e35f49259 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.641108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bff9c4-20a1-4404-bc40-167e35f49259 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.641771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bff9c4-20a1-4404-bc40-167e35f49259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:42.642098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bff9c4-20a1-4404-bc40-167e35f49259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:42.643486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bff9c4-20a1-4404-bc40-167e35f49259 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:42.652999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc1a5-ccf7-4e6a-9321-b4bc522cdabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:42.653762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc1a5-ccf7-4e6a-9321-b4bc522cdabc None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.654073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc1a5-ccf7-4e6a-9321-b4bc522cdabc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.654374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8bc1a5-ccf7-4e6a-9321-b4bc522cdabc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.655087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bc1a5-ccf7-4e6a-9321-b4bc522cdabc None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d3a99d39337841849b3e2efe48ebe53c) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:42.655388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bc1a5-ccf7-4e6a-9321-b4bc522cdabc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:42.656358 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 314/644] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:42.656836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8bc1a5-ccf7-4e6a-9321-b4bc522cdabc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:42.657497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bff9c4-20a1-4404-bc40-167e35f49259 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:42.663375 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 331/645] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:42 2022] GET /identity/v3/role_assignments?user.id=d3a99d39337841849b3e2efe48ebe53c&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:42.664244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc1a5-ccf7-4e6a-9321-b4bc522cdabc None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:42.713412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:42.781417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8bc1a5-ccf7-4e6a-9321-b4bc522cdabc None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:42.828170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bff9c4-20a1-4404-bc40-167e35f49259 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:42.831940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1088a01-03c0-4a39-a6be-ede7052f8dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:42.832603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1088a01-03c0-4a39-a6be-ede7052f8dd6 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.832876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1088a01-03c0-4a39-a6be-ede7052f8dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.833144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1088a01-03c0-4a39-a6be-ede7052f8dd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.847276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1088a01-03c0-4a39-a6be-ede7052f8dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-b1088a01-03c0-4a39-a6be-ede7052f8dd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:42.854117 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:42.855114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:42.856344 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 332/646] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:42.857358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1088a01-03c0-4a39-a6be-ede7052f8dd6 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:42.876687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a605a5-b194-4628-9609-ba788ae37be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:42.877510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a605a5-b194-4628-9609-ba788ae37be1 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:42.878013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a605a5-b194-4628-9609-ba788ae37be1 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:42.878284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a605a5-b194-4628-9609-ba788ae37be1 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:42.879231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:42.879581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a605a5-b194-4628-9609-ba788ae37be1 None admin] RBAC: Adding query filter params (name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:42.880636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a605a5-b194-4628-9609-ba788ae37be1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:42.882199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a605a5-b194-4628-9609-ba788ae37be1 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:42.894411 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 315/647] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:42.895534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a605a5-b194-4628-9609-ba788ae37be1 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:42.981164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1088a01-03c0-4a39-a6be-ede7052f8dd6 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:43.017046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d50fe4-c903-4588-b32d-42c82d774a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:43.018102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d50fe4-c903-4588-b32d-42c82d774a92 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.018586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d50fe4-c903-4588-b32d-42c82d774a92 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.019045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d50fe4-c903-4588-b32d-42c82d774a92 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.020038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:43.028485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d50fe4-c903-4588-b32d-42c82d774a92 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:43.028665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a605a5-b194-4628-9609-ba788ae37be1 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:43.030679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d50fe4-c903-4588-b32d-42c82d774a92 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-78d50fe4-c903-4588-b32d-42c82d774a92 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:43.043150 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:43.044143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:43.045135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:43.045135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:43.045135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:43.045135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:43.045135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:43.045135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:43.045135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:43.045135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:43.045135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 03:58:43.045135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:43.047943 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 333/648] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:43.049065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d50fe4-c903-4588-b32d-42c82d774a92 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:43.067933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab67a2-e88b-42b2-83ba-1954b2784afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:43.068831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab67a2-e88b-42b2-83ba-1954b2784afa None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.069234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab67a2-e88b-42b2-83ba-1954b2784afa None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.069522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab67a2-e88b-42b2-83ba-1954b2784afa None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.070227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab67a2-e88b-42b2-83ba-1954b2784afa None admin] RBAC: Adding query filter params (name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:43.070528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab67a2-e88b-42b2-83ba-1954b2784afa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:43.072372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab67a2-e88b-42b2-83ba-1954b2784afa None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:43.087375 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 316/649] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:43.087375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab67a2-e88b-42b2-83ba-1954b2784afa None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:43.146390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:43.178635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d50fe4-c903-4588-b32d-42c82d774a92 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:43.197355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab67a2-e88b-42b2-83ba-1954b2784afa None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:43.225345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7915e-8d6c-43a2-ae9f-ca206cb84ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:43.226411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7915e-8d6c-43a2-ae9f-ca206cb84ccf None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.227266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7915e-8d6c-43a2-ae9f-ca206cb84ccf None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.227892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7915e-8d6c-43a2-ae9f-ca206cb84ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.240915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd01d1b-6444-40a7-b9fe-36e4732b3e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:43.241805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd01d1b-6444-40a7-b9fe-36e4732b3e43 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.242127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd01d1b-6444-40a7-b9fe-36e4732b3e43 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.242398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd01d1b-6444-40a7-b9fe-36e4732b3e43 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.243003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7915e-8d6c-43a2-ae9f-ca206cb84ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:43.243122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd01d1b-6444-40a7-b9fe-36e4732b3e43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:43.243424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd01d1b-6444-40a7-b9fe-36e4732b3e43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:43.245152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd01d1b-6444-40a7-b9fe-36e4732b3e43 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:43.245460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7915e-8d6c-43a2-ae9f-ca206cb84ccf None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-ebe7915e-8d6c-43a2-ae9f-ca206cb84ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:43.261859 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:43.262915 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:43.263857 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:43.263857 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:43.263857 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:43.266147 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 334/650] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:43.267290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7915e-8d6c-43a2-ae9f-ca206cb84ccf None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:43.269554 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 317/651] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 03:58:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:43.274878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd01d1b-6444-40a7-b9fe-36e4732b3e43 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:43.292084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:43.389469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd01d1b-6444-40a7-b9fe-36e4732b3e43 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:43.397947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7915e-8d6c-43a2-ae9f-ca206cb84ccf None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:43.432162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:43.434814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dc1d5-8342-41b1-8879-2c538f6d7aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:43.435478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dc1d5-8342-41b1-8879-2c538f6d7aed None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.437059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dc1d5-8342-41b1-8879-2c538f6d7aed None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.437334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dc1d5-8342-41b1-8879-2c538f6d7aed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.444023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3ad61-e02b-4078-a11f-0fe6f5bd2efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:43.444660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3ad61-e02b-4078-a11f-0fe6f5bd2efd None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.444930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3ad61-e02b-4078-a11f-0fe6f5bd2efd None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.445193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3ad61-e02b-4078-a11f-0fe6f5bd2efd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.457554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3ad61-e02b-4078-a11f-0fe6f5bd2efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:43.459051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3ad61-e02b-4078-a11f-0fe6f5bd2efd None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-50d3ad61-e02b-4078-a11f-0fe6f5bd2efd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:43.474888 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:43.475868 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:43.477143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:43.477143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:43.477143 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:43.481324 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 335/652] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:43.482180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3ad61-e02b-4078-a11f-0fe6f5bd2efd None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:43.528363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dc1d5-8342-41b1-8879-2c538f6d7aed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:43.531307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dc1d5-8342-41b1-8879-2c538f6d7aed None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:43.551303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:43.603191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3ad61-e02b-4078-a11f-0fe6f5bd2efd None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:43.646700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888c10c-35e1-447b-b8cb-2d0297a7145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:43.648445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888c10c-35e1-447b-b8cb-2d0297a7145c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.648662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888c10c-35e1-447b-b8cb-2d0297a7145c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.648930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888c10c-35e1-447b-b8cb-2d0297a7145c None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.649582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888c10c-35e1-447b-b8cb-2d0297a7145c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:43.649913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888c10c-35e1-447b-b8cb-2d0297a7145c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:43.651283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888c10c-35e1-447b-b8cb-2d0297a7145c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:43.655433 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 318/653] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:43.655846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dc1d5-8342-41b1-8879-2c538f6d7aed None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:43.664123 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 336/654] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:43.665308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82ea2-79c3-403e-aeab-b5ab61683fba None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.665548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82ea2-79c3-403e-aeab-b5ab61683fba None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.665798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82ea2-79c3-403e-aeab-b5ab61683fba None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.667239 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 337/655] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:43.667935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82ea2-79c3-403e-aeab-b5ab61683fba None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:43.713327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:43.763322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dc1d5-8342-41b1-8879-2c538f6d7aed None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:43.775872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82ea2-79c3-403e-aeab-b5ab61683fba None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:43.778959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:43.801370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804527a4-139d-497f-a705-6ac22cf96182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:43.802013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804527a4-139d-497f-a705-6ac22cf96182 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.802289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804527a4-139d-497f-a705-6ac22cf96182 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.802557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804527a4-139d-497f-a705-6ac22cf96182 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.803206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804527a4-139d-497f-a705-6ac22cf96182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:43.803503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804527a4-139d-497f-a705-6ac22cf96182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:43.804933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804527a4-139d-497f-a705-6ac22cf96182 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:43.811369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33de6b3-cf21-4698-bdde-4ae28ab9af12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:43.812037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de6b3-cf21-4698-bdde-4ae28ab9af12 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.812308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de6b3-cf21-4698-bdde-4ae28ab9af12 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.812574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33de6b3-cf21-4698-bdde-4ae28ab9af12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.819777 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 319/656] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:43.820951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804527a4-139d-497f-a705-6ac22cf96182 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:43.826832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33de6b3-cf21-4698-bdde-4ae28ab9af12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:43.828578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33de6b3-cf21-4698-bdde-4ae28ab9af12 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-e33de6b3-cf21-4698-bdde-4ae28ab9af12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:43.844803 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:43.845855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:43.846985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:43.846985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:43.846985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:43.847164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 338/657] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:43.848400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff5aa2-e5b5-4c41-acd9-cb82c8c55615 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.848679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff5aa2-e5b5-4c41-acd9-cb82c8c55615 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.848947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff5aa2-e5b5-4c41-acd9-cb82c8c55615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:43.867675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b5ff5aa2-e5b5-4c41-acd9-cb82c8c55615 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:43.868865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b5ff5aa2-e5b5-4c41-acd9-cb82c8c55615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:43.929463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804527a4-139d-497f-a705-6ac22cf96182 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:43.943248 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 339/658] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:43.944100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff5aa2-e5b5-4c41-acd9-cb82c8c55615 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:43.970898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:43.990580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae07fa3-34f6-40b6-b42c-9d7cefd74ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:43.992019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae07fa3-34f6-40b6-b42c-9d7cefd74ff0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:43.992505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae07fa3-34f6-40b6-b42c-9d7cefd74ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:43.993356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae07fa3-34f6-40b6-b42c-9d7cefd74ff0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.004066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae07fa3-34f6-40b6-b42c-9d7cefd74ff0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:44.006302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae07fa3-34f6-40b6-b42c-9d7cefd74ff0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-7ae07fa3-34f6-40b6-b42c-9d7cefd74ff0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:44.021094 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:44.022265 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:44.023242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:44.023242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:44.023242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:44.023242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:44.023242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:44.023242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:44.023242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:44.023242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:44.023242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 03:58:44.023242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:44.027267 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 320/659] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:44.028390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae07fa3-34f6-40b6-b42c-9d7cefd74ff0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:44.063307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:44.071365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff5aa2-e5b5-4c41-acd9-cb82c8c55615 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:44.115253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c2b0-cbb7-4bd2-acb4-3dbeef8dcde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:44.115961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c2b0-cbb7-4bd2-acb4-3dbeef8dcde1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:44.116311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c2b0-cbb7-4bd2-acb4-3dbeef8dcde1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:44.116668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3c2b0-cbb7-4bd2-acb4-3dbeef8dcde1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.125063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3c2b0-cbb7-4bd2-acb4-3dbeef8dcde1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:44.126656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3c2b0-cbb7-4bd2-acb4-3dbeef8dcde1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-dce3c2b0-cbb7-4bd2-acb4-3dbeef8dcde1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:44.140705 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:44.141717 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:44.142721 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:44.142721 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:44.142721 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:44.142721 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:44.142721 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:44.142721 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:44.142721 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:44.142721 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:44.142721 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 03:58:44.142721 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:44.144104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae07fa3-34f6-40b6-b42c-9d7cefd74ff0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:44.146445 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 340/660] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:44.147679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c2b0-cbb7-4bd2-acb4-3dbeef8dcde1 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:44.190367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d184b9-aea3-413a-9162-e7c4dd7898b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:44.191827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d184b9-aea3-413a-9162-e7c4dd7898b4 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:44.192287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d184b9-aea3-413a-9162-e7c4dd7898b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:44.192729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d184b9-aea3-413a-9162-e7c4dd7898b4 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.194044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d184b9-aea3-413a-9162-e7c4dd7898b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:44.194542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d184b9-aea3-413a-9162-e7c4dd7898b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:44.196933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d184b9-aea3-413a-9162-e7c4dd7898b4 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:44.214267 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 321/661] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:44.215985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d184b9-aea3-413a-9162-e7c4dd7898b4 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:44.237769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:44.257561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3c2b0-cbb7-4bd2-acb4-3dbeef8dcde1 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:44.294122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3e7c5-3d5e-4a27-9d60-d50aa4ce41b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:44.294915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3e7c5-3d5e-4a27-9d60-d50aa4ce41b2 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:44.295434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3e7c5-3d5e-4a27-9d60-d50aa4ce41b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:44.295984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3e7c5-3d5e-4a27-9d60-d50aa4ce41b2 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.297952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3e7c5-3d5e-4a27-9d60-d50aa4ce41b2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:44.298369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3e7c5-3d5e-4a27-9d60-d50aa4ce41b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:44.300003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3e7c5-3d5e-4a27-9d60-d50aa4ce41b2 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:44.323002 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 341/662] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Aug 30 03:58:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:44.323002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3e7c5-3d5e-4a27-9d60-d50aa4ce41b2 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:44.328877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:44.336185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d184b9-aea3-413a-9162-e7c4dd7898b4 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:44.370903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef01e68-cd3e-4dec-a008-62b1440bfe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:44.371514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef01e68-cd3e-4dec-a008-62b1440bfe74 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:44.371788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef01e68-cd3e-4dec-a008-62b1440bfe74 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:44.372059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef01e68-cd3e-4dec-a008-62b1440bfe74 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.372793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef01e68-cd3e-4dec-a008-62b1440bfe74 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:44.373101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef01e68-cd3e-4dec-a008-62b1440bfe74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:44.374725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef01e68-cd3e-4dec-a008-62b1440bfe74 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:44.396147 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 322/663] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 03:58:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:44.396147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef01e68-cd3e-4dec-a008-62b1440bfe74 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:44.436378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3e7c5-3d5e-4a27-9d60-d50aa4ce41b2 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:44.473461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc6cff-3cdb-4d2d-a443-87b9b973ced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:44.474363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6cff-3cdb-4d2d-a443-87b9b973ced5 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:44.474641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6cff-3cdb-4d2d-a443-87b9b973ced5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:44.474911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc6cff-3cdb-4d2d-a443-87b9b973ced5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.484166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:44.488235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc6cff-3cdb-4d2d-a443-87b9b973ced5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:44.495051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef01e68-cd3e-4dec-a008-62b1440bfe74 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-debc6cff-3cdb-4d2d-a443-87b9b973ced5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:44.495189 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:44.496298 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 342/664] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:44.502347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc6cff-3cdb-4d2d-a443-87b9b973ced5 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:44.532794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea29dfa-0603-4aca-9ef5-1185b3284cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:44.533529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29dfa-0603-4aca-9ef5-1185b3284cee None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:44.533864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29dfa-0603-4aca-9ef5-1185b3284cee None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:44.534224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea29dfa-0603-4aca-9ef5-1185b3284cee None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.541046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea29dfa-0603-4aca-9ef5-1185b3284cee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:44.542918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea29dfa-0603-4aca-9ef5-1185b3284cee None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-bea29dfa-0603-4aca-9ef5-1185b3284cee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:44.555233 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:44.556357 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:44.557258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:44.557258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:44.557258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:44.557258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:44.557258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:44.557258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:44.557258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:44.557258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:44.562128 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 323/665] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:44.562355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea29dfa-0603-4aca-9ef5-1185b3284cee None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:44.577264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:44.614929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc6cff-3cdb-4d2d-a443-87b9b973ced5 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:44.653523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bd457-225e-4274-ac74-3e348afa3a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:44.654287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bd457-225e-4274-ac74-3e348afa3a70 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:44.654588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bd457-225e-4274-ac74-3e348afa3a70 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:44.655578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bd457-225e-4274-ac74-3e348afa3a70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.668889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea29dfa-0603-4aca-9ef5-1185b3284cee None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:44.706521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0f4fa-f743-4dc6-b4fa-56f2e6afeaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:44.707131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f4fa-f743-4dc6-b4fa-56f2e6afeaf9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:44.707405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f4fa-f743-4dc6-b4fa-56f2e6afeaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:44.707674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f4fa-f743-4dc6-b4fa-56f2e6afeaf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.734365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:44.736734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bd457-225e-4274-ac74-3e348afa3a70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:44.738171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4bd457-225e-4274-ac74-3e348afa3a70 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:44.775684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0f4fa-f743-4dc6-b4fa-56f2e6afeaf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:44.777159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd0f4fa-f743-4dc6-b4fa-56f2e6afeaf9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:44.790898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:44.833636 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 343/666] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:44.834519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bd457-225e-4274-ac74-3e348afa3a70 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:44.877585 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 324/667] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:44.878502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0f4fa-f743-4dc6-b4fa-56f2e6afeaf9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:44.937065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:44.940344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4bd457-225e-4274-ac74-3e348afa3a70 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:44.976502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0f4fa-f743-4dc6-b4fa-56f2e6afeaf9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:44.978025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5ddce-ec41-4740-8112-78f9f7d1be66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:44.978641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5ddce-ec41-4740-8112-78f9f7d1be66 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:44.978912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5ddce-ec41-4740-8112-78f9f7d1be66 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:44.979183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5ddce-ec41-4740-8112-78f9f7d1be66 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.979839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5ddce-ec41-4740-8112-78f9f7d1be66 None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:44.980129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5ddce-ec41-4740-8112-78f9f7d1be66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:44.981508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5ddce-ec41-4740-8112-78f9f7d1be66 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:44.990987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:44.992276 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 344/668] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:44.993848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f7004-d963-4789-8919-e3e8ed848cf6 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:44.994250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f7004-d963-4789-8919-e3e8ed848cf6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:44.994540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f7004-d963-4789-8919-e3e8ed848cf6 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:44.995898 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 345/669] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:45.001022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f7004-d963-4789-8919-e3e8ed848cf6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.015929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df276ede-5123-4bc5-bd20-b4c10bb6d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.016530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df276ede-5123-4bc5-bd20-b4c10bb6d60c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.016806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df276ede-5123-4bc5-bd20-b4c10bb6d60c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.017075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df276ede-5123-4bc5-bd20-b4c10bb6d60c None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.017771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df276ede-5123-4bc5-bd20-b4c10bb6d60c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:45.018112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df276ede-5123-4bc5-bd20-b4c10bb6d60c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:45.019553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df276ede-5123-4bc5-bd20-b4c10bb6d60c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:45.031405 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 325/670] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:45.032206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df276ede-5123-4bc5-bd20-b4c10bb6d60c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.105358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f7004-d963-4789-8919-e3e8ed848cf6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.130186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df276ede-5123-4bc5-bd20-b4c10bb6d60c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.140033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af8d2c-046e-4b94-8224-ae6645cb5a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.140670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af8d2c-046e-4b94-8224-ae6645cb5a71 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.140942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af8d2c-046e-4b94-8224-ae6645cb5a71 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.141208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af8d2c-046e-4b94-8224-ae6645cb5a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.151668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af8d2c-046e-4b94-8224-ae6645cb5a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:45.153110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af8d2c-046e-4b94-8224-ae6645cb5a71 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:45.165553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116208e6-a814-47d8-ab22-ded6391deed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.166207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116208e6-a814-47d8-ab22-ded6391deed1 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.166479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116208e6-a814-47d8-ab22-ded6391deed1 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.166739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116208e6-a814-47d8-ab22-ded6391deed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-06af8d2c-046e-4b94-8224-ae6645cb5a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:45.167195 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:45.168277 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:45.169188 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:45.169188 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:45.169188 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:45.169188 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 346/671] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:45.169473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af8d2c-046e-4b94-8224-ae6645cb5a71 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.182103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116208e6-a814-47d8-ab22-ded6391deed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:45.183555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116208e6-a814-47d8-ab22-ded6391deed1 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:45.184980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-116208e6-a814-47d8-ab22-ded6391deed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:45.198427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:45.199569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:45.200656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:45.200656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:45.200656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:45.200656 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 326/672] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:45.201050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6672d-68a5-4deb-9e6c-735eebd3a30e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.201327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6672d-68a5-4deb-9e6c-735eebd3a30e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.201758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6672d-68a5-4deb-9e6c-735eebd3a30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.219491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d2e6672d-68a5-4deb-9e6c-735eebd3a30e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:45.220690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d2e6672d-68a5-4deb-9e6c-735eebd3a30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:45.238031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:45.271565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af8d2c-046e-4b94-8224-ae6645cb5a71 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.287282 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 327/673] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:45.287936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6672d-68a5-4deb-9e6c-735eebd3a30e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.305006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b5c30-118f-4cf1-aa62-db696b1e3147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.305639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b5c30-118f-4cf1-aa62-db696b1e3147 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.321896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b5c30-118f-4cf1-aa62-db696b1e3147 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.321896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b5c30-118f-4cf1-aa62-db696b1e3147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.321896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b5c30-118f-4cf1-aa62-db696b1e3147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:45.321896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b5c30-118f-4cf1-aa62-db696b1e3147 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-f16b5c30-118f-4cf1-aa62-db696b1e3147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:45.332341 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:45.333501 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:45.335021 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:45.335021 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:45.335021 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:45.335021 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 347/674] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:45.335021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b5c30-118f-4cf1-aa62-db696b1e3147 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.402241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:45.410059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6672d-68a5-4deb-9e6c-735eebd3a30e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.441546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b5c30-118f-4cf1-aa62-db696b1e3147 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.453327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff3e02-1cf4-437e-984a-da6fcd3b2ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.454231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3e02-1cf4-437e-984a-da6fcd3b2ecc None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.454507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3e02-1cf4-437e-984a-da6fcd3b2ecc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.454771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff3e02-1cf4-437e-984a-da6fcd3b2ecc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.455494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff3e02-1cf4-437e-984a-da6fcd3b2ecc None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=0d31eed8c74549f8b8c6bb5aaa6bee98) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:45.455932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff3e02-1cf4-437e-984a-da6fcd3b2ecc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:45.457947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff3e02-1cf4-437e-984a-da6fcd3b2ecc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:45.469919 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 328/675] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:45 2022] GET /identity/v3/role_assignments?user.id=0d31eed8c74549f8b8c6bb5aaa6bee98&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:45.469919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff3e02-1cf4-437e-984a-da6fcd3b2ecc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.477883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119bcb8-859c-481e-8301-17af15e0f961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.478529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119bcb8-859c-481e-8301-17af15e0f961 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.478803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119bcb8-859c-481e-8301-17af15e0f961 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.479073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119bcb8-859c-481e-8301-17af15e0f961 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.479737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119bcb8-859c-481e-8301-17af15e0f961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:45.480035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119bcb8-859c-481e-8301-17af15e0f961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:45.481457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119bcb8-859c-481e-8301-17af15e0f961 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:45.495780 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 348/676] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:45.501338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119bcb8-859c-481e-8301-17af15e0f961 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.522377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:45.610456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff3e02-1cf4-437e-984a-da6fcd3b2ecc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.619409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119bcb8-859c-481e-8301-17af15e0f961 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.650519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:45.660130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebd639-a4fa-47f4-a20a-7192d0e40353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.661026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebd639-a4fa-47f4-a20a-7192d0e40353 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.661449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebd639-a4fa-47f4-a20a-7192d0e40353 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.661716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ebd639-a4fa-47f4-a20a-7192d0e40353 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.662434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebd639-a4fa-47f4-a20a-7192d0e40353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:45.662693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e033f6-cf1d-43eb-a7e0-689f388177b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.662828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebd639-a4fa-47f4-a20a-7192d0e40353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:45.663318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e033f6-cf1d-43eb-a7e0-689f388177b0 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.663590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e033f6-cf1d-43eb-a7e0-689f388177b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.663849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e033f6-cf1d-43eb-a7e0-689f388177b0 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.664496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e033f6-cf1d-43eb-a7e0-689f388177b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:45.664795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e033f6-cf1d-43eb-a7e0-689f388177b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:45.664899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ebd639-a4fa-47f4-a20a-7192d0e40353 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:45.666182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e033f6-cf1d-43eb-a7e0-689f388177b0 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:45.677468 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 329/677] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:45.678383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebd639-a4fa-47f4-a20a-7192d0e40353 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.683107 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 349/678] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:45.683797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e033f6-cf1d-43eb-a7e0-689f388177b0 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.764821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:45.787260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ebd639-a4fa-47f4-a20a-7192d0e40353 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.796931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e033f6-cf1d-43eb-a7e0-689f388177b0 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.821726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8114f-c9fe-492c-bbc7-f0080bea7c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.822679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8114f-c9fe-492c-bbc7-f0080bea7c0d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.822921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8114f-c9fe-492c-bbc7-f0080bea7c0d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.823213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8114f-c9fe-492c-bbc7-f0080bea7c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.831523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8114f-c9fe-492c-bbc7-f0080bea7c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:45.832969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8114f-c9fe-492c-bbc7-f0080bea7c0d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:45.833822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b882cba-b5c1-464b-8a77-0ca6c2bfee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.834496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b882cba-b5c1-464b-8a77-0ca6c2bfee93 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:45.834755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b882cba-b5c1-464b-8a77-0ca6c2bfee93 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:45.835022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b882cba-b5c1-464b-8a77-0ca6c2bfee93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-43f8114f-c9fe-492c-bbc7-f0080bea7c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:45.845148 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:45.846161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:45.847063 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:45.847063 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:45.847063 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:45.847063 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:45.847063 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:45.847063 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:45.847063 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:45.847063 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:45.847063 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 330/679] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:45.847559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8114f-c9fe-492c-bbc7-f0080bea7c0d None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.852096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b882cba-b5c1-464b-8a77-0ca6c2bfee93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-1b882cba-b5c1-464b-8a77-0ca6c2bfee93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:45.857476 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:45.858583 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:45.859461 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 350/680] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:45.861174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b882cba-b5c1-464b-8a77-0ca6c2bfee93 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:45.910551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:45.962089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8114f-c9fe-492c-bbc7-f0080bea7c0d None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.968672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b882cba-b5c1-464b-8a77-0ca6c2bfee93 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:45.998077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68a17c-bd89-42b1-bff1-51ca7dec7e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:45.999608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a17c-bd89-42b1-bff1-51ca7dec7e36 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.000202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a17c-bd89-42b1-bff1-51ca7dec7e36 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.000535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a17c-bd89-42b1-bff1-51ca7dec7e36 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.004790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfc939-28b9-40f8-98b3-60901f92faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:46.005420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfc939-28b9-40f8-98b3-60901f92faf5 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.005688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfc939-28b9-40f8-98b3-60901f92faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.005974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfc939-28b9-40f8-98b3-60901f92faf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.009259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68a17c-bd89-42b1-bff1-51ca7dec7e36 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.010736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68a17c-bd89-42b1-bff1-51ca7dec7e36 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.012547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfc939-28b9-40f8-98b3-60901f92faf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.012667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:46.014078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfc939-28b9-40f8-98b3-60901f92faf5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-ad68a17c-bd89-42b1-bff1-51ca7dec7e36 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:46.023979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:46.024977 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:46.031322 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 331/681] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-60cfc939-28b9-40f8-98b3-60901f92faf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:46.032406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:46.033206 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:46.034129 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:46.034129 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:46.034129 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:46.034129 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:46.034129 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:46.034129 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:46.034129 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:46.034129 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:46.034556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68a17c-bd89-42b1-bff1-51ca7dec7e36 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.034658 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 351/682] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:46.034658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfc939-28b9-40f8-98b3-60901f92faf5 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.133352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfc939-28b9-40f8-98b3-60901f92faf5 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:46.140434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:46.141776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68a17c-bd89-42b1-bff1-51ca7dec7e36 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:46.168049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f10714-e71c-4889-ae68-e66c3fa21b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:46.168663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f10714-e71c-4889-ae68-e66c3fa21b88 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.168928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f10714-e71c-4889-ae68-e66c3fa21b88 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.169176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f10714-e71c-4889-ae68-e66c3fa21b88 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.169841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f10714-e71c-4889-ae68-e66c3fa21b88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:46.170171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f10714-e71c-4889-ae68-e66c3fa21b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.171590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f10714-e71c-4889-ae68-e66c3fa21b88 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.177444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c673630-9ecd-4809-a0a9-2076480b1415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:46.178295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c673630-9ecd-4809-a0a9-2076480b1415 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.178748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c673630-9ecd-4809-a0a9-2076480b1415 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.179209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c673630-9ecd-4809-a0a9-2076480b1415 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.179881 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 352/683] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:46.180269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c673630-9ecd-4809-a0a9-2076480b1415 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:46.180667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f10714-e71c-4889-ae68-e66c3fa21b88 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.180913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c673630-9ecd-4809-a0a9-2076480b1415 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.182574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c673630-9ecd-4809-a0a9-2076480b1415 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.196231 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 332/684] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:46.197381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c673630-9ecd-4809-a0a9-2076480b1415 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.261331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:46.294024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f10714-e71c-4889-ae68-e66c3fa21b88 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:46.311527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c673630-9ecd-4809-a0a9-2076480b1415 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:46.328864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2524a7-f27d-427c-b18c-3e06759177aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:46.329479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2524a7-f27d-427c-b18c-3e06759177aa None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.329757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2524a7-f27d-427c-b18c-3e06759177aa None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.330059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2524a7-f27d-427c-b18c-3e06759177aa None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.330783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2524a7-f27d-427c-b18c-3e06759177aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:46.331088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2524a7-f27d-427c-b18c-3e06759177aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.332534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2524a7-f27d-427c-b18c-3e06759177aa None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.346200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb3c95-2400-41fb-a5be-a5d0c46ae5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:46.346830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb3c95-2400-41fb-a5be-a5d0c46ae5af None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.347095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb3c95-2400-41fb-a5be-a5d0c46ae5af None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.347356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb3c95-2400-41fb-a5be-a5d0c46ae5af None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.348046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb3c95-2400-41fb-a5be-a5d0c46ae5af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:46.348343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb3c95-2400-41fb-a5be-a5d0c46ae5af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.349770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb3c95-2400-41fb-a5be-a5d0c46ae5af None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.351692 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 353/685] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:46.353072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2524a7-f27d-427c-b18c-3e06759177aa None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.366551 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 333/686] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:46.367658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb3c95-2400-41fb-a5be-a5d0c46ae5af None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.390596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:46.467158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2524a7-f27d-427c-b18c-3e06759177aa None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:46.472208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb3c95-2400-41fb-a5be-a5d0c46ae5af None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:46.491002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:46.505190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701269-7d97-4cab-b27d-8beb37c5be05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:46.505828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701269-7d97-4cab-b27d-8beb37c5be05 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.506147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701269-7d97-4cab-b27d-8beb37c5be05 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.506440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701269-7d97-4cab-b27d-8beb37c5be05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.508450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcf432-4bc0-48ee-9ca1-f2d8359ee3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:46.509278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcf432-4bc0-48ee-9ca1-f2d8359ee3d1 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.509384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcf432-4bc0-48ee-9ca1-f2d8359ee3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.509631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcf432-4bc0-48ee-9ca1-f2d8359ee3d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.510390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcf432-4bc0-48ee-9ca1-f2d8359ee3d1 None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=e7fbaf173ad846c6a5cb818ea09c9197) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:46.510692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcf432-4bc0-48ee-9ca1-f2d8359ee3d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.512119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcf432-4bc0-48ee-9ca1-f2d8359ee3d1 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.517745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f701269-7d97-4cab-b27d-8beb37c5be05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.518693 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 334/687] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/role_assignments?user.id=e7fbaf173ad846c6a5cb818ea09c9197&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:46.519325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcf432-4bc0-48ee-9ca1-f2d8359ee3d1 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.527029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f701269-7d97-4cab-b27d-8beb37c5be05 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-1f701269-7d97-4cab-b27d-8beb37c5be05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:46.551000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:46.552219 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:46.553321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:46.553321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:46.553321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:46.560537 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 354/688] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:46.560537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701269-7d97-4cab-b27d-8beb37c5be05 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.659398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:46.676108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcf432-4bc0-48ee-9ca1-f2d8359ee3d1 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:46.687050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701269-7d97-4cab-b27d-8beb37c5be05 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:46.723683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe29b1-0f82-4f97-963c-dabec9a74f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:46.724294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe29b1-0f82-4f97-963c-dabec9a74f26 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.724572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe29b1-0f82-4f97-963c-dabec9a74f26 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.724833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe29b1-0f82-4f97-963c-dabec9a74f26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.730060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276866c8-d6dd-4ec7-bee5-29ab119021cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:46.730805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276866c8-d6dd-4ec7-bee5-29ab119021cf None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.731169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276866c8-d6dd-4ec7-bee5-29ab119021cf None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.731526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276866c8-d6dd-4ec7-bee5-29ab119021cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.732344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276866c8-d6dd-4ec7-bee5-29ab119021cf None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=38a84e3c6a2d4c0ab3a00851e555330a) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:46.732759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276866c8-d6dd-4ec7-bee5-29ab119021cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.734347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276866c8-d6dd-4ec7-bee5-29ab119021cf None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.741326 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 355/689] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/role_assignments?user.id=38a84e3c6a2d4c0ab3a00851e555330a&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:46.742144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276866c8-d6dd-4ec7-bee5-29ab119021cf None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.779417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:46.800298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe29b1-0f82-4f97-963c-dabec9a74f26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.801926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe29b1-0f82-4f97-963c-dabec9a74f26 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.874287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276866c8-d6dd-4ec7-bee5-29ab119021cf None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:46.945539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256bf7f-62ae-434e-ac6b-dd66451f3bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:46.946110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256bf7f-62ae-434e-ac6b-dd66451f3bfc None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:46.946378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256bf7f-62ae-434e-ac6b-dd66451f3bfc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:46.946639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256bf7f-62ae-434e-ac6b-dd66451f3bfc None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:46.947287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256bf7f-62ae-434e-ac6b-dd66451f3bfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:46.947578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256bf7f-62ae-434e-ac6b-dd66451f3bfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:46.948940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256bf7f-62ae-434e-ac6b-dd66451f3bfc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:46.965044 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 356/690] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:46.970100 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 335/691] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:46.971255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256bf7f-62ae-434e-ac6b-dd66451f3bfc None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.972126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe29b1-0f82-4f97-963c-dabec9a74f26 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:46.975288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:47.071871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:47.081475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256bf7f-62ae-434e-ac6b-dd66451f3bfc None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:47.098440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe29b1-0f82-4f97-963c-dabec9a74f26 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:47.121555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cb1c3-2788-473b-8ab8-b73ff443286f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:47.122170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cb1c3-2788-473b-8ab8-b73ff443286f None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:47.122450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cb1c3-2788-473b-8ab8-b73ff443286f None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:47.122721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cb1c3-2788-473b-8ab8-b73ff443286f None admin] PATH_INFO: `/v3/users/nova` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:47.131702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cb1c3-2788-473b-8ab8-b73ff443286f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:47.133236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cb1c3-2788-473b-8ab8-b73ff443286f None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-fa9cb1c3-2788-473b-8ab8-b73ff443286f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:47.146019 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:47.147274 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:47.148412 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 357/692] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:47.152612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b16a06-a5be-420b-a7ce-14d76d1a44a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:47.152933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cb1c3-2788-473b-8ab8-b73ff443286f None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:47.153596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b16a06-a5be-420b-a7ce-14d76d1a44a6 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:47.154036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b16a06-a5be-420b-a7ce-14d76d1a44a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:47.154436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b16a06-a5be-420b-a7ce-14d76d1a44a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:47.168093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b16a06-a5be-420b-a7ce-14d76d1a44a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:47.170715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b16a06-a5be-420b-a7ce-14d76d1a44a6 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-c2b16a06-a5be-420b-a7ce-14d76d1a44a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:47.196122 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:47.197224 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:47.198235 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:47.198235 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:47.198235 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:47.198235 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 336/693] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:47.203264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b16a06-a5be-420b-a7ce-14d76d1a44a6 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:47.256729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:47.306182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cb1c3-2788-473b-8ab8-b73ff443286f None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:47.342179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d67dea-f76d-4b3f-b9ee-232253a12604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:47.342857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67dea-f76d-4b3f-b9ee-232253a12604 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:47.343136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67dea-f76d-4b3f-b9ee-232253a12604 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:47.343409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d67dea-f76d-4b3f-b9ee-232253a12604 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:47.344155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d67dea-f76d-4b3f-b9ee-232253a12604 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:47.344464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d67dea-f76d-4b3f-b9ee-232253a12604 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:47.346461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d67dea-f76d-4b3f-b9ee-232253a12604 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:47.370277 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 358/694] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 03:58:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:47.371864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d67dea-f76d-4b3f-b9ee-232253a12604 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:47.482717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d67dea-f76d-4b3f-b9ee-232253a12604 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:47.498280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b16a06-a5be-420b-a7ce-14d76d1a44a6 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:47.522591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:47.548528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203920b-ece3-402d-bcec-a369e8b846f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:47.549298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203920b-ece3-402d-bcec-a369e8b846f2 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:47.550239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203920b-ece3-402d-bcec-a369e8b846f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:47.550769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203920b-ece3-402d-bcec-a369e8b846f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:47.559146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fd5e4-b6b9-4b0f-9681-0c257e087dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:47.559765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fd5e4-b6b9-4b0f-9681-0c257e087dc8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:47.560036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fd5e4-b6b9-4b0f-9681-0c257e087dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:47.560302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fd5e4-b6b9-4b0f-9681-0c257e087dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:47.560955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fd5e4-b6b9-4b0f-9681-0c257e087dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:47.561414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fd5e4-b6b9-4b0f-9681-0c257e087dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:47.562951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fd5e4-b6b9-4b0f-9681-0c257e087dc8 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:47.575393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:47.577749 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 337/695] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:47.583982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4674d4c-a3ce-44ae-8bd8-10fa36a93e70 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:47.584295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4674d4c-a3ce-44ae-8bd8-10fa36a93e70 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:47.585489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4674d4c-a3ce-44ae-8bd8-10fa36a93e70 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:47.589760 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 338/696] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:47.589760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4674d4c-a3ce-44ae-8bd8-10fa36a93e70 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:47.634277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203920b-ece3-402d-bcec-a369e8b846f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:47.636189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203920b-ece3-402d-bcec-a369e8b846f2 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:47.713188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4674d4c-a3ce-44ae-8bd8-10fa36a93e70 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:47.748925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc06c3d-1284-4ab9-97f8-24a4e7644ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:47.750206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc06c3d-1284-4ab9-97f8-24a4e7644ae9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:47.750893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc06c3d-1284-4ab9-97f8-24a4e7644ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:47.751316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc06c3d-1284-4ab9-97f8-24a4e7644ae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:47.762861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc06c3d-1284-4ab9-97f8-24a4e7644ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:47.765328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc06c3d-1284-4ab9-97f8-24a4e7644ae9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:47.774031 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 359/697] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 03:58:47.775647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e620e3f-96c1-433b-a5ea-268921670e77 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:47.776076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e620e3f-96c1-433b-a5ea-268921670e77 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:47.776484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e620e3f-96c1-433b-a5ea-268921670e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-9cc06c3d-1284-4ab9-97f8-24a4e7644ae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:47.779330 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:47.780457 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:47.781536 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:47.781536 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:47.781536 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:47.781536 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:47.781536 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:47.781536 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:47.781536 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:47.781536 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:47.781536 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 339/698] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:47.782229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc06c3d-1284-4ab9-97f8-24a4e7644ae9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:47.798880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8e620e3f-96c1-433b-a5ea-268921670e77 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:47.800446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8e620e3f-96c1-433b-a5ea-268921670e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:47.816296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:47.856628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:47.882081 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 360/699] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:47.883652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e620e3f-96c1-433b-a5ea-268921670e77 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:47.909750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc06c3d-1284-4ab9-97f8-24a4e7644ae9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:47.947812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7a975-9fbb-4474-ac88-448a39da0fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:47.948441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7a975-9fbb-4474-ac88-448a39da0fdc None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:47.948713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7a975-9fbb-4474-ac88-448a39da0fdc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:47.948978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7a975-9fbb-4474-ac88-448a39da0fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:47.961942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7a975-9fbb-4474-ac88-448a39da0fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:47.963608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7a975-9fbb-4474-ac88-448a39da0fdc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-11d7a975-9fbb-4474-ac88-448a39da0fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:47.982040 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:47.983082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:47.985096 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:47.985096 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:47.985096 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:47.985096 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 340/700] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:47.989983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7a975-9fbb-4474-ac88-448a39da0fdc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:48.111071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7a975-9fbb-4474-ac88-448a39da0fdc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:48.119306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:48.149276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e199b89-f758-4b84-935d-3f58031cf194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:48.150266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e199b89-f758-4b84-935d-3f58031cf194 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.150541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e199b89-f758-4b84-935d-3f58031cf194 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.150808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e199b89-f758-4b84-935d-3f58031cf194 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.151454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e199b89-f758-4b84-935d-3f58031cf194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:48.151747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e199b89-f758-4b84-935d-3f58031cf194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:48.153185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e199b89-f758-4b84-935d-3f58031cf194 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:48.157337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e620e3f-96c1-433b-a5ea-268921670e77 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:48.167073 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 341/701] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:48.176548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e199b89-f758-4b84-935d-3f58031cf194 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:48.229867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906c57-e0b2-499c-9711-d5cf97d86db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:48.231077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906c57-e0b2-499c-9711-d5cf97d86db0 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.231690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906c57-e0b2-499c-9711-d5cf97d86db0 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.232155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906c57-e0b2-499c-9711-d5cf97d86db0 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.233222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906c57-e0b2-499c-9711-d5cf97d86db0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:48.233842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906c57-e0b2-499c-9711-d5cf97d86db0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:48.235783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906c57-e0b2-499c-9711-d5cf97d86db0 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:48.249245 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 361/702] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:48.250597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906c57-e0b2-499c-9711-d5cf97d86db0 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:48.299349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:48.321418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e199b89-f758-4b84-935d-3f58031cf194 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:48.363819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906c57-e0b2-499c-9711-d5cf97d86db0 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:48.370797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb56ce-2f27-4c3a-8aea-27d7e359ce65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:48.371459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb56ce-2f27-4c3a-8aea-27d7e359ce65 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.371731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb56ce-2f27-4c3a-8aea-27d7e359ce65 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.371994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb56ce-2f27-4c3a-8aea-27d7e359ce65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.381928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb56ce-2f27-4c3a-8aea-27d7e359ce65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:48.383714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecb56ce-2f27-4c3a-8aea-27d7e359ce65 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-0ecb56ce-2f27-4c3a-8aea-27d7e359ce65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:48.399517 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:48.400989 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:48.402637 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:48.402637 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:48.402637 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:48.402637 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:48.402637 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:48.402637 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:48.402637 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:48.402637 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:48.402637 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 342/703] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:48.402637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb56ce-2f27-4c3a-8aea-27d7e359ce65 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:48.413893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b14ff0-fc82-4283-a37c-32cbf8d8c8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:48.414601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14ff0-fc82-4283-a37c-32cbf8d8c8f1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.414883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14ff0-fc82-4283-a37c-32cbf8d8c8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.415149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14ff0-fc82-4283-a37c-32cbf8d8c8f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.431300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b14ff0-fc82-4283-a37c-32cbf8d8c8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:48.433111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b14ff0-fc82-4283-a37c-32cbf8d8c8f1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:48.433835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-a0b14ff0-fc82-4283-a37c-32cbf8d8c8f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:48.454648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:48.455761 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:48.461662 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:48.461662 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:48.461662 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:48.461662 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 362/704] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:48.461662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b14ff0-fc82-4283-a37c-32cbf8d8c8f1 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:48.530333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb56ce-2f27-4c3a-8aea-27d7e359ce65 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:48.535114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:48.577020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f3a75-82e1-4877-ba63-1736aa88b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:48.578171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f3a75-82e1-4877-ba63-1736aa88b141 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.578695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f3a75-82e1-4877-ba63-1736aa88b141 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.579172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f3a75-82e1-4877-ba63-1736aa88b141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.580129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f3a75-82e1-4877-ba63-1736aa88b141 None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d9592051e6894c86a699ca2074a32079) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:48.580634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f3a75-82e1-4877-ba63-1736aa88b141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:48.582323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f3a75-82e1-4877-ba63-1736aa88b141 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:48.588855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b14ff0-fc82-4283-a37c-32cbf8d8c8f1 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:48.589125 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 343/705] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:48 2022] GET /identity/v3/role_assignments?user.id=d9592051e6894c86a699ca2074a32079&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:48.590270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f3a75-82e1-4877-ba63-1736aa88b141 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:48.644846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4e8e1-b24f-46a3-83e4-962fe3f466a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:48.645487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4e8e1-b24f-46a3-83e4-962fe3f466a9 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.645767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4e8e1-b24f-46a3-83e4-962fe3f466a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.646144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4e8e1-b24f-46a3-83e4-962fe3f466a9 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.647163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4e8e1-b24f-46a3-83e4-962fe3f466a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:48.647475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4e8e1-b24f-46a3-83e4-962fe3f466a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:48.649836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4e8e1-b24f-46a3-83e4-962fe3f466a9 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:48.668404 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 363/706] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:48.674632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4e8e1-b24f-46a3-83e4-962fe3f466a9 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:48.705465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:48.717443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f3a75-82e1-4877-ba63-1736aa88b141 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:48.759018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e88744-524b-4e99-9aa8-56d859ad9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:48.760053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88744-524b-4e99-9aa8-56d859ad9e75 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.760529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88744-524b-4e99-9aa8-56d859ad9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.761055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e88744-524b-4e99-9aa8-56d859ad9e75 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.762006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e88744-524b-4e99-9aa8-56d859ad9e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:48.762518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e88744-524b-4e99-9aa8-56d859ad9e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:48.764131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e88744-524b-4e99-9aa8-56d859ad9e75 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:48.784019 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 344/707] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:48.786043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e88744-524b-4e99-9aa8-56d859ad9e75 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:48.872237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4e8e1-b24f-46a3-83e4-962fe3f466a9 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:48.898432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:48.900793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e88744-524b-4e99-9aa8-56d859ad9e75 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:48.912821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e01e57-f7bf-4e65-9dc0-e725f3c3bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:48.913709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e01e57-f7bf-4e65-9dc0-e725f3c3bc6d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.914185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e01e57-f7bf-4e65-9dc0-e725f3c3bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.914622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e01e57-f7bf-4e65-9dc0-e725f3c3bc6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.915538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e01e57-f7bf-4e65-9dc0-e725f3c3bc6d None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d3a99d39337841849b3e2efe48ebe53c) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:48.916029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e01e57-f7bf-4e65-9dc0-e725f3c3bc6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:48.917676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e01e57-f7bf-4e65-9dc0-e725f3c3bc6d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:48.924574 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 364/708] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:48 2022] GET /identity/v3/role_assignments?user.id=d3a99d39337841849b3e2efe48ebe53c&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:48.929929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255e903-7d45-4ddd-915b-a12768166a0c None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.929929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255e903-7d45-4ddd-915b-a12768166a0c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.929929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255e903-7d45-4ddd-915b-a12768166a0c None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.931566 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 365/709] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:48.938502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296d11-29f8-4d37-9dce-a1ba18063899 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.938883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296d11-29f8-4d37-9dce-a1ba18063899 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.939246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c296d11-29f8-4d37-9dce-a1ba18063899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.940678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f08678-9ddf-4f00-931b-ebeeaf63cd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:48.941307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f08678-9ddf-4f00-931b-ebeeaf63cd50 None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:48.941582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f08678-9ddf-4f00-931b-ebeeaf63cd50 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:48.941849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f08678-9ddf-4f00-931b-ebeeaf63cd50 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:48.942598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f08678-9ddf-4f00-931b-ebeeaf63cd50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:48.944121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f08678-9ddf-4f00-931b-ebeeaf63cd50 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:48.962410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0c296d11-29f8-4d37-9dce-a1ba18063899 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:48.963718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0c296d11-29f8-4d37-9dce-a1ba18063899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:48.974334 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 345/710] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:58:48 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 03:58:49.050055 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 366/711] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:49.107916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55665cea-1e95-4548-a9b7-38c76e0f5e51 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:49.109397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55665cea-1e95-4548-a9b7-38c76e0f5e51 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:49.109917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55665cea-1e95-4548-a9b7-38c76e0f5e51 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:49.111903 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 346/712] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:49.117946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003a49-9934-4a3c-aae5-dc436db08e2e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:49.118214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003a49-9934-4a3c-aae5-dc436db08e2e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:49.118452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55003a49-9934-4a3c-aae5-dc436db08e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:49.139827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-55003a49-9934-4a3c-aae5-dc436db08e2e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:49.141927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-55003a49-9934-4a3c-aae5-dc436db08e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:49.228952 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 367/713] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:49.338768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55665cea-1e95-4548-a9b7-38c76e0f5e51 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:49.348078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:49.465708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55665cea-1e95-4548-a9b7-38c76e0f5e51 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:49.513123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282666f9-300c-4354-89da-3e6199decfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:49.514168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282666f9-300c-4354-89da-3e6199decfd3 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:49.514815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282666f9-300c-4354-89da-3e6199decfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:49.515832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282666f9-300c-4354-89da-3e6199decfd3 None admin] PATH_INFO: `/v3/services/network` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:49.516627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282666f9-300c-4354-89da-3e6199decfd3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:49.518388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282666f9-300c-4354-89da-3e6199decfd3 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-282666f9-300c-4354-89da-3e6199decfd3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:49.534563 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:49.535704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 03:58:49.536649 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:49.539497 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 347/714] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:49 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:49.545808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55003a49-9934-4a3c-aae5-dc436db08e2e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:49.545981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282666f9-300c-4354-89da-3e6199decfd3 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:49.621276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:49.662425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282666f9-300c-4354-89da-3e6199decfd3 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:49.707544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:49.708941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3a91-035f-4034-99e3-da024e5ec11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:49.709700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3a91-035f-4034-99e3-da024e5ec11d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:49.710004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3a91-035f-4034-99e3-da024e5ec11d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:49.710274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f3a91-035f-4034-99e3-da024e5ec11d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:49.710986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f3a91-035f-4034-99e3-da024e5ec11d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:49.712574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f3a91-035f-4034-99e3-da024e5ec11d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-fc3f3a91-035f-4034-99e3-da024e5ec11d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:49.723313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:49.724359 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 03:58:49.725201 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:49.730291 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 348/715] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Aug 30 03:58:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:49.731790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3a91-035f-4034-99e3-da024e5ec11d None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:49.797788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55003a49-9934-4a3c-aae5-dc436db08e2e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:49.865245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405e9d1-bfe3-4221-86f8-d5575e2614fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:49.865885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405e9d1-bfe3-4221-86f8-d5575e2614fc None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:49.866164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405e9d1-bfe3-4221-86f8-d5575e2614fc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:49.866430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405e9d1-bfe3-4221-86f8-d5575e2614fc None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:49.867071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405e9d1-bfe3-4221-86f8-d5575e2614fc None admin] RBAC: Adding query filter params (name=network) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:49.867369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405e9d1-bfe3-4221-86f8-d5575e2614fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:49.868749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405e9d1-bfe3-4221-86f8-d5575e2614fc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:49.879882 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 368/716] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:58:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:49.887333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405e9d1-bfe3-4221-86f8-d5575e2614fc None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:49.907682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f3a91-035f-4034-99e3-da024e5ec11d None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:49.951098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6930e0f-d245-41bf-8052-0c2b17cb1bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:49.952497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6930e0f-d245-41bf-8052-0c2b17cb1bc8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:49.953211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6930e0f-d245-41bf-8052-0c2b17cb1bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:49.953966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6930e0f-d245-41bf-8052-0c2b17cb1bc8 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:49.954906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6930e0f-d245-41bf-8052-0c2b17cb1bc8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:49.955455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6930e0f-d245-41bf-8052-0c2b17cb1bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:49.957765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6930e0f-d245-41bf-8052-0c2b17cb1bc8 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:49.959924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:49.965968 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 349/717] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 03:58:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:49.972320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6930e0f-d245-41bf-8052-0c2b17cb1bc8 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:50.037058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405e9d1-bfe3-4221-86f8-d5575e2614fc None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:50.048486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:50.079017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e92391-2a81-4f4f-aa10-4eb25279de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:50.079639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92391-2a81-4f4f-aa10-4eb25279de3e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:50.079918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92391-2a81-4f4f-aa10-4eb25279de3e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:50.080189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e92391-2a81-4f4f-aa10-4eb25279de3e None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:50.080830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e92391-2a81-4f4f-aa10-4eb25279de3e None admin] RBAC: Adding query filter params (type=network) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:50.081129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e92391-2a81-4f4f-aa10-4eb25279de3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:50.083866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e92391-2a81-4f4f-aa10-4eb25279de3e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:50.089482 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 369/718] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:58:49 2022] GET /identity/v3/services?type=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:50.140928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6930e0f-d245-41bf-8052-0c2b17cb1bc8 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:50.186863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fe91e-45d9-491e-954a-8b545ab602fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:50.187907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fe91e-45d9-491e-954a-8b545ab602fe None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:50.188358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fe91e-45d9-491e-954a-8b545ab602fe None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:50.188826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fe91e-45d9-491e-954a-8b545ab602fe None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:50.189643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fe91e-45d9-491e-954a-8b545ab602fe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:50.190135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fe91e-45d9-491e-954a-8b545ab602fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:50.191741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fe91e-45d9-491e-954a-8b545ab602fe None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:50.198841 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 350/719] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 03:58:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:51.184326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb71ebd-ccc0-4d53-906a-6a98e418c600 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:51.184874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb71ebd-ccc0-4d53-906a-6a98e418c600 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:51.184874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb71ebd-ccc0-4d53-906a-6a98e418c600 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:51.186558 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 370/720] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:51.191998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172ee2e-363b-4b1e-b39b-992aaa18d27e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:51.192842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172ee2e-363b-4b1e-b39b-992aaa18d27e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:51.193379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172ee2e-363b-4b1e-b39b-992aaa18d27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:51.222977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6172ee2e-363b-4b1e-b39b-992aaa18d27e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:51.224619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6172ee2e-363b-4b1e-b39b-992aaa18d27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:51.296905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:51.307824 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 351/721] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:51.384950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271f83-f8c4-4e32-bc7b-1fa78d10bd4a None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:51.385575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271f83-f8c4-4e32-bc7b-1fa78d10bd4a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:51.386082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e271f83-f8c4-4e32-bc7b-1fa78d10bd4a None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:51.387946 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 371/722] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:51.393686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497b2c1-c598-49e8-803c-cf3c6b7a667f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:51.394009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497b2c1-c598-49e8-803c-cf3c6b7a667f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:51.394285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497b2c1-c598-49e8-803c-cf3c6b7a667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:51.414586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3497b2c1-c598-49e8-803c-cf3c6b7a667f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:51.416082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3497b2c1-c598-49e8-803c-cf3c6b7a667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:51.494461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719597b-5edd-4321-9726-dd3044eb0d52 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:51.494659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719597b-5edd-4321-9726-dd3044eb0d52 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:51.494912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719597b-5edd-4321-9726-dd3044eb0d52 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:51.496579 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 372/723] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:51.501466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246150-3c40-4bec-ac5a-f9a8fde38055 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:51.501747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246150-3c40-4bec-ac5a-f9a8fde38055 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:51.502057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97246150-3c40-4bec-ac5a-f9a8fde38055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:51.502514 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 352/724] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:51.533053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-97246150-3c40-4bec-ac5a-f9a8fde38055 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:51.534285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-97246150-3c40-4bec-ac5a-f9a8fde38055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:51.619034 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 373/725] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 03:58:51.668442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497b2c1-c598-49e8-803c-cf3c6b7a667f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:51.768578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497b2c1-c598-49e8-803c-cf3c6b7a667f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:51.791398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:51.803246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fa652-6c36-4c73-804b-7bfb9a6058e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:51.803881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fa652-6c36-4c73-804b-7bfb9a6058e2 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:51.804151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fa652-6c36-4c73-804b-7bfb9a6058e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:51.804414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fa652-6c36-4c73-804b-7bfb9a6058e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:51.815190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fa652-6c36-4c73-804b-7bfb9a6058e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6f3fa652-6c36-4c73-804b-7bfb9a6058e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:51.819945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:51.820869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:51.822134 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 353/726] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:51.827145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97246150-3c40-4bec-ac5a-f9a8fde38055 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:51.845358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fa652-6c36-4c73-804b-7bfb9a6058e2 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:51.936858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97246150-3c40-4bec-ac5a-f9a8fde38055 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:51.941270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:51.982985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a60bf0-b240-404d-84d4-31d94987972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:51.983759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a60bf0-b240-404d-84d4-31d94987972c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:51.984093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a60bf0-b240-404d-84d4-31d94987972c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:51.984651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a60bf0-b240-404d-84d4-31d94987972c None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:51.985384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a60bf0-b240-404d-84d4-31d94987972c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:51.985683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a60bf0-b240-404d-84d4-31d94987972c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:51.987843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a60bf0-b240-404d-84d4-31d94987972c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:52.000326 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 374/727] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:52.002608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a60bf0-b240-404d-84d4-31d94987972c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.007731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fa652-6c36-4c73-804b-7bfb9a6058e2 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.056632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e993a-4032-4234-986e-2fede5d071b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.057909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e993a-4032-4234-986e-2fede5d071b8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.058737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e993a-4032-4234-986e-2fede5d071b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.059202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e993a-4032-4234-986e-2fede5d071b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.073408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e993a-4032-4234-986e-2fede5d071b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-729e993a-4032-4234-986e-2fede5d071b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:52.080890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:52.081812 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:52.082696 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:52.085791 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 354/728] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:52.087362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e993a-4032-4234-986e-2fede5d071b8 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.112845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a60bf0-b240-404d-84d4-31d94987972c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.146253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:52.149193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3ed43-533f-4238-b76a-6dd6a2eb2106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.149922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ed43-533f-4238-b76a-6dd6a2eb2106 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.150251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ed43-533f-4238-b76a-6dd6a2eb2106 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.150492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ed43-533f-4238-b76a-6dd6a2eb2106 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.162750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3ed43-533f-4238-b76a-6dd6a2eb2106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-adf3ed43-533f-4238-b76a-6dd6a2eb2106 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:52.168779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:52.169685 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:52.170563 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 375/729] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:52.171354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3ed43-533f-4238-b76a-6dd6a2eb2106 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.202802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:52.225572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e993a-4032-4234-986e-2fede5d071b8 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.263436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982d74e-e39a-462d-87ba-991ca3ba2080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.264481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982d74e-e39a-462d-87ba-991ca3ba2080 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.265143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982d74e-e39a-462d-87ba-991ca3ba2080 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.265581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982d74e-e39a-462d-87ba-991ca3ba2080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.277212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982d74e-e39a-462d-87ba-991ca3ba2080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:52.279083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982d74e-e39a-462d-87ba-991ca3ba2080 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:52.283255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3ed43-533f-4238-b76a-6dd6a2eb2106 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-a982d74e-e39a-462d-87ba-991ca3ba2080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:52.295687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:52.297106 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:52.298600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:52.298600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:52.298600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:52.305019 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 355/730] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:52.306314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982d74e-e39a-462d-87ba-991ca3ba2080 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.323080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbead3-8240-4152-a13f-a7b50068085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.323617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbead3-8240-4152-a13f-a7b50068085e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.323892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbead3-8240-4152-a13f-a7b50068085e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.324166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbead3-8240-4152-a13f-a7b50068085e None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.324840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbead3-8240-4152-a13f-a7b50068085e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:52.325137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbead3-8240-4152-a13f-a7b50068085e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:52.326833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbead3-8240-4152-a13f-a7b50068085e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:52.336435 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 376/731] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:52.337377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbead3-8240-4152-a13f-a7b50068085e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.414678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:52.423410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982d74e-e39a-462d-87ba-991ca3ba2080 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.429253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:52.442655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbead3-8240-4152-a13f-a7b50068085e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.459047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87d1fe-e3de-4080-94de-de195fe1aaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.459661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87d1fe-e3de-4080-94de-de195fe1aaf0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.459936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87d1fe-e3de-4080-94de-de195fe1aaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.460424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87d1fe-e3de-4080-94de-de195fe1aaf0 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.460874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87d1fe-e3de-4080-94de-de195fe1aaf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:52.461170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87d1fe-e3de-4080-94de-de195fe1aaf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:52.462604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87d1fe-e3de-4080-94de-de195fe1aaf0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:52.472013 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 356/732] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:52.473088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87d1fe-e3de-4080-94de-de195fe1aaf0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.482223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba534efd-1210-4367-9d4e-0292ec4859ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.482887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba534efd-1210-4367-9d4e-0292ec4859ce None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.483124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba534efd-1210-4367-9d4e-0292ec4859ce None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.483388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba534efd-1210-4367-9d4e-0292ec4859ce None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.484124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba534efd-1210-4367-9d4e-0292ec4859ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:52.484418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba534efd-1210-4367-9d4e-0292ec4859ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:52.485782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba534efd-1210-4367-9d4e-0292ec4859ce None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:52.498131 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 377/733] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:52.499479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03a78-12b3-4322-aeb0-4082d34ded3a None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.499761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03a78-12b3-4322-aeb0-4082d34ded3a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.500033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03a78-12b3-4322-aeb0-4082d34ded3a None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.505545 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 378/734] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:52.505545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b03a78-12b3-4322-aeb0-4082d34ded3a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.586681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87d1fe-e3de-4080-94de-de195fe1aaf0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.610440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b03a78-12b3-4322-aeb0-4082d34ded3a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.623003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4581af7-af2a-4204-816e-bf9fc3ee206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.623893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581af7-af2a-4204-816e-bf9fc3ee206f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.624412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581af7-af2a-4204-816e-bf9fc3ee206f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.624854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581af7-af2a-4204-816e-bf9fc3ee206f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.639217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4581af7-af2a-4204-816e-bf9fc3ee206f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:52.641043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4581af7-af2a-4204-816e-bf9fc3ee206f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:52.651154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bf0a4-88ce-423a-beb8-253502fa27e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.651798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bf0a4-88ce-423a-beb8-253502fa27e9 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.652068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bf0a4-88ce-423a-beb8-253502fa27e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.652331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bf0a4-88ce-423a-beb8-253502fa27e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-e4581af7-af2a-4204-816e-bf9fc3ee206f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:52.655773 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:52.656834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:52.657736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:52.657736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:52.657736 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:52.661586 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 357/735] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:52.662508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4581af7-af2a-4204-816e-bf9fc3ee206f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.662999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bf0a4-88ce-423a-beb8-253502fa27e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:52.664460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bf0a4-88ce-423a-beb8-253502fa27e9 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:52.673094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:52.676192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-3f7bf0a4-88ce-423a-beb8-253502fa27e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:52.681960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:52.682929 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:52.683805 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:52.683805 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:52.683805 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:52.683805 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 379/736] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:52.683805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ff73-cbdc-4f4e-b71d-9c40036bfa05 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.683805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ff73-cbdc-4f4e-b71d-9c40036bfa05 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.683805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921ff73-cbdc-4f4e-b71d-9c40036bfa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.701318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f921ff73-cbdc-4f4e-b71d-9c40036bfa05 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:52.702629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f921ff73-cbdc-4f4e-b71d-9c40036bfa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:52.773914 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 380/737] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:52.774923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ff73-cbdc-4f4e-b71d-9c40036bfa05 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.788631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4581af7-af2a-4204-816e-bf9fc3ee206f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.823320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb3c4-ed18-4590-b2b2-b838acbf79af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.823958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb3c4-ed18-4590-b2b2-b838acbf79af None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.824234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb3c4-ed18-4590-b2b2-b838acbf79af None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.824511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb3c4-ed18-4590-b2b2-b838acbf79af None admin] PATH_INFO: `/v3/users/swift` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.832116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdb3c4-ed18-4590-b2b2-b838acbf79af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:52.833578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fdb3c4-ed18-4590-b2b2-b838acbf79af None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-c3fdb3c4-ed18-4590-b2b2-b838acbf79af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:52.844858 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:52.846067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 358/738] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:52.847170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb3c4-ed18-4590-b2b2-b838acbf79af None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.897627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921ff73-cbdc-4f4e-b71d-9c40036bfa05 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.918337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:52.929662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:52.936690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e7527-af83-47e2-aa6b-c6a073da23b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.937385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e7527-af83-47e2-aa6b-c6a073da23b7 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.937667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e7527-af83-47e2-aa6b-c6a073da23b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.937967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e7527-af83-47e2-aa6b-c6a073da23b7 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.938624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e7527-af83-47e2-aa6b-c6a073da23b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:52.938923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e7527-af83-47e2-aa6b-c6a073da23b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:52.940303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e7527-af83-47e2-aa6b-c6a073da23b7 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:52.952235 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 381/739] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:52.954062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62cb0-4e78-481d-8007-48d6c505f117 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.954485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62cb0-4e78-481d-8007-48d6c505f117 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.954761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f62cb0-4e78-481d-8007-48d6c505f117 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.955373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb3c4-ed18-4590-b2b2-b838acbf79af None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:52.957996 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 382/740] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:52.959702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f62cb0-4e78-481d-8007-48d6c505f117 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:52.993309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7f76f-35f9-4638-883a-a69854b7a74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:52.994033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f76f-35f9-4638-883a-a69854b7a74c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:52.994231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f76f-35f9-4638-883a-a69854b7a74c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:52.994504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f76f-35f9-4638-883a-a69854b7a74c None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:52.995155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7f76f-35f9-4638-883a-a69854b7a74c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:52.995455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7f76f-35f9-4638-883a-a69854b7a74c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:52.996860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7f76f-35f9-4638-883a-a69854b7a74c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:53.014306 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 359/741] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:53.014306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7f76f-35f9-4638-883a-a69854b7a74c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:53.069779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f62cb0-4e78-481d-8007-48d6c505f117 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:53.103248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af7a2d-38d8-4f59-bdee-c69a5bf0442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:53.103792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7a2d-38d8-4f59-bdee-c69a5bf0442f None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:53.104054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7a2d-38d8-4f59-bdee-c69a5bf0442f None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:53.104329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7a2d-38d8-4f59-bdee-c69a5bf0442f None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:53.105060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af7a2d-38d8-4f59-bdee-c69a5bf0442f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:53.105364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af7a2d-38d8-4f59-bdee-c69a5bf0442f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:53.106856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af7a2d-38d8-4f59-bdee-c69a5bf0442f None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:53.112916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7f76f-35f9-4638-883a-a69854b7a74c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:53.123834 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 383/742] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 03:58:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:53.125050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2791-af05-4a6f-bacf-ef5e4935a7f7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:53.125331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2791-af05-4a6f-bacf-ef5e4935a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:53.125602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2791-af05-4a6f-bacf-ef5e4935a7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:53.139261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:53.142948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4c7a2791-af05-4a6f-bacf-ef5e4935a7f7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:53.144243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4c7a2791-af05-4a6f-bacf-ef5e4935a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:53.147554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2474df9-1d23-4ac2-964a-b5f03062deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:53.148184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2474df9-1d23-4ac2-964a-b5f03062deb5 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:53.148458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2474df9-1d23-4ac2-964a-b5f03062deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:53.148726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2474df9-1d23-4ac2-964a-b5f03062deb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:53.155796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2474df9-1d23-4ac2-964a-b5f03062deb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:53.157254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2474df9-1d23-4ac2-964a-b5f03062deb5 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-d2474df9-1d23-4ac2-964a-b5f03062deb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:53.169380 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:53.170491 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 360/743] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 03:58:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:53.171677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2474df9-1d23-4ac2-964a-b5f03062deb5 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:53.190833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:53.214177 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 384/744] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 03:58:53.214984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a2791-af05-4a6f-bacf-ef5e4935a7f7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:53.275322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2474df9-1d23-4ac2-964a-b5f03062deb5 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:53.314395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af05bb-686e-423e-a608-4fd221a96b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:53.315027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af05bb-686e-423e-a608-4fd221a96b06 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:53.315305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af05bb-686e-423e-a608-4fd221a96b06 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:53.315574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af05bb-686e-423e-a608-4fd221a96b06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:53.323357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a2791-af05-4a6f-bacf-ef5e4935a7f7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:53.323505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af05bb-686e-423e-a608-4fd221a96b06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:53.324837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af05bb-686e-423e-a608-4fd221a96b06 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-e4af05bb-686e-423e-a608-4fd221a96b06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:53.336379 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:53.337361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 361/745] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 03:58:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:53.338496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af05bb-686e-423e-a608-4fd221a96b06 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:53.367236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524e2af-35ed-4448-8963-c413a27ac1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:53.367786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e2af-35ed-4448-8963-c413a27ac1fd None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:53.368058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e2af-35ed-4448-8963-c413a27ac1fd None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:53.368309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524e2af-35ed-4448-8963-c413a27ac1fd None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:53.368960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524e2af-35ed-4448-8963-c413a27ac1fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:53.370372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524e2af-35ed-4448-8963-c413a27ac1fd None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:53.392582 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 385/746] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:58:53 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:58:53.393564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524e2af-35ed-4448-8963-c413a27ac1fd None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:53.426294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:53.441451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:53.473351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af05bb-686e-423e-a608-4fd221a96b06 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:53.517631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91212a6-aef6-4346-b180-e87d21bc6be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:53.518285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91212a6-aef6-4346-b180-e87d21bc6be7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:53.518560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91212a6-aef6-4346-b180-e87d21bc6be7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:53.518826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91212a6-aef6-4346-b180-e87d21bc6be7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:53.526541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524e2af-35ed-4448-8963-c413a27ac1fd None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:53.565709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46231-7ae6-40c0-826a-0ceb39e0e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:53.566358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46231-7ae6-40c0-826a-0ceb39e0e187 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:53.566638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46231-7ae6-40c0-826a-0ceb39e0e187 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:53.566898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf46231-7ae6-40c0-826a-0ceb39e0e187 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:53.567623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf46231-7ae6-40c0-826a-0ceb39e0e187 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:53.567922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf46231-7ae6-40c0-826a-0ceb39e0e187 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:53.569372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf46231-7ae6-40c0-826a-0ceb39e0e187 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:53.589312 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 386/747] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 03:58:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:53.590320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46231-7ae6-40c0-826a-0ceb39e0e187 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:53.600973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91212a6-aef6-4346-b180-e87d21bc6be7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:53.602865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91212a6-aef6-4346-b180-e87d21bc6be7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:53.651630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:53.698328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:53.709174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf46231-7ae6-40c0-826a-0ceb39e0e187 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:53.721957 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 362/748] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:53 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 03:58:53.721957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91212a6-aef6-4346-b180-e87d21bc6be7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:53.753677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6a11-133a-4dd6-8f75-4f1dfab5b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:53.754294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6a11-133a-4dd6-8f75-4f1dfab5b868 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:53.754574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6a11-133a-4dd6-8f75-4f1dfab5b868 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:53.754843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca6a11-133a-4dd6-8f75-4f1dfab5b868 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:53.755565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca6a11-133a-4dd6-8f75-4f1dfab5b868 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:53.755867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca6a11-133a-4dd6-8f75-4f1dfab5b868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:53.757311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca6a11-133a-4dd6-8f75-4f1dfab5b868 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:53.781298 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 387/749] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 03:58:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:53.781298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6a11-133a-4dd6-8f75-4f1dfab5b868 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:53.830098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91212a6-aef6-4346-b180-e87d21bc6be7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:53.864392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85847b74-00f1-4bec-9376-b7ceb1594bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:53.864610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85847b74-00f1-4bec-9376-b7ceb1594bdc None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:53.864974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85847b74-00f1-4bec-9376-b7ceb1594bdc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:53.865249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85847b74-00f1-4bec-9376-b7ceb1594bdc None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:53.865985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85847b74-00f1-4bec-9376-b7ceb1594bdc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:53.867411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85847b74-00f1-4bec-9376-b7ceb1594bdc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:53.883957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca6a11-133a-4dd6-8f75-4f1dfab5b868 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:53.888866 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 363/750] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:58:53 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:58:53.899614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85847b74-00f1-4bec-9376-b7ceb1594bdc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:53.905418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:53.933171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602995c-4c32-4361-a47a-34b581df2edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:53.934714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602995c-4c32-4361-a47a-34b581df2edf None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:53.935138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602995c-4c32-4361-a47a-34b581df2edf None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:53.935562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602995c-4c32-4361-a47a-34b581df2edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:53.951246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602995c-4c32-4361-a47a-34b581df2edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:53.954018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602995c-4c32-4361-a47a-34b581df2edf None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:53.964749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-0602995c-4c32-4361-a47a-34b581df2edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:53.977024 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:53.978621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:53.979702 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:53.979702 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:53.979702 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:53.986884 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 388/751] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:53.988124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602995c-4c32-4361-a47a-34b581df2edf None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:54.044869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85847b74-00f1-4bec-9376-b7ceb1594bdc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:54.091431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5e7e0-e25d-4de8-8c4f-50637cf04f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:54.092108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5e7e0-e25d-4de8-8c4f-50637cf04f60 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:54.092392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5e7e0-e25d-4de8-8c4f-50637cf04f60 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:54.092664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd5e7e0-e25d-4de8-8c4f-50637cf04f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:54.105017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5e7e0-e25d-4de8-8c4f-50637cf04f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:54.106553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd5e7e0-e25d-4de8-8c4f-50637cf04f60 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:54.107360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602995c-4c32-4361-a47a-34b581df2edf None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-bbd5e7e0-e25d-4de8-8c4f-50637cf04f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:54.122101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:54.123273 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:54.124470 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:54.124470 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:54.124470 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:54.128063 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 364/752] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:54.128930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5e7e0-e25d-4de8-8c4f-50637cf04f60 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:54.151421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719444e-07b3-4019-aea7-3c124af40a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:54.152327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719444e-07b3-4019-aea7-3c124af40a4d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:54.153239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719444e-07b3-4019-aea7-3c124af40a4d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:54.153656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719444e-07b3-4019-aea7-3c124af40a4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:54.196567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:54.243806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:54.248042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719444e-07b3-4019-aea7-3c124af40a4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:54.249718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719444e-07b3-4019-aea7-3c124af40a4d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:54.257508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd5e7e0-e25d-4de8-8c4f-50637cf04f60 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:54.294803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7245-f875-4a7d-9a23-0a58de36f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:54.295500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7245-f875-4a7d-9a23-0a58de36f882 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:54.295500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7245-f875-4a7d-9a23-0a58de36f882 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:54.295675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7245-f875-4a7d-9a23-0a58de36f882 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:54.296395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a7245-f875-4a7d-9a23-0a58de36f882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:54.296820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a7245-f875-4a7d-9a23-0a58de36f882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:54.298442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a7245-f875-4a7d-9a23-0a58de36f882 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:54.316067 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 365/753] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:54.316067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7245-f875-4a7d-9a23-0a58de36f882 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:54.392471 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 389/754] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:58:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 03:58:54.393591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719444e-07b3-4019-aea7-3c124af40a4d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:54.428774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7245-f875-4a7d-9a23-0a58de36f882 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:54.451538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:54.475361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14801831-b3d9-4b39-af56-67d609df1e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:54.475991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14801831-b3d9-4b39-af56-67d609df1e75 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:54.476497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14801831-b3d9-4b39-af56-67d609df1e75 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:54.476765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14801831-b3d9-4b39-af56-67d609df1e75 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:54.477408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14801831-b3d9-4b39-af56-67d609df1e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:54.478091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14801831-b3d9-4b39-af56-67d609df1e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:54.480445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14801831-b3d9-4b39-af56-67d609df1e75 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:54.495145 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 366/755] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:54.496397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14801831-b3d9-4b39-af56-67d609df1e75 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:54.516630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:54.522926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719444e-07b3-4019-aea7-3c124af40a4d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:54.567371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ae78-ce1c-43cf-b467-cd085251a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:54.568504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ae78-ce1c-43cf-b467-cd085251a149 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:54.569245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ae78-ce1c-43cf-b467-cd085251a149 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:54.570096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ae78-ce1c-43cf-b467-cd085251a149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:54.581439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ae78-ce1c-43cf-b467-cd085251a149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:54.583429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ae78-ce1c-43cf-b467-cd085251a149 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-7a33ae78-ce1c-43cf-b467-cd085251a149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:54.594827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:54.595951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:54.597074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:54.597074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:54.597074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:54.597074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:54.597074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:54.597074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:54.597074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:54.597074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:54.597074 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 390/756] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:54.597074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ae78-ce1c-43cf-b467-cd085251a149 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:54.623317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14801831-b3d9-4b39-af56-67d609df1e75 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:54.672818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f6514-4a8b-4136-9e68-d325b86d7332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:54.674336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f6514-4a8b-4136-9e68-d325b86d7332 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:54.676001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f6514-4a8b-4136-9e68-d325b86d7332 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:54.676637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f6514-4a8b-4136-9e68-d325b86d7332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:54.693240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f6514-4a8b-4136-9e68-d325b86d7332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:54.695329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f6514-4a8b-4136-9e68-d325b86d7332 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:54.711313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ae78-ce1c-43cf-b467-cd085251a149 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-e23f6514-4a8b-4136-9e68-d325b86d7332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:54.716395 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:54.717545 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:54.718701 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:54.718701 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:54.718701 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:54.720500 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 367/757] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:54.721520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f6514-4a8b-4136-9e68-d325b86d7332 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:54.748285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48352ad-fa02-4138-b912-f20062d9ba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:54.749060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48352ad-fa02-4138-b912-f20062d9ba32 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:54.749514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48352ad-fa02-4138-b912-f20062d9ba32 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:54.749867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48352ad-fa02-4138-b912-f20062d9ba32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:54.753499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:54.757017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48352ad-fa02-4138-b912-f20062d9ba32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:54.758928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48352ad-fa02-4138-b912-f20062d9ba32 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-b48352ad-fa02-4138-b912-f20062d9ba32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:54.771027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:54.772132 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:54.773250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:54.773250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:54.773250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:54.773250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:54.773250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:54.773250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:54.773250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:54.773250 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:54.774848 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 391/758] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:54.775709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48352ad-fa02-4138-b912-f20062d9ba32 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:54.794699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:54.837498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f6514-4a8b-4136-9e68-d325b86d7332 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:54.875450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b4a9a-d316-4032-91a5-3b8a4749daa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:54.876354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4a9a-d316-4032-91a5-3b8a4749daa4 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:54.876769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4a9a-d316-4032-91a5-3b8a4749daa4 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:54.877187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b4a9a-d316-4032-91a5-3b8a4749daa4 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:54.878058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b4a9a-d316-4032-91a5-3b8a4749daa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:54.878445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48352ad-fa02-4138-b912-f20062d9ba32 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:54.878666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b4a9a-d316-4032-91a5-3b8a4749daa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:54.880343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b4a9a-d316-4032-91a5-3b8a4749daa4 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:54.895103 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 368/759] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:54.896252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b4a9a-d316-4032-91a5-3b8a4749daa4 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:54.913403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5add0-46fc-415b-89ca-eca6e677a190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:54.914221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5add0-46fc-415b-89ca-eca6e677a190 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:54.914604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5add0-46fc-415b-89ca-eca6e677a190 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:54.914972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5add0-46fc-415b-89ca-eca6e677a190 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:54.915721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5add0-46fc-415b-89ca-eca6e677a190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:54.916122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5add0-46fc-415b-89ca-eca6e677a190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:54.917585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5add0-46fc-415b-89ca-eca6e677a190 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:54.930060 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 392/760] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:54.931064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5add0-46fc-415b-89ca-eca6e677a190 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:54.995450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:55.011102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b4a9a-d316-4032-91a5-3b8a4749daa4 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:55.015656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:55.041669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5add0-46fc-415b-89ca-eca6e677a190 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:55.054395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a871c-453a-4c0a-bf97-ffd27487863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:55.055307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a871c-453a-4c0a-bf97-ffd27487863d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:55.055722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a871c-453a-4c0a-bf97-ffd27487863d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:55.056132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a871c-453a-4c0a-bf97-ffd27487863d None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:55.056973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a871c-453a-4c0a-bf97-ffd27487863d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:55.057409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a871c-453a-4c0a-bf97-ffd27487863d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:55.059214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a871c-453a-4c0a-bf97-ffd27487863d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:55.072440 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 369/761] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:55.073521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a871c-453a-4c0a-bf97-ffd27487863d None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:55.081523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c4d43-a14d-480b-bd29-453c6990a2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:55.082408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c4d43-a14d-480b-bd29-453c6990a2e2 None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:55.082793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c4d43-a14d-480b-bd29-453c6990a2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:55.083189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c4d43-a14d-480b-bd29-453c6990a2e2 None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d3a99d39337841849b3e2efe48ebe53c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:55.085466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c4d43-a14d-480b-bd29-453c6990a2e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=d3a99d39337841849b3e2efe48ebe53c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:55.087090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c4d43-a14d-480b-bd29-453c6990a2e2 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:55.108221 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 393/762] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:58:54 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d3a99d39337841849b3e2efe48ebe53c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:58:55.109747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c4d43-a14d-480b-bd29-453c6990a2e2 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:55.193062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a871c-453a-4c0a-bf97-ffd27487863d None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:55.232527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446191-9d89-4263-a133-7d1fe4b23856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:55.233526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446191-9d89-4263-a133-7d1fe4b23856 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:55.234138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446191-9d89-4263-a133-7d1fe4b23856 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:55.234648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446191-9d89-4263-a133-7d1fe4b23856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:55.243098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446191-9d89-4263-a133-7d1fe4b23856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:55.245108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446191-9d89-4263-a133-7d1fe4b23856 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:55.264560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c4d43-a14d-480b-bd29-453c6990a2e2 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-f5446191-9d89-4263-a133-7d1fe4b23856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:58:55.272404 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:55.273512 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:55.274633 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:58:55.274633 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:58:55.274633 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:58:55.274633 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:58:55.274633 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:58:55.274633 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:58:55.274633 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:58:55.274633 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:55.278324 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 370/763] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:55.285029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446191-9d89-4263-a133-7d1fe4b23856 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:55.310454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:55.340714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b55536-ccbe-4bc5-9477-4cc89253c17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:55.341712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b55536-ccbe-4bc5-9477-4cc89253c17c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:55.342141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b55536-ccbe-4bc5-9477-4cc89253c17c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:55.342553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b55536-ccbe-4bc5-9477-4cc89253c17c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:55.343514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b55536-ccbe-4bc5-9477-4cc89253c17c None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d9592051e6894c86a699ca2074a32079) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:55.344039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b55536-ccbe-4bc5-9477-4cc89253c17c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:55.345827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b55536-ccbe-4bc5-9477-4cc89253c17c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:55.353129 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 394/764] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:55 2022] GET /identity/v3/role_assignments?user.id=d9592051e6894c86a699ca2074a32079&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:55.354741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baa105-bd48-4719-a94e-a7478d8bfcb5 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:55.355229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baa105-bd48-4719-a94e-a7478d8bfcb5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:55.355697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baa105-bd48-4719-a94e-a7478d8bfcb5 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:55.357634 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 395/765] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:55.363471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b5777-9466-4426-a73d-c57cd2c52897 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:55.363781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b5777-9466-4426-a73d-c57cd2c52897 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:55.364011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b5777-9466-4426-a73d-c57cd2c52897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:55.370575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:55.391871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b26b5777-9466-4426-a73d-c57cd2c52897 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:55.393101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b26b5777-9466-4426-a73d-c57cd2c52897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:55.458483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446191-9d89-4263-a133-7d1fe4b23856 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:55.510060 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 396/766] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:58:55.533258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3776e0-c244-4908-9d90-6986d1de3789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:55.534388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3776e0-c244-4908-9d90-6986d1de3789 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:55.534872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3776e0-c244-4908-9d90-6986d1de3789 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:55.535342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3776e0-c244-4908-9d90-6986d1de3789 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:55.536261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3776e0-c244-4908-9d90-6986d1de3789 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:55.536767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3776e0-c244-4908-9d90-6986d1de3789 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:55.538480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3776e0-c244-4908-9d90-6986d1de3789 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:55.557603 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 371/767] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:58:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:55.563632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b5777-9466-4426-a73d-c57cd2c52897 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:55.690838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b5777-9466-4426-a73d-c57cd2c52897 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:55.726814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:55.732445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a421a8-7188-4e14-bc4a-a6078d460a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:55.733073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a421a8-7188-4e14-bc4a-a6078d460a08 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:55.733352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a421a8-7188-4e14-bc4a-a6078d460a08 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:55.734111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a421a8-7188-4e14-bc4a-a6078d460a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:55.734439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a421a8-7188-4e14-bc4a-a6078d460a08 None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d7c17b0543d14adda9784af0fd2082d5) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:55.734828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a421a8-7188-4e14-bc4a-a6078d460a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:55.736423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a421a8-7188-4e14-bc4a-a6078d460a08 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:55.742965 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 397/768] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:58:55 2022] GET /identity/v3/role_assignments?user.id=d7c17b0543d14adda9784af0fd2082d5&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:55.876451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3776e0-c244-4908-9d90-6986d1de3789 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:55.946639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:55.989710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3776e0-c244-4908-9d90-6986d1de3789 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:56.039982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951b9b9-25ff-45b7-93ef-1ca5c676f38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:56.040625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b9b9-25ff-45b7-93ef-1ca5c676f38e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:56.040903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b9b9-25ff-45b7-93ef-1ca5c676f38e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:56.041168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951b9b9-25ff-45b7-93ef-1ca5c676f38e None admin] PATH_INFO: `/v3/services/network` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:56.041756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951b9b9-25ff-45b7-93ef-1ca5c676f38e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:56.043189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951b9b9-25ff-45b7-93ef-1ca5c676f38e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-8951b9b9-25ff-45b7-93ef-1ca5c676f38e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:56.054897 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:56.055921 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:56.057752 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 372/769] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:58:55 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:56.061867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a421a8-7188-4e14-bc4a-a6078d460a08 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:56.203764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9a79b-024a-4d0f-a7c5-36434ebdd1b3 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:56.203948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9a79b-024a-4d0f-a7c5-36434ebdd1b3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:56.204238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9a79b-024a-4d0f-a7c5-36434ebdd1b3 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:56.205552 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 373/770] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:56.210967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd674f7-d892-4532-adeb-a65fa3be9895 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:56.211486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd674f7-d892-4532-adeb-a65fa3be9895 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:56.211957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd674f7-d892-4532-adeb-a65fa3be9895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:56.222260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a421a8-7188-4e14-bc4a-a6078d460a08 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:56.258996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fdd674f7-d892-4532-adeb-a65fa3be9895 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:56.260566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fdd674f7-d892-4532-adeb-a65fa3be9895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:56.292019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1a0e-da95-492a-a104-333f456b097e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:56.292695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1a0e-da95-492a-a104-333f456b097e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:56.292907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1a0e-da95-492a-a104-333f456b097e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:56.293167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa1a0e-da95-492a-a104-333f456b097e None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:56.293801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa1a0e-da95-492a-a104-333f456b097e None admin] RBAC: Adding query filter params (name=network) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:56.294122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa1a0e-da95-492a-a104-333f456b097e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:56.295495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa1a0e-da95-492a-a104-333f456b097e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:56.302422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 398/771] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:58:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:56.310870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1a0e-da95-492a-a104-333f456b097e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:56.367553 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 374/772] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:58:56.386239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:56.432467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa1a0e-da95-492a-a104-333f456b097e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:56.471972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22238e6-a4d0-44a9-9dad-ec14f8c6f570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:56.472501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22238e6-a4d0-44a9-9dad-ec14f8c6f570 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:56.472771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22238e6-a4d0-44a9-9dad-ec14f8c6f570 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:56.473034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22238e6-a4d0-44a9-9dad-ec14f8c6f570 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:56.473668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22238e6-a4d0-44a9-9dad-ec14f8c6f570 None admin] RBAC: Adding query filter params (type=network) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:56.473985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22238e6-a4d0-44a9-9dad-ec14f8c6f570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:56.475359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22238e6-a4d0-44a9-9dad-ec14f8c6f570 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:56.481162 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 399/773] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:58:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:56.486888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd674f7-d892-4532-adeb-a65fa3be9895 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:56.570548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:56.625486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd674f7-d892-4532-adeb-a65fa3be9895 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:56.669448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ca3f3-c7a0-4579-b2a4-c523ccad01b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:56.670091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ca3f3-c7a0-4579-b2a4-c523ccad01b9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:56.670369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ca3f3-c7a0-4579-b2a4-c523ccad01b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:56.670632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ca3f3-c7a0-4579-b2a4-c523ccad01b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:56.671343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ca3f3-c7a0-4579-b2a4-c523ccad01b9 None admin] RBAC: Adding query filter params (interface=public, service_id=22c03cff21564d27825b5071322df748, region_id=RegionOne) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:56.671704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ca3f3-c7a0-4579-b2a4-c523ccad01b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:56.673108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ca3f3-c7a0-4579-b2a4-c523ccad01b9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:56.681407 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 375/774] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 03:58:56 2022] GET /identity/v3/endpoints?service_id=22c03cff21564d27825b5071322df748&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:56.686985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22238e6-a4d0-44a9-9dad-ec14f8c6f570 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:56.756612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ca3f3-c7a0-4579-b2a4-c523ccad01b9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:56.869005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ca3f3-c7a0-4579-b2a4-c523ccad01b9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:56.881220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22238e6-a4d0-44a9-9dad-ec14f8c6f570 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:56.907440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:56.915601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:56.923751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961959c-4dc5-4731-9efd-ad487c16bc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:56.924728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961959c-4dc5-4731-9efd-ad487c16bc29 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:56.925209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961959c-4dc5-4731-9efd-ad487c16bc29 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:56.925677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961959c-4dc5-4731-9efd-ad487c16bc29 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:56.926688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961959c-4dc5-4731-9efd-ad487c16bc29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:56.928561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961959c-4dc5-4731-9efd-ad487c16bc29 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:56.937376 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 400/775] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 03:58:56 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:56.941206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f337c6d-c8f6-40d3-90f8-d171d5a04613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:56.942300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f337c6d-c8f6-40d3-90f8-d171d5a04613 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:56.942860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f337c6d-c8f6-40d3-90f8-d171d5a04613 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:56.943345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f337c6d-c8f6-40d3-90f8-d171d5a04613 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:56.944214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f337c6d-c8f6-40d3-90f8-d171d5a04613 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:56.945983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f337c6d-c8f6-40d3-90f8-d171d5a04613 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-9f337c6d-c8f6-40d3-90f8-d171d5a04613 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:56.956869 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:56.957991 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 03:58:56.958823 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:56.967688 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 376/776] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Aug 30 03:58:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:56.969584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961959c-4dc5-4731-9efd-ad487c16bc29 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:57.121901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961959c-4dc5-4731-9efd-ad487c16bc29 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:57.160960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1db430-68a8-4cdc-9f64-ccf2cca08f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:57.162007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1db430-68a8-4cdc-9f64-ccf2cca08f31 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:57.162512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1db430-68a8-4cdc-9f64-ccf2cca08f31 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:57.162980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1db430-68a8-4cdc-9f64-ccf2cca08f31 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:57.163826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1db430-68a8-4cdc-9f64-ccf2cca08f31 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:57.164326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1db430-68a8-4cdc-9f64-ccf2cca08f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:57.166042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1db430-68a8-4cdc-9f64-ccf2cca08f31 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:57.175859 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 401/777] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 03:58:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:58:57.178016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f337c6d-c8f6-40d3-90f8-d171d5a04613 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:57.287434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f337c6d-c8f6-40d3-90f8-d171d5a04613 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:57.325318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f15eb-41ad-4f1c-94e6-035b05239cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:57.326347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f15eb-41ad-4f1c-94e6-035b05239cfe None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:57.326860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f15eb-41ad-4f1c-94e6-035b05239cfe None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:57.327399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f15eb-41ad-4f1c-94e6-035b05239cfe None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:57.328597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f15eb-41ad-4f1c-94e6-035b05239cfe None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:57.329170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f15eb-41ad-4f1c-94e6-035b05239cfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:57.330791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f15eb-41ad-4f1c-94e6-035b05239cfe None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:57.340627 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 377/778] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 03:58:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:57.343175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1db430-68a8-4cdc-9f64-ccf2cca08f31 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:57.412896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:57.470731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1db430-68a8-4cdc-9f64-ccf2cca08f31 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:57.521691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7397a-fc6c-4f21-a8ea-1ba09d6de62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:57.522868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7397a-fc6c-4f21-a8ea-1ba09d6de62d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:57.523419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7397a-fc6c-4f21-a8ea-1ba09d6de62d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:57.523899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7397a-fc6c-4f21-a8ea-1ba09d6de62d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:57.524807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7397a-fc6c-4f21-a8ea-1ba09d6de62d None admin] RBAC: Adding query filter params (interface=public, service_id=15fe9df8c54a4662af18a724e1284bd8, region_id=RegionOne) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:57.525325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7397a-fc6c-4f21-a8ea-1ba09d6de62d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:57.526956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7397a-fc6c-4f21-a8ea-1ba09d6de62d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:57.539277 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 402/779] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 03:58:57 2022] GET /identity/v3/endpoints?service_id=15fe9df8c54a4662af18a724e1284bd8&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:57.544897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f15eb-41ad-4f1c-94e6-035b05239cfe None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:57.619661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:57.668830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f15eb-41ad-4f1c-94e6-035b05239cfe None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:57.674085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd662120-27d4-423c-bd61-8a2f30e04d97 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:57.674373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd662120-27d4-423c-bd61-8a2f30e04d97 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:57.674648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd662120-27d4-423c-bd61-8a2f30e04d97 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:57.676247 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 403/780] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:58:57.681772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a71cb-d300-4b89-94b4-56f3157fc774 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:57.682092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a71cb-d300-4b89-94b4-56f3157fc774 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:57.682355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a71cb-d300-4b89-94b4-56f3157fc774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:57.704804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-058a71cb-d300-4b89-94b4-56f3157fc774 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:57.706160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-058a71cb-d300-4b89-94b4-56f3157fc774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:57.706761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c2f19-5899-44e0-b201-4ee86f03a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:57.707424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2f19-5899-44e0-b201-4ee86f03a0ed None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:57.707703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2f19-5899-44e0-b201-4ee86f03a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:57.707970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c2f19-5899-44e0-b201-4ee86f03a0ed None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:57.708699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c2f19-5899-44e0-b201-4ee86f03a0ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:57.710380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c2f19-5899-44e0-b201-4ee86f03a0ed None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:57.717555 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 378/781] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 03:58:57 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:57.819730 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 404/782] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:58:57.924971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609ca7d-dc79-47e5-81a5-7c5fef46ae7d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:57.925356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609ca7d-dc79-47e5-81a5-7c5fef46ae7d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:57.925737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609ca7d-dc79-47e5-81a5-7c5fef46ae7d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:57.927514 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 379/783] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:57.933244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee4078-d290-4334-a5b2-c3ccc89ae70c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:57.933528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee4078-d290-4334-a5b2-c3ccc89ae70c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:57.933798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee4078-d290-4334-a5b2-c3ccc89ae70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:57.954012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ffee4078-d290-4334-a5b2-c3ccc89ae70c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:57.955212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ffee4078-d290-4334-a5b2-c3ccc89ae70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:58.016348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:58.057099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50c98-1bb7-4e14-b3cf-eafc80841030 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:58.057462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50c98-1bb7-4e14-b3cf-eafc80841030 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:58.057635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c50c98-1bb7-4e14-b3cf-eafc80841030 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:58.059244 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 380/784] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:58.060540 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 405/785] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:58:58.064395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f3cd-74d0-4001-8966-1e9e21a2cbb4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:58.064730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f3cd-74d0-4001-8966-1e9e21a2cbb4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:58.064986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8f3cd-74d0-4001-8966-1e9e21a2cbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:58.095780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8de8f3cd-74d0-4001-8966-1e9e21a2cbb4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:58.097520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8de8f3cd-74d0-4001-8966-1e9e21a2cbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:58.166722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee4078-d290-4334-a5b2-c3ccc89ae70c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:58.175110 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 381/786] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:58:58.279832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee4078-d290-4334-a5b2-c3ccc89ae70c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:58.317858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3439b-ed26-4e55-bfc6-95db8c4febaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:58.318971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3439b-ed26-4e55-bfc6-95db8c4febaa None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:58.319401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3439b-ed26-4e55-bfc6-95db8c4febaa None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:58.319816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3439b-ed26-4e55-bfc6-95db8c4febaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:58.334362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3439b-ed26-4e55-bfc6-95db8c4febaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-65b3439b-ed26-4e55-bfc6-95db8c4febaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:58.339969 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:58.341197 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:58.342302 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:58.344835 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 406/787] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:58:58.351738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8f3cd-74d0-4001-8966-1e9e21a2cbb4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:58.427990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:58.477560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3439b-ed26-4e55-bfc6-95db8c4febaa None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:58.526260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8f3cd-74d0-4001-8966-1e9e21a2cbb4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:58.556627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:58.596099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06b726-1c0d-4d9e-84c8-d520480514b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:58.597302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b726-1c0d-4d9e-84c8-d520480514b7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:58.597837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b726-1c0d-4d9e-84c8-d520480514b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:58.598343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b726-1c0d-4d9e-84c8-d520480514b7 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:58.599245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06b726-1c0d-4d9e-84c8-d520480514b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:58.599787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06b726-1c0d-4d9e-84c8-d520480514b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:58.601434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06b726-1c0d-4d9e-84c8-d520480514b7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:58.613494 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 382/788] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:58.618093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06b726-1c0d-4d9e-84c8-d520480514b7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:58.654381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3439b-ed26-4e55-bfc6-95db8c4febaa None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:58.703934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee596c3-074b-430f-a883-865933ff18f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:58.704924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee596c3-074b-430f-a883-865933ff18f4 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:58.705418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee596c3-074b-430f-a883-865933ff18f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:58.706002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee596c3-074b-430f-a883-865933ff18f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:58.717905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee596c3-074b-430f-a883-865933ff18f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-aee596c3-074b-430f-a883-865933ff18f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:58.723321 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:58.724292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:58:58.725142 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:58.734390 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 407/789] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:58.735727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee596c3-074b-430f-a883-865933ff18f4 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:58.752444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06b726-1c0d-4d9e-84c8-d520480514b7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:58.770033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:58.803406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2434d2-67ee-4a7f-9133-4ae6e8ea6662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:58.804150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2434d2-67ee-4a7f-9133-4ae6e8ea6662 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:58.804424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2434d2-67ee-4a7f-9133-4ae6e8ea6662 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:58.804690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2434d2-67ee-4a7f-9133-4ae6e8ea6662 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:58.822403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2434d2-67ee-4a7f-9133-4ae6e8ea6662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-1b2434d2-67ee-4a7f-9133-4ae6e8ea6662 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:58:58.828764 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:58.829771 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:58:58.830651 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:58.839195 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 383/790] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:58:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:58.840388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2434d2-67ee-4a7f-9133-4ae6e8ea6662 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:58.859212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:58.868738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee596c3-074b-430f-a883-865933ff18f4 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:58.914205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78825b91-3cf1-48fb-b58d-687d9a751899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:58.915856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78825b91-3cf1-48fb-b58d-687d9a751899 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:58.916352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78825b91-3cf1-48fb-b58d-687d9a751899 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:58.916833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78825b91-3cf1-48fb-b58d-687d9a751899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:58.930508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78825b91-3cf1-48fb-b58d-687d9a751899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:58.932919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78825b91-3cf1-48fb-b58d-687d9a751899 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-78825b91-3cf1-48fb-b58d-687d9a751899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:58.956510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:58.958652 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:58.959813 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:58.959813 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:58.959813 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:58.962119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2434d2-67ee-4a7f-9133-4ae6e8ea6662 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:58.964582 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 408/791] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:58.965891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78825b91-3cf1-48fb-b58d-687d9a751899 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:59.002860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcab52a-7117-40da-bdd1-87c120deab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:59.003484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcab52a-7117-40da-bdd1-87c120deab4a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.003760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcab52a-7117-40da-bdd1-87c120deab4a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.004027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcab52a-7117-40da-bdd1-87c120deab4a None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.004741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcab52a-7117-40da-bdd1-87c120deab4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:59.005003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcab52a-7117-40da-bdd1-87c120deab4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:59.006460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcab52a-7117-40da-bdd1-87c120deab4a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:59.016271 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 384/792] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:59.017291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcab52a-7117-40da-bdd1-87c120deab4a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:59.069975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:59.111327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78825b91-3cf1-48fb-b58d-687d9a751899 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:59.146965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99827a8a-ad04-4c32-8950-44f3519d98e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:59.147585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99827a8a-ad04-4c32-8950-44f3519d98e2 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.147860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99827a8a-ad04-4c32-8950-44f3519d98e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.148129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99827a8a-ad04-4c32-8950-44f3519d98e2 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.148938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99827a8a-ad04-4c32-8950-44f3519d98e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:59.149250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99827a8a-ad04-4c32-8950-44f3519d98e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:59.151237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99827a8a-ad04-4c32-8950-44f3519d98e2 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:59.156268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcab52a-7117-40da-bdd1-87c120deab4a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:59.166014 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 409/793] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:58:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:59.166014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99827a8a-ad04-4c32-8950-44f3519d98e2 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:59.177227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:59.201075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5e8ec-10a8-4297-994c-2af8e07cd840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:59.202103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5e8ec-10a8-4297-994c-2af8e07cd840 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.202599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5e8ec-10a8-4297-994c-2af8e07cd840 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.203234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5e8ec-10a8-4297-994c-2af8e07cd840 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.204198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5e8ec-10a8-4297-994c-2af8e07cd840 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:59.204701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5e8ec-10a8-4297-994c-2af8e07cd840 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:59.206366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5e8ec-10a8-4297-994c-2af8e07cd840 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:59.220185 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 385/794] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:59.221573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5e8ec-10a8-4297-994c-2af8e07cd840 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:59.281532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99827a8a-ad04-4c32-8950-44f3519d98e2 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:59.318608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1da6f9-2018-490e-acab-a8ae93cb8f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:59.319663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1da6f9-2018-490e-acab-a8ae93cb8f36 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.320139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1da6f9-2018-490e-acab-a8ae93cb8f36 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.320623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1da6f9-2018-490e-acab-a8ae93cb8f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.334280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1da6f9-2018-490e-acab-a8ae93cb8f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:59.335744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1da6f9-2018-490e-acab-a8ae93cb8f36 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:59.339754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:59.350472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5e8ec-10a8-4297-994c-2af8e07cd840 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-7f1da6f9-2018-490e-acab-a8ae93cb8f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:59.350855 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:59.357850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:59.358816 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:59.358816 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:59.358816 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:59.358816 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 410/795] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:59.358816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1da6f9-2018-490e-acab-a8ae93cb8f36 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:59.391724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14970098-58fc-440d-b0bc-b911e575d023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:59.392360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14970098-58fc-440d-b0bc-b911e575d023 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.393310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14970098-58fc-440d-b0bc-b911e575d023 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.393310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14970098-58fc-440d-b0bc-b911e575d023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.404145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14970098-58fc-440d-b0bc-b911e575d023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:59.405714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14970098-58fc-440d-b0bc-b911e575d023 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:59.421534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-14970098-58fc-440d-b0bc-b911e575d023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:58:59.422186 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:59.423082 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:58:59.423981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:58:59.423981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:58:59.423981 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:58:59.423981 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 386/796] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:59.425752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb461-604a-4625-98b0-21e180a8d429 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.425752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb461-604a-4625-98b0-21e180a8d429 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.425752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454eb461-604a-4625-98b0-21e180a8d429 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.429987 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 387/797] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:58:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:58:59.431013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb461-604a-4625-98b0-21e180a8d429 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:59.472212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1da6f9-2018-490e-acab-a8ae93cb8f36 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:59.512662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49345cd6-0de0-4d9a-b244-c4302970e54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:59.513332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345cd6-0de0-4d9a-b244-c4302970e54a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.513606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345cd6-0de0-4d9a-b244-c4302970e54a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.513867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345cd6-0de0-4d9a-b244-c4302970e54a None admin] PATH_INFO: `/v3/users/nova` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.523400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49345cd6-0de0-4d9a-b244-c4302970e54a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:59.524888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49345cd6-0de0-4d9a-b244-c4302970e54a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-49345cd6-0de0-4d9a-b244-c4302970e54a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:59.540182 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:58:59.541224 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 411/798] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 03:58:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:58:59.547659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49345cd6-0de0-4d9a-b244-c4302970e54a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:59.662834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454eb461-604a-4625-98b0-21e180a8d429 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:59.663322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49345cd6-0de0-4d9a-b244-c4302970e54a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:59.687521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:59.701025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c816a7d-90c7-41ee-ad62-2817c2d0afc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:59.701664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c816a7d-90c7-41ee-ad62-2817c2d0afc6 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.701962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c816a7d-90c7-41ee-ad62-2817c2d0afc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.702247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c816a7d-90c7-41ee-ad62-2817c2d0afc6 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.702861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c816a7d-90c7-41ee-ad62-2817c2d0afc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:59.703331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c816a7d-90c7-41ee-ad62-2817c2d0afc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:59.703506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44412a52-a01a-4b7a-9a06-5ae9afcd434b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:59.704115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44412a52-a01a-4b7a-9a06-5ae9afcd434b None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.704386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44412a52-a01a-4b7a-9a06-5ae9afcd434b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.704652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44412a52-a01a-4b7a-9a06-5ae9afcd434b None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.704801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c816a7d-90c7-41ee-ad62-2817c2d0afc6 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:59.705294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44412a52-a01a-4b7a-9a06-5ae9afcd434b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:59.705588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44412a52-a01a-4b7a-9a06-5ae9afcd434b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:59.707031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44412a52-a01a-4b7a-9a06-5ae9afcd434b None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:59.716872 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 412/799] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:59.718372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad241c-fe53-4e4c-8eb8-0f3a5597ff16 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.718685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad241c-fe53-4e4c-8eb8-0f3a5597ff16 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.719047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad241c-fe53-4e4c-8eb8-0f3a5597ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.725988 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 388/800] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:59.729497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44412a52-a01a-4b7a-9a06-5ae9afcd434b None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:59.734002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:59.739339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5bad241c-fe53-4e4c-8eb8-0f3a5597ff16 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:58:59.740575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5bad241c-fe53-4e4c-8eb8-0f3a5597ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:58:59.818218 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 413/801] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:58:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:58:59.819761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad241c-fe53-4e4c-8eb8-0f3a5597ff16 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:59.834560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44412a52-a01a-4b7a-9a06-5ae9afcd434b None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:59.875591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347aa1e-4007-4c03-ad7b-f0a2a94ac3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:59.876983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347aa1e-4007-4c03-ad7b-f0a2a94ac3f1 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.877680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347aa1e-4007-4c03-ad7b-f0a2a94ac3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.878233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347aa1e-4007-4c03-ad7b-f0a2a94ac3f1 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.879388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347aa1e-4007-4c03-ad7b-f0a2a94ac3f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:58:59.880345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347aa1e-4007-4c03-ad7b-f0a2a94ac3f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:59.882257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347aa1e-4007-4c03-ad7b-f0a2a94ac3f1 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:59.906640 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 389/802] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 03:58:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:58:59.907837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347aa1e-4007-4c03-ad7b-f0a2a94ac3f1 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:58:59.937696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad241c-fe53-4e4c-8eb8-0f3a5597ff16 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:58:59.951446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:59.974724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a13dfe-3b47-48e6-9fb1-9c826367803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:58:59.975367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a13dfe-3b47-48e6-9fb1-9c826367803d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:58:59.975651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a13dfe-3b47-48e6-9fb1-9c826367803d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:58:59.975911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a13dfe-3b47-48e6-9fb1-9c826367803d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:58:59.976195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:58:59.984777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a13dfe-3b47-48e6-9fb1-9c826367803d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:58:59.986573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a13dfe-3b47-48e6-9fb1-9c826367803d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-84a13dfe-3b47-48e6-9fb1-9c826367803d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:58:59.999196 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:00.000202 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 414/803] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 03:58:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:00.001238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a13dfe-3b47-48e6-9fb1-9c826367803d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.022026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347aa1e-4007-4c03-ad7b-f0a2a94ac3f1 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:00.056166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b40cc-0be1-4b8d-aef2-ce631f3ad43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:00.056794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b40cc-0be1-4b8d-aef2-ce631f3ad43a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.057061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b40cc-0be1-4b8d-aef2-ce631f3ad43a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.057372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b40cc-0be1-4b8d-aef2-ce631f3ad43a None admin] PATH_INFO: `/v3/users/swift` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.064537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b40cc-0be1-4b8d-aef2-ce631f3ad43a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:00.066014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b40cc-0be1-4b8d-aef2-ce631f3ad43a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-f93b40cc-0be1-4b8d-aef2-ce631f3ad43a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:59:00.077702 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:00.079013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:00.079987 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 390/804] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:58:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:00.080586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f68734-eb74-4729-9dbc-fc7c01b475c6 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.080586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f68734-eb74-4729-9dbc-fc7c01b475c6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.080710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f68734-eb74-4729-9dbc-fc7c01b475c6 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.082102 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 391/805] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:00.082693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f68734-eb74-4729-9dbc-fc7c01b475c6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.110792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a13dfe-3b47-48e6-9fb1-9c826367803d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:00.143497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5a726-9d0e-49d9-8195-4266d4b0a483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:00.144099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5a726-9d0e-49d9-8195-4266d4b0a483 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.144369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5a726-9d0e-49d9-8195-4266d4b0a483 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.144632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5a726-9d0e-49d9-8195-4266d4b0a483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.183377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f68734-eb74-4729-9dbc-fc7c01b475c6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:00.184182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:00.205017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:00.210987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5a726-9d0e-49d9-8195-4266d4b0a483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:00.212451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5a726-9d0e-49d9-8195-4266d4b0a483 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:00.216733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7fd22-df3e-47f1-9739-4966018a3dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:00.217338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7fd22-df3e-47f1-9739-4966018a3dee None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.217613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7fd22-df3e-47f1-9739-4966018a3dee None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.217894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7fd22-df3e-47f1-9739-4966018a3dee None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.218644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7fd22-df3e-47f1-9739-4966018a3dee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:00.219069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7fd22-df3e-47f1-9739-4966018a3dee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:00.220535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7fd22-df3e-47f1-9739-4966018a3dee None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:00.237816 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 392/806] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:00.238579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7fd22-df3e-47f1-9739-4966018a3dee None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.311127 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 415/807] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:00.311970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5a726-9d0e-49d9-8195-4266d4b0a483 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.334040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7fd22-df3e-47f1-9739-4966018a3dee None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:00.368240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd43b7-23ac-4f6b-9e22-31d8a8ac87aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:00.368887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd43b7-23ac-4f6b-9e22-31d8a8ac87aa None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.369160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd43b7-23ac-4f6b-9e22-31d8a8ac87aa None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.369427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd43b7-23ac-4f6b-9e22-31d8a8ac87aa None admin] PATH_INFO: `/v3/services/network` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.370043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd43b7-23ac-4f6b-9e22-31d8a8ac87aa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:00.371429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd43b7-23ac-4f6b-9e22-31d8a8ac87aa None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-accd43b7-23ac-4f6b-9e22-31d8a8ac87aa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:00.380013 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:00.381077 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 03:59:00.381949 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:00.382717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:00.383126 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 393/808] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/services/network => generated 88 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:00.383126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3df8b-206c-434f-af02-5587d5b6096f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.383126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3df8b-206c-434f-af02-5587d5b6096f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.383126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3df8b-206c-434f-af02-5587d5b6096f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.401057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-60b3df8b-206c-434f-af02-5587d5b6096f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:00.402324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-60b3df8b-206c-434f-af02-5587d5b6096f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:00.415706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5a726-9d0e-49d9-8195-4266d4b0a483 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:00.442662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:00.451738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c4470-505c-4626-b948-ce0fbd140e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:00.452348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4470-505c-4626-b948-ce0fbd140e89 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.452616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4470-505c-4626-b948-ce0fbd140e89 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.452880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c4470-505c-4626-b948-ce0fbd140e89 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.453972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c4470-505c-4626-b948-ce0fbd140e89 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:00.454308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c4470-505c-4626-b948-ce0fbd140e89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:00.455751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c4470-505c-4626-b948-ce0fbd140e89 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:00.470546 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 394/809] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:00.471390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3df8b-206c-434f-af02-5587d5b6096f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.477060 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 416/810] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:00.478076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c4470-505c-4626-b948-ce0fbd140e89 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.591921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3df8b-206c-434f-af02-5587d5b6096f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:00.628944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b571e5-5442-495e-b0fc-0b9605dfd53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:00.629589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b571e5-5442-495e-b0fc-0b9605dfd53c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.629866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b571e5-5442-495e-b0fc-0b9605dfd53c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.630172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b571e5-5442-495e-b0fc-0b9605dfd53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.643301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b571e5-5442-495e-b0fc-0b9605dfd53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:00.644783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b571e5-5442-495e-b0fc-0b9605dfd53c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-95b571e5-5442-495e-b0fc-0b9605dfd53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:00.660538 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:00.661713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:00.662660 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:00.662660 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:00.662660 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:00.662660 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 395/811] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:00.662888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b571e5-5442-495e-b0fc-0b9605dfd53c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.695561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:00.716940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c4470-505c-4626-b948-ce0fbd140e89 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:00.745458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:00.752293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48a6a7-29f9-460f-bc24-4ae451c2310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:00.752924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48a6a7-29f9-460f-bc24-4ae451c2310a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.753194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48a6a7-29f9-460f-bc24-4ae451c2310a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.753453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48a6a7-29f9-460f-bc24-4ae451c2310a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.763278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48a6a7-29f9-460f-bc24-4ae451c2310a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:00.764709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48a6a7-29f9-460f-bc24-4ae451c2310a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:00.772610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b571e5-5442-495e-b0fc-0b9605dfd53c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-4c48a6a7-29f9-460f-bc24-4ae451c2310a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:00.779227 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:00.780199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:00.781091 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:00.781091 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:00.781091 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:00.781091 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 417/812] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:00.781427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48a6a7-29f9-460f-bc24-4ae451c2310a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.808661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f49e-8226-4b7d-80b4-ba7d3d1a1d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:00.809272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f49e-8226-4b7d-80b4-ba7d3d1a1d61 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.809543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f49e-8226-4b7d-80b4-ba7d3d1a1d61 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.809812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64f49e-8226-4b7d-80b4-ba7d3d1a1d61 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.810471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64f49e-8226-4b7d-80b4-ba7d3d1a1d61 None admin] RBAC: Adding query filter params (name=network) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:00.810767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64f49e-8226-4b7d-80b4-ba7d3d1a1d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:00.812178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64f49e-8226-4b7d-80b4-ba7d3d1a1d61 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:00.816534 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 396/813] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:00.817306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f49e-8226-4b7d-80b4-ba7d3d1a1d61 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.883485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48a6a7-29f9-460f-bc24-4ae451c2310a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:00.905256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:00.915610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64f49e-8226-4b7d-80b4-ba7d3d1a1d61 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:00.917298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2cd34-25f7-47c0-9369-938a5f7a800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:00.917997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2cd34-25f7-47c0-9369-938a5f7a800b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.918270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2cd34-25f7-47c0-9369-938a5f7a800b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.918534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2cd34-25f7-47c0-9369-938a5f7a800b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.928247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2cd34-25f7-47c0-9369-938a5f7a800b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:00.929698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2cd34-25f7-47c0-9369-938a5f7a800b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-0ab2cd34-25f7-47c0-9369-938a5f7a800b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:00.944086 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:00.945191 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:00.946578 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:00.946578 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:00.946578 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:00.946578 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 418/814] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:00.946578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2cd34-25f7-47c0-9369-938a5f7a800b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.949283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe85c2-5eab-4513-96e3-f79b2f253fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:00.950100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe85c2-5eab-4513-96e3-f79b2f253fae None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:00.950195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe85c2-5eab-4513-96e3-f79b2f253fae None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:00.950442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe85c2-5eab-4513-96e3-f79b2f253fae None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:00.951089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe85c2-5eab-4513-96e3-f79b2f253fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:00.951386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe85c2-5eab-4513-96e3-f79b2f253fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:00.952764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe85c2-5eab-4513-96e3-f79b2f253fae None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:00.964905 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 397/815] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:00.965462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe85c2-5eab-4513-96e3-f79b2f253fae None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:00.988736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:01.053536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2cd34-25f7-47c0-9369-938a5f7a800b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.067133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe85c2-5eab-4513-96e3-f79b2f253fae None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.087549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b73aad-ceee-4cee-8c2d-6638fd27ef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.088182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b73aad-ceee-4cee-8c2d-6638fd27ef2f None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.088450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b73aad-ceee-4cee-8c2d-6638fd27ef2f None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.088714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b73aad-ceee-4cee-8c2d-6638fd27ef2f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.089295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b73aad-ceee-4cee-8c2d-6638fd27ef2f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.090684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b73aad-ceee-4cee-8c2d-6638fd27ef2f None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.099955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd544c0-bb9e-4c73-9371-7fefa596778c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.100554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd544c0-bb9e-4c73-9371-7fefa596778c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.100824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd544c0-bb9e-4c73-9371-7fefa596778c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.101085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd544c0-bb9e-4c73-9371-7fefa596778c None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-92b73aad-ceee-4cee-8c2d-6638fd27ef2f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:01.101181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:01.102328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 03:59:01.103156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:01.104259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd544c0-bb9e-4c73-9371-7fefa596778c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:01.104259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd544c0-bb9e-4c73-9371-7fefa596778c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.104470 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 419/816] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:01.104470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b73aad-ceee-4cee-8c2d-6638fd27ef2f None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.104611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd544c0-bb9e-4c73-9371-7fefa596778c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.115269 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 398/817] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:01.116088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd544c0-bb9e-4c73-9371-7fefa596778c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.129640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:01.202898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:01.207421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b73aad-ceee-4cee-8c2d-6638fd27ef2f None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.216607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd544c0-bb9e-4c73-9371-7fefa596778c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.240986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c558e-67de-4ff7-9f0f-235c5fd9d893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.241644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c558e-67de-4ff7-9f0f-235c5fd9d893 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.241941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c558e-67de-4ff7-9f0f-235c5fd9d893 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.242214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c558e-67de-4ff7-9f0f-235c5fd9d893 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.242858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c558e-67de-4ff7-9f0f-235c5fd9d893 None admin] RBAC: Adding query filter params (type=network) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:01.243143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c558e-67de-4ff7-9f0f-235c5fd9d893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.244508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c558e-67de-4ff7-9f0f-235c5fd9d893 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.249107 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 420/818] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:59:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:01.249384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772fab4-8c7f-4f5a-9627-489dba8ee42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.249888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c558e-67de-4ff7-9f0f-235c5fd9d893 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.250068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772fab4-8c7f-4f5a-9627-489dba8ee42a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.251272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772fab4-8c7f-4f5a-9627-489dba8ee42a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.251272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772fab4-8c7f-4f5a-9627-489dba8ee42a None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.251479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772fab4-8c7f-4f5a-9627-489dba8ee42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:01.251754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772fab4-8c7f-4f5a-9627-489dba8ee42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.253113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772fab4-8c7f-4f5a-9627-489dba8ee42a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.265259 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 399/819] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:01.266457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772fab4-8c7f-4f5a-9627-489dba8ee42a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.332965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:01.354799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c558e-67de-4ff7-9f0f-235c5fd9d893 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.365427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772fab4-8c7f-4f5a-9627-489dba8ee42a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.388593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdec24-3f02-4363-8626-5c80cea3abb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.389208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdec24-3f02-4363-8626-5c80cea3abb5 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.389486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdec24-3f02-4363-8626-5c80cea3abb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.389772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccdec24-3f02-4363-8626-5c80cea3abb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.396855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccdec24-3f02-4363-8626-5c80cea3abb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.398320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccdec24-3f02-4363-8626-5c80cea3abb5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.401546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa05542-39a1-4895-b27c-d4f4961cf71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.402177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa05542-39a1-4895-b27c-d4f4961cf71e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.402455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa05542-39a1-4895-b27c-d4f4961cf71e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.402725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa05542-39a1-4895-b27c-d4f4961cf71e None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.403356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa05542-39a1-4895-b27c-d4f4961cf71e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:01.403655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa05542-39a1-4895-b27c-d4f4961cf71e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.405062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa05542-39a1-4895-b27c-d4f4961cf71e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-2ccdec24-3f02-4363-8626-5c80cea3abb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:01.409264 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:01.410181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:01.411762 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:01.411762 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:01.411762 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:01.411762 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:01.411762 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:01.411762 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:01.411762 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:01.411762 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:01.412229 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 400/820] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 03:59:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:01.412300 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 421/821] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:01.412300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdec24-3f02-4363-8626-5c80cea3abb5 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.413226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa05542-39a1-4895-b27c-d4f4961cf71e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.439600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:01.515408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccdec24-3f02-4363-8626-5c80cea3abb5 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.518595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa05542-39a1-4895-b27c-d4f4961cf71e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.548441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2539c5-a819-49cd-9962-f97896efd2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.548627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2539c5-a819-49cd-9962-f97896efd2bd None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.548755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2539c5-a819-49cd-9962-f97896efd2bd None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.549013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2539c5-a819-49cd-9962-f97896efd2bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.549676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2539c5-a819-49cd-9962-f97896efd2bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.551090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2539c5-a819-49cd-9962-f97896efd2bd None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.554245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61959746-fc11-48a6-9a09-fb2de87132b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.554875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959746-fc11-48a6-9a09-fb2de87132b9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.555152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959746-fc11-48a6-9a09-fb2de87132b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.555423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959746-fc11-48a6-9a09-fb2de87132b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.557416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:01.563656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61959746-fc11-48a6-9a09-fb2de87132b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.565905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61959746-fc11-48a6-9a09-fb2de87132b9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.573317 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 422/822] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 03:59:01 2022] POST /identity/v3/endpoints => generated 337 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:01.574168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2539c5-a819-49cd-9962-f97896efd2bd None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-61959746-fc11-48a6-9a09-fb2de87132b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:01.578003 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:01.579324 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:01.580364 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:01.580364 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:01.580364 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:01.580364 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:01.580364 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:01.580364 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:01.580364 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:01.580364 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:01.580364 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 401/823] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:01.581033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61959746-fc11-48a6-9a09-fb2de87132b9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.679588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:01.710117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61959746-fc11-48a6-9a09-fb2de87132b9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.717536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2539c5-a819-49cd-9962-f97896efd2bd None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.757914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b885aa3-6c05-482b-bffe-07bdc3384ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.758424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885aa3-6c05-482b-bffe-07bdc3384ce0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.758696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885aa3-6c05-482b-bffe-07bdc3384ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.758971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b885aa3-6c05-482b-bffe-07bdc3384ce0 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.759594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b885aa3-6c05-482b-bffe-07bdc3384ce0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:01.759887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b885aa3-6c05-482b-bffe-07bdc3384ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.761361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b885aa3-6c05-482b-bffe-07bdc3384ce0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.766688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4200aa-b031-4c97-86f5-eec44e076d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.766869 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 402/824] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 03:59:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:01.766992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4200aa-b031-4c97-86f5-eec44e076d28 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.767268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4200aa-b031-4c97-86f5-eec44e076d28 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.767500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4200aa-b031-4c97-86f5-eec44e076d28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.767705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b885aa3-6c05-482b-bffe-07bdc3384ce0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.774770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4200aa-b031-4c97-86f5-eec44e076d28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.776382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4200aa-b031-4c97-86f5-eec44e076d28 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-7b4200aa-b031-4c97-86f5-eec44e076d28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:01.790167 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:01.791204 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:01.792305 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:01.792305 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:01.792305 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:01.792305 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:01.792305 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:01.792305 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:01.792305 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:01.792305 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:01.794099 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 423/825] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:01.795088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4200aa-b031-4c97-86f5-eec44e076d28 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.833169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:01.876726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b885aa3-6c05-482b-bffe-07bdc3384ce0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.897658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4200aa-b031-4c97-86f5-eec44e076d28 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:01.911488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf612-441e-444b-9ee7-9387b04f596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.912099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf612-441e-444b-9ee7-9387b04f596e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.912370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf612-441e-444b-9ee7-9387b04f596e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.912640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cf612-441e-444b-9ee7-9387b04f596e None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.913336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf612-441e-444b-9ee7-9387b04f596e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:01.913636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf612-441e-444b-9ee7-9387b04f596e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.915143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cf612-441e-444b-9ee7-9387b04f596e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.927420 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 403/826] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:01.927995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf612-441e-444b-9ee7-9387b04f596e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:01.937346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969d45e-667b-4607-bb88-5e4db8b10c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:01.938283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d45e-667b-4607-bb88-5e4db8b10c6d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:01.938933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d45e-667b-4607-bb88-5e4db8b10c6d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:01.939214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969d45e-667b-4607-bb88-5e4db8b10c6d None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:01.939908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969d45e-667b-4607-bb88-5e4db8b10c6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:01.940218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969d45e-667b-4607-bb88-5e4db8b10c6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:01.941658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9969d45e-667b-4607-bb88-5e4db8b10c6d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:01.943417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:01.956262 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 424/827] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:01.957116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969d45e-667b-4607-bb88-5e4db8b10c6d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:02.028328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cf612-441e-444b-9ee7-9387b04f596e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:02.045119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:02.058196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969d45e-667b-4607-bb88-5e4db8b10c6d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:02.063208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f849c5-1f4b-4071-9ea2-1d9d095e12c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:02.064153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f849c5-1f4b-4071-9ea2-1d9d095e12c0 None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:02.064423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f849c5-1f4b-4071-9ea2-1d9d095e12c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:02.064680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f849c5-1f4b-4071-9ea2-1d9d095e12c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:02.065378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f849c5-1f4b-4071-9ea2-1d9d095e12c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:02.066773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f849c5-1f4b-4071-9ea2-1d9d095e12c0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:02.089072 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 404/828] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 03:59:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:02.090023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f849c5-1f4b-4071-9ea2-1d9d095e12c0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:02.101336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a59bf6-cf78-46ce-9611-c8023915967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:02.102135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a59bf6-cf78-46ce-9611-c8023915967a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:02.102434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a59bf6-cf78-46ce-9611-c8023915967a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:02.102777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a59bf6-cf78-46ce-9611-c8023915967a None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:02.103951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a59bf6-cf78-46ce-9611-c8023915967a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:02.104598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a59bf6-cf78-46ce-9611-c8023915967a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:02.106421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a59bf6-cf78-46ce-9611-c8023915967a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:02.122264 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 425/829] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:02.123159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a59bf6-cf78-46ce-9611-c8023915967a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:02.184730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:02.216636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f849c5-1f4b-4071-9ea2-1d9d095e12c0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:02.241236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a59bf6-cf78-46ce-9611-c8023915967a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:02.257494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebb8d1-171d-46de-8c23-3ea732fd6846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:02.258206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebb8d1-171d-46de-8c23-3ea732fd6846 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:02.258465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebb8d1-171d-46de-8c23-3ea732fd6846 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:02.258755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebb8d1-171d-46de-8c23-3ea732fd6846 None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d7c17b0543d14adda9784af0fd2082d5/roles/a212b3b588c542cca718d55760a48f1f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:02.277908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebb8d1-171d-46de-8c23-3ea732fd6846 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=d7c17b0543d14adda9784af0fd2082d5, role_id=a212b3b588c542cca718d55760a48f1f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:02.279772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebb8d1-171d-46de-8c23-3ea732fd6846 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:02.285407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abe8a7-6243-4b60-91a7-c7691ec0b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:02.286215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe8a7-6243-4b60-91a7-c7691ec0b4e4 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:02.286555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe8a7-6243-4b60-91a7-c7691ec0b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:02.286893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe8a7-6243-4b60-91a7-c7691ec0b4e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:02.287708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abe8a7-6243-4b60-91a7-c7691ec0b4e4 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d3a99d39337841849b3e2efe48ebe53c) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:02.288022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abe8a7-6243-4b60-91a7-c7691ec0b4e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:02.289458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abe8a7-6243-4b60-91a7-c7691ec0b4e4 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:02.295472 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 405/830] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:59:02 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d7c17b0543d14adda9784af0fd2082d5/roles/a212b3b588c542cca718d55760a48f1f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:59:02.296002 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 426/831] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:02 2022] GET /identity/v3/role_assignments?user.id=d3a99d39337841849b3e2efe48ebe53c&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:02.296115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebb8d1-171d-46de-8c23-3ea732fd6846 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:02.332931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:02.434132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebb8d1-171d-46de-8c23-3ea732fd6846 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:02.477308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68049853-dbd7-4b28-9b6c-dec12cf54354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:02.478040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68049853-dbd7-4b28-9b6c-dec12cf54354 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:02.478320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68049853-dbd7-4b28-9b6c-dec12cf54354 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:02.478960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68049853-dbd7-4b28-9b6c-dec12cf54354 None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d9592051e6894c86a699ca2074a32079/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:02.481067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68049853-dbd7-4b28-9b6c-dec12cf54354 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=d9592051e6894c86a699ca2074a32079, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:02.482589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68049853-dbd7-4b28-9b6c-dec12cf54354 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:02.499874 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 406/832] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:59:02 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d9592051e6894c86a699ca2074a32079/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:59:04.074637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a7d57-3ff1-4a88-a274-96e60573d319 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.075673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a7d57-3ff1-4a88-a274-96e60573d319 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.076157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a7d57-3ff1-4a88-a274-96e60573d319 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.077973 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 427/833] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:04.083487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886d11e-2d64-4774-84ee-58dbdaed906f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.084316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886d11e-2d64-4774-84ee-58dbdaed906f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.084810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886d11e-2d64-4774-84ee-58dbdaed906f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.103574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6886d11e-2d64-4774-84ee-58dbdaed906f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:04.105459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6886d11e-2d64-4774-84ee-58dbdaed906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:04.173935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 407/834] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:59:04.272454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f9ea-8e01-4e9d-880b-07f46a11d39f None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.272817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f9ea-8e01-4e9d-880b-07f46a11d39f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.272984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866f9ea-8e01-4e9d-880b-07f46a11d39f None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.274626 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 428/835] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:04.280210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97dedc-9844-4fda-96f7-6b29f2db57f5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.280674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97dedc-9844-4fda-96f7-6b29f2db57f5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.281102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97dedc-9844-4fda-96f7-6b29f2db57f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.306500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0d97dedc-9844-4fda-96f7-6b29f2db57f5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:04.307934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0d97dedc-9844-4fda-96f7-6b29f2db57f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:04.318332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:04.328362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ce576-176e-4102-b9c5-3c5c3f8d63ff None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.329097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ce576-176e-4102-b9c5-3c5c3f8d63ff None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.329645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ce576-176e-4102-b9c5-3c5c3f8d63ff None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.331445 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 429/836] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:59:04.336795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec43f86-c8d6-4047-ac0d-e2ac9a1efafe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.337358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec43f86-c8d6-4047-ac0d-e2ac9a1efafe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.337827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec43f86-c8d6-4047-ac0d-e2ac9a1efafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.360733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-aec43f86-c8d6-4047-ac0d-e2ac9a1efafe None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:04.363539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aec43f86-c8d6-4047-ac0d-e2ac9a1efafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:04.395357 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 408/837] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:59:04.443422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 430/838] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:04.459167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67e112-24a7-45eb-8d28-7baed61684e2 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.459450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67e112-24a7-45eb-8d28-7baed61684e2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.459717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67e112-24a7-45eb-8d28-7baed61684e2 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.461299 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 409/839] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:04.465812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67e112-24a7-45eb-8d28-7baed61684e2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:04.467541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b69568-2ba6-4702-9ebb-79c0719c8dd4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.468058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b69568-2ba6-4702-9ebb-79c0719c8dd4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.468526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b69568-2ba6-4702-9ebb-79c0719c8dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.487537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b3b69568-2ba6-4702-9ebb-79c0719c8dd4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:04.488998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b3b69568-2ba6-4702-9ebb-79c0719c8dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:04.540801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:04.586116 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 431/840] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:04.587094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67e112-24a7-45eb-8d28-7baed61684e2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:04.622440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f1e07-def0-45f8-8a71-50be1edd14c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:04.623411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1e07-def0-45f8-8a71-50be1edd14c8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.623887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1e07-def0-45f8-8a71-50be1edd14c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.624433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1e07-def0-45f8-8a71-50be1edd14c8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.625215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f1e07-def0-45f8-8a71-50be1edd14c8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:04.627005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f1e07-def0-45f8-8a71-50be1edd14c8 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-be5f1e07-def0-45f8-8a71-50be1edd14c8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:04.642071 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:04.643336 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 03:59:04.644192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:04.647000 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 410/841] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:59:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:04.653159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b69568-2ba6-4702-9ebb-79c0719c8dd4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:04.678651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f1e07-def0-45f8-8a71-50be1edd14c8 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:04.694423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:04.769327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b69568-2ba6-4702-9ebb-79c0719c8dd4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:04.787473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f1e07-def0-45f8-8a71-50be1edd14c8 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:04.804729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22178bd1-222d-4aed-9590-f349b8566e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:04.805343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178bd1-222d-4aed-9590-f349b8566e15 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.805616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178bd1-222d-4aed-9590-f349b8566e15 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.805972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178bd1-222d-4aed-9590-f349b8566e15 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.806539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22178bd1-222d-4aed-9590-f349b8566e15 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:04.806839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22178bd1-222d-4aed-9590-f349b8566e15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:04.808210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22178bd1-222d-4aed-9590-f349b8566e15 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:04.813174 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 432/842] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:59:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:04.814293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22178bd1-222d-4aed-9590-f349b8566e15 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:04.823296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84677d-3137-412b-a763-25fb22d83d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:04.823930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84677d-3137-412b-a763-25fb22d83d19 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.824203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84677d-3137-412b-a763-25fb22d83d19 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.824735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84677d-3137-412b-a763-25fb22d83d19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.835503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84677d-3137-412b-a763-25fb22d83d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-8a84677d-3137-412b-a763-25fb22d83d19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:04.841212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:04.842159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 411/843] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 03:59:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:04.843007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84677d-3137-412b-a763-25fb22d83d19 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:04.863031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:04.914553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:04.923671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22178bd1-222d-4aed-9590-f349b8566e15 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:04.949169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84677d-3137-412b-a763-25fb22d83d19 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:04.958496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b315d0-51e7-4d8f-8aeb-d0102e680269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:04.959128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b315d0-51e7-4d8f-8aeb-d0102e680269 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.959387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b315d0-51e7-4d8f-8aeb-d0102e680269 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.959650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b315d0-51e7-4d8f-8aeb-d0102e680269 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.960262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b315d0-51e7-4d8f-8aeb-d0102e680269 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:04.961630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b315d0-51e7-4d8f-8aeb-d0102e680269 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-e5b315d0-51e7-4d8f-8aeb-d0102e680269 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:04.970597 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:04.971707 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:04.972616 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 433/844] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Aug 30 03:59:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:04.973426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b315d0-51e7-4d8f-8aeb-d0102e680269 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:04.986443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c00cf-1bc1-4dd7-aaa6-5bf938a12693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:04.987091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c00cf-1bc1-4dd7-aaa6-5bf938a12693 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:04.987331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c00cf-1bc1-4dd7-aaa6-5bf938a12693 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:04.987645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c00cf-1bc1-4dd7-aaa6-5bf938a12693 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:04.988416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c00cf-1bc1-4dd7-aaa6-5bf938a12693 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:04.988723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c00cf-1bc1-4dd7-aaa6-5bf938a12693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:04.990278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c00cf-1bc1-4dd7-aaa6-5bf938a12693 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:04.995886 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 412/845] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:59:04 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:04.997199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c00cf-1bc1-4dd7-aaa6-5bf938a12693 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.089661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b315d0-51e7-4d8f-8aeb-d0102e680269 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:05.092109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:05.120646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c00cf-1bc1-4dd7-aaa6-5bf938a12693 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:05.135009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466d2f-b556-480f-8ae5-2892caec5417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:05.135636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466d2f-b556-480f-8ae5-2892caec5417 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:05.136060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466d2f-b556-480f-8ae5-2892caec5417 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:05.136193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466d2f-b556-480f-8ae5-2892caec5417 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:05.136827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da466d2f-b556-480f-8ae5-2892caec5417 None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:05.137115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da466d2f-b556-480f-8ae5-2892caec5417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:05.138516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da466d2f-b556-480f-8ae5-2892caec5417 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:05.149733 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 434/846] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 03:59:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:05.150408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466d2f-b556-480f-8ae5-2892caec5417 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.156629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:05.162258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c97a9-9151-4652-8f1a-bcfdae8cb62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:05.162901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c97a9-9151-4652-8f1a-bcfdae8cb62f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:05.163175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c97a9-9151-4652-8f1a-bcfdae8cb62f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:05.163444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c97a9-9151-4652-8f1a-bcfdae8cb62f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:05.177857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c97a9-9151-4652-8f1a-bcfdae8cb62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-138c97a9-9151-4652-8f1a-bcfdae8cb62f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:05.183240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:05.184192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:05.185023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 413/847] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:05.185720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c97a9-9151-4652-8f1a-bcfdae8cb62f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.267644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466d2f-b556-480f-8ae5-2892caec5417 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:05.294000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c97a9-9151-4652-8f1a-bcfdae8cb62f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:05.304766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17ad7-c2b5-45aa-b6d7-d14fd64ec883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:05.305163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17ad7-c2b5-45aa-b6d7-d14fd64ec883 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:05.305439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17ad7-c2b5-45aa-b6d7-d14fd64ec883 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:05.305702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef17ad7-c2b5-45aa-b6d7-d14fd64ec883 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:05.306364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef17ad7-c2b5-45aa-b6d7-d14fd64ec883 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:05.306659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef17ad7-c2b5-45aa-b6d7-d14fd64ec883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:05.308021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef17ad7-c2b5-45aa-b6d7-d14fd64ec883 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:05.312839 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 435/848] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:05.318483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17ad7-c2b5-45aa-b6d7-d14fd64ec883 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.329213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419c20d-a6d8-44a5-b1f4-2ec32fb2023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:05.329844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419c20d-a6d8-44a5-b1f4-2ec32fb2023f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:05.330148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419c20d-a6d8-44a5-b1f4-2ec32fb2023f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:05.330413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419c20d-a6d8-44a5-b1f4-2ec32fb2023f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:05.340968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419c20d-a6d8-44a5-b1f4-2ec32fb2023f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:05.342522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419c20d-a6d8-44a5-b1f4-2ec32fb2023f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:05.348530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-1419c20d-a6d8-44a5-b1f4-2ec32fb2023f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:05.357566 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:05.358707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:05.359713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:05.359713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:05.359713 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:05.359713 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 414/849] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:05.364136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419c20d-a6d8-44a5-b1f4-2ec32fb2023f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.410617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:05.428506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef17ad7-c2b5-45aa-b6d7-d14fd64ec883 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:05.464132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229772-ce93-42de-a3c9-b06164465b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:05.464768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229772-ce93-42de-a3c9-b06164465b89 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:05.465044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229772-ce93-42de-a3c9-b06164465b89 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:05.465304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f229772-ce93-42de-a3c9-b06164465b89 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:05.465975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f229772-ce93-42de-a3c9-b06164465b89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:05.466263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f229772-ce93-42de-a3c9-b06164465b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:05.467620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f229772-ce93-42de-a3c9-b06164465b89 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:05.472225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419c20d-a6d8-44a5-b1f4-2ec32fb2023f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:05.480916 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 436/850] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:59:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:05.480916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229772-ce93-42de-a3c9-b06164465b89 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.510407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacaf0f-d75f-4263-b4f2-e170f3e05613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:05.511409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacaf0f-d75f-4263-b4f2-e170f3e05613 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:05.511679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacaf0f-d75f-4263-b4f2-e170f3e05613 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:05.512199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacaf0f-d75f-4263-b4f2-e170f3e05613 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:05.512856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacaf0f-d75f-4263-b4f2-e170f3e05613 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:05.513385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacaf0f-d75f-4263-b4f2-e170f3e05613 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:05.515552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacaf0f-d75f-4263-b4f2-e170f3e05613 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:05.521009 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 415/851] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:05.522112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacaf0f-d75f-4263-b4f2-e170f3e05613 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.592175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:05.609087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f229772-ce93-42de-a3c9-b06164465b89 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:05.643470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacaf0f-d75f-4263-b4f2-e170f3e05613 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:05.654101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:05.661273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6b705-56b8-45f8-b87a-df074bb0d7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:05.662743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6b705-56b8-45f8-b87a-df074bb0d7cb None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:05.663198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6b705-56b8-45f8-b87a-df074bb0d7cb None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:05.663607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6b705-56b8-45f8-b87a-df074bb0d7cb None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:05.664939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6b705-56b8-45f8-b87a-df074bb0d7cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:05.665645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6b705-56b8-45f8-b87a-df074bb0d7cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:05.667636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6b705-56b8-45f8-b87a-df074bb0d7cb None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:05.686170 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 437/852] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:05.688202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfed5a5-1753-4f69-adc5-c130bfbc11a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:05.688916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed5a5-1753-4f69-adc5-c130bfbc11a4 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:05.689260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed5a5-1753-4f69-adc5-c130bfbc11a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:05.689611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed5a5-1753-4f69-adc5-c130bfbc11a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:05.693086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6b705-56b8-45f8-b87a-df074bb0d7cb None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.712632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfed5a5-1753-4f69-adc5-c130bfbc11a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:05.714518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfed5a5-1753-4f69-adc5-c130bfbc11a4 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3dfed5a5-1753-4f69-adc5-c130bfbc11a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:05.732391 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:05.733496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:05.734685 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:05.734685 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:05.734685 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:05.734685 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 416/853] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:05.741001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfed5a5-1753-4f69-adc5-c130bfbc11a4 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.821784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6b705-56b8-45f8-b87a-df074bb0d7cb None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:05.846511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfed5a5-1753-4f69-adc5-c130bfbc11a4 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:05.860409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc96e82-948d-4ba7-b0ae-3438cb38ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:05.861538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc96e82-948d-4ba7-b0ae-3438cb38ee8e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:05.862056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc96e82-948d-4ba7-b0ae-3438cb38ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:05.862517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc96e82-948d-4ba7-b0ae-3438cb38ee8e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:05.872887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc96e82-948d-4ba7-b0ae-3438cb38ee8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:05.874741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc96e82-948d-4ba7-b0ae-3438cb38ee8e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:05.881086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed61a81-38df-4e30-be4c-bbf5a778ddad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:05.881697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed61a81-38df-4e30-be4c-bbf5a778ddad None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:05.882012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed61a81-38df-4e30-be4c-bbf5a778ddad None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:05.882281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed61a81-38df-4e30-be4c-bbf5a778ddad None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:05.882924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed61a81-38df-4e30-be4c-bbf5a778ddad None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:05.883218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed61a81-38df-4e30-be4c-bbf5a778ddad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:05.884589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed61a81-38df-4e30-be4c-bbf5a778ddad None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-ddc96e82-948d-4ba7-b0ae-3438cb38ee8e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:59:05.890849 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:05.892160 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:05.893114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:05.893114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:05.893114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:05.893114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:05.893114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:05.893114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:05.893114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:05.893114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:05.893114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:59:05.893114 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:05.895786 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 438/854] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 03:59:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:05.901957 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 417/855] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:05.903390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc96e82-948d-4ba7-b0ae-3438cb38ee8e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.905149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed61a81-38df-4e30-be4c-bbf5a778ddad None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:05.917740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:05.927060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:06.007686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed61a81-38df-4e30-be4c-bbf5a778ddad None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:06.023915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc96e82-948d-4ba7-b0ae-3438cb38ee8e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:06.057738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddf55c-a00b-44d4-b2a0-93ef4a11a005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:06.058401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddf55c-a00b-44d4-b2a0-93ef4a11a005 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:06.058666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddf55c-a00b-44d4-b2a0-93ef4a11a005 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:06.058921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddf55c-a00b-44d4-b2a0-93ef4a11a005 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:06.071683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddf55c-a00b-44d4-b2a0-93ef4a11a005 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:06.072017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007e72-7b47-474d-90ab-dd3059496643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:06.072633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007e72-7b47-474d-90ab-dd3059496643 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:06.072901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007e72-7b47-474d-90ab-dd3059496643 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:06.073164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b007e72-7b47-474d-90ab-dd3059496643 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:06.073981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b007e72-7b47-474d-90ab-dd3059496643 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:06.074283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b007e72-7b47-474d-90ab-dd3059496643 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:06.074783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cddf55c-a00b-44d4-b2a0-93ef4a11a005 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:06.075703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b007e72-7b47-474d-90ab-dd3059496643 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-2cddf55c-a00b-44d4-b2a0-93ef4a11a005 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:59:06.091210 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:06.092258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:06.093217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:06.093217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:06.093217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:06.093217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:06.093217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:06.093217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:06.093217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:06.093217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:06.093217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 03:59:06.093217 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:06.100689 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 418/856] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:59:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:06.102945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddf55c-a00b-44d4-b2a0-93ef4a11a005 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:06.108563 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 439/857] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 03:59:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:06.109507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007e72-7b47-474d-90ab-dd3059496643 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:06.184849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:06.210090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:06.233456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cddf55c-a00b-44d4-b2a0-93ef4a11a005 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:06.237669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b007e72-7b47-474d-90ab-dd3059496643 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:06.270196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94a6c-51f6-40d6-85b9-78feae535d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:06.270791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94a6c-51f6-40d6-85b9-78feae535d86 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:06.271071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94a6c-51f6-40d6-85b9-78feae535d86 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:06.271325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e94a6c-51f6-40d6-85b9-78feae535d86 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:06.272036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e94a6c-51f6-40d6-85b9-78feae535d86 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:06.272583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e94a6c-51f6-40d6-85b9-78feae535d86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:06.273763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e94a6c-51f6-40d6-85b9-78feae535d86 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:06.287030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92d17e-e6f0-46be-acb6-9147c3bc37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:06.287964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92d17e-e6f0-46be-acb6-9147c3bc37ac None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:06.288998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92d17e-e6f0-46be-acb6-9147c3bc37ac None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:06.289488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92d17e-e6f0-46be-acb6-9147c3bc37ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:06.296383 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 419/858] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 03:59:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:06.298113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94a6c-51f6-40d6-85b9-78feae535d86 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:06.383639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92d17e-e6f0-46be-acb6-9147c3bc37ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:06.384726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92d17e-e6f0-46be-acb6-9147c3bc37ac None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:06.429815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e94a6c-51f6-40d6-85b9-78feae535d86 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:06.463012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:06.471159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb624444-b9f9-4488-b8a6-005e1b312a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:06.472073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb624444-b9f9-4488-b8a6-005e1b312a7d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:06.472488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb624444-b9f9-4488-b8a6-005e1b312a7d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:06.473001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb624444-b9f9-4488-b8a6-005e1b312a7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:06.483019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:06.515960 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 440/859] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:06.517814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92d17e-e6f0-46be-acb6-9147c3bc37ac None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:06.564776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb624444-b9f9-4488-b8a6-005e1b312a7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:06.566588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb624444-b9f9-4488-b8a6-005e1b312a7d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:06.622861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92d17e-e6f0-46be-acb6-9147c3bc37ac None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:06.661569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbf299-aba8-46cc-b527-93ede5bc2e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:06.662304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbf299-aba8-46cc-b527-93ede5bc2e9c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:06.662575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbf299-aba8-46cc-b527-93ede5bc2e9c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:06.662890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedbf299-aba8-46cc-b527-93ede5bc2e9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:06.683564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbf299-aba8-46cc-b527-93ede5bc2e9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:06.683564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedbf299-aba8-46cc-b527-93ede5bc2e9c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:06.701478 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 420/860] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:06.702489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb624444-b9f9-4488-b8a6-005e1b312a7d None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-aedbf299-aba8-46cc-b527-93ede5bc2e9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:06.703532 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:06.704874 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:06.705768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:06.705768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:06.705768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:06.707334 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 441/861] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:06.712000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbf299-aba8-46cc-b527-93ede5bc2e9c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:06.737719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:06.758715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:06.828565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedbf299-aba8-46cc-b527-93ede5bc2e9c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:06.840779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb624444-b9f9-4488-b8a6-005e1b312a7d None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:06.867409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648b87b-ef4f-4bf9-acfa-2f348a4c19f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:06.868685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648b87b-ef4f-4bf9-acfa-2f348a4c19f3 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:06.869454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648b87b-ef4f-4bf9-acfa-2f348a4c19f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:06.870090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648b87b-ef4f-4bf9-acfa-2f348a4c19f3 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:06.870925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648b87b-ef4f-4bf9-acfa-2f348a4c19f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:06.871476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648b87b-ef4f-4bf9-acfa-2f348a4c19f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:06.873180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648b87b-ef4f-4bf9-acfa-2f348a4c19f3 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:06.885585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60ac5-4d64-403f-a27b-75807f594d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:06.886363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60ac5-4d64-403f-a27b-75807f594d67 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:06.886640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60ac5-4d64-403f-a27b-75807f594d67 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:06.886909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c60ac5-4d64-403f-a27b-75807f594d67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:06.893226 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 442/862] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:06.894470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648b87b-ef4f-4bf9-acfa-2f348a4c19f3 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:06.899755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c60ac5-4d64-403f-a27b-75807f594d67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:06.901238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c60ac5-4d64-403f-a27b-75807f594d67 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-41c60ac5-4d64-403f-a27b-75807f594d67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:06.920656 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:06.921655 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:06.922609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:06.922609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:06.922609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:06.922609 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 421/863] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:06.927681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60ac5-4d64-403f-a27b-75807f594d67 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:06.995376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.016543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648b87b-ef4f-4bf9-acfa-2f348a4c19f3 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:07.026830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.038103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c60ac5-4d64-403f-a27b-75807f594d67 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:07.055804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fea9b-fa3c-4639-821d-b5ab9b1a740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:07.056575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fea9b-fa3c-4639-821d-b5ab9b1a740e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.056941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fea9b-fa3c-4639-821d-b5ab9b1a740e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.057301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fea9b-fa3c-4639-821d-b5ab9b1a740e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.064336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fea9b-fa3c-4639-821d-b5ab9b1a740e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:07.065937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505fea9b-fa3c-4639-821d-b5ab9b1a740e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:07.075053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b287b-59eb-4834-b7bd-aa7b73f0af19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:07.075906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b287b-59eb-4834-b7bd-aa7b73f0af19 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.076325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b287b-59eb-4834-b7bd-aa7b73f0af19 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.076750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b287b-59eb-4834-b7bd-aa7b73f0af19 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.077534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b287b-59eb-4834-b7bd-aa7b73f0af19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-505fea9b-fa3c-4639-821d-b5ab9b1a740e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:07.077675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:07.078664 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:07.079865 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:07.079865 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:07.079865 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:07.079865 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:07.079865 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:07.079865 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:07.079865 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:07.079865 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:07.079865 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 443/864] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:07.080733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b287b-59eb-4834-b7bd-aa7b73f0af19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:07.080832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11555-ee8a-4c9a-9558-906858ee1d52 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.081080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11555-ee8a-4c9a-9558-906858ee1d52 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.081347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11555-ee8a-4c9a-9558-906858ee1d52 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.082679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b287b-59eb-4834-b7bd-aa7b73f0af19 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:07.082852 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 444/865] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:07.088539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11555-ee8a-4c9a-9558-906858ee1d52 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:07.104587 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 422/866] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:07.106096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb38f7-9b24-4d82-9a50-3a946a96a8e2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.106450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb38f7-9b24-4d82-9a50-3a946a96a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.106791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddb38f7-9b24-4d82-9a50-3a946a96a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.125409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-eddb38f7-9b24-4d82-9a50-3a946a96a8e2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:07.126814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eddb38f7-9b24-4d82-9a50-3a946a96a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:07.199313 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 423/867] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:07.200459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb38f7-9b24-4d82-9a50-3a946a96a8e2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:07.209114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11555-ee8a-4c9a-9558-906858ee1d52 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:07.243891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad41a-9016-4173-9471-3d6522efd644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:07.244490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad41a-9016-4173-9471-3d6522efd644 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.244769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad41a-9016-4173-9471-3d6522efd644 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.245037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ad41a-9016-4173-9471-3d6522efd644 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.245840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad41a-9016-4173-9471-3d6522efd644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:07.246114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad41a-9016-4173-9471-3d6522efd644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:07.247605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ad41a-9016-4173-9471-3d6522efd644 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:07.257028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.265656 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 445/868] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:07.266923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad41a-9016-4173-9471-3d6522efd644 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:07.310316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.336546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddb38f7-9b24-4d82-9a50-3a946a96a8e2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:07.378973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ad41a-9016-4173-9471-3d6522efd644 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:07.380904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce796cc4-3b99-462a-884e-5c6eb95312ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:07.382748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce796cc4-3b99-462a-884e-5c6eb95312ba None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.383185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce796cc4-3b99-462a-884e-5c6eb95312ba None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.383616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce796cc4-3b99-462a-884e-5c6eb95312ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.393197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce796cc4-3b99-462a-884e-5c6eb95312ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:07.395865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce796cc4-3b99-462a-884e-5c6eb95312ba None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-ce796cc4-3b99-462a-884e-5c6eb95312ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:07.412301 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:07.413423 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:07.414556 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:07.414556 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:07.414556 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:07.414556 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:07.414556 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:07.414556 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:07.414556 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:07.414556 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:07.421413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb05d7b-805f-46f2-b21e-c1b98f67f1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:07.421413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb05d7b-805f-46f2-b21e-c1b98f67f1b8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.421413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb05d7b-805f-46f2-b21e-c1b98f67f1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.421413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb05d7b-805f-46f2-b21e-c1b98f67f1b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.422369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb05d7b-805f-46f2-b21e-c1b98f67f1b8 None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d7c17b0543d14adda9784af0fd2082d5) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:07.422604 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 424/869] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:07.422844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb05d7b-805f-46f2-b21e-c1b98f67f1b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:07.423746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce796cc4-3b99-462a-884e-5c6eb95312ba None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:07.424641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb05d7b-805f-46f2-b21e-c1b98f67f1b8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:07.438055 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 446/870] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:07 2022] GET /identity/v3/role_assignments?user.id=d7c17b0543d14adda9784af0fd2082d5&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:07.501024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb05d7b-805f-46f2-b21e-c1b98f67f1b8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:07.544804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce796cc4-3b99-462a-884e-5c6eb95312ba None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:07.575234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.585405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965cd24-e0cc-4a85-8d3f-c83d81404759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:07.586334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965cd24-e0cc-4a85-8d3f-c83d81404759 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.586771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965cd24-e0cc-4a85-8d3f-c83d81404759 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.587043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965cd24-e0cc-4a85-8d3f-c83d81404759 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.587784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965cd24-e0cc-4a85-8d3f-c83d81404759 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:07.588446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965cd24-e0cc-4a85-8d3f-c83d81404759 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:07.589536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965cd24-e0cc-4a85-8d3f-c83d81404759 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:07.600547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.605442 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 425/871] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:07.607032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f05ce-02fa-46ce-b2b8-a9a053a93130 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.607312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f05ce-02fa-46ce-b2b8-a9a053a93130 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.607580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f05ce-02fa-46ce-b2b8-a9a053a93130 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.608908 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 426/872] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:07.614523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a59e-f928-4426-b107-c2c12a12979d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.614523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a59e-f928-4426-b107-c2c12a12979d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.614786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150a59e-f928-4426-b107-c2c12a12979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.625102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb05d7b-805f-46f2-b21e-c1b98f67f1b8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:07.634373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5150a59e-f928-4426-b107-c2c12a12979d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:07.635584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5150a59e-f928-4426-b107-c2c12a12979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:07.672308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f117c8-80c5-4c79-8a0a-bb601b966ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:07.673293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f117c8-80c5-4c79-8a0a-bb601b966ca2 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.673720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f117c8-80c5-4c79-8a0a-bb601b966ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.674155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f117c8-80c5-4c79-8a0a-bb601b966ca2 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.674989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f117c8-80c5-4c79-8a0a-bb601b966ca2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:07.676374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f117c8-80c5-4c79-8a0a-bb601b966ca2 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:07.693337 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 447/873] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:59:07 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 03:59:07.698621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f117c8-80c5-4c79-8a0a-bb601b966ca2 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:07.716046 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 427/874] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:07 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:07.827250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f117c8-80c5-4c79-8a0a-bb601b966ca2 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:07.860867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.871737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ff025-cd26-49fc-b4d5-cb5bfc60e25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:07.874100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff025-cd26-49fc-b4d5-cb5bfc60e25a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:07.874100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff025-cd26-49fc-b4d5-cb5bfc60e25a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:07.874100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ff025-cd26-49fc-b4d5-cb5bfc60e25a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:07.874100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ff025-cd26-49fc-b4d5-cb5bfc60e25a None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d9592051e6894c86a699ca2074a32079) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:07.874100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ff025-cd26-49fc-b4d5-cb5bfc60e25a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:07.875377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ff025-cd26-49fc-b4d5-cb5bfc60e25a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:07.883327 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 448/875] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:07 2022] GET /identity/v3/role_assignments?user.id=d9592051e6894c86a699ca2074a32079&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:08.012508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150a59e-f928-4426-b107-c2c12a12979d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:08.131714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150a59e-f928-4426-b107-c2c12a12979d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:08.161472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:08.173274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde97b90-0a70-4905-852a-20dee1de2f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:08.173919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde97b90-0a70-4905-852a-20dee1de2f3d None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:08.174200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde97b90-0a70-4905-852a-20dee1de2f3d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:08.174469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde97b90-0a70-4905-852a-20dee1de2f3d None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:08.175141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde97b90-0a70-4905-852a-20dee1de2f3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:08.176525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde97b90-0a70-4905-852a-20dee1de2f3d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:08.204046 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 428/876] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:59:08 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:09.546915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e66004-81ea-4ae0-9e5d-20f1d580c459 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:09.547447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e66004-81ea-4ae0-9e5d-20f1d580c459 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:09.547447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e66004-81ea-4ae0-9e5d-20f1d580c459 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:09.549357 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 449/877] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:09.554626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c4d15-6aa6-4353-a3f8-8bbface79801 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:09.555038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c4d15-6aa6-4353-a3f8-8bbface79801 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:09.555249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c4d15-6aa6-4353-a3f8-8bbface79801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:09.573628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ba4c4d15-6aa6-4353-a3f8-8bbface79801 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:09.574859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ba4c4d15-6aa6-4353-a3f8-8bbface79801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:09.656503 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 429/878] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:09.831079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c916b8-bcd6-48eb-a3c0-06ea47ebafc7 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:09.831257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c916b8-bcd6-48eb-a3c0-06ea47ebafc7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:09.831528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c916b8-bcd6-48eb-a3c0-06ea47ebafc7 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:09.833100 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 450/879] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:09.838528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f2380-97d8-482a-95d5-977c06db0680 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:09.838810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f2380-97d8-482a-95d5-977c06db0680 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:09.839079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f2380-97d8-482a-95d5-977c06db0680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:09.857863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-276f2380-97d8-482a-95d5-977c06db0680 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:09.859095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-276f2380-97d8-482a-95d5-977c06db0680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:09.926685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c916b8-bcd6-48eb-a3c0-06ea47ebafc7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:09.930783 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 430/880] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:09.973475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65b79c-8e51-4c51-b8aa-bb0813bfbfd0 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:09.974166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65b79c-8e51-4c51-b8aa-bb0813bfbfd0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:09.974647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65b79c-8e51-4c51-b8aa-bb0813bfbfd0 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:09.977530 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 431/881] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:59:09.982349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92f3b5-c8a9-4e07-9101-69468fcc0cd5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:09.982877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92f3b5-c8a9-4e07-9101-69468fcc0cd5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:09.983337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92f3b5-c8a9-4e07-9101-69468fcc0cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.002644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3a92f3b5-c8a9-4e07-9101-69468fcc0cd5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:10.004143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3a92f3b5-c8a9-4e07-9101-69468fcc0cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:10.031804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c916b8-bcd6-48eb-a3c0-06ea47ebafc7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:10.043121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:10.072629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947117c-ab6e-4300-8deb-5e255dbde6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:10.073676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947117c-ab6e-4300-8deb-5e255dbde6ea None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.074164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947117c-ab6e-4300-8deb-5e255dbde6ea None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.074687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947117c-ab6e-4300-8deb-5e255dbde6ea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.089975 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 432/882] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:09 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:59:10.090142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947117c-ab6e-4300-8deb-5e255dbde6ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-7947117c-ab6e-4300-8deb-5e255dbde6ea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:10.094010 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:10.095070 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:10.096364 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 451/883] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 03:59:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:10.101678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92f3b5-c8a9-4e07-9101-69468fcc0cd5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.198968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947117c-ab6e-4300-8deb-5e255dbde6ea None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.204230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92f3b5-c8a9-4e07-9101-69468fcc0cd5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:10.241851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03172bae-a8df-49d2-b815-351961d63d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:10.242679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172bae-a8df-49d2-b815-351961d63d3e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.242957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172bae-a8df-49d2-b815-351961d63d3e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.243221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172bae-a8df-49d2-b815-351961d63d3e None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.243893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03172bae-a8df-49d2-b815-351961d63d3e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:10.244191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03172bae-a8df-49d2-b815-351961d63d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:10.245571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03172bae-a8df-49d2-b815-351961d63d3e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:10.250239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:10.254905 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 433/884] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:10.256161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2c0b-f7bf-4185-990b-bef417e5bd8c None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.256439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2c0b-f7bf-4185-990b-bef417e5bd8c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.256709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2c0b-f7bf-4185-990b-bef417e5bd8c None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.258058 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 434/885] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:10.262595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d2c0b-f7bf-4185-990b-bef417e5bd8c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.299644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:10.310889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947117c-ab6e-4300-8deb-5e255dbde6ea None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:10.346387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd741aa5-fb2d-47ac-8870-b41f6810f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:10.346962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd741aa5-fb2d-47ac-8870-b41f6810f7bc None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.347236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd741aa5-fb2d-47ac-8870-b41f6810f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.347465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd741aa5-fb2d-47ac-8870-b41f6810f7bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.348055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd741aa5-fb2d-47ac-8870-b41f6810f7bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:10.349458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd741aa5-fb2d-47ac-8870-b41f6810f7bc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-bd741aa5-fb2d-47ac-8870-b41f6810f7bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:10.358744 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:10.359774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:10.360782 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 452/886] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:10.361607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55607bcb-c5e6-46d7-a168-207aa13ccde9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.361607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55607bcb-c5e6-46d7-a168-207aa13ccde9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.361742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55607bcb-c5e6-46d7-a168-207aa13ccde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.374094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d2c0b-f7bf-4185-990b-bef417e5bd8c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:10.379309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-55607bcb-c5e6-46d7-a168-207aa13ccde9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:10.380504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-55607bcb-c5e6-46d7-a168-207aa13ccde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:10.406936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911bbb-a18b-440a-8245-dfda466d4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:10.407642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911bbb-a18b-440a-8245-dfda466d4430 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.407932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911bbb-a18b-440a-8245-dfda466d4430 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.408213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911bbb-a18b-440a-8245-dfda466d4430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.418300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911bbb-a18b-440a-8245-dfda466d4430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:10.419742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911bbb-a18b-440a-8245-dfda466d4430 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-15911bbb-a18b-440a-8245-dfda466d4430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:10.433603 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:10.434695 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:10.436043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:10.436043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:10.436043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:10.436043 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 435/887] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:10.436043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911bbb-a18b-440a-8245-dfda466d4430 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.450847 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 453/888] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:10.451722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55607bcb-c5e6-46d7-a168-207aa13ccde9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.511984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:10.528616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:10.544589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911bbb-a18b-440a-8245-dfda466d4430 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:10.574627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55607bcb-c5e6-46d7-a168-207aa13ccde9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:10.581172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2faa3-eb60-4172-a7c9-443cda387708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:10.581814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2faa3-eb60-4172-a7c9-443cda387708 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.582110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2faa3-eb60-4172-a7c9-443cda387708 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.582376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2faa3-eb60-4172-a7c9-443cda387708 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.582965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2faa3-eb60-4172-a7c9-443cda387708 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:10.584337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2faa3-eb60-4172-a7c9-443cda387708 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-2bc2faa3-eb60-4172-a7c9-443cda387708 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:10.593161 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:10.594179 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:10.595285 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 436/889] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:10.596483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2faa3-eb60-4172-a7c9-443cda387708 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.614306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47846e2a-9da3-46be-89c5-0b0f643205dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:10.615085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47846e2a-9da3-46be-89c5-0b0f643205dc None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.615369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47846e2a-9da3-46be-89c5-0b0f643205dc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.615636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47846e2a-9da3-46be-89c5-0b0f643205dc None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.616267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47846e2a-9da3-46be-89c5-0b0f643205dc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:10.616566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47846e2a-9da3-46be-89c5-0b0f643205dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:10.617957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47846e2a-9da3-46be-89c5-0b0f643205dc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:10.622991 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 454/890] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:10.623839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47846e2a-9da3-46be-89c5-0b0f643205dc None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.711804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2faa3-eb60-4172-a7c9-443cda387708 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:10.730250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47846e2a-9da3-46be-89c5-0b0f643205dc None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:10.737583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:10.746231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f377e-66dc-4ac7-af30-0f4af02a354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:10.746841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f377e-66dc-4ac7-af30-0f4af02a354c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.747118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f377e-66dc-4ac7-af30-0f4af02a354c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.747376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f377e-66dc-4ac7-af30-0f4af02a354c None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.748012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f377e-66dc-4ac7-af30-0f4af02a354c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:10.748300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f377e-66dc-4ac7-af30-0f4af02a354c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:10.749665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f377e-66dc-4ac7-af30-0f4af02a354c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:10.761007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 437/891] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:10.761790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f377e-66dc-4ac7-af30-0f4af02a354c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.764417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286b137-548a-42b5-b277-7396342aec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:10.765023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286b137-548a-42b5-b277-7396342aec0c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.765291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286b137-548a-42b5-b277-7396342aec0c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.765645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286b137-548a-42b5-b277-7396342aec0c None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.766357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286b137-548a-42b5-b277-7396342aec0c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:10.766986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286b137-548a-42b5-b277-7396342aec0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:10.768068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286b137-548a-42b5-b277-7396342aec0c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:10.772878 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 455/892] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:10.773650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286b137-548a-42b5-b277-7396342aec0c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.776188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:10.869192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f377e-66dc-4ac7-af30-0f4af02a354c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:10.891117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286b137-548a-42b5-b277-7396342aec0c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:10.902997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f342a-8793-47e1-a113-995fc76d1d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:10.903602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f342a-8793-47e1-a113-995fc76d1d14 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.903872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f342a-8793-47e1-a113-995fc76d1d14 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.904121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f342a-8793-47e1-a113-995fc76d1d14 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.904734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f342a-8793-47e1-a113-995fc76d1d14 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:10.905027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f342a-8793-47e1-a113-995fc76d1d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:10.906451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f342a-8793-47e1-a113-995fc76d1d14 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:10.911172 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 438/893] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:10.912095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f342a-8793-47e1-a113-995fc76d1d14 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.925994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2faf06-600f-4962-ae20-2a98c1cec6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:10.926622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2faf06-600f-4962-ae20-2a98c1cec6d7 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:10.926899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2faf06-600f-4962-ae20-2a98c1cec6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:10.927161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2faf06-600f-4962-ae20-2a98c1cec6d7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:10.927748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2faf06-600f-4962-ae20-2a98c1cec6d7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:10.929111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2faf06-600f-4962-ae20-2a98c1cec6d7 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-1c2faf06-600f-4962-ae20-2a98c1cec6d7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:10.937700 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:10.938779 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:10.939690 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 456/894] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:10.940478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2faf06-600f-4962-ae20-2a98c1cec6d7 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:10.980372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:10.993506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:11.020507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f342a-8793-47e1-a113-995fc76d1d14 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.047216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2faf06-600f-4962-ae20-2a98c1cec6d7 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.054012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2fbbc-bbd4-40cc-90f8-ee90e49683b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.054645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2fbbc-bbd4-40cc-90f8-ee90e49683b1 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.054921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2fbbc-bbd4-40cc-90f8-ee90e49683b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.055315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2fbbc-bbd4-40cc-90f8-ee90e49683b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.064028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2fbbc-bbd4-40cc-90f8-ee90e49683b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.065506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2fbbc-bbd4-40cc-90f8-ee90e49683b1 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-fcb2fbbc-bbd4-40cc-90f8-ee90e49683b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:59:11.077010 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:11.077997 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 439/895] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:11.079494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2fbbc-bbd4-40cc-90f8-ee90e49683b1 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:11.085688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29954d-88cd-47d2-9a78-187d51c439bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.086444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29954d-88cd-47d2-9a78-187d51c439bf None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.086720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29954d-88cd-47d2-9a78-187d51c439bf None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.086988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29954d-88cd-47d2-9a78-187d51c439bf None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.087630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29954d-88cd-47d2-9a78-187d51c439bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:11.087907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29954d-88cd-47d2-9a78-187d51c439bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.089313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29954d-88cd-47d2-9a78-187d51c439bf None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:11.094250 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 457/896] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 03:59:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:11.095518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29954d-88cd-47d2-9a78-187d51c439bf None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:11.205556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2fbbc-bbd4-40cc-90f8-ee90e49683b1 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.212078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:11.217125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29954d-88cd-47d2-9a78-187d51c439bf None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.244922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547644b-a609-4c0b-8509-2540b72685d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.245537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547644b-a609-4c0b-8509-2540b72685d6 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.245814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547644b-a609-4c0b-8509-2540b72685d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.246109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7547644b-a609-4c0b-8509-2540b72685d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.247597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547644b-a609-4c0b-8509-2540b72685d6 None admin] RBAC: Adding query filter params (interface=public, service_id=5660c1ce92604cb5b0ec4c9a0e9c345f, region_id=RegionOne) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:11.247597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547644b-a609-4c0b-8509-2540b72685d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.248550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7547644b-a609-4c0b-8509-2540b72685d6 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:11.250129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:11.255815 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 440/897] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 03:59:11 2022] GET /identity/v3/endpoints?service_id=5660c1ce92604cb5b0ec4c9a0e9c345f&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:11.256490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547644b-a609-4c0b-8509-2540b72685d6 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:11.259585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb20b4-e11b-4683-96a7-eb3ff4a9a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.260406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb20b4-e11b-4683-96a7-eb3ff4a9a7de None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.260487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb20b4-e11b-4683-96a7-eb3ff4a9a7de None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.260742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb20b4-e11b-4683-96a7-eb3ff4a9a7de None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.261455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb20b4-e11b-4683-96a7-eb3ff4a9a7de None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:11.261752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb20b4-e11b-4683-96a7-eb3ff4a9a7de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.263576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb20b4-e11b-4683-96a7-eb3ff4a9a7de None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:11.268425 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 458/898] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:11.269241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb20b4-e11b-4683-96a7-eb3ff4a9a7de None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:11.374535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb20b4-e11b-4683-96a7-eb3ff4a9a7de None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.377529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7547644b-a609-4c0b-8509-2540b72685d6 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.411502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b5985-d9b0-47c4-9a97-aa7bb06ec4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.412114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b5985-d9b0-47c4-9a97-aa7bb06ec4dd None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.412398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b5985-d9b0-47c4-9a97-aa7bb06ec4dd None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.412663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b5985-d9b0-47c4-9a97-aa7bb06ec4dd None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.413397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b5985-d9b0-47c4-9a97-aa7bb06ec4dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:11.413698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b5985-d9b0-47c4-9a97-aa7bb06ec4dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.414240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455800-5909-40de-9025-5a7e726ac1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.415014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455800-5909-40de-9025-5a7e726ac1f2 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.415171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b5985-d9b0-47c4-9a97-aa7bb06ec4dd None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:11.415562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455800-5909-40de-9025-5a7e726ac1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.415990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455800-5909-40de-9025-5a7e726ac1f2 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.416853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455800-5909-40de-9025-5a7e726ac1f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.418479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455800-5909-40de-9025-5a7e726ac1f2 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:11.424831 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 459/899] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 03:59:11 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 03:59:11.425791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455800-5909-40de-9025-5a7e726ac1f2 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:11.445420 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 441/900] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 03:59:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:11.450850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b5985-d9b0-47c4-9a97-aa7bb06ec4dd None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:11.462932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:11.523692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:11.564335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455800-5909-40de-9025-5a7e726ac1f2 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.583540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b5985-d9b0-47c4-9a97-aa7bb06ec4dd None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.608237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45ff88-d27e-4ab7-ba55-8cd828fa075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.608926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ff88-d27e-4ab7-ba55-8cd828fa075e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.609123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ff88-d27e-4ab7-ba55-8cd828fa075e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.609391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ff88-d27e-4ab7-ba55-8cd828fa075e None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.610350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45ff88-d27e-4ab7-ba55-8cd828fa075e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:11.611743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45ff88-d27e-4ab7-ba55-8cd828fa075e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.612316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45ff88-d27e-4ab7-ba55-8cd828fa075e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:11.617679 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 460/901] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:11.625504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45ff88-d27e-4ab7-ba55-8cd828fa075e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:11.630633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a280c7-6653-41fe-ba9e-6e527301311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.631260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a280c7-6653-41fe-ba9e-6e527301311b None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.631530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a280c7-6653-41fe-ba9e-6e527301311b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.637327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a280c7-6653-41fe-ba9e-6e527301311b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.707975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a280c7-6653-41fe-ba9e-6e527301311b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.709140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a280c7-6653-41fe-ba9e-6e527301311b None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:11.734370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:11.746975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45ff88-d27e-4ab7-ba55-8cd828fa075e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.769892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:11.794768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192340d-d0e0-49df-8f47-7296b9d5708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.796372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192340d-d0e0-49df-8f47-7296b9d5708c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.796883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192340d-d0e0-49df-8f47-7296b9d5708c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.797365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192340d-d0e0-49df-8f47-7296b9d5708c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.799475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192340d-d0e0-49df-8f47-7296b9d5708c None admin] RBAC: Adding query filter params (interface=public, service_id=93ccd1c7a9654aa2b7cc95e47d571d32, region_id=RegionOne) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:11.800249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192340d-d0e0-49df-8f47-7296b9d5708c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.802104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192340d-d0e0-49df-8f47-7296b9d5708c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:11.814568 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 461/902] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 03:59:11 2022] GET /identity/v3/endpoints?service_id=93ccd1c7a9654aa2b7cc95e47d571d32&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:11.815798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192340d-d0e0-49df-8f47-7296b9d5708c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:11.819268 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 442/903] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:11 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 03:59:11.824895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a280c7-6653-41fe-ba9e-6e527301311b None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:11.930472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192340d-d0e0-49df-8f47-7296b9d5708c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.934583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a280c7-6653-41fe-ba9e-6e527301311b None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:11.969077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d387abd-1a42-4dc0-ae1a-5d29e0356853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.969696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d387abd-1a42-4dc0-ae1a-5d29e0356853 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.970116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d387abd-1a42-4dc0-ae1a-5d29e0356853 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.970645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d387abd-1a42-4dc0-ae1a-5d29e0356853 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.971268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d387abd-1a42-4dc0-ae1a-5d29e0356853 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.972648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d387abd-1a42-4dc0-ae1a-5d29e0356853 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:11.981594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421f815-2e1e-49ef-b4ba-1cd2ad3b21a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:11.982543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421f815-2e1e-49ef-b4ba-1cd2ad3b21a7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:11.983021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421f815-2e1e-49ef-b4ba-1cd2ad3b21a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:11.983505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421f815-2e1e-49ef-b4ba-1cd2ad3b21a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:11.986373 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 462/904] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 03:59:11 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 03:59:11.996649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421f815-2e1e-49ef-b4ba-1cd2ad3b21a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:11.998566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421f815-2e1e-49ef-b4ba-1cd2ad3b21a7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-0421f815-2e1e-49ef-b4ba-1cd2ad3b21a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:12.016438 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:12.017534 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:12.018891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:12.018891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:12.018891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:12.020819 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 443/905] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:12.026957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d387abd-1a42-4dc0-ae1a-5d29e0356853 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:12.051753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:12.145317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d387abd-1a42-4dc0-ae1a-5d29e0356853 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:12.183318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14632553-1aba-4b2a-9dfd-f514a1142501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:12.183950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14632553-1aba-4b2a-9dfd-f514a1142501 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:12.184225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14632553-1aba-4b2a-9dfd-f514a1142501 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:12.184494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14632553-1aba-4b2a-9dfd-f514a1142501 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:12.185160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14632553-1aba-4b2a-9dfd-f514a1142501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:12.185459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14632553-1aba-4b2a-9dfd-f514a1142501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:12.186929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14632553-1aba-4b2a-9dfd-f514a1142501 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:12.200390 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 463/906] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:12.206194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421f815-2e1e-49ef-b4ba-1cd2ad3b21a7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:12.218336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:12.309400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421f815-2e1e-49ef-b4ba-1cd2ad3b21a7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:12.345818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7ad5f-ee89-49b0-b6ab-83dbc591a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:12.345818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7ad5f-ee89-49b0-b6ab-83dbc591a387 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:12.345818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7ad5f-ee89-49b0-b6ab-83dbc591a387 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:12.345818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7ad5f-ee89-49b0-b6ab-83dbc591a387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:12.353167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7ad5f-ee89-49b0-b6ab-83dbc591a387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:12.355329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7ad5f-ee89-49b0-b6ab-83dbc591a387 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-c1c7ad5f-ee89-49b0-b6ab-83dbc591a387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:12.367738 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:12.368694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:12.369600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:12.369600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:12.369600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:12.369600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:12.369600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:12.369600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:12.369600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:12.369600 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:12.372035 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 444/907] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:12.378121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14632553-1aba-4b2a-9dfd-f514a1142501 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:12.458927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:12.482442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14632553-1aba-4b2a-9dfd-f514a1142501 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:12.521247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28afa5c-a6af-4024-b694-3ceeb0aa31b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:12.521953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28afa5c-a6af-4024-b694-3ceeb0aa31b7 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:12.522292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28afa5c-a6af-4024-b694-3ceeb0aa31b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:12.522610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28afa5c-a6af-4024-b694-3ceeb0aa31b7 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:12.523373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28afa5c-a6af-4024-b694-3ceeb0aa31b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:12.523728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28afa5c-a6af-4024-b694-3ceeb0aa31b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:12.525179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28afa5c-a6af-4024-b694-3ceeb0aa31b7 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:12.539425 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 464/908] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:12.545605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7ad5f-ee89-49b0-b6ab-83dbc591a387 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:12.615813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:12.649587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7ad5f-ee89-49b0-b6ab-83dbc591a387 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:12.684395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c18c37-f78c-44b7-967c-a2c9db529209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:12.685005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c18c37-f78c-44b7-967c-a2c9db529209 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:12.685281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c18c37-f78c-44b7-967c-a2c9db529209 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:12.685554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c18c37-f78c-44b7-967c-a2c9db529209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:12.686308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c18c37-f78c-44b7-967c-a2c9db529209 None admin] RBAC: Adding query filter params (role.id=c0df7bf5ce494e0ab735be8639aec320, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d7c17b0543d14adda9784af0fd2082d5) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:12.686613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c18c37-f78c-44b7-967c-a2c9db529209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:12.688060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c18c37-f78c-44b7-967c-a2c9db529209 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:12.694535 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 445/909] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:12 2022] GET /identity/v3/role_assignments?user.id=d7c17b0543d14adda9784af0fd2082d5&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=c0df7bf5ce494e0ab735be8639aec320 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:13.050292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829ebb9-d6a2-4a3e-a227-c5104f311f95 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:13.050908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829ebb9-d6a2-4a3e-a227-c5104f311f95 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:13.050908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829ebb9-d6a2-4a3e-a227-c5104f311f95 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:13.052440 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 465/910] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:13.057838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0149-391c-4d34-9f4d-248595bb0e4e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:13.058432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0149-391c-4d34-9f4d-248595bb0e4e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:13.058925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0149-391c-4d34-9f4d-248595bb0e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:13.077851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-513c0149-391c-4d34-9f4d-248595bb0e4e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:13.079408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-513c0149-391c-4d34-9f4d-248595bb0e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:13.155558 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 446/911] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:13.414284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbb4ee-3245-4967-b7b2-af8552101fca None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:13.414478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbb4ee-3245-4967-b7b2-af8552101fca None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:13.414752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbb4ee-3245-4967-b7b2-af8552101fca None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:13.416221 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 466/912] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:13.421570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4238-ad2e-440c-82e5-80fd51d30c43 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:13.422164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4238-ad2e-440c-82e5-80fd51d30c43 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:13.422664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a4238-ad2e-440c-82e5-80fd51d30c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:13.441394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbb4ee-3245-4967-b7b2-af8552101fca None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:13.441839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bf9a4238-ad2e-440c-82e5-80fd51d30c43 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:13.443268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bf9a4238-ad2e-440c-82e5-80fd51d30c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:13.533899 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 447/913] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:13.533899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:13.554550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbb4ee-3245-4967-b7b2-af8552101fca None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:13.589902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b03c5a-35c6-4283-bbff-02ef32cc869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:13.590532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b03c5a-35c6-4283-bbff-02ef32cc869a None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:13.590801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b03c5a-35c6-4283-bbff-02ef32cc869a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:13.591063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b03c5a-35c6-4283-bbff-02ef32cc869a None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:13.591713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b03c5a-35c6-4283-bbff-02ef32cc869a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:13.593091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b03c5a-35c6-4283-bbff-02ef32cc869a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:13.604267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:13.616138 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 467/914] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:59:13 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 03:59:13.816969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a4238-ad2e-440c-82e5-80fd51d30c43 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:13.919014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a4238-ad2e-440c-82e5-80fd51d30c43 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:13.959773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b4dcf-e114-4b10-aa94-ab9b33214a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:13.960826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b4dcf-e114-4b10-aa94-ab9b33214a19 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:13.961457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b4dcf-e114-4b10-aa94-ab9b33214a19 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:13.961960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b4dcf-e114-4b10-aa94-ab9b33214a19 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:13.962750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b4dcf-e114-4b10-aa94-ab9b33214a19 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:13.964390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b4dcf-e114-4b10-aa94-ab9b33214a19 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-318b4dcf-e114-4b10-aa94-ab9b33214a19 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:13.973942 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:13.975043 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 03:59:13.975968 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:13.978741 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 448/915] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:59:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:13.985287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b03c5a-35c6-4283-bbff-02ef32cc869a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:14.002533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c4107-f826-4e61-88e7-afa32d75c32f None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:14.003202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c4107-f826-4e61-88e7-afa32d75c32f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:14.003758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c4107-f826-4e61-88e7-afa32d75c32f None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:14.005719 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 449/916] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:14.011175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993fee9-1615-4dae-b739-fbcd91a9782c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:14.011816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993fee9-1615-4dae-b739-fbcd91a9782c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:14.012674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993fee9-1615-4dae-b739-fbcd91a9782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:14.039614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9993fee9-1615-4dae-b739-fbcd91a9782c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:14.041457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9993fee9-1615-4dae-b739-fbcd91a9782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:14.100583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b03c5a-35c6-4283-bbff-02ef32cc869a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:14.111048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:14.138912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf98921-5c29-4ddb-9d9e-48d96453f5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:14.139500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf98921-5c29-4ddb-9d9e-48d96453f5e6 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:14.139688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf98921-5c29-4ddb-9d9e-48d96453f5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:14.139884 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 450/917] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:59:14.139989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf98921-5c29-4ddb-9d9e-48d96453f5e6 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:14.140564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf98921-5c29-4ddb-9d9e-48d96453f5e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:14.140856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf98921-5c29-4ddb-9d9e-48d96453f5e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:14.145956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf98921-5c29-4ddb-9d9e-48d96453f5e6 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:14.150623 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 468/918] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:59:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:14.159816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993fee9-1615-4dae-b739-fbcd91a9782c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:14.262557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993fee9-1615-4dae-b739-fbcd91a9782c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:14.297301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472ae93-75c5-4ce6-9404-54a6d4a45839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:14.297945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472ae93-75c5-4ce6-9404-54a6d4a45839 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:14.298223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472ae93-75c5-4ce6-9404-54a6d4a45839 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:14.298523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472ae93-75c5-4ce6-9404-54a6d4a45839 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:14.299282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472ae93-75c5-4ce6-9404-54a6d4a45839 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:14.299610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472ae93-75c5-4ce6-9404-54a6d4a45839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:14.300999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472ae93-75c5-4ce6-9404-54a6d4a45839 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:14.306497 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 451/919] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 03:59:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:14.312258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf98921-5c29-4ddb-9d9e-48d96453f5e6 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:14.376338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:14.416018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf98921-5c29-4ddb-9d9e-48d96453f5e6 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:14.426946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472ae93-75c5-4ce6-9404-54a6d4a45839 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:14.451373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35586563-0627-449a-9bf6-ef3dcb7ccc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:14.452439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35586563-0627-449a-9bf6-ef3dcb7ccc48 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:14.452910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35586563-0627-449a-9bf6-ef3dcb7ccc48 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:14.453402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35586563-0627-449a-9bf6-ef3dcb7ccc48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:14.454300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35586563-0627-449a-9bf6-ef3dcb7ccc48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:14.456247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35586563-0627-449a-9bf6-ef3dcb7ccc48 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:14.480426 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 469/920] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 03:59:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:14.489125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:14.546400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472ae93-75c5-4ce6-9404-54a6d4a45839 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:14.592496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec80e06-cdfa-4ae4-948d-9435f78e30e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:14.593145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec80e06-cdfa-4ae4-948d-9435f78e30e3 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:14.593418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec80e06-cdfa-4ae4-948d-9435f78e30e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:14.593682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec80e06-cdfa-4ae4-948d-9435f78e30e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:14.594356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec80e06-cdfa-4ae4-948d-9435f78e30e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:14.595879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec80e06-cdfa-4ae4-948d-9435f78e30e3 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-8ec80e06-cdfa-4ae4-948d-9435f78e30e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:14.606017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:14.607047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:14.607926 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 452/921] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Aug 30 03:59:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:14.614226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35586563-0627-449a-9bf6-ef3dcb7ccc48 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:14.616705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb57a2-e92b-4a0f-b260-e139e55aa24f None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:14.616988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb57a2-e92b-4a0f-b260-e139e55aa24f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:14.617405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb57a2-e92b-4a0f-b260-e139e55aa24f None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:14.618954 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 453/922] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:14.629820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c04f4-a9b6-4297-ac76-3d9d9ca4a8dc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:14.630532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c04f4-a9b6-4297-ac76-3d9d9ca4a8dc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:14.631153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c04f4-a9b6-4297-ac76-3d9d9ca4a8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:14.654102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-457c04f4-a9b6-4297-ac76-3d9d9ca4a8dc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:14.655439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-457c04f4-a9b6-4297-ac76-3d9d9ca4a8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:14.740404 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 454/923] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:14.747784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35586563-0627-449a-9bf6-ef3dcb7ccc48 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:14.766208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:14.791999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230ebdd-0cc5-4fe9-ac78-2a3a1e523ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:14.792637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230ebdd-0cc5-4fe9-ac78-2a3a1e523ae5 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:14.792908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230ebdd-0cc5-4fe9-ac78-2a3a1e523ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:14.793170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230ebdd-0cc5-4fe9-ac78-2a3a1e523ae5 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:14.793805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230ebdd-0cc5-4fe9-ac78-2a3a1e523ae5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:14.794136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230ebdd-0cc5-4fe9-ac78-2a3a1e523ae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:14.795512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230ebdd-0cc5-4fe9-ac78-2a3a1e523ae5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:14.801411 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 470/924] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:14.811202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c04f4-a9b6-4297-ac76-3d9d9ca4a8dc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:14.847065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:14.912905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c04f4-a9b6-4297-ac76-3d9d9ca4a8dc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:14.950617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eeab-0947-41b6-b523-76e881257ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:14.951233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eeab-0947-41b6-b523-76e881257ce2 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:14.951503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eeab-0947-41b6-b523-76e881257ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:14.951765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eeab-0947-41b6-b523-76e881257ce2 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:14.952398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278eeab-0947-41b6-b523-76e881257ce2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:14.952694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278eeab-0947-41b6-b523-76e881257ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:14.954110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278eeab-0947-41b6-b523-76e881257ce2 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:14.959509 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 455/925] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:14.965298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230ebdd-0cc5-4fe9-ac78-2a3a1e523ae5 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:15.044233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eeab-0947-41b6-b523-76e881257ce2 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:15.075416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230ebdd-0cc5-4fe9-ac78-2a3a1e523ae5 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:15.118472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25d1a8-a707-42e6-955a-5a74160ffb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:15.119138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25d1a8-a707-42e6-955a-5a74160ffb42 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:15.119384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25d1a8-a707-42e6-955a-5a74160ffb42 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:15.119613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25d1a8-a707-42e6-955a-5a74160ffb42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:15.120289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25d1a8-a707-42e6-955a-5a74160ffb42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:15.121677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25d1a8-a707-42e6-955a-5a74160ffb42 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:15.148442 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 471/926] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 03:59:14 2022] POST /identity/v3/endpoints => generated 347 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:15.154355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:15.165402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eeab-0947-41b6-b523-76e881257ce2 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:15.214744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e8b41-b8a7-4098-ba35-14b2932a322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:15.215856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e8b41-b8a7-4098-ba35-14b2932a322f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:15.216324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e8b41-b8a7-4098-ba35-14b2932a322f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:15.216790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66e8b41-b8a7-4098-ba35-14b2932a322f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:15.230373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66e8b41-b8a7-4098-ba35-14b2932a322f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-e66e8b41-b8a7-4098-ba35-14b2932a322f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:15.235962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:15.237089 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:15.237974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:15.241158 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 456/927] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 03:59:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:15.247097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25d1a8-a707-42e6-955a-5a74160ffb42 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:15.293444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:15.354281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25d1a8-a707-42e6-955a-5a74160ffb42 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:15.388636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68124ce-9e10-47af-87ff-1e8124671a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:15.389258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68124ce-9e10-47af-87ff-1e8124671a80 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:15.389532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68124ce-9e10-47af-87ff-1e8124671a80 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:15.389796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68124ce-9e10-47af-87ff-1e8124671a80 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:15.390496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68124ce-9e10-47af-87ff-1e8124671a80 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:15.390793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68124ce-9e10-47af-87ff-1e8124671a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:15.392421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68124ce-9e10-47af-87ff-1e8124671a80 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:15.401151 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 472/928] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 03:59:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:15.406843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e8b41-b8a7-4098-ba35-14b2932a322f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:15.511640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66e8b41-b8a7-4098-ba35-14b2932a322f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:15.546742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250202bb-28ec-45b1-a64f-ce233d341b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:15.547374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250202bb-28ec-45b1-a64f-ce233d341b23 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:15.547648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250202bb-28ec-45b1-a64f-ce233d341b23 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:15.547912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250202bb-28ec-45b1-a64f-ce233d341b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:15.558392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250202bb-28ec-45b1-a64f-ce233d341b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:15.559866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250202bb-28ec-45b1-a64f-ce233d341b23 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-250202bb-28ec-45b1-a64f-ce233d341b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:15.574857 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:15.575885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:15.576781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:15.576781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:15.576781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:15.576781 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 457/929] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:15.582152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68124ce-9e10-47af-87ff-1e8124671a80 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:15.647786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f4a91-58fa-41de-b8e7-88271f45e7cd None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:15.647989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f4a91-58fa-41de-b8e7-88271f45e7cd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:15.648424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f4a91-58fa-41de-b8e7-88271f45e7cd None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:15.650675 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 458/930] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:59:15.661201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c04187-4916-4005-b3cb-b0a2498efd3e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:15.661493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c04187-4916-4005-b3cb-b0a2498efd3e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:15.662598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c04187-4916-4005-b3cb-b0a2498efd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:15.685279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-57c04187-4916-4005-b3cb-b0a2498efd3e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:15.686884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-57c04187-4916-4005-b3cb-b0a2498efd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:15.694483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:15.697784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68124ce-9e10-47af-87ff-1e8124671a80 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:15.702233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:15.735501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0fbc5-a5bd-45a2-a159-f4666d9ac7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:15.737100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0fbc5-a5bd-45a2-a159-f4666d9ac7d1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:15.737100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0fbc5-a5bd-45a2-a159-f4666d9ac7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:15.737100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0fbc5-a5bd-45a2-a159-f4666d9ac7d1 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:15.737793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0fbc5-a5bd-45a2-a159-f4666d9ac7d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:15.738188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0fbc5-a5bd-45a2-a159-f4666d9ac7d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:15.740914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0fbc5-a5bd-45a2-a159-f4666d9ac7d1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:15.759599 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 473/931] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:15.760390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0fbc5-a5bd-45a2-a159-f4666d9ac7d1 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:15.782075 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 459/932] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:15.864169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0fbc5-a5bd-45a2-a159-f4666d9ac7d1 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:15.898697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d87c3-6701-4fc4-95e4-b1727b090b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:15.899670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d87c3-6701-4fc4-95e4-b1727b090b03 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:15.900153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d87c3-6701-4fc4-95e4-b1727b090b03 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:15.900625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d87c3-6701-4fc4-95e4-b1727b090b03 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:15.907902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d87c3-6701-4fc4-95e4-b1727b090b03 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:15.909564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d87c3-6701-4fc4-95e4-b1727b090b03 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-149d87c3-6701-4fc4-95e4-b1727b090b03 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:59:15.921267 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:15.922256 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:15.923252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:15.923252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:15.923252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:15.923252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:15.923252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:15.923252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:15.923252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:15.923252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:15.923252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:59:15.923252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:15.929973 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 474/933] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 03:59:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:15.932011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c04187-4916-4005-b3cb-b0a2498efd3e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.037010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c04187-4916-4005-b3cb-b0a2498efd3e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:16.072276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc94f4a-b955-4164-8627-1d686bc7e364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:16.073277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc94f4a-b955-4164-8627-1d686bc7e364 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.073752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc94f4a-b955-4164-8627-1d686bc7e364 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.074246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc94f4a-b955-4164-8627-1d686bc7e364 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.075199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc94f4a-b955-4164-8627-1d686bc7e364 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:16.075721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc94f4a-b955-4164-8627-1d686bc7e364 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:16.077482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc94f4a-b955-4164-8627-1d686bc7e364 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:16.078633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d87c3-6701-4fc4-95e4-b1727b090b03 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.090251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:16.099237 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 460/934] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 03:59:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:16.102859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:16.104889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc94f4a-b955-4164-8627-1d686bc7e364 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.186230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d87c3-6701-4fc4-95e4-b1727b090b03 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:16.217413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc94f4a-b955-4164-8627-1d686bc7e364 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:16.221202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaf9d2-5103-4970-8297-f320bbe544df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:16.221976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf9d2-5103-4970-8297-f320bbe544df None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.222250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf9d2-5103-4970-8297-f320bbe544df None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.222532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaf9d2-5103-4970-8297-f320bbe544df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.223127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaf9d2-5103-4970-8297-f320bbe544df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:16.224704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaf9d2-5103-4970-8297-f320bbe544df None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-23eaf9d2-5103-4970-8297-f320bbe544df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:16.237276 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:16.238406 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:16.239244 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:16.241965 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 475/935] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:16.245219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaf9d2-5103-4970-8297-f320bbe544df None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.259960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9e7c3-3d3f-444b-98b0-3425ccdc5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:16.261095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9e7c3-3d3f-444b-98b0-3425ccdc5a8a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.261473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9e7c3-3d3f-444b-98b0-3425ccdc5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.262111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9e7c3-3d3f-444b-98b0-3425ccdc5a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.276800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9e7c3-3d3f-444b-98b0-3425ccdc5a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:16.279133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9e7c3-3d3f-444b-98b0-3425ccdc5a8a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-22f9e7c3-3d3f-444b-98b0-3425ccdc5a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:16.300875 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:16.302112 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:16.303242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:16.303242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:16.303242 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:16.305966 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 461/936] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:16.310574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9e7c3-3d3f-444b-98b0-3425ccdc5a8a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.350351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:16.362701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:16.371662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaf9d2-5103-4970-8297-f320bbe544df None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:16.409807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfca52-28fd-4afe-ba7e-5a099287cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:16.410866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfca52-28fd-4afe-ba7e-5a099287cd00 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.411342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfca52-28fd-4afe-ba7e-5a099287cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.411802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfca52-28fd-4afe-ba7e-5a099287cd00 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.412693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfca52-28fd-4afe-ba7e-5a099287cd00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:16.412895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9e7c3-3d3f-444b-98b0-3425ccdc5a8a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:16.413432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfca52-28fd-4afe-ba7e-5a099287cd00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:16.415219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfca52-28fd-4afe-ba7e-5a099287cd00 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:16.421033 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 476/937] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 03:59:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:16.429925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfca52-28fd-4afe-ba7e-5a099287cd00 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.447414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc14f5d-faec-4149-a133-063312c840e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:16.448020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc14f5d-faec-4149-a133-063312c840e9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.448297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc14f5d-faec-4149-a133-063312c840e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.448560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc14f5d-faec-4149-a133-063312c840e9 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.449200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc14f5d-faec-4149-a133-063312c840e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:16.449489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc14f5d-faec-4149-a133-063312c840e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:16.451098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc14f5d-faec-4149-a133-063312c840e9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:16.468289 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 462/938] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:16.470440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc14f5d-faec-4149-a133-063312c840e9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.539409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfca52-28fd-4afe-ba7e-5a099287cd00 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:16.574935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc14f5d-faec-4149-a133-063312c840e9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:16.578149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca32d1-fd38-45fb-a01d-5c8ff87e2c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:16.579006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca32d1-fd38-45fb-a01d-5c8ff87e2c92 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.579485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca32d1-fd38-45fb-a01d-5c8ff87e2c92 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.580047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca32d1-fd38-45fb-a01d-5c8ff87e2c92 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.580882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca32d1-fd38-45fb-a01d-5c8ff87e2c92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:16.581442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca32d1-fd38-45fb-a01d-5c8ff87e2c92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:16.583204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca32d1-fd38-45fb-a01d-5c8ff87e2c92 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:16.584873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:16.590350 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 477/939] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 03:59:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:16.592680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb95664-6ee2-43b6-a95f-cb8d639b7809 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.593169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb95664-6ee2-43b6-a95f-cb8d639b7809 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.593750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb95664-6ee2-43b6-a95f-cb8d639b7809 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.595293 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 478/940] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:16.596624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb95664-6ee2-43b6-a95f-cb8d639b7809 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.612588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:16.617500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086277fa-f2fc-4fe3-9870-a5b83fecda89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:16.618326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086277fa-f2fc-4fe3-9870-a5b83fecda89 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.618606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086277fa-f2fc-4fe3-9870-a5b83fecda89 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.618872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086277fa-f2fc-4fe3-9870-a5b83fecda89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.625859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086277fa-f2fc-4fe3-9870-a5b83fecda89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:16.627508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086277fa-f2fc-4fe3-9870-a5b83fecda89 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-086277fa-f2fc-4fe3-9870-a5b83fecda89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:16.639515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:16.640417 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:16.641313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:16.641313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:16.641313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:16.641313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:16.641313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:16.641313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:16.641313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:16.641313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:16.645642 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 463/941] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:16.647169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbb48-7dd1-4a1e-9c25-bbc66e85d5f9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.647456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbb48-7dd1-4a1e-9c25-bbc66e85d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.647730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dbb48-7dd1-4a1e-9c25-bbc66e85d5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.666910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-751dbb48-7dd1-4a1e-9c25-bbc66e85d5f9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:16.668207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-751dbb48-7dd1-4a1e-9c25-bbc66e85d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:16.714536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb95664-6ee2-43b6-a95f-cb8d639b7809 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:16.747642 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 464/942] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:16.748521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dbb48-7dd1-4a1e-9c25-bbc66e85d5f9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.764020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403542b-2f96-4328-8b77-5db3ffa9635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:16.765214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403542b-2f96-4328-8b77-5db3ffa9635d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.766133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403542b-2f96-4328-8b77-5db3ffa9635d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.766922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403542b-2f96-4328-8b77-5db3ffa9635d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.768641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403542b-2f96-4328-8b77-5db3ffa9635d None admin] RBAC: Adding query filter params (interface=public, service_id=05ff80311a6346698a3025f00e644409, region_id=RegionOne) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:16.769512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403542b-2f96-4328-8b77-5db3ffa9635d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:16.771160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403542b-2f96-4328-8b77-5db3ffa9635d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:16.779797 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 479/943] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 03:59:16 2022] GET /identity/v3/endpoints?service_id=05ff80311a6346698a3025f00e644409&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:16.787382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403542b-2f96-4328-8b77-5db3ffa9635d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.861001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:16.865742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dbb48-7dd1-4a1e-9c25-bbc66e85d5f9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:16.888614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:16.912493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25e6a4-c6c8-451b-81df-838d35c5db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:16.913372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403542b-2f96-4328-8b77-5db3ffa9635d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:16.913624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25e6a4-c6c8-451b-81df-838d35c5db95 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.914086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25e6a4-c6c8-451b-81df-838d35c5db95 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.914535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25e6a4-c6c8-451b-81df-838d35c5db95 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.915651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25e6a4-c6c8-451b-81df-838d35c5db95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:16.916984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25e6a4-c6c8-451b-81df-838d35c5db95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:16.918649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25e6a4-c6c8-451b-81df-838d35c5db95 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:16.934869 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 465/944] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:16.940390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25e6a4-c6c8-451b-81df-838d35c5db95 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:16.954003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca65e-efcb-4e3a-9d73-7db0827295ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:16.955101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca65e-efcb-4e3a-9d73-7db0827295ca None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:16.955381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca65e-efcb-4e3a-9d73-7db0827295ca None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:16.955825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca65e-efcb-4e3a-9d73-7db0827295ca None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:16.956708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca65e-efcb-4e3a-9d73-7db0827295ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:16.958167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca65e-efcb-4e3a-9d73-7db0827295ca None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:16.969904 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 480/945] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 03:59:16 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 03:59:17.024968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca65e-efcb-4e3a-9d73-7db0827295ca None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:17.073576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25e6a4-c6c8-451b-81df-838d35c5db95 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:17.121626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6410e8-eb38-4add-aba4-973e766103f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:17.122251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6410e8-eb38-4add-aba4-973e766103f7 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:17.122523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6410e8-eb38-4add-aba4-973e766103f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:17.122803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6410e8-eb38-4add-aba4-973e766103f7 None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d7c17b0543d14adda9784af0fd2082d5/roles/c0df7bf5ce494e0ab735be8639aec320` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:17.124939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6410e8-eb38-4add-aba4-973e766103f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=d7c17b0543d14adda9784af0fd2082d5, role_id=c0df7bf5ce494e0ab735be8639aec320)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:17.127081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6410e8-eb38-4add-aba4-973e766103f7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:17.141903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca65e-efcb-4e3a-9d73-7db0827295ca None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:17.144069 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 466/946] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:59:16 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d7c17b0543d14adda9784af0fd2082d5/roles/c0df7bf5ce494e0ab735be8639aec320 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 03:59:17.145519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f86ee-d777-4ece-9c82-1543ca2ede5d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:17.145787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f86ee-d777-4ece-9c82-1543ca2ede5d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:17.146103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f86ee-d777-4ece-9c82-1543ca2ede5d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:17.147628 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 467/947] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:17.154539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12b859-d2c5-4804-9a4a-9125498377ff None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:17.154812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12b859-d2c5-4804-9a4a-9125498377ff None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:17.155099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12b859-d2c5-4804-9a4a-9125498377ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:17.175119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9d12b859-d2c5-4804-9a4a-9125498377ff None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:17.177387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9d12b859-d2c5-4804-9a4a-9125498377ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:17.191385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:17.197454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:17.198899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:17.199406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:17.201167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:17.202484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:17.204008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:17.208955 n-d-820368-36 devstack@keystone.service[82098]: WARNING keystone.server.flask.common [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 03:59:17.228046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:17.242059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.sql.core [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 03:59:17.242059 n-d-820368-36 devstack@keystone.service[82098]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 03:59:17.242059 n-d-820368-36 devstack@keystone.service[82098]: [parameters: {'id': '09692105233749b29cc9ce747356c1c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 03:59:17.242059 n-d-820368-36 devstack@keystone.service[82098]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82098) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 09692105233749b29cc9ce747356c1c9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 09692105233749b29cc9ce747356c1c9. Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application conn.query(q) Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:59:17.253962 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result.read() Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 03:59:17.254931 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application next(self.gen) Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application yield resource Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application next(self.gen) Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise self.value Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application session.commit() Aug 30 03:59:17.255922 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.session.flush() Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application compat.raise_( Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 03:59:17.256850 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 03:59:17.257771 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application conn.query(q) Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result.read() Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:59:17.261995 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [parameters: {'id': '09692105233749b29cc9ce747356c1c9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:17.262954 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:17.263765 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:17.264660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:17.264660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 03:59:17.264660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 03:59:17.264660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:17.264660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:17.264660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 03:59:17.264660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 03:59:17.264660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 09692105233749b29cc9ce747356c1c9. Aug 30 03:59:17.264660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.264660 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 481/948] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Aug 30 03:59:17 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:17.266680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:17.281786 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 468/949] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:59:17.382295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65616a60-a9c6-4428-9993-5b48b3b9e209 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:17.418832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c5f30-e882-46dd-8c73-477a124c84f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:17.419648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c5f30-e882-46dd-8c73-477a124c84f7 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:17.420017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c5f30-e882-46dd-8c73-477a124c84f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:17.420377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21c5f30-e882-46dd-8c73-477a124c84f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:17.427653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c5f30-e882-46dd-8c73-477a124c84f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:17.429536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21c5f30-e882-46dd-8c73-477a124c84f7 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-f21c5f30-e882-46dd-8c73-477a124c84f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:17.441184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:17.442328 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:17.443448 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:17.443448 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:17.443448 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:17.443448 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:17.443448 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:17.443448 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:17.443448 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:17.443448 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.445048 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 482/950] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:17.451018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12b859-d2c5-4804-9a4a-9125498377ff None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:17.551999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c5f30-e882-46dd-8c73-477a124c84f7 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:17.562070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12b859-d2c5-4804-9a4a-9125498377ff None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:17.598255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403922a-c57b-4b8b-b4af-2a07f0622c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:17.598870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403922a-c57b-4b8b-b4af-2a07f0622c56 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:17.599144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403922a-c57b-4b8b-b4af-2a07f0622c56 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:17.599408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403922a-c57b-4b8b-b4af-2a07f0622c56 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:17.600080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403922a-c57b-4b8b-b4af-2a07f0622c56 None admin] RBAC: Adding query filter params (name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:17.600377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403922a-c57b-4b8b-b4af-2a07f0622c56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:17.601828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403922a-c57b-4b8b-b4af-2a07f0622c56 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:17.625127 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 469/951] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:59:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:17.625829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:17.682602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21c5f30-e882-46dd-8c73-477a124c84f7 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:17.719492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99baf5-52dd-40e2-a5ea-1afd89f58e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:17.720403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99baf5-52dd-40e2-a5ea-1afd89f58e1a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:17.720853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99baf5-52dd-40e2-a5ea-1afd89f58e1a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:17.721259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99baf5-52dd-40e2-a5ea-1afd89f58e1a None admin] PATH_INFO: `/v3/services/compute` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:17.722032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99baf5-52dd-40e2-a5ea-1afd89f58e1a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:17.723663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99baf5-52dd-40e2-a5ea-1afd89f58e1a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-de99baf5-52dd-40e2-a5ea-1afd89f58e1a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:17.738768 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:17.740077 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:17.741186 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 483/952] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:17.746255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403922a-c57b-4b8b-b4af-2a07f0622c56 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:17.758273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:17.858839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403922a-c57b-4b8b-b4af-2a07f0622c56 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:17.896794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81540b-b2cc-4c2d-baa5-b96914acf0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:17.897335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81540b-b2cc-4c2d-baa5-b96914acf0c7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:17.897608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81540b-b2cc-4c2d-baa5-b96914acf0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:17.897888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81540b-b2cc-4c2d-baa5-b96914acf0c7 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:17.898539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81540b-b2cc-4c2d-baa5-b96914acf0c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:17.898837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81540b-b2cc-4c2d-baa5-b96914acf0c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:17.900227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81540b-b2cc-4c2d-baa5-b96914acf0c7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:17.906164 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 470/953] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:59:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:17.911974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99baf5-52dd-40e2-a5ea-1afd89f58e1a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:18.016928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99baf5-52dd-40e2-a5ea-1afd89f58e1a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:18.038295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:18.052765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b9849-1b35-4ac1-b68c-6cccb264ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:18.053535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9849-1b35-4ac1-b68c-6cccb264ea58 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:18.053915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9849-1b35-4ac1-b68c-6cccb264ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:18.054281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b9849-1b35-4ac1-b68c-6cccb264ea58 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:18.055013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b9849-1b35-4ac1-b68c-6cccb264ea58 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:18.055422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b9849-1b35-4ac1-b68c-6cccb264ea58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:18.056891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b9849-1b35-4ac1-b68c-6cccb264ea58 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:18.065161 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 484/954] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:59:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:19.008501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5d8f-f503-4cd7-b9fa-209e20000200 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:19.009006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5d8f-f503-4cd7-b9fa-209e20000200 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:19.009006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f5d8f-f503-4cd7-b9fa-209e20000200 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:19.010668 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 471/955] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:19.016157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30543621-7203-497c-8d51-c92271b35f17 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:19.016566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30543621-7203-497c-8d51-c92271b35f17 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:19.016734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30543621-7203-497c-8d51-c92271b35f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:19.035801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-30543621-7203-497c-8d51-c92271b35f17 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:19.037330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-30543621-7203-497c-8d51-c92271b35f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:19.110603 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 485/956] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:19.192039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300421bb-5784-4ae8-ac0c-d956cb7a3290 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:19.192662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300421bb-5784-4ae8-ac0c-d956cb7a3290 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:19.193228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300421bb-5784-4ae8-ac0c-d956cb7a3290 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:19.195023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 472/957] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:19.200690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edcf4b-fecd-40b0-8ffe-ce0c395bbf72 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:19.201212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edcf4b-fecd-40b0-8ffe-ce0c395bbf72 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:19.201694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edcf4b-fecd-40b0-8ffe-ce0c395bbf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:19.220451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-47edcf4b-fecd-40b0-8ffe-ce0c395bbf72 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:19.222187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-47edcf4b-fecd-40b0-8ffe-ce0c395bbf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:19.290221 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 486/958] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:19.373317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300421bb-5784-4ae8-ac0c-d956cb7a3290 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:19.445786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:19.476738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300421bb-5784-4ae8-ac0c-d956cb7a3290 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:19.511805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151684f7-54f6-427c-9c11-b821292df217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:19.512441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151684f7-54f6-427c-9c11-b821292df217 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:19.512714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151684f7-54f6-427c-9c11-b821292df217 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:19.512981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151684f7-54f6-427c-9c11-b821292df217 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:19.513568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151684f7-54f6-427c-9c11-b821292df217 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:19.514988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151684f7-54f6-427c-9c11-b821292df217 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-151684f7-54f6-427c-9c11-b821292df217 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:19.524298 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:19.525399 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:19.526340 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 473/959] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:19.531401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edcf4b-fecd-40b0-8ffe-ce0c395bbf72 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:19.570563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151684f7-54f6-427c-9c11-b821292df217 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:19.579198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:19.653525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edcf4b-fecd-40b0-8ffe-ce0c395bbf72 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:19.691851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151684f7-54f6-427c-9c11-b821292df217 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:19.703513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214b47d-2625-41be-850e-fc068920c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:19.704155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214b47d-2625-41be-850e-fc068920c3f4 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:19.704428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214b47d-2625-41be-850e-fc068920c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:19.704691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214b47d-2625-41be-850e-fc068920c3f4 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:19.705644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214b47d-2625-41be-850e-fc068920c3f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:19.705980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214b47d-2625-41be-850e-fc068920c3f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:19.707521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214b47d-2625-41be-850e-fc068920c3f4 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:19.712739 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 487/960] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 03:59:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:19.713993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245ce98-ff97-455b-9eda-e9e66a236ba8 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:19.714274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245ce98-ff97-455b-9eda-e9e66a236ba8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:19.714536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245ce98-ff97-455b-9eda-e9e66a236ba8 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:19.719764 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 488/961] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:19.719764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245ce98-ff97-455b-9eda-e9e66a236ba8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:19.732184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fbc86-a5b1-4fea-8a7b-7c68944f43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:19.732876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbc86-a5b1-4fea-8a7b-7c68944f43a7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:19.733152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbc86-a5b1-4fea-8a7b-7c68944f43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:19.733416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbc86-a5b1-4fea-8a7b-7c68944f43a7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:19.736106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:19.744933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fbc86-a5b1-4fea-8a7b-7c68944f43a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6e2fbc86-a5b1-4fea-8a7b-7c68944f43a7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:19.751609 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:19.752763 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:19.753616 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 474/962] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 03:59:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:19.754375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d70d-16d4-4c8a-983d-8bb9581342fe None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:19.754375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d70d-16d4-4c8a-983d-8bb9581342fe None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:19.754506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145d70d-16d4-4c8a-983d-8bb9581342fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:19.772185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c145d70d-16d4-4c8a-983d-8bb9581342fe None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:19.773361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c145d70d-16d4-4c8a-983d-8bb9581342fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:19.839145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245ce98-ff97-455b-9eda-e9e66a236ba8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:19.842994 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 475/963] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:19.844024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d70d-16d4-4c8a-983d-8bb9581342fe None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:19.852350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:19.883034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae401a-c287-491f-b121-181f6bde275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:19.884091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae401a-c287-491f-b121-181f6bde275d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:19.884439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae401a-c287-491f-b121-181f6bde275d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:19.884777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae401a-c287-491f-b121-181f6bde275d None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:19.885488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae401a-c287-491f-b121-181f6bde275d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:19.885970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae401a-c287-491f-b121-181f6bde275d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:19.887517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae401a-c287-491f-b121-181f6bde275d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:19.897923 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 489/964] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 03:59:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:19.898977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae401a-c287-491f-b121-181f6bde275d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:19.970030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145d70d-16d4-4c8a-983d-8bb9581342fe None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:19.997606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:20.008008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25230e24-b240-4705-84f4-efc2c6d84072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:20.008906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25230e24-b240-4705-84f4-efc2c6d84072 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.009786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25230e24-b240-4705-84f4-efc2c6d84072 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.009933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae401a-c287-491f-b121-181f6bde275d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:20.010385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25230e24-b240-4705-84f4-efc2c6d84072 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.011224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25230e24-b240-4705-84f4-efc2c6d84072 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:20.011801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25230e24-b240-4705-84f4-efc2c6d84072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:20.013533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25230e24-b240-4705-84f4-efc2c6d84072 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:20.025150 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 476/965] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 03:59:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:20.030685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25230e24-b240-4705-84f4-efc2c6d84072 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:20.048409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c4336-656b-4940-9a4d-f614716338dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:20.049749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4336-656b-4940-9a4d-f614716338dc None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.050230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4336-656b-4940-9a4d-f614716338dc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.050710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4336-656b-4940-9a4d-f614716338dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.051566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c4336-656b-4940-9a4d-f614716338dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:20.053077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c4336-656b-4940-9a4d-f614716338dc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:20.075891 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 490/966] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 03:59:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:20.077016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6873-9475-4b72-b17d-78c174bf935d None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.077457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6873-9475-4b72-b17d-78c174bf935d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.077789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c6873-9475-4b72-b17d-78c174bf935d None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.081936 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 491/967] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:20.085827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b5451-0765-46bf-9bd3-359b134de409 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.086340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b5451-0765-46bf-9bd3-359b134de409 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.086760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b5451-0765-46bf-9bd3-359b134de409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.114145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c54b5451-0765-46bf-9bd3-359b134de409 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:20.115938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c54b5451-0765-46bf-9bd3-359b134de409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:20.151094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:20.153615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25230e24-b240-4705-84f4-efc2c6d84072 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:20.197394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437a77-bbe3-4d15-b913-cf355516504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:20.198070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437a77-bbe3-4d15-b913-cf355516504f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.198342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437a77-bbe3-4d15-b913-cf355516504f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.198605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e437a77-bbe3-4d15-b913-cf355516504f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.204541 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 492/968] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:20.205240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b5451-0765-46bf-9bd3-359b134de409 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:20.217899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e437a77-bbe3-4d15-b913-cf355516504f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:20.217899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e437a77-bbe3-4d15-b913-cf355516504f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3e437a77-bbe3-4d15-b913-cf355516504f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:20.233753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:20.234936 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:20.235830 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:20.235830 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:20.235830 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:20.240349 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 477/969] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:20.241995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437a77-bbe3-4d15-b913-cf355516504f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:20.285808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:20.329961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b5451-0765-46bf-9bd3-359b134de409 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:20.366162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f709db-3ab1-49be-8997-7c1f62c1aee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:20.366781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f709db-3ab1-49be-8997-7c1f62c1aee7 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.367011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f709db-3ab1-49be-8997-7c1f62c1aee7 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.367329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f709db-3ab1-49be-8997-7c1f62c1aee7 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.367927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f709db-3ab1-49be-8997-7c1f62c1aee7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:20.369566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e437a77-bbe3-4d15-b913-cf355516504f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:20.369693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f709db-3ab1-49be-8997-7c1f62c1aee7 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:20.386054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.sql.core [None req-79f709db-3ab1-49be-8997-7c1f62c1aee7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 03:59:20.386054 n-d-820368-36 devstack@keystone.service[82098]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 03:59:20.386054 n-d-820368-36 devstack@keystone.service[82098]: [parameters: {'user_id': '52f22984edcf4f619f836781c181d07d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 03:59:20.386054 n-d-820368-36 devstack@keystone.service[82098]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82098) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-79f709db-3ab1-49be-8997-7c1f62c1aee7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application conn.query(q) Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result.read() Aug 30 03:59:20.395680 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 03:59:20.396645 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application next(self.gen) Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application yield resource Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application next(self.gen) Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise self.value Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application session.commit() Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 03:59:20.397642 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.session.flush() Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application compat.raise_( Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 03:59:20.398589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 03:59:20.399484 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application conn.query(q) Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result.read() Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 03:59:20.400330 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [parameters: {'user_id': '52f22984edcf4f619f836781c181d07d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:20.401172 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 03:59:20.408436 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 03:59:20.410613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 03:59:20.410613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 03:59:20.410613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 03:59:20.410613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 03:59:20.410613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 03:59:20.410613 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:20.410613 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 493/970] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Aug 30 03:59:20 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:20.410613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f709db-3ab1-49be-8997-7c1f62c1aee7 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:20.421352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82778e-9b1a-4c6c-953c-49524c240cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:20.422370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82778e-9b1a-4c6c-953c-49524c240cb5 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.422894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82778e-9b1a-4c6c-953c-49524c240cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.423357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82778e-9b1a-4c6c-953c-49524c240cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.424459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82778e-9b1a-4c6c-953c-49524c240cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:20.425140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82778e-9b1a-4c6c-953c-49524c240cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:20.427675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82778e-9b1a-4c6c-953c-49524c240cb5 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:20.435709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:20.447432 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 478/971] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:20.457912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82778e-9b1a-4c6c-953c-49524c240cb5 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:20.535649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f709db-3ab1-49be-8997-7c1f62c1aee7 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:20.563485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:20.571506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82778e-9b1a-4c6c-953c-49524c240cb5 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:20.572420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff9a0f-f2c6-478c-8eba-4e98ce89865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:20.573098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff9a0f-f2c6-478c-8eba-4e98ce89865a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.573396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff9a0f-f2c6-478c-8eba-4e98ce89865a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.573657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff9a0f-f2c6-478c-8eba-4e98ce89865a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.582441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff9a0f-f2c6-478c-8eba-4e98ce89865a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:20.583805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff9a0f-f2c6-478c-8eba-4e98ce89865a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-68ff9a0f-f2c6-478c-8eba-4e98ce89865a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:59:20.596125 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:20.597315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 494/972] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:59:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:20.603135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff9a0f-f2c6-478c-8eba-4e98ce89865a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:20.621821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b9c3e-1970-4af3-80dd-2f575eefb48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:20.622843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b9c3e-1970-4af3-80dd-2f575eefb48a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.623126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b9c3e-1970-4af3-80dd-2f575eefb48a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.623449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b9c3e-1970-4af3-80dd-2f575eefb48a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.636985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b9c3e-1970-4af3-80dd-2f575eefb48a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:20.636985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b9c3e-1970-4af3-80dd-2f575eefb48a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6c1b9c3e-1970-4af3-80dd-2f575eefb48a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:59:20.653313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:20.654652 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:20.655654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:20.655654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:20.655654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:20.655654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:20.655654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:20.655654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:20.655654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:20.655654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:20.655654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 03:59:20.655654 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:20.660120 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 479/973] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 03:59:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:20.661083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b9c3e-1970-4af3-80dd-2f575eefb48a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:20.687716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:20.707637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff9a0f-f2c6-478c-8eba-4e98ce89865a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:20.744685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7686f0-937d-4611-ae2c-6fc79710ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:20.745328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7686f0-937d-4611-ae2c-6fc79710ecd3 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.745661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7686f0-937d-4611-ae2c-6fc79710ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.746104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7686f0-937d-4611-ae2c-6fc79710ecd3 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.746506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7686f0-937d-4611-ae2c-6fc79710ecd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:20.747908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7686f0-937d-4611-ae2c-6fc79710ecd3 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:20.766335 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 495/974] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:59:20 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:20.766335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7686f0-937d-4611-ae2c-6fc79710ecd3 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:20.786238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b9c3e-1970-4af3-80dd-2f575eefb48a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:20.844064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae97ac-e100-4222-af3e-783a79e633df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:20.844971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae97ac-e100-4222-af3e-783a79e633df None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.845714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae97ac-e100-4222-af3e-783a79e633df None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.846202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae97ac-e100-4222-af3e-783a79e633df None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.847343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae97ac-e100-4222-af3e-783a79e633df None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:20.847801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae97ac-e100-4222-af3e-783a79e633df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:20.850314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae97ac-e100-4222-af3e-783a79e633df None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:20.902281 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 480/975] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 03:59:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:20.910882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7686f0-937d-4611-ae2c-6fc79710ecd3 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:20.950535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd712569-1064-4d4d-b3d4-b412abb074d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:20.951179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd712569-1064-4d4d-b3d4-b412abb074d7 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:20.951452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd712569-1064-4d4d-b3d4-b412abb074d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:20.951716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd712569-1064-4d4d-b3d4-b412abb074d7 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:20.952477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd712569-1064-4d4d-b3d4-b412abb074d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:20.952773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd712569-1064-4d4d-b3d4-b412abb074d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:20.954304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd712569-1064-4d4d-b3d4-b412abb074d7 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:20.967985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:20.978882 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 496/976] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 03:59:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:20.984807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae97ac-e100-4222-af3e-783a79e633df None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:20.999855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:21.108788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae97ac-e100-4222-af3e-783a79e633df None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:21.144344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97341b57-1677-4467-8840-045973b22a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:21.144953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97341b57-1677-4467-8840-045973b22a79 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:21.145223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97341b57-1677-4467-8840-045973b22a79 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:21.145485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97341b57-1677-4467-8840-045973b22a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:21.219521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97341b57-1677-4467-8840-045973b22a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:21.220961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97341b57-1677-4467-8840-045973b22a79 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:21.233475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:21.326522 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 481/977] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:20 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:21.332456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd712569-1064-4d4d-b3d4-b412abb074d7 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:21.438297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd712569-1064-4d4d-b3d4-b412abb074d7 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:21.472706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed5505-e467-43c2-8598-325af62d8229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:21.473260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed5505-e467-43c2-8598-325af62d8229 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:21.473592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed5505-e467-43c2-8598-325af62d8229 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:21.473861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed5505-e467-43c2-8598-325af62d8229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:21.485040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed5505-e467-43c2-8598-325af62d8229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:21.486521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed5505-e467-43c2-8598-325af62d8229 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-b9ed5505-e467-43c2-8598-325af62d8229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:21.502432 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:21.503667 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:21.504581 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:21.504581 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:21.504581 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:21.504581 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 497/978] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:21.510609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97341b57-1677-4467-8840-045973b22a79 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:21.611720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97341b57-1677-4467-8840-045973b22a79 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:21.624476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:21.652179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85834f-298d-4a6b-a5d5-1ecdcfd0c575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:21.652788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85834f-298d-4a6b-a5d5-1ecdcfd0c575 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:21.653058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85834f-298d-4a6b-a5d5-1ecdcfd0c575 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:21.653318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85834f-298d-4a6b-a5d5-1ecdcfd0c575 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:21.653988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85834f-298d-4a6b-a5d5-1ecdcfd0c575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:21.654286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85834f-298d-4a6b-a5d5-1ecdcfd0c575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:21.655666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85834f-298d-4a6b-a5d5-1ecdcfd0c575 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:21.671865 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 482/979] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:21.673528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed5505-e467-43c2-8598-325af62d8229 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:21.732294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:21.787099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed5505-e467-43c2-8598-325af62d8229 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:21.822351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f0bed-d923-4f22-8078-0c2af8f4040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:21.822989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0bed-d923-4f22-8078-0c2af8f4040e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:21.823268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0bed-d923-4f22-8078-0c2af8f4040e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:21.823534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f0bed-d923-4f22-8078-0c2af8f4040e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:21.830568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f0bed-d923-4f22-8078-0c2af8f4040e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:21.832220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f0bed-d923-4f22-8078-0c2af8f4040e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-540f0bed-d923-4f22-8078-0c2af8f4040e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:21.843604 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:21.844541 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:21.845438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:21.845438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:21.845438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:21.845438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:21.845438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:21.845438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:21.845438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:21.845438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:21.849853 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 498/980] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:21.851266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85834f-298d-4a6b-a5d5-1ecdcfd0c575 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:21.960315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85834f-298d-4a6b-a5d5-1ecdcfd0c575 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:21.997200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939c9fa-2f69-468b-8da2-64f3b365b065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:21.997954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939c9fa-2f69-468b-8da2-64f3b365b065 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:21.998229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939c9fa-2f69-468b-8da2-64f3b365b065 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:21.998491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939c9fa-2f69-468b-8da2-64f3b365b065 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:21.999182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939c9fa-2f69-468b-8da2-64f3b365b065 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:21.999481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939c9fa-2f69-468b-8da2-64f3b365b065 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:22.000914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939c9fa-2f69-468b-8da2-64f3b365b065 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:22.014130 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 483/981] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:22.020110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f0bed-d923-4f22-8078-0c2af8f4040e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:22.063158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb69575-65ae-484a-a59f-64791c34b062 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:22.063788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb69575-65ae-484a-a59f-64791c34b062 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:22.064295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb69575-65ae-484a-a59f-64791c34b062 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:22.066294 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 484/982] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:59:22.071422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278378b-5c84-40fc-aa3e-05a8c8c6f5e3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:22.072224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278378b-5c84-40fc-aa3e-05a8c8c6f5e3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:22.072695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278378b-5c84-40fc-aa3e-05a8c8c6f5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:22.097488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0278378b-5c84-40fc-aa3e-05a8c8c6f5e3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:22.099848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0278378b-5c84-40fc-aa3e-05a8c8c6f5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:22.128824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:22.134603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f0bed-d923-4f22-8078-0c2af8f4040e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:22.145924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:22.170331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc65e-d1cb-4d91-a977-a335c735811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:22.170945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc65e-d1cb-4d91-a977-a335c735811e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:22.171240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc65e-d1cb-4d91-a977-a335c735811e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:22.171487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dc65e-d1cb-4d91-a977-a335c735811e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:22.172214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dc65e-d1cb-4d91-a977-a335c735811e None admin] RBAC: Adding query filter params (role.id=c0df7bf5ce494e0ab735be8639aec320, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d7c17b0543d14adda9784af0fd2082d5) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:22.172519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dc65e-d1cb-4d91-a977-a335c735811e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:22.173971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dc65e-d1cb-4d91-a977-a335c735811e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:22.189905 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 499/983] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:22 2022] GET /identity/v3/role_assignments?user.id=d7c17b0543d14adda9784af0fd2082d5&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=c0df7bf5ce494e0ab735be8639aec320 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:22.190116 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 485/984] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:22.443587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc65e-d1cb-4d91-a977-a335c735811e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:22.548042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dc65e-d1cb-4d91-a977-a335c735811e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:22.582072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5988e4-2a10-4eb3-8d37-9de78451c8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:22.582688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5988e4-2a10-4eb3-8d37-9de78451c8a4 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:22.582974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5988e4-2a10-4eb3-8d37-9de78451c8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:22.583248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5988e4-2a10-4eb3-8d37-9de78451c8a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:22.583798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5988e4-2a10-4eb3-8d37-9de78451c8a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:22.585174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5988e4-2a10-4eb3-8d37-9de78451c8a4 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-fa5988e4-2a10-4eb3-8d37-9de78451c8a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:22.594074 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:22.595056 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:22.595901 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:22.597976 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 500/985] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:22.601468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278378b-5c84-40fc-aa3e-05a8c8c6f5e3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:22.713310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278378b-5c84-40fc-aa3e-05a8c8c6f5e3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:22.750400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c3229-2a37-471e-b6d6-8d8e823345ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:22.751019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3229-2a37-471e-b6d6-8d8e823345ce None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:22.751289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3229-2a37-471e-b6d6-8d8e823345ce None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:22.751568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c3229-2a37-471e-b6d6-8d8e823345ce None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:22.752207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c3229-2a37-471e-b6d6-8d8e823345ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:22.752612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c3229-2a37-471e-b6d6-8d8e823345ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:22.754117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c3229-2a37-471e-b6d6-8d8e823345ce None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:22.759610 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 486/986] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 03:59:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:22.765615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5988e4-2a10-4eb3-8d37-9de78451c8a4 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:22.767263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777567a-b229-4692-a161-f8456264ed1c None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:22.767548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777567a-b229-4692-a161-f8456264ed1c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:22.767818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777567a-b229-4692-a161-f8456264ed1c None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:22.769563 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 487/987] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:22.774487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d85ef-ff32-479c-ae08-28a815444e8b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:22.774959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d85ef-ff32-479c-ae08-28a815444e8b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:22.775428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d85ef-ff32-479c-ae08-28a815444e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:22.793971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cf3d85ef-ff32-479c-ae08-28a815444e8b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:22.795150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cf3d85ef-ff32-479c-ae08-28a815444e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:22.810769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:22.815883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:22.875565 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 488/988] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:59:22.877110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5988e4-2a10-4eb3-8d37-9de78451c8a4 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:22.912178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90623ce7-ce2c-4e12-8110-d2e8d9c99195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:22.912793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90623ce7-ce2c-4e12-8110-d2e8d9c99195 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:22.913066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90623ce7-ce2c-4e12-8110-d2e8d9c99195 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:22.913329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90623ce7-ce2c-4e12-8110-d2e8d9c99195 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:22.913979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90623ce7-ce2c-4e12-8110-d2e8d9c99195 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:22.914277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90623ce7-ce2c-4e12-8110-d2e8d9c99195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:22.915639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90623ce7-ce2c-4e12-8110-d2e8d9c99195 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:22.925725 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 501/989] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 03:59:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:22.927362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d85ef-ff32-479c-ae08-28a815444e8b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:23.028332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d85ef-ff32-479c-ae08-28a815444e8b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:23.063732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ecb5c-8954-46b0-8ce8-277c9756411a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:23.064351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ecb5c-8954-46b0-8ce8-277c9756411a None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:23.064626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ecb5c-8954-46b0-8ce8-277c9756411a None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:23.064963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ecb5c-8954-46b0-8ce8-277c9756411a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:23.065762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ecb5c-8954-46b0-8ce8-277c9756411a None admin] RBAC: Adding query filter params (interface=admin, service_id=05ff80311a6346698a3025f00e644409, region_id=RegionOne) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:23.066108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ecb5c-8954-46b0-8ce8-277c9756411a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:23.067502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906ecb5c-8954-46b0-8ce8-277c9756411a None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:23.072696 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 489/990] 10.222.0.43 () {56 vars in 1249 bytes} [Tue Aug 30 03:59:22 2022] GET /identity/v3/endpoints?service_id=05ff80311a6346698a3025f00e644409&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:23.078421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90623ce7-ce2c-4e12-8110-d2e8d9c99195 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:23.147628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ecb5c-8954-46b0-8ce8-277c9756411a None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:23.169582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:23.187548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90623ce7-ce2c-4e12-8110-d2e8d9c99195 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:23.189128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:23.224816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d4461-306d-427c-b08d-b8539e20ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:23.225432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d4461-306d-427c-b08d-b8539e20ded6 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:23.225705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d4461-306d-427c-b08d-b8539e20ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:23.225998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d4461-306d-427c-b08d-b8539e20ded6 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:23.226606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d4461-306d-427c-b08d-b8539e20ded6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:23.227979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d4461-306d-427c-b08d-b8539e20ded6 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:23.236318 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 502/991] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 03:59:23 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 03:59:23.262986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ecb5c-8954-46b0-8ce8-277c9756411a None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:23.306434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15be34-adc5-4a7e-b45b-4650564e64a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:23.307136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15be34-adc5-4a7e-b45b-4650564e64a7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:23.307399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15be34-adc5-4a7e-b45b-4650564e64a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:23.307663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15be34-adc5-4a7e-b45b-4650564e64a7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:23.308259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15be34-adc5-4a7e-b45b-4650564e64a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:23.309667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad15be34-adc5-4a7e-b45b-4650564e64a7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-ad15be34-adc5-4a7e-b45b-4650564e64a7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:23.319801 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:23.320917 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:23.321766 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 490/992] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:23.327254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d4461-306d-427c-b08d-b8539e20ded6 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:23.441211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d4461-306d-427c-b08d-b8539e20ded6 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:23.476828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e52e51-39fb-4b33-b76b-35840cd3fd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:23.477495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e52e51-39fb-4b33-b76b-35840cd3fd8a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:23.477717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e52e51-39fb-4b33-b76b-35840cd3fd8a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:23.477983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e52e51-39fb-4b33-b76b-35840cd3fd8a None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:23.478605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e52e51-39fb-4b33-b76b-35840cd3fd8a None admin] RBAC: Adding query filter params (name=compute) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:23.478902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e52e51-39fb-4b33-b76b-35840cd3fd8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:23.480265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e52e51-39fb-4b33-b76b-35840cd3fd8a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:23.485598 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 503/993] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:59:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:23.491283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15be34-adc5-4a7e-b45b-4650564e64a7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:23.579489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:23.601197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15be34-adc5-4a7e-b45b-4650564e64a7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:23.643957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036c7a8-6bc3-414a-a4ae-996814df68e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:23.644595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c7a8-6bc3-414a-a4ae-996814df68e5 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:23.644870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c7a8-6bc3-414a-a4ae-996814df68e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:23.645137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c7a8-6bc3-414a-a4ae-996814df68e5 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:23.645781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036c7a8-6bc3-414a-a4ae-996814df68e5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:23.646107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036c7a8-6bc3-414a-a4ae-996814df68e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:23.647498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036c7a8-6bc3-414a-a4ae-996814df68e5 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:23.653044 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 491/994] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:59:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:23.658987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e52e51-39fb-4b33-b76b-35840cd3fd8a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:23.696675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:23.771224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e52e51-39fb-4b33-b76b-35840cd3fd8a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:23.806505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32ad2b-cfdf-491f-9bda-1619068a7ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:23.807114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32ad2b-cfdf-491f-9bda-1619068a7ddc None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:23.807382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32ad2b-cfdf-491f-9bda-1619068a7ddc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:23.807646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32ad2b-cfdf-491f-9bda-1619068a7ddc None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:23.808335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32ad2b-cfdf-491f-9bda-1619068a7ddc None admin] RBAC: Adding query filter params (interface=public, service_id=f8d009d9795f43b191aa281126862257, region_id=RegionOne) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:23.808633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32ad2b-cfdf-491f-9bda-1619068a7ddc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:23.810062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32ad2b-cfdf-491f-9bda-1619068a7ddc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:23.816020 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 504/995] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 03:59:23 2022] GET /identity/v3/endpoints?service_id=f8d009d9795f43b191aa281126862257&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:23.821475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036c7a8-6bc3-414a-a4ae-996814df68e5 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:23.933041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036c7a8-6bc3-414a-a4ae-996814df68e5 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:23.968113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbe528-e31a-480e-857c-525c0837047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:23.968724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe528-e31a-480e-857c-525c0837047e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:23.969001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe528-e31a-480e-857c-525c0837047e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:23.969266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbe528-e31a-480e-857c-525c0837047e None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:23.969867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbe528-e31a-480e-857c-525c0837047e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:23.971334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbe528-e31a-480e-857c-525c0837047e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:23.978441 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 492/996] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 03:59:23 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 03:59:24.134230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa79ee-eccf-4339-a1ed-aa70553dae63 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:24.134505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa79ee-eccf-4339-a1ed-aa70553dae63 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:24.134767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa79ee-eccf-4339-a1ed-aa70553dae63 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:24.136151 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 505/997] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:24.141767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbfcba-3169-4aae-afb7-0cc8e82d5e69 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:24.142150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbfcba-3169-4aae-afb7-0cc8e82d5e69 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:24.142422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efbfcba-3169-4aae-afb7-0cc8e82d5e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:24.161515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5efbfcba-3169-4aae-afb7-0cc8e82d5e69 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:24.163389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5efbfcba-3169-4aae-afb7-0cc8e82d5e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:24.166733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:24.235696 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 493/998] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:24.496218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa79ee-eccf-4339-a1ed-aa70553dae63 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:24.598567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:24.607757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa79ee-eccf-4339-a1ed-aa70553dae63 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:24.649903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a931-8245-40cd-befd-6635f1d1ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:24.650592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a931-8245-40cd-befd-6635f1d1ed7b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:24.650867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a931-8245-40cd-befd-6635f1d1ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:24.651203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a931-8245-40cd-befd-6635f1d1ed7b None admin] PATH_INFO: `/v3/services/image` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:24.651952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82a931-8245-40cd-befd-6635f1d1ed7b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:24.653537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82a931-8245-40cd-befd-6635f1d1ed7b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-1e82a931-8245-40cd-befd-6635f1d1ed7b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:24.663429 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:24.664416 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:24.665252 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 506/999] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Aug 30 03:59:24 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:24.671965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbfcba-3169-4aae-afb7-0cc8e82d5e69 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:24.778071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efbfcba-3169-4aae-afb7-0cc8e82d5e69 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:24.811972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fddafd-f7ef-4a69-9305-26593fe41812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:24.812586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fddafd-f7ef-4a69-9305-26593fe41812 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:24.812858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fddafd-f7ef-4a69-9305-26593fe41812 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:24.813125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fddafd-f7ef-4a69-9305-26593fe41812 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:24.813756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fddafd-f7ef-4a69-9305-26593fe41812 None admin] RBAC: Adding query filter params (name=image) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:24.814068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fddafd-f7ef-4a69-9305-26593fe41812 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:24.815748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fddafd-f7ef-4a69-9305-26593fe41812 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:24.825466 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 494/1000] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:24.827151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a931-8245-40cd-befd-6635f1d1ed7b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:24.935950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a931-8245-40cd-befd-6635f1d1ed7b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:24.971658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf0e1-c10c-4646-a7c0-c39e8377541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:24.972276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf0e1-c10c-4646-a7c0-c39e8377541b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:24.972550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf0e1-c10c-4646-a7c0-c39e8377541b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:24.972833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf0e1-c10c-4646-a7c0-c39e8377541b None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:24.973553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adf0e1-c10c-4646-a7c0-c39e8377541b None admin] RBAC: Adding query filter params (type=image) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:24.973855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adf0e1-c10c-4646-a7c0-c39e8377541b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:24.975265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adf0e1-c10c-4646-a7c0-c39e8377541b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:24.986144 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 507/1001] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:24 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:25.150292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e47e-37f1-4d39-b51a-2af07cad5548 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:25.150636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e47e-37f1-4d39-b51a-2af07cad5548 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:25.150840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e47e-37f1-4d39-b51a-2af07cad5548 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:25.152402 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 495/1002] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:25.157774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64f09c-8cb5-4292-8211-9ae444a67bcb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:25.158097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64f09c-8cb5-4292-8211-9ae444a67bcb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:25.158370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64f09c-8cb5-4292-8211-9ae444a67bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:25.178818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1d64f09c-8cb5-4292-8211-9ae444a67bcb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:25.180451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1d64f09c-8cb5-4292-8211-9ae444a67bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:25.198762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:25.256154 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 508/1003] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:25.515995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932e47e-37f1-4d39-b51a-2af07cad5548 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:25.520396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:25.625278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932e47e-37f1-4d39-b51a-2af07cad5548 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:25.664680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65155f94-17dc-4c2d-bbc4-85debb8e5097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:25.665400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65155f94-17dc-4c2d-bbc4-85debb8e5097 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:25.665680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65155f94-17dc-4c2d-bbc4-85debb8e5097 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:25.665977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65155f94-17dc-4c2d-bbc4-85debb8e5097 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:25.666586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65155f94-17dc-4c2d-bbc4-85debb8e5097 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:25.667979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65155f94-17dc-4c2d-bbc4-85debb8e5097 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-65155f94-17dc-4c2d-bbc4-85debb8e5097 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:25.677171 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:25.678234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:25.684070 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 496/1004] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 03:59:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:25.684905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64f09c-8cb5-4292-8211-9ae444a67bcb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:25.789398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64f09c-8cb5-4292-8211-9ae444a67bcb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:25.825290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c61f46-57b4-4035-851f-36ae04baead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:25.825906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c61f46-57b4-4035-851f-36ae04baead3 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:25.826198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c61f46-57b4-4035-851f-36ae04baead3 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:25.826467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c61f46-57b4-4035-851f-36ae04baead3 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:25.827097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c61f46-57b4-4035-851f-36ae04baead3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:25.827394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c61f46-57b4-4035-851f-36ae04baead3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:25.828756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c61f46-57b4-4035-851f-36ae04baead3 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:25.834059 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 509/1005] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 03:59:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:25.839842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65155f94-17dc-4c2d-bbc4-85debb8e5097 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:25.878729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44e89-90fa-42a4-8a7b-afdcc8d72f1b None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:25.879024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44e89-90fa-42a4-8a7b-afdcc8d72f1b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:25.879286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa44e89-90fa-42a4-8a7b-afdcc8d72f1b None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:25.880642 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 510/1006] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:59:25.885408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54a4bd-f401-48ed-be2c-a099e6c79446 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:25.885686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54a4bd-f401-48ed-be2c-a099e6c79446 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:25.885981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af54a4bd-f401-48ed-be2c-a099e6c79446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:25.905221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-af54a4bd-f401-48ed-be2c-a099e6c79446 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:25.906460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-af54a4bd-f401-48ed-be2c-a099e6c79446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:25.918580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:25.920496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:25.960108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65155f94-17dc-4c2d-bbc4-85debb8e5097 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:25.981342 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 511/1007] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:59:25.999885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36758f5-a4bb-4613-9052-659d6c12828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:26.000735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36758f5-a4bb-4613-9052-659d6c12828f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:26.001159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36758f5-a4bb-4613-9052-659d6c12828f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:26.001573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36758f5-a4bb-4613-9052-659d6c12828f None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:26.002390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36758f5-a4bb-4613-9052-659d6c12828f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:26.003095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36758f5-a4bb-4613-9052-659d6c12828f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:26.005132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36758f5-a4bb-4613-9052-659d6c12828f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:26.010966 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 497/1008] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 03:59:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:26.016867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54a4bd-f401-48ed-be2c-a099e6c79446 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:26.125380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af54a4bd-f401-48ed-be2c-a099e6c79446 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:26.161125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2974e-4788-4c3f-92fd-48dcd1d6662d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:26.161738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2974e-4788-4c3f-92fd-48dcd1d6662d None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:26.162041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2974e-4788-4c3f-92fd-48dcd1d6662d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:26.162296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2974e-4788-4c3f-92fd-48dcd1d6662d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:26.162952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2974e-4788-4c3f-92fd-48dcd1d6662d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:26.164320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2974e-4788-4c3f-92fd-48dcd1d6662d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:26.185913 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 512/1009] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 03:59:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:26.243764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36758f5-a4bb-4613-9052-659d6c12828f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:26.352171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36758f5-a4bb-4613-9052-659d6c12828f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:26.382968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:26.394872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175074-b3b7-496f-90f2-595366f5302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:26.395501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175074-b3b7-496f-90f2-595366f5302d None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:26.395779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175074-b3b7-496f-90f2-595366f5302d None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:26.396035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50175074-b3b7-496f-90f2-595366f5302d None admin] PATH_INFO: `/v3/services/compute` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:26.396609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50175074-b3b7-496f-90f2-595366f5302d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:26.398000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50175074-b3b7-496f-90f2-595366f5302d None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-50175074-b3b7-496f-90f2-595366f5302d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:26.406761 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:26.407774 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:26.408704 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 498/1010] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:26.415629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2974e-4788-4c3f-92fd-48dcd1d6662d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:26.424564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:26.522636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2974e-4788-4c3f-92fd-48dcd1d6662d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:26.557315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b79eb0-d04f-4fb0-9d39-d152d413d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:26.557961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b79eb0-d04f-4fb0-9d39-d152d413d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:26.558226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b79eb0-d04f-4fb0-9d39-d152d413d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:26.558490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b79eb0-d04f-4fb0-9d39-d152d413d7f1 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:26.559112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b79eb0-d04f-4fb0-9d39-d152d413d7f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:26.559407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b79eb0-d04f-4fb0-9d39-d152d413d7f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:26.560841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b79eb0-d04f-4fb0-9d39-d152d413d7f1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:26.566527 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 513/1011] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:59:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:26.572216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175074-b3b7-496f-90f2-595366f5302d None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:26.678942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50175074-b3b7-496f-90f2-595366f5302d None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:26.718551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3ee8b-008c-4ef5-8c25-82592c11507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:26.719168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3ee8b-008c-4ef5-8c25-82592c11507c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:26.719438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3ee8b-008c-4ef5-8c25-82592c11507c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:26.719710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3ee8b-008c-4ef5-8c25-82592c11507c None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:26.720341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3ee8b-008c-4ef5-8c25-82592c11507c None admin] RBAC: Adding query filter params (type=compute) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:26.720638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3ee8b-008c-4ef5-8c25-82592c11507c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:26.722074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3ee8b-008c-4ef5-8c25-82592c11507c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:26.732146 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 499/1012] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 03:59:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:26.733322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b79eb0-d04f-4fb0-9d39-d152d413d7f1 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:26.805530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:26.839888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b79eb0-d04f-4fb0-9d39-d152d413d7f1 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:26.874463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbadb44-f885-478f-b7c9-68d1f0ef92cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:26.875071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbadb44-f885-478f-b7c9-68d1f0ef92cc None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:26.875347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbadb44-f885-478f-b7c9-68d1f0ef92cc None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:26.875610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbadb44-f885-478f-b7c9-68d1f0ef92cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:26.876265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbadb44-f885-478f-b7c9-68d1f0ef92cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:26.877662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbadb44-f885-478f-b7c9-68d1f0ef92cc None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:26.888171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af697b25-7780-4110-a5c9-473a40f01e6e None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:26.889197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af697b25-7780-4110-a5c9-473a40f01e6e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:26.889426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af697b25-7780-4110-a5c9-473a40f01e6e None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:26.890819 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 500/1013] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:26.896455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef64877-8467-405e-9e16-207f054f7f4d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:26.896806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef64877-8467-405e-9e16-207f054f7f4d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:26.897142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef64877-8467-405e-9e16-207f054f7f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:26.905355 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 514/1014] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 03:59:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:26.916980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1ef64877-8467-405e-9e16-207f054f7f4d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:26.918401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ef64877-8467-405e-9e16-207f054f7f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:26.984640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:27.020898 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 501/1015] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:26 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:27.284908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbadb44-f885-478f-b7c9-68d1f0ef92cc None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:27.389767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbadb44-f885-478f-b7c9-68d1f0ef92cc None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:27.415002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:27.425625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fabe50-3572-4813-87ab-7d635fb94051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:27.426280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fabe50-3572-4813-87ab-7d635fb94051 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:27.426571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fabe50-3572-4813-87ab-7d635fb94051 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:27.426823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fabe50-3572-4813-87ab-7d635fb94051 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:27.427488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fabe50-3572-4813-87ab-7d635fb94051 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:27.428860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fabe50-3572-4813-87ab-7d635fb94051 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:27.445914 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 515/1016] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:59:27 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:28.117716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad3af-3360-4750-adb2-2616191710cf None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:28.118311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad3af-3360-4750-adb2-2616191710cf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:28.118311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad3af-3360-4750-adb2-2616191710cf None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:28.119723 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 502/1017] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:28.125830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d511155-be93-4800-b328-6b3441669971 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:28.126379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d511155-be93-4800-b328-6b3441669971 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:28.126379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d511155-be93-4800-b328-6b3441669971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:28.145502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2d511155-be93-4800-b328-6b3441669971 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:28.146719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2d511155-be93-4800-b328-6b3441669971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:28.219752 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 516/1018] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:28.480092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ad3af-3360-4750-adb2-2616191710cf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:28.591391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ad3af-3360-4750-adb2-2616191710cf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:28.626013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb26991-7930-4bbf-8b31-fce4fc41a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:28.626642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb26991-7930-4bbf-8b31-fce4fc41a94e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:28.626916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb26991-7930-4bbf-8b31-fce4fc41a94e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:28.627180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb26991-7930-4bbf-8b31-fce4fc41a94e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:28.628394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb26991-7930-4bbf-8b31-fce4fc41a94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:28.629867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb26991-7930-4bbf-8b31-fce4fc41a94e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:28.631661 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 503/1019] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:28.638571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d511155-be93-4800-b328-6b3441669971 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:28.748012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d511155-be93-4800-b328-6b3441669971 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:28.763939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:28.788369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcf121-c491-4aed-8086-cb0c055cae2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:28.789256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf121-c491-4aed-8086-cb0c055cae2c None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:28.789670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf121-c491-4aed-8086-cb0c055cae2c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:28.790115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcf121-c491-4aed-8086-cb0c055cae2c None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:28.790898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcf121-c491-4aed-8086-cb0c055cae2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:28.792458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcf121-c491-4aed-8086-cb0c055cae2c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:28.821253 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 517/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:59:28 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:28.983929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a9e0-3a08-4507-8712-6751c888adcd None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:28.984141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a9e0-3a08-4507-8712-6751c888adcd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:28.984412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4a9e0-3a08-4507-8712-6751c888adcd None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:28.985786 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 504/1021] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:28.991849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ffd39-c63b-4295-bae9-c60acc492770 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:28.992140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ffd39-c63b-4295-bae9-c60acc492770 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:28.992409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ffd39-c63b-4295-bae9-c60acc492770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:29.012738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-724ffd39-c63b-4295-bae9-c60acc492770 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:29.013854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-724ffd39-c63b-4295-bae9-c60acc492770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:29.086497 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 518/1022] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:29.351296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4a9e0-3a08-4507-8712-6751c888adcd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:29.379391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f270-faed-4669-b45c-ea657211780d None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:29.379930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f270-faed-4669-b45c-ea657211780d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:29.379930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f270-faed-4669-b45c-ea657211780d None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:29.381301 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 519/1023] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:29.386383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286bd64-727e-49cb-94b4-f6d7a5a0d342 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:29.386774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286bd64-727e-49cb-94b4-f6d7a5a0d342 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:29.387041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286bd64-727e-49cb-94b4-f6d7a5a0d342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:29.407711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0286bd64-727e-49cb-94b4-f6d7a5a0d342 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:29.408911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0286bd64-727e-49cb-94b4-f6d7a5a0d342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:29.412955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:29.470093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4a9e0-3a08-4507-8712-6751c888adcd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:29.483236 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 520/1024] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:29.507889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20df6c-3ca7-40b3-955f-a7b25365a9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:29.508527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20df6c-3ca7-40b3-955f-a7b25365a9fa None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:29.508799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20df6c-3ca7-40b3-955f-a7b25365a9fa None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:29.509064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20df6c-3ca7-40b3-955f-a7b25365a9fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:29.519800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20df6c-3ca7-40b3-955f-a7b25365a9fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-dc20df6c-3ca7-40b3-955f-a7b25365a9fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:29.524610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:29.525796 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:29.527386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:29.528577 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 505/1025] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 03:59:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:29.531752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286bd64-727e-49cb-94b4-f6d7a5a0d342 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:29.558046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:29.641022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286bd64-727e-49cb-94b4-f6d7a5a0d342 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:29.677508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc75132-3a16-4cf6-bd18-e0a1e1dbcfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:29.680855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc75132-3a16-4cf6-bd18-e0a1e1dbcfe9 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:29.680855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc75132-3a16-4cf6-bd18-e0a1e1dbcfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:29.680855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc75132-3a16-4cf6-bd18-e0a1e1dbcfe9 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:29.680855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc75132-3a16-4cf6-bd18-e0a1e1dbcfe9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:29.680855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc75132-3a16-4cf6-bd18-e0a1e1dbcfe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:29.681351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc75132-3a16-4cf6-bd18-e0a1e1dbcfe9 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:29.689848 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 521/1026] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 03:59:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:29.695747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20df6c-3ca7-40b3-955f-a7b25365a9fa None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:29.749902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc75132-3a16-4cf6-bd18-e0a1e1dbcfe9 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:29.809212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20df6c-3ca7-40b3-955f-a7b25365a9fa None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:29.820822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:29.843920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:29.844863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cd73d-1549-4915-9f1a-56a1dc725202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:29.845557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cd73d-1549-4915-9f1a-56a1dc725202 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:29.845854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cd73d-1549-4915-9f1a-56a1dc725202 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:29.846137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cd73d-1549-4915-9f1a-56a1dc725202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:29.857150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cd73d-1549-4915-9f1a-56a1dc725202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:29.858681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cd73d-1549-4915-9f1a-56a1dc725202 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:29.863336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc75132-3a16-4cf6-bd18-e0a1e1dbcfe9 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-d86cd73d-1549-4915-9f1a-56a1dc725202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:29.875590 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:29.876742 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:29.878004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:29.878004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:29.878004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:29.878004 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 506/1027] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:29.882583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cd73d-1549-4915-9f1a-56a1dc725202 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:29.903159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4f21c-b902-4155-8bbe-594e4543ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:29.903744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4f21c-b902-4155-8bbe-594e4543ae77 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:29.904012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4f21c-b902-4155-8bbe-594e4543ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:29.904273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4f21c-b902-4155-8bbe-594e4543ae77 None admin] PATH_INFO: `/v3/services/image` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:29.904849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4f21c-b902-4155-8bbe-594e4543ae77 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:29.906242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4f21c-b902-4155-8bbe-594e4543ae77 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-65e4f21c-b902-4155-8bbe-594e4543ae77 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:29.915579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:29.916801 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:29.917763 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 522/1028] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Aug 30 03:59:29 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:29.922790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4f21c-b902-4155-8bbe-594e4543ae77 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:30.003960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cd73d-1549-4915-9f1a-56a1dc725202 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:30.038671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4f21c-b902-4155-8bbe-594e4543ae77 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:30.042189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ab9b8-3a07-4b51-b54b-b10d71cf254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:30.042799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ab9b8-3a07-4b51-b54b-b10d71cf254e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.043073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ab9b8-3a07-4b51-b54b-b10d71cf254e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.043338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ab9b8-3a07-4b51-b54b-b10d71cf254e None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.043979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ab9b8-3a07-4b51-b54b-b10d71cf254e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:30.044277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ab9b8-3a07-4b51-b54b-b10d71cf254e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:30.045660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ab9b8-3a07-4b51-b54b-b10d71cf254e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:30.058827 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 507/1029] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:30.064258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ab9b8-3a07-4b51-b54b-b10d71cf254e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:30.075519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2b230-dc67-4354-9ba4-522d3ab5da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:30.076141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2b230-dc67-4354-9ba4-522d3ab5da3a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.076420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2b230-dc67-4354-9ba4-522d3ab5da3a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.076687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2b230-dc67-4354-9ba4-522d3ab5da3a None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.077308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2b230-dc67-4354-9ba4-522d3ab5da3a None admin] RBAC: Adding query filter params (name=image) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:30.077616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2b230-dc67-4354-9ba4-522d3ab5da3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:30.079012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2b230-dc67-4354-9ba4-522d3ab5da3a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:30.088645 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 523/1030] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:30.089641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2b230-dc67-4354-9ba4-522d3ab5da3a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:30.095115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:30.107736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:30.178379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ab9b8-3a07-4b51-b54b-b10d71cf254e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:30.191355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2b230-dc67-4354-9ba4-522d3ab5da3a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:30.213836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adae4c9-cd7e-4f20-bea7-d28de303e7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:30.214602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae4c9-cd7e-4f20-bea7-d28de303e7ff None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.214896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae4c9-cd7e-4f20-bea7-d28de303e7ff None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.215127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae4c9-cd7e-4f20-bea7-d28de303e7ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.222892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adae4c9-cd7e-4f20-bea7-d28de303e7ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:30.224527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adae4c9-cd7e-4f20-bea7-d28de303e7ff None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:30.224894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbaa47-e32e-412a-9979-79a36a80e690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:30.225504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbaa47-e32e-412a-9979-79a36a80e690 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.225772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbaa47-e32e-412a-9979-79a36a80e690 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.226070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbaa47-e32e-412a-9979-79a36a80e690 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.226694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbaa47-e32e-412a-9979-79a36a80e690 None admin] RBAC: Adding query filter params (type=image) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:30.227015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbaa47-e32e-412a-9979-79a36a80e690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:30.228379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbaa47-e32e-412a-9979-79a36a80e690 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:30.233440 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 524/1031] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-1adae4c9-cd7e-4f20-bea7-d28de303e7ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:59:30.238192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:30.239454 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:30.240564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:30.240564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:30.240564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:30.240564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:30.240564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:30.240564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:30.240564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:30.240564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:30.240564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:59:30.240564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:30.241133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbaa47-e32e-412a-9979-79a36a80e690 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:30.244294 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 508/1032] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 03:59:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:30.244981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adae4c9-cd7e-4f20-bea7-d28de303e7ff None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:30.327416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:30.334521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:30.352202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbaa47-e32e-412a-9979-79a36a80e690 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:30.354261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adae4c9-cd7e-4f20-bea7-d28de303e7ff None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:30.388618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41013eab-4a22-4d7a-b880-0b9fe27d7a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:30.389054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970357e-b35b-46b7-8a2d-d183e732ce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:30.389499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41013eab-4a22-4d7a-b880-0b9fe27d7a35 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.389499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41013eab-4a22-4d7a-b880-0b9fe27d7a35 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.389741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970357e-b35b-46b7-8a2d-d183e732ce79 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.389859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41013eab-4a22-4d7a-b880-0b9fe27d7a35 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.389976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970357e-b35b-46b7-8a2d-d183e732ce79 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.390230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970357e-b35b-46b7-8a2d-d183e732ce79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.390465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41013eab-4a22-4d7a-b880-0b9fe27d7a35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:30.390762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41013eab-4a22-4d7a-b880-0b9fe27d7a35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:30.390929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970357e-b35b-46b7-8a2d-d183e732ce79 None admin] RBAC: Adding query filter params (interface=public, service_id=673275ce86a84bd5905e26fd9eae20cc, region_id=RegionOne) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:30.391228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970357e-b35b-46b7-8a2d-d183e732ce79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:30.392203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41013eab-4a22-4d7a-b880-0b9fe27d7a35 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:30.392582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970357e-b35b-46b7-8a2d-d183e732ce79 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:30.398562 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 525/1033] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 03:59:30 2022] GET /identity/v3/endpoints?service_id=673275ce86a84bd5905e26fd9eae20cc&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:30.404039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970357e-b35b-46b7-8a2d-d183e732ce79 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:30.415996 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 509/1034] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 03:59:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:30.417255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41013eab-4a22-4d7a-b880-0b9fe27d7a35 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:30.510596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970357e-b35b-46b7-8a2d-d183e732ce79 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:30.523964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41013eab-4a22-4d7a-b880-0b9fe27d7a35 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:30.545018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b2413-c867-4473-8f25-519b07853d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:30.545628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b2413-c867-4473-8f25-519b07853d0a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.545917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b2413-c867-4473-8f25-519b07853d0a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.546188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b2413-c867-4473-8f25-519b07853d0a None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.546802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b2413-c867-4473-8f25-519b07853d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:30.548164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b2413-c867-4473-8f25-519b07853d0a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:30.555012 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 526/1035] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 03:59:30 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 03:59:30.572962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded980d-48c2-4c87-ac13-f26e8530a275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:30.573594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded980d-48c2-4c87-ac13-f26e8530a275 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.573864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded980d-48c2-4c87-ac13-f26e8530a275 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.574170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded980d-48c2-4c87-ac13-f26e8530a275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.587324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:30.653125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded980d-48c2-4c87-ac13-f26e8530a275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:30.654683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded980d-48c2-4c87-ac13-f26e8530a275 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:30.765283 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 510/1036] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:30.771599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b2413-c867-4473-8f25-519b07853d0a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:30.782318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:30.877895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9888d5-4d5e-46cf-b1f4-445594d99140 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.878298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9888d5-4d5e-46cf-b1f4-445594d99140 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.878973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9888d5-4d5e-46cf-b1f4-445594d99140 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.880063 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 511/1037] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:30.883281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b2413-c867-4473-8f25-519b07853d0a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:30.885064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2962773-7969-46e3-91af-c246dac87c8d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.885345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2962773-7969-46e3-91af-c246dac87c8d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.885909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2962773-7969-46e3-91af-c246dac87c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.904335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b2962773-7969-46e3-91af-c246dac87c8d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:30.905544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b2962773-7969-46e3-91af-c246dac87c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:30.920034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a95d-aaae-4a96-8c0f-69bfc36473f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:30.920703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a95d-aaae-4a96-8c0f-69bfc36473f2 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:30.920944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a95d-aaae-4a96-8c0f-69bfc36473f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:30.921208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a95d-aaae-4a96-8c0f-69bfc36473f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:30.932370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0a95d-aaae-4a96-8c0f-69bfc36473f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:30.933845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be0a95d-aaae-4a96-8c0f-69bfc36473f2 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:30.945649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-1be0a95d-aaae-4a96-8c0f-69bfc36473f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:30.949088 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:30.950151 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:30.951072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:30.951072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:30.951072 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:30.955067 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 527/1038] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:30.955918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a95d-aaae-4a96-8c0f-69bfc36473f2 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:30.983022 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 512/1039] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:31.016707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:31.060292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a95d-aaae-4a96-8c0f-69bfc36473f2 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:31.095915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf449a-987f-4606-ab13-e308212de1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:31.096527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf449a-987f-4606-ab13-e308212de1ee None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:31.096798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf449a-987f-4606-ab13-e308212de1ee None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:31.097113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf449a-987f-4606-ab13-e308212de1ee None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:31.097759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf449a-987f-4606-ab13-e308212de1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:31.098175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf449a-987f-4606-ab13-e308212de1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:31.099550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf449a-987f-4606-ab13-e308212de1ee None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:31.112028 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 528/1040] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:31.118357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2962773-7969-46e3-91af-c246dac87c8d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:31.219175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2962773-7969-46e3-91af-c246dac87c8d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:31.253091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf449a-987f-4606-ab13-e308212de1ee None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:31.257724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498f75-9cf1-4efc-bf64-d5f8b2acf2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:31.258412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498f75-9cf1-4efc-bf64-d5f8b2acf2db None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:31.258690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498f75-9cf1-4efc-bf64-d5f8b2acf2db None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:31.258953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5498f75-9cf1-4efc-bf64-d5f8b2acf2db None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:31.265788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5498f75-9cf1-4efc-bf64-d5f8b2acf2db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:31.267347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5498f75-9cf1-4efc-bf64-d5f8b2acf2db None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-b5498f75-9cf1-4efc-bf64-d5f8b2acf2db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:31.278712 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:31.279625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:31.280529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:31.280529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:31.280529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:31.280529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:31.280529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:31.280529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:31.280529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:31.280529 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:31.280529 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 513/1041] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:31.285665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498f75-9cf1-4efc-bf64-d5f8b2acf2db None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:31.320568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:31.365437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf449a-987f-4606-ab13-e308212de1ee None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:31.384921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:31.394275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5498f75-9cf1-4efc-bf64-d5f8b2acf2db None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:31.403059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53846e3a-d66b-454e-b9f8-3aae03b75170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:31.404177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53846e3a-d66b-454e-b9f8-3aae03b75170 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:31.404625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53846e3a-d66b-454e-b9f8-3aae03b75170 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:31.405026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53846e3a-d66b-454e-b9f8-3aae03b75170 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:31.406310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53846e3a-d66b-454e-b9f8-3aae03b75170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:31.407896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53846e3a-d66b-454e-b9f8-3aae03b75170 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:31.414656 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 529/1042] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:31.415679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53846e3a-d66b-454e-b9f8-3aae03b75170 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:31.429838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ca526-a879-452d-930f-36945eaba699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:31.430841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ca526-a879-452d-930f-36945eaba699 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:31.431287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ca526-a879-452d-930f-36945eaba699 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:31.432034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ca526-a879-452d-930f-36945eaba699 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:31.433166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ca526-a879-452d-930f-36945eaba699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:31.433614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ca526-a879-452d-930f-36945eaba699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:31.435726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ca526-a879-452d-930f-36945eaba699 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:31.452114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 514/1043] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:31.458634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ca526-a879-452d-930f-36945eaba699 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:31.523213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53846e3a-d66b-454e-b9f8-3aae03b75170 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:31.558152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:31.559856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d394be1e-2375-4ed6-99d3-652e63a54359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:31.560464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394be1e-2375-4ed6-99d3-652e63a54359 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:31.560686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394be1e-2375-4ed6-99d3-652e63a54359 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:31.560952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d394be1e-2375-4ed6-99d3-652e63a54359 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:31.561703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394be1e-2375-4ed6-99d3-652e63a54359 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:31.563216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d394be1e-2375-4ed6-99d3-652e63a54359 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:31.569732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ca526-a879-452d-930f-36945eaba699 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:31.587619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 530/1044] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:59:31 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:31.609117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9ac8a-c2ac-4b6c-ab4f-56af42f8b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:31.609758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ac8a-c2ac-4b6c-ab4f-56af42f8b8ee None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:31.610073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ac8a-c2ac-4b6c-ab4f-56af42f8b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:31.610344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9ac8a-c2ac-4b6c-ab4f-56af42f8b8ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:31.611099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9ac8a-c2ac-4b6c-ab4f-56af42f8b8ee None admin] RBAC: Adding query filter params (role.id=c0df7bf5ce494e0ab735be8639aec320, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d3a99d39337841849b3e2efe48ebe53c) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:31.611406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9ac8a-c2ac-4b6c-ab4f-56af42f8b8ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:31.612997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9ac8a-c2ac-4b6c-ab4f-56af42f8b8ee None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:31.626083 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 515/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:31 2022] GET /identity/v3/role_assignments?user.id=d3a99d39337841849b3e2efe48ebe53c&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=c0df7bf5ce494e0ab735be8639aec320 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:32.493756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9163aa-8691-48bc-8724-45bf3f34c7eb None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:32.494372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9163aa-8691-48bc-8724-45bf3f34c7eb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:32.494372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9163aa-8691-48bc-8724-45bf3f34c7eb None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:32.495640 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 531/1046] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:32.501180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e877b6e-ef3e-4668-bccb-401c23f14b4f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:32.501625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e877b6e-ef3e-4668-bccb-401c23f14b4f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:32.501707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e877b6e-ef3e-4668-bccb-401c23f14b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:32.520468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3e877b6e-ef3e-4668-bccb-401c23f14b4f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:32.521653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3e877b6e-ef3e-4668-bccb-401c23f14b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:32.589471 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 516/1047] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:32.854532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9163aa-8691-48bc-8724-45bf3f34c7eb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:32.900574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:32.963484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9163aa-8691-48bc-8724-45bf3f34c7eb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:33.001563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6314a2a-60b4-47e6-b852-ce5be6640af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:33.002240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314a2a-60b4-47e6-b852-ce5be6640af3 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:33.002516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314a2a-60b4-47e6-b852-ce5be6640af3 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:33.002784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314a2a-60b4-47e6-b852-ce5be6640af3 None admin] PATH_INFO: `/v3/services/image` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:33.003369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6314a2a-60b4-47e6-b852-ce5be6640af3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:33.005130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6314a2a-60b4-47e6-b852-ce5be6640af3 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-c6314a2a-60b4-47e6-b852-ce5be6640af3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:33.014304 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:33.015312 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:33.018751 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 532/1048] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Aug 30 03:59:32 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:33.022112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e877b6e-ef3e-4668-bccb-401c23f14b4f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:33.108928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:33.125844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e877b6e-ef3e-4668-bccb-401c23f14b4f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:33.160460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a645d9-cafb-4a32-ad84-9f8eb8c0c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:33.161079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a645d9-cafb-4a32-ad84-9f8eb8c0c0dc None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:33.161354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a645d9-cafb-4a32-ad84-9f8eb8c0c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:33.161622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a645d9-cafb-4a32-ad84-9f8eb8c0c0dc None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:33.162284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a645d9-cafb-4a32-ad84-9f8eb8c0c0dc None admin] RBAC: Adding query filter params (name=image) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:33.162587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a645d9-cafb-4a32-ad84-9f8eb8c0c0dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:33.163975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a645d9-cafb-4a32-ad84-9f8eb8c0c0dc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:33.173604 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 517/1049] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:33.175160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6314a2a-60b4-47e6-b852-ce5be6640af3 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:33.278185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6314a2a-60b4-47e6-b852-ce5be6640af3 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:33.286669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:33.314417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c98b16-f7e7-4967-998d-308b42ddfa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:33.315031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c98b16-f7e7-4967-998d-308b42ddfa4a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:33.315301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c98b16-f7e7-4967-998d-308b42ddfa4a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:33.315565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c98b16-f7e7-4967-998d-308b42ddfa4a None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:33.316755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c98b16-f7e7-4967-998d-308b42ddfa4a None admin] RBAC: Adding query filter params (type=image) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:33.316951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c98b16-f7e7-4967-998d-308b42ddfa4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:33.318354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c98b16-f7e7-4967-998d-308b42ddfa4a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:33.323355 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 533/1050] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:33.329270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a645d9-cafb-4a32-ad84-9f8eb8c0c0dc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:33.434245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a645d9-cafb-4a32-ad84-9f8eb8c0c0dc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:33.468556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358fd66-55cc-471b-879c-88f72ed0acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:33.469171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358fd66-55cc-471b-879c-88f72ed0acfc None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:33.469448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358fd66-55cc-471b-879c-88f72ed0acfc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:33.469715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358fd66-55cc-471b-879c-88f72ed0acfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:33.470417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358fd66-55cc-471b-879c-88f72ed0acfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:33.471807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358fd66-55cc-471b-879c-88f72ed0acfc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:33.492850 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 518/1051] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 03:59:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:33.522248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5f9e7-a3ef-4f99-8572-ca6b685d634a None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:33.522780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5f9e7-a3ef-4f99-8572-ca6b685d634a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:33.522780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5f9e7-a3ef-4f99-8572-ca6b685d634a None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:33.524360 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 534/1052] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:33.530375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8437a1-4fcb-42a8-b2b8-2e7a4fd65ce2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:33.530915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8437a1-4fcb-42a8-b2b8-2e7a4fd65ce2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:33.530915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8437a1-4fcb-42a8-b2b8-2e7a4fd65ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:33.539828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:33.553307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4e8437a1-4fcb-42a8-b2b8-2e7a4fd65ce2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:33.554565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4e8437a1-4fcb-42a8-b2b8-2e7a4fd65ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:33.613097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9085608-f40d-4b7e-ae35-cc0fffc866c2 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:33.613524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9085608-f40d-4b7e-ae35-cc0fffc866c2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:33.614110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9085608-f40d-4b7e-ae35-cc0fffc866c2 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:33.618297 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 535/1053] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:59:33.621421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060700f7-0444-444e-891f-2d0a4a28a36e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:33.621705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060700f7-0444-444e-891f-2d0a4a28a36e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:33.622011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060700f7-0444-444e-891f-2d0a4a28a36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:33.642731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-060700f7-0444-444e-891f-2d0a4a28a36e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:33.643975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-060700f7-0444-444e-891f-2d0a4a28a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:33.647349 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 519/1054] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:33.721069 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 536/1055] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:33.917851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8437a1-4fcb-42a8-b2b8-2e7a4fd65ce2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:33.989536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060700f7-0444-444e-891f-2d0a4a28a36e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:34.022010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8437a1-4fcb-42a8-b2b8-2e7a4fd65ce2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:34.056372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:34.063103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346176a-6cf5-46bb-9d00-a770dbd4ccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:34.064346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346176a-6cf5-46bb-9d00-a770dbd4ccb7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:34.064346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346176a-6cf5-46bb-9d00-a770dbd4ccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:34.064576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346176a-6cf5-46bb-9d00-a770dbd4ccb7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:34.075521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346176a-6cf5-46bb-9d00-a770dbd4ccb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3346176a-6cf5-46bb-9d00-a770dbd4ccb7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:34.080808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:34.086622 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:34.087570 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 520/1056] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 03:59:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:34.090051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346176a-6cf5-46bb-9d00-a770dbd4ccb7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:34.099074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:34.103032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060700f7-0444-444e-891f-2d0a4a28a36e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:34.149508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02947a5a-2d7d-48c8-aa79-5951590ec052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:34.150514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947a5a-2d7d-48c8-aa79-5951590ec052 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:34.150954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947a5a-2d7d-48c8-aa79-5951590ec052 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:34.151263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947a5a-2d7d-48c8-aa79-5951590ec052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:34.164866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02947a5a-2d7d-48c8-aa79-5951590ec052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-02947a5a-2d7d-48c8-aa79-5951590ec052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:34.171350 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:34.172292 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:34.174624 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 537/1057] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:59:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:34.179686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02947a5a-2d7d-48c8-aa79-5951590ec052 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:34.225229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346176a-6cf5-46bb-9d00-a770dbd4ccb7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:34.269770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9edbd-f740-4151-9958-73955ff926fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:34.270579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9edbd-f740-4151-9958-73955ff926fd None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:34.270984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9edbd-f740-4151-9958-73955ff926fd None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:34.271414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9edbd-f740-4151-9958-73955ff926fd None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:34.272202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9edbd-f740-4151-9958-73955ff926fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:34.272689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9edbd-f740-4151-9958-73955ff926fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:34.274371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9edbd-f740-4151-9958-73955ff926fd None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:34.284321 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 521/1058] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 03:59:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:34.290786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9edbd-f740-4151-9958-73955ff926fd None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:34.302675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02947a5a-2d7d-48c8-aa79-5951590ec052 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:34.341619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988adb-7c1c-46a0-8133-ba07d3c64850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:34.342515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988adb-7c1c-46a0-8133-ba07d3c64850 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:34.342789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988adb-7c1c-46a0-8133-ba07d3c64850 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:34.343053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988adb-7c1c-46a0-8133-ba07d3c64850 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:34.343944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01988adb-7c1c-46a0-8133-ba07d3c64850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:34.344527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01988adb-7c1c-46a0-8133-ba07d3c64850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:34.345902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01988adb-7c1c-46a0-8133-ba07d3c64850 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:34.347045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:34.355304 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 538/1059] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:59:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:34.361460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988adb-7c1c-46a0-8133-ba07d3c64850 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:34.390232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:34.396923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9edbd-f740-4151-9958-73955ff926fd None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:34.433447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fdf58-db67-4776-9d7c-91828e217323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:34.434104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdf58-db67-4776-9d7c-91828e217323 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:34.434528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdf58-db67-4776-9d7c-91828e217323 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:34.434797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fdf58-db67-4776-9d7c-91828e217323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:34.448836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fdf58-db67-4776-9d7c-91828e217323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:34.450715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fdf58-db67-4776-9d7c-91828e217323 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-930fdf58-db67-4776-9d7c-91828e217323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:34.467030 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:34.468050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:34.469799 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:34.469799 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:34.469799 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:34.469799 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 522/1060] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:34.474321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fdf58-db67-4776-9d7c-91828e217323 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:34.476605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988adb-7c1c-46a0-8133-ba07d3c64850 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:34.521986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b137e4-88c2-4493-997b-391ed7657322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:34.521986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b137e4-88c2-4493-997b-391ed7657322 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:34.521986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b137e4-88c2-4493-997b-391ed7657322 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:34.521986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b137e4-88c2-4493-997b-391ed7657322 None admin] PATH_INFO: `/v3/users/d54fa855fa99401e8603008d605f5903` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:34.533621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b137e4-88c2-4493-997b-391ed7657322 None admin] RBAC: Authorizing `identity:get_user(user_id=d54fa855fa99401e8603008d605f5903)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:34.535576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b137e4-88c2-4493-997b-391ed7657322 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:34.538169 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 539/1061] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:59:34 2022] GET /identity/v3/users/d54fa855fa99401e8603008d605f5903 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:34.544055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b137e4-88c2-4493-997b-391ed7657322 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:34.592847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fdf58-db67-4776-9d7c-91828e217323 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:34.596022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:34.639429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453a46e-7cd5-4afc-ab10-91c52dfc96f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:34.639970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:34.640941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453a46e-7cd5-4afc-ab10-91c52dfc96f4 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:34.641637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453a46e-7cd5-4afc-ab10-91c52dfc96f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:34.641983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453a46e-7cd5-4afc-ab10-91c52dfc96f4 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:34.642984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453a46e-7cd5-4afc-ab10-91c52dfc96f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:34.643284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453a46e-7cd5-4afc-ab10-91c52dfc96f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:34.644797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453a46e-7cd5-4afc-ab10-91c52dfc96f4 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:34.659113 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 523/1062] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:34.662368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b137e4-88c2-4493-997b-391ed7657322 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:34.664917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453a46e-7cd5-4afc-ab10-91c52dfc96f4 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:34.700550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80bc26-bb4e-4846-b179-dd24fc3669f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:34.701538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80bc26-bb4e-4846-b179-dd24fc3669f4 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:34.701995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80bc26-bb4e-4846-b179-dd24fc3669f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:34.702459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80bc26-bb4e-4846-b179-dd24fc3669f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:34.775625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80bc26-bb4e-4846-b179-dd24fc3669f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:34.776389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453a46e-7cd5-4afc-ab10-91c52dfc96f4 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:34.777001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80bc26-bb4e-4846-b179-dd24fc3669f4 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:34.812010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842639-63e8-4a17-a34b-c6238b4d0b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:34.812637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842639-63e8-4a17-a34b-c6238b4d0b09 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:34.812914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842639-63e8-4a17-a34b-c6238b4d0b09 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:34.813185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64842639-63e8-4a17-a34b-c6238b4d0b09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:34.820722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64842639-63e8-4a17-a34b-c6238b4d0b09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:34.822212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64842639-63e8-4a17-a34b-c6238b4d0b09 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-64842639-63e8-4a17-a34b-c6238b4d0b09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:59:34.833868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:34.834868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:34.835844 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 524/1063] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 03:59:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:34.840646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842639-63e8-4a17-a34b-c6238b4d0b09 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:34.867348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:34.868404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:34.894726 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 540/1064] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 03:59:34.895651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80bc26-bb4e-4846-b179-dd24fc3669f4 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:34.956232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64842639-63e8-4a17-a34b-c6238b4d0b09 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:34.992880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a016be-5377-49c9-9961-26223fa8a3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:34.993600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a016be-5377-49c9-9961-26223fa8a3c9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:34.993911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a016be-5377-49c9-9961-26223fa8a3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:34.994276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a016be-5377-49c9-9961-26223fa8a3c9 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:34.995006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a016be-5377-49c9-9961-26223fa8a3c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:34.995312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a016be-5377-49c9-9961-26223fa8a3c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:34.997010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a016be-5377-49c9-9961-26223fa8a3c9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:35.000544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80bc26-bb4e-4846-b179-dd24fc3669f4 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:35.020732 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 525/1065] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 03:59:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:35.021467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a016be-5377-49c9-9961-26223fa8a3c9 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:35.036788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0861bb-cd66-4596-8c10-3a0f0a7a081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:35.037344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0861bb-cd66-4596-8c10-3a0f0a7a081a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:35.037606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0861bb-cd66-4596-8c10-3a0f0a7a081a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:35.037895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0861bb-cd66-4596-8c10-3a0f0a7a081a None admin] PATH_INFO: `/v3/projects/0adc251b9fdf4d019bede45a4643e9b5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:35.039032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0861bb-cd66-4596-8c10-3a0f0a7a081a None admin] RBAC: Authorizing `identity:get_project(project_id=0adc251b9fdf4d019bede45a4643e9b5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:35.040530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0861bb-cd66-4596-8c10-3a0f0a7a081a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:35.042279 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 541/1066] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:59:34 2022] GET /identity/v3/projects/0adc251b9fdf4d019bede45a4643e9b5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:35.048773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0861bb-cd66-4596-8c10-3a0f0a7a081a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:35.100105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:35.118814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:35.138511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a016be-5377-49c9-9961-26223fa8a3c9 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:35.154262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0861bb-cd66-4596-8c10-3a0f0a7a081a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:35.173930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e512d3-6a43-47c4-b301-893449e56755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:35.174895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e512d3-6a43-47c4-b301-893449e56755 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:35.175346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e512d3-6a43-47c4-b301-893449e56755 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:35.176014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e512d3-6a43-47c4-b301-893449e56755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:35.186715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e512d3-6a43-47c4-b301-893449e56755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:35.188301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e512d3-6a43-47c4-b301-893449e56755 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:35.190254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265d8df-5d70-46fe-b342-909be1799668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:35.190966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265d8df-5d70-46fe-b342-909be1799668 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:35.191211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265d8df-5d70-46fe-b342-909be1799668 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:35.191490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265d8df-5d70-46fe-b342-909be1799668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:35.192213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265d8df-5d70-46fe-b342-909be1799668 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=0adc251b9fdf4d019bede45a4643e9b5, user.id=d54fa855fa99401e8603008d605f5903) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:35.192514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265d8df-5d70-46fe-b342-909be1799668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:35.193950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265d8df-5d70-46fe-b342-909be1799668 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:35.200193 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 542/1067] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:35 2022] GET /identity/v3/role_assignments?user.id=d54fa855fa99401e8603008d605f5903&scope.project.id=0adc251b9fdf4d019bede45a4643e9b5&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-61e512d3-6a43-47c4-b301-893449e56755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:35.203974 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:35.204940 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:35.211026 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:35.211026 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:35.211026 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:35.211026 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 526/1068] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:35.218171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265d8df-5d70-46fe-b342-909be1799668 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:35.345693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265d8df-5d70-46fe-b342-909be1799668 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:35.360092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:35.384314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1421c7ce-50d2-4c90-a839-68231a9cd98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:35.384933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421c7ce-50d2-4c90-a839-68231a9cd98d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:35.385207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421c7ce-50d2-4c90-a839-68231a9cd98d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:35.385470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1421c7ce-50d2-4c90-a839-68231a9cd98d None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:35.386144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421c7ce-50d2-4c90-a839-68231a9cd98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:35.386440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421c7ce-50d2-4c90-a839-68231a9cd98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:35.387809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1421c7ce-50d2-4c90-a839-68231a9cd98d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:35.400176 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 543/1069] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:35.405947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e512d3-6a43-47c4-b301-893449e56755 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:35.461757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2c54a-25d9-41d3-996a-32d5d4d41e42 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:35.462061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2c54a-25d9-41d3-996a-32d5d4d41e42 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:35.462331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2c54a-25d9-41d3-996a-32d5d4d41e42 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:35.463803 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 544/1070] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:59:35.468754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb4453-56b7-456b-87dc-6c6a6c2a7d05 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:35.469030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb4453-56b7-456b-87dc-6c6a6c2a7d05 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:35.469294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb4453-56b7-456b-87dc-6c6a6c2a7d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:35.490423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-75fb4453-56b7-456b-87dc-6c6a6c2a7d05 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:35.491631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-75fb4453-56b7-456b-87dc-6c6a6c2a7d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:35.518160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e512d3-6a43-47c4-b301-893449e56755 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:35.556372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51523efc-e3f1-4260-85cc-ea4b8ff68c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:35.557000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51523efc-e3f1-4260-85cc-ea4b8ff68c7c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:35.557271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51523efc-e3f1-4260-85cc-ea4b8ff68c7c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:35.557533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51523efc-e3f1-4260-85cc-ea4b8ff68c7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:35.560360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:35.566954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51523efc-e3f1-4260-85cc-ea4b8ff68c7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:35.568976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51523efc-e3f1-4260-85cc-ea4b8ff68c7c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:35.569909 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 545/1071] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-51523efc-e3f1-4260-85cc-ea4b8ff68c7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:35.584808 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:35.585753 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:35.586993 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:35.586993 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:35.586993 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:35.586993 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:35.586993 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:35.586993 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:35.586993 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:35.586993 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:35.587812 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 527/1072] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:35.591723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb4453-56b7-456b-87dc-6c6a6c2a7d05 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:35.709748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb4453-56b7-456b-87dc-6c6a6c2a7d05 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:35.711477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:35.747521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937c25-8224-4267-85c7-35f8fe3c656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:35.748142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937c25-8224-4267-85c7-35f8fe3c656e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:35.748414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937c25-8224-4267-85c7-35f8fe3c656e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:35.748678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb937c25-8224-4267-85c7-35f8fe3c656e None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:35.749377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb937c25-8224-4267-85c7-35f8fe3c656e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:35.749678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb937c25-8224-4267-85c7-35f8fe3c656e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:35.751144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb937c25-8224-4267-85c7-35f8fe3c656e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:35.766309 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 546/1073] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:35.769102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51523efc-e3f1-4260-85cc-ea4b8ff68c7c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:35.831985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937c25-8224-4267-85c7-35f8fe3c656e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:35.883140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51523efc-e3f1-4260-85cc-ea4b8ff68c7c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:35.921845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f0c47-4f5e-4f4b-85eb-72026e068604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:35.922460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0c47-4f5e-4f4b-85eb-72026e068604 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:35.922735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0c47-4f5e-4f4b-85eb-72026e068604 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:35.923000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f0c47-4f5e-4f4b-85eb-72026e068604 None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d3a99d39337841849b3e2efe48ebe53c/roles/c0df7bf5ce494e0ab735be8639aec320` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:35.925170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f0c47-4f5e-4f4b-85eb-72026e068604 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=d3a99d39337841849b3e2efe48ebe53c, role_id=c0df7bf5ce494e0ab735be8639aec320)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:35.926905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f0c47-4f5e-4f4b-85eb-72026e068604 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:35.940952 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 528/1074] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:59:35 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/d3a99d39337841849b3e2efe48ebe53c/roles/c0df7bf5ce494e0ab735be8639aec320 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:59:35.948053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb937c25-8224-4267-85c7-35f8fe3c656e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:35.990048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ecdc3-a3e1-41ff-ace1-000a93aaeb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:35.990729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ecdc3-a3e1-41ff-ace1-000a93aaeb85 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:35.991013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ecdc3-a3e1-41ff-ace1-000a93aaeb85 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:35.991277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ecdc3-a3e1-41ff-ace1-000a93aaeb85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:36.043326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:36.098187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ecdc3-a3e1-41ff-ace1-000a93aaeb85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:36.099684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ecdc3-a3e1-41ff-ace1-000a93aaeb85 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:36.210907 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 547/1075] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 03:59:36.217084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f0c47-4f5e-4f4b-85eb-72026e068604 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:36.290083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:36.344866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f0c47-4f5e-4f4b-85eb-72026e068604 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:36.384342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c68f6-621c-4ae5-becc-39c7039afa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:36.384987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c68f6-621c-4ae5-becc-39c7039afa47 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:36.385263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c68f6-621c-4ae5-becc-39c7039afa47 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:36.385535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c68f6-621c-4ae5-becc-39c7039afa47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:36.397216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c68f6-621c-4ae5-becc-39c7039afa47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:36.398741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c68f6-621c-4ae5-becc-39c7039afa47 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-c04c68f6-621c-4ae5-becc-39c7039afa47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:36.414419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:36.415427 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:36.417982 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:36.417982 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:36.417982 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:36.417982 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 529/1076] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:36.422953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ecdc3-a3e1-41ff-ace1-000a93aaeb85 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:36.489459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:36.540023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ecdc3-a3e1-41ff-ace1-000a93aaeb85 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:36.576400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c9154-138c-4674-858a-07ddceafd874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:36.577065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c9154-138c-4674-858a-07ddceafd874 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:36.577065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c9154-138c-4674-858a-07ddceafd874 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:36.577390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c9154-138c-4674-858a-07ddceafd874 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:36.578039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c9154-138c-4674-858a-07ddceafd874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:36.578341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c9154-138c-4674-858a-07ddceafd874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:36.579744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c9154-138c-4674-858a-07ddceafd874 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:36.592092 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 548/1077] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:37.106830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6677c-1115-4c67-8199-c2db0641f201 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:37.108017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6677c-1115-4c67-8199-c2db0641f201 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:37.108174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6677c-1115-4c67-8199-c2db0641f201 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:37.109546 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 530/1078] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:37.116552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac78f-3182-45d7-912a-3611d774e987 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:37.117125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac78f-3182-45d7-912a-3611d774e987 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:37.117596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebac78f-3182-45d7-912a-3611d774e987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:37.140014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-aebac78f-3182-45d7-912a-3611d774e987 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:37.141201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aebac78f-3182-45d7-912a-3611d774e987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:37.211536 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 549/1079] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:37.483808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6677c-1115-4c67-8199-c2db0641f201 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:37.593094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6677c-1115-4c67-8199-c2db0641f201 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:37.600745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:37.629174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76022539-91b5-490d-a40c-facbaac7c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:37.630040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76022539-91b5-490d-a40c-facbaac7c453 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:37.630321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76022539-91b5-490d-a40c-facbaac7c453 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:37.630591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76022539-91b5-490d-a40c-facbaac7c453 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:37.642069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76022539-91b5-490d-a40c-facbaac7c453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-76022539-91b5-490d-a40c-facbaac7c453 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:37.647452 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:37.649254 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:59:37.650687 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:37.653690 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 531/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:59:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:37.654968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebac78f-3182-45d7-912a-3611d774e987 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:37.713651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:37.764229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebac78f-3182-45d7-912a-3611d774e987 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:37.799676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bfafd-b232-4597-a2a1-33d2249fa145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:37.800368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bfafd-b232-4597-a2a1-33d2249fa145 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:37.800729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bfafd-b232-4597-a2a1-33d2249fa145 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:37.801062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bfafd-b232-4597-a2a1-33d2249fa145 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:37.801828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bfafd-b232-4597-a2a1-33d2249fa145 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:37.802251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bfafd-b232-4597-a2a1-33d2249fa145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:37.803691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bfafd-b232-4597-a2a1-33d2249fa145 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:37.812105 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 550/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:59:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:37.819082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76022539-91b5-490d-a40c-facbaac7c453 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:37.886162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c92f0-5821-46d6-9693-0140717a8fb9 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:37.886458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c92f0-5821-46d6-9693-0140717a8fb9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:37.886694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c92f0-5821-46d6-9693-0140717a8fb9 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:37.888020 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 551/1082] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 03:59:37.892939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71e3d4-1a14-4157-ad14-2b496a7362d1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:37.893214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71e3d4-1a14-4157-ad14-2b496a7362d1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:37.893459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71e3d4-1a14-4157-ad14-2b496a7362d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:37.912605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6e71e3d4-1a14-4157-ad14-2b496a7362d1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:37.913803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6e71e3d4-1a14-4157-ad14-2b496a7362d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:37.935702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76022539-91b5-490d-a40c-facbaac7c453 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:37.971820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918b68-dfbd-4d3c-955c-c5c037b3ce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:37.972786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918b68-dfbd-4d3c-955c-c5c037b3ce62 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:37.973192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918b68-dfbd-4d3c-955c-c5c037b3ce62 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:37.973462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01918b68-dfbd-4d3c-955c-c5c037b3ce62 None admin] PATH_INFO: `/v3/users/d54fa855fa99401e8603008d605f5903` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:37.974683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01918b68-dfbd-4d3c-955c-c5c037b3ce62 None admin] RBAC: Authorizing `identity:get_user(user_id=d54fa855fa99401e8603008d605f5903)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:37.976153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01918b68-dfbd-4d3c-955c-c5c037b3ce62 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:37.977776 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 532/1083] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:59:37 2022] GET /identity/v3/users/d54fa855fa99401e8603008d605f5903 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:37.984034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918b68-dfbd-4d3c-955c-c5c037b3ce62 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:37.985914 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 552/1084] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:59:38.020462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:38.092457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01918b68-dfbd-4d3c-955c-c5c037b3ce62 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:38.135134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8674f2-181a-4221-8c0c-f2689144a353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:38.135848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8674f2-181a-4221-8c0c-f2689144a353 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:38.136023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8674f2-181a-4221-8c0c-f2689144a353 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:38.136301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8674f2-181a-4221-8c0c-f2689144a353 None admin] PATH_INFO: `/v3/projects/0adc251b9fdf4d019bede45a4643e9b5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:38.137450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8674f2-181a-4221-8c0c-f2689144a353 None admin] RBAC: Authorizing `identity:get_project(project_id=0adc251b9fdf4d019bede45a4643e9b5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:38.138928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8674f2-181a-4221-8c0c-f2689144a353 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:38.140752 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 533/1085] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:59:37 2022] GET /identity/v3/projects/0adc251b9fdf4d019bede45a4643e9b5 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:38.146856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71e3d4-1a14-4157-ad14-2b496a7362d1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:38.194208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:38.249840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71e3d4-1a14-4157-ad14-2b496a7362d1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:38.251331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8674f2-181a-4221-8c0c-f2689144a353 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:38.286796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8a23f-d8a2-4a68-8a55-18f0abdb6464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:38.287470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8a23f-d8a2-4a68-8a55-18f0abdb6464 None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:38.287740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8a23f-d8a2-4a68-8a55-18f0abdb6464 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:38.288004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8a23f-d8a2-4a68-8a55-18f0abdb6464 None admin] PATH_INFO: `/v3/projects/0adc251b9fdf4d019bede45a4643e9b5/users/d54fa855fa99401e8603008d605f5903/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:38.289959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8a23f-d8a2-4a68-8a55-18f0abdb6464 None admin] RBAC: Authorizing `identity:create_grant(project_id=0adc251b9fdf4d019bede45a4643e9b5, user_id=d54fa855fa99401e8603008d605f5903, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:38.291400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8a23f-d8a2-4a68-8a55-18f0abdb6464 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:38.305061 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 553/1086] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:59:38 2022] PUT /identity/v3/projects/0adc251b9fdf4d019bede45a4643e9b5/users/d54fa855fa99401e8603008d605f5903/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:59:38.373153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8674f2-181a-4221-8c0c-f2689144a353 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:38.374854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:38.412399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b2d7e-f04f-4da8-9a9f-a55ceb4b42a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:38.413050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b2d7e-f04f-4da8-9a9f-a55ceb4b42a4 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:38.413332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b2d7e-f04f-4da8-9a9f-a55ceb4b42a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:38.413598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b2d7e-f04f-4da8-9a9f-a55ceb4b42a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:38.425039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b2d7e-f04f-4da8-9a9f-a55ceb4b42a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-827b2d7e-f04f-4da8-9a9f-a55ceb4b42a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:38.430492 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:38.431527 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:38.432386 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 534/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 03:59:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 03:59:38.438477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8a23f-d8a2-4a68-8a55-18f0abdb6464 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:38.544345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8a23f-d8a2-4a68-8a55-18f0abdb6464 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:38.546607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:38.580738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bafe2-e441-4646-962e-3a3e06b671af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:38.581356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bafe2-e441-4646-962e-3a3e06b671af None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:38.581603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bafe2-e441-4646-962e-3a3e06b671af None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:38.581901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bafe2-e441-4646-962e-3a3e06b671af None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:38.582615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bafe2-e441-4646-962e-3a3e06b671af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:38.582927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bafe2-e441-4646-962e-3a3e06b671af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:38.584267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8bafe2-e441-4646-962e-3a3e06b671af None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:38.592491 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 554/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 03:59:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:38.598782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b2d7e-f04f-4da8-9a9f-a55ceb4b42a4 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:38.697608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b2d7e-f04f-4da8-9a9f-a55ceb4b42a4 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:38.732662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be7761-c0d1-4687-bede-42c4b15e1d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:38.733304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be7761-c0d1-4687-bede-42c4b15e1d85 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:38.733576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be7761-c0d1-4687-bede-42c4b15e1d85 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:38.733840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be7761-c0d1-4687-bede-42c4b15e1d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:38.745778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be7761-c0d1-4687-bede-42c4b15e1d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:38.747268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be7761-c0d1-4687-bede-42c4b15e1d85 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-f8be7761-c0d1-4687-bede-42c4b15e1d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:38.762052 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:38.763044 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:38.763951 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:38.763951 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:38.763951 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:38.763951 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 535/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:38.769280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bafe2-e441-4646-962e-3a3e06b671af None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:38.872133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8bafe2-e441-4646-962e-3a3e06b671af None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:38.906562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683996c-0647-44aa-a807-0081086b5069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:38.907197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683996c-0647-44aa-a807-0081086b5069 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:38.907468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683996c-0647-44aa-a807-0081086b5069 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:38.907732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683996c-0647-44aa-a807-0081086b5069 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:38.908373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683996c-0647-44aa-a807-0081086b5069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:38.908670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683996c-0647-44aa-a807-0081086b5069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:38.910088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683996c-0647-44aa-a807-0081086b5069 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:38.922235 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 555/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:38.928265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be7761-c0d1-4687-bede-42c4b15e1d85 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:38.944423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:39.031124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be7761-c0d1-4687-bede-42c4b15e1d85 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:39.065108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b109252-aec8-4ee2-83ae-f95e51c8d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:39.065721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b109252-aec8-4ee2-83ae-f95e51c8d339 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:39.066022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b109252-aec8-4ee2-83ae-f95e51c8d339 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:39.066281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b109252-aec8-4ee2-83ae-f95e51c8d339 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:39.073750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b109252-aec8-4ee2-83ae-f95e51c8d339 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:39.075228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b109252-aec8-4ee2-83ae-f95e51c8d339 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-0b109252-aec8-4ee2-83ae-f95e51c8d339 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 03:59:39.086177 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:39.087221 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 03:59:39.088192 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 536/1091] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 03:59:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:39.093161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683996c-0647-44aa-a807-0081086b5069 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:39.123365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:39.198550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683996c-0647-44aa-a807-0081086b5069 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:39.233571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276b26b-3afe-4eee-85f6-07816c0196e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:39.234192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276b26b-3afe-4eee-85f6-07816c0196e1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:39.234471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276b26b-3afe-4eee-85f6-07816c0196e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:39.234736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276b26b-3afe-4eee-85f6-07816c0196e1 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:39.235459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276b26b-3afe-4eee-85f6-07816c0196e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:39.235755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276b26b-3afe-4eee-85f6-07816c0196e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:39.237182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276b26b-3afe-4eee-85f6-07816c0196e1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:39.254264 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 556/1092] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 03:59:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:39.260268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b109252-aec8-4ee2-83ae-f95e51c8d339 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:39.335021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:39.360573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b109252-aec8-4ee2-83ae-f95e51c8d339 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:39.396601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d3c0-5e02-4773-a51d-1c83d0d6e608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:39.397115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d3c0-5e02-4773-a51d-1c83d0d6e608 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:39.397387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d3c0-5e02-4773-a51d-1c83d0d6e608 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:39.397653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20d3c0-5e02-4773-a51d-1c83d0d6e608 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:39.464100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20d3c0-5e02-4773-a51d-1c83d0d6e608 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:39.465555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20d3c0-5e02-4773-a51d-1c83d0d6e608 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:39.538517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:39.565086 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 537/1093] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:39.571146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276b26b-3afe-4eee-85f6-07816c0196e1 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:39.656345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:39.672896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276b26b-3afe-4eee-85f6-07816c0196e1 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:39.706904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290654-4a81-4e13-9c90-308f88d01654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:39.707788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290654-4a81-4e13-9c90-308f88d01654 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:39.708061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290654-4a81-4e13-9c90-308f88d01654 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:39.708323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a290654-4a81-4e13-9c90-308f88d01654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:39.718543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290654-4a81-4e13-9c90-308f88d01654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:39.719981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a290654-4a81-4e13-9c90-308f88d01654 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-7a290654-4a81-4e13-9c90-308f88d01654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 03:59:39.734755 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:39.735735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 03:59:39.736622 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 03:59:39.736622 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 03:59:39.736622 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:39.736622 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 557/1094] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:39.741964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d3c0-5e02-4773-a51d-1c83d0d6e608 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:39.840088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20d3c0-5e02-4773-a51d-1c83d0d6e608 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:39.875219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c58a7e-0e9e-4bf6-83f8-632a0054ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:39.875834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c58a7e-0e9e-4bf6-83f8-632a0054ad1c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:39.876111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c58a7e-0e9e-4bf6-83f8-632a0054ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:39.876379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c58a7e-0e9e-4bf6-83f8-632a0054ad1c None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:39.877032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c58a7e-0e9e-4bf6-83f8-632a0054ad1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:39.877327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c58a7e-0e9e-4bf6-83f8-632a0054ad1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:39.878753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c58a7e-0e9e-4bf6-83f8-632a0054ad1c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:39.890824 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 538/1095] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 03:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:39.897244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290654-4a81-4e13-9c90-308f88d01654 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:40.002691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a290654-4a81-4e13-9c90-308f88d01654 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:40.040957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c79bf0-3f05-4b51-9b65-9be763d05f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:40.041601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c79bf0-3f05-4b51-9b65-9be763d05f18 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:40.041909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c79bf0-3f05-4b51-9b65-9be763d05f18 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:40.042174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c79bf0-3f05-4b51-9b65-9be763d05f18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:40.044990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:40.051553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c79bf0-3f05-4b51-9b65-9be763d05f18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:40.053520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c79bf0-3f05-4b51-9b65-9be763d05f18 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-d3c79bf0-3f05-4b51-9b65-9be763d05f18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 03:59:40.065324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:40.066323 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:40.067832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 03:59:40.067832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 03:59:40.067832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 03:59:40.067832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 03:59:40.067832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 03:59:40.067832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 03:59:40.067832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 03:59:40.067832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:40.067832 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 558/1096] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 03:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:40.072773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c58a7e-0e9e-4bf6-83f8-632a0054ad1c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:40.110392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:40.178632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c58a7e-0e9e-4bf6-83f8-632a0054ad1c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:40.208176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481de4e3-3863-4cef-be64-71d05e98d719 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:40.208464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481de4e3-3863-4cef-be64-71d05e98d719 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:40.208740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481de4e3-3863-4cef-be64-71d05e98d719 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:40.210180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 559/1097] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:40.213587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc84d71-07a0-4704-8c72-299e1e8a4680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:40.214222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84d71-07a0-4704-8c72-299e1e8a4680 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:40.214499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84d71-07a0-4704-8c72-299e1e8a4680 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:40.214768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84d71-07a0-4704-8c72-299e1e8a4680 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:40.215222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757f49-8fd3-43ba-88d3-560817ee4beb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:40.215463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc84d71-07a0-4704-8c72-299e1e8a4680 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:40.215557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757f49-8fd3-43ba-88d3-560817ee4beb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:40.215758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32757f49-8fd3-43ba-88d3-560817ee4beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:40.215864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc84d71-07a0-4704-8c72-299e1e8a4680 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:40.217199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc84d71-07a0-4704-8c72-299e1e8a4680 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:40.229568 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 539/1098] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 03:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:40.235450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-32757f49-8fd3-43ba-88d3-560817ee4beb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:40.235976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc84d71-07a0-4704-8c72-299e1e8a4680 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:40.236639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-32757f49-8fd3-43ba-88d3-560817ee4beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:40.302762 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 560/1099] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:40.333634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:40.341786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc84d71-07a0-4704-8c72-299e1e8a4680 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:40.378969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa994c88-f1a3-4616-ba2c-e40a4c802d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:40.379849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa994c88-f1a3-4616-ba2c-e40a4c802d20 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:40.380133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa994c88-f1a3-4616-ba2c-e40a4c802d20 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:40.380463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa994c88-f1a3-4616-ba2c-e40a4c802d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:40.381212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa994c88-f1a3-4616-ba2c-e40a4c802d20 None admin] RBAC: Adding query filter params (role.id=c0df7bf5ce494e0ab735be8639aec320, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=d3a99d39337841849b3e2efe48ebe53c) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:40.381512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa994c88-f1a3-4616-ba2c-e40a4c802d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:40.383015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa994c88-f1a3-4616-ba2c-e40a4c802d20 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:40.388923 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 540/1100] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:40 2022] GET /identity/v3/role_assignments?user.id=d3a99d39337841849b3e2efe48ebe53c&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=c0df7bf5ce494e0ab735be8639aec320 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 03:59:40.566456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32757f49-8fd3-43ba-88d3-560817ee4beb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:40.668883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32757f49-8fd3-43ba-88d3-560817ee4beb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:40.698150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:40.707634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75831b98-12ec-479c-add4-3d7ae98323c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:40.708362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75831b98-12ec-479c-add4-3d7ae98323c2 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:40.708648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75831b98-12ec-479c-add4-3d7ae98323c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:40.708916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75831b98-12ec-479c-add4-3d7ae98323c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:40.719130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75831b98-12ec-479c-add4-3d7ae98323c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-75831b98-12ec-479c-add4-3d7ae98323c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 03:59:40.724246 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 03:59:40.725218 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 03:59:40.726110 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 561/1101] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 03:59:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 03:59:40.731595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa994c88-f1a3-4616-ba2c-e40a4c802d20 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:40.840027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa994c88-f1a3-4616-ba2c-e40a4c802d20 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:40.876364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaff58-a7fb-4f9c-91e2-ef22cb80f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:40.876981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaff58-a7fb-4f9c-91e2-ef22cb80f55b None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:40.877255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaff58-a7fb-4f9c-91e2-ef22cb80f55b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:40.877521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaff58-a7fb-4f9c-91e2-ef22cb80f55b None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:40.878219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaff58-a7fb-4f9c-91e2-ef22cb80f55b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:40.878518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaff58-a7fb-4f9c-91e2-ef22cb80f55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:40.880004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaff58-a7fb-4f9c-91e2-ef22cb80f55b None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:40.889371 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 541/1102] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 03:59:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:40.895470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75831b98-12ec-479c-add4-3d7ae98323c2 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:41.004698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75831b98-12ec-479c-add4-3d7ae98323c2 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:41.038878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbefcc-31f0-4fee-ba71-9f7369da7373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:41.039521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbefcc-31f0-4fee-ba71-9f7369da7373 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:41.039797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbefcc-31f0-4fee-ba71-9f7369da7373 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:41.040060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbefcc-31f0-4fee-ba71-9f7369da7373 None admin] PATH_INFO: `/v3/users/d54fa855fa99401e8603008d605f5903` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:41.041180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbefcc-31f0-4fee-ba71-9f7369da7373 None admin] RBAC: Authorizing `identity:get_user(user_id=d54fa855fa99401e8603008d605f5903)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:41.042647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddbefcc-31f0-4fee-ba71-9f7369da7373 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:41.044403 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 562/1103] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:59:40 2022] GET /identity/v3/users/d54fa855fa99401e8603008d605f5903 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:41.050482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaff58-a7fb-4f9c-91e2-ef22cb80f55b None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:41.075981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:41.162188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaff58-a7fb-4f9c-91e2-ef22cb80f55b None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:41.197354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cfd4b-818a-42e7-8567-4ee7fc554339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:41.197990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cfd4b-818a-42e7-8567-4ee7fc554339 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:41.198269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cfd4b-818a-42e7-8567-4ee7fc554339 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:41.198539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cfd4b-818a-42e7-8567-4ee7fc554339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:41.269669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cfd4b-818a-42e7-8567-4ee7fc554339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:41.271212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22cfd4b-818a-42e7-8567-4ee7fc554339 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:41.291629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:41.372006 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 542/1104] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:41.378471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbefcc-31f0-4fee-ba71-9f7369da7373 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:41.440623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:41.505820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddbefcc-31f0-4fee-ba71-9f7369da7373 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:41.543196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55de35-ec87-454b-972e-2e26c9d97bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:41.543820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55de35-ec87-454b-972e-2e26c9d97bbe None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:41.544097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55de35-ec87-454b-972e-2e26c9d97bbe None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:41.544360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55de35-ec87-454b-972e-2e26c9d97bbe None admin] PATH_INFO: `/v3/projects/0adc251b9fdf4d019bede45a4643e9b5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:41.545612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55de35-ec87-454b-972e-2e26c9d97bbe None admin] RBAC: Authorizing `identity:get_project(project_id=0adc251b9fdf4d019bede45a4643e9b5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:41.547203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55de35-ec87-454b-972e-2e26c9d97bbe None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:41.548812 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 563/1105] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:59:41 2022] GET /identity/v3/projects/0adc251b9fdf4d019bede45a4643e9b5 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:41.559599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cfd4b-818a-42e7-8567-4ee7fc554339 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:41.666707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cfd4b-818a-42e7-8567-4ee7fc554339 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:41.687362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:41.702989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcdfb0-0ef8-4be7-8523-f21352ef3821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:41.703526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcdfb0-0ef8-4be7-8523-f21352ef3821 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:41.703799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcdfb0-0ef8-4be7-8523-f21352ef3821 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:41.704067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcdfb0-0ef8-4be7-8523-f21352ef3821 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:41.704780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcdfb0-0ef8-4be7-8523-f21352ef3821 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=0adc251b9fdf4d019bede45a4643e9b5, user.id=d54fa855fa99401e8603008d605f5903) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:41.705081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcdfb0-0ef8-4be7-8523-f21352ef3821 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:41.706570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcdfb0-0ef8-4be7-8523-f21352ef3821 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:41.714800 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 543/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:41 2022] GET /identity/v3/role_assignments?user.id=d54fa855fa99401e8603008d605f5903&scope.project.id=0adc251b9fdf4d019bede45a4643e9b5&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:43.613221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d4ed-db47-4327-aceb-8f0d03ed2c8c None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:43.614255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d4ed-db47-4327-aceb-8f0d03ed2c8c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:43.614255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921d4ed-db47-4327-aceb-8f0d03ed2c8c None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:43.616666 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 564/1107] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:43.622117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe18389-dd65-4d29-a256-dedc9717c934 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:43.622564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe18389-dd65-4d29-a256-dedc9717c934 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:43.622673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe18389-dd65-4d29-a256-dedc9717c934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:43.645818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bbe18389-dd65-4d29-a256-dedc9717c934 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:43.648028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bbe18389-dd65-4d29-a256-dedc9717c934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:43.724260 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 544/1108] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:44.005901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921d4ed-db47-4327-aceb-8f0d03ed2c8c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:44.113777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921d4ed-db47-4327-aceb-8f0d03ed2c8c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:44.137519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:44.149683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6f29a-78d7-47e9-8edf-e0436ef239a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:44.150333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6f29a-78d7-47e9-8edf-e0436ef239a4 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:44.150599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6f29a-78d7-47e9-8edf-e0436ef239a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:44.150861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6f29a-78d7-47e9-8edf-e0436ef239a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:44.151973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6f29a-78d7-47e9-8edf-e0436ef239a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:44.153395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6f29a-78d7-47e9-8edf-e0436ef239a4 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:44.154981 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 565/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:44.161466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe18389-dd65-4d29-a256-dedc9717c934 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:44.271273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe18389-dd65-4d29-a256-dedc9717c934 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:44.284602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:44.316679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6fa35-6804-46ab-a396-fb74ff7a1361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:44.317453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6fa35-6804-46ab-a396-fb74ff7a1361 None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:44.317867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6fa35-6804-46ab-a396-fb74ff7a1361 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:44.318174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6fa35-6804-46ab-a396-fb74ff7a1361 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:44.318816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6fa35-6804-46ab-a396-fb74ff7a1361 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:44.320262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6fa35-6804-46ab-a396-fb74ff7a1361 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:44.342412 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 545/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:59:44 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:46.272139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55817b-2890-4d13-8d5d-ef9f798622f8 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:46.273040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55817b-2890-4d13-8d5d-ef9f798622f8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:46.273040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55817b-2890-4d13-8d5d-ef9f798622f8 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:46.275199 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 566/1111] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:46.281514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fee42-682f-4d72-859a-ee3eb347360a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:46.282227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fee42-682f-4d72-859a-ee3eb347360a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:46.282504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47fee42-682f-4d72-859a-ee3eb347360a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:46.308570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e47fee42-682f-4d72-859a-ee3eb347360a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:46.309762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e47fee42-682f-4d72-859a-ee3eb347360a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:46.384164 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 546/1112] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:46.651299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55817b-2890-4d13-8d5d-ef9f798622f8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:46.767657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55817b-2890-4d13-8d5d-ef9f798622f8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:46.812572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d88b9-ff38-4e5b-950c-cdd7829eb791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:46.813223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d88b9-ff38-4e5b-950c-cdd7829eb791 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:46.813516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d88b9-ff38-4e5b-950c-cdd7829eb791 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:46.813801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d88b9-ff38-4e5b-950c-cdd7829eb791 None admin] PATH_INFO: `/v3/roles/c8196760d5404ccf95f4bccb62c5a1a3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:46.815303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d88b9-ff38-4e5b-950c-cdd7829eb791 None admin] RBAC: Authorizing `identity:get_role(role_id=c8196760d5404ccf95f4bccb62c5a1a3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:46.816707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d88b9-ff38-4e5b-950c-cdd7829eb791 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:46.818226 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 567/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:59:46 2022] GET /identity/v3/roles/c8196760d5404ccf95f4bccb62c5a1a3 => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:46.825644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fee42-682f-4d72-859a-ee3eb347360a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:46.936523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:46.940930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47fee42-682f-4d72-859a-ee3eb347360a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:46.990519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a617-ffce-43fc-bf69-41e2a30359f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:46.991163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a617-ffce-43fc-bf69-41e2a30359f0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:46.991442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a617-ffce-43fc-bf69-41e2a30359f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:46.991711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a617-ffce-43fc-bf69-41e2a30359f0 None admin] PATH_INFO: `/v3/users/4ae1bebd619e42de9bbfc9f49f8f37bb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:47.013757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8a617-ffce-43fc-bf69-41e2a30359f0 None admin] RBAC: Authorizing `identity:get_user(user_id=4ae1bebd619e42de9bbfc9f49f8f37bb)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:47.015970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8a617-ffce-43fc-bf69-41e2a30359f0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:47.018614 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 547/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:59:46 2022] GET /identity/v3/users/4ae1bebd619e42de9bbfc9f49f8f37bb => generated 286 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:47.025865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d88b9-ff38-4e5b-950c-cdd7829eb791 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:47.094006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:47.141145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d88b9-ff38-4e5b-950c-cdd7829eb791 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:47.182283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1205a8-6709-42bd-9d73-379c6f8298c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:47.182903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1205a8-6709-42bd-9d73-379c6f8298c1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:47.183185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1205a8-6709-42bd-9d73-379c6f8298c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:47.183454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1205a8-6709-42bd-9d73-379c6f8298c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:47.262529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1205a8-6709-42bd-9d73-379c6f8298c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:47.263892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1205a8-6709-42bd-9d73-379c6f8298c1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:47.324740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:47.371662 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 568/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:47.381298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a617-ffce-43fc-bf69-41e2a30359f0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:47.494999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a617-ffce-43fc-bf69-41e2a30359f0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:47.531654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13436ef-eb37-4a6a-8258-54ae2b20af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:47.532210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13436ef-eb37-4a6a-8258-54ae2b20af4e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:47.532485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13436ef-eb37-4a6a-8258-54ae2b20af4e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:47.532766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13436ef-eb37-4a6a-8258-54ae2b20af4e None admin] PATH_INFO: `/v3/projects/0adc251b9fdf4d019bede45a4643e9b5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:47.534010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13436ef-eb37-4a6a-8258-54ae2b20af4e None admin] RBAC: Authorizing `identity:get_project(project_id=0adc251b9fdf4d019bede45a4643e9b5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:47.535455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13436ef-eb37-4a6a-8258-54ae2b20af4e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:47.537177 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 548/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:59:47 2022] GET /identity/v3/projects/0adc251b9fdf4d019bede45a4643e9b5 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:47.543818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1205a8-6709-42bd-9d73-379c6f8298c1 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:47.650759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1205a8-6709-42bd-9d73-379c6f8298c1 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:47.689262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480bf96-f744-4659-90fd-48242ab35c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:47.690203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480bf96-f744-4659-90fd-48242ab35c58 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:47.690549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480bf96-f744-4659-90fd-48242ab35c58 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:47.690896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480bf96-f744-4659-90fd-48242ab35c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:47.692012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480bf96-f744-4659-90fd-48242ab35c58 None admin] RBAC: Adding query filter params (role.id=c8196760d5404ccf95f4bccb62c5a1a3, scope.project.id=0adc251b9fdf4d019bede45a4643e9b5, user.id=4ae1bebd619e42de9bbfc9f49f8f37bb) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:47.692424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480bf96-f744-4659-90fd-48242ab35c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:47.694768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d480bf96-f744-4659-90fd-48242ab35c58 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:47.703806 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 569/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:47 2022] GET /identity/v3/role_assignments?user.id=4ae1bebd619e42de9bbfc9f49f8f37bb&scope.project.id=0adc251b9fdf4d019bede45a4643e9b5&role.id=c8196760d5404ccf95f4bccb62c5a1a3 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:49.566754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fa8f1-aaaa-461d-b45f-a46515ea762b None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:49.567660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fa8f1-aaaa-461d-b45f-a46515ea762b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:49.567660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fa8f1-aaaa-461d-b45f-a46515ea762b None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:49.569676 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 549/1118] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:49.575065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6160e3-445f-4e0d-864d-732092ec1d2e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:49.575504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6160e3-445f-4e0d-864d-732092ec1d2e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:49.575596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6160e3-445f-4e0d-864d-732092ec1d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:49.595523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4c6160e3-445f-4e0d-864d-732092ec1d2e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:49.596696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4c6160e3-445f-4e0d-864d-732092ec1d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:49.613817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:49.666455 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 570/1119] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:49.932068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fa8f1-aaaa-461d-b45f-a46515ea762b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:49.978232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:50.059226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fa8f1-aaaa-461d-b45f-a46515ea762b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:50.097356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf809f-50d6-451b-939a-62dc9263301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:50.098007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf809f-50d6-451b-939a-62dc9263301e None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:50.098288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf809f-50d6-451b-939a-62dc9263301e None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:50.098553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf809f-50d6-451b-939a-62dc9263301e None admin] PATH_INFO: `/v3/roles/c8196760d5404ccf95f4bccb62c5a1a3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:50.100128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf809f-50d6-451b-939a-62dc9263301e None admin] RBAC: Authorizing `identity:get_role(role_id=c8196760d5404ccf95f4bccb62c5a1a3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:50.101529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf809f-50d6-451b-939a-62dc9263301e None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:50.102873 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 550/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:59:49 2022] GET /identity/v3/roles/c8196760d5404ccf95f4bccb62c5a1a3 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:50.109253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6160e3-445f-4e0d-864d-732092ec1d2e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:50.212156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6160e3-445f-4e0d-864d-732092ec1d2e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:50.253718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5063b62-5074-4093-9b7c-d7d94b4ab468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:50.254398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5063b62-5074-4093-9b7c-d7d94b4ab468 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:50.254881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5063b62-5074-4093-9b7c-d7d94b4ab468 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:50.255400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5063b62-5074-4093-9b7c-d7d94b4ab468 None admin] PATH_INFO: `/v3/users/4ae1bebd619e42de9bbfc9f49f8f37bb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:50.257509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5063b62-5074-4093-9b7c-d7d94b4ab468 None admin] RBAC: Authorizing `identity:get_user(user_id=4ae1bebd619e42de9bbfc9f49f8f37bb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:50.259207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5063b62-5074-4093-9b7c-d7d94b4ab468 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:50.260949 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 571/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:59:50 2022] GET /identity/v3/users/4ae1bebd619e42de9bbfc9f49f8f37bb => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:50.268001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf809f-50d6-451b-939a-62dc9263301e None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:50.379813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:50.387638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf809f-50d6-451b-939a-62dc9263301e None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:50.422431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f520cc-7b7d-49cf-bbed-b11285474663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:50.423047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f520cc-7b7d-49cf-bbed-b11285474663 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:50.423321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f520cc-7b7d-49cf-bbed-b11285474663 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:50.423583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f520cc-7b7d-49cf-bbed-b11285474663 None admin] PATH_INFO: `/v3/projects/0adc251b9fdf4d019bede45a4643e9b5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:50.424743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f520cc-7b7d-49cf-bbed-b11285474663 None admin] RBAC: Authorizing `identity:get_project(project_id=0adc251b9fdf4d019bede45a4643e9b5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:50.426220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f520cc-7b7d-49cf-bbed-b11285474663 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:50.427903 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 551/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:59:50 2022] GET /identity/v3/projects/0adc251b9fdf4d019bede45a4643e9b5 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:50.437955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5063b62-5074-4093-9b7c-d7d94b4ab468 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:50.465347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:50.558219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5063b62-5074-4093-9b7c-d7d94b4ab468 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:50.607606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae686e-0310-4bf2-8128-5bf671f225c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:50.608386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae686e-0310-4bf2-8128-5bf671f225c5 None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:50.608523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae686e-0310-4bf2-8128-5bf671f225c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:50.609168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae686e-0310-4bf2-8128-5bf671f225c5 None admin] PATH_INFO: `/v3/projects/0adc251b9fdf4d019bede45a4643e9b5/users/4ae1bebd619e42de9bbfc9f49f8f37bb/roles/c8196760d5404ccf95f4bccb62c5a1a3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:50.611621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae686e-0310-4bf2-8128-5bf671f225c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0adc251b9fdf4d019bede45a4643e9b5, user_id=4ae1bebd619e42de9bbfc9f49f8f37bb, role_id=c8196760d5404ccf95f4bccb62c5a1a3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:50.613073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae686e-0310-4bf2-8128-5bf671f225c5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:50.630103 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 572/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 03:59:50 2022] PUT /identity/v3/projects/0adc251b9fdf4d019bede45a4643e9b5/users/4ae1bebd619e42de9bbfc9f49f8f37bb/roles/c8196760d5404ccf95f4bccb62c5a1a3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 03:59:52.503477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113dd58-cc50-4ccd-ada5-3db05a65eed1 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:52.504068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113dd58-cc50-4ccd-ada5-3db05a65eed1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:52.504068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113dd58-cc50-4ccd-ada5-3db05a65eed1 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:52.505366 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 552/1124] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:52.512098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb870e8-ebf3-4083-9b38-438eb2693d5c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:52.512815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb870e8-ebf3-4083-9b38-438eb2693d5c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:52.512963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb870e8-ebf3-4083-9b38-438eb2693d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:52.541648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5bb870e8-ebf3-4083-9b38-438eb2693d5c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:52.542868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5bb870e8-ebf3-4083-9b38-438eb2693d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:52.617683 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 573/1125] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:52.893394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113dd58-cc50-4ccd-ada5-3db05a65eed1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:53.001127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113dd58-cc50-4ccd-ada5-3db05a65eed1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:53.037724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdccab3-e44a-4517-9960-4abdfd7a642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:53.038362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdccab3-e44a-4517-9960-4abdfd7a642b None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:53.038631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdccab3-e44a-4517-9960-4abdfd7a642b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:53.038892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdccab3-e44a-4517-9960-4abdfd7a642b None admin] PATH_INFO: `/v3/roles/c8196760d5404ccf95f4bccb62c5a1a3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:53.040395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdccab3-e44a-4517-9960-4abdfd7a642b None admin] RBAC: Authorizing `identity:get_role(role_id=c8196760d5404ccf95f4bccb62c5a1a3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:53.041779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdccab3-e44a-4517-9960-4abdfd7a642b None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:53.043321 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 553/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:59:52 2022] GET /identity/v3/roles/c8196760d5404ccf95f4bccb62c5a1a3 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:53.049649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb870e8-ebf3-4083-9b38-438eb2693d5c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:53.061962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:53.157686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb870e8-ebf3-4083-9b38-438eb2693d5c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:53.195618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352f37-dcdc-4a58-a661-f0e8f8f2427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:53.196543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352f37-dcdc-4a58-a661-f0e8f8f2427b None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:53.196905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352f37-dcdc-4a58-a661-f0e8f8f2427b None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:53.197253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352f37-dcdc-4a58-a661-f0e8f8f2427b None admin] PATH_INFO: `/v3/users/4ae1bebd619e42de9bbfc9f49f8f37bb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:53.199299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2352f37-dcdc-4a58-a661-f0e8f8f2427b None admin] RBAC: Authorizing `identity:get_user(user_id=4ae1bebd619e42de9bbfc9f49f8f37bb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:53.201538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2352f37-dcdc-4a58-a661-f0e8f8f2427b None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:53.204001 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 574/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 03:59:53 2022] GET /identity/v3/users/4ae1bebd619e42de9bbfc9f49f8f37bb => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:53.212585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdccab3-e44a-4517-9960-4abdfd7a642b None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:53.247321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:53.324006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdccab3-e44a-4517-9960-4abdfd7a642b None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:53.365271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6149ae-cd28-4352-9552-cf0585541220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:53.366351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6149ae-cd28-4352-9552-cf0585541220 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:53.366636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6149ae-cd28-4352-9552-cf0585541220 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:53.366906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6149ae-cd28-4352-9552-cf0585541220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:53.444862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6149ae-cd28-4352-9552-cf0585541220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:53.446274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6149ae-cd28-4352-9552-cf0585541220 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:53.476189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:53.555394 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 554/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 03:59:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:53.562243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352f37-dcdc-4a58-a661-f0e8f8f2427b None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:53.650712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:53.674674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352f37-dcdc-4a58-a661-f0e8f8f2427b None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:53.713231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d65bd-456f-40e9-8a10-eb748942c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:53.713784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d65bd-456f-40e9-8a10-eb748942c815 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:53.714089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d65bd-456f-40e9-8a10-eb748942c815 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:53.714351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d65bd-456f-40e9-8a10-eb748942c815 None admin] PATH_INFO: `/v3/projects/0adc251b9fdf4d019bede45a4643e9b5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:53.715609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d65bd-456f-40e9-8a10-eb748942c815 None admin] RBAC: Authorizing `identity:get_project(project_id=0adc251b9fdf4d019bede45a4643e9b5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:53.717044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d65bd-456f-40e9-8a10-eb748942c815 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:53.718705 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 575/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 03:59:53 2022] GET /identity/v3/projects/0adc251b9fdf4d019bede45a4643e9b5 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:53.725150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6149ae-cd28-4352-9552-cf0585541220 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:53.833128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6149ae-cd28-4352-9552-cf0585541220 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:53.862652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:53.870087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a8b86e-3338-4f84-8892-4e5ba0cea3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:53.870689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8b86e-3338-4f84-8892-4e5ba0cea3ee None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:53.870966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8b86e-3338-4f84-8892-4e5ba0cea3ee None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:53.871227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a8b86e-3338-4f84-8892-4e5ba0cea3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:53.871948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8b86e-3338-4f84-8892-4e5ba0cea3ee None admin] RBAC: Adding query filter params (role.id=c8196760d5404ccf95f4bccb62c5a1a3, scope.project.id=0adc251b9fdf4d019bede45a4643e9b5, user.id=4ae1bebd619e42de9bbfc9f49f8f37bb) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 03:59:53.872250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8b86e-3338-4f84-8892-4e5ba0cea3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:53.873694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a8b86e-3338-4f84-8892-4e5ba0cea3ee None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:53.880085 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 555/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 03:59:53 2022] GET /identity/v3/role_assignments?user.id=4ae1bebd619e42de9bbfc9f49f8f37bb&scope.project.id=0adc251b9fdf4d019bede45a4643e9b5&role.id=c8196760d5404ccf95f4bccb62c5a1a3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:55.780700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fbbb8-6997-43ee-b54f-bc0689d77041 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:55.781296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fbbb8-6997-43ee-b54f-bc0689d77041 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:55.781296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fbbb8-6997-43ee-b54f-bc0689d77041 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:55.782733 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 576/1131] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:55.788662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246c9eb-df16-4ec4-af67-676e06deb155 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:55.789134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246c9eb-df16-4ec4-af67-676e06deb155 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:55.789235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246c9eb-df16-4ec4-af67-676e06deb155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:55.809011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0246c9eb-df16-4ec4-af67-676e06deb155 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:55.810216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0246c9eb-df16-4ec4-af67-676e06deb155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:55.882453 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 556/1132] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 03:59:56.153386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fbbb8-6997-43ee-b54f-bc0689d77041 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:56.265789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fbbb8-6997-43ee-b54f-bc0689d77041 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:56.301040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e7f55-1402-4e4f-963c-80ac2e29e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:56.301660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e7f55-1402-4e4f-963c-80ac2e29e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:56.301922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e7f55-1402-4e4f-963c-80ac2e29e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:56.302222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e7f55-1402-4e4f-963c-80ac2e29e2b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:56.303491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e7f55-1402-4e4f-963c-80ac2e29e2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:56.305023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e7f55-1402-4e4f-963c-80ac2e29e2b6 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:56.306735 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 577/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:56.313492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246c9eb-df16-4ec4-af67-676e06deb155 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:56.422850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246c9eb-df16-4ec4-af67-676e06deb155 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:56.447284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:56.458979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32474d1e-e36b-4afc-a6fd-e16a09c7a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:56.459611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474d1e-e36b-4afc-a6fd-e16a09c7a38c None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:56.459900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474d1e-e36b-4afc-a6fd-e16a09c7a38c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:56.460170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32474d1e-e36b-4afc-a6fd-e16a09c7a38c None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:56.460821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32474d1e-e36b-4afc-a6fd-e16a09c7a38c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:56.462306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32474d1e-e36b-4afc-a6fd-e16a09c7a38c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:56.491392 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 557/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 03:59:56 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 03:59:58.397154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056009c-6613-4315-9257-97d9bc8a24f0 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:58.397753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056009c-6613-4315-9257-97d9bc8a24f0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:58.397753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056009c-6613-4315-9257-97d9bc8a24f0 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:58.399129 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 578/1135] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 03:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 03:59:58.406253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186d5ac-e226-48bb-a2cd-983e6982da05 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:58.406983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186d5ac-e226-48bb-a2cd-983e6982da05 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:58.407170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186d5ac-e226-48bb-a2cd-983e6982da05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:58.434484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5186d5ac-e226-48bb-a2cd-983e6982da05 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 03:59:58.435671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5186d5ac-e226-48bb-a2cd-983e6982da05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 03:59:58.504640 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 558/1136] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 03:59:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 03:59:58.775791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056009c-6613-4315-9257-97d9bc8a24f0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:58.793258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:58.891925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056009c-6613-4315-9257-97d9bc8a24f0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:58.931261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29967831-d9a3-471b-bddb-afc95f7ab41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:58.931888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29967831-d9a3-471b-bddb-afc95f7ab41f None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:58.932164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29967831-d9a3-471b-bddb-afc95f7ab41f None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:58.932422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29967831-d9a3-471b-bddb-afc95f7ab41f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:58.933602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29967831-d9a3-471b-bddb-afc95f7ab41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:58.935067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29967831-d9a3-471b-bddb-afc95f7ab41f None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:58.936677 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 579/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 03:59:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 03:59:58.942858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186d5ac-e226-48bb-a2cd-983e6982da05 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 03:59:59.051253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186d5ac-e226-48bb-a2cd-983e6982da05 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 03:59:59.059220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:59.097445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6cb65-0b39-4860-a03d-73650678dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 03:59:59.098100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6cb65-0b39-4860-a03d-73650678dae5 None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 03:59:59.098340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6cb65-0b39-4860-a03d-73650678dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 03:59:59.098626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6cb65-0b39-4860-a03d-73650678dae5 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 03:59:59.099269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6cb65-0b39-4860-a03d-73650678dae5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 03:59:59.100775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6cb65-0b39-4860-a03d-73650678dae5 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 03:59:59.128181 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 559/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 03:59:58 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:00:01.120605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cea87a-2c59-4a53-b7b1-8a548d99e2fd None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:01.121201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cea87a-2c59-4a53-b7b1-8a548d99e2fd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:01.121201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cea87a-2c59-4a53-b7b1-8a548d99e2fd None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:01.122503 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 580/1139] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:00:01.128463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23e47-31ec-4c1e-b8d3-3084713ccc19 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:01.129193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23e47-31ec-4c1e-b8d3-3084713ccc19 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:01.129358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e23e47-31ec-4c1e-b8d3-3084713ccc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:01.155884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-73e23e47-31ec-4c1e-b8d3-3084713ccc19 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:00:01.157095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-73e23e47-31ec-4c1e-b8d3-3084713ccc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:00:01.237265 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 560/1140] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:00:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:00:01.504269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cea87a-2c59-4a53-b7b1-8a548d99e2fd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:01.593469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:01.614373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cea87a-2c59-4a53-b7b1-8a548d99e2fd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:01.651209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391874a-fb1a-461e-8123-ddcf664d619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:01.651833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391874a-fb1a-461e-8123-ddcf664d619f None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:01.652104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391874a-fb1a-461e-8123-ddcf664d619f None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:01.652369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9391874a-fb1a-461e-8123-ddcf664d619f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:01.662855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9391874a-fb1a-461e-8123-ddcf664d619f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-9391874a-fb1a-461e-8123-ddcf664d619f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:00:01.667671 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:00:01.668869 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:00:01.670320 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 581/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 04:00:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:00:01.675684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23e47-31ec-4c1e-b8d3-3084713ccc19 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:01.785069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:01.794527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e23e47-31ec-4c1e-b8d3-3084713ccc19 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:01.829096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e286f5e-2bc9-4fa9-b0cb-e2a18c59c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:01.829705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e286f5e-2bc9-4fa9-b0cb-e2a18c59c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:01.830080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e286f5e-2bc9-4fa9-b0cb-e2a18c59c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:01.830350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e286f5e-2bc9-4fa9-b0cb-e2a18c59c4d0 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:01.831008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e286f5e-2bc9-4fa9-b0cb-e2a18c59c4d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:01.831306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e286f5e-2bc9-4fa9-b0cb-e2a18c59c4d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:01.832696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e286f5e-2bc9-4fa9-b0cb-e2a18c59c4d0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:01.840899 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 561/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 04:00:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:01.847542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391874a-fb1a-461e-8123-ddcf664d619f None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:01.977686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9391874a-fb1a-461e-8123-ddcf664d619f None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:02.026231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554b587-7d47-447e-bb12-f0c8c4c73881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:02.026871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554b587-7d47-447e-bb12-f0c8c4c73881 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:02.027147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554b587-7d47-447e-bb12-f0c8c4c73881 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:02.027415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554b587-7d47-447e-bb12-f0c8c4c73881 None admin] PATH_INFO: `/v3/users/82a0c994eedb492e89a1971fac59af2a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:02.039088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:02.041666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554b587-7d47-447e-bb12-f0c8c4c73881 None admin] RBAC: Authorizing `identity:get_user(user_id=82a0c994eedb492e89a1971fac59af2a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:02.043429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554b587-7d47-447e-bb12-f0c8c4c73881 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:02.045067 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 582/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 04:00:01 2022] GET /identity/v3/users/82a0c994eedb492e89a1971fac59af2a => generated 286 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:02.051361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e286f5e-2bc9-4fa9-b0cb-e2a18c59c4d0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:02.155748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e286f5e-2bc9-4fa9-b0cb-e2a18c59c4d0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:02.190063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48abbd-f6cf-4992-8999-24980476dbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:02.190654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48abbd-f6cf-4992-8999-24980476dbad None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:02.190930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48abbd-f6cf-4992-8999-24980476dbad None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:02.191192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48abbd-f6cf-4992-8999-24980476dbad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:02.215149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:02.260018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48abbd-f6cf-4992-8999-24980476dbad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:02.261475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48abbd-f6cf-4992-8999-24980476dbad None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:02.358557 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 562/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 04:00:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:00:02.365070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554b587-7d47-447e-bb12-f0c8c4c73881 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:02.474861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554b587-7d47-447e-bb12-f0c8c4c73881 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:02.509725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2a6a1-f85c-4411-a88a-60722994312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:02.510378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a6a1-f85c-4411-a88a-60722994312a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:02.510651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a6a1-f85c-4411-a88a-60722994312a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:02.510910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2a6a1-f85c-4411-a88a-60722994312a None admin] PATH_INFO: `/v3/projects/d78a10104f514aea818aea05403ca2a0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:02.512124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2a6a1-f85c-4411-a88a-60722994312a None admin] RBAC: Authorizing `identity:get_project(project_id=d78a10104f514aea818aea05403ca2a0)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:02.513549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2a6a1-f85c-4411-a88a-60722994312a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:02.515179 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 583/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 04:00:02 2022] GET /identity/v3/projects/d78a10104f514aea818aea05403ca2a0 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:02.521688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48abbd-f6cf-4992-8999-24980476dbad None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:02.579595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:02.624822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48abbd-f6cf-4992-8999-24980476dbad None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:02.665334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc5edc-1a9f-4a0b-a7f0-dbb8f1042f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:02.665838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5edc-1a9f-4a0b-a7f0-dbb8f1042f91 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:02.666133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5edc-1a9f-4a0b-a7f0-dbb8f1042f91 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:02.666386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc5edc-1a9f-4a0b-a7f0-dbb8f1042f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:02.667109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc5edc-1a9f-4a0b-a7f0-dbb8f1042f91 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=d78a10104f514aea818aea05403ca2a0, user.id=82a0c994eedb492e89a1971fac59af2a) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:02.667408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc5edc-1a9f-4a0b-a7f0-dbb8f1042f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:02.668963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc5edc-1a9f-4a0b-a7f0-dbb8f1042f91 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:02.674240 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 563/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 04:00:02 2022] GET /identity/v3/role_assignments?user.id=82a0c994eedb492e89a1971fac59af2a&scope.project.id=d78a10104f514aea818aea05403ca2a0&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:04.563672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17937a9-2479-4ecc-8169-11da0bd72042 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:04.564273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17937a9-2479-4ecc-8169-11da0bd72042 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:04.564273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17937a9-2479-4ecc-8169-11da0bd72042 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:04.566341 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 584/1147] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:00:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:00:04.574453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958477-ab7f-41c5-b894-6386c3d2bc15 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:04.574900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958477-ab7f-41c5-b894-6386c3d2bc15 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:04.574990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75958477-ab7f-41c5-b894-6386c3d2bc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:04.595116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-75958477-ab7f-41c5-b894-6386c3d2bc15 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:00:04.596301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-75958477-ab7f-41c5-b894-6386c3d2bc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:00:04.668735 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 564/1148] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:00:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:00:04.942312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17937a9-2479-4ecc-8169-11da0bd72042 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:05.021390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:05.062599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17937a9-2479-4ecc-8169-11da0bd72042 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:05.102337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d303-8fc0-42fb-9a68-8d99707924d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:05.102986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d303-8fc0-42fb-9a68-8d99707924d2 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:05.103252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d303-8fc0-42fb-9a68-8d99707924d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:05.103514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b3d303-8fc0-42fb-9a68-8d99707924d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:05.115489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b3d303-8fc0-42fb-9a68-8d99707924d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-e0b3d303-8fc0-42fb-9a68-8d99707924d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:00:05.120408 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:00:05.121389 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:00:05.122465 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 585/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 04:00:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:00:05.130766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75958477-ab7f-41c5-b894-6386c3d2bc15 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:05.184244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:05.234828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75958477-ab7f-41c5-b894-6386c3d2bc15 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:05.269821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb095b8-f1d7-408f-91a9-28abd1c68036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:05.270444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb095b8-f1d7-408f-91a9-28abd1c68036 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:05.270713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb095b8-f1d7-408f-91a9-28abd1c68036 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:05.270973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb095b8-f1d7-408f-91a9-28abd1c68036 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:05.271631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb095b8-f1d7-408f-91a9-28abd1c68036 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:05.271928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb095b8-f1d7-408f-91a9-28abd1c68036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:05.273298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb095b8-f1d7-408f-91a9-28abd1c68036 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:05.281674 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 565/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 04:00:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:00:05.288401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d303-8fc0-42fb-9a68-8d99707924d2 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:05.399084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b3d303-8fc0-42fb-9a68-8d99707924d2 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:05.426334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:05.435525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e7a43-5845-437a-ae43-b6ed75484fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:05.436162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7a43-5845-437a-ae43-b6ed75484fbb None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:05.436433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7a43-5845-437a-ae43-b6ed75484fbb None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:05.436696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e7a43-5845-437a-ae43-b6ed75484fbb None admin] PATH_INFO: `/v3/users/82a0c994eedb492e89a1971fac59af2a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:05.437816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e7a43-5845-437a-ae43-b6ed75484fbb None admin] RBAC: Authorizing `identity:get_user(user_id=82a0c994eedb492e89a1971fac59af2a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:05.439284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e7a43-5845-437a-ae43-b6ed75484fbb None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:05.440897 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 586/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 04:00:05 2022] GET /identity/v3/users/82a0c994eedb492e89a1971fac59af2a => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:05.447213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb095b8-f1d7-408f-91a9-28abd1c68036 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:05.555776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb095b8-f1d7-408f-91a9-28abd1c68036 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:05.568048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:05.593803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0223e-76d8-441c-b8b3-b1a957538ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:05.594464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0223e-76d8-441c-b8b3-b1a957538ec8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:05.594713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0223e-76d8-441c-b8b3-b1a957538ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:05.594972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0223e-76d8-441c-b8b3-b1a957538ec8 None admin] PATH_INFO: `/v3/projects/d78a10104f514aea818aea05403ca2a0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:05.596131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0223e-76d8-441c-b8b3-b1a957538ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=d78a10104f514aea818aea05403ca2a0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:05.597587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0223e-76d8-441c-b8b3-b1a957538ec8 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:05.599246 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 566/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 04:00:05 2022] GET /identity/v3/projects/d78a10104f514aea818aea05403ca2a0 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:05.608414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e7a43-5845-437a-ae43-b6ed75484fbb None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:05.711726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e7a43-5845-437a-ae43-b6ed75484fbb None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:05.747220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80656078-a585-4305-9ac9-efcb48a3659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:05.747873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80656078-a585-4305-9ac9-efcb48a3659f None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:05.748142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80656078-a585-4305-9ac9-efcb48a3659f None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:05.748413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80656078-a585-4305-9ac9-efcb48a3659f None admin] PATH_INFO: `/v3/projects/d78a10104f514aea818aea05403ca2a0/users/82a0c994eedb492e89a1971fac59af2a/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:05.750461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80656078-a585-4305-9ac9-efcb48a3659f None admin] RBAC: Authorizing `identity:create_grant(project_id=d78a10104f514aea818aea05403ca2a0, user_id=82a0c994eedb492e89a1971fac59af2a, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:05.751905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80656078-a585-4305-9ac9-efcb48a3659f None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:05.767782 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 587/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 04:00:05 2022] PUT /identity/v3/projects/d78a10104f514aea818aea05403ca2a0/users/82a0c994eedb492e89a1971fac59af2a/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:00:07.671737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb7ab3-ac51-4b5e-9e6e-379e7bb66f11 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:07.672272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb7ab3-ac51-4b5e-9e6e-379e7bb66f11 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:07.672272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb7ab3-ac51-4b5e-9e6e-379e7bb66f11 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:07.673598 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 567/1154] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:00:07.679016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6dcc-4020-43ef-80d1-6e08876dd8b9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:07.679487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6dcc-4020-43ef-80d1-6e08876dd8b9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:07.679594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f6dcc-4020-43ef-80d1-6e08876dd8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:07.701366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f66f6dcc-4020-43ef-80d1-6e08876dd8b9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:00:07.702599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f66f6dcc-4020-43ef-80d1-6e08876dd8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:00:07.756276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:07.773757 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 588/1155] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:00:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:00:08.038157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb7ab3-ac51-4b5e-9e6e-379e7bb66f11 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:08.147725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb7ab3-ac51-4b5e-9e6e-379e7bb66f11 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:08.184382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f280e74-b108-48af-bf2f-4dde953cae6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:08.185013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f280e74-b108-48af-bf2f-4dde953cae6f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:08.185283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f280e74-b108-48af-bf2f-4dde953cae6f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:08.185549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f280e74-b108-48af-bf2f-4dde953cae6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:08.196965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f280e74-b108-48af-bf2f-4dde953cae6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-0f280e74-b108-48af-bf2f-4dde953cae6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:00:08.201731 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:00:08.202890 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:00:08.203885 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 568/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 04:00:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:00:08.209152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f6dcc-4020-43ef-80d1-6e08876dd8b9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:08.312894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f6dcc-4020-43ef-80d1-6e08876dd8b9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:08.348995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c290-afc0-4b01-83b3-c02faca5e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:08.349600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c290-afc0-4b01-83b3-c02faca5e693 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:08.349908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c290-afc0-4b01-83b3-c02faca5e693 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:08.350156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c290-afc0-4b01-83b3-c02faca5e693 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:08.350818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c290-afc0-4b01-83b3-c02faca5e693 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:08.351117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c290-afc0-4b01-83b3-c02faca5e693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:08.352471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c290-afc0-4b01-83b3-c02faca5e693 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:08.361149 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 589/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 04:00:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:08.367267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f280e74-b108-48af-bf2f-4dde953cae6f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:08.418873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:08.484632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f280e74-b108-48af-bf2f-4dde953cae6f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:08.519699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823e5e0-1f3c-4281-8521-9003e5419f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:08.520332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e5e0-1f3c-4281-8521-9003e5419f80 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:08.520601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e5e0-1f3c-4281-8521-9003e5419f80 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:08.520861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e5e0-1f3c-4281-8521-9003e5419f80 None admin] PATH_INFO: `/v3/users/82a0c994eedb492e89a1971fac59af2a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:08.522013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823e5e0-1f3c-4281-8521-9003e5419f80 None admin] RBAC: Authorizing `identity:get_user(user_id=82a0c994eedb492e89a1971fac59af2a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:08.523458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823e5e0-1f3c-4281-8521-9003e5419f80 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:08.525911 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 569/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 04:00:08 2022] GET /identity/v3/users/82a0c994eedb492e89a1971fac59af2a => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:08.531265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c290-afc0-4b01-83b3-c02faca5e693 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:08.580766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:08.632836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c290-afc0-4b01-83b3-c02faca5e693 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:08.670637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cd913-3474-4da1-9a86-4e22eba5f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:08.671259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cd913-3474-4da1-9a86-4e22eba5f91a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:08.671528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cd913-3474-4da1-9a86-4e22eba5f91a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:08.671789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cd913-3474-4da1-9a86-4e22eba5f91a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:08.739443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cd913-3474-4da1-9a86-4e22eba5f91a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:08.740893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cd913-3474-4da1-9a86-4e22eba5f91a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:08.789988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:08.845720 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 590/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 04:00:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:00:08.851978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823e5e0-1f3c-4281-8521-9003e5419f80 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:08.956637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823e5e0-1f3c-4281-8521-9003e5419f80 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:08.964115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:08.997543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f5f49-bae2-4eb6-93f5-5b03ae5ca656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:08.998205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f5f49-bae2-4eb6-93f5-5b03ae5ca656 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:08.998480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f5f49-bae2-4eb6-93f5-5b03ae5ca656 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:08.998749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f5f49-bae2-4eb6-93f5-5b03ae5ca656 None admin] PATH_INFO: `/v3/projects/d78a10104f514aea818aea05403ca2a0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:08.999913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f5f49-bae2-4eb6-93f5-5b03ae5ca656 None admin] RBAC: Authorizing `identity:get_project(project_id=d78a10104f514aea818aea05403ca2a0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:09.001395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f5f49-bae2-4eb6-93f5-5b03ae5ca656 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:09.003062 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 570/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 04:00:08 2022] GET /identity/v3/projects/d78a10104f514aea818aea05403ca2a0 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:09.009677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cd913-3474-4da1-9a86-4e22eba5f91a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:09.114899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cd913-3474-4da1-9a86-4e22eba5f91a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:09.150782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea49df-702b-4556-b268-15895b9aaee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:09.151398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea49df-702b-4556-b268-15895b9aaee7 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:09.151661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea49df-702b-4556-b268-15895b9aaee7 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:09.151924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea49df-702b-4556-b268-15895b9aaee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:09.152645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea49df-702b-4556-b268-15895b9aaee7 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=d78a10104f514aea818aea05403ca2a0, user.id=82a0c994eedb492e89a1971fac59af2a) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:09.152948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea49df-702b-4556-b268-15895b9aaee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:09.154417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea49df-702b-4556-b268-15895b9aaee7 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:09.160432 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 591/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 04:00:09 2022] GET /identity/v3/role_assignments?user.id=82a0c994eedb492e89a1971fac59af2a&scope.project.id=d78a10104f514aea818aea05403ca2a0&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:11.070048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8f72-bd73-496f-a2de-e130d2a99db7 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:11.070624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8f72-bd73-496f-a2de-e130d2a99db7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:11.070624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b8f72-bd73-496f-a2de-e130d2a99db7 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:11.071984 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 571/1162] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:00:11.077667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44adff-c781-4fde-9607-1a05e415d6be None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:11.078137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44adff-c781-4fde-9607-1a05e415d6be None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:11.078245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44adff-c781-4fde-9607-1a05e415d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:11.097538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-db44adff-c781-4fde-9607-1a05e415d6be None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:00:11.098845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-db44adff-c781-4fde-9607-1a05e415d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:00:11.106681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:11.172105 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 592/1163] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:00:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:00:11.442501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b8f72-bd73-496f-a2de-e130d2a99db7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:11.549818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b8f72-bd73-496f-a2de-e130d2a99db7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:11.585851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca09a2-897d-4f54-a7d7-39dd6c983142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:11.586491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca09a2-897d-4f54-a7d7-39dd6c983142 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:11.586760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca09a2-897d-4f54-a7d7-39dd6c983142 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:11.587024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca09a2-897d-4f54-a7d7-39dd6c983142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:11.632835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:11.662186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca09a2-897d-4f54-a7d7-39dd6c983142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:11.663674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca09a2-897d-4f54-a7d7-39dd6c983142 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:11.772501 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 572/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 04:00:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:00:11.778917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44adff-c781-4fde-9607-1a05e415d6be None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:11.883672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44adff-c781-4fde-9607-1a05e415d6be None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:11.919284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75a5b2-fce3-4bb3-bac7-aba87e15ad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:11.919933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a5b2-fce3-4bb3-bac7-aba87e15ad0c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:11.920205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a5b2-fce3-4bb3-bac7-aba87e15ad0c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:11.920461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a5b2-fce3-4bb3-bac7-aba87e15ad0c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:11.928093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75a5b2-fce3-4bb3-bac7-aba87e15ad0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:11.929555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75a5b2-fce3-4bb3-bac7-aba87e15ad0c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-7f75a5b2-fce3-4bb3-bac7-aba87e15ad0c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:00:11.941710 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:00:11.942863 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:00:11.943917 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 593/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 04:00:11 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:00:11.949337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca09a2-897d-4f54-a7d7-39dd6c983142 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:12.043863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:12.071580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca09a2-897d-4f54-a7d7-39dd6c983142 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:12.109623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a017f-1096-46d5-8224-af00b1e958b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:12.110261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a017f-1096-46d5-8224-af00b1e958b3 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:12.110533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a017f-1096-46d5-8224-af00b1e958b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:12.110796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a017f-1096-46d5-8224-af00b1e958b3 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:12.111804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a017f-1096-46d5-8224-af00b1e958b3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:12.112097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a017f-1096-46d5-8224-af00b1e958b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:12.113478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a017f-1096-46d5-8224-af00b1e958b3 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:12.121262 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 573/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 04:00:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:00:14.014287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0944-2804-4cd6-9095-0374450ec923 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:14.014834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0944-2804-4cd6-9095-0374450ec923 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:14.014834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc0944-2804-4cd6-9095-0374450ec923 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:14.016135 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 594/1167] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:00:14.021400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e750e9-5ce9-4d58-ab3b-3d9a3248227f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:14.021862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e750e9-5ce9-4d58-ab3b-3d9a3248227f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:14.021976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e750e9-5ce9-4d58-ab3b-3d9a3248227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:14.041437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-02e750e9-5ce9-4d58-ab3b-3d9a3248227f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:00:14.042673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-02e750e9-5ce9-4d58-ab3b-3d9a3248227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:00:14.112295 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 574/1168] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:00:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:00:14.378738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0944-2804-4cd6-9095-0374450ec923 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:14.381883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:14.486923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc0944-2804-4cd6-9095-0374450ec923 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:14.520865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92f25e-eb68-43dd-8555-078002a7f071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:14.521465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92f25e-eb68-43dd-8555-078002a7f071 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:14.521738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92f25e-eb68-43dd-8555-078002a7f071 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:14.522023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92f25e-eb68-43dd-8555-078002a7f071 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:14.522684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92f25e-eb68-43dd-8555-078002a7f071 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:14.524058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92f25e-eb68-43dd-8555-078002a7f071 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:14.541851 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 595/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Tue Aug 30 04:00:14 2022] POST /identity/v3/domains => generated 267 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:00:16.450637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f85a1-8799-4549-bfa8-53a15cdc5cfa None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:16.451250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f85a1-8799-4549-bfa8-53a15cdc5cfa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:16.451250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f85a1-8799-4549-bfa8-53a15cdc5cfa None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:16.452523 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 575/1170] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:00:16.458009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcbe1c-55e1-435b-bad0-778b1acf46b3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:16.458489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcbe1c-55e1-435b-bad0-778b1acf46b3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:16.458587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcbe1c-55e1-435b-bad0-778b1acf46b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:16.480363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-07dcbe1c-55e1-435b-bad0-778b1acf46b3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:00:16.481622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-07dcbe1c-55e1-435b-bad0-778b1acf46b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:00:16.545290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:16.557428 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 596/1171] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:00:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:00:16.817759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f85a1-8799-4549-bfa8-53a15cdc5cfa None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:16.892076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:16.928334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f85a1-8799-4549-bfa8-53a15cdc5cfa None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:16.965053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7d7c9-3481-4fb7-a34d-68044949c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:16.965677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7d7c9-3481-4fb7-a34d-68044949c0cc None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:16.966029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7d7c9-3481-4fb7-a34d-68044949c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:16.966329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7d7c9-3481-4fb7-a34d-68044949c0cc None admin] PATH_INFO: `/v3/domains/aeb1f4ac593c40e6bc681652e63c1f3a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:16.977599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7d7c9-3481-4fb7-a34d-68044949c0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=aeb1f4ac593c40e6bc681652e63c1f3a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:16.979227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7d7c9-3481-4fb7-a34d-68044949c0cc None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:16.980833 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 576/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Aug 30 04:00:16 2022] GET /identity/v3/domains/aeb1f4ac593c40e6bc681652e63c1f3a => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:16.987411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcbe1c-55e1-435b-bad0-778b1acf46b3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:17.088454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcbe1c-55e1-435b-bad0-778b1acf46b3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:17.124547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102383-d9cc-4b00-b4fd-5a7ea5895958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:17.125173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102383-d9cc-4b00-b4fd-5a7ea5895958 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:17.125420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102383-d9cc-4b00-b4fd-5a7ea5895958 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:17.125687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102383-d9cc-4b00-b4fd-5a7ea5895958 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:17.126365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102383-d9cc-4b00-b4fd-5a7ea5895958 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:17.127804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102383-d9cc-4b00-b4fd-5a7ea5895958 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:17.155121 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 597/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 04:00:16 2022] POST /identity/v3/projects => generated 361 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:00:19.073615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9246b63-5a57-418f-bf91-40b22e1bb6a0 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:19.074231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9246b63-5a57-418f-bf91-40b22e1bb6a0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:19.074231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9246b63-5a57-418f-bf91-40b22e1bb6a0 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:19.075536 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 577/1174] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:00:19.081034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c4ac-ac5f-493c-896f-afdfcfec5626 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:19.081457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c4ac-ac5f-493c-896f-afdfcfec5626 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:19.081570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c4ac-ac5f-493c-896f-afdfcfec5626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:19.101293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9b67c4ac-ac5f-493c-896f-afdfcfec5626 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:00:19.102515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9b67c4ac-ac5f-493c-896f-afdfcfec5626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:00:19.145220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:19.173029 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 598/1175] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:00:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:00:19.439524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9246b63-5a57-418f-bf91-40b22e1bb6a0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:19.544561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9246b63-5a57-418f-bf91-40b22e1bb6a0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:19.571271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:19.581037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61929-75e9-4444-b23e-2d48617773f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:19.581665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61929-75e9-4444-b23e-2d48617773f0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:19.581964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61929-75e9-4444-b23e-2d48617773f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:19.582233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61929-75e9-4444-b23e-2d48617773f0 None admin] PATH_INFO: `/v3/domains/aeb1f4ac593c40e6bc681652e63c1f3a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:19.583388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf61929-75e9-4444-b23e-2d48617773f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=aeb1f4ac593c40e6bc681652e63c1f3a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:19.584837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf61929-75e9-4444-b23e-2d48617773f0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:19.586428 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 578/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Aug 30 04:00:19 2022] GET /identity/v3/domains/aeb1f4ac593c40e6bc681652e63c1f3a => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:19.592526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c4ac-ac5f-493c-896f-afdfcfec5626 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:19.697742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c4ac-ac5f-493c-896f-afdfcfec5626 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:19.733936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb4fa4-cc1e-4b14-af3c-068ee1c83fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:19.734583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb4fa4-cc1e-4b14-af3c-068ee1c83fc0 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:19.734853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb4fa4-cc1e-4b14-af3c-068ee1c83fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:19.735113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb4fa4-cc1e-4b14-af3c-068ee1c83fc0 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:19.735788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb4fa4-cc1e-4b14-af3c-068ee1c83fc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:19.737585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb4fa4-cc1e-4b14-af3c-068ee1c83fc0 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:19.758553 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 599/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 04:00:19 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:00:21.690081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eb425-ef90-4c0e-8c0a-794ed61e154d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:21.690650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eb425-ef90-4c0e-8c0a-794ed61e154d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:21.690650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841eb425-ef90-4c0e-8c0a-794ed61e154d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:21.692094 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 579/1178] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:00:21.698812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fef1f-cf4e-419a-aa6f-cf6a0d3873f1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:21.699255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fef1f-cf4e-419a-aa6f-cf6a0d3873f1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:21.699412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fef1f-cf4e-419a-aa6f-cf6a0d3873f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:21.721297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-813fef1f-cf4e-419a-aa6f-cf6a0d3873f1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:00:21.722508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-813fef1f-cf4e-419a-aa6f-cf6a0d3873f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:00:21.749805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:21.801739 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 600/1179] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:00:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:00:22.085498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841eb425-ef90-4c0e-8c0a-794ed61e154d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:22.188805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841eb425-ef90-4c0e-8c0a-794ed61e154d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:22.223784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd16377-8ca6-4638-99cc-2ee0bc2c7bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:22.224406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd16377-8ca6-4638-99cc-2ee0bc2c7bdc None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:22.224676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd16377-8ca6-4638-99cc-2ee0bc2c7bdc None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:22.224943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd16377-8ca6-4638-99cc-2ee0bc2c7bdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:22.235818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd16377-8ca6-4638-99cc-2ee0bc2c7bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-1fd16377-8ca6-4638-99cc-2ee0bc2c7bdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:00:22.240958 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:00:22.242185 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:00:22.243113 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 580/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 04:00:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:00:22.248410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fef1f-cf4e-419a-aa6f-cf6a0d3873f1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:22.354003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fef1f-cf4e-419a-aa6f-cf6a0d3873f1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:22.394442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d28444-6dd8-4f16-a561-dfdb9d6e5631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:22.395064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d28444-6dd8-4f16-a561-dfdb9d6e5631 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:22.395346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d28444-6dd8-4f16-a561-dfdb9d6e5631 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:22.395614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d28444-6dd8-4f16-a561-dfdb9d6e5631 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:22.396285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d28444-6dd8-4f16-a561-dfdb9d6e5631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:22.396569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d28444-6dd8-4f16-a561-dfdb9d6e5631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:22.398093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d28444-6dd8-4f16-a561-dfdb9d6e5631 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:22.408315 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 601/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 04:00:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:22.414618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd16377-8ca6-4638-99cc-2ee0bc2c7bdc None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:22.475288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:22.520942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd16377-8ca6-4638-99cc-2ee0bc2c7bdc None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:22.558455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e6fc-2fa2-47c7-adf9-f4776e92a3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:22.559087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e6fc-2fa2-47c7-adf9-f4776e92a3a0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:22.559360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e6fc-2fa2-47c7-adf9-f4776e92a3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:22.559631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6e6fc-2fa2-47c7-adf9-f4776e92a3a0 None admin] PATH_INFO: `/v3/users/761e0a1522b04377b35214eb5a39d4a0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:22.574065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6e6fc-2fa2-47c7-adf9-f4776e92a3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=761e0a1522b04377b35214eb5a39d4a0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:22.575532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d6e6fc-2fa2-47c7-adf9-f4776e92a3a0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:22.577151 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 581/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 04:00:22 2022] GET /identity/v3/users/761e0a1522b04377b35214eb5a39d4a0 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:22.583468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d28444-6dd8-4f16-a561-dfdb9d6e5631 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:22.609207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:22.690601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d28444-6dd8-4f16-a561-dfdb9d6e5631 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:22.724839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47cfd3-fbcc-43a6-b6cc-de3e61cbcfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:22.725517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47cfd3-fbcc-43a6-b6cc-de3e61cbcfc3 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:22.725724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47cfd3-fbcc-43a6-b6cc-de3e61cbcfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:22.726022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47cfd3-fbcc-43a6-b6cc-de3e61cbcfc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:22.800664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47cfd3-fbcc-43a6-b6cc-de3e61cbcfc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:22.802162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47cfd3-fbcc-43a6-b6cc-de3e61cbcfc3 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:22.826294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:22.905297 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 602/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 04:00:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:00:22.911497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e6fc-2fa2-47c7-adf9-f4776e92a3a0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:23.015202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6e6fc-2fa2-47c7-adf9-f4776e92a3a0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:23.029505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:23.052270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c89a4-3e4d-4a4f-8a8d-f40c72d455b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:23.052898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c89a4-3e4d-4a4f-8a8d-f40c72d455b9 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:23.053170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c89a4-3e4d-4a4f-8a8d-f40c72d455b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:23.053445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c89a4-3e4d-4a4f-8a8d-f40c72d455b9 None admin] PATH_INFO: `/v3/projects/01c30461acb54b52bfb4edc9e21b40a9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:23.054597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c89a4-3e4d-4a4f-8a8d-f40c72d455b9 None admin] RBAC: Authorizing `identity:get_project(project_id=01c30461acb54b52bfb4edc9e21b40a9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:23.056040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c89a4-3e4d-4a4f-8a8d-f40c72d455b9 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:23.057727 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 582/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 04:00:22 2022] GET /identity/v3/projects/01c30461acb54b52bfb4edc9e21b40a9 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:23.064232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47cfd3-fbcc-43a6-b6cc-de3e61cbcfc3 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:23.165816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47cfd3-fbcc-43a6-b6cc-de3e61cbcfc3 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:23.189287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:23.202318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535f4d9-ec18-4bce-85ff-6a28bde17700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:23.202915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f4d9-ec18-4bce-85ff-6a28bde17700 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:23.203181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f4d9-ec18-4bce-85ff-6a28bde17700 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:23.203439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f4d9-ec18-4bce-85ff-6a28bde17700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:23.204162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535f4d9-ec18-4bce-85ff-6a28bde17700 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=01c30461acb54b52bfb4edc9e21b40a9, user.id=761e0a1522b04377b35214eb5a39d4a0) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:23.204461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535f4d9-ec18-4bce-85ff-6a28bde17700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:23.205925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535f4d9-ec18-4bce-85ff-6a28bde17700 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:23.211230 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 603/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 04:00:23 2022] GET /identity/v3/role_assignments?user.id=761e0a1522b04377b35214eb5a39d4a0&scope.project.id=01c30461acb54b52bfb4edc9e21b40a9&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:25.069419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c02c4-2761-4e19-9b8b-574ca9f1ece9 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:25.070011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c02c4-2761-4e19-9b8b-574ca9f1ece9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:25.070011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c02c4-2761-4e19-9b8b-574ca9f1ece9 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:25.071321 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 583/1186] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:00:25.076912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dbb46-c8fc-4fa9-9949-9cd6fea50ecf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:25.077356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dbb46-c8fc-4fa9-9949-9cd6fea50ecf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:25.077454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dbb46-c8fc-4fa9-9949-9cd6fea50ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:25.096288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4b5dbb46-c8fc-4fa9-9949-9cd6fea50ecf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:00:25.097475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4b5dbb46-c8fc-4fa9-9949-9cd6fea50ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:00:25.166974 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 604/1187] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:00:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:00:25.428664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c02c4-2761-4e19-9b8b-574ca9f1ece9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:25.536104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c02c4-2761-4e19-9b8b-574ca9f1ece9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:25.571996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636212a7-d249-454c-b16e-6cd221295ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:25.572623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636212a7-d249-454c-b16e-6cd221295ee8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:25.572896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636212a7-d249-454c-b16e-6cd221295ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:25.573163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636212a7-d249-454c-b16e-6cd221295ee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:25.583855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636212a7-d249-454c-b16e-6cd221295ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-636212a7-d249-454c-b16e-6cd221295ee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:00:25.588595 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:00:25.589634 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:25.590662 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:00:25.594062 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 584/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 04:00:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:00:25.596134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dbb46-c8fc-4fa9-9949-9cd6fea50ecf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:25.699638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dbb46-c8fc-4fa9-9949-9cd6fea50ecf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:25.716947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:25.736454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97443711-fd92-4a44-9ee7-74438c35ab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:25.737068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443711-fd92-4a44-9ee7-74438c35ab92 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:25.737694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443711-fd92-4a44-9ee7-74438c35ab92 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:25.737979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97443711-fd92-4a44-9ee7-74438c35ab92 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:25.738634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97443711-fd92-4a44-9ee7-74438c35ab92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:25.738917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97443711-fd92-4a44-9ee7-74438c35ab92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:25.740292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97443711-fd92-4a44-9ee7-74438c35ab92 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:25.748412 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 605/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 04:00:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:25.754560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636212a7-d249-454c-b16e-6cd221295ee8 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:25.798830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:25.858398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636212a7-d249-454c-b16e-6cd221295ee8 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:25.893894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7159c75-9a14-4fb1-9a8c-08a19dd10fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:25.894617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7159c75-9a14-4fb1-9a8c-08a19dd10fe0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:25.894891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7159c75-9a14-4fb1-9a8c-08a19dd10fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:25.895152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7159c75-9a14-4fb1-9a8c-08a19dd10fe0 None admin] PATH_INFO: `/v3/users/761e0a1522b04377b35214eb5a39d4a0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:25.896329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7159c75-9a14-4fb1-9a8c-08a19dd10fe0 None admin] RBAC: Authorizing `identity:get_user(user_id=761e0a1522b04377b35214eb5a39d4a0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:25.897777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7159c75-9a14-4fb1-9a8c-08a19dd10fe0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:25.899379 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 585/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 04:00:25 2022] GET /identity/v3/users/761e0a1522b04377b35214eb5a39d4a0 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:25.905728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97443711-fd92-4a44-9ee7-74438c35ab92 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:26.013210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97443711-fd92-4a44-9ee7-74438c35ab92 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:26.047582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0bdb7-ffa1-490f-979a-8c10c65688fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:26.048202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0bdb7-ffa1-490f-979a-8c10c65688fa None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:26.048472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0bdb7-ffa1-490f-979a-8c10c65688fa None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:26.048737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0bdb7-ffa1-490f-979a-8c10c65688fa None admin] PATH_INFO: `/v3/projects/01c30461acb54b52bfb4edc9e21b40a9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:26.049908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0bdb7-ffa1-490f-979a-8c10c65688fa None admin] RBAC: Authorizing `identity:get_project(project_id=01c30461acb54b52bfb4edc9e21b40a9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:26.051338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0bdb7-ffa1-490f-979a-8c10c65688fa None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:26.052963 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 606/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 04:00:25 2022] GET /identity/v3/projects/01c30461acb54b52bfb4edc9e21b40a9 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:00:26.059557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7159c75-9a14-4fb1-9a8c-08a19dd10fe0 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:26.163151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7159c75-9a14-4fb1-9a8c-08a19dd10fe0 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:26.174178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:26.198944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa2ae7-c1d7-4114-99e4-3deda32a0b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:26.199606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa2ae7-c1d7-4114-99e4-3deda32a0b48 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:26.199882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa2ae7-c1d7-4114-99e4-3deda32a0b48 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:26.200143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa2ae7-c1d7-4114-99e4-3deda32a0b48 None admin] PATH_INFO: `/v3/projects/01c30461acb54b52bfb4edc9e21b40a9/users/761e0a1522b04377b35214eb5a39d4a0/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:26.202096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa2ae7-c1d7-4114-99e4-3deda32a0b48 None admin] RBAC: Authorizing `identity:create_grant(project_id=01c30461acb54b52bfb4edc9e21b40a9, user_id=761e0a1522b04377b35214eb5a39d4a0, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:26.203547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa2ae7-c1d7-4114-99e4-3deda32a0b48 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:26.219883 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 586/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 04:00:26 2022] PUT /identity/v3/projects/01c30461acb54b52bfb4edc9e21b40a9/users/761e0a1522b04377b35214eb5a39d4a0/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:00:28.092526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cc8c0-699c-481c-ad03-38ecec8e70e5 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:28.093117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cc8c0-699c-481c-ad03-38ecec8e70e5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:28.093117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5cc8c0-699c-481c-ad03-38ecec8e70e5 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:28.094443 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 607/1193] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:00:28.099898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f358f2-d89d-4778-873c-fbf687923b99 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:28.100326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f358f2-d89d-4778-873c-fbf687923b99 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:28.100416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f358f2-d89d-4778-873c-fbf687923b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:28.120679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-62f358f2-d89d-4778-873c-fbf687923b99 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:00:28.122185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-62f358f2-d89d-4778-873c-fbf687923b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:00:28.194053 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 587/1194] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:00:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:00:28.457331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cc8c0-699c-481c-ad03-38ecec8e70e5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:28.506129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:28.562746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5cc8c0-699c-481c-ad03-38ecec8e70e5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:28.598932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f8067-e218-4be2-ac3e-47009eec86a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:28.599558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f8067-e218-4be2-ac3e-47009eec86a8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:28.599830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f8067-e218-4be2-ac3e-47009eec86a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:28.600097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f8067-e218-4be2-ac3e-47009eec86a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:28.611241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f8067-e218-4be2-ac3e-47009eec86a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-8b6f8067-e218-4be2-ac3e-47009eec86a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:00:28.616467 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:00:28.618419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:00:28.619985 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 608/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 04:00:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:00:28.624641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f358f2-d89d-4778-873c-fbf687923b99 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:28.725118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:28.728166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f358f2-d89d-4778-873c-fbf687923b99 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:28.764796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4411-5241-45bf-aa47-a33287d2c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:28.765400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4411-5241-45bf-aa47-a33287d2c286 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:28.765674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4411-5241-45bf-aa47-a33287d2c286 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:28.765956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4411-5241-45bf-aa47-a33287d2c286 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:28.766631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d4411-5241-45bf-aa47-a33287d2c286 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:28.766939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d4411-5241-45bf-aa47-a33287d2c286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:28.768334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d4411-5241-45bf-aa47-a33287d2c286 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:28.776503 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 588/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 04:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:28.782882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f8067-e218-4be2-ac3e-47009eec86a8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:28.889463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f8067-e218-4be2-ac3e-47009eec86a8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:28.896931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:28.925261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823e17d-55c2-4936-87ea-06eda2b5b1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:28.926005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e17d-55c2-4936-87ea-06eda2b5b1b8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:28.926166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e17d-55c2-4936-87ea-06eda2b5b1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:28.926460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823e17d-55c2-4936-87ea-06eda2b5b1b8 None admin] PATH_INFO: `/v3/users/761e0a1522b04377b35214eb5a39d4a0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:28.927620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823e17d-55c2-4936-87ea-06eda2b5b1b8 None admin] RBAC: Authorizing `identity:get_user(user_id=761e0a1522b04377b35214eb5a39d4a0)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:28.929029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823e17d-55c2-4936-87ea-06eda2b5b1b8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:28.930657 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 609/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 04:00:28 2022] GET /identity/v3/users/761e0a1522b04377b35214eb5a39d4a0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:28.937441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4411-5241-45bf-aa47-a33287d2c286 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:29.045065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4411-5241-45bf-aa47-a33287d2c286 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:29.080112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b234fd-2873-4233-a1ce-d22163692270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:29.080725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b234fd-2873-4233-a1ce-d22163692270 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:29.080999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b234fd-2873-4233-a1ce-d22163692270 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:29.081270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b234fd-2873-4233-a1ce-d22163692270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:29.112579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:29.152756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b234fd-2873-4233-a1ce-d22163692270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:29.154257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b234fd-2873-4233-a1ce-d22163692270 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:29.256757 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 589/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 04:00:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:00:29.263765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823e17d-55c2-4936-87ea-06eda2b5b1b8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:29.379607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823e17d-55c2-4936-87ea-06eda2b5b1b8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:29.419677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6194ddf-6ffc-4915-9d99-74a7cb02a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:29.420305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6194ddf-6ffc-4915-9d99-74a7cb02a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:29.420571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6194ddf-6ffc-4915-9d99-74a7cb02a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:29.420837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6194ddf-6ffc-4915-9d99-74a7cb02a9a3 None admin] PATH_INFO: `/v3/projects/01c30461acb54b52bfb4edc9e21b40a9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:29.421967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6194ddf-6ffc-4915-9d99-74a7cb02a9a3 None admin] RBAC: Authorizing `identity:get_project(project_id=01c30461acb54b52bfb4edc9e21b40a9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:29.423408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6194ddf-6ffc-4915-9d99-74a7cb02a9a3 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:29.425046 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 610/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 04:00:29 2022] GET /identity/v3/projects/01c30461acb54b52bfb4edc9e21b40a9 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:29.431572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b234fd-2873-4233-a1ce-d22163692270 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:00:29.496454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:29.537083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b234fd-2873-4233-a1ce-d22163692270 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:00:29.573345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ade75e-2c51-4c4c-a3b6-b4cecb1b565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:00:29.574027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade75e-2c51-4c4c-a3b6-b4cecb1b565c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:00:29.574302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade75e-2c51-4c4c-a3b6-b4cecb1b565c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:00:29.574570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ade75e-2c51-4c4c-a3b6-b4cecb1b565c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:00:29.575299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade75e-2c51-4c4c-a3b6-b4cecb1b565c None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=01c30461acb54b52bfb4edc9e21b40a9, user.id=761e0a1522b04377b35214eb5a39d4a0) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:00:29.575600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade75e-2c51-4c4c-a3b6-b4cecb1b565c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:00:29.577062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ade75e-2c51-4c4c-a3b6-b4cecb1b565c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:00:29.583974 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 590/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 04:00:29 2022] GET /identity/v3/role_assignments?user.id=761e0a1522b04377b35214eb5a39d4a0&scope.project.id=01c30461acb54b52bfb4edc9e21b40a9&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:00:39.414756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=79 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:39.581027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=37 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:25.541005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bedfc-59ad-4c3f-a102-9be745286a80 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:25.541005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bedfc-59ad-4c3f-a102-9be745286a80 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:25.541005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506bedfc-59ad-4c3f-a102-9be745286a80 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:25.541005 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 611/1201] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:01:25.548006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412aab7-2cdf-4378-8a5d-41c3d7f51672 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:25.549206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412aab7-2cdf-4378-8a5d-41c3d7f51672 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:25.550039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412aab7-2cdf-4378-8a5d-41c3d7f51672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:25.571438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c412aab7-2cdf-4378-8a5d-41c3d7f51672 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:01:25.572960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c412aab7-2cdf-4378-8a5d-41c3d7f51672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:01:25.665921 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 591/1202] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:01:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:01:25.970201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bedfc-59ad-4c3f-a102-9be745286a80 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:26.127936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506bedfc-59ad-4c3f-a102-9be745286a80 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:26.184587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726a10-df06-4c8a-acc2-2364f53e4be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:26.185494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726a10-df06-4c8a-acc2-2364f53e4be9 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:26.185790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726a10-df06-4c8a-acc2-2364f53e4be9 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:26.186254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726a10-df06-4c8a-acc2-2364f53e4be9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:26.206263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726a10-df06-4c8a-acc2-2364f53e4be9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:26.209259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726a10-df06-4c8a-acc2-2364f53e4be9 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-e8726a10-df06-4c8a-acc2-2364f53e4be9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:26.232139 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:26.233673 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:26.235265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:26.235265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:26.235265 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:26.235265 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 612/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:26.241838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412aab7-2cdf-4378-8a5d-41c3d7f51672 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:26.372530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412aab7-2cdf-4378-8a5d-41c3d7f51672 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:26.415819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:26.423494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71c55e-2153-412b-9f03-9fcaf8cf40c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:26.424704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71c55e-2153-412b-9f03-9fcaf8cf40c0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:26.425105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71c55e-2153-412b-9f03-9fcaf8cf40c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:26.425889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71c55e-2153-412b-9f03-9fcaf8cf40c0 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:26.426673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71c55e-2153-412b-9f03-9fcaf8cf40c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:26.427089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71c55e-2153-412b-9f03-9fcaf8cf40c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:26.428701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71c55e-2153-412b-9f03-9fcaf8cf40c0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:26.445937 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 592/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:26.452125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726a10-df06-4c8a-acc2-2364f53e4be9 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:26.529700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:26.595174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726a10-df06-4c8a-acc2-2364f53e4be9 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:26.642572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47db91f-68a3-4a72-8113-d2126d409071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:26.643193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db91f-68a3-4a72-8113-d2126d409071 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:26.643550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db91f-68a3-4a72-8113-d2126d409071 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:26.643821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47db91f-68a3-4a72-8113-d2126d409071 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:26.644516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47db91f-68a3-4a72-8113-d2126d409071 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:26.646021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47db91f-68a3-4a72-8113-d2126d409071 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:26.673920 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 613/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 04:01:26 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:01:29.024070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec061f-11e5-4038-8e8a-3d3d1cb7eb97 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:29.024661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec061f-11e5-4038-8e8a-3d3d1cb7eb97 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:29.024661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec061f-11e5-4038-8e8a-3d3d1cb7eb97 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:29.026576 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 593/1206] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:01:29.035960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d97a5-51d1-4b85-ae9b-8a91b82b7a28 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:29.036516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d97a5-51d1-4b85-ae9b-8a91b82b7a28 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:29.036753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d97a5-51d1-4b85-ae9b-8a91b82b7a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:29.061074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c71d97a5-51d1-4b85-ae9b-8a91b82b7a28 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:01:29.062547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c71d97a5-51d1-4b85-ae9b-8a91b82b7a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:01:29.144690 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 614/1207] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:01:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 04:01:29.449667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec061f-11e5-4038-8e8a-3d3d1cb7eb97 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:29.602566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec061f-11e5-4038-8e8a-3d3d1cb7eb97 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:29.658667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691d7cf-585d-480c-aa4f-5d501411702f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:29.659678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d7cf-585d-480c-aa4f-5d501411702f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:29.660003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d7cf-585d-480c-aa4f-5d501411702f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:29.660229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691d7cf-585d-480c-aa4f-5d501411702f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:29.675475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691d7cf-585d-480c-aa4f-5d501411702f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-f691d7cf-585d-480c-aa4f-5d501411702f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:01:29.681313 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:29.682797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:29.683758 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 594/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 04:01:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:29.689114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d97a5-51d1-4b85-ae9b-8a91b82b7a28 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:29.737146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:29.837971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d97a5-51d1-4b85-ae9b-8a91b82b7a28 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:29.894409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc3a7e-3490-404d-807b-356a9d71d141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:29.896239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3a7e-3490-404d-807b-356a9d71d141 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:29.896611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3a7e-3490-404d-807b-356a9d71d141 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:29.896717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc3a7e-3490-404d-807b-356a9d71d141 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:29.897387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc3a7e-3490-404d-807b-356a9d71d141 None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:29.897684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc3a7e-3490-404d-807b-356a9d71d141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:29.899116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc3a7e-3490-404d-807b-356a9d71d141 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:29.908498 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 615/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 04:01:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:29.914881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691d7cf-585d-480c-aa4f-5d501411702f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:29.981205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:30.058866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691d7cf-585d-480c-aa4f-5d501411702f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:30.102927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26321dee-98be-44be-b6ab-2f3d89882497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:30.103717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321dee-98be-44be-b6ab-2f3d89882497 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:30.104013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321dee-98be-44be-b6ab-2f3d89882497 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:30.104431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321dee-98be-44be-b6ab-2f3d89882497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:30.120165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26321dee-98be-44be-b6ab-2f3d89882497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:30.121568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26321dee-98be-44be-b6ab-2f3d89882497 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-26321dee-98be-44be-b6ab-2f3d89882497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:30.138496 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:30.139767 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:30.140729 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:30.140729 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:30.140729 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:30.140729 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 595/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:30.147143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc3a7e-3490-404d-807b-356a9d71d141 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:30.277584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:30.280413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc3a7e-3490-404d-807b-356a9d71d141 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:30.322110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a92b-35fb-4079-967c-216762959a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:30.322711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a92b-35fb-4079-967c-216762959a60 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:30.322982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a92b-35fb-4079-967c-216762959a60 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:30.323250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a92b-35fb-4079-967c-216762959a60 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:30.323904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1a92b-35fb-4079-967c-216762959a60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:30.324235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1a92b-35fb-4079-967c-216762959a60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:30.325585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1a92b-35fb-4079-967c-216762959a60 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:30.342083 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 616/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:30.344326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26321dee-98be-44be-b6ab-2f3d89882497 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:30.463026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26321dee-98be-44be-b6ab-2f3d89882497 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:30.463785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:30.504374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a972-fea4-4634-867a-a005f4185c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:30.505160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a972-fea4-4634-867a-a005f4185c2c None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:30.505530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a972-fea4-4634-867a-a005f4185c2c None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:30.505948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0a972-fea4-4634-867a-a005f4185c2c None admin] PATH_INFO: `/v3/users/placement` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:30.516838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0a972-fea4-4634-867a-a005f4185c2c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:30.518604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f0a972-fea4-4634-867a-a005f4185c2c None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-a8f0a972-fea4-4634-867a-a005f4185c2c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:01:30.530722 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:30.532119 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:30.533544 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 596/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:30.538485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a92b-35fb-4079-967c-216762959a60 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:30.646105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a92b-35fb-4079-967c-216762959a60 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:30.683994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dd00c-a01d-46b1-a9a4-e716e83fc432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:30.684557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dd00c-a01d-46b1-a9a4-e716e83fc432 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:30.684863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dd00c-a01d-46b1-a9a4-e716e83fc432 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:30.685129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dd00c-a01d-46b1-a9a4-e716e83fc432 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:30.685842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dd00c-a01d-46b1-a9a4-e716e83fc432 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:30.686193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dd00c-a01d-46b1-a9a4-e716e83fc432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:30.687616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dd00c-a01d-46b1-a9a4-e716e83fc432 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:30.709900 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 617/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 04:01:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:30.712853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a972-fea4-4634-867a-a005f4185c2c None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:30.862944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0a972-fea4-4634-867a-a005f4185c2c None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:30.924804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fbe81-7662-42b1-9765-17a7812757ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:30.926151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fbe81-7662-42b1-9765-17a7812757ba None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:30.926526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fbe81-7662-42b1-9765-17a7812757ba None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:30.926931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32fbe81-7662-42b1-9765-17a7812757ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:30.977818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:31.034189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fbe81-7662-42b1-9765-17a7812757ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:31.035971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32fbe81-7662-42b1-9765-17a7812757ba None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:31.157297 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 597/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 04:01:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:01:31.164515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dd00c-a01d-46b1-a9a4-e716e83fc432 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:31.189615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:31.288133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dd00c-a01d-46b1-a9a4-e716e83fc432 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:31.327013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869790c5-3bdd-4f85-880d-bfc6894aba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:31.327794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869790c5-3bdd-4f85-880d-bfc6894aba77 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:31.328164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869790c5-3bdd-4f85-880d-bfc6894aba77 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:31.328526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869790c5-3bdd-4f85-880d-bfc6894aba77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:31.340335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869790c5-3bdd-4f85-880d-bfc6894aba77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:31.342367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869790c5-3bdd-4f85-880d-bfc6894aba77 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-869790c5-3bdd-4f85-880d-bfc6894aba77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:31.362162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:31.363382 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:31.364482 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:31.364482 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:31.364482 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:31.365935 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 618/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:31.372683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fbe81-7662-42b1-9765-17a7812757ba None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:31.443860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:31.497554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32fbe81-7662-42b1-9765-17a7812757ba None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:31.542343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7cbdc-ebcf-486d-989f-c7dca422cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:31.542959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7cbdc-ebcf-486d-989f-c7dca422cefd None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:31.543231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7cbdc-ebcf-486d-989f-c7dca422cefd None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:31.543518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7cbdc-ebcf-486d-989f-c7dca422cefd None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:31.544167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7cbdc-ebcf-486d-989f-c7dca422cefd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:31.544463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7cbdc-ebcf-486d-989f-c7dca422cefd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:31.545843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7cbdc-ebcf-486d-989f-c7dca422cefd None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:31.557410 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 598/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:01:31.563902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869790c5-3bdd-4f85-880d-bfc6894aba77 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:31.643004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:31.680529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869790c5-3bdd-4f85-880d-bfc6894aba77 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:31.715876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50ef5c-ba50-4df0-a487-f4962b7cdb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:31.716594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50ef5c-ba50-4df0-a487-f4962b7cdb94 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:31.717424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50ef5c-ba50-4df0-a487-f4962b7cdb94 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:31.717845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50ef5c-ba50-4df0-a487-f4962b7cdb94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:31.725959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50ef5c-ba50-4df0-a487-f4962b7cdb94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:31.727610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50ef5c-ba50-4df0-a487-f4962b7cdb94 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-4e50ef5c-ba50-4df0-a487-f4962b7cdb94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:01:31.740641 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:31.741832 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:31.742965 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:01:31.742965 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:01:31.742965 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:01:31.742965 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:01:31.742965 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:01:31.742965 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:01:31.742965 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:31.742965 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:31.749746 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 619/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 04:01:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:31.751651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7cbdc-ebcf-486d-989f-c7dca422cefd None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:31.892076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7cbdc-ebcf-486d-989f-c7dca422cefd None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:31.927055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:31.946651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90856bf-57c3-4875-9351-17d1772895b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:31.947277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90856bf-57c3-4875-9351-17d1772895b0 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:31.947553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90856bf-57c3-4875-9351-17d1772895b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:31.947819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90856bf-57c3-4875-9351-17d1772895b0 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:31.948528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90856bf-57c3-4875-9351-17d1772895b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:31.948827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90856bf-57c3-4875-9351-17d1772895b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:31.950318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90856bf-57c3-4875-9351-17d1772895b0 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:31.964911 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 599/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 04:01:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:31.972345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50ef5c-ba50-4df0-a487-f4962b7cdb94 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:32.086893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50ef5c-ba50-4df0-a487-f4962b7cdb94 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:32.118053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:32.125166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5c8c-42db-4430-b52f-12daa75e4db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:32.125781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5c8c-42db-4430-b52f-12daa75e4db3 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:32.126087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5c8c-42db-4430-b52f-12daa75e4db3 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:32.126355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5c8c-42db-4430-b52f-12daa75e4db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:32.127089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b5c8c-42db-4430-b52f-12daa75e4db3 None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=f8e4120107ff4ec1b1f3846a7f475ecb) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:32.128051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b5c8c-42db-4430-b52f-12daa75e4db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:32.129502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b5c8c-42db-4430-b52f-12daa75e4db3 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:32.135206 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 620/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 04:01:31 2022] GET /identity/v3/role_assignments?user.id=f8e4120107ff4ec1b1f3846a7f475ecb&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:34.261562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2cbb2-5287-4162-860d-47ee55cc4374 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:34.262281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2cbb2-5287-4162-860d-47ee55cc4374 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:34.262281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2cbb2-5287-4162-860d-47ee55cc4374 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:34.263490 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 600/1220] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:01:34.269168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e84434-225b-4625-b3e9-c15d61b2d464 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:34.269700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e84434-225b-4625-b3e9-c15d61b2d464 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:34.269700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e84434-225b-4625-b3e9-c15d61b2d464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:34.289312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-40e84434-225b-4625-b3e9-c15d61b2d464 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:01:34.290581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-40e84434-225b-4625-b3e9-c15d61b2d464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:01:34.363602 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 621/1221] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:01:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:01:34.629157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2cbb2-5287-4162-860d-47ee55cc4374 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:34.740322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2cbb2-5287-4162-860d-47ee55cc4374 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:34.776319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cff2dc-e9c5-4a2e-8b87-f46831abce32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:34.776943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff2dc-e9c5-4a2e-8b87-f46831abce32 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:34.777213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff2dc-e9c5-4a2e-8b87-f46831abce32 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:34.777657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cff2dc-e9c5-4a2e-8b87-f46831abce32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:34.788759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cff2dc-e9c5-4a2e-8b87-f46831abce32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-94cff2dc-e9c5-4a2e-8b87-f46831abce32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:01:34.793667 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:34.795070 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:34.796568 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 601/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 04:01:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:01:34.803819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e84434-225b-4625-b3e9-c15d61b2d464 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:34.918062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e84434-225b-4625-b3e9-c15d61b2d464 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:34.951046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:34.962865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2d536-8c0c-4bfd-89cd-a6c22662c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:34.963493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2d536-8c0c-4bfd-89cd-a6c22662c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:34.963817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2d536-8c0c-4bfd-89cd-a6c22662c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:34.964179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2d536-8c0c-4bfd-89cd-a6c22662c1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:34.964858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2d536-8c0c-4bfd-89cd-a6c22662c1d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:34.965159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2d536-8c0c-4bfd-89cd-a6c22662c1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:34.966586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2d536-8c0c-4bfd-89cd-a6c22662c1d8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:34.975896 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 622/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 04:01:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:01:34.981914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cff2dc-e9c5-4a2e-8b87-f46831abce32 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:35.030077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:35.097890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cff2dc-e9c5-4a2e-8b87-f46831abce32 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:35.139337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325c122-c159-4aa1-b340-5dc38f17e480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:35.139980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325c122-c159-4aa1-b340-5dc38f17e480 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:35.140252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325c122-c159-4aa1-b340-5dc38f17e480 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:35.140515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325c122-c159-4aa1-b340-5dc38f17e480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:35.151179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325c122-c159-4aa1-b340-5dc38f17e480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:35.152802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325c122-c159-4aa1-b340-5dc38f17e480 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-7325c122-c159-4aa1-b340-5dc38f17e480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:35.169198 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:35.175212 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:35.176361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:35.176361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:35.176361 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:35.176361 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 602/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:35.177264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2d536-8c0c-4bfd-89cd-a6c22662c1d8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:35.287007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2d536-8c0c-4bfd-89cd-a6c22662c1d8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:35.322354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2ea36-c966-406c-85c1-d5ab15d684c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:35.323045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ea36-c966-406c-85c1-d5ab15d684c9 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:35.323391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ea36-c966-406c-85c1-d5ab15d684c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:35.323608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ea36-c966-406c-85c1-d5ab15d684c9 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:35.324316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2ea36-c966-406c-85c1-d5ab15d684c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:35.324609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2ea36-c966-406c-85c1-d5ab15d684c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:35.326093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2ea36-c966-406c-85c1-d5ab15d684c9 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:35.339296 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 623/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:35.344917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325c122-c159-4aa1-b340-5dc38f17e480 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:35.450378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:35.457799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325c122-c159-4aa1-b340-5dc38f17e480 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:35.493853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa318f-f507-42d4-bb07-e059304e70de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:35.494531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa318f-f507-42d4-bb07-e059304e70de None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:35.495174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa318f-f507-42d4-bb07-e059304e70de None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:35.495445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa318f-f507-42d4-bb07-e059304e70de None admin] PATH_INFO: `/v3/users/placement` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:35.504354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa318f-f507-42d4-bb07-e059304e70de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:35.505825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa318f-f507-42d4-bb07-e059304e70de None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-23fa318f-f507-42d4-bb07-e059304e70de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:01:35.518403 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:35.519666 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:35.520877 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 603/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:35.526118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2ea36-c966-406c-85c1-d5ab15d684c9 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:35.583061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:35.643100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2ea36-c966-406c-85c1-d5ab15d684c9 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:35.679552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ce31b-57e8-41f3-b3a6-38ebb8c347be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:35.680179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce31b-57e8-41f3-b3a6-38ebb8c347be None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:35.680450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce31b-57e8-41f3-b3a6-38ebb8c347be None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:35.680775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ce31b-57e8-41f3-b3a6-38ebb8c347be None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:35.681479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce31b-57e8-41f3-b3a6-38ebb8c347be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:35.681801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce31b-57e8-41f3-b3a6-38ebb8c347be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:35.683413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ce31b-57e8-41f3-b3a6-38ebb8c347be None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:35.703382 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 624/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 04:01:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:35.709605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa318f-f507-42d4-bb07-e059304e70de None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:35.819073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa318f-f507-42d4-bb07-e059304e70de None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:35.854750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f325f-576c-4d95-a8ed-2d906e89c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:35.855277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f325f-576c-4d95-a8ed-2d906e89c4ec None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:35.855553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f325f-576c-4d95-a8ed-2d906e89c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:35.855796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f325f-576c-4d95-a8ed-2d906e89c4ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:35.867701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f325f-576c-4d95-a8ed-2d906e89c4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:35.869184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f325f-576c-4d95-a8ed-2d906e89c4ec None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-5a0f325f-576c-4d95-a8ed-2d906e89c4ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:35.884542 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:35.891945 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:35.893410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:35.893410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:35.893410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:35.893410 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 604/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:35.894607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ce31b-57e8-41f3-b3a6-38ebb8c347be None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:35.999917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ce31b-57e8-41f3-b3a6-38ebb8c347be None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:36.002454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:36.047986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959ba90-002e-4767-875c-d80325ab6614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:36.048598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ba90-002e-4767-875c-d80325ab6614 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:36.048989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ba90-002e-4767-875c-d80325ab6614 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:36.049266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959ba90-002e-4767-875c-d80325ab6614 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:36.050263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959ba90-002e-4767-875c-d80325ab6614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:36.050649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959ba90-002e-4767-875c-d80325ab6614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:36.052829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959ba90-002e-4767-875c-d80325ab6614 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:36.073985 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 625/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:36.075282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f325f-576c-4d95-a8ed-2d906e89c4ec None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:36.085435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:36.195109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f325f-576c-4d95-a8ed-2d906e89c4ec None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:36.233694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b44f-12fc-446e-85a0-100d8e76e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:36.234428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b44f-12fc-446e-85a0-100d8e76e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:36.234705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b44f-12fc-446e-85a0-100d8e76e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:36.234972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b44f-12fc-446e-85a0-100d8e76e9c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:36.243247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b44f-12fc-446e-85a0-100d8e76e9c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:36.245289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b44f-12fc-446e-85a0-100d8e76e9c7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-4c48b44f-12fc-446e-85a0-100d8e76e9c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:01:36.257984 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:36.259151 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:36.260074 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:01:36.260074 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:01:36.260074 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:01:36.260074 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:01:36.260074 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:01:36.260074 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:01:36.260074 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:36.260074 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:36.260074 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 605/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 04:01:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:01:36.265292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959ba90-002e-4767-875c-d80325ab6614 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:36.379400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959ba90-002e-4767-875c-d80325ab6614 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:36.417260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa9d5f-ac3d-4d06-9e72-ee956ae62fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:36.417913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9d5f-ac3d-4d06-9e72-ee956ae62fe1 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:36.418198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9d5f-ac3d-4d06-9e72-ee956ae62fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:36.418472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9d5f-ac3d-4d06-9e72-ee956ae62fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:36.419169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa9d5f-ac3d-4d06-9e72-ee956ae62fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:36.419502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa9d5f-ac3d-4d06-9e72-ee956ae62fe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:36.420894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa9d5f-ac3d-4d06-9e72-ee956ae62fe1 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:36.433674 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 626/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 04:01:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:01:36.440694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b44f-12fc-446e-85a0-100d8e76e9c7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:36.533061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:36.574656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b44f-12fc-446e-85a0-100d8e76e9c7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:36.613110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7683ab0-4d3f-4ddc-934c-f9e058d00b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:36.613782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683ab0-4d3f-4ddc-934c-f9e058d00b58 None admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:36.614092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683ab0-4d3f-4ddc-934c-f9e058d00b58 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:36.614398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7683ab0-4d3f-4ddc-934c-f9e058d00b58 None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/f8e4120107ff4ec1b1f3846a7f475ecb/roles/a212b3b588c542cca718d55760a48f1f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:36.632600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7683ab0-4d3f-4ddc-934c-f9e058d00b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=f8e4120107ff4ec1b1f3846a7f475ecb, role_id=a212b3b588c542cca718d55760a48f1f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:36.634442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7683ab0-4d3f-4ddc-934c-f9e058d00b58 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:36.651726 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 606/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 04:01:36 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/f8e4120107ff4ec1b1f3846a7f475ecb/roles/a212b3b588c542cca718d55760a48f1f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:01:38.652177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f23e6-83d2-4f0a-93fd-10312e01e4de None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:38.652737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f23e6-83d2-4f0a-93fd-10312e01e4de None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:38.652737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f23e6-83d2-4f0a-93fd-10312e01e4de None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:38.654082 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 627/1233] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:01:38.660057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40bf18-d699-4d62-a380-7e7fa04b1076 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:38.660609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40bf18-d699-4d62-a380-7e7fa04b1076 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:38.660609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40bf18-d699-4d62-a380-7e7fa04b1076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:38.680350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3a40bf18-d699-4d62-a380-7e7fa04b1076 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:01:38.681695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3a40bf18-d699-4d62-a380-7e7fa04b1076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:01:38.764692 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 607/1234] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:01:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:01:39.082661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f23e6-83d2-4f0a-93fd-10312e01e4de None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:39.112600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:39.204472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f23e6-83d2-4f0a-93fd-10312e01e4de None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:39.246650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d597bb-d017-428d-bdcb-79d833d265fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:39.247301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d597bb-d017-428d-bdcb-79d833d265fd None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:39.247627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d597bb-d017-428d-bdcb-79d833d265fd None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:39.247888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d597bb-d017-428d-bdcb-79d833d265fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:39.262673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d597bb-d017-428d-bdcb-79d833d265fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-b9d597bb-d017-428d-bdcb-79d833d265fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:01:39.267571 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:39.268753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 04:01:39.270198 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:39.274096 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 628/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 04:01:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:39.275923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40bf18-d699-4d62-a380-7e7fa04b1076 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:39.331445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:39.407671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40bf18-d699-4d62-a380-7e7fa04b1076 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:39.446462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526773cb-d034-4488-adbd-56a120900268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:39.447148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526773cb-d034-4488-adbd-56a120900268 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:39.447428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526773cb-d034-4488-adbd-56a120900268 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:39.447690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526773cb-d034-4488-adbd-56a120900268 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:39.448366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526773cb-d034-4488-adbd-56a120900268 None admin] RBAC: Adding query filter params (name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:39.448660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526773cb-d034-4488-adbd-56a120900268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:39.450104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526773cb-d034-4488-adbd-56a120900268 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:39.460329 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 608/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 04:01:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:39.467623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d597bb-d017-428d-bdcb-79d833d265fd None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:39.566747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:39.585358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d597bb-d017-428d-bdcb-79d833d265fd None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:39.623790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161c36c-b915-412e-8894-49bd5e45635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:39.624497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c36c-b915-412e-8894-49bd5e45635d None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:39.624735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c36c-b915-412e-8894-49bd5e45635d None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:39.624996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161c36c-b915-412e-8894-49bd5e45635d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:39.636588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161c36c-b915-412e-8894-49bd5e45635d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:39.638105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161c36c-b915-412e-8894-49bd5e45635d None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-2161c36c-b915-412e-8894-49bd5e45635d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:39.654739 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:39.657215 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:39.658688 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:39.658688 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:39.658688 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:39.658688 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 629/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:39.662758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526773cb-d034-4488-adbd-56a120900268 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:39.794686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526773cb-d034-4488-adbd-56a120900268 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:39.805157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:39.839106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec58564-4b0f-4460-98cc-af2b86a1b4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:39.840014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec58564-4b0f-4460-98cc-af2b86a1b4f2 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:39.840351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec58564-4b0f-4460-98cc-af2b86a1b4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:39.840698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec58564-4b0f-4460-98cc-af2b86a1b4f2 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:39.841440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec58564-4b0f-4460-98cc-af2b86a1b4f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:39.841966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec58564-4b0f-4460-98cc-af2b86a1b4f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:39.844417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec58564-4b0f-4460-98cc-af2b86a1b4f2 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:39.868650 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 609/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:39.870651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161c36c-b915-412e-8894-49bd5e45635d None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:39.997010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161c36c-b915-412e-8894-49bd5e45635d None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:40.036591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022566e1-7ce1-45c1-a4f9-3481f8b675d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:40.037317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022566e1-7ce1-45c1-a4f9-3481f8b675d7 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:40.037552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022566e1-7ce1-45c1-a4f9-3481f8b675d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:40.037837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022566e1-7ce1-45c1-a4f9-3481f8b675d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:40.041090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:40.046995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022566e1-7ce1-45c1-a4f9-3481f8b675d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:40.048534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022566e1-7ce1-45c1-a4f9-3481f8b675d7 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-022566e1-7ce1-45c1-a4f9-3481f8b675d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:01:40.061558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:40.062940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:40.064438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:40.064438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:40.064438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:01:40.064438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:01:40.064438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:01:40.064438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:01:40.064438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:01:40.064438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:01:40.064438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:40.064438 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:40.070204 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 630/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:40.070377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec58564-4b0f-4460-98cc-af2b86a1b4f2 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:40.191070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec58564-4b0f-4460-98cc-af2b86a1b4f2 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:40.226499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e42df-81b7-4785-8461-1b2c1e4e5bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:40.227112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e42df-81b7-4785-8461-1b2c1e4e5bd7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:40.227382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e42df-81b7-4785-8461-1b2c1e4e5bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:40.227645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e42df-81b7-4785-8461-1b2c1e4e5bd7 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:40.228380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e42df-81b7-4785-8461-1b2c1e4e5bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:40.228705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e42df-81b7-4785-8461-1b2c1e4e5bd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:40.230174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e42df-81b7-4785-8461-1b2c1e4e5bd7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:40.250328 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 610/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 04:01:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:40.257707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022566e1-7ce1-45c1-a4f9-3481f8b675d7 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:40.378762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022566e1-7ce1-45c1-a4f9-3481f8b675d7 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:40.421976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67455f3f-7ac4-4c72-8f6c-719e208973ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:40.422664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67455f3f-7ac4-4c72-8f6c-719e208973ae None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:40.422972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67455f3f-7ac4-4c72-8f6c-719e208973ae None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:40.423249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67455f3f-7ac4-4c72-8f6c-719e208973ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:40.505501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:40.512885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67455f3f-7ac4-4c72-8f6c-719e208973ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:40.514481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67455f3f-7ac4-4c72-8f6c-719e208973ae None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:40.627717 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 631/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 04:01:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:01:40.635380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e42df-81b7-4785-8461-1b2c1e4e5bd7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:40.665429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:40.749031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e42df-81b7-4785-8461-1b2c1e4e5bd7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:40.786783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d199584-ae59-4f26-8823-a1b30538689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:40.787556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d199584-ae59-4f26-8823-a1b30538689b None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:40.787827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d199584-ae59-4f26-8823-a1b30538689b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:40.788099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d199584-ae59-4f26-8823-a1b30538689b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:40.800221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d199584-ae59-4f26-8823-a1b30538689b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:40.801695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d199584-ae59-4f26-8823-a1b30538689b None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-7d199584-ae59-4f26-8823-a1b30538689b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:40.819781 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:40.827162 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:40.828419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:40.828419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:40.828419 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:40.828419 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 611/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:40.829499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67455f3f-7ac4-4c72-8f6c-719e208973ae None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:40.969245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:40.975596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67455f3f-7ac4-4c72-8f6c-719e208973ae None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:41.014005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f893-36ee-4fab-9036-b98c8275a9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:41.017161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f893-36ee-4fab-9036-b98c8275a9b5 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:41.017161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f893-36ee-4fab-9036-b98c8275a9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:41.017161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f893-36ee-4fab-9036-b98c8275a9b5 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:41.017161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7f893-36ee-4fab-9036-b98c8275a9b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:41.017161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7f893-36ee-4fab-9036-b98c8275a9b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:41.017635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7f893-36ee-4fab-9036-b98c8275a9b5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:41.030407 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 632/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:41.037151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d199584-ae59-4f26-8823-a1b30538689b None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:41.156943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:41.181421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d199584-ae59-4f26-8823-a1b30538689b None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:41.221960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c3334-5701-49c1-97fc-e77f2bbe2ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:41.223153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c3334-5701-49c1-97fc-e77f2bbe2ff7 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:41.223431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c3334-5701-49c1-97fc-e77f2bbe2ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:41.223699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c3334-5701-49c1-97fc-e77f2bbe2ff7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:41.231605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c3334-5701-49c1-97fc-e77f2bbe2ff7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:41.233445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c3334-5701-49c1-97fc-e77f2bbe2ff7 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-2c9c3334-5701-49c1-97fc-e77f2bbe2ff7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:01:41.252707 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:41.253930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:41.254888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:01:41.254888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:01:41.254888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:01:41.254888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:01:41.254888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:01:41.254888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:01:41.254888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:41.254888 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:41.254888 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 612/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 04:01:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:41.263119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f893-36ee-4fab-9036-b98c8275a9b5 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:41.408185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f893-36ee-4fab-9036-b98c8275a9b5 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:41.450109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facfe4d-8547-4297-8a73-0ada3f6ba855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:41.450811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facfe4d-8547-4297-8a73-0ada3f6ba855 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:41.451133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facfe4d-8547-4297-8a73-0ada3f6ba855 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:41.451357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facfe4d-8547-4297-8a73-0ada3f6ba855 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:41.452256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facfe4d-8547-4297-8a73-0ada3f6ba855 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:41.452767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facfe4d-8547-4297-8a73-0ada3f6ba855 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:41.455052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facfe4d-8547-4297-8a73-0ada3f6ba855 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:41.468967 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 633/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 04:01:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:01:41.475442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c3334-5701-49c1-97fc-e77f2bbe2ff7 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:41.590296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c3334-5701-49c1-97fc-e77f2bbe2ff7 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:41.631745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cc9a1-dcbd-4450-a500-35f946804faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:41.632771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc9a1-dcbd-4450-a500-35f946804faa None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:41.633138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc9a1-dcbd-4450-a500-35f946804faa None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:41.633520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cc9a1-dcbd-4450-a500-35f946804faa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:41.634501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cc9a1-dcbd-4450-a500-35f946804faa None admin] RBAC: Adding query filter params (role.id=a212b3b588c542cca718d55760a48f1f, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=f8e4120107ff4ec1b1f3846a7f475ecb) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:41.634818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cc9a1-dcbd-4450-a500-35f946804faa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:41.636303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cc9a1-dcbd-4450-a500-35f946804faa None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:41.644910 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 613/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 04:01:41 2022] GET /identity/v3/role_assignments?user.id=f8e4120107ff4ec1b1f3846a7f475ecb&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a212b3b588c542cca718d55760a48f1f => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:43.688582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a0398-56a8-44e7-ab41-aa0da8752b62 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:43.689146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a0398-56a8-44e7-ab41-aa0da8752b62 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:43.689298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a0398-56a8-44e7-ab41-aa0da8752b62 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:43.691036 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 634/1247] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:01:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:01:43.696868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521682-7a01-4c79-bbb8-e367f4a51e52 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:43.697373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521682-7a01-4c79-bbb8-e367f4a51e52 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:43.697451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521682-7a01-4c79-bbb8-e367f4a51e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:43.704080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:43.719155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-22521682-7a01-4c79-bbb8-e367f4a51e52 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:01:43.720461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-22521682-7a01-4c79-bbb8-e367f4a51e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:01:43.805569 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 614/1248] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:01:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:01:44.086698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a0398-56a8-44e7-ab41-aa0da8752b62 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:44.109281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:44.215469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a0398-56a8-44e7-ab41-aa0da8752b62 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:44.258527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94692504-daba-4a3f-aad9-0d270463864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:44.259170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94692504-daba-4a3f-aad9-0d270463864f None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:44.259437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94692504-daba-4a3f-aad9-0d270463864f None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:44.259700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94692504-daba-4a3f-aad9-0d270463864f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:44.272654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94692504-daba-4a3f-aad9-0d270463864f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-94692504-daba-4a3f-aad9-0d270463864f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:01:44.277558 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:44.279018 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:44.280156 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 635/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 04:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:44.285969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22521682-7a01-4c79-bbb8-e367f4a51e52 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:44.414159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22521682-7a01-4c79-bbb8-e367f4a51e52 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:44.451787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:44.459630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f1d40-e8f3-4f16-8012-dbe93c5b2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:44.460369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f1d40-e8f3-4f16-8012-dbe93c5b2201 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:44.460677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f1d40-e8f3-4f16-8012-dbe93c5b2201 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:44.461056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f1d40-e8f3-4f16-8012-dbe93c5b2201 None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:44.461889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f1d40-e8f3-4f16-8012-dbe93c5b2201 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:44.462196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f1d40-e8f3-4f16-8012-dbe93c5b2201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:44.463592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f1d40-e8f3-4f16-8012-dbe93c5b2201 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:44.477970 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 615/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 04:01:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:44.481018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94692504-daba-4a3f-aad9-0d270463864f None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:44.576420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:44.606846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94692504-daba-4a3f-aad9-0d270463864f None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:44.657542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdfb61-4ed5-4da9-8a4c-e12966711239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:44.658028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfb61-4ed5-4da9-8a4c-e12966711239 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:44.658272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfb61-4ed5-4da9-8a4c-e12966711239 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:44.658567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdfb61-4ed5-4da9-8a4c-e12966711239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:44.672516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdfb61-4ed5-4da9-8a4c-e12966711239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:44.674172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdfb61-4ed5-4da9-8a4c-e12966711239 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-e0cdfb61-4ed5-4da9-8a4c-e12966711239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:44.692557 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:44.694444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:44.695690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:44.695690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:44.695690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:44.695690 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 636/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:01:44.700006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f1d40-e8f3-4f16-8012-dbe93c5b2201 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:44.827899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f1d40-e8f3-4f16-8012-dbe93c5b2201 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:44.873667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364da1a-e860-410d-a8b4-8c66c5272229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:44.874339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364da1a-e860-410d-a8b4-8c66c5272229 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:44.874620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364da1a-e860-410d-a8b4-8c66c5272229 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:44.874885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364da1a-e860-410d-a8b4-8c66c5272229 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:44.875530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364da1a-e860-410d-a8b4-8c66c5272229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:44.877138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364da1a-e860-410d-a8b4-8c66c5272229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:44.877401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364da1a-e860-410d-a8b4-8c66c5272229 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:44.890796 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 616/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:44.896678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdfb61-4ed5-4da9-8a4c-e12966711239 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:45.027061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdfb61-4ed5-4da9-8a4c-e12966711239 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:45.059969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:45.071691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2413e-62ba-4deb-980f-985130ea967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:45.072430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2413e-62ba-4deb-980f-985130ea967a None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:45.072792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2413e-62ba-4deb-980f-985130ea967a None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:45.073060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2413e-62ba-4deb-980f-985130ea967a None admin] PATH_INFO: `/v3/users/placement` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:45.082437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2413e-62ba-4deb-980f-985130ea967a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:45.084175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2413e-62ba-4deb-980f-985130ea967a None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-e2a2413e-62ba-4deb-980f-985130ea967a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:01:45.098984 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:45.100973 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:45.102269 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 637/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:45.107032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364da1a-e860-410d-a8b4-8c66c5272229 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:45.178537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:45.245472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364da1a-e860-410d-a8b4-8c66c5272229 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:45.294182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c19401-f049-4dda-b5d2-e0dd71a7bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:45.295187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19401-f049-4dda-b5d2-e0dd71a7bb73 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:45.295659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19401-f049-4dda-b5d2-e0dd71a7bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:45.296122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c19401-f049-4dda-b5d2-e0dd71a7bb73 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:45.297403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c19401-f049-4dda-b5d2-e0dd71a7bb73 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:45.297966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c19401-f049-4dda-b5d2-e0dd71a7bb73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:45.300672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c19401-f049-4dda-b5d2-e0dd71a7bb73 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:45.334235 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 617/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 04:01:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:45.335916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2413e-62ba-4deb-980f-985130ea967a None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:45.460279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2413e-62ba-4deb-980f-985130ea967a None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:45.505474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39dd37-b008-459d-99fa-5dcec7303db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:45.506438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39dd37-b008-459d-99fa-5dcec7303db7 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:45.506760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39dd37-b008-459d-99fa-5dcec7303db7 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:45.507072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39dd37-b008-459d-99fa-5dcec7303db7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:45.588390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:45.604032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39dd37-b008-459d-99fa-5dcec7303db7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:45.605536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39dd37-b008-459d-99fa-5dcec7303db7 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:45.729455 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 638/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 04:01:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 04:01:45.735962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c19401-f049-4dda-b5d2-e0dd71a7bb73 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:45.866566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c19401-f049-4dda-b5d2-e0dd71a7bb73 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:45.887284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:45.915223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dcbe6-d98d-4e45-af5f-732492782a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:45.915885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dcbe6-d98d-4e45-af5f-732492782a02 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:45.916145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dcbe6-d98d-4e45-af5f-732492782a02 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:45.916417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dcbe6-d98d-4e45-af5f-732492782a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:45.929633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dcbe6-d98d-4e45-af5f-732492782a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:45.931282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dcbe6-d98d-4e45-af5f-732492782a02 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-7d6dcbe6-d98d-4e45-af5f-732492782a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:45.946880 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:45.948088 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:45.949041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:45.949041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:45.949041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:45.949041 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 618/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:01:45.955482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39dd37-b008-459d-99fa-5dcec7303db7 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:46.055058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:46.073052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39dd37-b008-459d-99fa-5dcec7303db7 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:46.111160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b00f3-4491-4179-9688-c7ea9daeddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:46.111877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b00f3-4491-4179-9688-c7ea9daeddc0 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:46.112186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b00f3-4491-4179-9688-c7ea9daeddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:46.112618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b00f3-4491-4179-9688-c7ea9daeddc0 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:46.113478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b00f3-4491-4179-9688-c7ea9daeddc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:46.113755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b00f3-4491-4179-9688-c7ea9daeddc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:46.115307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b00f3-4491-4179-9688-c7ea9daeddc0 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:46.129997 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 639/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:46.135260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dcbe6-d98d-4e45-af5f-732492782a02 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:46.260865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dcbe6-d98d-4e45-af5f-732492782a02 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:46.303102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1372bb-27ec-44d2-88c3-fa71c4313a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:46.303756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1372bb-27ec-44d2-88c3-fa71c4313a94 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:46.304028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1372bb-27ec-44d2-88c3-fa71c4313a94 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:46.304296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1372bb-27ec-44d2-88c3-fa71c4313a94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:46.312265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1372bb-27ec-44d2-88c3-fa71c4313a94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:46.314887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1372bb-27ec-44d2-88c3-fa71c4313a94 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-0c1372bb-27ec-44d2-88c3-fa71c4313a94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:01:46.328017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:46.329057 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:46.330017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:01:46.330017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:01:46.330017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:01:46.330017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:01:46.330017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:01:46.330017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:01:46.330017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:46.330017 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:46.330017 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 619/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 04:01:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:01:46.335834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b00f3-4491-4179-9688-c7ea9daeddc0 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:46.456820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b00f3-4491-4179-9688-c7ea9daeddc0 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:46.493513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b3385-2fc2-46f5-a032-4066dc568407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:46.494218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b3385-2fc2-46f5-a032-4066dc568407 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:46.494549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b3385-2fc2-46f5-a032-4066dc568407 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:46.494818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b3385-2fc2-46f5-a032-4066dc568407 None admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:46.495540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b3385-2fc2-46f5-a032-4066dc568407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:46.496229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b3385-2fc2-46f5-a032-4066dc568407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:46.497750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b3385-2fc2-46f5-a032-4066dc568407 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:46.516445 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 640/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 04:01:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:46.517782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1372bb-27ec-44d2-88c3-fa71c4313a94 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:46.544550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:46.624858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1372bb-27ec-44d2-88c3-fa71c4313a94 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:46.666540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffecdb-a1e0-4716-b58d-c495b84682c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:46.667191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffecdb-a1e0-4716-b58d-c495b84682c3 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:46.667464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffecdb-a1e0-4716-b58d-c495b84682c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:46.667729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffecdb-a1e0-4716-b58d-c495b84682c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:46.668604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffecdb-a1e0-4716-b58d-c495b84682c3 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=f8e4120107ff4ec1b1f3846a7f475ecb) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:46.668802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffecdb-a1e0-4716-b58d-c495b84682c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:46.670337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffecdb-a1e0-4716-b58d-c495b84682c3 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:46.690167 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 620/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 04:01:46 2022] GET /identity/v3/role_assignments?user.id=f8e4120107ff4ec1b1f3846a7f475ecb&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:48.592206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec3d23-1e16-43f4-88dd-c7b70a18f765 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:48.592821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec3d23-1e16-43f4-88dd-c7b70a18f765 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:48.592821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec3d23-1e16-43f4-88dd-c7b70a18f765 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:48.594122 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 641/1261] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:01:48.599778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce878-9d49-4d91-b927-9becebe410e9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:48.600604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce878-9d49-4d91-b927-9becebe410e9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:48.600604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ce878-9d49-4d91-b927-9becebe410e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:48.626706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3e7ce878-9d49-4d91-b927-9becebe410e9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:01:48.628442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3e7ce878-9d49-4d91-b927-9becebe410e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:01:48.702292 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 621/1262] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:01:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:01:48.968384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec3d23-1e16-43f4-88dd-c7b70a18f765 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:48.980093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:49.085139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec3d23-1e16-43f4-88dd-c7b70a18f765 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:49.123583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68600a2a-02fa-4c50-bbe3-7cf81fb1be20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:49.124209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600a2a-02fa-4c50-bbe3-7cf81fb1be20 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:49.124495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600a2a-02fa-4c50-bbe3-7cf81fb1be20 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:49.124763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600a2a-02fa-4c50-bbe3-7cf81fb1be20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:49.135172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68600a2a-02fa-4c50-bbe3-7cf81fb1be20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-68600a2a-02fa-4c50-bbe3-7cf81fb1be20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:01:49.139988 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:49.141199 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:49.142184 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 642/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 04:01:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:49.148325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ce878-9d49-4d91-b927-9becebe410e9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:49.169647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:49.254811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ce878-9d49-4d91-b927-9becebe410e9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:49.297465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aad6e-aaa0-4816-80d6-55afe922366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:49.298294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aad6e-aaa0-4816-80d6-55afe922366b None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:49.298571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aad6e-aaa0-4816-80d6-55afe922366b None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:49.298937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aad6e-aaa0-4816-80d6-55afe922366b None admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:49.299902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aad6e-aaa0-4816-80d6-55afe922366b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:49.300320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aad6e-aaa0-4816-80d6-55afe922366b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:49.302257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aad6e-aaa0-4816-80d6-55afe922366b None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:49.315302 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 622/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 04:01:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:49.322308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68600a2a-02fa-4c50-bbe3-7cf81fb1be20 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:49.404434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:49.442390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68600a2a-02fa-4c50-bbe3-7cf81fb1be20 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:49.486527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7090e-10d4-489e-acf8-fc04ab6dac36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:49.487410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7090e-10d4-489e-acf8-fc04ab6dac36 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:49.487753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7090e-10d4-489e-acf8-fc04ab6dac36 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:49.488135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7090e-10d4-489e-acf8-fc04ab6dac36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:49.499492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7090e-10d4-489e-acf8-fc04ab6dac36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:49.500936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7090e-10d4-489e-acf8-fc04ab6dac36 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-17d7090e-10d4-489e-acf8-fc04ab6dac36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:49.515811 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:49.516996 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:49.517942 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:49.517942 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:49.517942 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:49.517942 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 643/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:01:49.523070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aad6e-aaa0-4816-80d6-55afe922366b None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:49.606136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:49.630407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aad6e-aaa0-4816-80d6-55afe922366b None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:49.667232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194ef9e-3363-4696-94f4-2114060ce653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:49.667846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ef9e-3363-4696-94f4-2114060ce653 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:49.668121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ef9e-3363-4696-94f4-2114060ce653 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:49.668390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194ef9e-3363-4696-94f4-2114060ce653 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:49.669033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194ef9e-3363-4696-94f4-2114060ce653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:49.669325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194ef9e-3363-4696-94f4-2114060ce653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:49.670779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194ef9e-3363-4696-94f4-2114060ce653 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:49.683050 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 623/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:49.689117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7090e-10d4-489e-acf8-fc04ab6dac36 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:49.793123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7090e-10d4-489e-acf8-fc04ab6dac36 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:49.812852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:49.834953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694bec6-d43a-482d-9e7e-8a2f656b977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:49.835585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694bec6-d43a-482d-9e7e-8a2f656b977e None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:49.835853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694bec6-d43a-482d-9e7e-8a2f656b977e None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:49.836114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694bec6-d43a-482d-9e7e-8a2f656b977e None admin] PATH_INFO: `/v3/users/placement` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:49.843650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694bec6-d43a-482d-9e7e-8a2f656b977e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:49.845088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694bec6-d43a-482d-9e7e-8a2f656b977e None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-c694bec6-d43a-482d-9e7e-8a2f656b977e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:01:49.856314 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:49.857487 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:49.858871 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 644/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:01:49.864136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194ef9e-3363-4696-94f4-2114060ce653 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:49.981133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194ef9e-3363-4696-94f4-2114060ce653 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:50.017827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead196b6-e8a3-4d56-84e4-aeeeb750fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:50.018558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead196b6-e8a3-4d56-84e4-aeeeb750fb59 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:50.018854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead196b6-e8a3-4d56-84e4-aeeeb750fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:50.019134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead196b6-e8a3-4d56-84e4-aeeeb750fb59 None admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:50.019947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead196b6-e8a3-4d56-84e4-aeeeb750fb59 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:50.020269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead196b6-e8a3-4d56-84e4-aeeeb750fb59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:50.022404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead196b6-e8a3-4d56-84e4-aeeeb750fb59 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:50.032665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:50.043233 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 624/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 04:01:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:01:50.049518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694bec6-d43a-482d-9e7e-8a2f656b977e None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:50.153895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694bec6-d43a-482d-9e7e-8a2f656b977e None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:50.188769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a85f34-f350-4ddc-9387-7c0c8bd1a751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:50.189388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a85f34-f350-4ddc-9387-7c0c8bd1a751 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:50.189652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a85f34-f350-4ddc-9387-7c0c8bd1a751 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:50.189917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a85f34-f350-4ddc-9387-7c0c8bd1a751 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:50.200741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a85f34-f350-4ddc-9387-7c0c8bd1a751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:50.202208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a85f34-f350-4ddc-9387-7c0c8bd1a751 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-14a85f34-f350-4ddc-9387-7c0c8bd1a751 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:50.216660 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:50.217735 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:50.218758 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:50.218758 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:50.218758 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:50.218758 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 645/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:50.224930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead196b6-e8a3-4d56-84e4-aeeeb750fb59 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:50.334334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead196b6-e8a3-4d56-84e4-aeeeb750fb59 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:50.371059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ff2bb-fd27-4dd6-b4db-e2f34fb4f999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:50.372016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ff2bb-fd27-4dd6-b4db-e2f34fb4f999 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:50.372289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ff2bb-fd27-4dd6-b4db-e2f34fb4f999 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:50.372554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ff2bb-fd27-4dd6-b4db-e2f34fb4f999 None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:50.373195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ff2bb-fd27-4dd6-b4db-e2f34fb4f999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:50.373497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ff2bb-fd27-4dd6-b4db-e2f34fb4f999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:50.374895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74ff2bb-fd27-4dd6-b4db-e2f34fb4f999 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:50.387522 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 625/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:50.396410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a85f34-f350-4ddc-9387-7c0c8bd1a751 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:50.436842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:50.516932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a85f34-f350-4ddc-9387-7c0c8bd1a751 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:50.558435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6ba8b-bded-444e-adc1-e55b62f59982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:50.559075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6ba8b-bded-444e-adc1-e55b62f59982 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:50.559342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6ba8b-bded-444e-adc1-e55b62f59982 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:50.559601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6ba8b-bded-444e-adc1-e55b62f59982 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:50.566978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6ba8b-bded-444e-adc1-e55b62f59982 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:50.568575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d6ba8b-bded-444e-adc1-e55b62f59982 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-58d6ba8b-bded-444e-adc1-e55b62f59982 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:01:50.580141 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:50.586116 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:50.587733 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:01:50.587733 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:01:50.587733 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:01:50.587733 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:01:50.587733 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:01:50.587733 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:01:50.587733 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:50.587733 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:50.587733 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 646/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 04:01:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:50.588369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ff2bb-fd27-4dd6-b4db-e2f34fb4f999 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:50.660208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:50.706132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74ff2bb-fd27-4dd6-b4db-e2f34fb4f999 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:50.742311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a717dd-041f-420f-a650-8f42b48a9356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:50.742920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a717dd-041f-420f-a650-8f42b48a9356 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:50.743201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a717dd-041f-420f-a650-8f42b48a9356 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:50.743490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a717dd-041f-420f-a650-8f42b48a9356 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:50.744368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a717dd-041f-420f-a650-8f42b48a9356 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:50.744510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a717dd-041f-420f-a650-8f42b48a9356 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:50.745920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a717dd-041f-420f-a650-8f42b48a9356 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:50.759372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 626/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 04:01:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:50.765655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6ba8b-bded-444e-adc1-e55b62f59982 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:50.864316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:50.876805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6ba8b-bded-444e-adc1-e55b62f59982 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:50.913084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533b8eb-25e6-4174-aa1d-38b0169540ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:50.913747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533b8eb-25e6-4174-aa1d-38b0169540ca None admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:50.914055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533b8eb-25e6-4174-aa1d-38b0169540ca None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:50.914326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533b8eb-25e6-4174-aa1d-38b0169540ca None admin] PATH_INFO: `/v3/projects/52a1a3876cb4499182e40a4018f69912/users/f8e4120107ff4ec1b1f3846a7f475ecb/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:50.916325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533b8eb-25e6-4174-aa1d-38b0169540ca None admin] RBAC: Authorizing `identity:create_grant(project_id=52a1a3876cb4499182e40a4018f69912, user_id=f8e4120107ff4ec1b1f3846a7f475ecb, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:50.917777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533b8eb-25e6-4174-aa1d-38b0169540ca None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:50.933932 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 647/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 04:01:50 2022] PUT /identity/v3/projects/52a1a3876cb4499182e40a4018f69912/users/f8e4120107ff4ec1b1f3846a7f475ecb/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:01:52.831182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70803efc-5ee2-498f-a44d-003870cb65cd None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:52.831768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70803efc-5ee2-498f-a44d-003870cb65cd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:52.831768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70803efc-5ee2-498f-a44d-003870cb65cd None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:52.833172 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 627/1274] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:01:52.838782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8bac-0866-4fbb-b536-e3ce553f0f8b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:52.839228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8bac-0866-4fbb-b536-e3ce553f0f8b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:52.839318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf8bac-0866-4fbb-b536-e3ce553f0f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:52.857789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-26bf8bac-0866-4fbb-b536-e3ce553f0f8b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:01:52.858997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-26bf8bac-0866-4fbb-b536-e3ce553f0f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:01:52.931651 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 648/1275] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:01:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:01:53.205151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70803efc-5ee2-498f-a44d-003870cb65cd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:53.314374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70803efc-5ee2-498f-a44d-003870cb65cd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:53.335083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:53.353330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e75d-e06f-4998-ab42-ec6d7193dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:53.353993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e75d-e06f-4998-ab42-ec6d7193dc36 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:53.354266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e75d-e06f-4998-ab42-ec6d7193dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:53.354532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883e75d-e06f-4998-ab42-ec6d7193dc36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:53.366015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883e75d-e06f-4998-ab42-ec6d7193dc36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6883e75d-e06f-4998-ab42-ec6d7193dc36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 04:01:53.370851 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:53.372333 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:53.374625 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 628/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 04:01:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:53.378691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8bac-0866-4fbb-b536-e3ce553f0f8b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:53.463560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:53.483706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf8bac-0866-4fbb-b536-e3ce553f0f8b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:53.524960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53996126-c082-4081-9917-762be43fa27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:53.525587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53996126-c082-4081-9917-762be43fa27c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:53.525863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53996126-c082-4081-9917-762be43fa27c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:53.526156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53996126-c082-4081-9917-762be43fa27c None admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:53.526872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53996126-c082-4081-9917-762be43fa27c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:53.527155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53996126-c082-4081-9917-762be43fa27c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:53.528534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53996126-c082-4081-9917-762be43fa27c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:53.541179 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 649/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 04:01:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:53.548286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e75d-e06f-4998-ab42-ec6d7193dc36 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:53.657059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883e75d-e06f-4998-ab42-ec6d7193dc36 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:53.692132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a8047-5a5f-409d-a187-11c5af4f58ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:53.692797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8047-5a5f-409d-a187-11c5af4f58ec None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:53.693074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8047-5a5f-409d-a187-11c5af4f58ec None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:53.693343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8047-5a5f-409d-a187-11c5af4f58ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:53.703783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a8047-5a5f-409d-a187-11c5af4f58ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:53.705235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a8047-5a5f-409d-a187-11c5af4f58ec None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3b4a8047-5a5f-409d-a187-11c5af4f58ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:53.719999 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:53.721101 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:53.722114 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:53.722114 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:53.722114 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:53.722114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 629/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:53.727338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53996126-c082-4081-9917-762be43fa27c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:53.838699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53996126-c082-4081-9917-762be43fa27c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:53.877414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b9ca0-59df-419e-8a7a-ad7b6eb51393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:53.878091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9ca0-59df-419e-8a7a-ad7b6eb51393 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:53.878318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9ca0-59df-419e-8a7a-ad7b6eb51393 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:53.878583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9ca0-59df-419e-8a7a-ad7b6eb51393 None admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:53.879221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b9ca0-59df-419e-8a7a-ad7b6eb51393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:53.879522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b9ca0-59df-419e-8a7a-ad7b6eb51393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:53.881122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b9ca0-59df-419e-8a7a-ad7b6eb51393 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:53.892883 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 650/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:53.899807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a8047-5a5f-409d-a187-11c5af4f58ec None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:53.944368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:54.017144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a8047-5a5f-409d-a187-11c5af4f58ec None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:54.055522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f39ee-4742-46c9-b168-f51bf3ebbac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:54.056157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f39ee-4742-46c9-b168-f51bf3ebbac6 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:54.056431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f39ee-4742-46c9-b168-f51bf3ebbac6 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:54.056694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f39ee-4742-46c9-b168-f51bf3ebbac6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:54.064358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f39ee-4742-46c9-b168-f51bf3ebbac6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:54.065822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f39ee-4742-46c9-b168-f51bf3ebbac6 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-225f39ee-4742-46c9-b168-f51bf3ebbac6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:01:54.077523 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:54.081980 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:54.083252 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 630/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:54.084968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b9ca0-59df-419e-8a7a-ad7b6eb51393 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:54.089179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:54.190298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b9ca0-59df-419e-8a7a-ad7b6eb51393 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:54.225331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5f9a-cce6-4f10-9feb-93690fb70a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:54.225920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5f9a-cce6-4f10-9feb-93690fb70a91 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:54.226220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5f9a-cce6-4f10-9feb-93690fb70a91 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:54.226481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f5f9a-cce6-4f10-9feb-93690fb70a91 None admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:54.227202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f5f9a-cce6-4f10-9feb-93690fb70a91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:54.227499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f5f9a-cce6-4f10-9feb-93690fb70a91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:54.228928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f5f9a-cce6-4f10-9feb-93690fb70a91 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:54.245917 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 651/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 04:01:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:54.252418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f39ee-4742-46c9-b168-f51bf3ebbac6 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:54.350974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:54.363619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f39ee-4742-46c9-b168-f51bf3ebbac6 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:54.400447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f059c7-952d-49ba-bd6e-02c2fa57b9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:54.401037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f059c7-952d-49ba-bd6e-02c2fa57b9e8 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:54.401309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f059c7-952d-49ba-bd6e-02c2fa57b9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:54.401573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f059c7-952d-49ba-bd6e-02c2fa57b9e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:54.473322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f059c7-952d-49ba-bd6e-02c2fa57b9e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:54.474821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f059c7-952d-49ba-bd6e-02c2fa57b9e8 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:54.563215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:54.577089 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 631/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 04:01:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 04:01:54.585664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5f9a-cce6-4f10-9feb-93690fb70a91 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:54.655709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:54.697114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f5f9a-cce6-4f10-9feb-93690fb70a91 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:54.732974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc1372-2dae-4c81-bcf6-8601b34cd4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:54.733598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc1372-2dae-4c81-bcf6-8601b34cd4e8 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:54.733916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc1372-2dae-4c81-bcf6-8601b34cd4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:54.734174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc1372-2dae-4c81-bcf6-8601b34cd4e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:54.744946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc1372-2dae-4c81-bcf6-8601b34cd4e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:54.746429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc1372-2dae-4c81-bcf6-8601b34cd4e8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-d2bc1372-2dae-4c81-bcf6-8601b34cd4e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:01:54.761864 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:54.762940 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 04:01:54.764047 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:01:54.764047 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 04:01:54.764047 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:54.766064 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 652/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:01:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:54.769438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f059c7-952d-49ba-bd6e-02c2fa57b9e8 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:54.888984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f059c7-952d-49ba-bd6e-02c2fa57b9e8 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:54.927907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c902f-b23f-4d36-ac2d-7111764fd81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:54.928523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c902f-b23f-4d36-ac2d-7111764fd81f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:54.928698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c902f-b23f-4d36-ac2d-7111764fd81f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:54.928963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c902f-b23f-4d36-ac2d-7111764fd81f None admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:54.929600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c902f-b23f-4d36-ac2d-7111764fd81f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:54.929915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c902f-b23f-4d36-ac2d-7111764fd81f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:54.931300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c902f-b23f-4d36-ac2d-7111764fd81f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:54.942765 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 632/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 04:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:54.951107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc1372-2dae-4c81-bcf6-8601b34cd4e8 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:55.060920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc1372-2dae-4c81-bcf6-8601b34cd4e8 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:55.074694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:55.095218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5166d50-845d-4b7a-a733-6b0598e68b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:55.095845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5166d50-845d-4b7a-a733-6b0598e68b8c None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:55.096121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5166d50-845d-4b7a-a733-6b0598e68b8c None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:55.096375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5166d50-845d-4b7a-a733-6b0598e68b8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:55.103025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5166d50-845d-4b7a-a733-6b0598e68b8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:55.104471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5166d50-845d-4b7a-a733-6b0598e68b8c None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-c5166d50-845d-4b7a-a733-6b0598e68b8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 04:01:55.115564 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:55.116621 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:55.118036 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 04:01:55.118036 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 04:01:55.118036 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:01:55.118036 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:01:55.118036 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:01:55.118036 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:01:55.118036 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 04:01:55.118036 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:01:55.118036 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 653/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 04:01:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 04:01:55.126689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c902f-b23f-4d36-ac2d-7111764fd81f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:55.185107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:55.251632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c902f-b23f-4d36-ac2d-7111764fd81f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:55.302330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85cae0-e933-4136-9e7e-1bca309b3c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:55.303004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85cae0-e933-4136-9e7e-1bca309b3c78 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:55.303285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85cae0-e933-4136-9e7e-1bca309b3c78 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:55.303560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85cae0-e933-4136-9e7e-1bca309b3c78 None admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:55.304253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85cae0-e933-4136-9e7e-1bca309b3c78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:55.304559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85cae0-e933-4136-9e7e-1bca309b3c78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:55.306049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85cae0-e933-4136-9e7e-1bca309b3c78 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:55.319325 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 633/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 04:01:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:55.325919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5166d50-845d-4b7a-a733-6b0598e68b8c None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:55.431873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5166d50-845d-4b7a-a733-6b0598e68b8c None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:55.466674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f601f-0bf6-438b-adab-ecc4c81462b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:55.467204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f601f-0bf6-438b-adab-ecc4c81462b5 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:55.467478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f601f-0bf6-438b-adab-ecc4c81462b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:55.467740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f601f-0bf6-438b-adab-ecc4c81462b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:55.468529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f601f-0bf6-438b-adab-ecc4c81462b5 None admin] RBAC: Adding query filter params (role.id=a56982ccacee4cd0b5dba95be3067f04, scope.project.id=52a1a3876cb4499182e40a4018f69912, user.id=f8e4120107ff4ec1b1f3846a7f475ecb) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:55.468842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f601f-0bf6-438b-adab-ecc4c81462b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:55.470315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f601f-0bf6-438b-adab-ecc4c81462b5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:55.476292 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 654/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 04:01:55 2022] GET /identity/v3/role_assignments?user.id=f8e4120107ff4ec1b1f3846a7f475ecb&scope.project.id=52a1a3876cb4499182e40a4018f69912&role.id=a56982ccacee4cd0b5dba95be3067f04 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:57.513742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7576b07-e920-4bc4-9d2d-754e5f498824 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:57.514428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7576b07-e920-4bc4-9d2d-754e5f498824 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:57.514547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7576b07-e920-4bc4-9d2d-754e5f498824 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:57.515980 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 634/1288] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:01:57.522475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7ed7-a308-4a7b-bbe9-31097eccfd9b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:57.523236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7ed7-a308-4a7b-bbe9-31097eccfd9b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:57.523359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7ed7-a308-4a7b-bbe9-31097eccfd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:57.551764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e41d7ed7-a308-4a7b-bbe9-31097eccfd9b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:01:57.552949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e41d7ed7-a308-4a7b-bbe9-31097eccfd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:01:57.586725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:57.625298 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 655/1289] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:01:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:01:57.888301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7576b07-e920-4bc4-9d2d-754e5f498824 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:57.998305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7576b07-e920-4bc4-9d2d-754e5f498824 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:58.010206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:58.046540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9b760-6039-4b5e-8570-d56accd07e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:58.047483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9b760-6039-4b5e-8570-d56accd07e3f None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:58.047939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9b760-6039-4b5e-8570-d56accd07e3f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:58.048298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef9b760-6039-4b5e-8570-d56accd07e3f None admin] PATH_INFO: `/v3/services/placement` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:58.049113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9b760-6039-4b5e-8570-d56accd07e3f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:58.051288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef9b760-6039-4b5e-8570-d56accd07e3f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-cef9b760-6039-4b5e-8570-d56accd07e3f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:01:58.064105 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:01:58.065964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:01:58.066885 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 635/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 04:01:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:01:58.072593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d7ed7-a308-4a7b-bbe9-31097eccfd9b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:58.205849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d7ed7-a308-4a7b-bbe9-31097eccfd9b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:58.241794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2497e-ec4c-4224-b91c-96778a126cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:58.242423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2497e-ec4c-4224-b91c-96778a126cd5 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:58.242698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2497e-ec4c-4224-b91c-96778a126cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:58.242964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2497e-ec4c-4224-b91c-96778a126cd5 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:58.243586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2497e-ec4c-4224-b91c-96778a126cd5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:58.243883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2497e-ec4c-4224-b91c-96778a126cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:58.245596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2497e-ec4c-4224-b91c-96778a126cd5 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:58.250546 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 656/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Aug 30 04:01:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:01:58.256916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9b760-6039-4b5e-8570-d56accd07e3f None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:01:58.369282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef9b760-6039-4b5e-8570-d56accd07e3f None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:01:58.408006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879440d-b54b-4e0a-b8e9-40fd9b711422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:01:58.408606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879440d-b54b-4e0a-b8e9-40fd9b711422 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:01:58.408880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879440d-b54b-4e0a-b8e9-40fd9b711422 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:01:58.409152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879440d-b54b-4e0a-b8e9-40fd9b711422 None admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:01:58.409775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879440d-b54b-4e0a-b8e9-40fd9b711422 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:01:58.410101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879440d-b54b-4e0a-b8e9-40fd9b711422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:01:58.411487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879440d-b54b-4e0a-b8e9-40fd9b711422 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:01:58.416417 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 636/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Aug 30 04:01:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:00.303235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f323a2-55f0-499e-8ae7-c1720677cf08 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:00.304035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f323a2-55f0-499e-8ae7-c1720677cf08 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:00.304035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f323a2-55f0-499e-8ae7-c1720677cf08 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:00.306025 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 657/1293] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:02:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:00.311339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729f91-364d-4c86-897e-21b9dd0177fc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:00.311769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729f91-364d-4c86-897e-21b9dd0177fc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:00.311861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3729f91-364d-4c86-897e-21b9dd0177fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:00.331907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f3729f91-364d-4c86-897e-21b9dd0177fc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:00.333092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f3729f91-364d-4c86-897e-21b9dd0177fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:00.367584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:00.416681 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 637/1294] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:02:00.687435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f323a2-55f0-499e-8ae7-c1720677cf08 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:00.726284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:00.806657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f323a2-55f0-499e-8ae7-c1720677cf08 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:00.847505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a1383-c066-49e9-9c4b-10b8b2f22aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:00.848092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1383-c066-49e9-9c4b-10b8b2f22aa8 None admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:00.848363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1383-c066-49e9-9c4b-10b8b2f22aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:00.848626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a1383-c066-49e9-9c4b-10b8b2f22aa8 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:00.849277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a1383-c066-49e9-9c4b-10b8b2f22aa8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:00.850682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a1383-c066-49e9-9c4b-10b8b2f22aa8 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:00.869507 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 658/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 04:02:00 2022] POST /identity/v3/services => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:02:02.798548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4494a-68a1-4c99-a952-ba6f343ad9ee None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:02.799288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4494a-68a1-4c99-a952-ba6f343ad9ee None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:02.799288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4494a-68a1-4c99-a952-ba6f343ad9ee None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:02.801330 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 638/1296] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:02:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:02.806679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b1e7-845f-491a-8b9a-88766e11e04e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:02.807094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b1e7-845f-491a-8b9a-88766e11e04e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:02.807183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b1e7-845f-491a-8b9a-88766e11e04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:02.827092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-19e7b1e7-845f-491a-8b9a-88766e11e04e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:02.828265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-19e7b1e7-845f-491a-8b9a-88766e11e04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:02.921494 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 659/1297] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:02:03.196126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4494a-68a1-4c99-a952-ba6f343ad9ee None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:03.321240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4494a-68a1-4c99-a952-ba6f343ad9ee None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:03.357284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81ab1-fa4d-44ba-8d93-df568d108868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:03.357916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81ab1-fa4d-44ba-8d93-df568d108868 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:03.358199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81ab1-fa4d-44ba-8d93-df568d108868 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:03.358468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc81ab1-fa4d-44ba-8d93-df568d108868 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:03.359056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc81ab1-fa4d-44ba-8d93-df568d108868 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:03.360427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc81ab1-fa4d-44ba-8d93-df568d108868 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-0bc81ab1-fa4d-44ba-8d93-df568d108868 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:03.370174 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:03.371334 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:02:03.372572 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 639/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 04:02:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:03.378253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b1e7-845f-491a-8b9a-88766e11e04e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:03.402751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:03.487317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b1e7-845f-491a-8b9a-88766e11e04e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:03.523363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a5665-2616-4f9a-883a-ba50f0f81b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:03.523976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a5665-2616-4f9a-883a-ba50f0f81b95 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:03.524245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a5665-2616-4f9a-883a-ba50f0f81b95 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:03.524508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a5665-2616-4f9a-883a-ba50f0f81b95 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:03.525139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a5665-2616-4f9a-883a-ba50f0f81b95 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:03.525434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a5665-2616-4f9a-883a-ba50f0f81b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:03.526827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a5665-2616-4f9a-883a-ba50f0f81b95 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:03.532131 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 660/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Aug 30 04:02:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:03.538655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81ab1-fa4d-44ba-8d93-df568d108868 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:03.571261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:03.648356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc81ab1-fa4d-44ba-8d93-df568d108868 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:03.682329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d4ac6-62b4-4060-92e4-8bab758c4f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:03.682929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d4ac6-62b4-4060-92e4-8bab758c4f48 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:03.683200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d4ac6-62b4-4060-92e4-8bab758c4f48 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:03.683467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d4ac6-62b4-4060-92e4-8bab758c4f48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:03.684204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d4ac6-62b4-4060-92e4-8bab758c4f48 None admin] RBAC: Adding query filter params (interface=public, service_id=4eef0645cd954ef0b855baabd2af287e, region_id=RegionOne) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:03.684507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d4ac6-62b4-4060-92e4-8bab758c4f48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:03.685905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d4ac6-62b4-4060-92e4-8bab758c4f48 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:03.691361 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 640/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 04:02:03 2022] GET /identity/v3/endpoints?service_id=4eef0645cd954ef0b855baabd2af287e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:03.700160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a5665-2616-4f9a-883a-ba50f0f81b95 None admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:03.785373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:03.803590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a5665-2616-4f9a-883a-ba50f0f81b95 None admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:03.837163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acfd5d-fc2c-4feb-bbf2-6bd6dac868ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:03.837787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acfd5d-fc2c-4feb-bbf2-6bd6dac868ac None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:03.838051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acfd5d-fc2c-4feb-bbf2-6bd6dac868ac None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:03.838318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acfd5d-fc2c-4feb-bbf2-6bd6dac868ac None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:03.838920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acfd5d-fc2c-4feb-bbf2-6bd6dac868ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:03.840328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52acfd5d-fc2c-4feb-bbf2-6bd6dac868ac None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:03.847632 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 661/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 04:02:03 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:02:05.723666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a242-a38b-45ff-80e5-65983c40054c None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:05.724245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a242-a38b-45ff-80e5-65983c40054c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:05.724245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a242-a38b-45ff-80e5-65983c40054c None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:05.725529 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 641/1302] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:02:05.731794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e300d18-1e95-4291-ac48-c062a049be0c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:05.732339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e300d18-1e95-4291-ac48-c062a049be0c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:05.732485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e300d18-1e95-4291-ac48-c062a049be0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:05.761023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3e300d18-1e95-4291-ac48-c062a049be0c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:02:05.762271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3e300d18-1e95-4291-ac48-c062a049be0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:02:05.836972 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 662/1303] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:02:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 04:02:06.105151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860a242-a38b-45ff-80e5-65983c40054c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:06.205654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:06.215221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860a242-a38b-45ff-80e5-65983c40054c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:06.253275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af604961-7a1d-4a20-b738-288208b87a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:06.253906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604961-7a1d-4a20-b738-288208b87a56 None admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:06.254197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604961-7a1d-4a20-b738-288208b87a56 None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:06.254463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604961-7a1d-4a20-b738-288208b87a56 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:06.255043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af604961-7a1d-4a20-b738-288208b87a56 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:06.256422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af604961-7a1d-4a20-b738-288208b87a56 None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-af604961-7a1d-4a20-b738-288208b87a56 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:02:06.265393 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:02:06.266571 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:02:06.267605 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 642/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 04:02:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:02:06.273348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e300d18-1e95-4291-ac48-c062a049be0c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:06.356988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:06.388129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e300d18-1e95-4291-ac48-c062a049be0c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:06.423836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6456b-e5a0-4871-afc9-09bd181d4f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:06.424441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6456b-e5a0-4871-afc9-09bd181d4f93 None admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:06.424715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6456b-e5a0-4871-afc9-09bd181d4f93 None admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:06.424982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6456b-e5a0-4871-afc9-09bd181d4f93 None admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:06.425606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6456b-e5a0-4871-afc9-09bd181d4f93 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:02:06.425913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6456b-e5a0-4871-afc9-09bd181d4f93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:06.427291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6456b-e5a0-4871-afc9-09bd181d4f93 None admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:06.432498 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 663/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Aug 30 04:02:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:02:06.438564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af604961-7a1d-4a20-b738-288208b87a56 None admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:02:06.554424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af604961-7a1d-4a20-b738-288208b87a56 None admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:02:06.601258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46df7b-2557-4f36-9fea-c3ad6a79219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:02:06.602192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46df7b-2557-4f36-9fea-c3ad6a79219f None admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:02:06.602588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46df7b-2557-4f36-9fea-c3ad6a79219f None admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:02:06.603116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46df7b-2557-4f36-9fea-c3ad6a79219f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:02:06.603947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46df7b-2557-4f36-9fea-c3ad6a79219f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:02:06.605334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46df7b-2557-4f36-9fea-c3ad6a79219f None admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:02:06.629137 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 643/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:02:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:02:16.429380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=30 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:02:16.624519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:12.715080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36bc0-efd3-4fee-a2ad-0fc286079424 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.716129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36bc0-efd3-4fee-a2ad-0fc286079424 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.716614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36bc0-efd3-4fee-a2ad-0fc286079424 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.718405 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 664/1307] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:03:12.725212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aa8cc-4cbf-4e48-b981-0ef17be6128f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:12.725726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aa8cc-4cbf-4e48-b981-0ef17be6128f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:12.726194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532aa8cc-4cbf-4e48-b981-0ef17be6128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:12.913067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-532aa8cc-4cbf-4e48-b981-0ef17be6128f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:12.914260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-532aa8cc-4cbf-4e48-b981-0ef17be6128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:13.115331 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 644/1308] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:13.412898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70477-dafc-47a7-a654-11b8332ce026 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:13.413181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70477-dafc-47a7-a654-11b8332ce026 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:13.413518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de70477-dafc-47a7-a654-11b8332ce026 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:13.415061 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 665/1309] 10.222.0.43 () {54 vars in 965 bytes} [Tue Aug 30 04:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:13.428537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7238c02-424d-44d2-8328-34a819eea2c4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:13.429133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7238c02-424d-44d2-8328-34a819eea2c4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:13.429476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7238c02-424d-44d2-8328-34a819eea2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:13.630761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f7238c02-424d-44d2-8328-34a819eea2c4 None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:13.632288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f7238c02-424d-44d2-8328-34a819eea2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:13.666430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:13.754639 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 645/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Aug 30 04:03:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:13.763585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70477-dafc-47a7-a654-11b8332ce026 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:13.766297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2de70477-dafc-47a7-a654-11b8332ce026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:13.924745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de70477-dafc-47a7-a654-11b8332ce026 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:14.009828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59848dd-877f-49b3-a3ba-71967c4da779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:14.010675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59848dd-877f-49b3-a3ba-71967c4da779 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:14.010959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59848dd-877f-49b3-a3ba-71967c4da779 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:14.011235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59848dd-877f-49b3-a3ba-71967c4da779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:14.013005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e59848dd-877f-49b3-a3ba-71967c4da779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:14.084062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:14.154192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59848dd-877f-49b3-a3ba-71967c4da779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:14.155826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59848dd-877f-49b3-a3ba-71967c4da779 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:14.176881 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 666/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:03:16.428814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d4b9-f850-4109-bf1b-e470909d16cf None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.429468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d4b9-f850-4109-bf1b-e470909d16cf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.429468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d4b9-f850-4109-bf1b-e470909d16cf None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.430819 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 646/1312] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:16.438300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3cee1-ab92-4067-b4e6-35a5821d7841 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:16.439054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3cee1-ab92-4067-b4e6-35a5821d7841 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:16.439054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3cee1-ab92-4067-b4e6-35a5821d7841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:16.534661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-62e3cee1-ab92-4067-b4e6-35a5821d7841 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:16.535949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-62e3cee1-ab92-4067-b4e6-35a5821d7841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:16.645320 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 667/1313] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:16.924502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d4b9-f850-4109-bf1b-e470909d16cf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:16.926785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4664d4b9-f850-4109-bf1b-e470909d16cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:17.042050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d4b9-f850-4109-bf1b-e470909d16cf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:17.119455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:17.122698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25e980-b1da-4c6f-976c-44e01f47b8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:17.123688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e980-b1da-4c6f-976c-44e01f47b8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:17.124204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e980-b1da-4c6f-976c-44e01f47b8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:17.124557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25e980-b1da-4c6f-976c-44e01f47b8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:17.127213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8e25e980-b1da-4c6f-976c-44e01f47b8e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:17.280621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25e980-b1da-4c6f-976c-44e01f47b8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:17.282111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25e980-b1da-4c6f-976c-44e01f47b8e2 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:17.302225 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 647/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:19.583001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496f0bf-afc1-4ab2-aed3-eb0467b18dad None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.583650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496f0bf-afc1-4ab2-aed3-eb0467b18dad None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.583650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496f0bf-afc1-4ab2-aed3-eb0467b18dad None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.584906 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 668/1315] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:19.592930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7317e5-ef22-49c5-be57-5bd7a8d4168b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:19.592930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7317e5-ef22-49c5-be57-5bd7a8d4168b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:19.592930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7317e5-ef22-49c5-be57-5bd7a8d4168b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:19.669968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4e7317e5-ef22-49c5-be57-5bd7a8d4168b None None] MFA Rules not processed for user `cfee50d53ea3488497dcd29cd28b652c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:19.671207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4e7317e5-ef22-49c5-be57-5bd7a8d4168b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:19.725452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:19.775382 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 648/1316] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:20.061660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496f0bf-afc1-4ab2-aed3-eb0467b18dad None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:20.064037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8496f0bf-afc1-4ab2-aed3-eb0467b18dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:20.075699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:20.182268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496f0bf-afc1-4ab2-aed3-eb0467b18dad None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:20.267514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d19185-ebc8-46fa-9849-4cf8cc62bd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:20.268131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d19185-ebc8-46fa-9849-4cf8cc62bd46 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:20.268366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d19185-ebc8-46fa-9849-4cf8cc62bd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:20.268663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d19185-ebc8-46fa-9849-4cf8cc62bd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:20.270313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b3d19185-ebc8-46fa-9849-4cf8cc62bd46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:20.335089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:20.384887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d19185-ebc8-46fa-9849-4cf8cc62bd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:20.387807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d19185-ebc8-46fa-9849-4cf8cc62bd46 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:20.410300 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 669/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:22.929770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be175095-5e77-4598-86ab-a59a57dff683 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:22.930660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be175095-5e77-4598-86ab-a59a57dff683 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:22.930660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be175095-5e77-4598-86ab-a59a57dff683 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:22.932852 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 649/1318] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:22.938862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06293525-62a1-454b-b4ba-5a17338bb63b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:22.939312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06293525-62a1-454b-b4ba-5a17338bb63b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:22.939413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06293525-62a1-454b-b4ba-5a17338bb63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.010175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-06293525-62a1-454b-b4ba-5a17338bb63b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:23.011834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-06293525-62a1-454b-b4ba-5a17338bb63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:23.120760 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 670/1319] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:23.414738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be175095-5e77-4598-86ab-a59a57dff683 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:23.416518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-be175095-5e77-4598-86ab-a59a57dff683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:23.541804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be175095-5e77-4598-86ab-a59a57dff683 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:23.626423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090ce11-8b65-4333-b9ba-45ae6ac84035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:23.627034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090ce11-8b65-4333-b9ba-45ae6ac84035 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:23.627310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090ce11-8b65-4333-b9ba-45ae6ac84035 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:23.627577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090ce11-8b65-4333-b9ba-45ae6ac84035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:23.629216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4090ce11-8b65-4333-b9ba-45ae6ac84035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:23.638550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:23.749389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090ce11-8b65-4333-b9ba-45ae6ac84035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:23.750801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090ce11-8b65-4333-b9ba-45ae6ac84035 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:23.769396 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 650/1320] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:26.437824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a495-1eb2-437b-83c3-92e27fe3a809 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.438416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a495-1eb2-437b-83c3-92e27fe3a809 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.438416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0a495-1eb2-437b-83c3-92e27fe3a809 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.439743 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 671/1321] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:26.446826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dc901-51f2-4342-9a1e-a04f0acabcd6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:26.447303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dc901-51f2-4342-9a1e-a04f0acabcd6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:26.447388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dc901-51f2-4342-9a1e-a04f0acabcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:26.528372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ab7dc901-51f2-4342-9a1e-a04f0acabcd6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:26.529593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ab7dc901-51f2-4342-9a1e-a04f0acabcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:26.589560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:26.629075 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 651/1322] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:26.912160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0a495-1eb2-437b-83c3-92e27fe3a809 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:26.913745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-adc0a495-1eb2-437b-83c3-92e27fe3a809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:26.936425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:27.031708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0a495-1eb2-437b-83c3-92e27fe3a809 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:27.115012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14977ed6-8bef-4c82-8ee1-585cd3a8bd9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:27.115652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14977ed6-8bef-4c82-8ee1-585cd3a8bd9e service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:27.115927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14977ed6-8bef-4c82-8ee1-585cd3a8bd9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:27.116195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14977ed6-8bef-4c82-8ee1-585cd3a8bd9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:27.118062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-14977ed6-8bef-4c82-8ee1-585cd3a8bd9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:27.216276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:27.257364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14977ed6-8bef-4c82-8ee1-585cd3a8bd9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:27.258942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14977ed6-8bef-4c82-8ee1-585cd3a8bd9e service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:27.278699 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 672/1323] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:29.255994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97335a-0fe7-44d4-9759-59054def086f None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:29.256544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97335a-0fe7-44d4-9759-59054def086f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:29.256544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97335a-0fe7-44d4-9759-59054def086f None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:29.257827 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 652/1324] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:29.263828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5c1a6-e96b-4dd3-8c10-af0c659dfa13 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:29.264341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5c1a6-e96b-4dd3-8c10-af0c659dfa13 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:29.264341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5c1a6-e96b-4dd3-8c10-af0c659dfa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:29.338051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-33c5c1a6-e96b-4dd3-8c10-af0c659dfa13 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:29.339274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-33c5c1a6-e96b-4dd3-8c10-af0c659dfa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:29.442281 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 673/1325] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:29.723766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97335a-0fe7-44d4-9759-59054def086f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:29.725349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2d97335a-0fe7-44d4-9759-59054def086f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:29.858746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97335a-0fe7-44d4-9759-59054def086f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:29.943981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba08788-6b1d-4708-a7e0-686d3f037a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:29.944587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba08788-6b1d-4708-a7e0-686d3f037a7d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:29.945168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba08788-6b1d-4708-a7e0-686d3f037a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:29.945442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba08788-6b1d-4708-a7e0-686d3f037a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:29.947112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ba08788-6b1d-4708-a7e0-686d3f037a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:29.968222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:30.087749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba08788-6b1d-4708-a7e0-686d3f037a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:30.089517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba08788-6b1d-4708-a7e0-686d3f037a7d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:30.108651 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 653/1326] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:32.125248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18833f-159c-49da-92af-69aa0196f08b None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.125788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18833f-159c-49da-92af-69aa0196f08b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.125788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18833f-159c-49da-92af-69aa0196f08b None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.127254 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 674/1327] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:32.133037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac4681-817a-4dda-9e5c-6444f3d55d1d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.133592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac4681-817a-4dda-9e5c-6444f3d55d1d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.133592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac4681-817a-4dda-9e5c-6444f3d55d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.204555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-12ac4681-817a-4dda-9e5c-6444f3d55d1d None None] MFA Rules not processed for user `cfee50d53ea3488497dcd29cd28b652c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:32.205763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-12ac4681-817a-4dda-9e5c-6444f3d55d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:32.271662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:32.310399 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 654/1328] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:32.629230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1a317-ecf5-4a4c-8e7d-f151da8439e9 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.629442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1a317-ecf5-4a4c-8e7d-f151da8439e9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.629751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1a317-ecf5-4a4c-8e7d-f151da8439e9 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.631224 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 675/1329] 10.222.0.43 () {54 vars in 965 bytes} [Tue Aug 30 04:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:32.638638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115641b6-8888-4327-9ca4-d0d42403a685 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:32.638879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115641b6-8888-4327-9ca4-d0d42403a685 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:32.639174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115641b6-8888-4327-9ca4-d0d42403a685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:32.726649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-115641b6-8888-4327-9ca4-d0d42403a685 None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:32.727864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-115641b6-8888-4327-9ca4-d0d42403a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:32.807656 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 655/1330] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Aug 30 04:03:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:32.816987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1a317-ecf5-4a4c-8e7d-f151da8439e9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:32.818548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-13e1a317-ecf5-4a4c-8e7d-f151da8439e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:32.856928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:32.941017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1a317-ecf5-4a4c-8e7d-f151da8439e9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:33.058572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2272e-f5b2-4502-9f0e-47f7199f2ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:33.059227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2272e-f5b2-4502-9f0e-47f7199f2ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:33.059495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2272e-f5b2-4502-9f0e-47f7199f2ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:33.059815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2272e-f5b2-4502-9f0e-47f7199f2ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:33.061513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d4d2272e-f5b2-4502-9f0e-47f7199f2ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:33.155147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:33.197305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2272e-f5b2-4502-9f0e-47f7199f2ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:33.198808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d2272e-f5b2-4502-9f0e-47f7199f2ab7 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:33.219318 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 676/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:32 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:35.805127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dd2b2-7fb3-4d10-8b5b-fe78dc0ea10b None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:35.806109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dd2b2-7fb3-4d10-8b5b-fe78dc0ea10b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:35.806109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dd2b2-7fb3-4d10-8b5b-fe78dc0ea10b None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:35.807425 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 656/1332] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:35.813201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6f45a-c749-42f6-a25c-3a0c05ad857c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:35.813718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6f45a-c749-42f6-a25c-3a0c05ad857c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:35.813718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6f45a-c749-42f6-a25c-3a0c05ad857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:35.886897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-80b6f45a-c749-42f6-a25c-3a0c05ad857c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:35.888116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-80b6f45a-c749-42f6-a25c-3a0c05ad857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:35.987920 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 677/1333] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:36.270452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dd2b2-7fb3-4d10-8b5b-fe78dc0ea10b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:36.272086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fd7dd2b2-7fb3-4d10-8b5b-fe78dc0ea10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:36.347843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:36.384066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dd2b2-7fb3-4d10-8b5b-fe78dc0ea10b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:36.466087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce486608-2dd1-488a-b7c0-0b2818b565ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:36.466697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486608-2dd1-488a-b7c0-0b2818b565ff service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:36.466968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486608-2dd1-488a-b7c0-0b2818b565ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:36.467229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486608-2dd1-488a-b7c0-0b2818b565ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:36.468814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ce486608-2dd1-488a-b7c0-0b2818b565ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:36.579686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce486608-2dd1-488a-b7c0-0b2818b565ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:36.581130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce486608-2dd1-488a-b7c0-0b2818b565ff service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:36.597284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:36.607228 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 657/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:38.573966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16341d-4f0f-4ef3-8c4c-a14208a3f499 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.574536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16341d-4f0f-4ef3-8c4c-a14208a3f499 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.574536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16341d-4f0f-4ef3-8c4c-a14208a3f499 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.575848 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 678/1335] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:38.581214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8956-f890-45ec-9e42-31ce2f2f43c1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:38.581665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8956-f890-45ec-9e42-31ce2f2f43c1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:38.581784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8956-f890-45ec-9e42-31ce2f2f43c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:38.653551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-29cd8956-f890-45ec-9e42-31ce2f2f43c1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:38.654805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-29cd8956-f890-45ec-9e42-31ce2f2f43c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:38.754916 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 658/1336] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:39.046019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16341d-4f0f-4ef3-8c4c-a14208a3f499 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:39.047896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bf16341d-4f0f-4ef3-8c4c-a14208a3f499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:39.093489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:39.163462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16341d-4f0f-4ef3-8c4c-a14208a3f499 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:39.242848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f354c-b3ff-48c2-a975-c5ccfb85121b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:39.243461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f354c-b3ff-48c2-a975-c5ccfb85121b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:39.243731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f354c-b3ff-48c2-a975-c5ccfb85121b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:39.243991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f354c-b3ff-48c2-a975-c5ccfb85121b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:39.245603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ef3f354c-b3ff-48c2-a975-c5ccfb85121b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:39.331233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:39.357769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f354c-b3ff-48c2-a975-c5ccfb85121b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:39.359174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f354c-b3ff-48c2-a975-c5ccfb85121b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:39.377536 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 679/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:41.592495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b865a-9879-45c4-9145-f366a083886b None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.593067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b865a-9879-45c4-9145-f366a083886b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.593067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b865a-9879-45c4-9145-f366a083886b None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.594428 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 659/1338] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:41.600705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8127599-f05c-4f28-b829-66a05ef88aad None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:41.601380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8127599-f05c-4f28-b829-66a05ef88aad None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:41.601559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8127599-f05c-4f28-b829-66a05ef88aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:41.673550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b8127599-f05c-4f28-b829-66a05ef88aad None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:41.674796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b8127599-f05c-4f28-b829-66a05ef88aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:41.784774 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 680/1339] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:42.076634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b865a-9879-45c4-9145-f366a083886b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:42.079090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5f6b865a-9879-45c4-9145-f366a083886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:42.165885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:42.196253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b865a-9879-45c4-9145-f366a083886b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:42.274062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f24aa4-9189-4156-a40a-518f0dca3a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:42.274678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24aa4-9189-4156-a40a-518f0dca3a3e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:42.274950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24aa4-9189-4156-a40a-518f0dca3a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:42.275218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f24aa4-9189-4156-a40a-518f0dca3a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:42.276829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f2f24aa4-9189-4156-a40a-518f0dca3a3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:42.401021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f24aa4-9189-4156-a40a-518f0dca3a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:42.402428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f24aa4-9189-4156-a40a-518f0dca3a3e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:42.421155 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 660/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:46.562425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5636a3-9f9d-4cd6-ae19-e5fae310de08 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.563081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5636a3-9f9d-4cd6-ae19-e5fae310de08 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.563081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5636a3-9f9d-4cd6-ae19-e5fae310de08 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.564370 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 681/1341] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:03:46.570758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba97045-bbf6-49fd-a97f-fad19aa27af1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:46.571309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba97045-bbf6-49fd-a97f-fad19aa27af1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:46.571407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba97045-bbf6-49fd-a97f-fad19aa27af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:46.577360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:46.649817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8ba97045-bbf6-49fd-a97f-fad19aa27af1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:46.651055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8ba97045-bbf6-49fd-a97f-fad19aa27af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:46.763110 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 661/1342] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:47.065252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5636a3-9f9d-4cd6-ae19-e5fae310de08 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:47.066813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2e5636a3-9f9d-4cd6-ae19-e5fae310de08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:47.123824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:47.181474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5636a3-9f9d-4cd6-ae19-e5fae310de08 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:47.259940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b24048-4c7e-4aad-adde-d86decd508c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:47.260556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b24048-4c7e-4aad-adde-d86decd508c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:47.260825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b24048-4c7e-4aad-adde-d86decd508c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:47.261091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b24048-4c7e-4aad-adde-d86decd508c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:47.262725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-48b24048-4c7e-4aad-adde-d86decd508c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:47.365253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:47.384139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b24048-4c7e-4aad-adde-d86decd508c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:47.385582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b24048-4c7e-4aad-adde-d86decd508c2 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:47.405418 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 682/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:49.999184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992568c-224c-49d5-9f6e-8251d720907e None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:49.999800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992568c-224c-49d5-9f6e-8251d720907e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:49.999985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992568c-224c-49d5-9f6e-8251d720907e None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.002506 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 662/1344] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:50.010929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c4809-1719-456f-b875-86bc7a487273 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.011550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c4809-1719-456f-b875-86bc7a487273 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.011550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c4809-1719-456f-b875-86bc7a487273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.086481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bc4c4809-1719-456f-b875-86bc7a487273 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:50.087738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bc4c4809-1719-456f-b875-86bc7a487273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:50.196769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 683/1345] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:50.478301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992568c-224c-49d5-9f6e-8251d720907e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:50.479919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9992568c-224c-49d5-9f6e-8251d720907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:50.580958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:50.599840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992568c-224c-49d5-9f6e-8251d720907e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:50.693206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239a2f5-ecf1-47f1-9eb4-12cbeeda6c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:50.693827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239a2f5-ecf1-47f1-9eb4-12cbeeda6c2a service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:50.694090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239a2f5-ecf1-47f1-9eb4-12cbeeda6c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:50.694395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239a2f5-ecf1-47f1-9eb4-12cbeeda6c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:50.696045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d239a2f5-ecf1-47f1-9eb4-12cbeeda6c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:50.816475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239a2f5-ecf1-47f1-9eb4-12cbeeda6c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:50.817963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239a2f5-ecf1-47f1-9eb4-12cbeeda6c2a service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:50.836974 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 663/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:03:55.289818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd41a-0a12-4b31-b53d-47c22a253921 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:55.290378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd41a-0a12-4b31-b53d-47c22a253921 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:55.290378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafd41a-0a12-4b31-b53d-47c22a253921 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:55.291769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 684/1347] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:03:55.298004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff717ff-cb0b-4e94-a95b-7813a638b668 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:55.298573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff717ff-cb0b-4e94-a95b-7813a638b668 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:55.299099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff717ff-cb0b-4e94-a95b-7813a638b668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:55.317583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:55.384498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cff717ff-cb0b-4e94-a95b-7813a638b668 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:03:55.385731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cff717ff-cb0b-4e94-a95b-7813a638b668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:55.506207 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 664/1348] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:03:55.799521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafd41a-0a12-4b31-b53d-47c22a253921 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:03:55.801542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1aafd41a-0a12-4b31-b53d-47c22a253921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:55.866079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:55.921629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafd41a-0a12-4b31-b53d-47c22a253921 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:03:56.002462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b069e-1590-4525-8e90-4f4d6bff6334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:03:56.003110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b069e-1590-4525-8e90-4f4d6bff6334 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:03:56.003433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b069e-1590-4525-8e90-4f4d6bff6334 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:03:56.003724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b069e-1590-4525-8e90-4f4d6bff6334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:03:56.005348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1f8b069e-1590-4525-8e90-4f4d6bff6334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:03:56.119699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:03:56.123714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b069e-1590-4525-8e90-4f4d6bff6334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:03:56.125945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b069e-1590-4525-8e90-4f4d6bff6334 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:03:56.147226 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 685/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:01.269600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d197-3cdd-40eb-aae4-f18a82427aba None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.270247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d197-3cdd-40eb-aae4-f18a82427aba None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.270247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5d197-3cdd-40eb-aae4-f18a82427aba None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.271570 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 665/1350] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:01.276956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce931e77-02fb-487f-b1e3-8b4a84a38238 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:01.277851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce931e77-02fb-487f-b1e3-8b4a84a38238 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:01.277851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce931e77-02fb-487f-b1e3-8b4a84a38238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:01.383577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ce931e77-02fb-487f-b1e3-8b4a84a38238 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:01.384833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ce931e77-02fb-487f-b1e3-8b4a84a38238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:01.595470 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 686/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:04:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:05.504269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=59 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:06.060884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a8fd-fa3c-4b4e-9461-025f399b6ac7 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.061294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a8fd-fa3c-4b4e-9461-025f399b6ac7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.061507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363a8fd-fa3c-4b4e-9461-025f399b6ac7 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.063146 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 666/1352] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:06.070040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497982ab-05b1-42a8-8533-8225ea9b9743 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:06.070586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497982ab-05b1-42a8-8533-8225ea9b9743 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:06.070802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497982ab-05b1-42a8-8533-8225ea9b9743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:06.128624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:06.154246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-497982ab-05b1-42a8-8533-8225ea9b9743 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:06.155800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-497982ab-05b1-42a8-8533-8225ea9b9743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:06.279158 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 687/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:04:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:07.609977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ef77-2c78-46bf-b985-f12ada3aeabb None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.610523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ef77-2c78-46bf-b985-f12ada3aeabb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.610733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ef77-2c78-46bf-b985-f12ada3aeabb None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.612346 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 667/1354] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:07.618561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189bfa6-3758-4ad1-9b36-0ae4f592eef6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:07.619062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189bfa6-3758-4ad1-9b36-0ae4f592eef6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:07.619159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189bfa6-3758-4ad1-9b36-0ae4f592eef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:07.713073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7189bfa6-3758-4ad1-9b36-0ae4f592eef6 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:07.714346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7189bfa6-3758-4ad1-9b36-0ae4f592eef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:07.762411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:07.840943 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 688/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:04:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:11.292239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bfa55-1479-46dd-8ce3-e3afe20c5f47 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.292821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bfa55-1479-46dd-8ce3-e3afe20c5f47 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.292821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bfa55-1479-46dd-8ce3-e3afe20c5f47 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.294153 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 668/1356] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:11.300938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae4efd-8dab-4ed1-9689-dcc57af525df None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.301626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae4efd-8dab-4ed1-9689-dcc57af525df None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.301626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae4efd-8dab-4ed1-9689-dcc57af525df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.373954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8dae4efd-8dab-4ed1-9689-dcc57af525df None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:11.375223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8dae4efd-8dab-4ed1-9689-dcc57af525df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:11.492768 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 689/1357] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:11.803118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55888bc-cde2-4ed9-8048-e393bd2309ba None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.803337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55888bc-cde2-4ed9-8048-e393bd2309ba None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.803608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55888bc-cde2-4ed9-8048-e393bd2309ba None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.808902 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 669/1358] 10.222.0.43 () {54 vars in 962 bytes} [Tue Aug 30 04:04:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:11.831566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3ccb6-8d73-4242-a120-e98ff4d93b06 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:11.832144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3ccb6-8d73-4242-a120-e98ff4d93b06 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:11.832571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3ccb6-8d73-4242-a120-e98ff4d93b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:11.855160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:11.940699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9ca3ccb6-8d73-4242-a120-e98ff4d93b06 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:11.942390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9ca3ccb6-8d73-4242-a120-e98ff4d93b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:12.107741 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 690/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Aug 30 04:04:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:12.116117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55888bc-cde2-4ed9-8048-e393bd2309ba None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:12.118472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b55888bc-cde2-4ed9-8048-e393bd2309ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:12.292097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55888bc-cde2-4ed9-8048-e393bd2309ba None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:12.373539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:12.414775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26673791-cc93-44a5-964b-acb6abbd939e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:12.415544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26673791-cc93-44a5-964b-acb6abbd939e service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:12.415913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26673791-cc93-44a5-964b-acb6abbd939e service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:12.416291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26673791-cc93-44a5-964b-acb6abbd939e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:12.418022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-26673791-cc93-44a5-964b-acb6abbd939e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:12.523731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26673791-cc93-44a5-964b-acb6abbd939e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:12.525458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26673791-cc93-44a5-964b-acb6abbd939e service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:12.548289 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 670/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:14.754979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f726-df1c-40b0-b539-72504fd5428c None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.755495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f726-df1c-40b0-b539-72504fd5428c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.755495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f726-df1c-40b0-b539-72504fd5428c None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.756962 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 691/1361] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:14.762321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62f582-5265-4d8c-94a3-11b40b9900ec None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:14.762829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62f582-5265-4d8c-94a3-11b40b9900ec None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:14.762829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62f582-5265-4d8c-94a3-11b40b9900ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:14.835154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fb62f582-5265-4d8c-94a3-11b40b9900ec None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:14.836282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fb62f582-5265-4d8c-94a3-11b40b9900ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:14.877243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:14.966488 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 671/1362] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:15.258849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4f726-df1c-40b0-b539-72504fd5428c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:15.260260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-91b4f726-df1c-40b0-b539-72504fd5428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:15.346790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:15.477864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4f726-df1c-40b0-b539-72504fd5428c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:15.611978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edad74b-5d6d-40e8-935f-d3620ae92fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:15.612595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad74b-5d6d-40e8-935f-d3620ae92fac service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:15.612866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad74b-5d6d-40e8-935f-d3620ae92fac service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:15.613131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edad74b-5d6d-40e8-935f-d3620ae92fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:15.614878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1edad74b-5d6d-40e8-935f-d3620ae92fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:15.648290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:15.737778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edad74b-5d6d-40e8-935f-d3620ae92fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:15.739454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edad74b-5d6d-40e8-935f-d3620ae92fac service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:15.764551 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 692/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:18.053998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9b0f6-d4df-439a-9f76-4bf9dfc593c1 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.054531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9b0f6-d4df-439a-9f76-4bf9dfc593c1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.054756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9b0f6-d4df-439a-9f76-4bf9dfc593c1 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.057420 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 672/1364] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:18.063155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fdbb7-fd1e-4b70-a027-6c227c1314a8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.063915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fdbb7-fd1e-4b70-a027-6c227c1314a8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.064053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fdbb7-fd1e-4b70-a027-6c227c1314a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.144190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ad2fdbb7-fd1e-4b70-a027-6c227c1314a8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:18.145424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ad2fdbb7-fd1e-4b70-a027-6c227c1314a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:18.270157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:18.273954 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 693/1365] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:18.576024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad331c1-dcbb-4840-9740-0d22566187ab None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.576403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad331c1-dcbb-4840-9740-0d22566187ab None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.576627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad331c1-dcbb-4840-9740-0d22566187ab None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.578482 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 673/1366] 10.222.0.43 () {54 vars in 962 bytes} [Tue Aug 30 04:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:18.584890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2099b-ecf9-468d-8e80-c0fb22272866 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:18.585172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2099b-ecf9-468d-8e80-c0fb22272866 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:18.585472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2099b-ecf9-468d-8e80-c0fb22272866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:18.692321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b0c2099b-ecf9-468d-8e80-c0fb22272866 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:18.693642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b0c2099b-ecf9-468d-8e80-c0fb22272866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:18.893184 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 694/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Aug 30 04:04:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:04:18.903225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad331c1-dcbb-4840-9740-0d22566187ab None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:18.904736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8ad331c1-dcbb-4840-9740-0d22566187ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:19.073428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad331c1-dcbb-4840-9740-0d22566187ab None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:19.095086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:19.251571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9646e6-14cd-46b1-9e5d-6c09142e748e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:19.252104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9646e6-14cd-46b1-9e5d-6c09142e748e service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:19.252377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9646e6-14cd-46b1-9e5d-6c09142e748e service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:19.252645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9646e6-14cd-46b1-9e5d-6c09142e748e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:19.254349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ed9646e6-14cd-46b1-9e5d-6c09142e748e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:19.362159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9646e6-14cd-46b1-9e5d-6c09142e748e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:19.363797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9646e6-14cd-46b1-9e5d-6c09142e748e service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:19.382755 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 674/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:04:21.537381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24abb2-9953-4c44-9735-1f351b332a11 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.537940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24abb2-9953-4c44-9735-1f351b332a11 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.538297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24abb2-9953-4c44-9735-1f351b332a11 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.544506 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 695/1369] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:21.546458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5a76-c2fe-44f1-986d-aafc679291bb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:21.546909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5a76-c2fe-44f1-986d-aafc679291bb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:21.547118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d5a76-c2fe-44f1-986d-aafc679291bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:21.604476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:21.696615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d47d5a76-c2fe-44f1-986d-aafc679291bb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:21.696824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d47d5a76-c2fe-44f1-986d-aafc679291bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:21.933382 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 675/1370] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:22.270962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24abb2-9953-4c44-9735-1f351b332a11 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:22.272800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cf24abb2-9953-4c44-9735-1f351b332a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:22.333730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.440245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24abb2-9953-4c44-9735-1f351b332a11 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:22.578817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1ef1-eafa-47c1-a212-44973e0c3de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:22.579606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1ef1-eafa-47c1-a212-44973e0c3de3 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:22.580115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1ef1-eafa-47c1-a212-44973e0c3de3 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:22.580602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1ef1-eafa-47c1-a212-44973e0c3de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:22.582464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5d3c1ef1-eafa-47c1-a212-44973e0c3de3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:22.592851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:22.686281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1ef1-eafa-47c1-a212-44973e0c3de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:22.688156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1ef1-eafa-47c1-a212-44973e0c3de3 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:22.723902 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 696/1371] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:23.773462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac46d4-17bb-431b-91c7-dea9f955a1dd None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.773895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac46d4-17bb-431b-91c7-dea9f955a1dd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.774184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac46d4-17bb-431b-91c7-dea9f955a1dd None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.775550 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 676/1372] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:23.782369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aec49-375e-4eaf-b892-153531ab41a7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:23.783329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aec49-375e-4eaf-b892-153531ab41a7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:23.783807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430aec49-375e-4eaf-b892-153531ab41a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:23.896530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-430aec49-375e-4eaf-b892-153531ab41a7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:23.897864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-430aec49-375e-4eaf-b892-153531ab41a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:24.000250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.029414 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 697/1373] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:24.647788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8298f-00b5-4f42-b8f5-747d9801bfc4 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.647788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8298f-00b5-4f42-b8f5-747d9801bfc4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.647788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8298f-00b5-4f42-b8f5-747d9801bfc4 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.647788 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 677/1374] 10.222.0.43 () {54 vars in 964 bytes} [Tue Aug 30 04:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:24.653310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09edc-4441-4533-af7b-97fbad5b91e0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.653310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09edc-4441-4533-af7b-97fbad5b91e0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.653310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d09edc-4441-4533-af7b-97fbad5b91e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.744889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f2d09edc-4441-4533-af7b-97fbad5b91e0 None None] MFA Rules not processed for user `38a84e3c6a2d4c0ab3a00851e555330a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:24.746241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f2d09edc-4441-4533-af7b-97fbad5b91e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:24.791728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797876a6-7e85-49dc-b1d5-e3925676d81c None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.792269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797876a6-7e85-49dc-b1d5-e3925676d81c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.792269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797876a6-7e85-49dc-b1d5-e3925676d81c None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.793848 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 678/1375] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:24.799387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37570ab-21ec-47d3-a16f-5a35dbae84de None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.799758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37570ab-21ec-47d3-a16f-5a35dbae84de None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.800143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37570ab-21ec-47d3-a16f-5a35dbae84de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.829864 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 698/1376] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Aug 30 04:04:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:04:24.837980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d09edc-4441-4533-af7b-97fbad5b91e0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:24.848005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d09edc-4441-4533-af7b-97fbad5b91e0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:24.873326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e37570ab-21ec-47d3-a16f-5a35dbae84de None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:24.874512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e37570ab-21ec-47d3-a16f-5a35dbae84de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:24.928176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.930556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28692048-4734-4b45-aad7-25fe54c2f064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:24.931530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:24.932424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28692048-4734-4b45-aad7-25fe54c2f064 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:24.933382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28692048-4734-4b45-aad7-25fe54c2f064 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:24.933949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28692048-4734-4b45-aad7-25fe54c2f064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:24.936679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-28692048-4734-4b45-aad7-25fe54c2f064 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:24.982168 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 679/1377] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:04:25.054296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28692048-4734-4b45-aad7-25fe54c2f064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:25.055747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28692048-4734-4b45-aad7-25fe54c2f064 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:25.078435 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 699/1378] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:25.274611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37570ab-21ec-47d3-a16f-5a35dbae84de None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:25.276146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e37570ab-21ec-47d3-a16f-5a35dbae84de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:25.401365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37570ab-21ec-47d3-a16f-5a35dbae84de None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:25.477590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:25.543302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9682aff-bf39-417b-9bcd-23f24c2f52bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:25.543916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9682aff-bf39-417b-9bcd-23f24c2f52bb service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:25.544183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9682aff-bf39-417b-9bcd-23f24c2f52bb service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:25.544786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9682aff-bf39-417b-9bcd-23f24c2f52bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:25.548028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c9682aff-bf39-417b-9bcd-23f24c2f52bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:25.742384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9682aff-bf39-417b-9bcd-23f24c2f52bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:25.745357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9682aff-bf39-417b-9bcd-23f24c2f52bb service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:25.779497 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 680/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:27.747603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea051d5-3b3b-429a-81c5-a067993b31e1 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:27.748561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea051d5-3b3b-429a-81c5-a067993b31e1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:27.748847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea051d5-3b3b-429a-81c5-a067993b31e1 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:27.750458 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 700/1380] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:27.756015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565df61-1464-4f65-8128-184ff5400398 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:27.756797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565df61-1464-4f65-8128-184ff5400398 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:27.757227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565df61-1464-4f65-8128-184ff5400398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:27.859323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5565df61-1464-4f65-8128-184ff5400398 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:27.860887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5565df61-1464-4f65-8128-184ff5400398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:27.898653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:27.967835 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 681/1381] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:28.254091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea051d5-3b3b-429a-81c5-a067993b31e1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:28.255824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6ea051d5-3b3b-429a-81c5-a067993b31e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:28.392709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:28.444487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea051d5-3b3b-429a-81c5-a067993b31e1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:28.568882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b153f31-9809-4705-8e6b-914ba3616079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:28.571311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b153f31-9809-4705-8e6b-914ba3616079 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:28.571311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b153f31-9809-4705-8e6b-914ba3616079 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:28.571311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b153f31-9809-4705-8e6b-914ba3616079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:28.572181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0b153f31-9809-4705-8e6b-914ba3616079 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:28.655380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:28.698590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b153f31-9809-4705-8e6b-914ba3616079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:28.700322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b153f31-9809-4705-8e6b-914ba3616079 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:28.719239 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 701/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:30.859593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f10c31-50dc-4bf4-8dc0-6c53caee12e9 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:30.860172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f10c31-50dc-4bf4-8dc0-6c53caee12e9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:30.860172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f10c31-50dc-4bf4-8dc0-6c53caee12e9 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:30.862480 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 682/1383] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:30.870577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137ca43-f2c9-49d5-a332-0fc9075edcbc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:30.871071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137ca43-f2c9-49d5-a332-0fc9075edcbc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:30.871236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137ca43-f2c9-49d5-a332-0fc9075edcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:30.954695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1137ca43-f2c9-49d5-a332-0fc9075edcbc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:30.955911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1137ca43-f2c9-49d5-a332-0fc9075edcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:31.082020 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 702/1384] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:31.403795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f10c31-50dc-4bf4-8dc0-6c53caee12e9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:31.405467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-83f10c31-50dc-4bf4-8dc0-6c53caee12e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:31.611479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f10c31-50dc-4bf4-8dc0-6c53caee12e9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:31.626924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:31.755584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f191654-70eb-426c-8f76-5e5e3da32082 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:31.756624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f191654-70eb-426c-8f76-5e5e3da32082 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:31.757077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f191654-70eb-426c-8f76-5e5e3da32082 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:31.757528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f191654-70eb-426c-8f76-5e5e3da32082 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:31.760233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9f191654-70eb-426c-8f76-5e5e3da32082 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:31.871680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f191654-70eb-426c-8f76-5e5e3da32082 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:31.873701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f191654-70eb-426c-8f76-5e5e3da32082 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:31.898996 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 683/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:33.987906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f3ed8-7615-408c-89aa-54e7750bbb5e None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:33.988491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f3ed8-7615-408c-89aa-54e7750bbb5e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:33.988701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f3ed8-7615-408c-89aa-54e7750bbb5e None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:33.991725 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 703/1386] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:33.998489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a66f-cb85-41e9-87d0-6b78c7a12a6a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:33.999135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a66f-cb85-41e9-87d0-6b78c7a12a6a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:33.999135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4a66f-cb85-41e9-87d0-6b78c7a12a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.033028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:34.106288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-aae4a66f-cb85-41e9-87d0-6b78c7a12a6a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:34.108169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aae4a66f-cb85-41e9-87d0-6b78c7a12a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:34.248441 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 684/1387] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:34.569203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f3ed8-7615-408c-89aa-54e7750bbb5e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:34.570949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-246f3ed8-7615-408c-89aa-54e7750bbb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:34.626310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:34.777307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f3ed8-7615-408c-89aa-54e7750bbb5e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:34.925734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf6b89-7ea8-4168-a370-253922ac86b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:34.926417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf6b89-7ea8-4168-a370-253922ac86b7 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:34.926695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf6b89-7ea8-4168-a370-253922ac86b7 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:34.926962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf6b89-7ea8-4168-a370-253922ac86b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:34.928649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ebf6b89-7ea8-4168-a370-253922ac86b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:34.932245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:35.035609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf6b89-7ea8-4168-a370-253922ac86b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:35.037427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf6b89-7ea8-4168-a370-253922ac86b7 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:35.059098 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 704/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:37.455859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06db8e-5166-49d6-9563-7fbc60ee710b None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:37.456397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06db8e-5166-49d6-9563-7fbc60ee710b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:37.456397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06db8e-5166-49d6-9563-7fbc60ee710b None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:37.458001 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 685/1389] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:37.465551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f9efc-26a5-4275-98ff-eaf9cb423eec None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:37.466315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f9efc-26a5-4275-98ff-eaf9cb423eec None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:37.466315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f9efc-26a5-4275-98ff-eaf9cb423eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:37.549352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-922f9efc-26a5-4275-98ff-eaf9cb423eec None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:37.550668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-922f9efc-26a5-4275-98ff-eaf9cb423eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:37.635052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:37.659055 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 705/1390] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:37.948664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06db8e-5166-49d6-9563-7fbc60ee710b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:37.953919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4d06db8e-5166-49d6-9563-7fbc60ee710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:38.062285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:38.127188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06db8e-5166-49d6-9563-7fbc60ee710b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:38.284926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4105b84-c4b1-497a-a7ad-a93bcca22f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:38.285458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105b84-c4b1-497a-a7ad-a93bcca22f5a service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:38.285735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105b84-c4b1-497a-a7ad-a93bcca22f5a service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:38.286045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4105b84-c4b1-497a-a7ad-a93bcca22f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:38.287671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a4105b84-c4b1-497a-a7ad-a93bcca22f5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:38.355282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:38.394922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105b84-c4b1-497a-a7ad-a93bcca22f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:38.396685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4105b84-c4b1-497a-a7ad-a93bcca22f5a service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:38.416821 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 686/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:40.776108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f8ac5-13a3-4c5a-b383-3e871d753eee None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:40.776683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f8ac5-13a3-4c5a-b383-3e871d753eee None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:40.776777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f8ac5-13a3-4c5a-b383-3e871d753eee None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:40.778682 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 706/1392] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:40.784703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a0103-b506-444d-a0ed-48fac29fe6ed None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:40.785232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a0103-b506-444d-a0ed-48fac29fe6ed None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:40.785232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a0103-b506-444d-a0ed-48fac29fe6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:40.869454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-706a0103-b506-444d-a0ed-48fac29fe6ed None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:40.869921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-706a0103-b506-444d-a0ed-48fac29fe6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:40.982271 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 687/1393] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:41.299359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f8ac5-13a3-4c5a-b383-3e871d753eee None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:41.300896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-677f8ac5-13a3-4c5a-b383-3e871d753eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:41.463600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f8ac5-13a3-4c5a-b383-3e871d753eee None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:41.527102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:41.595094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c6f46-39db-4e78-9b51-b3ea579e2a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:41.595817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6f46-39db-4e78-9b51-b3ea579e2a0d service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:41.596064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6f46-39db-4e78-9b51-b3ea579e2a0d service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:41.596358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c6f46-39db-4e78-9b51-b3ea579e2a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:41.598487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ec1c6f46-39db-4e78-9b51-b3ea579e2a0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:41.716300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c6f46-39db-4e78-9b51-b3ea579e2a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:41.717905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c6f46-39db-4e78-9b51-b3ea579e2a0d service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:41.737457 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 707/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:43.706168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1e127-6e29-495b-8e12-c047b0606f8a None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:43.706872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1e127-6e29-495b-8e12-c047b0606f8a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:43.706872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1e127-6e29-495b-8e12-c047b0606f8a None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:43.708035 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 688/1395] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:43.714170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982ab7-4c44-4075-a058-3f78457adbb0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:43.714862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982ab7-4c44-4075-a058-3f78457adbb0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:43.714862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2982ab7-4c44-4075-a058-3f78457adbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:43.799576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f2982ab7-4c44-4075-a058-3f78457adbb0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:43.800815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f2982ab7-4c44-4075-a058-3f78457adbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:43.821611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:43.922619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 708/1396] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:04:44.227550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1e127-6e29-495b-8e12-c047b0606f8a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:44.229507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-19f1e127-6e29-495b-8e12-c047b0606f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:44.280009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:44.407163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1e127-6e29-495b-8e12-c047b0606f8a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:44.543161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:44.548887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca2a72-2f0c-4bbf-a544-671001c0a1bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:44.549514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2a72-2f0c-4bbf-a544-671001c0a1bf service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:44.549786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2a72-2f0c-4bbf-a544-671001c0a1bf service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:44.550095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca2a72-2f0c-4bbf-a544-671001c0a1bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:44.552154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a0ca2a72-2f0c-4bbf-a544-671001c0a1bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:44.653127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca2a72-2f0c-4bbf-a544-671001c0a1bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:44.654803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca2a72-2f0c-4bbf-a544-671001c0a1bf service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:44.688476 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 689/1397] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:44.748266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84134bc8-0e89-4f9d-b2de-2e3eb5a3c1e6 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:44.748943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84134bc8-0e89-4f9d-b2de-2e3eb5a3c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:44.748943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84134bc8-0e89-4f9d-b2de-2e3eb5a3c1e6 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:44.750463 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 709/1398] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:44.756180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23836755-0089-4708-bb6b-80ea395f536a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:44.756932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23836755-0089-4708-bb6b-80ea395f536a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:44.756932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23836755-0089-4708-bb6b-80ea395f536a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:44.844546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-23836755-0089-4708-bb6b-80ea395f536a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:44.846091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-23836755-0089-4708-bb6b-80ea395f536a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:44.934431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:44.973015 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 690/1399] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:45.279786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fe79-1215-4a63-97f5-86197a4c07cf None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.280250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fe79-1215-4a63-97f5-86197a4c07cf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.280782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fe79-1215-4a63-97f5-86197a4c07cf None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.282696 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 710/1400] 10.222.0.43 () {54 vars in 967 bytes} [Tue Aug 30 04:04:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:45.288680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688babc-0018-42de-a4de-a50624153b4b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.289004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688babc-0018-42de-a4de-a50624153b4b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.289259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688babc-0018-42de-a4de-a50624153b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.402012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a688babc-0018-42de-a4de-a50624153b4b None None] MFA Rules not processed for user `0d31eed8c74549f8b8c6bb5aaa6bee98`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:45.403316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a688babc-0018-42de-a4de-a50624153b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:45.497983 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 691/1401] 10.222.0.43 () {58 vars in 1064 bytes} [Tue Aug 30 04:04:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:45.510185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864fe79-1215-4a63-97f5-86197a4c07cf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:45.511789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b864fe79-1215-4a63-97f5-86197a4c07cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:45.634435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864fe79-1215-4a63-97f5-86197a4c07cf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:45.708147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:45.751300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2efd7-8ef2-456a-ba50-aea895d05d02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:45.751954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2efd7-8ef2-456a-ba50-aea895d05d02 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:45.752309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2efd7-8ef2-456a-ba50-aea895d05d02 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:45.752772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2efd7-8ef2-456a-ba50-aea895d05d02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:45.755348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a2f2efd7-8ef2-456a-ba50-aea895d05d02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:45.895629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2efd7-8ef2-456a-ba50-aea895d05d02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:45.897312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2efd7-8ef2-456a-ba50-aea895d05d02 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:45.923148 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 711/1402] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:46.701689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea6523-6c32-4c20-96e3-8878f4f576f0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:46.702274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea6523-6c32-4c20-96e3-8878f4f576f0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:46.702377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea6523-6c32-4c20-96e3-8878f4f576f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:46.746529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3043b6-e5a9-4575-aec9-d8cf53d0dc59 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:46.746994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3043b6-e5a9-4575-aec9-d8cf53d0dc59 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:46.747484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3043b6-e5a9-4575-aec9-d8cf53d0dc59 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:46.749902 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 712/1403] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:04:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:04:46.756450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ff1d6-abd8-4c28-9b2d-fda30d91e47f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:46.757406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ff1d6-abd8-4c28-9b2d-fda30d91e47f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:46.757406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ff1d6-abd8-4c28-9b2d-fda30d91e47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:46.785818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ddea6523-6c32-4c20-96e3-8878f4f576f0 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:46.787071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ddea6523-6c32-4c20-96e3-8878f4f576f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:46.806631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:46.856915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-492ff1d6-abd8-4c28-9b2d-fda30d91e47f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:46.858119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-492ff1d6-abd8-4c28-9b2d-fda30d91e47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:46.890252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:46.898467 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 692/1404] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:04:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:04:46.958503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8cf0-d7f1-4c36-aad2-b6f462debed6 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:46.958503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8cf0-d7f1-4c36-aad2-b6f462debed6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:46.958503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca8cf0-d7f1-4c36-aad2-b6f462debed6 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:46.960350 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 693/1405] 10.222.0.43 () {54 vars in 943 bytes} [Tue Aug 30 04:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:04:46.967113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e07a1-c5bf-48c6-a6ab-af3de82d15b9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:46.967393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e07a1-c5bf-48c6-a6ab-af3de82d15b9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:46.967661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e07a1-c5bf-48c6-a6ab-af3de82d15b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:46.988539 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 713/1406] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:04:47.059283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-154e07a1-c5bf-48c6-a6ab-af3de82d15b9 None None] MFA Rules not processed for user `d9592051e6894c86a699ca2074a32079`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:04:47.060523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-154e07a1-c5bf-48c6-a6ab-af3de82d15b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:47.183213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:47.199040 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 694/1407] 10.222.0.43 () {58 vars in 1040 bytes} [Tue Aug 30 04:04:46 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:04:47.209474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ff1d6-abd8-4c28-9b2d-fda30d91e47f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:47.211326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-492ff1d6-abd8-4c28-9b2d-fda30d91e47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:47.318882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e07a1-c5bf-48c6-a6ab-af3de82d15b9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:04:47.320734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-154e07a1-c5bf-48c6-a6ab-af3de82d15b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:47.328981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ff1d6-abd8-4c28-9b2d-fda30d91e47f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:47.389320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:47.445363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e07a1-c5bf-48c6-a6ab-af3de82d15b9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:04:47.448010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa840da6-0bf1-4d78-aba1-0dc419f17e4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:47.449382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa840da6-0bf1-4d78-aba1-0dc419f17e4f service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:47.449729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa840da6-0bf1-4d78-aba1-0dc419f17e4f service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:47.450088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa840da6-0bf1-4d78-aba1-0dc419f17e4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:47.451883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aa840da6-0bf1-4d78-aba1-0dc419f17e4f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:47.561253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa840da6-0bf1-4d78-aba1-0dc419f17e4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:47.564053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa840da6-0bf1-4d78-aba1-0dc419f17e4f service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:47.577356 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 714/1408] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:04:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:04:47.605333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b2689-6ee4-49d1-a293-37d66ddf1154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:04:47.611606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b2689-6ee4-49d1-a293-37d66ddf1154 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:04:47.611982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b2689-6ee4-49d1-a293-37d66ddf1154 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:04:47.612476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:47.613020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b2689-6ee4-49d1-a293-37d66ddf1154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:04:47.616233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-296b2689-6ee4-49d1-a293-37d66ddf1154 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:04:47.743292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b2689-6ee4-49d1-a293-37d66ddf1154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:04:47.745466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b2689-6ee4-49d1-a293-37d66ddf1154 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:04:47.767715 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 695/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:04:57.571937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=61 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:04:57.764547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=45 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:10.885896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2fd2b-dbb2-495d-8914-3afeabce0daf None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:10.886418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2fd2b-dbb2-495d-8914-3afeabce0daf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:10.886649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2fd2b-dbb2-495d-8914-3afeabce0daf None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:10.888193 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 715/1410] 10.222.0.43 () {54 vars in 918 bytes} [Tue Aug 30 04:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:10.894128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae16948-dc85-4b62-b1d0-f85dc0e4890a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:10.894657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae16948-dc85-4b62-b1d0-f85dc0e4890a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:10.894657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae16948-dc85-4b62-b1d0-f85dc0e4890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:10.983585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-eae16948-dc85-4b62-b1d0-f85dc0e4890a None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:10.984856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eae16948-dc85-4b62-b1d0-f85dc0e4890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:11.100122 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 696/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Aug 30 04:05:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:11.114989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059417fe-b942-47ff-8049-6eec8a0878b9 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:11.115277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059417fe-b942-47ff-8049-6eec8a0878b9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:11.115552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059417fe-b942-47ff-8049-6eec8a0878b9 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:11.116964 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 716/1412] 10.222.0.43 () {54 vars in 918 bytes} [Tue Aug 30 04:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:11.122010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658dec0-1762-4d18-ab93-f1e48fa49eba None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:11.122301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658dec0-1762-4d18-ab93-f1e48fa49eba None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:11.122572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658dec0-1762-4d18-ab93-f1e48fa49eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:11.203471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:11.207360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2658dec0-1762-4d18-ab93-f1e48fa49eba None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:11.209458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2658dec0-1762-4d18-ab93-f1e48fa49eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:11.327722 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 697/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Aug 30 04:05:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:13.794471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18bb70-263f-4dbd-abe9-d84238400b49 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:13.795034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18bb70-263f-4dbd-abe9-d84238400b49 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:13.795034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18bb70-263f-4dbd-abe9-d84238400b49 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:13.796370 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:13.802265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e29e-e231-4f9a-86ff-ca75ec31bcfa None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:13.802749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e29e-e231-4f9a-86ff-ca75ec31bcfa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:13.802749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131e29e-e231-4f9a-86ff-ca75ec31bcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:13.886078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4131e29e-e231-4f9a-86ff-ca75ec31bcfa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:13.887311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4131e29e-e231-4f9a-86ff-ca75ec31bcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:13.951400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:13.998975 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:14.280525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18bb70-263f-4dbd-abe9-d84238400b49 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:14.282375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8b18bb70-263f-4dbd-abe9-d84238400b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:14.439676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18bb70-263f-4dbd-abe9-d84238400b49 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:14.518409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:14.561019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986690a-623f-4a06-a79c-f261bba300c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:14.561639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986690a-623f-4a06-a79c-f261bba300c5 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:14.561900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986690a-623f-4a06-a79c-f261bba300c5 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:14.562213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986690a-623f-4a06-a79c-f261bba300c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:14.563812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4986690a-623f-4a06-a79c-f261bba300c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:14.657309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986690a-623f-4a06-a79c-f261bba300c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:14.658998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986690a-623f-4a06-a79c-f261bba300c5 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:14.679847 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 718/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:15.609429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da6b2c-1046-4c72-8777-bc150f2c4d2d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:15.610051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da6b2c-1046-4c72-8777-bc150f2c4d2d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:15.610051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da6b2c-1046-4c72-8777-bc150f2c4d2d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:15.611345 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:15.616762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb438f-9d5b-4f79-811b-464e711b42d0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:15.617249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb438f-9d5b-4f79-811b-464e711b42d0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:15.617249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb438f-9d5b-4f79-811b-464e711b42d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:15.709557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-58bb438f-9d5b-4f79-811b-464e711b42d0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:15.710873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-58bb438f-9d5b-4f79-811b-464e711b42d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:15.746161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:15.821546 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:16.000083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da6b2c-1046-4c72-8777-bc150f2c4d2d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:16.001526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-64da6b2c-1046-4c72-8777-bc150f2c4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:16.155422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da6b2c-1046-4c72-8777-bc150f2c4d2d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:16.200722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:16.278143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b6d1c-55d4-4a2c-a922-9be9dbf7f8e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:16.278659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b6d1c-55d4-4a2c-a922-9be9dbf7f8e0 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:16.278933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b6d1c-55d4-4a2c-a922-9be9dbf7f8e0 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:16.279196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b6d1c-55d4-4a2c-a922-9be9dbf7f8e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:16.280812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-698b6d1c-55d4-4a2c-a922-9be9dbf7f8e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:16.378484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b6d1c-55d4-4a2c-a922-9be9dbf7f8e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:16.380236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b6d1c-55d4-4a2c-a922-9be9dbf7f8e0 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:16.400422 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 700/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:17.287516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7846-8725-4874-9ca4-bb8c1521dccd None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:17.288415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7846-8725-4874-9ca4-bb8c1521dccd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:17.288415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7846-8725-4874-9ca4-bb8c1521dccd None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:17.289808 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:17.295122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06e109-eefb-4999-a009-ad97760256a1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:17.295586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06e109-eefb-4999-a009-ad97760256a1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:17.295693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06e109-eefb-4999-a009-ad97760256a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:17.352948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:17.376113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7d06e109-eefb-4999-a009-ad97760256a1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:17.377362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7d06e109-eefb-4999-a009-ad97760256a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:17.484247 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:17.640608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7846-8725-4874-9ca4-bb8c1521dccd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:17.641854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-82bb7846-8725-4874-9ca4-bb8c1521dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:17.795514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7846-8725-4874-9ca4-bb8c1521dccd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:17.809536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:17.915696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97527ab-c9c9-4086-9a66-fbe11d81625c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:17.916442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97527ab-c9c9-4086-9a66-fbe11d81625c service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:17.916817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97527ab-c9c9-4086-9a66-fbe11d81625c service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:17.917240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97527ab-c9c9-4086-9a66-fbe11d81625c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:17.919054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e97527ab-c9c9-4086-9a66-fbe11d81625c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:18.011152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97527ab-c9c9-4086-9a66-fbe11d81625c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:18.012770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97527ab-c9c9-4086-9a66-fbe11d81625c service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:18.031181 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 721/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:18.896984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a6c14-8f49-4ae3-9959-5e9990f825c4 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:18.897533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a6c14-8f49-4ae3-9959-5e9990f825c4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:18.897533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a6c14-8f49-4ae3-9959-5e9990f825c4 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:18.898926 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:05:18.904324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc036-dd7a-460e-ac5b-1d6683fd0b17 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:18.904806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc036-dd7a-460e-ac5b-1d6683fd0b17 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:18.904806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fc036-dd7a-460e-ac5b-1d6683fd0b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:18.926606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:18.990072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-304fc036-dd7a-460e-ac5b-1d6683fd0b17 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:18.991330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-304fc036-dd7a-460e-ac5b-1d6683fd0b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:19.095837 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:05:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:19.246822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a6c14-8f49-4ae3-9959-5e9990f825c4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:19.248248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bb9a6c14-8f49-4ae3-9959-5e9990f825c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:19.364676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:19.402427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a6c14-8f49-4ae3-9959-5e9990f825c4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:19.528896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbe925-74a9-4a5f-9fba-e4baceabf042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:19.529419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe925-74a9-4a5f-9fba-e4baceabf042 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:19.529737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe925-74a9-4a5f-9fba-e4baceabf042 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:19.530007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbe925-74a9-4a5f-9fba-e4baceabf042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:19.531610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a1fbe925-74a9-4a5f-9fba-e4baceabf042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:19.610986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:19.625416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbe925-74a9-4a5f-9fba-e4baceabf042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:19.627237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbe925-74a9-4a5f-9fba-e4baceabf042 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:19.649236 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 703/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:20.523826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989199-2cee-41c4-a7bf-e3216b52a587 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:20.524435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989199-2cee-41c4-a7bf-e3216b52a587 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:20.524435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989199-2cee-41c4-a7bf-e3216b52a587 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:20.525769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:20.531098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89590a6c-432c-4111-bf41-cdb073237f1d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:20.531538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89590a6c-432c-4111-bf41-cdb073237f1d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:20.531636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89590a6c-432c-4111-bf41-cdb073237f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:20.612211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-89590a6c-432c-4111-bf41-cdb073237f1d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:20.613502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-89590a6c-432c-4111-bf41-cdb073237f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:20.715882 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:20.865614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989199-2cee-41c4-a7bf-e3216b52a587 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:20.867188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-80989199-2cee-41c4-a7bf-e3216b52a587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:20.957952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:21.024741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989199-2cee-41c4-a7bf-e3216b52a587 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:21.145088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c1bcf-4a01-4d30-bb06-da67bf83b4d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:21.145696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c1bcf-4a01-4d30-bb06-da67bf83b4d0 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:21.145994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c1bcf-4a01-4d30-bb06-da67bf83b4d0 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:21.146259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c1bcf-4a01-4d30-bb06-da67bf83b4d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:21.147848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-836c1bcf-4a01-4d30-bb06-da67bf83b4d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:21.199508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:21.242039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c1bcf-4a01-4d30-bb06-da67bf83b4d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:21.243704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c1bcf-4a01-4d30-bb06-da67bf83b4d0 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:21.262222 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 724/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:22.061720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d02cb4-f090-4e3c-a2c0-2b987712211d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:22.062380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d02cb4-f090-4e3c-a2c0-2b987712211d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:22.062380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d02cb4-f090-4e3c-a2c0-2b987712211d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:22.063924 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:22.069420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e20b37-8725-42b2-a0fb-280148876883 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:22.069987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e20b37-8725-42b2-a0fb-280148876883 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:22.069987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e20b37-8725-42b2-a0fb-280148876883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:22.153279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b9e20b37-8725-42b2-a0fb-280148876883 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:22.154545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b9e20b37-8725-42b2-a0fb-280148876883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:22.258782 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:22.408696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d02cb4-f090-4e3c-a2c0-2b987712211d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:22.410242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c1d02cb4-f090-4e3c-a2c0-2b987712211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:22.466894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:22.570214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d02cb4-f090-4e3c-a2c0-2b987712211d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:22.688820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7596b-bedc-4ceb-a47d-e25777fa98d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:22.689353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7596b-bedc-4ceb-a47d-e25777fa98d1 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:22.689627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7596b-bedc-4ceb-a47d-e25777fa98d1 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:22.689904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7596b-bedc-4ceb-a47d-e25777fa98d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:22.691609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-47c7596b-bedc-4ceb-a47d-e25777fa98d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:22.699178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:22.788915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7596b-bedc-4ceb-a47d-e25777fa98d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:22.790697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7596b-bedc-4ceb-a47d-e25777fa98d1 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:22.810432 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 706/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:23.608618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ef14-21b7-4192-9261-aec522b804db None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:23.609216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ef14-21b7-4192-9261-aec522b804db None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:23.609216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ef14-21b7-4192-9261-aec522b804db None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:23.610584 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:23.619843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19fde-2b8a-49f5-8a0e-6a84fba61261 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:23.620317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19fde-2b8a-49f5-8a0e-6a84fba61261 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:23.620423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19fde-2b8a-49f5-8a0e-6a84fba61261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:23.702272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0ff19fde-2b8a-49f5-8a0e-6a84fba61261 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:23.703504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0ff19fde-2b8a-49f5-8a0e-6a84fba61261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:23.773882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:23.806805 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:23.955705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659ef14-21b7-4192-9261-aec522b804db None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:23.957149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3659ef14-21b7-4192-9261-aec522b804db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:23.975979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:24.108701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659ef14-21b7-4192-9261-aec522b804db None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:24.198136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:24.225086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23bee9-73b7-400c-9e83-0664e9b82c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:24.225618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23bee9-73b7-400c-9e83-0664e9b82c78 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:24.225909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23bee9-73b7-400c-9e83-0664e9b82c78 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:24.226188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23bee9-73b7-400c-9e83-0664e9b82c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:24.227817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-db23bee9-73b7-400c-9e83-0664e9b82c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:24.319634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23bee9-73b7-400c-9e83-0664e9b82c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:24.321262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23bee9-73b7-400c-9e83-0664e9b82c78 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:24.339799 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 727/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:25.170716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be312007-e358-4ffc-8be7-cf486b36fb6c None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:25.171282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be312007-e358-4ffc-8be7-cf486b36fb6c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:25.171282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be312007-e358-4ffc-8be7-cf486b36fb6c None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:25.172537 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:25.178918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0592e-e3b0-4ebc-9fed-492d688eddad None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:25.179427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0592e-e3b0-4ebc-9fed-492d688eddad None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:25.179546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0592e-e3b0-4ebc-9fed-492d688eddad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:25.262356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-88c0592e-e3b0-4ebc-9fed-492d688eddad None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:25.263596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-88c0592e-e3b0-4ebc-9fed-492d688eddad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:25.308947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:25.368680 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:05:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:25.523064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be312007-e358-4ffc-8be7-cf486b36fb6c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:25.524508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-be312007-e358-4ffc-8be7-cf486b36fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:25.698476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be312007-e358-4ffc-8be7-cf486b36fb6c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:25.753739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:25.815573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980db57-c8a9-4a1f-b70f-98b68de8adce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:25.816280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980db57-c8a9-4a1f-b70f-98b68de8adce service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:25.816635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980db57-c8a9-4a1f-b70f-98b68de8adce service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:25.816996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980db57-c8a9-4a1f-b70f-98b68de8adce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:25.818677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1980db57-c8a9-4a1f-b70f-98b68de8adce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:25.917546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980db57-c8a9-4a1f-b70f-98b68de8adce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:25.919229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980db57-c8a9-4a1f-b70f-98b68de8adce service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:25.938914 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 709/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:26.743670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167fc37-9e0e-418d-9a93-e38d8151f36d None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:26.744286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167fc37-9e0e-418d-9a93-e38d8151f36d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:26.744286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167fc37-9e0e-418d-9a93-e38d8151f36d None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:26.745580 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:26.750854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16560417-7c11-4ba5-9724-defce57775f8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:26.751325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16560417-7c11-4ba5-9724-defce57775f8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:26.751451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16560417-7c11-4ba5-9724-defce57775f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:26.841058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-16560417-7c11-4ba5-9724-defce57775f8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:26.842362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-16560417-7c11-4ba5-9724-defce57775f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:26.844498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:26.949476 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:27.098398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167fc37-9e0e-418d-9a93-e38d8151f36d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:27.099932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b167fc37-9e0e-418d-9a93-e38d8151f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:27.260362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167fc37-9e0e-418d-9a93-e38d8151f36d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:27.288414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:27.378144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea422d6e-a476-41f2-a435-71f666e47394 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:27.378805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422d6e-a476-41f2-a435-71f666e47394 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:27.379075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422d6e-a476-41f2-a435-71f666e47394 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:27.379456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422d6e-a476-41f2-a435-71f666e47394 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:27.381130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ea422d6e-a476-41f2-a435-71f666e47394 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:27.476090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea422d6e-a476-41f2-a435-71f666e47394 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:27.477742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea422d6e-a476-41f2-a435-71f666e47394 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:27.499649 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 730/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:05:29.309256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5ef5-1a99-4f6e-be09-a262faf05acb None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:29.309860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5ef5-1a99-4f6e-be09-a262faf05acb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:29.309860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc5ef5-1a99-4f6e-be09-a262faf05acb None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:29.311157 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:29.316830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ebb55-479d-460d-bba8-bd3b50ce5b8d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:29.317284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ebb55-479d-460d-bba8-bd3b50ce5b8d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:29.317378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ebb55-479d-460d-bba8-bd3b50ce5b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:29.360468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:29.387446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4f3ebb55-479d-460d-bba8-bd3b50ce5b8d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:29.388665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4f3ebb55-479d-460d-bba8-bd3b50ce5b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:29.496825 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:29.784849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc5ef5-1a99-4f6e-be09-a262faf05acb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:29.786438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4bbc5ef5-1a99-4f6e-be09-a262faf05acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:29.898308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc5ef5-1a99-4f6e-be09-a262faf05acb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:29.931756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:29.975590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce3c3d-49e7-4b95-859f-2cb8afc71d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:29.976208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3c3d-49e7-4b95-859f-2cb8afc71d76 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:29.976514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3c3d-49e7-4b95-859f-2cb8afc71d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:29.976780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce3c3d-49e7-4b95-859f-2cb8afc71d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:29.978447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b5ce3c3d-49e7-4b95-859f-2cb8afc71d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:30.105378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce3c3d-49e7-4b95-859f-2cb8afc71d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:30.106902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce3c3d-49e7-4b95-859f-2cb8afc71d76 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:30.128882 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 712/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:32.218549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48e8a4-69c2-491f-8b61-b27c314d5cf2 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:32.219196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48e8a4-69c2-491f-8b61-b27c314d5cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:32.219196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48e8a4-69c2-491f-8b61-b27c314d5cf2 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:32.220481 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:32.227329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d34d2-632f-43c2-ad52-a9577f4e72a1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:32.227817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d34d2-632f-43c2-ad52-a9577f4e72a1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:32.227932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d34d2-632f-43c2-ad52-a9577f4e72a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:32.299740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-571d34d2-632f-43c2-ad52-a9577f4e72a1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:32.300923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-571d34d2-632f-43c2-ad52-a9577f4e72a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:32.313730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:32.402620 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:32.683636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48e8a4-69c2-491f-8b61-b27c314d5cf2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:32.685249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e48e8a4-69c2-491f-8b61-b27c314d5cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:32.796506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48e8a4-69c2-491f-8b61-b27c314d5cf2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:32.809922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:32.873473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620ad77-6d16-4b83-8c48-d0c4ce1340e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:32.874110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ad77-6d16-4b83-8c48-d0c4ce1340e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:32.874379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ad77-6d16-4b83-8c48-d0c4ce1340e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:32.874639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620ad77-6d16-4b83-8c48-d0c4ce1340e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:32.876250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6620ad77-6d16-4b83-8c48-d0c4ce1340e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:32.995251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ad77-6d16-4b83-8c48-d0c4ce1340e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:32.996709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620ad77-6d16-4b83-8c48-d0c4ce1340e9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:33.015400 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 733/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:35.354954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d5212-893a-4882-8935-40ccd34c6e8b None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:35.355546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d5212-893a-4882-8935-40ccd34c6e8b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:35.355546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d5212-893a-4882-8935-40ccd34c6e8b None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:35.356887 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:35.362797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219229e-0fb4-44cc-8c05-82e902af5dc9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:35.363378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219229e-0fb4-44cc-8c05-82e902af5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:35.363599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219229e-0fb4-44cc-8c05-82e902af5dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:35.421244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:35.444834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2219229e-0fb4-44cc-8c05-82e902af5dc9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:35.446135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2219229e-0fb4-44cc-8c05-82e902af5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:35.550250 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:35.841536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d5212-893a-4882-8935-40ccd34c6e8b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:35.843116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-734d5212-893a-4882-8935-40ccd34c6e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:35.954433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d5212-893a-4882-8935-40ccd34c6e8b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:35.997103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:36.031419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469c67b-55e3-42f7-bbb4-aeb23f974ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:36.032037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c67b-55e3-42f7-bbb4-aeb23f974ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:36.032339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c67b-55e3-42f7-bbb4-aeb23f974ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:36.032610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469c67b-55e3-42f7-bbb4-aeb23f974ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:36.034907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3469c67b-55e3-42f7-bbb4-aeb23f974ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:36.173601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c67b-55e3-42f7-bbb4-aeb23f974ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:36.175560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469c67b-55e3-42f7-bbb4-aeb23f974ac0 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:36.195031 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 715/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:38.293718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448dc5-9fcc-41ee-97da-1a9295347435 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:38.294367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448dc5-9fcc-41ee-97da-1a9295347435 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:38.294367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62448dc5-9fcc-41ee-97da-1a9295347435 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:38.295672 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:38.301994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081742b-f5ca-4da2-b487-32a2455315e0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:38.302453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081742b-f5ca-4da2-b487-32a2455315e0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:38.302559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081742b-f5ca-4da2-b487-32a2455315e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:38.371313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2081742b-f5ca-4da2-b487-32a2455315e0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:38.372553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2081742b-f5ca-4da2-b487-32a2455315e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:38.394457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:38.475724 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:38.757988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62448dc5-9fcc-41ee-97da-1a9295347435 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:38.759568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-62448dc5-9fcc-41ee-97da-1a9295347435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:38.881102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62448dc5-9fcc-41ee-97da-1a9295347435 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:38.902457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:38.964697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f018db0a-0c8d-4bd2-b9db-72849d435233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:38.965320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018db0a-0c8d-4bd2-b9db-72849d435233 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:38.965595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018db0a-0c8d-4bd2-b9db-72849d435233 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:38.965866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f018db0a-0c8d-4bd2-b9db-72849d435233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:38.967508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f018db0a-0c8d-4bd2-b9db-72849d435233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:39.081778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018db0a-0c8d-4bd2-b9db-72849d435233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:39.083263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f018db0a-0c8d-4bd2-b9db-72849d435233 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:39.102201 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 736/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:41.238571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cf6d6-1e2a-4ad0-98f4-93555031a3bc None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:41.239152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cf6d6-1e2a-4ad0-98f4-93555031a3bc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:41.239152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cf6d6-1e2a-4ad0-98f4-93555031a3bc None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:41.240548 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:41.246106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f53c0f-64e5-4a7d-b3ab-dfcf9fec16e6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:41.246584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f53c0f-64e5-4a7d-b3ab-dfcf9fec16e6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:41.246703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f53c0f-64e5-4a7d-b3ab-dfcf9fec16e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:41.316607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:41.320110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-02f53c0f-64e5-4a7d-b3ab-dfcf9fec16e6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:41.321913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-02f53c0f-64e5-4a7d-b3ab-dfcf9fec16e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:41.426564 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:41.707417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cf6d6-1e2a-4ad0-98f4-93555031a3bc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:41.709013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f88cf6d6-1e2a-4ad0-98f4-93555031a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:41.822339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cf6d6-1e2a-4ad0-98f4-93555031a3bc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:41.873503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:41.899951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f487155-c58d-439f-9bac-3f0e451f01ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:41.900474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487155-c58d-439f-9bac-3f0e451f01ba service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:41.900746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487155-c58d-439f-9bac-3f0e451f01ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:41.901013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f487155-c58d-439f-9bac-3f0e451f01ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:41.902697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0f487155-c58d-439f-9bac-3f0e451f01ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:42.016880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f487155-c58d-439f-9bac-3f0e451f01ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:42.018446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f487155-c58d-439f-9bac-3f0e451f01ba service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:42.037731 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 718/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:43.988380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9d46-c9da-44af-ac62-caa08cb17887 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:43.988964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9d46-c9da-44af-ac62-caa08cb17887 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:43.988964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb9d46-c9da-44af-ac62-caa08cb17887 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:43.990351 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:43.996076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87034ebf-be0d-4a52-b13c-e09c9d82cb11 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:43.996493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87034ebf-be0d-4a52-b13c-e09c9d82cb11 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:43.996637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87034ebf-be0d-4a52-b13c-e09c9d82cb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:44.066586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-87034ebf-be0d-4a52-b13c-e09c9d82cb11 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:44.067855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-87034ebf-be0d-4a52-b13c-e09c9d82cb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:44.099848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:44.172799 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:44.453434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb9d46-c9da-44af-ac62-caa08cb17887 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:44.455347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-71eb9d46-c9da-44af-ac62-caa08cb17887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:44.565258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb9d46-c9da-44af-ac62-caa08cb17887 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:44.595134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:44.643479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83e247-a5c2-4f00-a87f-f6ef3d98ad3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:44.644101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e247-a5c2-4f00-a87f-f6ef3d98ad3a service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:44.644379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e247-a5c2-4f00-a87f-f6ef3d98ad3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:44.644641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e247-a5c2-4f00-a87f-f6ef3d98ad3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:44.646275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9e83e247-a5c2-4f00-a87f-f6ef3d98ad3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:44.763322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83e247-a5c2-4f00-a87f-f6ef3d98ad3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:44.764687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83e247-a5c2-4f00-a87f-f6ef3d98ad3a service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:44.784217 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 739/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:46.765927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7572d-c5f9-4090-acbf-44e03c6f37de None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:46.766532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7572d-c5f9-4090-acbf-44e03c6f37de None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:46.766532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7572d-c5f9-4090-acbf-44e03c6f37de None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:46.767924 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:46.773461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6cacd-9b02-4b41-9b44-19e0a639dbca None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:46.773934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6cacd-9b02-4b41-9b44-19e0a639dbca None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:46.774054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6cacd-9b02-4b41-9b44-19e0a639dbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:46.843744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fbb6cacd-9b02-4b41-9b44-19e0a639dbca None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:46.844950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fbb6cacd-9b02-4b41-9b44-19e0a639dbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:46.854145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:46.946068 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:47.231167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7572d-c5f9-4090-acbf-44e03c6f37de None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:47.232706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-83e7572d-c5f9-4090-acbf-44e03c6f37de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:47.347474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7572d-c5f9-4090-acbf-44e03c6f37de None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:47.405019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:47.426317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ab1b1-aef9-44ec-9fbc-addb61a37b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:47.426850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ab1b1-aef9-44ec-9fbc-addb61a37b51 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:47.427145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ab1b1-aef9-44ec-9fbc-addb61a37b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:47.427409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ab1b1-aef9-44ec-9fbc-addb61a37b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:47.429027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c16ab1b1-aef9-44ec-9fbc-addb61a37b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:47.547461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ab1b1-aef9-44ec-9fbc-addb61a37b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:47.549106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ab1b1-aef9-44ec-9fbc-addb61a37b51 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:47.569550 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 721/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:49.531572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058433b-5e54-48ba-91e7-c9da88d1a455 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:49.532182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058433b-5e54-48ba-91e7-c9da88d1a455 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:49.532182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058433b-5e54-48ba-91e7-c9da88d1a455 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:49.533526 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:49.539516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b3eb7-eb05-467f-b687-bbef7ce3a83f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:49.539992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b3eb7-eb05-467f-b687-bbef7ce3a83f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:49.540088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b3eb7-eb05-467f-b687-bbef7ce3a83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:49.734894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2e0b3eb7-eb05-467f-b687-bbef7ce3a83f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:49.736357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2e0b3eb7-eb05-467f-b687-bbef7ce3a83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:49.776617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:49.836539 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:50.121207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058433b-5e54-48ba-91e7-c9da88d1a455 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:50.123632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9058433b-5e54-48ba-91e7-c9da88d1a455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:50.234503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058433b-5e54-48ba-91e7-c9da88d1a455 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:50.273085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:50.312601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f580af-f8d2-473a-b795-762d68c79347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:50.313224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f580af-f8d2-473a-b795-762d68c79347 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:50.313492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f580af-f8d2-473a-b795-762d68c79347 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:50.313754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f580af-f8d2-473a-b795-762d68c79347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:50.315542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-49f580af-f8d2-473a-b795-762d68c79347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:50.429291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f580af-f8d2-473a-b795-762d68c79347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:50.430664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f580af-f8d2-473a-b795-762d68c79347 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:50.451611 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 742/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:52.423386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece1353-a13b-4daf-9caa-1d1cfcf2de14 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:52.423973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece1353-a13b-4daf-9caa-1d1cfcf2de14 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:52.423973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece1353-a13b-4daf-9caa-1d1cfcf2de14 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:52.425306 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:52.431383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305c5c-398a-4b47-9c49-dc043cb51ef4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:52.431928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305c5c-398a-4b47-9c49-dc043cb51ef4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:52.431928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c305c5c-398a-4b47-9c49-dc043cb51ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:52.506303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8c305c5c-398a-4b47-9c49-dc043cb51ef4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:52.507550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8c305c5c-398a-4b47-9c49-dc043cb51ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:52.531194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:52.622048 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:52.901569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece1353-a13b-4daf-9caa-1d1cfcf2de14 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:52.903135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2ece1353-a13b-4daf-9caa-1d1cfcf2de14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:53.021274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece1353-a13b-4daf-9caa-1d1cfcf2de14 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:53.097826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:53.105394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee6498-9457-4408-b973-1e74b0b9b51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:53.106041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee6498-9457-4408-b973-1e74b0b9b51a service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:53.106315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee6498-9457-4408-b973-1e74b0b9b51a service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:53.106580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee6498-9457-4408-b973-1e74b0b9b51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:53.108207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-caee6498-9457-4408-b973-1e74b0b9b51a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:53.227982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee6498-9457-4408-b973-1e74b0b9b51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:53.229358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee6498-9457-4408-b973-1e74b0b9b51a service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:53.248294 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 724/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:05:55.142298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b32d6-980b-491f-83e7-d965df86087f None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:55.142860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b32d6-980b-491f-83e7-d965df86087f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:55.142860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b32d6-980b-491f-83e7-d965df86087f None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:55.144192 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:05:55.150280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11014657-3f8c-4bf7-b6eb-9af6f75159c4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:55.150716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11014657-3f8c-4bf7-b6eb-9af6f75159c4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:55.150945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11014657-3f8c-4bf7-b6eb-9af6f75159c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:55.243964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-11014657-3f8c-4bf7-b6eb-9af6f75159c4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:05:55.245199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-11014657-3f8c-4bf7-b6eb-9af6f75159c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:55.302952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:55.362006 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:05:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:05:55.644350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b32d6-980b-491f-83e7-d965df86087f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:05:55.646753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b12b32d6-980b-491f-83e7-d965df86087f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:55.760606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b32d6-980b-491f-83e7-d965df86087f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:05:55.815670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:05:55.844580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677b403-a8dd-49e4-9003-b6115fbef00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:05:55.845241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677b403-a8dd-49e4-9003-b6115fbef00f service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:05:55.845518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677b403-a8dd-49e4-9003-b6115fbef00f service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:05:55.845827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677b403-a8dd-49e4-9003-b6115fbef00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:05:55.847775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3677b403-a8dd-49e4-9003-b6115fbef00f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:05:55.968116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677b403-a8dd-49e4-9003-b6115fbef00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:05:55.969577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677b403-a8dd-49e4-9003-b6115fbef00f service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:05:55.987903 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 745/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:05:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:06:05.359497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=22 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:05.985569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=66 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:15.873516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b5e0-bbd3-421d-bc79-ffe82c1d56e1 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:15.874115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b5e0-bbd3-421d-bc79-ffe82c1d56e1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:15.874115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57b5e0-bbd3-421d-bc79-ffe82c1d56e1 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:15.876201 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 726/1471] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:06:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:15.883054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb7850-b5fc-49d0-b0b1-40e1d445a51e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:15.883541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb7850-b5fc-49d0-b0b1-40e1d445a51e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:15.883638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb7850-b5fc-49d0-b0b1-40e1d445a51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:15.957472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a4bb7850-b5fc-49d0-b0b1-40e1d445a51e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:15.958646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a4bb7850-b5fc-49d0-b0b1-40e1d445a51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:16.071920 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 746/1472] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:06:16.367092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81935948-c812-4361-b842-6228161b4fe9 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:16.367410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81935948-c812-4361-b842-6228161b4fe9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:16.367673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81935948-c812-4361-b842-6228161b4fe9 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:16.369014 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 727/1473] 10.222.0.43 () {54 vars in 967 bytes} [Tue Aug 30 04:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:16.374325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfba30b-62ad-4e2d-8502-81495280783b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:16.374617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfba30b-62ad-4e2d-8502-81495280783b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:16.374874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfba30b-62ad-4e2d-8502-81495280783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:16.454409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3dfba30b-62ad-4e2d-8502-81495280783b None None] MFA Rules not processed for user `0d31eed8c74549f8b8c6bb5aaa6bee98`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:16.455710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3dfba30b-62ad-4e2d-8502-81495280783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:16.477921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:16.537180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 747/1474] 10.222.0.43 () {58 vars in 1064 bytes} [Tue Aug 30 04:06:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:06:16.545149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81935948-c812-4361-b842-6228161b4fe9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:16.546711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-81935948-c812-4361-b842-6228161b4fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:16.667391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81935948-c812-4361-b842-6228161b4fe9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:16.747236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba243800-508e-409f-a4c2-05927231f0b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:16.747851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243800-508e-409f-a4c2-05927231f0b0 service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:16.748124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243800-508e-409f-a4c2-05927231f0b0 service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:16.748393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba243800-508e-409f-a4c2-05927231f0b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:16.750026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ba243800-508e-409f-a4c2-05927231f0b0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:16.806425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:16.875046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243800-508e-409f-a4c2-05927231f0b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:16.876657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba243800-508e-409f-a4c2-05927231f0b0 service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:16.896857 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 728/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:06:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:06:18.940645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbfbf4-fdff-43e0-9f8e-46161ede4aa1 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:18.941239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbfbf4-fdff-43e0-9f8e-46161ede4aa1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:18.941239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbfbf4-fdff-43e0-9f8e-46161ede4aa1 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:18.942666 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 748/1476] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:18.948371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251d63-e875-4dc7-b381-b3ffea941afa None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:18.948896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251d63-e875-4dc7-b381-b3ffea941afa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:18.948896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251d63-e875-4dc7-b381-b3ffea941afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:19.021730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-64251d63-e875-4dc7-b381-b3ffea941afa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:19.022991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-64251d63-e875-4dc7-b381-b3ffea941afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:19.134996 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 729/1477] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:06:19.411628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbfbf4-fdff-43e0-9f8e-46161ede4aa1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:19.413158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-babbfbf4-fdff-43e0-9f8e-46161ede4aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:19.547588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbfbf4-fdff-43e0-9f8e-46161ede4aa1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:19.601765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:19.651592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d578c14-0210-4f45-9945-22ff25ced494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:19.652211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578c14-0210-4f45-9945-22ff25ced494 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:19.652492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578c14-0210-4f45-9945-22ff25ced494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:19.652750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d578c14-0210-4f45-9945-22ff25ced494 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:19.653396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d578c14-0210-4f45-9945-22ff25ced494 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:19.655295 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-3d578c14-0210-4f45-9945-22ff25ced494 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:06:19.655295 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:06:19.655295 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:06:19.656442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d578c14-0210-4f45-9945-22ff25ced494 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:19.677130 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 749/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 04:06:19 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:06:21.670210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e7825-4fe2-41b4-b585-d411e0e41317 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:21.670840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e7825-4fe2-41b4-b585-d411e0e41317 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:21.670840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e7825-4fe2-41b4-b585-d411e0e41317 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:21.672172 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 730/1479] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:21.678648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aaadc-839b-4035-a515-39ba96a55730 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:21.679266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aaadc-839b-4035-a515-39ba96a55730 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:21.679378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aaadc-839b-4035-a515-39ba96a55730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:21.757185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0c7aaadc-839b-4035-a515-39ba96a55730 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:21.758455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0c7aaadc-839b-4035-a515-39ba96a55730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:21.877535 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 750/1480] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:06:22.172918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e7825-4fe2-41b4-b585-d411e0e41317 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:22.174672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d97e7825-4fe2-41b4-b585-d411e0e41317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:22.184922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:22.339784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e7825-4fe2-41b4-b585-d411e0e41317 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:22.425459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:22.459441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32989b60-3806-4790-b6c1-67253cd7a7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:22.460041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989b60-3806-4790-b6c1-67253cd7a7ab service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:22.460317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989b60-3806-4790-b6c1-67253cd7a7ab service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:22.460582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32989b60-3806-4790-b6c1-67253cd7a7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:22.462197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-32989b60-3806-4790-b6c1-67253cd7a7ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:22.560420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32989b60-3806-4790-b6c1-67253cd7a7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:22.562072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32989b60-3806-4790-b6c1-67253cd7a7ab service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:22.582025 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 731/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:06:24.708742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fba56-8d85-44c0-9a56-8a5a95e10db2 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:24.709947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fba56-8d85-44c0-9a56-8a5a95e10db2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:24.709947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fba56-8d85-44c0-9a56-8a5a95e10db2 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:24.711822 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 751/1482] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:06:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:24.718428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf81f1d-7b38-4d68-a72f-2b4cb75b2a7f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:24.719176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf81f1d-7b38-4d68-a72f-2b4cb75b2a7f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:24.719272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf81f1d-7b38-4d68-a72f-2b4cb75b2a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:24.791547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cbf81f1d-7b38-4d68-a72f-2b4cb75b2a7f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:24.792797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cbf81f1d-7b38-4d68-a72f-2b4cb75b2a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:24.843302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:24.897423 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 732/1483] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:06:25.182794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fba56-8d85-44c0-9a56-8a5a95e10db2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:25.184333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d31fba56-8d85-44c0-9a56-8a5a95e10db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:25.208469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:25.420803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fba56-8d85-44c0-9a56-8a5a95e10db2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:25.503466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ff5b0-d13f-4917-9156-05ba49bf2a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:25.504153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff5b0-d13f-4917-9156-05ba49bf2a7f service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:25.504540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff5b0-d13f-4917-9156-05ba49bf2a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:25.504923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff5b0-d13f-4917-9156-05ba49bf2a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:25.507474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-649ff5b0-d13f-4917-9156-05ba49bf2a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:25.600740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:25.637728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ff5b0-d13f-4917-9156-05ba49bf2a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:25.639289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ff5b0-d13f-4917-9156-05ba49bf2a7f service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:25.659183 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 752/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:06:27.613087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c35f55-bc8d-4355-be8c-4a87d1fd32b5 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:27.613666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c35f55-bc8d-4355-be8c-4a87d1fd32b5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:27.613666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c35f55-bc8d-4355-be8c-4a87d1fd32b5 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:27.615010 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 733/1485] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:27.620585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f44d3-692f-44cd-8515-451af3e6e9c3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:27.621067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f44d3-692f-44cd-8515-451af3e6e9c3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:27.621173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f44d3-692f-44cd-8515-451af3e6e9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:27.692855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4e0f44d3-692f-44cd-8515-451af3e6e9c3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:27.694129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4e0f44d3-692f-44cd-8515-451af3e6e9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:27.799528 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 753/1486] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:06:28.084804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c35f55-bc8d-4355-be8c-4a87d1fd32b5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:28.086362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-42c35f55-bc8d-4355-be8c-4a87d1fd32b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:28.198469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c35f55-bc8d-4355-be8c-4a87d1fd32b5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:28.282229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:28.284806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc9849-ba47-4943-8b2e-64d35d11e108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:28.285440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc9849-ba47-4943-8b2e-64d35d11e108 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:28.285738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc9849-ba47-4943-8b2e-64d35d11e108 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:28.286030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc9849-ba47-4943-8b2e-64d35d11e108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:28.288141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-49fc9849-ba47-4943-8b2e-64d35d11e108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:28.400341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc9849-ba47-4943-8b2e-64d35d11e108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:28.401700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc9849-ba47-4943-8b2e-64d35d11e108 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:28.420811 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 734/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:06:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:06:30.445673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeb7d2-60e7-4186-a449-8e2c1ed6aaf0 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:30.446305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeb7d2-60e7-4186-a449-8e2c1ed6aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:30.446305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eeb7d2-60e7-4186-a449-8e2c1ed6aaf0 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:30.447711 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 754/1488] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:30.453258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20161a5-2d41-4e8e-b7e3-1c044f9083e9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:30.453709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20161a5-2d41-4e8e-b7e3-1c044f9083e9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:30.453822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20161a5-2d41-4e8e-b7e3-1c044f9083e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:30.526753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f20161a5-2d41-4e8e-b7e3-1c044f9083e9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:30.527970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f20161a5-2d41-4e8e-b7e3-1c044f9083e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:30.587348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:30.634280 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 735/1489] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:06:30.921447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eeb7d2-60e7-4186-a449-8e2c1ed6aaf0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:30.923214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-09eeb7d2-60e7-4186-a449-8e2c1ed6aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:30.963868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:31.038083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eeb7d2-60e7-4186-a449-8e2c1ed6aaf0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:31.130112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0cf2d-5147-444a-8b2e-f014f0a0b538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:31.130731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0cf2d-5147-444a-8b2e-f014f0a0b538 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:31.131005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0cf2d-5147-444a-8b2e-f014f0a0b538 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:31.131261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0cf2d-5147-444a-8b2e-f014f0a0b538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:31.132902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e0d0cf2d-5147-444a-8b2e-f014f0a0b538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:31.216286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:31.251944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0cf2d-5147-444a-8b2e-f014f0a0b538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:31.253532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0cf2d-5147-444a-8b2e-f014f0a0b538 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:31.277322 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 755/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:06:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:06:33.405185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a9d3b-8703-46dd-a5ef-e95d7a0cef8c None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:33.405826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a9d3b-8703-46dd-a5ef-e95d7a0cef8c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:33.405826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a9d3b-8703-46dd-a5ef-e95d7a0cef8c None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:33.407091 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 736/1491] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 04:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:06:33.412981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f1552-4659-41a5-99d1-b4ab9858674a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:33.413468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f1552-4659-41a5-99d1-b4ab9858674a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:33.413575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f1552-4659-41a5-99d1-b4ab9858674a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:33.484574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ca2f1552-4659-41a5-99d1-b4ab9858674a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:06:33.486158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ca2f1552-4659-41a5-99d1-b4ab9858674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:33.588943 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 756/1492] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 04:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:06:33.895974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a9d3b-8703-46dd-a5ef-e95d7a0cef8c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:06:33.897592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-496a9d3b-8703-46dd-a5ef-e95d7a0cef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:34.007573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a9d3b-8703-46dd-a5ef-e95d7a0cef8c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:06:34.089188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4dcdc-afd3-4e60-8846-c8b6c525ff28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:06:34.089791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4dcdc-afd3-4e60-8846-c8b6c525ff28 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:06:34.090095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4dcdc-afd3-4e60-8846-c8b6c525ff28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:06:34.090362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4dcdc-afd3-4e60-8846-c8b6c525ff28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:06:34.091985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a1a4dcdc-afd3-4e60-8846-c8b6c525ff28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:06:34.101602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:34.210243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4dcdc-afd3-4e60-8846-c8b6c525ff28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:06:34.211641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4dcdc-afd3-4e60-8846-c8b6c525ff28 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:06:34.232322 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 737/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:06:43.587004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=82 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:44.229720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=50 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:48.538589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ee5bb-2b41-407c-8dde-c764793b3afb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:48.539244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ee5bb-2b41-407c-8dde-c764793b3afb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:48.539244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ee5bb-2b41-407c-8dde-c764793b3afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:48.620216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a13ee5bb-2b41-407c-8dde-c764793b3afb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:48.621452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a13ee5bb-2b41-407c-8dde-c764793b3afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:48.728952 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 757/1494] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:07:48.738506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e566bc2-ec6f-4302-b024-ec46c4e5e8eb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:48.739044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e566bc2-ec6f-4302-b024-ec46c4e5e8eb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:48.739044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e566bc2-ec6f-4302-b024-ec46c4e5e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:48.818441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0e566bc2-ec6f-4302-b024-ec46c4e5e8eb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:48.819580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0e566bc2-ec6f-4302-b024-ec46c4e5e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:48.920524 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 738/1495] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:07:48.925406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ee5bb-2b41-407c-8dde-c764793b3afb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:48.926653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a13ee5bb-2b41-407c-8dde-c764793b3afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:48.938372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ee5bb-2b41-407c-8dde-c764793b3afb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:49.002094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:49.043642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:49.044258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:49.044524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:49.044780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:49.045456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:07:49.045741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:49.046793 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:07:49.046793 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:07:49.046793 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:07:49.047670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:49.060118 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 758/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:07:49.068983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e566bc2-ec6f-4302-b024-ec46c4e5e8eb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:49.078853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e566bc2-ec6f-4302-b024-ec46c4e5e8eb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:49.145900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:49.182486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15744-8b76-44c4-9b75-7002bda80924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:49.183104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15744-8b76-44c4-9b75-7002bda80924 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:49.183378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15744-8b76-44c4-9b75-7002bda80924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:49.183644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b15744-8b76-44c4-9b75-7002bda80924 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:49.184286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15744-8b76-44c4-9b75-7002bda80924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:49.186115 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-97b15744-8b76-44c4-9b75-7002bda80924 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:07:49.186115 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:07:49.186115 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:07:49.187327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b15744-8b76-44c4-9b75-7002bda80924 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:49.245737 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 739/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:07:49 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:07:49.250280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:49.251824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:49.286449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ae994-e0c6-4303-b713-9b614eac59a9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:49.388047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803eeaf-d873-4a3b-917c-f1c9511902f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:49.388565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803eeaf-d873-4a3b-917c-f1c9511902f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:49.388834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803eeaf-d873-4a3b-917c-f1c9511902f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:49.389101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803eeaf-d873-4a3b-917c-f1c9511902f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:49.389747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803eeaf-d873-4a3b-917c-f1c9511902f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:49.390802 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-c803eeaf-d873-4a3b-917c-f1c9511902f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:07:49.390802 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:07:49.390802 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:07:49.392006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803eeaf-d873-4a3b-917c-f1c9511902f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:49.437607 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 759/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:07:49 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:07:49.442137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15744-8b76-44c4-9b75-7002bda80924 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:49.443644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-97b15744-8b76-44c4-9b75-7002bda80924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:49.507900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b15744-8b76-44c4-9b75-7002bda80924 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:49.597106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:49.609357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34f260-25bd-4fc8-b3e3-ea223202932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:49.610029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f260-25bd-4fc8-b3e3-ea223202932d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:49.610301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f260-25bd-4fc8-b3e3-ea223202932d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:49.610564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34f260-25bd-4fc8-b3e3-ea223202932d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:49.611206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34f260-25bd-4fc8-b3e3-ea223202932d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:49.612238 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-eb34f260-25bd-4fc8-b3e3-ea223202932d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:07:49.612238 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:07:49.612238 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:07:49.613118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34f260-25bd-4fc8-b3e3-ea223202932d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:49.626217 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 740/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:07:49.630804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803eeaf-d873-4a3b-917c-f1c9511902f2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:49.632338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c803eeaf-d873-4a3b-917c-f1c9511902f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:49.644439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803eeaf-d873-4a3b-917c-f1c9511902f2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:49.672442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:49.750725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234e584-0c43-43ac-a9ea-7049af33225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:49.751368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e584-0c43-43ac-a9ea-7049af33225c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:49.751597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e584-0c43-43ac-a9ea-7049af33225c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:49.751883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e584-0c43-43ac-a9ea-7049af33225c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:49.753137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234e584-0c43-43ac-a9ea-7049af33225c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:49.753839 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-1234e584-0c43-43ac-a9ea-7049af33225c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:07:49.753839 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:07:49.753839 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:07:49.754745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234e584-0c43-43ac-a9ea-7049af33225c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:49.768164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 760/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:07:49.772788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34f260-25bd-4fc8-b3e3-ea223202932d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:49.774364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eb34f260-25bd-4fc8-b3e3-ea223202932d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:49.810630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34f260-25bd-4fc8-b3e3-ea223202932d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:49.913201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed168c5-dec4-45c0-b2b0-0cc561a4b971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:49.914244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed168c5-dec4-45c0-b2b0-0cc561a4b971 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:49.914511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed168c5-dec4-45c0-b2b0-0cc561a4b971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:49.914772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed168c5-dec4-45c0-b2b0-0cc561a4b971 admin admin] PATH_INFO: `/v3/projects/b3ed916216584eadb2c887ca9f42eb25/users/261f7a4064cd4738b718aa610e618606/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:49.938693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed168c5-dec4-45c0-b2b0-0cc561a4b971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ed916216584eadb2c887ca9f42eb25, user_id=261f7a4064cd4738b718aa610e618606, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:49.939847 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-fed168c5-dec4-45c0-b2b0-0cc561a4b971 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:07:49.939847 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:07:49.939847 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:07:49.941938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed168c5-dec4-45c0-b2b0-0cc561a4b971 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:49.968579 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 741/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:07:49 2022] PUT /identity/v3/projects/b3ed916216584eadb2c887ca9f42eb25/users/261f7a4064cd4738b718aa610e618606/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:07:49.981110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb783-f6fe-4a10-8bd6-2222d09cd2cf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:49.981391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb783-f6fe-4a10-8bd6-2222d09cd2cf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:49.981658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eb783-f6fe-4a10-8bd6-2222d09cd2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:50.043254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a93eb783-f6fe-4a10-8bd6-2222d09cd2cf None None] MFA Rules not processed for user `261f7a4064cd4738b718aa610e618606`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:50.044465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a93eb783-f6fe-4a10-8bd6-2222d09cd2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:50.131501 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 761/1502] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:07:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:07:50.145972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a7179-5ab0-44fb-b7a1-241a7f413b13 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:50.146253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a7179-5ab0-44fb-b7a1-241a7f413b13 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:50.146520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a7179-5ab0-44fb-b7a1-241a7f413b13 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:50.147860 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 742/1503] 10.222.0.43 () {54 vars in 964 bytes} [Tue Aug 30 04:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:07:50.152944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b385b-e0a0-40a7-97f5-d8e0273cb651 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:50.153229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b385b-e0a0-40a7-97f5-d8e0273cb651 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:50.153496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b385b-e0a0-40a7-97f5-d8e0273cb651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:50.187715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:50.239665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b13b385b-e0a0-40a7-97f5-d8e0273cb651 None None] MFA Rules not processed for user `38a84e3c6a2d4c0ab3a00851e555330a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:50.240980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b13b385b-e0a0-40a7-97f5-d8e0273cb651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:50.327225 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 762/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Aug 30 04:07:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:07:50.335348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a7179-5ab0-44fb-b7a1-241a7f413b13 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:50.337083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d53a7179-5ab0-44fb-b7a1-241a7f413b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:50.394889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:50.453501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a7179-5ab0-44fb-b7a1-241a7f413b13 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:50.537181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1f590-5639-4f19-947c-cfbcb6748e36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:50.537794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1f590-5639-4f19-947c-cfbcb6748e36 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:50.538100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1f590-5639-4f19-947c-cfbcb6748e36 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:50.538369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1f590-5639-4f19-947c-cfbcb6748e36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:50.540020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b9a1f590-5639-4f19-947c-cfbcb6748e36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:50.645117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1f590-5639-4f19-947c-cfbcb6748e36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:50.646629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1f590-5639-4f19-947c-cfbcb6748e36 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:50.650393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:50.666635 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 743/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:07:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:07:50.713422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeaa84-7986-4477-888a-49fba890b344 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:50.713975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeaa84-7986-4477-888a-49fba890b344 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:50.713975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeaa84-7986-4477-888a-49fba890b344 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:50.715372 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 763/1506] 10.222.0.43 () {52 vars in 830 bytes} [Tue Aug 30 04:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:07:50.719285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1f590-5639-4f19-947c-cfbcb6748e36 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:50.720516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b9a1f590-5639-4f19-947c-cfbcb6748e36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:50.826468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1f590-5639-4f19-947c-cfbcb6748e36 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:50.924288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:50.924930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:50.925283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:50.925527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] PATH_INFO: `/v3/users/261f7a4064cd4738b718aa610e618606` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:50.939319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=261f7a4064cd4738b718aa610e618606)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:50.940585 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:07:50.940585 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:07:50.940585 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:07:50.941841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:50.952776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:51.016369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '261f7a4064cd4738b718aa610e618606'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:07:51.031891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '261f7a4064cd4738b718aa610e618606'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:07:51.060840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '261f7a4064cd4738b718aa610e618606'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:07:51.072299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '261f7a4064cd4738b718aa610e618606'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:07:51.072741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '261f7a4064cd4738b718aa610e618606'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:07:51.078638 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 744/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:07:50 2022] DELETE /identity/v3/users/261f7a4064cd4738b718aa610e618606 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:07:51.083511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa1408-1007-4b44-b0fc-a149691dfd56 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:51.083796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa1408-1007-4b44-b0fc-a149691dfd56 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:51.084099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa1408-1007-4b44-b0fc-a149691dfd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:51.143053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-51aa1408-1007-4b44-b0fc-a149691dfd56 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:07:51.144272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51aa1408-1007-4b44-b0fc-a149691dfd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:51.220896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:51.233703 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 764/1508] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:07:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:07:51.243997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:51.245255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:51.353495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6755536-e7c0-4de8-ad07-2221cab841ae admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:51.410636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:07:51.431027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3da4b-2249-4c69-80b0-b952d8d32a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:51.431648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3da4b-2249-4c69-80b0-b952d8d32a54 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:51.431921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3da4b-2249-4c69-80b0-b952d8d32a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:51.432214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3da4b-2249-4c69-80b0-b952d8d32a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:51.433787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-62e3da4b-2249-4c69-80b0-b952d8d32a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:51.546825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3da4b-2249-4c69-80b0-b952d8d32a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:51.548288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3da4b-2249-4c69-80b0-b952d8d32a54 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:51.567680 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 745/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:07:51.934828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa1408-1007-4b44-b0fc-a149691dfd56 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:07:51.936085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51aa1408-1007-4b44-b0fc-a149691dfd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:07:51.948324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa1408-1007-4b44-b0fc-a149691dfd56 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:07:52.051980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:07:52.052586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:07:52.052919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:07:52.053092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] PATH_INFO: `/v3/projects/b3ed916216584eadb2c887ca9f42eb25` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:07:52.063625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ed916216584eadb2c887ca9f42eb25)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:07:52.064790 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:07:52.064790 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:07:52.064790 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:07:52.066061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:07:52.126288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ed916216584eadb2c887ca9f42eb25', 'request_id': 'req-8d885575-52f8-44bb-bd35-b7d5e13b84f9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:07:52.140288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ed916216584eadb2c887ca9f42eb25', 'request_id': 'req-8d885575-52f8-44bb-bd35-b7d5e13b84f9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:07:52.151851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ed916216584eadb2c887ca9f42eb25', 'request_id': 'req-8d885575-52f8-44bb-bd35-b7d5e13b84f9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:07:52.175522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] The token cache is being invalidate because project b3ed916216584eadb2c887ca9f42eb25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:07:52.175807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:07:52.176344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d885575-52f8-44bb-bd35-b7d5e13b84f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:07:52.177683 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 765/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:07:51 2022] DELETE /identity/v3/projects/b3ed916216584eadb2c887ca9f42eb25 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:08:01.564957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=62 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:02.173401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:23.766561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f34e6-8a86-4114-9cb0-8d39dfa1b7fa None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:23.767239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f34e6-8a86-4114-9cb0-8d39dfa1b7fa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:23.767239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f34e6-8a86-4114-9cb0-8d39dfa1b7fa None None] PATH_INFO: `/v3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:23.768531 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 746/1511] 10.222.0.45 () {54 vars in 925 bytes} [Tue Aug 30 04:11:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:11:23.775580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18947ba-b90a-4279-b436-df1ace7743df None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:23.776038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18947ba-b90a-4279-b436-df1ace7743df None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:23.776145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18947ba-b90a-4279-b436-df1ace7743df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:23.864304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f18947ba-b90a-4279-b436-df1ace7743df None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:23.865707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f18947ba-b90a-4279-b436-df1ace7743df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:24.000547 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 766/1512] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Aug 30 04:11:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:26.525076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36400f97-c032-4145-a386-fcbfcc260763 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:26.525696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36400f97-c032-4145-a386-fcbfcc260763 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:26.525696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36400f97-c032-4145-a386-fcbfcc260763 None None] PATH_INFO: `/v3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:26.527251 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 747/1513] 10.222.0.65 () {54 vars in 925 bytes} [Tue Aug 30 04:11:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:11:26.541644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdd8fe-706a-4ed5-a083-3b3020978b1a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:26.542134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdd8fe-706a-4ed5-a083-3b3020978b1a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:26.542239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdd8fe-706a-4ed5-a083-3b3020978b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:26.565307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f1bdd8fe-706a-4ed5-a083-3b3020978b1a None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:26.566703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f1bdd8fe-706a-4ed5-a083-3b3020978b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:26.576577 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 767/1514] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 30 04:11:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:33.000611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9526a-e51d-41c0-a807-f2e3909ebfb9 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:33.001215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9526a-e51d-41c0-a807-f2e3909ebfb9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:33.001215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9526a-e51d-41c0-a807-f2e3909ebfb9 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:33.002418 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 748/1515] 10.222.0.43 () {54 vars in 961 bytes} [Tue Aug 30 04:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:33.008653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f51b3b-bac1-4921-9bec-18ae1b5e7c90 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:33.009174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f51b3b-bac1-4921-9bec-18ae1b5e7c90 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:33.009174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f51b3b-bac1-4921-9bec-18ae1b5e7c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:33.039685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a6f51b3b-bac1-4921-9bec-18ae1b5e7c90 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:33.041495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a6f51b3b-bac1-4921-9bec-18ae1b5e7c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:33.053343 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 768/1516] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Aug 30 04:11:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:33.061278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9526a-e51d-41c0-a807-f2e3909ebfb9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:33.077711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9526a-e51d-41c0-a807-f2e3909ebfb9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:33.083241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488b03e-3e97-4e0b-ba8c-dc4ad5ad81d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:33.083834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488b03e-3e97-4e0b-ba8c-dc4ad5ad81d5 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:33.084109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488b03e-3e97-4e0b-ba8c-dc4ad5ad81d5 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:33.084403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488b03e-3e97-4e0b-ba8c-dc4ad5ad81d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:33.093247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488b03e-3e97-4e0b-ba8c-dc4ad5ad81d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:33.094887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488b03e-3e97-4e0b-ba8c-dc4ad5ad81d5 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:33.104771 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 749/1517] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:35.230985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f51b3b-bac1-4921-9bec-18ae1b5e7c90 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:35.241563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f51b3b-bac1-4921-9bec-18ae1b5e7c90 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:35.249381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10635512-9747-4982-9903-7950a9e45b5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:35.250040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10635512-9747-4982-9903-7950a9e45b5c service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:35.250315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10635512-9747-4982-9903-7950a9e45b5c service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:35.250581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10635512-9747-4982-9903-7950a9e45b5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:35.260106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10635512-9747-4982-9903-7950a9e45b5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:35.261750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10635512-9747-4982-9903-7950a9e45b5c service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:35.272173 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 769/1518] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:43.100623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:45.267777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:52.086958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1c255-4472-437e-91f4-5204a9d08880 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:52.087785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1c255-4472-437e-91f4-5204a9d08880 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:52.087785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1c255-4472-437e-91f4-5204a9d08880 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:52.088902 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 750/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:11:52.094585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8e10-c9f5-4c26-81ca-9b82c055191b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:52.095323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8e10-c9f5-4c26-81ca-9b82c055191b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:52.095323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad8e10-c9f5-4c26-81ca-9b82c055191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:52.169460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-88ad8e10-c9f5-4c26-81ca-9b82c055191b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:52.170618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-88ad8e10-c9f5-4c26-81ca-9b82c055191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:52.260734 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 770/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:52.425777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1c255-4472-437e-91f4-5204a9d08880 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:52.427594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-caf1c255-4472-437e-91f4-5204a9d08880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:52.547792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1c255-4472-437e-91f4-5204a9d08880 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:52.554096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dc24b-0507-46e9-93fc-bbb0d260e802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:52.554793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc24b-0507-46e9-93fc-bbb0d260e802 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:52.555293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc24b-0507-46e9-93fc-bbb0d260e802 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:52.555576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dc24b-0507-46e9-93fc-bbb0d260e802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:52.566320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dc24b-0507-46e9-93fc-bbb0d260e802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:52.568323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dc24b-0507-46e9-93fc-bbb0d260e802 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:52.581243 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 751/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:53.458783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417687-0a7a-48a9-8401-a9647f5f4ef1 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:53.459643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417687-0a7a-48a9-8401-a9647f5f4ef1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:53.459643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2417687-0a7a-48a9-8401-a9647f5f4ef1 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:53.461490 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 04:11:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:53.467157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f7b15-e042-40d3-89ff-6d7c8badb04a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:53.467814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f7b15-e042-40d3-89ff-6d7c8badb04a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:53.467814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f7b15-e042-40d3-89ff-6d7c8badb04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:53.491080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b70f7b15-e042-40d3-89ff-6d7c8badb04a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:53.492451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b70f7b15-e042-40d3-89ff-6d7c8badb04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:53.502375 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 04:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:53.665456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2417687-0a7a-48a9-8401-a9647f5f4ef1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:53.688952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2417687-0a7a-48a9-8401-a9647f5f4ef1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:53.698006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798c75a-21f4-4f37-86a6-e67a97bbaa91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:53.698995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798c75a-21f4-4f37-86a6-e67a97bbaa91 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:53.699442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798c75a-21f4-4f37-86a6-e67a97bbaa91 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:53.699879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798c75a-21f4-4f37-86a6-e67a97bbaa91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:53.714403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798c75a-21f4-4f37-86a6-e67a97bbaa91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:53.717179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798c75a-21f4-4f37-86a6-e67a97bbaa91 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:53.733057 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 772/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:57.905673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4cb5e-f726-4732-82c7-18049ddf3bda None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:57.906326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4cb5e-f726-4732-82c7-18049ddf3bda None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:57.906326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4cb5e-f726-4732-82c7-18049ddf3bda None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:57.907404 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:11:57.913315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ff1b8-9810-4f54-af2c-cf294673b7be None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:57.914203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ff1b8-9810-4f54-af2c-cf294673b7be None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:57.915286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ff1b8-9810-4f54-af2c-cf294673b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:57.938557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8c3ff1b8-9810-4f54-af2c-cf294673b7be None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:11:57.939783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8c3ff1b8-9810-4f54-af2c-cf294673b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:57.948697 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:11:58.235132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4cb5e-f726-4732-82c7-18049ddf3bda None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:11:58.237056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d5e4cb5e-f726-4732-82c7-18049ddf3bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:11:58.326134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4cb5e-f726-4732-82c7-18049ddf3bda None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:11:58.330172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6e856-373e-45d5-b675-584fc9d24793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:11:58.330849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6e856-373e-45d5-b675-584fc9d24793 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:11:58.331166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6e856-373e-45d5-b675-584fc9d24793 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:11:58.331475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6e856-373e-45d5-b675-584fc9d24793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:11:58.341863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6e856-373e-45d5-b675-584fc9d24793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:11:58.343369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6e856-373e-45d5-b675-584fc9d24793 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:11:58.353848 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 754/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:11:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:12:00.469367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae77ad-4c50-4df9-a4fb-e942df819ae5 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:00.470026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae77ad-4c50-4df9-a4fb-e942df819ae5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:00.470026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae77ad-4c50-4df9-a4fb-e942df819ae5 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:00.471299 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 04:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:12:00.477264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5764-36c2-4699-8f73-691919f8290f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:00.477779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5764-36c2-4699-8f73-691919f8290f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:00.477908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5764-36c2-4699-8f73-691919f8290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:00.499722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-558e5764-36c2-4699-8f73-691919f8290f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:00.500960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-558e5764-36c2-4699-8f73-691919f8290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:00.509764 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 04:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:12:00.795276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae77ad-4c50-4df9-a4fb-e942df819ae5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:12:00.797318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c8ae77ad-4c50-4df9-a4fb-e942df819ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:00.812036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae77ad-4c50-4df9-a4fb-e942df819ae5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:12:00.815751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b12054-6cc1-446a-94fe-34728b261b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:12:00.816363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b12054-6cc1-446a-94fe-34728b261b39 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:00.816633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b12054-6cc1-446a-94fe-34728b261b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:00.816894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b12054-6cc1-446a-94fe-34728b261b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:00.827012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b12054-6cc1-446a-94fe-34728b261b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:12:00.828552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b12054-6cc1-446a-94fe-34728b261b39 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:12:00.842325 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 775/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:12:10.494287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:10.837328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=65 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:52.067145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e1d1e-e1b6-4bf9-9f49-ac795239166e None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:52.067784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e1d1e-e1b6-4bf9-9f49-ac795239166e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:52.067784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e1d1e-e1b6-4bf9-9f49-ac795239166e None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:52.070252 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 756/1531] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:12:52.076018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b2714-3739-4f0c-98c7-63683fbf2268 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:12:52.076545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b2714-3739-4f0c-98c7-63683fbf2268 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:12:52.076631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b2714-3739-4f0c-98c7-63683fbf2268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:12:52.098984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-166b2714-3739-4f0c-98c7-63683fbf2268 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:12:52.100377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-166b2714-3739-4f0c-98c7-63683fbf2268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:12:52.109601 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 776/1532] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:12:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:02.093268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:25.886450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706dba3-470f-46e6-afca-2ecf9e6d6f2c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:25.887508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706dba3-470f-46e6-afca-2ecf9e6d6f2c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:25.888027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706dba3-470f-46e6-afca-2ecf9e6d6f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:25.899634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395931c-7ffb-4b55-bc27-580d0852c6f4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:25.900539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395931c-7ffb-4b55-bc27-580d0852c6f4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:25.900951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395931c-7ffb-4b55-bc27-580d0852c6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:25.916836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0706dba3-470f-46e6-afca-2ecf9e6d6f2c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:25.918434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0706dba3-470f-46e6-afca-2ecf9e6d6f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:25.933725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0395931c-7ffb-4b55-bc27-580d0852c6f4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:25.935231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0395931c-7ffb-4b55-bc27-580d0852c6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:25.939980 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 757/1533] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:25.941457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1707ca-a4cf-4965-91a3-2103ee11b813 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:25.941899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1707ca-a4cf-4965-91a3-2103ee11b813 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:25.942387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1707ca-a4cf-4965-91a3-2103ee11b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:25.951632 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 777/1534] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:13:25.953152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02165e4-5bcc-4632-b5e2-226c6276a13d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:25.953439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02165e4-5bcc-4632-b5e2-226c6276a13d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:25.953794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02165e4-5bcc-4632-b5e2-226c6276a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:25.986346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7f1707ca-a4cf-4965-91a3-2103ee11b813 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:25.988109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7f1707ca-a4cf-4965-91a3-2103ee11b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:25.989807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b02165e4-5bcc-4632-b5e2-226c6276a13d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:25.992788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b02165e4-5bcc-4632-b5e2-226c6276a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:26.002452 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 758/1535] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:26.004032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a58d-66d0-46d7-bda4-0dae78071f62 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.004515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a58d-66d0-46d7-bda4-0dae78071f62 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.004784 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 778/1536] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:26.005216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a58d-66d0-46d7-bda4-0dae78071f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.015501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02165e4-5bcc-4632-b5e2-226c6276a13d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.032467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02165e4-5bcc-4632-b5e2-226c6276a13d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.045918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2626c4-94d5-4da2-be37-98d017ad2c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.045918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2626c4-94d5-4da2-be37-98d017ad2c79 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.045918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2626c4-94d5-4da2-be37-98d017ad2c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.045918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2626c4-94d5-4da2-be37-98d017ad2c79 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.046405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2626c4-94d5-4da2-be37-98d017ad2c79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:26.046405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2626c4-94d5-4da2-be37-98d017ad2c79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.047458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2626c4-94d5-4da2-be37-98d017ad2c79 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.048542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b3f2a58d-66d0-46d7-bda4-0dae78071f62 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:26.050246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b3f2a58d-66d0-46d7-bda4-0dae78071f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:26.068276 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 759/1537] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:26.069864 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 779/1538] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:26.070467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74a7c6-57dd-4eb0-bcee-3192a8d8e2e4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.070943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74a7c6-57dd-4eb0-bcee-3192a8d8e2e4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.071411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74a7c6-57dd-4eb0-bcee-3192a8d8e2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.074489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2626c4-94d5-4da2-be37-98d017ad2c79 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.094518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2626c4-94d5-4da2-be37-98d017ad2c79 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.104099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7889ee8-4653-42f0-8e94-4254fcca988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.104733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889ee8-4653-42f0-8e94-4254fcca988c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.105015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889ee8-4653-42f0-8e94-4254fcca988c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.105314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7889ee8-4653-42f0-8e94-4254fcca988c admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.105760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ff74a7c6-57dd-4eb0-bcee-3192a8d8e2e4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:26.105961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7889ee8-4653-42f0-8e94-4254fcca988c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:26.106291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7889ee8-4653-42f0-8e94-4254fcca988c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.107380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ff74a7c6-57dd-4eb0-bcee-3192a8d8e2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:26.107933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7889ee8-4653-42f0-8e94-4254fcca988c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.119748 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 760/1539] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:26.120794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74a7c6-57dd-4eb0-bcee-3192a8d8e2e4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.131749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74a7c6-57dd-4eb0-bcee-3192a8d8e2e4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.132020 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 780/1540] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:26.132636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7889ee8-4653-42f0-8e94-4254fcca988c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.141661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0033b-f8e4-453a-b500-4fa112b42667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.142492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0033b-f8e4-453a-b500-4fa112b42667 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.142915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0033b-f8e4-453a-b500-4fa112b42667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.143275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0033b-f8e4-453a-b500-4fa112b42667 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.144020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0033b-f8e4-453a-b500-4fa112b42667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.146157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0033b-f8e4-453a-b500-4fa112b42667 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.148905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7889ee8-4653-42f0-8e94-4254fcca988c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.169389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72768e70-833e-4c22-a872-21ec07a5cd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.169961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72768e70-833e-4c22-a872-21ec07a5cd2a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.170240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72768e70-833e-4c22-a872-21ec07a5cd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.170510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72768e70-833e-4c22-a872-21ec07a5cd2a admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.171227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72768e70-833e-4c22-a872-21ec07a5cd2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:26.171529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72768e70-833e-4c22-a872-21ec07a5cd2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.173219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72768e70-833e-4c22-a872-21ec07a5cd2a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.209452 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 781/1541] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:26.210804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d181-3544-4bf6-88bc-472d064ea48e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.211087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d181-3544-4bf6-88bc-472d064ea48e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.211355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d181-3544-4bf6-88bc-472d064ea48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.258393 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 761/1542] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:26.263120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0033b-f8e4-453a-b500-4fa112b42667 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.264859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a238d181-3544-4bf6-88bc-472d064ea48e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:26.266127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a238d181-3544-4bf6-88bc-472d064ea48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:26.424589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0033b-f8e4-453a-b500-4fa112b42667 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.438296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539309c-9328-49db-ac99-b6cea71d181e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.438935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539309c-9328-49db-ac99-b6cea71d181e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.439220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539309c-9328-49db-ac99-b6cea71d181e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.439480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539309c-9328-49db-ac99-b6cea71d181e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.440141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539309c-9328-49db-ac99-b6cea71d181e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.445753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539309c-9328-49db-ac99-b6cea71d181e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.448483 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 782/1543] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:26.449449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238d181-3544-4bf6-88bc-472d064ea48e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.469559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238d181-3544-4bf6-88bc-472d064ea48e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.482170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c800aba-5866-4c4c-97e4-4e574cd6e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.483432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c800aba-5866-4c4c-97e4-4e574cd6e5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.483969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c800aba-5866-4c4c-97e4-4e574cd6e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.484365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c800aba-5866-4c4c-97e4-4e574cd6e5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.485037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c800aba-5866-4c4c-97e4-4e574cd6e5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.486284 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-7c800aba-5866-4c4c-97e4-4e574cd6e5e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:13:26.486284 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:13:26.486284 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:13:26.487492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c800aba-5866-4c4c-97e4-4e574cd6e5e2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.519759 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 762/1544] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/projects => generated 387 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:26.520327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539309c-9328-49db-ac99-b6cea71d181e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.566591 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 783/1545] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:26.568183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b6c8-c283-4a83-a0e6-e507cc1eb37c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.568470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b6c8-c283-4a83-a0e6-e507cc1eb37c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.570564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166b6c8-c283-4a83-a0e6-e507cc1eb37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.617697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f166b6c8-c283-4a83-a0e6-e507cc1eb37c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:26.618974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f166b6c8-c283-4a83-a0e6-e507cc1eb37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:26.669364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539309c-9328-49db-ac99-b6cea71d181e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.727199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:26.758270 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 784/1546] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:26.758270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fafdd0-c0ab-47bd-af50-d49de44c5848 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.758270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fafdd0-c0ab-47bd-af50-d49de44c5848 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.758270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fafdd0-c0ab-47bd-af50-d49de44c5848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.774169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c0204-fa38-4577-ba4f-01a6774541cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.780009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c0204-fa38-4577-ba4f-01a6774541cd admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.780009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c0204-fa38-4577-ba4f-01a6774541cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.780009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c0204-fa38-4577-ba4f-01a6774541cd admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.780009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c0204-fa38-4577-ba4f-01a6774541cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.780009 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-bf3c0204-fa38-4577-ba4f-01a6774541cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:13:26.780009 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:13:26.780009 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:13:26.780921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c0204-fa38-4577-ba4f-01a6774541cd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.788939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-87fafdd0-c0ab-47bd-af50-d49de44c5848 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:26.790825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-87fafdd0-c0ab-47bd-af50-d49de44c5848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:26.800045 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 785/1547] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:26.801089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fafdd0-c0ab-47bd-af50-d49de44c5848 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.812315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fafdd0-c0ab-47bd-af50-d49de44c5848 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.813929 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 763/1548] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/users => generated 292 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:26.815424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c0204-fa38-4577-ba4f-01a6774541cd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.817229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd03b1-9fe5-472d-8abc-25d80d24afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.817973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd03b1-9fe5-472d-8abc-25d80d24afd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.818565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd03b1-9fe5-472d-8abc-25d80d24afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.818759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd03b1-9fe5-472d-8abc-25d80d24afd0 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.819512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd03b1-9fe5-472d-8abc-25d80d24afd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.821547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd03b1-9fe5-472d-8abc-25d80d24afd0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.828623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c0204-fa38-4577-ba4f-01a6774541cd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.835283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20c957-b595-48f1-b542-84f8865c46c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.836021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20c957-b595-48f1-b542-84f8865c46c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.836405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20c957-b595-48f1-b542-84f8865c46c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.836723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20c957-b595-48f1-b542-84f8865c46c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.837525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20c957-b595-48f1-b542-84f8865c46c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.839706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20c957-b595-48f1-b542-84f8865c46c9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.855307 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 786/1549] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/users => generated 294 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:26.856923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a013de-d786-4ef7-84ae-6c27e476cd72 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.857271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a013de-d786-4ef7-84ae-6c27e476cd72 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.857624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a013de-d786-4ef7-84ae-6c27e476cd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.867486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:26.872240 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 764/1550] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/users => generated 292 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:26.875139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350c17c-80e6-4c82-b30d-b5713c6ae821 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.875139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350c17c-80e6-4c82-b30d-b5713c6ae821 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.875139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350c17c-80e6-4c82-b30d-b5713c6ae821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.883930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e0a013de-d786-4ef7-84ae-6c27e476cd72 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:26.885367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e0a013de-d786-4ef7-84ae-6c27e476cd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:26.894490 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 787/1551] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:26.897857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a39ca-d357-4669-92d8-a9dcfc7d93ce None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.898249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a39ca-d357-4669-92d8-a9dcfc7d93ce None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.898966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a39ca-d357-4669-92d8-a9dcfc7d93ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.903659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4350c17c-80e6-4c82-b30d-b5713c6ae821 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:26.905543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4350c17c-80e6-4c82-b30d-b5713c6ae821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:26.920049 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 765/1552] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:26.923548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ae3a39ca-d357-4669-92d8-a9dcfc7d93ce None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:26.924827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ae3a39ca-d357-4669-92d8-a9dcfc7d93ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:26.929272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350c17c-80e6-4c82-b30d-b5713c6ae821 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.933736 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 788/1553] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:26.934650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a39ca-d357-4669-92d8-a9dcfc7d93ce None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.943552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350c17c-80e6-4c82-b30d-b5713c6ae821 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.947782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a39ca-d357-4669-92d8-a9dcfc7d93ce None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.949043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c050af3-b544-4d12-90a7-c134f1f46f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.949701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c050af3-b544-4d12-90a7-c134f1f46f04 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.950078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c050af3-b544-4d12-90a7-c134f1f46f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.950349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c050af3-b544-4d12-90a7-c134f1f46f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.951033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c050af3-b544-4d12-90a7-c134f1f46f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:26.951383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c050af3-b544-4d12-90a7-c134f1f46f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.952428 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-4c050af3-b544-4d12-90a7-c134f1f46f04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:13:26.952428 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:13:26.952428 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:13:26.953331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c050af3-b544-4d12-90a7-c134f1f46f04 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.954039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599b2d4-781a-4792-9e2d-27439bcc313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.954740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599b2d4-781a-4792-9e2d-27439bcc313d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.955414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599b2d4-781a-4792-9e2d-27439bcc313d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.955746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599b2d4-781a-4792-9e2d-27439bcc313d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.957162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599b2d4-781a-4792-9e2d-27439bcc313d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.959420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599b2d4-781a-4792-9e2d-27439bcc313d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.968254 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 766/1554] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:26.969631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c050af3-b544-4d12-90a7-c134f1f46f04 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.974208 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 789/1555] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:26.974208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599b2d4-781a-4792-9e2d-27439bcc313d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:26.985557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c050af3-b544-4d12-90a7-c134f1f46f04 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.986121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599b2d4-781a-4792-9e2d-27439bcc313d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:26.990883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf11274-c0d2-478f-b3c5-322027350544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.991448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c99f0-6e65-42df-8849-5232839ad848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:26.991562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11274-c0d2-478f-b3c5-322027350544 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.991789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11274-c0d2-478f-b3c5-322027350544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.992060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf11274-c0d2-478f-b3c5-322027350544 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.992263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c99f0-6e65-42df-8849-5232839ad848 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:26.992599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c99f0-6e65-42df-8849-5232839ad848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:26.992728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11274-c0d2-478f-b3c5-322027350544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.992977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c99f0-6e65-42df-8849-5232839ad848 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:26.993959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c99f0-6e65-42df-8849-5232839ad848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:26.994451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf11274-c0d2-478f-b3c5-322027350544 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:26.995697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c99f0-6e65-42df-8849-5232839ad848 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.009280 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 767/1556] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:27.009280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5ce39-0401-47d4-91b6-304e284976b2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.009280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5ce39-0401-47d4-91b6-304e284976b2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.009280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5ce39-0401-47d4-91b6-304e284976b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.010038 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 790/1557] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:27.011387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfb8d8-222e-465b-b910-d67330182788 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.011669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfb8d8-222e-465b-b910-d67330182788 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.011936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfb8d8-222e-465b-b910-d67330182788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.033155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6bdfb8d8-222e-465b-b910-d67330182788 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:27.034443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6bdfb8d8-222e-465b-b910-d67330182788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:27.034959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5ee5ce39-0401-47d4-91b6-304e284976b2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:27.036261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5ee5ce39-0401-47d4-91b6-304e284976b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:27.043093 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 791/1558] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:27.043729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfb8d8-222e-465b-b910-d67330182788 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.048532 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 768/1559] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:27.049514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5ce39-0401-47d4-91b6-304e284976b2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.058024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfb8d8-222e-465b-b910-d67330182788 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.059691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5ce39-0401-47d4-91b6-304e284976b2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.062868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f4820-7de7-4266-bb2a-b00d7a99d615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.063600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f4820-7de7-4266-bb2a-b00d7a99d615 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.063810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f4820-7de7-4266-bb2a-b00d7a99d615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.064042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f4820-7de7-4266-bb2a-b00d7a99d615 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.064397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c78b-b045-4891-a1c2-5258db105208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.064869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f4820-7de7-4266-bb2a-b00d7a99d615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:27.065044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c78b-b045-4891-a1c2-5258db105208 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.065208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f4820-7de7-4266-bb2a-b00d7a99d615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.065299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c78b-b045-4891-a1c2-5258db105208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.065529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062c78b-b045-4891-a1c2-5258db105208 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.066217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062c78b-b045-4891-a1c2-5258db105208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.066856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f4820-7de7-4266-bb2a-b00d7a99d615 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.068934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062c78b-b045-4891-a1c2-5258db105208 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.080220 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 769/1560] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:27.081176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c78b-b045-4891-a1c2-5258db105208 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.084669 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 792/1561] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:27.086185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f4820-7de7-4266-bb2a-b00d7a99d615 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.092148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062c78b-b045-4891-a1c2-5258db105208 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.097436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643edb9-d1b4-4adc-8892-6722e80dc2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.098064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643edb9-d1b4-4adc-8892-6722e80dc2ed admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.098339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643edb9-d1b4-4adc-8892-6722e80dc2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.098823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643edb9-d1b4-4adc-8892-6722e80dc2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.099805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643edb9-d1b4-4adc-8892-6722e80dc2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.101794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643edb9-d1b4-4adc-8892-6722e80dc2ed admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.103608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f4820-7de7-4266-bb2a-b00d7a99d615 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.109649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b55da-fa0f-430c-9567-393d93c0b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.110687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b55da-fa0f-430c-9567-393d93c0b0ae admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.111110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b55da-fa0f-430c-9567-393d93c0b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.111906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b55da-fa0f-430c-9567-393d93c0b0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.113489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b55da-fa0f-430c-9567-393d93c0b0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.120896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b55da-fa0f-430c-9567-393d93c0b0ae admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.139583 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 770/1562] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:27 2022] POST /identity/v3/projects => generated 401 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:27.139583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643edb9-d1b4-4adc-8892-6722e80dc2ed admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.147898 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 793/1563] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:27.154949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b55da-fa0f-430c-9567-393d93c0b0ae admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.176831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b55da-fa0f-430c-9567-393d93c0b0ae admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.231176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643edb9-d1b4-4adc-8892-6722e80dc2ed admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.238237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5afc0b-d4c5-4519-abd8-f9bc3e05efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.240021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5afc0b-d4c5-4519-abd8-f9bc3e05efc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.240463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5afc0b-d4c5-4519-abd8-f9bc3e05efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.240914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5afc0b-d4c5-4519-abd8-f9bc3e05efc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.242078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5afc0b-d4c5-4519-abd8-f9bc3e05efc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.246292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5afc0b-d4c5-4519-abd8-f9bc3e05efc0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.265749 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 771/1564] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:27.267692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5afc0b-d4c5-4519-abd8-f9bc3e05efc0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.268165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a6ae5-6a09-4b87-80b0-41c64cb111f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.269309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a6ae5-6a09-4b87-80b0-41c64cb111f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.269732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a6ae5-6a09-4b87-80b0-41c64cb111f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.270186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a6ae5-6a09-4b87-80b0-41c64cb111f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.271247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a6ae5-6a09-4b87-80b0-41c64cb111f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:27.271784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a6ae5-6a09-4b87-80b0-41c64cb111f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.275193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a6ae5-6a09-4b87-80b0-41c64cb111f6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.289282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5afc0b-d4c5-4519-abd8-f9bc3e05efc0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.289494 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 794/1565] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:27.290289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a6ae5-6a09-4b87-80b0-41c64cb111f6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.305267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a6ae5-6a09-4b87-80b0-41c64cb111f6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.309815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3da50e-9bc2-4846-ba65-1abced0eb745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.310055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbea9a-5cc1-4662-85fb-2074e9bc9ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.310629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbea9a-5cc1-4662-85fb-2074e9bc9ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.311365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da50e-9bc2-4846-ba65-1abced0eb745 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.311475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbea9a-5cc1-4662-85fb-2074e9bc9ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.311475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbbea9a-5cc1-4662-85fb-2074e9bc9ce5 admin admin] PATH_INFO: `/v3/projects/fd51e4a716bb44b68c77943d18db0bb9/users/b1cc2024e2144a6ea0011bc5bd8c1b7a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.311604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da50e-9bc2-4846-ba65-1abced0eb745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.311976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3da50e-9bc2-4846-ba65-1abced0eb745 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.313134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3da50e-9bc2-4846-ba65-1abced0eb745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:27.313860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3da50e-9bc2-4846-ba65-1abced0eb745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.318169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3da50e-9bc2-4846-ba65-1abced0eb745 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.330438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbea9a-5cc1-4662-85fb-2074e9bc9ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd51e4a716bb44b68c77943d18db0bb9, user_id=b1cc2024e2144a6ea0011bc5bd8c1b7a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.332725 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-ccbbea9a-5cc1-4662-85fb-2074e9bc9ce5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:13:27.332725 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:13:27.332725 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:13:27.337431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbbea9a-5cc1-4662-85fb-2074e9bc9ce5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.340904 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 772/1566] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:27.342199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3da50e-9bc2-4846-ba65-1abced0eb745 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.375029 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 795/1567] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:27 2022] PUT /identity/v3/projects/fd51e4a716bb44b68c77943d18db0bb9/users/b1cc2024e2144a6ea0011bc5bd8c1b7a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:27.375029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbea9a-5cc1-4662-85fb-2074e9bc9ce5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.375362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3da50e-9bc2-4846-ba65-1abced0eb745 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.405864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:27.458704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbbea9a-5cc1-4662-85fb-2074e9bc9ce5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.464911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77c92a-4109-47f7-a9b6-84aa5b64790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.465617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77c92a-4109-47f7-a9b6-84aa5b64790c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.466076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77c92a-4109-47f7-a9b6-84aa5b64790c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.466668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77c92a-4109-47f7-a9b6-84aa5b64790c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.467447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77c92a-4109-47f7-a9b6-84aa5b64790c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.469770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77c92a-4109-47f7-a9b6-84aa5b64790c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.482827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:27.483065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c8241-a619-4f8a-87ab-9f055fe2b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.484019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8241-a619-4f8a-87ab-9f055fe2b8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.484437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8241-a619-4f8a-87ab-9f055fe2b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.485020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8241-a619-4f8a-87ab-9f055fe2b8b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.486356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c8241-a619-4f8a-87ab-9f055fe2b8b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.490429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c8241-a619-4f8a-87ab-9f055fe2b8b9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.499478 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 796/1568] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:27 2022] POST /identity/v3/users => generated 301 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:27.500874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77c92a-4109-47f7-a9b6-84aa5b64790c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.515804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77c92a-4109-47f7-a9b6-84aa5b64790c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.524511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe9398-04ae-474c-8a5e-d4e33a9e0c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.525755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe9398-04ae-474c-8a5e-d4e33a9e0c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.526267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe9398-04ae-474c-8a5e-d4e33a9e0c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.526747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe9398-04ae-474c-8a5e-d4e33a9e0c87 admin admin] PATH_INFO: `/v3/projects/abaa814437884995aeb3a6e4fa2b469e/users/be1893eab33f40b99b220a59e4db398c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.535098 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 773/1569] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:27 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:27.537037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f37fb2-f3a3-47e3-9227-53f394d77f4e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.537539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f37fb2-f3a3-47e3-9227-53f394d77f4e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.537912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f37fb2-f3a3-47e3-9227-53f394d77f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.551450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe9398-04ae-474c-8a5e-d4e33a9e0c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abaa814437884995aeb3a6e4fa2b469e, user_id=be1893eab33f40b99b220a59e4db398c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.555805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe9398-04ae-474c-8a5e-d4e33a9e0c87 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.559947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b1f37fb2-f3a3-47e3-9227-53f394d77f4e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:27.561268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b1f37fb2-f3a3-47e3-9227-53f394d77f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:27.575728 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 797/1570] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:27 2022] PUT /identity/v3/projects/abaa814437884995aeb3a6e4fa2b469e/users/be1893eab33f40b99b220a59e4db398c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:27.576593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe9398-04ae-474c-8a5e-d4e33a9e0c87 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.650193 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 774/1571] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:27.651166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f37fb2-f3a3-47e3-9227-53f394d77f4e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.662074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f37fb2-f3a3-47e3-9227-53f394d77f4e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.678499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe9398-04ae-474c-8a5e-d4e33a9e0c87 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.685198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d8630-4f04-463c-9a62-2c81c41be9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.686117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d8630-4f04-463c-9a62-2c81c41be9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.686450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d8630-4f04-463c-9a62-2c81c41be9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.686776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d8630-4f04-463c-9a62-2c81c41be9ed admin admin] PATH_INFO: `/v3/projects/474e31261af4485097c80c8c9aac4c3d/users/790e08814cd643e5a1da5173a8301207/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.708367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d8630-4f04-463c-9a62-2c81c41be9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=474e31261af4485097c80c8c9aac4c3d, user_id=790e08814cd643e5a1da5173a8301207, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.714006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d8630-4f04-463c-9a62-2c81c41be9ed admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.732698 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 798/1572] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:27 2022] PUT /identity/v3/projects/474e31261af4485097c80c8c9aac4c3d/users/790e08814cd643e5a1da5173a8301207/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:27.733625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d8630-4f04-463c-9a62-2c81c41be9ed admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:27.750562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13dcd4-e0c1-4d50-82a2-b21343fe893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.752444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13dcd4-e0c1-4d50-82a2-b21343fe893e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.752910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13dcd4-e0c1-4d50-82a2-b21343fe893e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.753373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13dcd4-e0c1-4d50-82a2-b21343fe893e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.754624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13dcd4-e0c1-4d50-82a2-b21343fe893e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.759842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13dcd4-e0c1-4d50-82a2-b21343fe893e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.815708 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 775/1573] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:27 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:27.818351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4a92-1ec4-4fed-a9db-9e63d694b70d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.819150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4a92-1ec4-4fed-a9db-9e63d694b70d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.819852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d4a92-1ec4-4fed-a9db-9e63d694b70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.839019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d8630-4f04-463c-9a62-2c81c41be9ed admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:27.865097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ba0d4a92-1ec4-4fed-a9db-9e63d694b70d None None] MFA Rules not processed for user `b1cc2024e2144a6ea0011bc5bd8c1b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:27.867242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ba0d4a92-1ec4-4fed-a9db-9e63d694b70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:27.903163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:27.943226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025b97-53c9-4f44-9889-e58af81a6e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:27.944334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025b97-53c9-4f44-9889-e58af81a6e2e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:27.944802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025b97-53c9-4f44-9889-e58af81a6e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:27.945253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025b97-53c9-4f44-9889-e58af81a6e2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:27.946429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025b97-53c9-4f44-9889-e58af81a6e2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:27.950229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025b97-53c9-4f44-9889-e58af81a6e2e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:27.959579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:27.983600 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 776/1574] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:27.984420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d4a92-1ec4-4fed-a9db-9e63d694b70d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.003653 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 799/1575] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:27 2022] POST /identity/v3/projects => generated 383 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:28.004639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025b97-53c9-4f44-9889-e58af81a6e2e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.008847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d4a92-1ec4-4fed-a9db-9e63d694b70d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.091161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b39e5-9713-4e0e-b81c-f86b253f270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.091965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b39e5-9713-4e0e-b81c-f86b253f270d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.092310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b39e5-9713-4e0e-b81c-f86b253f270d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.092627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025b97-53c9-4f44-9889-e58af81a6e2e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.092833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b39e5-9713-4e0e-b81c-f86b253f270d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.093718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b39e5-9713-4e0e-b81c-f86b253f270d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.096190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b39e5-9713-4e0e-b81c-f86b253f270d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.099507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a274a0-ab98-40ae-88eb-5e490f2e972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.100464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a274a0-ab98-40ae-88eb-5e490f2e972c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.100905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a274a0-ab98-40ae-88eb-5e490f2e972c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.101338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a274a0-ab98-40ae-88eb-5e490f2e972c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.102409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a274a0-ab98-40ae-88eb-5e490f2e972c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.105739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a274a0-ab98-40ae-88eb-5e490f2e972c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.111587 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 777/1576] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:28.113513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65df0b-b684-4c59-9e30-f563b46dfd10 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.113929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65df0b-b684-4c59-9e30-f563b46dfd10 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.114549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65df0b-b684-4c59-9e30-f563b46dfd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.135330 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 800/1577] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:28.137732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603620e1-8fdc-49e9-9b00-7a7a3eb6d1f2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.138234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603620e1-8fdc-49e9-9b00-7a7a3eb6d1f2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.138705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603620e1-8fdc-49e9-9b00-7a7a3eb6d1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.160625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ec65df0b-b684-4c59-9e30-f563b46dfd10 None None] MFA Rules not processed for user `be1893eab33f40b99b220a59e4db398c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:28.162247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ec65df0b-b684-4c59-9e30-f563b46dfd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:28.167671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-603620e1-8fdc-49e9-9b00-7a7a3eb6d1f2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:28.169634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-603620e1-8fdc-49e9-9b00-7a7a3eb6d1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:28.189180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 801/1578] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:28.189180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb818d2-4a57-4328-8194-6b4b6091258a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.189180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb818d2-4a57-4328-8194-6b4b6091258a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.189180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb818d2-4a57-4328-8194-6b4b6091258a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.223712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4fb818d2-4a57-4328-8194-6b4b6091258a None None] MFA Rules not processed for user `790e08814cd643e5a1da5173a8301207`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:28.225173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4fb818d2-4a57-4328-8194-6b4b6091258a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:28.263757 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 778/1579] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:28.265010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65df0b-b684-4c59-9e30-f563b46dfd10 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.283086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65df0b-b684-4c59-9e30-f563b46dfd10 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.289027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eb3bf-a0df-4d3d-9f2c-c9cb03b52f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.289799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eb3bf-a0df-4d3d-9f2c-c9cb03b52f42 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.290183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eb3bf-a0df-4d3d-9f2c-c9cb03b52f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.290517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eb3bf-a0df-4d3d-9f2c-c9cb03b52f42 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.291303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72eb3bf-a0df-4d3d-9f2c-c9cb03b52f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.293963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72eb3bf-a0df-4d3d-9f2c-c9cb03b52f42 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.325574 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 802/1580] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:28.326743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb818d2-4a57-4328-8194-6b4b6091258a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.327301 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 779/1581] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/users => generated 287 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:28.328535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eb3bf-a0df-4d3d-9f2c-c9cb03b52f42 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.343943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eb3bf-a0df-4d3d-9f2c-c9cb03b52f42 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.351699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00b709-007e-4864-8a72-8ad4ec79e499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.352634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00b709-007e-4864-8a72-8ad4ec79e499 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.352976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00b709-007e-4864-8a72-8ad4ec79e499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.353314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00b709-007e-4864-8a72-8ad4ec79e499 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.354266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00b709-007e-4864-8a72-8ad4ec79e499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.356479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00b709-007e-4864-8a72-8ad4ec79e499 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.384729 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 780/1582] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/users => generated 292 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:28.386295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00b709-007e-4864-8a72-8ad4ec79e499 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.403366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00b709-007e-4864-8a72-8ad4ec79e499 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.408830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce1c8-ee8d-41ef-ba52-605b9fc1b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.409745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce1c8-ee8d-41ef-ba52-605b9fc1b67a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.410207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce1c8-ee8d-41ef-ba52-605b9fc1b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.410609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ce1c8-ee8d-41ef-ba52-605b9fc1b67a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.411598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ce1c8-ee8d-41ef-ba52-605b9fc1b67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.412558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb818d2-4a57-4328-8194-6b4b6091258a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.413576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ce1c8-ee8d-41ef-ba52-605b9fc1b67a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.417175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b0878-881b-473f-84d5-f9ccd7d51189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.417958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0878-881b-473f-84d5-f9ccd7d51189 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.418310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0878-881b-473f-84d5-f9ccd7d51189 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.418637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b0878-881b-473f-84d5-f9ccd7d51189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.422306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:28.430005 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 781/1583] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:28.431540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce1c8-ee8d-41ef-ba52-605b9fc1b67a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.440107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:28.446436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ce1c8-ee8d-41ef-ba52-605b9fc1b67a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.453508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076a0cf-f7b3-4e27-8f79-5fcc4c10af28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.454438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076a0cf-f7b3-4e27-8f79-5fcc4c10af28 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.454941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076a0cf-f7b3-4e27-8f79-5fcc4c10af28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.455337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076a0cf-f7b3-4e27-8f79-5fcc4c10af28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.456179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076a0cf-f7b3-4e27-8f79-5fcc4c10af28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.458331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076a0cf-f7b3-4e27-8f79-5fcc4c10af28 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.471468 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 782/1584] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:28.472707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076a0cf-f7b3-4e27-8f79-5fcc4c10af28 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.488307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076a0cf-f7b3-4e27-8f79-5fcc4c10af28 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.495707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0232ae-b604-4c03-8b77-f97365b6b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.496684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0232ae-b604-4c03-8b77-f97365b6b953 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.497147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0232ae-b604-4c03-8b77-f97365b6b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.497569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0232ae-b604-4c03-8b77-f97365b6b953 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.498691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0232ae-b604-4c03-8b77-f97365b6b953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:28.499198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0232ae-b604-4c03-8b77-f97365b6b953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.502043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0232ae-b604-4c03-8b77-f97365b6b953 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.510327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b0878-881b-473f-84d5-f9ccd7d51189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.511928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b0878-881b-473f-84d5-f9ccd7d51189 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.521775 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 783/1585] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:28.523666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0232ae-b604-4c03-8b77-f97365b6b953 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.527088 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 803/1586] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:28.536028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b0878-881b-473f-84d5-f9ccd7d51189 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.539962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0232ae-b604-4c03-8b77-f97365b6b953 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.545455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fec360-de86-4614-ad8f-2f3f46670d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.546391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fec360-de86-4614-ad8f-2f3f46670d41 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.546745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fec360-de86-4614-ad8f-2f3f46670d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.547078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fec360-de86-4614-ad8f-2f3f46670d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.547812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fec360-de86-4614-ad8f-2f3f46670d41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.551291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fec360-de86-4614-ad8f-2f3f46670d41 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.561852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b0878-881b-473f-84d5-f9ccd7d51189 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.571688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cac6b-a1a7-4867-8234-a2e9a635b802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.572508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cac6b-a1a7-4867-8234-a2e9a635b802 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.572912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cac6b-a1a7-4867-8234-a2e9a635b802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.573318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cac6b-a1a7-4867-8234-a2e9a635b802 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.574171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cac6b-a1a7-4867-8234-a2e9a635b802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.576924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cac6b-a1a7-4867-8234-a2e9a635b802 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.605687 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 784/1587] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:28.608336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fec360-de86-4614-ad8f-2f3f46670d41 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.627197 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 804/1588] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:28.628992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cac6b-a1a7-4867-8234-a2e9a635b802 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.741734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fec360-de86-4614-ad8f-2f3f46670d41 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.750066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47e1ce-cc2b-4bef-be25-f3d04531e2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.751082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47e1ce-cc2b-4bef-be25-f3d04531e2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.751534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47e1ce-cc2b-4bef-be25-f3d04531e2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.752017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47e1ce-cc2b-4bef-be25-f3d04531e2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.753202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47e1ce-cc2b-4bef-be25-f3d04531e2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.753606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cac6b-a1a7-4867-8234-a2e9a635b802 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.756388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47e1ce-cc2b-4bef-be25-f3d04531e2b5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.759908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f876b1-0454-4efd-b856-ab21d202d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.760961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f876b1-0454-4efd-b856-ab21d202d138 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.761455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f876b1-0454-4efd-b856-ab21d202d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.761936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f876b1-0454-4efd-b856-ab21d202d138 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.763085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f876b1-0454-4efd-b856-ab21d202d138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.766094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f876b1-0454-4efd-b856-ab21d202d138 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.772626 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 785/1589] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:28.773595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47e1ce-cc2b-4bef-be25-f3d04531e2b5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.784421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47e1ce-cc2b-4bef-be25-f3d04531e2b5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.788192 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 805/1590] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:28.788398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f876b1-0454-4efd-b856-ab21d202d138 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.796434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305db7ca-e1a2-4225-aec6-fbf039fc833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.797988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305db7ca-e1a2-4225-aec6-fbf039fc833a admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.798667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305db7ca-e1a2-4225-aec6-fbf039fc833a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.800345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305db7ca-e1a2-4225-aec6-fbf039fc833a admin admin] PATH_INFO: `/v3/projects/218b6606ee6242b5919b9f76d7582c2d/users/3845aed02101447aa07fabd6a600498f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.805252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f876b1-0454-4efd-b856-ab21d202d138 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.810597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084903bd-cce5-43c7-9512-4ae3c88696c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.811399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084903bd-cce5-43c7-9512-4ae3c88696c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.811780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084903bd-cce5-43c7-9512-4ae3c88696c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.812159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084903bd-cce5-43c7-9512-4ae3c88696c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.813168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084903bd-cce5-43c7-9512-4ae3c88696c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.815018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084903bd-cce5-43c7-9512-4ae3c88696c3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.827971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305db7ca-e1a2-4225-aec6-fbf039fc833a admin admin] RBAC: Authorizing `identity:create_grant(project_id=218b6606ee6242b5919b9f76d7582c2d, user_id=3845aed02101447aa07fabd6a600498f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.834198 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 806/1591] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:28.834198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084903bd-cce5-43c7-9512-4ae3c88696c3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.835261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305db7ca-e1a2-4225-aec6-fbf039fc833a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.845165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084903bd-cce5-43c7-9512-4ae3c88696c3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.855886 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 786/1592] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:28 2022] PUT /identity/v3/projects/218b6606ee6242b5919b9f76d7582c2d/users/3845aed02101447aa07fabd6a600498f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:28.862528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305db7ca-e1a2-4225-aec6-fbf039fc833a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:28.935189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f77198-82ba-4cbb-95ce-7a416d84113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.936314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77198-82ba-4cbb-95ce-7a416d84113d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.936877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77198-82ba-4cbb-95ce-7a416d84113d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.937345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77198-82ba-4cbb-95ce-7a416d84113d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.941095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f77198-82ba-4cbb-95ce-7a416d84113d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.941095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f77198-82ba-4cbb-95ce-7a416d84113d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.958224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305db7ca-e1a2-4225-aec6-fbf039fc833a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:28.964586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585447e4-6458-4882-8cad-c387b50de451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:28.965552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585447e4-6458-4882-8cad-c387b50de451 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:28.966121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585447e4-6458-4882-8cad-c387b50de451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:28.966670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585447e4-6458-4882-8cad-c387b50de451 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:28.967778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585447e4-6458-4882-8cad-c387b50de451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:28.970167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585447e4-6458-4882-8cad-c387b50de451 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:28.996414 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 807/1593] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:29.002567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f77198-82ba-4cbb-95ce-7a416d84113d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.004092 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 787/1594] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:29.005191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585447e4-6458-4882-8cad-c387b50de451 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.014827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:29.017624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585447e4-6458-4882-8cad-c387b50de451 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.037128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:29.097102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380001-4846-4a73-9f08-b77e5c81530a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.097744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380001-4846-4a73-9f08-b77e5c81530a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.098063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380001-4846-4a73-9f08-b77e5c81530a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.099273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a380001-4846-4a73-9f08-b77e5c81530a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.099460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a380001-4846-4a73-9f08-b77e5c81530a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.101071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a380001-4846-4a73-9f08-b77e5c81530a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.102881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f77198-82ba-4cbb-95ce-7a416d84113d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.107895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406e3d4-2a70-4b3b-9cd6-afc9e79cddeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.108530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406e3d4-2a70-4b3b-9cd6-afc9e79cddeb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.108814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406e3d4-2a70-4b3b-9cd6-afc9e79cddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.109084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406e3d4-2a70-4b3b-9cd6-afc9e79cddeb admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.109787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406e3d4-2a70-4b3b-9cd6-afc9e79cddeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.111793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406e3d4-2a70-4b3b-9cd6-afc9e79cddeb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.119823 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 788/1595] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:29.121517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380001-4846-4a73-9f08-b77e5c81530a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.136883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a380001-4846-4a73-9f08-b77e5c81530a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.137775 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 808/1596] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:28 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:29.138639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406e3d4-2a70-4b3b-9cd6-afc9e79cddeb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.143580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce86a18-fa2a-45a0-a55a-adea1f3658dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.144435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86a18-fa2a-45a0-a55a-adea1f3658dc admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.144860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86a18-fa2a-45a0-a55a-adea1f3658dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.145491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86a18-fa2a-45a0-a55a-adea1f3658dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.146802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce86a18-fa2a-45a0-a55a-adea1f3658dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.149149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce86a18-fa2a-45a0-a55a-adea1f3658dc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.150167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406e3d4-2a70-4b3b-9cd6-afc9e79cddeb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.155764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637655-cc6f-4b00-91d0-504255553134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.156585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637655-cc6f-4b00-91d0-504255553134 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.156916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637655-cc6f-4b00-91d0-504255553134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.157187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637655-cc6f-4b00-91d0-504255553134 admin admin] PATH_INFO: `/v3/projects/fc9f602898c54d2f95a73b97a7c4f845/users/a96a0a367e4c436781020de704c06345/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.165266 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 789/1597] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:29.167467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ef532-a14d-4afc-9da3-49f6a7e09c8b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.167942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ef532-a14d-4afc-9da3-49f6a7e09c8b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.168410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ef532-a14d-4afc-9da3-49f6a7e09c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.179086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7637655-cc6f-4b00-91d0-504255553134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9f602898c54d2f95a73b97a7c4f845, user_id=a96a0a367e4c436781020de704c06345, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.182028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7637655-cc6f-4b00-91d0-504255553134 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.195307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2e8ef532-a14d-4afc-9da3-49f6a7e09c8b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:29.196714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2e8ef532-a14d-4afc-9da3-49f6a7e09c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:29.200104 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 809/1598] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:29 2022] PUT /identity/v3/projects/fc9f602898c54d2f95a73b97a7c4f845/users/a96a0a367e4c436781020de704c06345/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:29.200989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637655-cc6f-4b00-91d0-504255553134 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.294284 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 790/1599] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:29.294284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ef532-a14d-4afc-9da3-49f6a7e09c8b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.307502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ef532-a14d-4afc-9da3-49f6a7e09c8b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.312540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903fa1b-34f7-42a4-b73e-98a58a2b58c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.313180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fa1b-34f7-42a4-b73e-98a58a2b58c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.313480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fa1b-34f7-42a4-b73e-98a58a2b58c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.313751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fa1b-34f7-42a4-b73e-98a58a2b58c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.314487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903fa1b-34f7-42a4-b73e-98a58a2b58c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.314946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637655-cc6f-4b00-91d0-504255553134 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.316166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903fa1b-34f7-42a4-b73e-98a58a2b58c8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.321706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced333d-ed6e-43e4-8264-7ce5675a3ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.322520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced333d-ed6e-43e4-8264-7ce5675a3ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.322953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced333d-ed6e-43e4-8264-7ce5675a3ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.323413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced333d-ed6e-43e4-8264-7ce5675a3ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.324125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced333d-ed6e-43e4-8264-7ce5675a3ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.326430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced333d-ed6e-43e4-8264-7ce5675a3ef9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.327934 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 791/1600] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:29.328837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903fa1b-34f7-42a4-b73e-98a58a2b58c8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.341201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903fa1b-34f7-42a4-b73e-98a58a2b58c8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.347756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.348948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.349386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.349855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] PATH_INFO: `/v3/users/b1cc2024e2144a6ea0011bc5bd8c1b7a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.351610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1cc2024e2144a6ea0011bc5bd8c1b7a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.354992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.359213 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 810/1601] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:29 2022] POST /identity/v3/users => generated 300 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:29.360548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced333d-ed6e-43e4-8264-7ce5675a3ef9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.376019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced333d-ed6e-43e4-8264-7ce5675a3ef9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.383683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c140ff-ae50-4a3f-8f77-f4ca64f4b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.384491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c140ff-ae50-4a3f-8f77-f4ca64f4b97a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.384878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c140ff-ae50-4a3f-8f77-f4ca64f4b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.385271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c140ff-ae50-4a3f-8f77-f4ca64f4b97a admin admin] PATH_INFO: `/v3/projects/2ecdb839de1a4d56a708dff9007e0e8f/users/885331f5db0b4ad78e75b4653bb89b6f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.409020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c140ff-ae50-4a3f-8f77-f4ca64f4b97a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ecdb839de1a4d56a708dff9007e0e8f, user_id=885331f5db0b4ad78e75b4653bb89b6f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.414299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c140ff-ae50-4a3f-8f77-f4ca64f4b97a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.433470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1cc2024e2144a6ea0011bc5bd8c1b7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:29.434792 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 811/1602] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:29 2022] PUT /identity/v3/projects/2ecdb839de1a4d56a708dff9007e0e8f/users/885331f5db0b4ad78e75b4653bb89b6f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:29.439645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c140ff-ae50-4a3f-8f77-f4ca64f4b97a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.443815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1cc2024e2144a6ea0011bc5bd8c1b7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:29.461113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1cc2024e2144a6ea0011bc5bd8c1b7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:29.471002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1cc2024e2144a6ea0011bc5bd8c1b7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:29.471755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1cc2024e2144a6ea0011bc5bd8c1b7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:29.480378 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 792/1603] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:29 2022] DELETE /identity/v3/users/b1cc2024e2144a6ea0011bc5bd8c1b7a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:29.481848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.484326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:29.492141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:29.499704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:29.541629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c140ff-ae50-4a3f-8f77-f4ca64f4b97a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.577443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4adb24-5cf3-4daf-b689-8113af9d9f02 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.584206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa252000-3083-4399-aa68-0d6999f8b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.585096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252000-3083-4399-aa68-0d6999f8b2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.585478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252000-3083-4399-aa68-0d6999f8b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.585836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252000-3083-4399-aa68-0d6999f8b2e0 admin admin] PATH_INFO: `/v3/projects/2339ba8063d147fba0ec29bdada0c503/users/d387739ecdf14841a888667e6d09b1e0/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.607091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa252000-3083-4399-aa68-0d6999f8b2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2339ba8063d147fba0ec29bdada0c503, user_id=d387739ecdf14841a888667e6d09b1e0, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.610207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa252000-3083-4399-aa68-0d6999f8b2e0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.628605 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 793/1604] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:29 2022] PUT /identity/v3/projects/2339ba8063d147fba0ec29bdada0c503/users/d387739ecdf14841a888667e6d09b1e0/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:29.630373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182546ad-0dd8-4cd7-a9b1-f0eb0ee034c5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.630605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182546ad-0dd8-4cd7-a9b1-f0eb0ee034c5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.631054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182546ad-0dd8-4cd7-a9b1-f0eb0ee034c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.631551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4997-29aa-498c-9d53-aa6e3855e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.632398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4997-29aa-498c-9d53-aa6e3855e06a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.632803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4997-29aa-498c-9d53-aa6e3855e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.633242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4997-29aa-498c-9d53-aa6e3855e06a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.637746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee4997-29aa-498c-9d53-aa6e3855e06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.637746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee4997-29aa-498c-9d53-aa6e3855e06a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.664824 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 812/1605] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:29.666243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4997-29aa-498c-9d53-aa6e3855e06a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.668961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b0ee4997-29aa-498c-9d53-aa6e3855e06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:29.677306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-182546ad-0dd8-4cd7-a9b1-f0eb0ee034c5 None None] MFA Rules not processed for user `a96a0a367e4c436781020de704c06345`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:29.680332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-182546ad-0dd8-4cd7-a9b1-f0eb0ee034c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:29.755188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4997-29aa-498c-9d53-aa6e3855e06a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.779855 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 794/1606] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:29.780866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182546ad-0dd8-4cd7-a9b1-f0eb0ee034c5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.782693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-182546ad-0dd8-4cd7-a9b1-f0eb0ee034c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:29.831174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667e978-f1ca-48c9-bb03-468309c211f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.832897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e978-f1ca-48c9-bb03-468309c211f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.833228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e978-f1ca-48c9-bb03-468309c211f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.833685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667e978-f1ca-48c9-bb03-468309c211f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.836639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f667e978-f1ca-48c9-bb03-468309c211f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:29.878734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182546ad-0dd8-4cd7-a9b1-f0eb0ee034c5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:29.884406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec85e9a-81fa-4f26-8165-4fa59a535709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:29.885322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec85e9a-81fa-4f26-8165-4fa59a535709 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.885704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec85e9a-81fa-4f26-8165-4fa59a535709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.886110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec85e9a-81fa-4f26-8165-4fa59a535709 admin admin] PATH_INFO: `/v3/projects/bb9e0ff062c649f29d136cdccd89143c/users/b219c7e9d2fd4a5d8fa038d4d70e2793/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.900579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:29.907178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec85e9a-81fa-4f26-8165-4fa59a535709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9e0ff062c649f29d136cdccd89143c, user_id=b219c7e9d2fd4a5d8fa038d4d70e2793, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.912066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec85e9a-81fa-4f26-8165-4fa59a535709 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.927184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:29.928733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667e978-f1ca-48c9-bb03-468309c211f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:29.930914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667e978-f1ca-48c9-bb03-468309c211f7 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:29.934726 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 795/1607] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:29 2022] PUT /identity/v3/projects/bb9e0ff062c649f29d136cdccd89143c/users/b219c7e9d2fd4a5d8fa038d4d70e2793/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:29.936973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec85e9a-81fa-4f26-8165-4fa59a535709 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:29.940401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ec85e9a-81fa-4f26-8165-4fa59a535709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:29.943787 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 813/1608] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:29.945125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c129ad7-4482-4eb9-8621-84541a84da76 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:29.945539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c129ad7-4482-4eb9-8621-84541a84da76 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:29.945703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c129ad7-4482-4eb9-8621-84541a84da76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:29.976842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5c129ad7-4482-4eb9-8621-84541a84da76 None None] MFA Rules not processed for user `885331f5db0b4ad78e75b4653bb89b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:29.978133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5c129ad7-4482-4eb9-8621-84541a84da76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:30.054036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec85e9a-81fa-4f26-8165-4fa59a535709 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.063785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ec576-9e71-46dd-94b4-dbd8b3964d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.065084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec576-9e71-46dd-94b4-dbd8b3964d09 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.065706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec576-9e71-46dd-94b4-dbd8b3964d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.066313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec576-9e71-46dd-94b4-dbd8b3964d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.067677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ec576-9e71-46dd-94b4-dbd8b3964d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.071219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ec576-9e71-46dd-94b4-dbd8b3964d09 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.084667 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 814/1609] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:30.086130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f09a-0f24-4077-866e-25242dbacf65 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.086468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f09a-0f24-4077-866e-25242dbacf65 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.086737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6f09a-0f24-4077-866e-25242dbacf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.095707 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 796/1610] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:30.098082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea17c0c-3e13-4156-afd7-7dc7c4a7679b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.099092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea17c0c-3e13-4156-afd7-7dc7c4a7679b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.099895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea17c0c-3e13-4156-afd7-7dc7c4a7679b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.116602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6bd6f09a-0f24-4077-866e-25242dbacf65 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:30.118469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6bd6f09a-0f24-4077-866e-25242dbacf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:30.132826 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 815/1611] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:30.132826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6f09a-0f24-4077-866e-25242dbacf65 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.132826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6bd6f09a-0f24-4077-866e-25242dbacf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:30.148818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6f09a-0f24-4077-866e-25242dbacf65 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.157082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e8486-3388-4a96-8563-715ab1bef2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.157823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1ea17c0c-3e13-4156-afd7-7dc7c4a7679b None None] MFA Rules not processed for user `d387739ecdf14841a888667e6d09b1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:30.158238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e8486-3388-4a96-8563-715ab1bef2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.158712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e8486-3388-4a96-8563-715ab1bef2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.159188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e8486-3388-4a96-8563-715ab1bef2f3 admin admin] PATH_INFO: `/v3/projects/23c8b5ff987e4c76b8dfacd5190651ff/users/e6aa363e0cf048be902e111af89f97a4/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.159618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ea17c0c-3e13-4156-afd7-7dc7c4a7679b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:30.193711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e8486-3388-4a96-8563-715ab1bef2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c8b5ff987e4c76b8dfacd5190651ff, user_id=e6aa363e0cf048be902e111af89f97a4, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.200601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e8486-3388-4a96-8563-715ab1bef2f3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.233892 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 816/1612] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:30 2022] PUT /identity/v3/projects/23c8b5ff987e4c76b8dfacd5190651ff/users/e6aa363e0cf048be902e111af89f97a4/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:30.235480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e8486-3388-4a96-8563-715ab1bef2f3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.242196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8e6e8486-3388-4a96-8563-715ab1bef2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:30.284854 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 797/1613] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:30.286295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea17c0c-3e13-4156-afd7-7dc7c4a7679b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.298599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea17c0c-3e13-4156-afd7-7dc7c4a7679b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.366221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e8486-3388-4a96-8563-715ab1bef2f3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.373512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df993f-bcce-4e1a-a1ad-a65e1f13176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.374422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df993f-bcce-4e1a-a1ad-a65e1f13176a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.374782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df993f-bcce-4e1a-a1ad-a65e1f13176a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.375228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df993f-bcce-4e1a-a1ad-a65e1f13176a admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.376351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df993f-bcce-4e1a-a1ad-a65e1f13176a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.378656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df993f-bcce-4e1a-a1ad-a65e1f13176a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.379710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc72e6c-d84f-40ed-892b-e86cc210f1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.381954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc72e6c-d84f-40ed-892b-e86cc210f1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.381954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc72e6c-d84f-40ed-892b-e86cc210f1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.382277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc72e6c-d84f-40ed-892b-e86cc210f1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.384408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc72e6c-d84f-40ed-892b-e86cc210f1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.387297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc72e6c-d84f-40ed-892b-e86cc210f1a8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.413613 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 798/1614] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:30.413613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc72e6c-d84f-40ed-892b-e86cc210f1a8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.413613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5fc72e6c-d84f-40ed-892b-e86cc210f1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:30.432435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc72e6c-d84f-40ed-892b-e86cc210f1a8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.441530 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 817/1615] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:30 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:30.441530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df993f-bcce-4e1a-a1ad-a65e1f13176a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.445594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16f9d1-388b-498c-a813-0f68ecb0333c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.446498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16f9d1-388b-498c-a813-0f68ecb0333c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.446855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16f9d1-388b-498c-a813-0f68ecb0333c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.447201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16f9d1-388b-498c-a813-0f68ecb0333c admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.447954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16f9d1-388b-498c-a813-0f68ecb0333c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.450307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa16f9d1-388b-498c-a813-0f68ecb0333c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.482738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:30.512092 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 799/1616] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:30 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:30.513257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:30.517016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16f9d1-388b-498c-a813-0f68ecb0333c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.524767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fa16f9d1-388b-498c-a813-0f68ecb0333c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:30.588322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df993f-bcce-4e1a-a1ad-a65e1f13176a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.656261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16f9d1-388b-498c-a813-0f68ecb0333c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.660996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6067-d9d9-4e9d-b898-866dbb91886e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.662037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6067-d9d9-4e9d-b898-866dbb91886e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.662329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6067-d9d9-4e9d-b898-866dbb91886e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.662607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6067-d9d9-4e9d-b898-866dbb91886e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.702512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5397e-8f3e-428a-86de-a6d3221d94fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.704298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5397e-8f3e-428a-86de-a6d3221d94fb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.704825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5397e-8f3e-428a-86de-a6d3221d94fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.705564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5397e-8f3e-428a-86de-a6d3221d94fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.707792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5397e-8f3e-428a-86de-a6d3221d94fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.710749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5397e-8f3e-428a-86de-a6d3221d94fb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.732875 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 818/1617] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:30.734233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5397e-8f3e-428a-86de-a6d3221d94fb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.747224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5397e-8f3e-428a-86de-a6d3221d94fb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.753040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbd910-df21-4b79-9b26-de7664dc98cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.753738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbd910-df21-4b79-9b26-de7664dc98cd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.754060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbd910-df21-4b79-9b26-de7664dc98cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.754325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbd910-df21-4b79-9b26-de7664dc98cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.755100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbd910-df21-4b79-9b26-de7664dc98cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.756890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbd910-df21-4b79-9b26-de7664dc98cd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.769402 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 819/1618] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:30.770650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbd910-df21-4b79-9b26-de7664dc98cd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.783458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e6067-d9d9-4e9d-b898-866dbb91886e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.785016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e6067-d9d9-4e9d-b898-866dbb91886e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.800364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbd910-df21-4b79-9b26-de7664dc98cd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.803701 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 800/1619] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:30.805218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6067-d9d9-4e9d-b898-866dbb91886e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.810244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f390f7d-01a6-47e8-92f6-f8fd3f3950eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.811497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f390f7d-01a6-47e8-92f6-f8fd3f3950eb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.812104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f390f7d-01a6-47e8-92f6-f8fd3f3950eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.812903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f390f7d-01a6-47e8-92f6-f8fd3f3950eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.814306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f390f7d-01a6-47e8-92f6-f8fd3f3950eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.818444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f390f7d-01a6-47e8-92f6-f8fd3f3950eb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.826125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6067-d9d9-4e9d-b898-866dbb91886e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:30.836998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb4328-b95c-43ea-a195-68d3f0ac29eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:30.839692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb4328-b95c-43ea-a195-68d3f0ac29eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:30.840412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb4328-b95c-43ea-a195-68d3f0ac29eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:30.841159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb4328-b95c-43ea-a195-68d3f0ac29eb admin admin] PATH_INFO: `/v3/projects/bb9e0ff062c649f29d136cdccd89143c/users/b219c7e9d2fd4a5d8fa038d4d70e2793/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:30.844768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb4328-b95c-43ea-a195-68d3f0ac29eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9e0ff062c649f29d136cdccd89143c, user_id=b219c7e9d2fd4a5d8fa038d4d70e2793, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:30.848066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb4328-b95c-43ea-a195-68d3f0ac29eb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:30.873945 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 801/1620] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:30 2022] PUT /identity/v3/projects/bb9e0ff062c649f29d136cdccd89143c/users/b219c7e9d2fd4a5d8fa038d4d70e2793/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:30.873945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb4328-b95c-43ea-a195-68d3f0ac29eb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:30.895197 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 820/1621] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:30 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:30.897492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f390f7d-01a6-47e8-92f6-f8fd3f3950eb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.002730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb4328-b95c-43ea-a195-68d3f0ac29eb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.024041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f390f7d-01a6-47e8-92f6-f8fd3f3950eb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.030152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e5a3e-ff1c-425f-9e8b-bba40336bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.030942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5a3e-ff1c-425f-9e8b-bba40336bd32 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.031313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5a3e-ff1c-425f-9e8b-bba40336bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.031675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e5a3e-ff1c-425f-9e8b-bba40336bd32 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.032425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e5a3e-ff1c-425f-9e8b-bba40336bd32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.034720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e5a3e-ff1c-425f-9e8b-bba40336bd32 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.075980 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 821/1622] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:30 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:31.077735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e5a3e-ff1c-425f-9e8b-bba40336bd32 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.086617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:31.098368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e5a3e-ff1c-425f-9e8b-bba40336bd32 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.107982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a6ac3-94af-4e2b-99b0-7968d5158f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.109271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a6ac3-94af-4e2b-99b0-7968d5158f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.109775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a6ac3-94af-4e2b-99b0-7968d5158f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.110505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a6ac3-94af-4e2b-99b0-7968d5158f34 admin admin] PATH_INFO: `/v3/projects/6df60b6010674bf5bf594fef89f7b52d/users/7e1165ea52e04e6088ea6d0cad09b96a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.117773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e538a-e6f7-4fcc-8969-1941a971405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.118690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e538a-e6f7-4fcc-8969-1941a971405c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.120196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e538a-e6f7-4fcc-8969-1941a971405c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.120196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e538a-e6f7-4fcc-8969-1941a971405c admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.120196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e538a-e6f7-4fcc-8969-1941a971405c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.122799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e538a-e6f7-4fcc-8969-1941a971405c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.141378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a6ac3-94af-4e2b-99b0-7968d5158f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df60b6010674bf5bf594fef89f7b52d, user_id=7e1165ea52e04e6088ea6d0cad09b96a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.149809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a6ac3-94af-4e2b-99b0-7968d5158f34 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.165502 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 802/1623] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:30 2022] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:31.165502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e538a-e6f7-4fcc-8969-1941a971405c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.188355 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 822/1624] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:31 2022] PUT /identity/v3/projects/6df60b6010674bf5bf594fef89f7b52d/users/7e1165ea52e04e6088ea6d0cad09b96a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:31.192421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc530-6bbe-4c2b-9bf3-fd17e157975a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.193399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc530-6bbe-4c2b-9bf3-fd17e157975a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.194150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc530-6bbe-4c2b-9bf3-fd17e157975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.198481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e538a-e6f7-4fcc-8969-1941a971405c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.222017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:31.286235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2b4cc530-6bbe-4c2b-9bf3-fd17e157975a None None] MFA Rules not processed for user `b219c7e9d2fd4a5d8fa038d4d70e2793`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:31.288468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b4cc530-6bbe-4c2b-9bf3-fd17e157975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:31.360150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efed326-894d-4b69-94bd-9157e837d5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.361165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efed326-894d-4b69-94bd-9157e837d5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.361588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efed326-894d-4b69-94bd-9157e837d5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.363358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efed326-894d-4b69-94bd-9157e837d5ac admin admin] PATH_INFO: `/v3/projects/23c8b5ff987e4c76b8dfacd5190651ff/users/e6aa363e0cf048be902e111af89f97a4/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.366366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efed326-894d-4b69-94bd-9157e837d5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c8b5ff987e4c76b8dfacd5190651ff, user_id=e6aa363e0cf048be902e111af89f97a4, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.369789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efed326-894d-4b69-94bd-9157e837d5ac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.398115 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 803/1625] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:31 2022] PUT /identity/v3/projects/23c8b5ff987e4c76b8dfacd5190651ff/users/e6aa363e0cf048be902e111af89f97a4/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:31.398115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efed326-894d-4b69-94bd-9157e837d5ac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.429340 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 823/1626] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:31.431054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cc530-6bbe-4c2b-9bf3-fd17e157975a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.451055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cc530-6bbe-4c2b-9bf3-fd17e157975a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.529863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efed326-894d-4b69-94bd-9157e837d5ac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.535754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e8634-d053-43d0-8794-0aa1381da1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.537400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e8634-d053-43d0-8794-0aa1381da1ef admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.537906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e8634-d053-43d0-8794-0aa1381da1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.538456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e8634-d053-43d0-8794-0aa1381da1ef admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.539473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e8634-d053-43d0-8794-0aa1381da1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.542167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e8634-d053-43d0-8794-0aa1381da1ef admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.580070 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 804/1627] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:31 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:31.580948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9befc-2271-4f0d-9a97-1136ea41035e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.581604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9befc-2271-4f0d-9a97-1136ea41035e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.581896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9befc-2271-4f0d-9a97-1136ea41035e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.582195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9befc-2271-4f0d-9a97-1136ea41035e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.582881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9befc-2271-4f0d-9a97-1136ea41035e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.583090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e8634-d053-43d0-8794-0aa1381da1ef admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.584936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e9befc-2271-4f0d-9a97-1136ea41035e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.603469 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 824/1628] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:31.604958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09006b8-bbcb-42fc-91fe-f8df29417288 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.605480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09006b8-bbcb-42fc-91fe-f8df29417288 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.605758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09006b8-bbcb-42fc-91fe-f8df29417288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.606081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e8634-d053-43d0-8794-0aa1381da1ef admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.618073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb23f4-caa1-4e13-b024-0849ad713509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.618709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb23f4-caa1-4e13-b024-0849ad713509 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.618984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb23f4-caa1-4e13-b024-0849ad713509 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.619249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb23f4-caa1-4e13-b024-0849ad713509 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.623764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb23f4-caa1-4e13-b024-0849ad713509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.629306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb23f4-caa1-4e13-b024-0849ad713509 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.655414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f09006b8-bbcb-42fc-91fe-f8df29417288 None None] MFA Rules not processed for user `7e1165ea52e04e6088ea6d0cad09b96a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:31.658466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f09006b8-bbcb-42fc-91fe-f8df29417288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:31.673356 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 805/1629] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:31.673356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60133d5f-d650-49d2-a135-d85b4adca08a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.673356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60133d5f-d650-49d2-a135-d85b4adca08a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.673356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60133d5f-d650-49d2-a135-d85b4adca08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.755793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-60133d5f-d650-49d2-a135-d85b4adca08a None None] MFA Rules not processed for user `e6aa363e0cf048be902e111af89f97a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:31.757132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-60133d5f-d650-49d2-a135-d85b4adca08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:31.819560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:31.833933 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 825/1630] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:31.836441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d428-8aff-4bc9-a6a4-30ac3c84a18c None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.836792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d428-8aff-4bc9-a6a4-30ac3c84a18c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.837039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728d428-8aff-4bc9-a6a4-30ac3c84a18c None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.840765 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 826/1631] 10.222.0.43 () {54 vars in 962 bytes} [Tue Aug 30 04:13:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:31.842052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d428-8aff-4bc9-a6a4-30ac3c84a18c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.863373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728d428-8aff-4bc9-a6a4-30ac3c84a18c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.876551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcc714-c868-4ecb-a700-de0e07b9b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.878263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcc714-c868-4ecb-a700-de0e07b9b9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.879250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcc714-c868-4ecb-a700-de0e07b9b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.879389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcc714-c868-4ecb-a700-de0e07b9b9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.880602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcc714-c868-4ecb-a700-de0e07b9b9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.884526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abcc714-c868-4ecb-a700-de0e07b9b9a2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.886602 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 806/1632] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:31.888166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60133d5f-d650-49d2-a135-d85b4adca08a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.906796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60133d5f-d650-49d2-a135-d85b4adca08a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.908871 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 827/1633] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:31.917707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ab4b-c462-403c-a307-e0a70b9f3b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.918893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcc714-c868-4ecb-a700-de0e07b9b9a2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.919107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ab4b-c462-403c-a307-e0a70b9f3b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.919482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ab4b-c462-403c-a307-e0a70b9f3b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.919859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ab4b-c462-403c-a307-e0a70b9f3b28 admin admin] PATH_INFO: `/v3/projects/e7571f1fc6b347cab1e09e0051d402ad/users/ecb468048d2a49818fbf91f00af8d58d/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:31.932898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:31.944277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ab4b-c462-403c-a307-e0a70b9f3b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7571f1fc6b347cab1e09e0051d402ad, user_id=ecb468048d2a49818fbf91f00af8d58d, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:31.948052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ab4b-c462-403c-a307-e0a70b9f3b28 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:31.952784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcc714-c868-4ecb-a700-de0e07b9b9a2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:31.974719 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 807/1634] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:31 2022] PUT /identity/v3/projects/e7571f1fc6b347cab1e09e0051d402ad/users/ecb468048d2a49818fbf91f00af8d58d/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:31.975103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a068e05-20d1-4fe4-9733-4aed3d593643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:31.975103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a068e05-20d1-4fe4-9733-4aed3d593643 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:31.975103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a068e05-20d1-4fe4-9733-4aed3d593643 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:31.975355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ab4b-c462-403c-a307-e0a70b9f3b28 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:31.975435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a068e05-20d1-4fe4-9733-4aed3d593643 admin admin] PATH_INFO: `/v3/projects/52f3928cb54b45939f6e2a4e95ac33e9/users/c64df393f7fe4a77add994a30b5d8a2a/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.013162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a068e05-20d1-4fe4-9733-4aed3d593643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f3928cb54b45939f6e2a4e95ac33e9, user_id=c64df393f7fe4a77add994a30b5d8a2a, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.022810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a068e05-20d1-4fe4-9733-4aed3d593643 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.047337 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 828/1635] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:31 2022] PUT /identity/v3/projects/52f3928cb54b45939f6e2a4e95ac33e9/users/c64df393f7fe4a77add994a30b5d8a2a/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:32.050381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60488e13-acf1-4f06-ae4f-c280269903b9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.052399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60488e13-acf1-4f06-ae4f-c280269903b9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.054826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60488e13-acf1-4f06-ae4f-c280269903b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.069622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ab4b-c462-403c-a307-e0a70b9f3b28 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.127838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-60488e13-acf1-4f06-ae4f-c280269903b9 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:32.130386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-60488e13-acf1-4f06-ae4f-c280269903b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:32.196541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa841e7-961f-4d64-8597-19680299695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.198269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa841e7-961f-4d64-8597-19680299695a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.200572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa841e7-961f-4d64-8597-19680299695a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.201104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa841e7-961f-4d64-8597-19680299695a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.202358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa841e7-961f-4d64-8597-19680299695a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.208994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa841e7-961f-4d64-8597-19680299695a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.257439 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 808/1636] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:31 2022] POST /identity/v3/projects => generated 399 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:32.257439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa841e7-961f-4d64-8597-19680299695a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.259001 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 829/1637] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Aug 30 04:13:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:32.259428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-daa841e7-961f-4d64-8597-19680299695a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:32.259919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60488e13-acf1-4f06-ae4f-c280269903b9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.272564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60488e13-acf1-4f06-ae4f-c280269903b9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.330209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:32.362408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d8435-2007-42f9-8898-7c37bb8dc2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.363572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8435-2007-42f9-8898-7c37bb8dc2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.364106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8435-2007-42f9-8898-7c37bb8dc2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.364520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d8435-2007-42f9-8898-7c37bb8dc2b8 admin admin] PATH_INFO: `/v3/projects/726a5c48ccd34cf7838e983827ab8680/users/7b925d0eb232429f9893a76d287bbc30/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.378746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa841e7-961f-4d64-8597-19680299695a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.400903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.402113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.402793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.403470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] PATH_INFO: `/v3/projects/fd51e4a716bb44b68c77943d18db0bb9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.406325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd51e4a716bb44b68c77943d18db0bb9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.406979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d8435-2007-42f9-8898-7c37bb8dc2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726a5c48ccd34cf7838e983827ab8680, user_id=7b925d0eb232429f9893a76d287bbc30, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.408452 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:13:32.408452 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:13:32.408452 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:13:32.411859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.413920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d8435-2007-42f9-8898-7c37bb8dc2b8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.445212 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 830/1638] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:32 2022] PUT /identity/v3/projects/726a5c48ccd34cf7838e983827ab8680/users/7b925d0eb232429f9893a76d287bbc30/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:32.448466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfecfba-b80c-43e1-8b9b-c4c9dbbdc462 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.448466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfecfba-b80c-43e1-8b9b-c4c9dbbdc462 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.448466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfecfba-b80c-43e1-8b9b-c4c9dbbdc462 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.448803 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 831/1639] 10.222.0.43 () {54 vars in 962 bytes} [Tue Aug 30 04:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:32.449585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfecfba-b80c-43e1-8b9b-c4c9dbbdc462 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.511755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:32.550382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd51e4a716bb44b68c77943d18db0bb9', 'request_id': 'req-90813412-b8a3-43a2-8ac3-d6e1a289d572'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:32.567702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfecfba-b80c-43e1-8b9b-c4c9dbbdc462 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.568169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd51e4a716bb44b68c77943d18db0bb9', 'request_id': 'req-90813412-b8a3-43a2-8ac3-d6e1a289d572'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:32.600464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd51e4a716bb44b68c77943d18db0bb9', 'request_id': 'req-90813412-b8a3-43a2-8ac3-d6e1a289d572'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:32.620167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] The token cache is being invalidate because project fd51e4a716bb44b68c77943d18db0bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:13:32.620658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:32.621862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:32.625151 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 809/1640] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:32 2022] DELETE /identity/v3/projects/fd51e4a716bb44b68c77943d18db0bb9 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:32.627157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.630153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:32.750895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2eacb-ac21-4d6f-88ca-06954ee61d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.752200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2eacb-ac21-4d6f-88ca-06954ee61d2b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.752740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2eacb-ac21-4d6f-88ca-06954ee61d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.753304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2eacb-ac21-4d6f-88ca-06954ee61d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.754403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2eacb-ac21-4d6f-88ca-06954ee61d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.757543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b2eacb-ac21-4d6f-88ca-06954ee61d2b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.777928 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 832/1641] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:32.777928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2eacb-ac21-4d6f-88ca-06954ee61d2b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.783617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-45b2eacb-ac21-4d6f-88ca-06954ee61d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:32.796550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90813412-b8a3-43a2-8ac3-d6e1a289d572 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.806812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778351-2561-49c7-96dd-98fe0fffde57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.807818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778351-2561-49c7-96dd-98fe0fffde57 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.809461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778351-2561-49c7-96dd-98fe0fffde57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.810111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778351-2561-49c7-96dd-98fe0fffde57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.811387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5778351-2561-49c7-96dd-98fe0fffde57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.814706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5778351-2561-49c7-96dd-98fe0fffde57 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.816578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2eacb-ac21-4d6f-88ca-06954ee61d2b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.822970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b591af-9468-4783-9381-d7a7a1dda9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.825691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b591af-9468-4783-9381-d7a7a1dda9ad admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.825691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b591af-9468-4783-9381-d7a7a1dda9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.825691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b591af-9468-4783-9381-d7a7a1dda9ad admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.825691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b591af-9468-4783-9381-d7a7a1dda9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.827600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b591af-9468-4783-9381-d7a7a1dda9ad admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.834693 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 810/1642] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:32.835931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778351-2561-49c7-96dd-98fe0fffde57 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.837760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b5778351-2561-49c7-96dd-98fe0fffde57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:32.867027 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 833/1643] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:32 2022] POST /identity/v3/users => generated 306 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:32.867027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b591af-9468-4783-9381-d7a7a1dda9ad admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:32.869281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-36b591af-9468-4783-9381-d7a7a1dda9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:32.884523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b591af-9468-4783-9381-d7a7a1dda9ad admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:32.894922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f5647-d64a-421e-8202-2d887f01065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:32.895643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f5647-d64a-421e-8202-2d887f01065d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.895967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f5647-d64a-421e-8202-2d887f01065d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.896187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f5647-d64a-421e-8202-2d887f01065d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.897314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f5647-d64a-421e-8202-2d887f01065d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:32.899134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9f5647-d64a-421e-8202-2d887f01065d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:32.913923 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 834/1644] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:32.913923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8c428-a6e1-4133-8203-467475117f44 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:32.913923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8c428-a6e1-4133-8203-467475117f44 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:32.913923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8c428-a6e1-4133-8203-467475117f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:32.935736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-88e8c428-a6e1-4133-8203-467475117f44 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:32.937375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-88e8c428-a6e1-4133-8203-467475117f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:32.993903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:33.011625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778351-2561-49c7-96dd-98fe0fffde57 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.017545 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 835/1645] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Aug 30 04:13:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:33.019452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a2f1c-b5f1-4194-a54b-9cdb8f36fee5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.020010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a2f1c-b5f1-4194-a54b-9cdb8f36fee5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.020657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a2f1c-b5f1-4194-a54b-9cdb8f36fee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.024271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e290c8-6df3-4b7e-9d1e-1ab550f877d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.025715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e290c8-6df3-4b7e-9d1e-1ab550f877d7 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.026318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e290c8-6df3-4b7e-9d1e-1ab550f877d7 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.026798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e290c8-6df3-4b7e-9d1e-1ab550f877d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.031562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-28e290c8-6df3-4b7e-9d1e-1ab550f877d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:33.047993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d56a2f1c-b5f1-4194-a54b-9cdb8f36fee5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:33.049407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d56a2f1c-b5f1-4194-a54b-9cdb8f36fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:33.059144 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 836/1646] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:33.060156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a2f1c-b5f1-4194-a54b-9cdb8f36fee5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.061797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d56a2f1c-b5f1-4194-a54b-9cdb8f36fee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:33.075786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a2f1c-b5f1-4194-a54b-9cdb8f36fee5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.081751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76fa78-dbc9-45c5-96a8-8979675d4911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.082580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76fa78-dbc9-45c5-96a8-8979675d4911 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.082966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76fa78-dbc9-45c5-96a8-8979675d4911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.083503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76fa78-dbc9-45c5-96a8-8979675d4911 admin admin] PATH_INFO: `/v3/projects/e7571f1fc6b347cab1e09e0051d402ad/users/ecb468048d2a49818fbf91f00af8d58d/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.085769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76fa78-dbc9-45c5-96a8-8979675d4911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7571f1fc6b347cab1e09e0051d402ad, user_id=ecb468048d2a49818fbf91f00af8d58d, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.089574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76fa78-dbc9-45c5-96a8-8979675d4911 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.112517 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 837/1647] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:33 2022] PUT /identity/v3/projects/e7571f1fc6b347cab1e09e0051d402ad/users/ecb468048d2a49818fbf91f00af8d58d/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:33.113251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76fa78-dbc9-45c5-96a8-8979675d4911 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.167860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e290c8-6df3-4b7e-9d1e-1ab550f877d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.170388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e290c8-6df3-4b7e-9d1e-1ab550f877d7 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.171473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:33.191871 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 811/1648] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:32 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:33.195485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e290c8-6df3-4b7e-9d1e-1ab550f877d7 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.217426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e290c8-6df3-4b7e-9d1e-1ab550f877d7 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.283716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76fa78-dbc9-45c5-96a8-8979675d4911 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.307679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107eda2-8f3c-4a7e-9c45-3b3c244f467e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.309046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107eda2-8f3c-4a7e-9c45-3b3c244f467e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.309475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107eda2-8f3c-4a7e-9c45-3b3c244f467e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.310059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107eda2-8f3c-4a7e-9c45-3b3c244f467e admin admin] PATH_INFO: `/v3/projects/52f3928cb54b45939f6e2a4e95ac33e9/users/c64df393f7fe4a77add994a30b5d8a2a/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.312926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107eda2-8f3c-4a7e-9c45-3b3c244f467e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f3928cb54b45939f6e2a4e95ac33e9, user_id=c64df393f7fe4a77add994a30b5d8a2a, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.321050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107eda2-8f3c-4a7e-9c45-3b3c244f467e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.348101 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 838/1649] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:33 2022] PUT /identity/v3/projects/52f3928cb54b45939f6e2a4e95ac33e9/users/c64df393f7fe4a77add994a30b5d8a2a/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:33.350250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107eda2-8f3c-4a7e-9c45-3b3c244f467e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.363136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15fedd-c0fe-4e5f-b37e-1a7284711370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.365348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15fedd-c0fe-4e5f-b37e-1a7284711370 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.365741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15fedd-c0fe-4e5f-b37e-1a7284711370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.366268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15fedd-c0fe-4e5f-b37e-1a7284711370 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.369758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15fedd-c0fe-4e5f-b37e-1a7284711370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.373126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15fedd-c0fe-4e5f-b37e-1a7284711370 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.397644 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 812/1650] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:33.400388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15fedd-c0fe-4e5f-b37e-1a7284711370 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:33.491841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107eda2-8f3c-4a7e-9c45-3b3c244f467e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.499618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c4a96-baa2-4446-b6d1-f66ee6ee6ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.501076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c4a96-baa2-4446-b6d1-f66ee6ee6ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.501507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c4a96-baa2-4446-b6d1-f66ee6ee6ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.501959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c4a96-baa2-4446-b6d1-f66ee6ee6ed3 admin admin] PATH_INFO: `/v3/projects/726a5c48ccd34cf7838e983827ab8680/users/7b925d0eb232429f9893a76d287bbc30/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.507973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c4a96-baa2-4446-b6d1-f66ee6ee6ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=726a5c48ccd34cf7838e983827ab8680, user_id=7b925d0eb232429f9893a76d287bbc30, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.511219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c4a96-baa2-4446-b6d1-f66ee6ee6ed3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.539184 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 839/1651] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:33 2022] PUT /identity/v3/projects/726a5c48ccd34cf7838e983827ab8680/users/7b925d0eb232429f9893a76d287bbc30/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:33.541675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d621347-9113-4cbc-8228-688802a20ae1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.541996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d621347-9113-4cbc-8228-688802a20ae1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.542396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d621347-9113-4cbc-8228-688802a20ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.577620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15fedd-c0fe-4e5f-b37e-1a7284711370 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:33.581002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2d621347-9113-4cbc-8228-688802a20ae1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:33.582305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2d621347-9113-4cbc-8228-688802a20ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:33.664355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:33.765919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1f825-82c3-41fa-83cd-f32b7f38cda3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:33.766807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1f825-82c3-41fa-83cd-f32b7f38cda3 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.767249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1f825-82c3-41fa-83cd-f32b7f38cda3 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.767624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1f825-82c3-41fa-83cd-f32b7f38cda3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.778935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ca1f825-82c3-41fa-83cd-f32b7f38cda3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:33.817313 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 840/1652] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:33.821754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cccfc-4483-4815-922e-5c4ee1f5b246 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.822639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cccfc-4483-4815-922e-5c4ee1f5b246 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.824142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cccfc-4483-4815-922e-5c4ee1f5b246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.881288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ef9cccfc-4483-4815-922e-5c4ee1f5b246 None None] MFA Rules not processed for user `ecb468048d2a49818fbf91f00af8d58d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:33.882915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ef9cccfc-4483-4815-922e-5c4ee1f5b246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:33.944428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1f825-82c3-41fa-83cd-f32b7f38cda3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:33.944428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1f825-82c3-41fa-83cd-f32b7f38cda3 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:33.954206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:33.963990 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 813/1653] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:33.965779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626eaea9-13d4-49f1-abf4-861d6f0eccd7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:33.966171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626eaea9-13d4-49f1-abf4-861d6f0eccd7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:33.966515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626eaea9-13d4-49f1-abf4-861d6f0eccd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:33.994704 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 841/1654] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:33.997546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cccfc-4483-4815-922e-5c4ee1f5b246 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.017760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cccfc-4483-4815-922e-5c4ee1f5b246 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.024220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee172b-9f98-4021-ba39-0d42808eadee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.026393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee172b-9f98-4021-ba39-0d42808eadee admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.026800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee172b-9f98-4021-ba39-0d42808eadee admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.027179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee172b-9f98-4021-ba39-0d42808eadee admin admin] PATH_INFO: `/v3/projects/fd027031e01a46e7bd65e4feae501a7e/users/814227e779a64f70916ebe4e0372fdbe/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.027892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-626eaea9-13d4-49f1-abf4-861d6f0eccd7 None None] MFA Rules not processed for user `c64df393f7fe4a77add994a30b5d8a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:34.029559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-626eaea9-13d4-49f1-abf4-861d6f0eccd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:34.062927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee172b-9f98-4021-ba39-0d42808eadee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd027031e01a46e7bd65e4feae501a7e, user_id=814227e779a64f70916ebe4e0372fdbe, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.066137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee172b-9f98-4021-ba39-0d42808eadee admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.100598 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 842/1655] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:33 2022] PUT /identity/v3/projects/fd027031e01a46e7bd65e4feae501a7e/users/814227e779a64f70916ebe4e0372fdbe/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:34.104209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156bd6b-6ac6-45c4-a6ed-d9eedf267a6c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.105123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156bd6b-6ac6-45c4-a6ed-d9eedf267a6c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.105688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156bd6b-6ac6-45c4-a6ed-d9eedf267a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.205953 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 814/1656] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:34.211474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626eaea9-13d4-49f1-abf4-861d6f0eccd7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.213681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4156bd6b-6ac6-45c4-a6ed-d9eedf267a6c None None] MFA Rules not processed for user `7b925d0eb232429f9893a76d287bbc30`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:34.217721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4156bd6b-6ac6-45c4-a6ed-d9eedf267a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:34.242443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626eaea9-13d4-49f1-abf4-861d6f0eccd7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.338548 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 843/1657] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:34.340011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156bd6b-6ac6-45c4-a6ed-d9eedf267a6c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.349282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:34.377672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae8f33-bfc6-4ff2-b705-cc07f3b0ab5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.378615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae8f33-bfc6-4ff2-b705-cc07f3b0ab5d service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.379125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae8f33-bfc6-4ff2-b705-cc07f3b0ab5d service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.379686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae8f33-bfc6-4ff2-b705-cc07f3b0ab5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.382225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aeae8f33-bfc6-4ff2-b705-cc07f3b0ab5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:34.533034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156bd6b-6ac6-45c4-a6ed-d9eedf267a6c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.534467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae8f33-bfc6-4ff2-b705-cc07f3b0ab5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.536915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae8f33-bfc6-4ff2-b705-cc07f3b0ab5d service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.549213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4016056-9b32-44c2-ac76-7ac0f9e9516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.549914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4016056-9b32-44c2-ac76-7ac0f9e9516b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.553357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4016056-9b32-44c2-ac76-7ac0f9e9516b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.553634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4016056-9b32-44c2-ac76-7ac0f9e9516b admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.555498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4016056-9b32-44c2-ac76-7ac0f9e9516b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:34.555803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4016056-9b32-44c2-ac76-7ac0f9e9516b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.566822 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 815/1658] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:34.569307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4016056-9b32-44c2-ac76-7ac0f9e9516b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.569728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373536e-f56d-4aaf-9905-51ba0379174d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.572570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373536e-f56d-4aaf-9905-51ba0379174d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.572889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373536e-f56d-4aaf-9905-51ba0379174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.591833 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 844/1659] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:34.593157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4016056-9b32-44c2-ac76-7ac0f9e9516b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.612593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2373536e-f56d-4aaf-9905-51ba0379174d None None] MFA Rules not processed for user `885331f5db0b4ad78e75b4653bb89b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:34.614039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2373536e-f56d-4aaf-9905-51ba0379174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:34.625465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4016056-9b32-44c2-ac76-7ac0f9e9516b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.644298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19286022-64ba-4b57-9712-d90f058b6c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.645117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19286022-64ba-4b57-9712-d90f058b6c1e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.645570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19286022-64ba-4b57-9712-d90f058b6c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.646387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19286022-64ba-4b57-9712-d90f058b6c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.647455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19286022-64ba-4b57-9712-d90f058b6c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.649566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19286022-64ba-4b57-9712-d90f058b6c1e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.688940 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 845/1660] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:34.690771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19286022-64ba-4b57-9712-d90f058b6c1e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.698638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-19286022-64ba-4b57-9712-d90f058b6c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:34.716970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19286022-64ba-4b57-9712-d90f058b6c1e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.719007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 816/1661] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:34.720696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373536e-f56d-4aaf-9905-51ba0379174d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.732317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.733199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.733753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.734080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] PATH_INFO: `/v3/users/790e08814cd643e5a1da5173a8301207` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.736735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=790e08814cd643e5a1da5173a8301207)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.738711 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:13:34.738711 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:13:34.738711 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:13:34.740555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.745560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373536e-f56d-4aaf-9905-51ba0379174d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.758948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270002c-ac2c-49ee-b52a-a28527080800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.760185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270002c-ac2c-49ee-b52a-a28527080800 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.760734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270002c-ac2c-49ee-b52a-a28527080800 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.761352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270002c-ac2c-49ee-b52a-a28527080800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.813866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:34.880230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270002c-ac2c-49ee-b52a-a28527080800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.883022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270002c-ac2c-49ee-b52a-a28527080800 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.902661 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 817/1662] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:34.904033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270002c-ac2c-49ee-b52a-a28527080800 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:34.922222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270002c-ac2c-49ee-b52a-a28527080800 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:34.922869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790e08814cd643e5a1da5173a8301207'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:34.923971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790e08814cd643e5a1da5173a8301207'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:34.930224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223571b-5db6-4a9c-a1da-1ad1a7acba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:34.931479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223571b-5db6-4a9c-a1da-1ad1a7acba2b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:34.931921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223571b-5db6-4a9c-a1da-1ad1a7acba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:34.932346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223571b-5db6-4a9c-a1da-1ad1a7acba2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:34.933423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223571b-5db6-4a9c-a1da-1ad1a7acba2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:34.937457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223571b-5db6-4a9c-a1da-1ad1a7acba2b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:34.978560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790e08814cd643e5a1da5173a8301207'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:35.000051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790e08814cd643e5a1da5173a8301207'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:35.022991 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 818/1663] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:34 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:35.022991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223571b-5db6-4a9c-a1da-1ad1a7acba2b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:35.058201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:35.079803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790e08814cd643e5a1da5173a8301207'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:35.108076 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 846/1664] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:34 2022] DELETE /identity/v3/users/790e08814cd643e5a1da5173a8301207 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:35.109698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:35.116890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:35.318583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223571b-5db6-4a9c-a1da-1ad1a7acba2b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:35.354042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a33526-543a-40da-8c66-bf1dfd22e6c4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:35.368556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6ebb-feac-4087-bbce-737703e6afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:35.370259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6ebb-feac-4087-bbce-737703e6afcd admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.370755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6ebb-feac-4087-bbce-737703e6afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.371197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa6ebb-feac-4087-bbce-737703e6afcd admin admin] PATH_INFO: `/v3/projects/fd027031e01a46e7bd65e4feae501a7e/users/814227e779a64f70916ebe4e0372fdbe/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.375971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6ebb-feac-4087-bbce-737703e6afcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd027031e01a46e7bd65e4feae501a7e, user_id=814227e779a64f70916ebe4e0372fdbe, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:35.382824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa6ebb-feac-4087-bbce-737703e6afcd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:35.417958 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 847/1665] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:35 2022] PUT /identity/v3/projects/fd027031e01a46e7bd65e4feae501a7e/users/814227e779a64f70916ebe4e0372fdbe/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:35.417958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6ebb-feac-4087-bbce-737703e6afcd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:35.417958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-93aa6ebb-feac-4087-bbce-737703e6afcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:35.604918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35201a-8003-43b1-ac1f-f0cad0a1b1f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:35.605855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35201a-8003-43b1-ac1f-f0cad0a1b1f5 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.612568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35201a-8003-43b1-ac1f-f0cad0a1b1f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.612934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35201a-8003-43b1-ac1f-f0cad0a1b1f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.618924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f35201a-8003-43b1-ac1f-f0cad0a1b1f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:35.700051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa6ebb-feac-4087-bbce-737703e6afcd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:35.717312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91127499-25d0-4016-a3b7-6c78faed3b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:35.719677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127499-25d0-4016-a3b7-6c78faed3b0d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.720188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127499-25d0-4016-a3b7-6c78faed3b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.720620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127499-25d0-4016-a3b7-6c78faed3b0d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.725690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91127499-25d0-4016-a3b7-6c78faed3b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:35.730374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91127499-25d0-4016-a3b7-6c78faed3b0d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:35.786487 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 848/1666] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:35 2022] POST /identity/v3/users => generated 289 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:35.794878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af19c7-49dd-440c-91c4-9a4a65185c66 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.795336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af19c7-49dd-440c-91c4-9a4a65185c66 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.795790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af19c7-49dd-440c-91c4-9a4a65185c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.846605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35201a-8003-43b1-ac1f-f0cad0a1b1f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:35.851543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35201a-8003-43b1-ac1f-f0cad0a1b1f5 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:35.854351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-16af19c7-49dd-440c-91c4-9a4a65185c66 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:35.857002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-16af19c7-49dd-440c-91c4-9a4a65185c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:35.876100 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 849/1667] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:35.880531 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 819/1668] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 861 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:35.884459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35201a-8003-43b1-ac1f-f0cad0a1b1f5 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:35.887480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f35201a-8003-43b1-ac1f-f0cad0a1b1f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:35.896624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489eb52-4481-4729-8920-2a5551fb3f2e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:35.902380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489eb52-4481-4729-8920-2a5551fb3f2e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:35.907044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489eb52-4481-4729-8920-2a5551fb3f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:35.923190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35201a-8003-43b1-ac1f-f0cad0a1b1f5 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:36.012646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:36.029698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d489eb52-4481-4729-8920-2a5551fb3f2e None None] MFA Rules not processed for user `814227e779a64f70916ebe4e0372fdbe`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:36.033260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:36.035268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d489eb52-4481-4729-8920-2a5551fb3f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:36.114491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874abf6-0d3c-4ab5-a971-92354c630769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:36.116753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874abf6-0d3c-4ab5-a971-92354c630769 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.117217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874abf6-0d3c-4ab5-a971-92354c630769 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.117657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874abf6-0d3c-4ab5-a971-92354c630769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.127954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c874abf6-0d3c-4ab5-a971-92354c630769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:36.316177 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 850/1669] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:35 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:36.319630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489eb52-4481-4729-8920-2a5551fb3f2e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:36.353306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489eb52-4481-4729-8920-2a5551fb3f2e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:36.371017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874abf6-0d3c-4ab5-a971-92354c630769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:36.372967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9202566-9e99-4e83-9020-53a319be63b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:36.373912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9202566-9e99-4e83-9020-53a319be63b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.374056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9202566-9e99-4e83-9020-53a319be63b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.374951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874abf6-0d3c-4ab5-a971-92354c630769 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:36.377690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9202566-9e99-4e83-9020-53a319be63b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.378500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9202566-9e99-4e83-9020-53a319be63b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:36.380547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9202566-9e99-4e83-9020-53a319be63b2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:36.406338 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 851/1670] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:36.406978 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 820/1671] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:36.412939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9202566-9e99-4e83-9020-53a319be63b2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:36.413923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874abf6-0d3c-4ab5-a971-92354c630769 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:36.427219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d9202566-9e99-4e83-9020-53a319be63b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:36.443430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874abf6-0d3c-4ab5-a971-92354c630769 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:36.480062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2a2e0-e7bc-4a7b-b455-435d06d7b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:36.481154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2a2e0-e7bc-4a7b-b455-435d06d7b032 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.481639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2a2e0-e7bc-4a7b-b455-435d06d7b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.482150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2a2e0-e7bc-4a7b-b455-435d06d7b032 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.483339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2a2e0-e7bc-4a7b-b455-435d06d7b032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:36.487746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a2a2e0-e7bc-4a7b-b455-435d06d7b032 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:36.535288 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 821/1672] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:13:36.542443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e43c8-579f-4cef-a1e5-b63767ab5e65 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.542929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e43c8-579f-4cef-a1e5-b63767ab5e65 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.543558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e43c8-579f-4cef-a1e5-b63767ab5e65 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.545993 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 822/1673] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:13:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:36.547064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e43c8-579f-4cef-a1e5-b63767ab5e65 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:36.573556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e43c8-579f-4cef-a1e5-b63767ab5e65 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:36.588038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b99d3-30e4-424f-bad4-e520bfe9a86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:36.589090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b99d3-30e4-424f-bad4-e520bfe9a86b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.589541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b99d3-30e4-424f-bad4-e520bfe9a86b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.590034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b99d3-30e4-424f-bad4-e520bfe9a86b admin admin] PATH_INFO: `/v3/projects/d60397af79964a1b8cacfd1def77ab97/users/bde77323678a499ea443e370ee328177/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.649627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b99d3-30e4-424f-bad4-e520bfe9a86b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60397af79964a1b8cacfd1def77ab97, user_id=bde77323678a499ea443e370ee328177, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:36.651859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9202566-9e99-4e83-9020-53a319be63b2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:36.655806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b99d3-30e4-424f-bad4-e520bfe9a86b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:36.682020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa847e-a08b-4f3a-84e6-b99ee0a1a6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:36.682885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa847e-a08b-4f3a-84e6-b99ee0a1a6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.683172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa847e-a08b-4f3a-84e6-b99ee0a1a6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.686091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa847e-a08b-4f3a-84e6-b99ee0a1a6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.715877 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 823/1674] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:36 2022] PUT /identity/v3/projects/d60397af79964a1b8cacfd1def77ab97/users/bde77323678a499ea443e370ee328177/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:36.717403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987c69f-eb5a-4da5-bc74-44cb67330df5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.717781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987c69f-eb5a-4da5-bc74-44cb67330df5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.718213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987c69f-eb5a-4da5-bc74-44cb67330df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.736200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa847e-a08b-4f3a-84e6-b99ee0a1a6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:36.755003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa847e-a08b-4f3a-84e6-b99ee0a1a6a8 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:36.783320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2987c69f-eb5a-4da5-bc74-44cb67330df5 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:36.787261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2987c69f-eb5a-4da5-bc74-44cb67330df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:36.799912 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 852/1675] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:36.802259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160cff2-61f6-45ef-a408-0d437a38c98c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.802867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160cff2-61f6-45ef-a408-0d437a38c98c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.808488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160cff2-61f6-45ef-a408-0d437a38c98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:36.916704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5160cff2-61f6-45ef-a408-0d437a38c98c None None] MFA Rules not processed for user `bde77323678a499ea443e370ee328177`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:36.918244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5160cff2-61f6-45ef-a408-0d437a38c98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:36.980589 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 824/1676] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:13:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:36.983695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3556d6d-480c-49ff-9613-f4f3eb0cb806 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:36.984308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3556d6d-480c-49ff-9613-f4f3eb0cb806 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:36.984847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3556d6d-480c-49ff-9613-f4f3eb0cb806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.033421 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 853/1677] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:37.035131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160cff2-61f6-45ef-a408-0d437a38c98c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.038498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5160cff2-61f6-45ef-a408-0d437a38c98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:37.063187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d3556d6d-480c-49ff-9613-f4f3eb0cb806 None None] MFA Rules not processed for user `3845aed02101447aa07fabd6a600498f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:37.064967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d3556d6d-480c-49ff-9613-f4f3eb0cb806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:37.070890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160cff2-61f6-45ef-a408-0d437a38c98c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.087294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fbf17-490f-42ec-b61f-56ed9725727a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.088466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.089280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fbf17-490f-42ec-b61f-56ed9725727a service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.097500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fbf17-490f-42ec-b61f-56ed9725727a service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.099273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fbf17-490f-42ec-b61f-56ed9725727a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.158523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.198463 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 825/1678] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:36 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:37.199700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3556d6d-480c-49ff-9613-f4f3eb0cb806 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.209097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d3556d6d-480c-49ff-9613-f4f3eb0cb806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:37.292668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fbf17-490f-42ec-b61f-56ed9725727a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:37.296003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fbf17-490f-42ec-b61f-56ed9725727a service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:37.332239 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 854/1679] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:37.334199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fbf17-490f-42ec-b61f-56ed9725727a service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.467168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3556d6d-480c-49ff-9613-f4f3eb0cb806 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.483112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed86652-2ca6-4b0e-967e-b5ce46726476 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.484110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed86652-2ca6-4b0e-967e-b5ce46726476 service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.497911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed86652-2ca6-4b0e-967e-b5ce46726476 service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.497911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed86652-2ca6-4b0e-967e-b5ce46726476 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.511832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed86652-2ca6-4b0e-967e-b5ce46726476 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:37.513358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed86652-2ca6-4b0e-967e-b5ce46726476 service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:37.545685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fbf17-490f-42ec-b61f-56ed9725727a service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.562061 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 826/1680] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:37.564621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed86652-2ca6-4b0e-967e-b5ce46726476 service glance] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.572326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30460b-678c-4b18-937b-f840829a11d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.573175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3ed86652-2ca6-4b0e-967e-b5ce46726476 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:37.576107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30460b-678c-4b18-937b-f840829a11d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.580044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30460b-678c-4b18-937b-f840829a11d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.583179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30460b-678c-4b18-937b-f840829a11d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.584552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30460b-678c-4b18-937b-f840829a11d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:37.588084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30460b-678c-4b18-937b-f840829a11d3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:37.652592 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 855/1681] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:37 2022] POST /identity/v3/projects => generated 375 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:37.652778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed86652-2ca6-4b0e-967e-b5ce46726476 service glance] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.654447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30460b-678c-4b18-937b-f840829a11d3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.657719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bd30460b-678c-4b18-937b-f840829a11d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:37.836778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16637fa-8f84-4c87-8d49-a35b74359d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.837676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16637fa-8f84-4c87-8d49-a35b74359d3d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.838115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16637fa-8f84-4c87-8d49-a35b74359d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.838490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16637fa-8f84-4c87-8d49-a35b74359d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.839312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16637fa-8f84-4c87-8d49-a35b74359d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:37.841693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16637fa-8f84-4c87-8d49-a35b74359d3d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:37.856108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30460b-678c-4b18-937b-f840829a11d3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:37.862135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:37.862800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:37.863076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:37.863343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] PATH_INFO: `/v3/projects/474e31261af4485097c80c8c9aac4c3d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:37.865177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=474e31261af4485097c80c8c9aac4c3d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:37.867308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:37.886751 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 827/1682] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:37 2022] POST /identity/v3/projects => generated 403 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:37.887829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16637fa-8f84-4c87-8d49-a35b74359d3d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:37.937840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.950004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:37.957984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474e31261af4485097c80c8c9aac4c3d', 'request_id': 'req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:37.973324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474e31261af4485097c80c8c9aac4c3d', 'request_id': 'req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:37.990318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474e31261af4485097c80c8c9aac4c3d', 'request_id': 'req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:37.994006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16637fa-8f84-4c87-8d49-a35b74359d3d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.017148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] The token cache is being invalidate because project 474e31261af4485097c80c8c9aac4c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:13:38.017630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:38.018864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cbc76446-130c-45c6-9ad1-8b14fb6b31d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:38.026007 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 856/1683] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:37 2022] DELETE /identity/v3/projects/474e31261af4485097c80c8c9aac4c3d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:38.027873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805382-89a4-41ee-b6e1-2073b87229ee None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.028238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805382-89a4-41ee-b6e1-2073b87229ee None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.028583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4805382-89a4-41ee-b6e1-2073b87229ee None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.030448 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 857/1684] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:38.031058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4805382-89a4-41ee-b6e1-2073b87229ee None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:38.039324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c4805382-89a4-41ee-b6e1-2073b87229ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:38.102306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9527b77-b2dd-4276-aa08-be9b2c37a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.103785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9527b77-b2dd-4276-aa08-be9b2c37a52b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.104186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9527b77-b2dd-4276-aa08-be9b2c37a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.104629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9527b77-b2dd-4276-aa08-be9b2c37a52b admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.105735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9527b77-b2dd-4276-aa08-be9b2c37a52b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.108196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9527b77-b2dd-4276-aa08-be9b2c37a52b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.139881 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 828/1685] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:37 2022] POST /identity/v3/users => generated 294 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:38.141676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9527b77-b2dd-4276-aa08-be9b2c37a52b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:38.145464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b9527b77-b2dd-4276-aa08-be9b2c37a52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:38.162850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9527b77-b2dd-4276-aa08-be9b2c37a52b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.169932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.170598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.170877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.171141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] PATH_INFO: `/v3/users/e6aa363e0cf048be902e111af89f97a4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.172624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6aa363e0cf048be902e111af89f97a4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.175801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.177136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4805382-89a4-41ee-b6e1-2073b87229ee None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.183629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3eabc-3d64-4532-a94b-0819edb7ab4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.184283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3eabc-3d64-4532-a94b-0819edb7ab4c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.185631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3eabc-3d64-4532-a94b-0819edb7ab4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.185631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3eabc-3d64-4532-a94b-0819edb7ab4c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.186096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3eabc-3d64-4532-a94b-0819edb7ab4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.187977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3eabc-3d64-4532-a94b-0819edb7ab4c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.218812 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 858/1686] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:38 2022] POST /identity/v3/users => generated 308 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:38.218812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88b73d-abdf-4806-b083-63a2ebeccac7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.218812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88b73d-abdf-4806-b083-63a2ebeccac7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.218812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88b73d-abdf-4806-b083-63a2ebeccac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.248011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7c88b73d-abdf-4806-b083-63a2ebeccac7 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:38.250439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c88b73d-abdf-4806-b083-63a2ebeccac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:38.258112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6aa363e0cf048be902e111af89f97a4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:38.276156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6aa363e0cf048be902e111af89f97a4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:38.303071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6aa363e0cf048be902e111af89f97a4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:38.316040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6aa363e0cf048be902e111af89f97a4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:38.317211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6aa363e0cf048be902e111af89f97a4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:38.334886 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 829/1687] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:38 2022] DELETE /identity/v3/users/e6aa363e0cf048be902e111af89f97a4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:38.336662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:38.339050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:38.388527 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 859/1688] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:13:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:38.415493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88b73d-abdf-4806-b083-63a2ebeccac7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:38.418127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c88b73d-abdf-4806-b083-63a2ebeccac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:38.424030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:38.474031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88b73d-abdf-4806-b083-63a2ebeccac7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.491719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dd474-7b4a-4a1b-b615-847ce51d762c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.497012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c12d9-3aa4-4a2a-8afb-21c70331f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.498883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c12d9-3aa4-4a2a-8afb-21c70331f11e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.499370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c12d9-3aa4-4a2a-8afb-21c70331f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.499843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c12d9-3aa4-4a2a-8afb-21c70331f11e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.501012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c12d9-3aa4-4a2a-8afb-21c70331f11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.502692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2500a6-9e16-487e-9a59-5ec15f945889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.503731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2500a6-9e16-487e-9a59-5ec15f945889 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.503932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c12d9-3aa4-4a2a-8afb-21c70331f11e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.504919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2500a6-9e16-487e-9a59-5ec15f945889 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.505354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2500a6-9e16-487e-9a59-5ec15f945889 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.512038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2500a6-9e16-487e-9a59-5ec15f945889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.515210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2500a6-9e16-487e-9a59-5ec15f945889 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.540115 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 830/1689] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:38.541956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2500a6-9e16-487e-9a59-5ec15f945889 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:38.544437 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 860/1690] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:38.544968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9d2500a6-9e16-487e-9a59-5ec15f945889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:38.550963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c12d9-3aa4-4a2a-8afb-21c70331f11e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:38.570892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c12d9-3aa4-4a2a-8afb-21c70331f11e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.581693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe469c-e8ad-4a5a-a6b8-de89c333eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.582589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe469c-e8ad-4a5a-a6b8-de89c333eed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.583292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe469c-e8ad-4a5a-a6b8-de89c333eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.583578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe469c-e8ad-4a5a-a6b8-de89c333eed9 admin admin] PATH_INFO: `/v3/projects/f6503365f6cf40fea47d7433f776f55c/users/2aadabeb4fc04e67a6c6ada79308dcae/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.609431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe469c-e8ad-4a5a-a6b8-de89c333eed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6503365f6cf40fea47d7433f776f55c, user_id=2aadabeb4fc04e67a6c6ada79308dcae, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.612971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe469c-e8ad-4a5a-a6b8-de89c333eed9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.637412 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 861/1691] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:38 2022] PUT /identity/v3/projects/f6503365f6cf40fea47d7433f776f55c/users/2aadabeb4fc04e67a6c6ada79308dcae/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:13:38.639933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe469c-e8ad-4a5a-a6b8-de89c333eed9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:38.686328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:38.744082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe469c-e8ad-4a5a-a6b8-de89c333eed9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.749952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f870b-85ce-474d-aa72-c069392d2c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.750503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f870b-85ce-474d-aa72-c069392d2c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.750781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f870b-85ce-474d-aa72-c069392d2c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.751064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f870b-85ce-474d-aa72-c069392d2c3b admin admin] PATH_INFO: `/v3/projects/28efd2873e1c40818dffa8a46958529c/users/1ca2d5d864d642a793214d0205552f7b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.791981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2500a6-9e16-487e-9a59-5ec15f945889 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.792920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f870b-85ce-474d-aa72-c069392d2c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28efd2873e1c40818dffa8a46958529c, user_id=1ca2d5d864d642a793214d0205552f7b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.802125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f870b-85ce-474d-aa72-c069392d2c3b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.837371 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 862/1692] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:38 2022] PUT /identity/v3/projects/28efd2873e1c40818dffa8a46958529c/users/1ca2d5d864d642a793214d0205552f7b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:38.837371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f870b-85ce-474d-aa72-c069392d2c3b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:38.940860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668fc12-4181-425e-93b8-86d171f21881 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.944070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668fc12-4181-425e-93b8-86d171f21881 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.944599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668fc12-4181-425e-93b8-86d171f21881 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.945062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668fc12-4181-425e-93b8-86d171f21881 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.962593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668fc12-4181-425e-93b8-86d171f21881 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.965919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668fc12-4181-425e-93b8-86d171f21881 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.972563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f870b-85ce-474d-aa72-c069392d2c3b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:38.978728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef54237-c312-47b8-af91-2aa8998ceca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:38.979450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54237-c312-47b8-af91-2aa8998ceca1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.979823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54237-c312-47b8-af91-2aa8998ceca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.980397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef54237-c312-47b8-af91-2aa8998ceca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.981114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef54237-c312-47b8-af91-2aa8998ceca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:38.982851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef54237-c312-47b8-af91-2aa8998ceca1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:38.989917 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 831/1693] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:38.992077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e66ef-03f7-4dac-8fbe-843afee2caf8 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:38.992546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e66ef-03f7-4dac-8fbe-843afee2caf8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:38.993006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e66ef-03f7-4dac-8fbe-843afee2caf8 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:38.995981 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 832/1694] 10.222.0.43 () {54 vars in 961 bytes} [Tue Aug 30 04:13:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:38.997240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e66ef-03f7-4dac-8fbe-843afee2caf8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.018888 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 863/1695] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:39.023829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f609e-0163-4f73-af8f-415944931ebe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.024278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f609e-0163-4f73-af8f-415944931ebe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.024278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f609e-0163-4f73-af8f-415944931ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.025266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e66ef-03f7-4dac-8fbe-843afee2caf8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:39.044134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59b878-b71c-4450-9421-1113fdf3fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:39.046126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59b878-b71c-4450-9421-1113fdf3fa38 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.046745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59b878-b71c-4450-9421-1113fdf3fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.049621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59b878-b71c-4450-9421-1113fdf3fa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.050942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59b878-b71c-4450-9421-1113fdf3fa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:39.058771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59b878-b71c-4450-9421-1113fdf3fa38 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:39.072656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7c0f609e-0163-4f73-af8f-415944931ebe None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:39.074021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c0f609e-0163-4f73-af8f-415944931ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:39.095605 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 833/1696] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:39.097181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59b878-b71c-4450-9421-1113fdf3fa38 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.117530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59b878-b71c-4450-9421-1113fdf3fa38 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:39.126393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aeef9-9a79-45b6-a2dd-92a6e445983d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:39.128667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aeef9-9a79-45b6-a2dd-92a6e445983d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.129583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aeef9-9a79-45b6-a2dd-92a6e445983d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.130384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aeef9-9a79-45b6-a2dd-92a6e445983d admin admin] PATH_INFO: `/v3/projects/f6503365f6cf40fea47d7433f776f55c/users/2aadabeb4fc04e67a6c6ada79308dcae/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.134329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9aeef9-9a79-45b6-a2dd-92a6e445983d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6503365f6cf40fea47d7433f776f55c, user_id=2aadabeb4fc04e67a6c6ada79308dcae, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:39.140868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9aeef9-9a79-45b6-a2dd-92a6e445983d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:39.192234 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 834/1697] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:39 2022] PUT /identity/v3/projects/f6503365f6cf40fea47d7433f776f55c/users/2aadabeb4fc04e67a6c6ada79308dcae/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:39.194396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aeef9-9a79-45b6-a2dd-92a6e445983d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.233425 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 864/1698] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Aug 30 04:13:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:39.237294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f609e-0163-4f73-af8f-415944931ebe None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.240429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c0f609e-0163-4f73-af8f-415944931ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:39.276354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f609e-0163-4f73-af8f-415944931ebe None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:39.366549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:39.409498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:39.410230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.410508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.410825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] PATH_INFO: `/v3/projects/23c8b5ff987e4c76b8dfacd5190651ff` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.412974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c8b5ff987e4c76b8dfacd5190651ff)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:39.419050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:39.427306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:39.466458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aeef9-9a79-45b6-a2dd-92a6e445983d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:39.475961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e234667-fb4a-4c82-8517-c2ab5645120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:39.477276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234667-fb4a-4c82-8517-c2ab5645120b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.477911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234667-fb4a-4c82-8517-c2ab5645120b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.478684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234667-fb4a-4c82-8517-c2ab5645120b admin admin] PATH_INFO: `/v3/projects/28efd2873e1c40818dffa8a46958529c/users/1ca2d5d864d642a793214d0205552f7b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.482818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e234667-fb4a-4c82-8517-c2ab5645120b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28efd2873e1c40818dffa8a46958529c, user_id=1ca2d5d864d642a793214d0205552f7b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:39.488335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e234667-fb4a-4c82-8517-c2ab5645120b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:39.512151 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 835/1699] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:39 2022] PUT /identity/v3/projects/28efd2873e1c40818dffa8a46958529c/users/1ca2d5d864d642a793214d0205552f7b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:39.514811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e234667-fb4a-4c82-8517-c2ab5645120b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.541002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c8b5ff987e4c76b8dfacd5190651ff', 'request_id': 'req-04164dcc-689e-48bc-a85a-2167655bba1e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:39.561662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c8b5ff987e4c76b8dfacd5190651ff', 'request_id': 'req-04164dcc-689e-48bc-a85a-2167655bba1e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:39.576327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c8b5ff987e4c76b8dfacd5190651ff', 'request_id': 'req-04164dcc-689e-48bc-a85a-2167655bba1e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:39.610536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] The token cache is being invalidate because project 23c8b5ff987e4c76b8dfacd5190651ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:13:39.611019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:39.612342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:39.616080 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 865/1700] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:39 2022] DELETE /identity/v3/projects/23c8b5ff987e4c76b8dfacd5190651ff => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:39.617702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:39.643796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:39.822908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e234667-fb4a-4c82-8517-c2ab5645120b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:39.948711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04164dcc-689e-48bc-a85a-2167655bba1e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:39.974480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:39.976002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.976870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.977385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] PATH_INFO: `/v3/users/be1893eab33f40b99b220a59e4db398c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.977526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e313b88-0a88-45cb-b3e0-e3417829d4cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:39.978832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e313b88-0a88-45cb-b3e0-e3417829d4cc service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:39.979292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e313b88-0a88-45cb-b3e0-e3417829d4cc service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:39.979920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e313b88-0a88-45cb-b3e0-e3417829d4cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:39.981449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1893eab33f40b99b220a59e4db398c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:39.982873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3e313b88-0a88-45cb-b3e0-e3417829d4cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:39.990849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:40.004707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e313b88-0a88-45cb-b3e0-e3417829d4cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:40.008383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e313b88-0a88-45cb-b3e0-e3417829d4cc service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:40.040390 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 836/1701] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:40.043770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349953-8ee3-4c17-83be-395820c9a753 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.044350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349953-8ee3-4c17-83be-395820c9a753 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.044822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91349953-8ee3-4c17-83be-395820c9a753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.113589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-91349953-8ee3-4c17-83be-395820c9a753 None None] MFA Rules not processed for user `1ca2d5d864d642a793214d0205552f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:40.116009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-91349953-8ee3-4c17-83be-395820c9a753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:40.184865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1893eab33f40b99b220a59e4db398c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:40.186583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1893eab33f40b99b220a59e4db398c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:40.215232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1893eab33f40b99b220a59e4db398c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:40.243866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1893eab33f40b99b220a59e4db398c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:40.258937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:40.292312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b3e16f5e-fe7d-46b2-885a-14801eef976d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1893eab33f40b99b220a59e4db398c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:40.310188 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 866/1702] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:39 2022] DELETE /identity/v3/users/be1893eab33f40b99b220a59e4db398c => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:40.313729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fb8cf-3ea9-4945-92de-4a3c76d808d4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.314289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fb8cf-3ea9-4945-92de-4a3c76d808d4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.314807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fb8cf-3ea9-4945-92de-4a3c76d808d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.344397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:40.373130 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 837/1703] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:40.382369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91349953-8ee3-4c17-83be-395820c9a753 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:40.385319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fd1fb8cf-3ea9-4945-92de-4a3c76d808d4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:40.386767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-91349953-8ee3-4c17-83be-395820c9a753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:40.391321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fd1fb8cf-3ea9-4945-92de-4a3c76d808d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:40.438230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91349953-8ee3-4c17-83be-395820c9a753 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:40.591378 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 867/1704] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:40.591378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d151c93-2541-40ef-9514-1f078c9e1810 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.591378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d151c93-2541-40ef-9514-1f078c9e1810 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.591378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d151c93-2541-40ef-9514-1f078c9e1810 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.598709 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 868/1705] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:13:40 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:40.601084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d1691-b485-4fb0-94d8-7983b0df2f45 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.601569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d1691-b485-4fb0-94d8-7983b0df2f45 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.603224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d1691-b485-4fb0-94d8-7983b0df2f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.604086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:40.605291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.605841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.606371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] PATH_INFO: `/v3/users/a96a0a367e4c436781020de704c06345` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.608706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96a0a367e4c436781020de704c06345)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:40.612598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:40.675865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-878d1691-b485-4fb0-94d8-7983b0df2f45 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:40.677666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-878d1691-b485-4fb0-94d8-7983b0df2f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:40.735546 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 869/1706] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:40.738425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc82d-c9ba-471f-8456-8e06115793c0 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.739180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc82d-c9ba-471f-8456-8e06115793c0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.739848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccc82d-c9ba-471f-8456-8e06115793c0 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.743658 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 870/1707] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:13:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:40.746920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6883-352c-4ec2-ba3c-721c47520b11 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.747506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6883-352c-4ec2-ba3c-721c47520b11 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.747985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d6883-352c-4ec2-ba3c-721c47520b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.800353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96a0a367e4c436781020de704c06345'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:40.816964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7c2d6883-352c-4ec2-ba3c-721c47520b11 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:40.819752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c2d6883-352c-4ec2-ba3c-721c47520b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:40.822599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96a0a367e4c436781020de704c06345'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:40.839407 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 871/1708] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:40.841246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f8b88-142b-4b30-b8d2-49986869184b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:40.843066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f8b88-142b-4b30-b8d2-49986869184b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:40.843423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f8b88-142b-4b30-b8d2-49986869184b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:40.855785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96a0a367e4c436781020de704c06345'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:40.874414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96a0a367e4c436781020de704c06345'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:40.876493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96a0a367e4c436781020de704c06345'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:40.899592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-660f8b88-142b-4b30-b8d2-49986869184b None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:40.900718 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 838/1709] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:40 2022] DELETE /identity/v3/users/a96a0a367e4c436781020de704c06345 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:40.902305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-660f8b88-142b-4b30-b8d2-49986869184b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:40.904628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:40.911733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:41.051567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488d8a7-01ed-4ca9-aa70-9cac8008ab0f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:41.071659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2236-2ae4-4282-bd01-2025b1bd8a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:41.074147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2236-2ae4-4282-bd01-2025b1bd8a6a service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.074702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2236-2ae4-4282-bd01-2025b1bd8a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.075397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2236-2ae4-4282-bd01-2025b1bd8a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.088801 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 872/1710] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:13:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:41.090721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b995-1cb5-491f-a8d6-7ae774ea50ba None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.091180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b995-1cb5-491f-a8d6-7ae774ea50ba None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.091636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9b995-1cb5-491f-a8d6-7ae774ea50ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.092342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-58cc2236-2ae4-4282-bd01-2025b1bd8a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:41.149770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bdf9b995-1cb5-491f-a8d6-7ae774ea50ba None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:41.151484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bdf9b995-1cb5-491f-a8d6-7ae774ea50ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:41.171170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:41.262494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:41.281748 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 873/1711] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:13:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:41.282963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9b995-1cb5-491f-a8d6-7ae774ea50ba None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.285694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bdf9b995-1cb5-491f-a8d6-7ae774ea50ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:41.296312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2236-2ae4-4282-bd01-2025b1bd8a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:41.299713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc2236-2ae4-4282-bd01-2025b1bd8a6a service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:41.308404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9b995-1cb5-491f-a8d6-7ae774ea50ba None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:41.316203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c67c89-e2d4-401c-a020-7188c129a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:41.320181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c67c89-e2d4-401c-a020-7188c129a639 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.323020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c67c89-e2d4-401c-a020-7188c129a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.324713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c67c89-e2d4-401c-a020-7188c129a639 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.325547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c67c89-e2d4-401c-a020-7188c129a639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:41.327017 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 839/1712] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:41.327158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c67c89-e2d4-401c-a020-7188c129a639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:41.329712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6320ce-2090-4c53-af2b-465745500601 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.330466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6320ce-2090-4c53-af2b-465745500601 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.330986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6320ce-2090-4c53-af2b-465745500601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.334610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c67c89-e2d4-401c-a020-7188c129a639 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:41.357031 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 874/1713] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:41.358414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c67c89-e2d4-401c-a020-7188c129a639 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.373342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ef6320ce-2090-4c53-af2b-465745500601 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:41.374271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c67c89-e2d4-401c-a020-7188c129a639 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:41.376053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ef6320ce-2090-4c53-af2b-465745500601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:41.379585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fa1ea-96f1-4123-8ef8-4bf8d1eca906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:41.381076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fa1ea-96f1-4123-8ef8-4bf8d1eca906 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.381653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fa1ea-96f1-4123-8ef8-4bf8d1eca906 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.382194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fa1ea-96f1-4123-8ef8-4bf8d1eca906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.397419 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 840/1714] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:41.398813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fa1ea-96f1-4123-8ef8-4bf8d1eca906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:41.399574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6320ce-2090-4c53-af2b-465745500601 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.400460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fa1ea-96f1-4123-8ef8-4bf8d1eca906 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:41.402105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ef6320ce-2090-4c53-af2b-465745500601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:41.423309 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 875/1715] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:41.424871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fa1ea-96f1-4123-8ef8-4bf8d1eca906 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.433082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6320ce-2090-4c53-af2b-465745500601 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:41.442396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fa1ea-96f1-4123-8ef8-4bf8d1eca906 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:41.442666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eedd3-8ff1-4c05-bfae-c26eb8682d03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:41.444087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eedd3-8ff1-4c05-bfae-c26eb8682d03 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.444697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eedd3-8ff1-4c05-bfae-c26eb8682d03 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.445509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594eedd3-8ff1-4c05-bfae-c26eb8682d03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.458595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482e7e6-2075-4c86-8625-11606458c760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:41.459420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482e7e6-2075-4c86-8625-11606458c760 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.459573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482e7e6-2075-4c86-8625-11606458c760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.459829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482e7e6-2075-4c86-8625-11606458c760 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.460503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482e7e6-2075-4c86-8625-11606458c760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:41.464029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482e7e6-2075-4c86-8625-11606458c760 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:41.467699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594eedd3-8ff1-4c05-bfae-c26eb8682d03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:41.471790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594eedd3-8ff1-4c05-bfae-c26eb8682d03 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:41.506914 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 841/1716] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:41.509084 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 876/1717] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:41 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:41.510918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eedd3-8ff1-4c05-bfae-c26eb8682d03 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.513856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482e7e6-2075-4c86-8625-11606458c760 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.515839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-594eedd3-8ff1-4c05-bfae-c26eb8682d03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:41.603687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594eedd3-8ff1-4c05-bfae-c26eb8682d03 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:41.684389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482e7e6-2075-4c86-8625-11606458c760 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:41.697730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372e165-d1e4-4283-8724-9f8db5dc7ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:41.698614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e165-d1e4-4283-8724-9f8db5dc7ecf admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.698986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e165-d1e4-4283-8724-9f8db5dc7ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.699260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e165-d1e4-4283-8724-9f8db5dc7ecf admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.701005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372e165-d1e4-4283-8724-9f8db5dc7ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:41.703388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372e165-d1e4-4283-8724-9f8db5dc7ecf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:41.779981 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 877/1718] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:41 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:41.781172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372e165-d1e4-4283-8724-9f8db5dc7ecf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.784031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0372e165-d1e4-4283-8724-9f8db5dc7ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:41.799821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f884a5-2503-4c2f-9b4d-68bbe1135557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:41.804259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f884a5-2503-4c2f-9b4d-68bbe1135557 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:41.804838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f884a5-2503-4c2f-9b4d-68bbe1135557 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:41.805307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f884a5-2503-4c2f-9b4d-68bbe1135557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:41.849214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f884a5-2503-4c2f-9b4d-68bbe1135557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:41.862882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f884a5-2503-4c2f-9b4d-68bbe1135557 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:41.922528 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 842/1719] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:41.924310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f884a5-2503-4c2f-9b4d-68bbe1135557 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:41.986736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f884a5-2503-4c2f-9b4d-68bbe1135557 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.006976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372e165-d1e4-4283-8724-9f8db5dc7ecf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.008545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c1696-4d60-44b1-9d1d-eb413d980b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.009763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c1696-4d60-44b1-9d1d-eb413d980b9f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.013090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c1696-4d60-44b1-9d1d-eb413d980b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.017416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3251147-7df6-402a-8c24-ad345ef8b076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.018455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251147-7df6-402a-8c24-ad345ef8b076 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.018907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251147-7df6-402a-8c24-ad345ef8b076 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.019349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3251147-7df6-402a-8c24-ad345ef8b076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.023654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c1696-4d60-44b1-9d1d-eb413d980b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.024346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c3251147-7df6-402a-8c24-ad345ef8b076 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:42.026707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c1696-4d60-44b1-9d1d-eb413d980b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.034640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c1696-4d60-44b1-9d1d-eb413d980b9f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:42.103526 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 843/1720] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:42.109036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:42.116365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c1696-4d60-44b1-9d1d-eb413d980b9f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.160807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3251147-7df6-402a-8c24-ad345ef8b076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.165295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3251147-7df6-402a-8c24-ad345ef8b076 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:42.169480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c1696-4d60-44b1-9d1d-eb413d980b9f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.201571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aac61d-a070-47c1-8385-a30f59262b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.202903 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 878/1721] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:42.206298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aac61d-a070-47c1-8385-a30f59262b90 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.209778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aac61d-a070-47c1-8385-a30f59262b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.211989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aac61d-a070-47c1-8385-a30f59262b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.213250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aac61d-a070-47c1-8385-a30f59262b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.223731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aac61d-a070-47c1-8385-a30f59262b90 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:42.282741 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 844/1722] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:42.289095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3251147-7df6-402a-8c24-ad345ef8b076 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.319043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3251147-7df6-402a-8c24-ad345ef8b076 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.351210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb33e-d507-4545-bfba-2e1bb7fe166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.354978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb33e-d507-4545-bfba-2e1bb7fe166e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.355756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb33e-d507-4545-bfba-2e1bb7fe166e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.357709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb33e-d507-4545-bfba-2e1bb7fe166e admin admin] PATH_INFO: `/v3/projects/d6dc848a4b494887b7f32e2bc7d0b796/users/90a5308fa4a04b5ebd30f97815cbfb03/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.432017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb33e-d507-4545-bfba-2e1bb7fe166e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6dc848a4b494887b7f32e2bc7d0b796, user_id=90a5308fa4a04b5ebd30f97815cbfb03, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.452904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb33e-d507-4545-bfba-2e1bb7fe166e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:42.497226 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 879/1723] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:42 2022] PUT /identity/v3/projects/d6dc848a4b494887b7f32e2bc7d0b796/users/90a5308fa4a04b5ebd30f97815cbfb03/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:42.524861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71191955-8bbd-4c7e-8a1e-b4c33f376cb4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.526645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71191955-8bbd-4c7e-8a1e-b4c33f376cb4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.527395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71191955-8bbd-4c7e-8a1e-b4c33f376cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.627327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-71191955-8bbd-4c7e-8a1e-b4c33f376cb4 None None] MFA Rules not processed for user `90a5308fa4a04b5ebd30f97815cbfb03`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:42.633203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-71191955-8bbd-4c7e-8a1e-b4c33f376cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:42.716946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb33e-d507-4545-bfba-2e1bb7fe166e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.825766 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 845/1724] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:42.827884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71191955-8bbd-4c7e-8a1e-b4c33f376cb4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:42.833709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-71191955-8bbd-4c7e-8a1e-b4c33f376cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:42.881545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:42.953475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71191955-8bbd-4c7e-8a1e-b4c33f376cb4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:42.959684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:42.960723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:42.963271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:42.963868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] PATH_INFO: `/v3/projects/abaa814437884995aeb3a6e4fa2b469e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:42.966479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abaa814437884995aeb3a6e4fa2b469e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:42.973599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:43.048374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abaa814437884995aeb3a6e4fa2b469e', 'request_id': 'req-d32faf43-45c6-4e85-92ac-41d356be543f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.064915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abaa814437884995aeb3a6e4fa2b469e', 'request_id': 'req-d32faf43-45c6-4e85-92ac-41d356be543f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.077022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abaa814437884995aeb3a6e4fa2b469e', 'request_id': 'req-d32faf43-45c6-4e85-92ac-41d356be543f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.085401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb33e-d507-4545-bfba-2e1bb7fe166e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:43.117780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] The token cache is being invalidate because project abaa814437884995aeb3a6e4fa2b469e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:13:43.119362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.121006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.125594 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 846/1725] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:42 2022] DELETE /identity/v3/projects/abaa814437884995aeb3a6e4fa2b469e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:43.126813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:43.128386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:43.288590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32faf43-45c6-4e85-92ac-41d356be543f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:43.295084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccbfa2-9c5d-465b-8929-0a3b6e7db804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:43.295678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccbfa2-9c5d-465b-8929-0a3b6e7db804 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:43.295958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccbfa2-9c5d-465b-8929-0a3b6e7db804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:43.296226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccbfa2-9c5d-465b-8929-0a3b6e7db804 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:43.297076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccbfa2-9c5d-465b-8929-0a3b6e7db804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:43.299313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccbfa2-9c5d-465b-8929-0a3b6e7db804 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:43.312531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b228a-806d-4ce3-b6d5-d6e47157e492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:43.313587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b228a-806d-4ce3-b6d5-d6e47157e492 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:43.314115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b228a-806d-4ce3-b6d5-d6e47157e492 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:43.314604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b228a-806d-4ce3-b6d5-d6e47157e492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:43.323622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-df7b228a-806d-4ce3-b6d5-d6e47157e492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:43.340769 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 847/1726] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:43 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:43.342128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccbfa2-9c5d-465b-8929-0a3b6e7db804 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:43.344420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-62ccbfa2-9c5d-465b-8929-0a3b6e7db804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:43.411975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:43.470427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccbfa2-9c5d-465b-8929-0a3b6e7db804 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:43.485140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:43.487316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:43.488322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:43.490691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] PATH_INFO: `/v3/users/b219c7e9d2fd4a5d8fa038d4d70e2793` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:43.492521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b219c7e9d2fd4a5d8fa038d4d70e2793)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:43.498771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:43.532185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:43.570046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b228a-806d-4ce3-b6d5-d6e47157e492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:43.573487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b228a-806d-4ce3-b6d5-d6e47157e492 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:43.589511 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 880/1727] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 872 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:43.591656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b228a-806d-4ce3-b6d5-d6e47157e492 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:43.613082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b228a-806d-4ce3-b6d5-d6e47157e492 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:43.623192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e13b2-8bf4-4bc0-bda8-409304d4d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:43.623843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e13b2-8bf4-4bc0-bda8-409304d4d5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:43.624214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e13b2-8bf4-4bc0-bda8-409304d4d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:43.624500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e13b2-8bf4-4bc0-bda8-409304d4d5a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:43.625182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e13b2-8bf4-4bc0-bda8-409304d4d5a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:43.627360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e13b2-8bf4-4bc0-bda8-409304d4d5a0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:43.682034 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 881/1728] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:43 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:43.683090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e13b2-8bf4-4bc0-bda8-409304d4d5a0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:43.685959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aa9e13b2-8bf4-4bc0-bda8-409304d4d5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:43.711225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b219c7e9d2fd4a5d8fa038d4d70e2793'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.712970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e13b2-8bf4-4bc0-bda8-409304d4d5a0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:43.726132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:43.727090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:43.727217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:43.727553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] PATH_INFO: `/v3/projects/fc9f602898c54d2f95a73b97a7c4f845` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:43.729460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9f602898c54d2f95a73b97a7c4f845)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:43.732218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:43.797792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b219c7e9d2fd4a5d8fa038d4d70e2793'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.840126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b219c7e9d2fd4a5d8fa038d4d70e2793'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.880813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b219c7e9d2fd4a5d8fa038d4d70e2793'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.881801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b219c7e9d2fd4a5d8fa038d4d70e2793'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.902022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9f602898c54d2f95a73b97a7c4f845', 'request_id': 'req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.908040 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 848/1729] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:43 2022] DELETE /identity/v3/users/b219c7e9d2fd4a5d8fa038d4d70e2793 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:43.909031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:43.913834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:43.938329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9f602898c54d2f95a73b97a7c4f845', 'request_id': 'req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:43.960210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9f602898c54d2f95a73b97a7c4f845', 'request_id': 'req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:44.010190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] The token cache is being invalidate because project fc9f602898c54d2f95a73b97a7c4f845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:13:44.010856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:44.012108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac8ff24d-9c8f-4cbd-9e14-ab0d6b7820a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:44.015521 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 882/1730] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:43 2022] DELETE /identity/v3/projects/fc9f602898c54d2f95a73b97a7c4f845 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:44.019290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b26f8e-8d47-4c4b-954a-46cfd965136e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:44.020588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b26f8e-8d47-4c4b-954a-46cfd965136e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:44.021218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b26f8e-8d47-4c4b-954a-46cfd965136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:44.060772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b2b26f8e-8d47-4c4b-954a-46cfd965136e None None] MFA Rules not processed for user `d387739ecdf14841a888667e6d09b1e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:44.063999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b2b26f8e-8d47-4c4b-954a-46cfd965136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:44.199097 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 883/1731] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:44.202548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b26f8e-8d47-4c4b-954a-46cfd965136e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:44.202548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b2b26f8e-8d47-4c4b-954a-46cfd965136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:44.215477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4480d-e945-4842-9e57-9f8072578ac4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:44.228629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7091d2-ac5b-441c-9cb5-52beed87c35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:44.231129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7091d2-ac5b-441c-9cb5-52beed87c35e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:44.231432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7091d2-ac5b-441c-9cb5-52beed87c35e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:44.231701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7091d2-ac5b-441c-9cb5-52beed87c35e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:44.237479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7091d2-ac5b-441c-9cb5-52beed87c35e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:44.244015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7091d2-ac5b-441c-9cb5-52beed87c35e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:44.251448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b26f8e-8d47-4c4b-954a-46cfd965136e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:44.260482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:44.262949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:44.263613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:44.264224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] PATH_INFO: `/v3/users/c64df393f7fe4a77add994a30b5d8a2a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:44.266561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64df393f7fe4a77add994a30b5d8a2a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:44.275626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:44.295167 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 849/1732] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:44.302295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7091d2-ac5b-441c-9cb5-52beed87c35e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:44.304901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9e7091d2-ac5b-441c-9cb5-52beed87c35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:44.359456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7091d2-ac5b-441c-9cb5-52beed87c35e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:44.375574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475af10-690d-404c-9e74-88e946380f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:44.376389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475af10-690d-404c-9e74-88e946380f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:44.376655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475af10-690d-404c-9e74-88e946380f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:44.376852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475af10-690d-404c-9e74-88e946380f7f admin admin] PATH_INFO: `/v3/projects/7b1c98aa20d149e0b0635375340755c7/users/cd9bb00de36a482ba29a9427506656c3/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:44.409001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64df393f7fe4a77add994a30b5d8a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:44.428068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64df393f7fe4a77add994a30b5d8a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:44.433675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:44.436466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475af10-690d-404c-9e74-88e946380f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1c98aa20d149e0b0635375340755c7, user_id=cd9bb00de36a482ba29a9427506656c3, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:44.449211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64df393f7fe4a77add994a30b5d8a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:44.450933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475af10-690d-404c-9e74-88e946380f7f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:44.470648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64df393f7fe4a77add994a30b5d8a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:44.520639 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 850/1733] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:44 2022] PUT /identity/v3/projects/7b1c98aa20d149e0b0635375340755c7/users/cd9bb00de36a482ba29a9427506656c3/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:44.526202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475af10-690d-404c-9e74-88e946380f7f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:44.536560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a475af10-690d-404c-9e74-88e946380f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:44.587425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64df393f7fe4a77add994a30b5d8a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:44.674840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:44.699608 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 884/1734] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:44 2022] DELETE /identity/v3/users/c64df393f7fe4a77add994a30b5d8a2a => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:44.701186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:44.707818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:44.984343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72fcc7-c77a-47f7-a3dd-efa3c6c9af0e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:44.996915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc804b-6700-42b3-b9c6-559990f7b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:44.999189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc804b-6700-42b3-b9c6-559990f7b1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:45.000068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc804b-6700-42b3-b9c6-559990f7b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:45.000977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc804b-6700-42b3-b9c6-559990f7b1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:45.003035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc804b-6700-42b3-b9c6-559990f7b1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:45.005163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475af10-690d-404c-9e74-88e946380f7f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:45.011880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc804b-6700-42b3-b9c6-559990f7b1d6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:45.081702 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 885/1735] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:45.090373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc804b-6700-42b3-b9c6-559990f7b1d6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:45.179059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc804b-6700-42b3-b9c6-559990f7b1d6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:45.213415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40e941-7df9-4551-b1a4-00e3d868d4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:45.223065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40e941-7df9-4551-b1a4-00e3d868d4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:45.223322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40e941-7df9-4551-b1a4-00e3d868d4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:45.223630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40e941-7df9-4551-b1a4-00e3d868d4b4 admin admin] PATH_INFO: `/v3/projects/7b1c98aa20d149e0b0635375340755c7/users/cd9bb00de36a482ba29a9427506656c3/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:45.229434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40e941-7df9-4551-b1a4-00e3d868d4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1c98aa20d149e0b0635375340755c7, user_id=cd9bb00de36a482ba29a9427506656c3, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:45.240718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40e941-7df9-4551-b1a4-00e3d868d4b4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:45.297418 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 886/1736] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:45 2022] PUT /identity/v3/projects/7b1c98aa20d149e0b0635375340755c7/users/cd9bb00de36a482ba29a9427506656c3/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:45.314580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6960-a1db-45b9-ba92-b3a36d2ed7b5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:45.315308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6960-a1db-45b9-ba92-b3a36d2ed7b5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:45.315308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b6960-a1db-45b9-ba92-b3a36d2ed7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:45.406984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd91d2-ef76-4be0-9ccf-4d5deb3c5f34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:45.410888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd91d2-ef76-4be0-9ccf-4d5deb3c5f34 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:45.417484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd91d2-ef76-4be0-9ccf-4d5deb3c5f34 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:45.419382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd91d2-ef76-4be0-9ccf-4d5deb3c5f34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:45.446138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5e8b6960-a1db-45b9-ba92-b3a36d2ed7b5 None None] MFA Rules not processed for user `cd9bb00de36a482ba29a9427506656c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:45.452710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5e8b6960-a1db-45b9-ba92-b3a36d2ed7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:45.454576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-12cd91d2-ef76-4be0-9ccf-4d5deb3c5f34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:45.794032 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 887/1737] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 30 04:13:45.804758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6960-a1db-45b9-ba92-b3a36d2ed7b5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:45.813821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5e8b6960-a1db-45b9-ba92-b3a36d2ed7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:45.837139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd91d2-ef76-4be0-9ccf-4d5deb3c5f34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:45.845573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd91d2-ef76-4be0-9ccf-4d5deb3c5f34 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:45.870734 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 851/1738] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:45.873170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113f3db-a894-42a8-b48a-6952f2d29a09 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:45.874201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113f3db-a894-42a8-b48a-6952f2d29a09 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:45.874687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113f3db-a894-42a8-b48a-6952f2d29a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:46.009247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:46.107946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b6960-a1db-45b9-ba92-b3a36d2ed7b5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:46.118467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5113f3db-a894-42a8-b48a-6952f2d29a09 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:46.121767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5113f3db-a894-42a8-b48a-6952f2d29a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:46.130723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:46.132270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:46.138640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:46.140838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] PATH_INFO: `/v3/projects/bb9e0ff062c649f29d136cdccd89143c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:46.151640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9e0ff062c649f29d136cdccd89143c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:46.162980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:46.215384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:46.292706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9e0ff062c649f29d136cdccd89143c', 'request_id': 'req-be35301f-10d2-4bff-a163-5796e5f0bc34'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:46.307130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9e0ff062c649f29d136cdccd89143c', 'request_id': 'req-be35301f-10d2-4bff-a163-5796e5f0bc34'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:46.326336 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 852/1739] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:13:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:46.330174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9e0ff062c649f29d136cdccd89143c', 'request_id': 'req-be35301f-10d2-4bff-a163-5796e5f0bc34'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:46.333966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113f3db-a894-42a8-b48a-6952f2d29a09 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:46.341097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5113f3db-a894-42a8-b48a-6952f2d29a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:46.373456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] The token cache is being invalidate because project bb9e0ff062c649f29d136cdccd89143c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:13:46.373456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:46.375672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:46.380738 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 888/1740] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:45 2022] DELETE /identity/v3/projects/bb9e0ff062c649f29d136cdccd89143c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:46.382477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:46.400457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:46.412585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113f3db-a894-42a8-b48a-6952f2d29a09 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:46.576629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:46.577591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:46.577903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:46.579977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] PATH_INFO: `/v3/projects/52f3928cb54b45939f6e2a4e95ac33e9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:46.586671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f3928cb54b45939f6e2a4e95ac33e9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:46.593237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:46.643288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35301f-10d2-4bff-a163-5796e5f0bc34 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:46.656484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49a055-8d26-4a7e-b545-3a85df2c33da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:46.657265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49a055-8d26-4a7e-b545-3a85df2c33da service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:46.658104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49a055-8d26-4a7e-b545-3a85df2c33da service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:46.659639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49a055-8d26-4a7e-b545-3a85df2c33da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:46.663627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9a49a055-8d26-4a7e-b545-3a85df2c33da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:46.743120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f3928cb54b45939f6e2a4e95ac33e9', 'request_id': 'req-50339bf5-6689-4b2c-9349-5007f8f75fd4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:46.768391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f3928cb54b45939f6e2a4e95ac33e9', 'request_id': 'req-50339bf5-6689-4b2c-9349-5007f8f75fd4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:46.781214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f3928cb54b45939f6e2a4e95ac33e9', 'request_id': 'req-50339bf5-6689-4b2c-9349-5007f8f75fd4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:46.819514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] The token cache is being invalidate because project 52f3928cb54b45939f6e2a4e95ac33e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:13:46.819786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:46.822527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50339bf5-6689-4b2c-9349-5007f8f75fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:46.827625 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 853/1741] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:46 2022] DELETE /identity/v3/projects/52f3928cb54b45939f6e2a4e95ac33e9 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:46.828876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ddebb-1e6d-41e7-af34-efa039891b2b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:46.829197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ddebb-1e6d-41e7-af34-efa039891b2b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:46.829472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ddebb-1e6d-41e7-af34-efa039891b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:46.875779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49a055-8d26-4a7e-b545-3a85df2c33da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:46.880629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f92ddebb-1e6d-41e7-af34-efa039891b2b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:46.881969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f92ddebb-1e6d-41e7-af34-efa039891b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:46.882134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49a055-8d26-4a7e-b545-3a85df2c33da service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:46.904979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:46.922725 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 889/1742] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:46.930798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49a055-8d26-4a7e-b545-3a85df2c33da service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:46.937195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9a49a055-8d26-4a7e-b545-3a85df2c33da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.046859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:47.104767 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 854/1743] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:47.106739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7873e-3304-4f87-9592-1648f4bc7497 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.109148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7873e-3304-4f87-9592-1648f4bc7497 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.110337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7873e-3304-4f87-9592-1648f4bc7497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.143481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fbe7873e-3304-4f87-9592-1648f4bc7497 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:47.144192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fbe7873e-3304-4f87-9592-1648f4bc7497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.156923 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 855/1744] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:47.159597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17975fc3-07a7-4f65-9eed-a1430367c75e None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.160117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17975fc3-07a7-4f65-9eed-a1430367c75e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.161682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17975fc3-07a7-4f65-9eed-a1430367c75e None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.168961 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 856/1745] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:13:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:47.170699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.171091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.171505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.214408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:47.216589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.240164 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 857/1746] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:47.241294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:13:47.246733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.297412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49a055-8d26-4a7e-b545-3a85df2c33da service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:47.425751 n-d-820368-36 devstack@keystone.service[82099]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 30 04:13:47.426116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:47.430177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.475259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71720205-db93-4839-8813-0ea1113ef116 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:47.477385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71720205-db93-4839-8813-0ea1113ef116 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.477899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71720205-db93-4839-8813-0ea1113ef116 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.480905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71720205-db93-4839-8813-0ea1113ef116 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.502716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-71720205-db93-4839-8813-0ea1113ef116 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.656844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71720205-db93-4839-8813-0ea1113ef116 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:47.658753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71720205-db93-4839-8813-0ea1113ef116 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:47.671997 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 890/1747] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:13:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:13:47.708604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd805e-5943-4b16-8bd6-4b79649ec64a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.709274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd805e-5943-4b16-8bd6-4b79649ec64a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.709645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd805e-5943-4b16-8bd6-4b79649ec64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.731434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae9395-cc23-49e6-a313-671da0445a4b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:47.756710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f6793-555a-476a-96be-cb3902aaa7be tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9bb00de36a482ba29a9427506656c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b1c98aa20d149e0b0635375340755c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:47.757060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f6793-555a-476a-96be-cb3902aaa7be tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.757354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f6793-555a-476a-96be-cb3902aaa7be tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.757632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f6793-555a-476a-96be-cb3902aaa7be tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] PATH_INFO: `/v3/projects/d6dc848a4b494887b7f32e2bc7d0b796` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.759590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f6793-555a-476a-96be-cb3902aaa7be tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] RBAC: Authorizing `identity:get_project(project_id=d6dc848a4b494887b7f32e2bc7d0b796)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:47.765369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f6793-555a-476a-96be-cb3902aaa7be tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:47.768247 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 858/1748] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:13:47 2022] GET /identity/v3/projects/d6dc848a4b494887b7f32e2bc7d0b796 => generated 379 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:47.771857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f6793-555a-476a-96be-cb3902aaa7be tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:47.784579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-90cd805e-5943-4b16-8bd6-4b79649ec64a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:47.788543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f6793-555a-476a-96be-cb3902aaa7be tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:47.788741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-90cd805e-5943-4b16-8bd6-4b79649ec64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.819518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f2460-ff73-4aa9-ad1e-e7654548226a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:47.820171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f2460-ff73-4aa9-ad1e-e7654548226a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.820441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f2460-ff73-4aa9-ad1e-e7654548226a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.820711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f2460-ff73-4aa9-ad1e-e7654548226a admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.821400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f2460-ff73-4aa9-ad1e-e7654548226a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:47.826676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f2460-ff73-4aa9-ad1e-e7654548226a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:47.837172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f2460-ff73-4aa9-ad1e-e7654548226a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:47.846490 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 891/1749] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:47.848127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd805e-5943-4b16-8bd6-4b79649ec64a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:47.858812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-90cd805e-5943-4b16-8bd6-4b79649ec64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:47.889829 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 859/1750] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:47.891918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f2460-ff73-4aa9-ad1e-e7654548226a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:47.933681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f2460-ff73-4aa9-ad1e-e7654548226a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:47.951964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72b85d-519a-46d1-a0e1-3acb8d1450a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:47.955078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72b85d-519a-46d1-a0e1-3acb8d1450a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:47.955421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72b85d-519a-46d1-a0e1-3acb8d1450a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:47.955636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72b85d-519a-46d1-a0e1-3acb8d1450a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:47.962005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72b85d-519a-46d1-a0e1-3acb8d1450a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:13:47.962384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72b85d-519a-46d1-a0e1-3acb8d1450a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:47.966787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72b85d-519a-46d1-a0e1-3acb8d1450a0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:47.980239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd805e-5943-4b16-8bd6-4b79649ec64a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:47.999323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a964716-0c5e-43e3-a845-8c20eb133681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.000642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a964716-0c5e-43e3-a845-8c20eb133681 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.000642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a964716-0c5e-43e3-a845-8c20eb133681 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.000642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a964716-0c5e-43e3-a845-8c20eb133681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.009264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8a964716-0c5e-43e3-a845-8c20eb133681 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:48.027519 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 860/1751] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:48.028670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72b85d-519a-46d1-a0e1-3acb8d1450a0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.062833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:48.073747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72b85d-519a-46d1-a0e1-3acb8d1450a0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.098937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d51354-62a4-4a2f-a457-49737c2a35e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.100906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d51354-62a4-4a2f-a457-49737c2a35e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.101190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d51354-62a4-4a2f-a457-49737c2a35e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.101461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d51354-62a4-4a2f-a457-49737c2a35e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.109421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d51354-62a4-4a2f-a457-49737c2a35e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:48.132153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d51354-62a4-4a2f-a457-49737c2a35e1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:48.231348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a964716-0c5e-43e3-a845-8c20eb133681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:48.233092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a964716-0c5e-43e3-a845-8c20eb133681 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:48.250772 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 861/1752] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:48 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:48.252704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d51354-62a4-4a2f-a457-49737c2a35e1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.255761 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 892/1753] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:48.256684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a964716-0c5e-43e3-a845-8c20eb133681 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.289969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a964716-0c5e-43e3-a845-8c20eb133681 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.357104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:48.480363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d51354-62a4-4a2f-a457-49737c2a35e1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.501974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd8ae6-7d56-426d-8a25-b36ec91e9c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.506814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd8ae6-7d56-426d-8a25-b36ec91e9c9a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.507105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd8ae6-7d56-426d-8a25-b36ec91e9c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.507399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd8ae6-7d56-426d-8a25-b36ec91e9c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.509040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd8ae6-7d56-426d-8a25-b36ec91e9c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:48.511840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd8ae6-7d56-426d-8a25-b36ec91e9c9a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:48.585836 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 862/1754] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:48 2022] POST /identity/v3/projects => generated 371 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:48.586900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd8ae6-7d56-426d-8a25-b36ec91e9c9a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.590227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f2e7b-903e-41b2-aac0-c5e1cbea6f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.591836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f2e7b-903e-41b2-aac0-c5e1cbea6f02 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.595294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f2e7b-903e-41b2-aac0-c5e1cbea6f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.596255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f2e7b-903e-41b2-aac0-c5e1cbea6f02 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.601022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f2e7b-903e-41b2-aac0-c5e1cbea6f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:48.609918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f2e7b-903e-41b2-aac0-c5e1cbea6f02 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:48.784658 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 893/1755] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:48 2022] POST /identity/v3/users => generated 288 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:48.787291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f2e7b-903e-41b2-aac0-c5e1cbea6f02 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:48.799423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd8ae6-7d56-426d-8a25-b36ec91e9c9a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.814724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f2e7b-903e-41b2-aac0-c5e1cbea6f02 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:48.841308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61c8a1-e25d-4fa2-8c52-dabb51847e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:48.841986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61c8a1-e25d-4fa2-8c52-dabb51847e44 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:48.842267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61c8a1-e25d-4fa2-8c52-dabb51847e44 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:48.842537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61c8a1-e25d-4fa2-8c52-dabb51847e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:48.867325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ee61c8a1-e25d-4fa2-8c52-dabb51847e44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:49.003015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56818f7a-5b05-43c7-8be9-85035021e0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.004020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56818f7a-5b05-43c7-8be9-85035021e0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.004168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56818f7a-5b05-43c7-8be9-85035021e0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.004422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56818f7a-5b05-43c7-8be9-85035021e0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.005145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56818f7a-5b05-43c7-8be9-85035021e0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.012057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56818f7a-5b05-43c7-8be9-85035021e0a1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.060062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61c8a1-e25d-4fa2-8c52-dabb51847e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.065480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61c8a1-e25d-4fa2-8c52-dabb51847e44 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.071216 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 894/1756] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:48 2022] POST /identity/v3/users => generated 286 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:49.073843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56818f7a-5b05-43c7-8be9-85035021e0a1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.110554 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 863/1757] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:49.112870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61c8a1-e25d-4fa2-8c52-dabb51847e44 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.121442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56818f7a-5b05-43c7-8be9-85035021e0a1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.203576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61c8a1-e25d-4fa2-8c52-dabb51847e44 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.211232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d79194-bfae-4791-9bad-fcb682f3ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.212336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d79194-bfae-4791-9bad-fcb682f3ba83 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.212804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d79194-bfae-4791-9bad-fcb682f3ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.213276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d79194-bfae-4791-9bad-fcb682f3ba83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.214503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d79194-bfae-4791-9bad-fcb682f3ba83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.217526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d79194-bfae-4791-9bad-fcb682f3ba83 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.234577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37792087-f89a-4321-a4f3-a74164889970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.247165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37792087-f89a-4321-a4f3-a74164889970 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.252697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37792087-f89a-4321-a4f3-a74164889970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.253647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37792087-f89a-4321-a4f3-a74164889970 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.261012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37792087-f89a-4321-a4f3-a74164889970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.276423 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 895/1758] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:49.282392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37792087-f89a-4321-a4f3-a74164889970 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.282608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d79194-bfae-4791-9bad-fcb682f3ba83 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.316844 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 864/1759] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:49.328691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d79194-bfae-4791-9bad-fcb682f3ba83 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.331942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37792087-f89a-4321-a4f3-a74164889970 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.371702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37792087-f89a-4321-a4f3-a74164889970 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.373929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3bbd7-d4af-40e0-9a47-9f293ede3cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.375009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3bbd7-d4af-40e0-9a47-9f293ede3cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.376327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3bbd7-d4af-40e0-9a47-9f293ede3cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.376327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3bbd7-d4af-40e0-9a47-9f293ede3cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.377227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3bbd7-d4af-40e0-9a47-9f293ede3cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.380656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3bbd7-d4af-40e0-9a47-9f293ede3cd5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.388158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3dee-dc99-4cae-b078-29bf6feb05f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.388951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3dee-dc99-4cae-b078-29bf6feb05f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.389295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3dee-dc99-4cae-b078-29bf6feb05f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.389563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3dee-dc99-4cae-b078-29bf6feb05f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.392625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb3dee-dc99-4cae-b078-29bf6feb05f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.401950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb3dee-dc99-4cae-b078-29bf6feb05f5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.426766 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 896/1760] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:49.429312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3bbd7-d4af-40e0-9a47-9f293ede3cd5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.449488 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 865/1761] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:49.455328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3dee-dc99-4cae-b078-29bf6feb05f5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:49.489212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3bbd7-d4af-40e0-9a47-9f293ede3cd5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.501655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3dee-dc99-4cae-b078-29bf6feb05f5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:49.511090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db97566-b58f-42ac-8503-2e00ea03680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.512251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97566-b58f-42ac-8503-2e00ea03680f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.512725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97566-b58f-42ac-8503-2e00ea03680f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.513200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97566-b58f-42ac-8503-2e00ea03680f admin admin] PATH_INFO: `/v3/projects/313e78337dd0491bb7628aa388ba40e8/users/4b4962b8db314402b1a2e4ca05734b55/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.530306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2828-4e31-4658-b637-296ad2aade90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:49.531093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2828-4e31-4658-b637-296ad2aade90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.532982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2828-4e31-4658-b637-296ad2aade90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.533235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2828-4e31-4658-b637-296ad2aade90 admin admin] PATH_INFO: `/v3/projects/b5ff5d874a014ecc9916a3a39cffb5de/users/281f421daf9d49bfb5db36b3edcb2b96/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.551595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:49.572230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db97566-b58f-42ac-8503-2e00ea03680f admin admin] RBAC: Authorizing `identity:create_grant(project_id=313e78337dd0491bb7628aa388ba40e8, user_id=4b4962b8db314402b1a2e4ca05734b55, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.587770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2828-4e31-4658-b637-296ad2aade90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ff5d874a014ecc9916a3a39cffb5de, user_id=281f421daf9d49bfb5db36b3edcb2b96, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:49.593190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db97566-b58f-42ac-8503-2e00ea03680f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.598032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2828-4e31-4658-b637-296ad2aade90 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:49.638361 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 866/1762] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:49 2022] PUT /identity/v3/projects/b5ff5d874a014ecc9916a3a39cffb5de/users/281f421daf9d49bfb5db36b3edcb2b96/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:49.643025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40423d-4208-4963-ad71-fd7c3f42cf31 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.644758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40423d-4208-4963-ad71-fd7c3f42cf31 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.645078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40423d-4208-4963-ad71-fd7c3f42cf31 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.656711 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 897/1764] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:49 2022] PUT /identity/v3/projects/313e78337dd0491bb7628aa388ba40e8/users/4b4962b8db314402b1a2e4ca05734b55/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:49.657798 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 867/1764] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:13:49 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:49.663551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ced5-a718-4edb-ace2-393cbbcce923 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.664062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ced5-a718-4edb-ace2-393cbbcce923 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.664555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052ced5-a718-4edb-ace2-393cbbcce923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.668301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378412a-9970-40aa-8f7b-bb92dc102175 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:49.669090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378412a-9970-40aa-8f7b-bb92dc102175 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:49.669292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378412a-9970-40aa-8f7b-bb92dc102175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:49.821638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:49.860574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3378412a-9970-40aa-8f7b-bb92dc102175 None None] MFA Rules not processed for user `4b4962b8db314402b1a2e4ca05734b55`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:49.865642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3378412a-9970-40aa-8f7b-bb92dc102175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:49.913120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9052ced5-a718-4edb-ace2-393cbbcce923 None None] MFA Rules not processed for user `281f421daf9d49bfb5db36b3edcb2b96`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:49.915202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9052ced5-a718-4edb-ace2-393cbbcce923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:50.106131 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 868/1765] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:50.111373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378412a-9970-40aa-8f7b-bb92dc102175 None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:13:50.166545 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 898/1766] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:50.170369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e62ff-db7e-4b4b-baae-6a6db5c4d8ae None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:50.170817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e62ff-db7e-4b4b-baae-6a6db5c4d8ae None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:50.171256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e62ff-db7e-4b4b-baae-6a6db5c4d8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:50.311792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e90e62ff-db7e-4b4b-baae-6a6db5c4d8ae None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:50.313764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e90e62ff-db7e-4b4b-baae-6a6db5c4d8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:50.351221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378412a-9970-40aa-8f7b-bb92dc102175 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:50.537663 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 899/1767] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 30 04:13:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:50.540456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e62ff-db7e-4b4b-baae-6a6db5c4d8ae None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:50.649726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378412a-9970-40aa-8f7b-bb92dc102175 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:50.666260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8a96f-0505-4373-9ad8-0c4a0d1a4d11 tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd9bb00de36a482ba29a9427506656c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b1c98aa20d149e0b0635375340755c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:50.666935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8a96f-0505-4373-9ad8-0c4a0d1a4d11 tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:50.667206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8a96f-0505-4373-9ad8-0c4a0d1a4d11 tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:50.667478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8a96f-0505-4373-9ad8-0c4a0d1a4d11 tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] PATH_INFO: `/v3/projects/d6dc848a4b494887b7f32e2bc7d0b796` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:50.668963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8a96f-0505-4373-9ad8-0c4a0d1a4d11 tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] RBAC: Authorizing `identity:get_project(project_id=d6dc848a4b494887b7f32e2bc7d0b796)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:50.671303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8a96f-0505-4373-9ad8-0c4a0d1a4d11 tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:50.684394 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 869/1768] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:13:50 2022] GET /identity/v3/projects/d6dc848a4b494887b7f32e2bc7d0b796 => generated 379 bytes in 572 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:13:50.684394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8a96f-0505-4373-9ad8-0c4a0d1a4d11 tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:50.777553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e62ff-db7e-4b4b-baae-6a6db5c4d8ae None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:50.794935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384a48-b5f4-4b9a-8f64-f31b028eb6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:50.795565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384a48-b5f4-4b9a-8f64-f31b028eb6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:50.795908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384a48-b5f4-4b9a-8f64-f31b028eb6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:50.796135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91384a48-b5f4-4b9a-8f64-f31b028eb6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:50.806002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384a48-b5f4-4b9a-8f64-f31b028eb6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:50.806002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91384a48-b5f4-4b9a-8f64-f31b028eb6c4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:50.809292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:50.884425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8a96f-0505-4373-9ad8-0c4a0d1a4d11 tempest-FlavorsAccessTestJSON-1902317393 tempest-FlavorsAccessTestJSON-1902317393-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:50.892363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1d6f4-9983-42a1-84cd-80bca5a2ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:50.892914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:50.893402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1d6f4-9983-42a1-84cd-80bca5a2ad47 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:50.893717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1d6f4-9983-42a1-84cd-80bca5a2ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:50.894200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1d6f4-9983-42a1-84cd-80bca5a2ad47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:50.896859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1d6f4-9983-42a1-84cd-80bca5a2ad47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:50.899905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1d6f4-9983-42a1-84cd-80bca5a2ad47 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:50.907431 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 900/1769] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:50 2022] POST /identity/v3/projects => generated 373 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:50.908877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384a48-b5f4-4b9a-8f64-f31b028eb6c4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:50.918067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-91384a48-b5f4-4b9a-8f64-f31b028eb6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:51.005068 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 870/1770] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:13:50 2022] POST /identity/v3/projects => generated 371 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:51.011124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1d6f4-9983-42a1-84cd-80bca5a2ad47 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:51.083488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91384a48-b5f4-4b9a-8f64-f31b028eb6c4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:51.134652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1d6f4-9983-42a1-84cd-80bca5a2ad47 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:51.143272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad01be-f7e9-41e1-8df9-68948d0e5ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:51.144002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad01be-f7e9-41e1-8df9-68948d0e5ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:51.144556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad01be-f7e9-41e1-8df9-68948d0e5ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:51.144909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad01be-f7e9-41e1-8df9-68948d0e5ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:51.145658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad01be-f7e9-41e1-8df9-68948d0e5ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:51.148983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad01be-f7e9-41e1-8df9-68948d0e5ae0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:51.188014 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 871/1771] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:51 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:51.193939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad01be-f7e9-41e1-8df9-68948d0e5ae0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:51.212697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad01be-f7e9-41e1-8df9-68948d0e5ae0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:51.221319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb0c59-370e-4a1a-9222-3b13ed21423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:51.224614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb0c59-370e-4a1a-9222-3b13ed21423f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:51.225077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb0c59-370e-4a1a-9222-3b13ed21423f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:51.225709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb0c59-370e-4a1a-9222-3b13ed21423f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:51.226776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb0c59-370e-4a1a-9222-3b13ed21423f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:51.230609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb0c59-370e-4a1a-9222-3b13ed21423f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:51.245702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a5a90-3e77-42c7-b2ae-69b60baf41f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:51.247118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a5a90-3e77-42c7-b2ae-69b60baf41f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:51.247468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a5a90-3e77-42c7-b2ae-69b60baf41f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:51.248876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a5a90-3e77-42c7-b2ae-69b60baf41f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:51.282028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a5a90-3e77-42c7-b2ae-69b60baf41f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:51.283575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a5a90-3e77-42c7-b2ae-69b60baf41f5 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:51.292375 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 872/1772] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:13:51 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:13:51.295667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb0c59-370e-4a1a-9222-3b13ed21423f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:51.322019 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 901/1773] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:51.324423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a5a90-3e77-42c7-b2ae-69b60baf41f5 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:51.338868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb0c59-370e-4a1a-9222-3b13ed21423f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:51.370329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b3e0-d6ca-4309-8da9-f21a8aac44ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:51.372451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b3e0-d6ca-4309-8da9-f21a8aac44ad admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:51.378787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b3e0-d6ca-4309-8da9-f21a8aac44ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:51.379084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a5a90-3e77-42c7-b2ae-69b60baf41f5 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:51.379787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b3e0-d6ca-4309-8da9-f21a8aac44ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:51.385018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418b3e0-d6ca-4309-8da9-f21a8aac44ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:51.393023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e5aa9-80e2-4e25-b612-725fd5ecef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:51.393679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e5aa9-80e2-4e25-b612-725fd5ecef27 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:51.393982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e5aa9-80e2-4e25-b612-725fd5ecef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:51.394287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e5aa9-80e2-4e25-b612-725fd5ecef27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:51.397974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418b3e0-d6ca-4309-8da9-f21a8aac44ad admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:51.401579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e5aa9-80e2-4e25-b612-725fd5ecef27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:51.410517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e5aa9-80e2-4e25-b612-725fd5ecef27 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:51.453593 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 902/1774] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:51.464617 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 873/1775] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:51.465691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e5aa9-80e2-4e25-b612-725fd5ecef27 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:51.469051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b3e0-d6ca-4309-8da9-f21a8aac44ad admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:51.491268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e5aa9-80e2-4e25-b612-725fd5ecef27 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:51.516898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6555b-9862-4b2c-aa52-b2c7a6023aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:51.517639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6555b-9862-4b2c-aa52-b2c7a6023aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:51.518071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6555b-9862-4b2c-aa52-b2c7a6023aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:51.518218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6555b-9862-4b2c-aa52-b2c7a6023aeb admin admin] PATH_INFO: `/v3/projects/dd7cf90f35e545bbb1e2dd3caf37f6ad/users/af73740918cc410189ccf8a30f81be21/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:51.523638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b3e0-d6ca-4309-8da9-f21a8aac44ad admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:51.557329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f250a-3924-4ec2-80d0-15c6725ef155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:51.558261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f250a-3924-4ec2-80d0-15c6725ef155 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:51.558733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f250a-3924-4ec2-80d0-15c6725ef155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:51.559450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f250a-3924-4ec2-80d0-15c6725ef155 admin admin] PATH_INFO: `/v3/projects/75756fbb887a43948d81707eee3c6e43/users/b94c58e3dae4494e8f4cd626b6bbc336/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:51.585342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6555b-9862-4b2c-aa52-b2c7a6023aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7cf90f35e545bbb1e2dd3caf37f6ad, user_id=af73740918cc410189ccf8a30f81be21, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:51.602723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d6555b-9862-4b2c-aa52-b2c7a6023aeb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:51.661633 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 903/1776] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:51 2022] PUT /identity/v3/projects/dd7cf90f35e545bbb1e2dd3caf37f6ad/users/af73740918cc410189ccf8a30f81be21/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:51.665698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6555b-9862-4b2c-aa52-b2c7a6023aeb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:51.700761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f250a-3924-4ec2-80d0-15c6725ef155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75756fbb887a43948d81707eee3c6e43, user_id=b94c58e3dae4494e8f4cd626b6bbc336, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:51.715607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f250a-3924-4ec2-80d0-15c6725ef155 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:51.781940 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 874/1777] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:51 2022] PUT /identity/v3/projects/75756fbb887a43948d81707eee3c6e43/users/b94c58e3dae4494e8f4cd626b6bbc336/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:51.786616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f250a-3924-4ec2-80d0-15c6725ef155 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:51.945425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6555b-9862-4b2c-aa52-b2c7a6023aeb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:52.067291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:52.103752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:52.117525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f250a-3924-4ec2-80d0-15c6725ef155 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:52.148991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e6624-5962-4a1b-96ec-34848898fc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:52.149628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e6624-5962-4a1b-96ec-34848898fc91 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.149986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e6624-5962-4a1b-96ec-34848898fc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.150269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e6624-5962-4a1b-96ec-34848898fc91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.150956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e6624-5962-4a1b-96ec-34848898fc91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:52.154235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21e6624-5962-4a1b-96ec-34848898fc91 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:52.196465 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 875/1778] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:13:52.196465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e6624-5962-4a1b-96ec-34848898fc91 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:52.198505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c21e6624-5962-4a1b-96ec-34848898fc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:52.203204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b4c6e-6fbb-41fc-b700-d63cc3c30e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:52.207839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b4c6e-6fbb-41fc-b700-d63cc3c30e95 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.209293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b4c6e-6fbb-41fc-b700-d63cc3c30e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.217277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b4c6e-6fbb-41fc-b700-d63cc3c30e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.218369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b4c6e-6fbb-41fc-b700-d63cc3c30e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:52.227349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b4c6e-6fbb-41fc-b700-d63cc3c30e95 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:52.247259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e6624-5962-4a1b-96ec-34848898fc91 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:52.257768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:52.258671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.258948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.259355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] PATH_INFO: `/v3/users/90a5308fa4a04b5ebd30f97815cbfb03` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.261293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a5308fa4a04b5ebd30f97815cbfb03)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:52.265726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:52.299956 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 904/1779] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 635 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:13:52.312881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b4c6e-6fbb-41fc-b700-d63cc3c30e95 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:52.370484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b4c6e-6fbb-41fc-b700-d63cc3c30e95 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:52.405444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51ba9c-9454-4f32-bcb3-a15085d20502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:52.406116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51ba9c-9454-4f32-bcb3-a15085d20502 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.406394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51ba9c-9454-4f32-bcb3-a15085d20502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.407451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51ba9c-9454-4f32-bcb3-a15085d20502 admin admin] PATH_INFO: `/v3/projects/75756fbb887a43948d81707eee3c6e43/users/b94c58e3dae4494e8f4cd626b6bbc336/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.411259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a5308fa4a04b5ebd30f97815cbfb03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:52.416557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51ba9c-9454-4f32-bcb3-a15085d20502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75756fbb887a43948d81707eee3c6e43, user_id=b94c58e3dae4494e8f4cd626b6bbc336, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:52.423156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51ba9c-9454-4f32-bcb3-a15085d20502 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:52.438067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a5308fa4a04b5ebd30f97815cbfb03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:52.478828 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 905/1780] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:52 2022] PUT /identity/v3/projects/75756fbb887a43948d81707eee3c6e43/users/b94c58e3dae4494e8f4cd626b6bbc336/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:52.480091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51ba9c-9454-4f32-bcb3-a15085d20502 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:52.500021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a5308fa4a04b5ebd30f97815cbfb03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:52.516869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a5308fa4a04b5ebd30f97815cbfb03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:52.518981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1b318a61-ae06-48ae-9923-2481fc559e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a5308fa4a04b5ebd30f97815cbfb03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:52.538240 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 876/1781] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:52 2022] DELETE /identity/v3/users/90a5308fa4a04b5ebd30f97815cbfb03 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:52.543142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0879dbd-aa77-42c5-9048-ec77e512bdb5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.545360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0879dbd-aa77-42c5-9048-ec77e512bdb5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.545912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0879dbd-aa77-42c5-9048-ec77e512bdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.644807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c0879dbd-aa77-42c5-9048-ec77e512bdb5 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:52.648047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c0879dbd-aa77-42c5-9048-ec77e512bdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:52.650660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51ba9c-9454-4f32-bcb3-a15085d20502 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:52.931110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ba9e3-b154-43d6-83a3-ce853ff1649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:52.932096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ba9e3-b154-43d6-83a3-ce853ff1649a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.932457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ba9e3-b154-43d6-83a3-ce853ff1649a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.932729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ba9e3-b154-43d6-83a3-ce853ff1649a admin admin] PATH_INFO: `/v3/projects/dd7cf90f35e545bbb1e2dd3caf37f6ad/users/af73740918cc410189ccf8a30f81be21/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:52.934153 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 877/1782] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:13:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:52.938325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ba9e3-b154-43d6-83a3-ce853ff1649a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7cf90f35e545bbb1e2dd3caf37f6ad, user_id=af73740918cc410189ccf8a30f81be21, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:52.942081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ba9e3-b154-43d6-83a3-ce853ff1649a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:52.970329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48255c1-83d4-477b-96fa-ce05517656e9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:52.973644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48255c1-83d4-477b-96fa-ce05517656e9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:52.974162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48255c1-83d4-477b-96fa-ce05517656e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:53.007709 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 906/1783] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:13:52 2022] PUT /identity/v3/projects/dd7cf90f35e545bbb1e2dd3caf37f6ad/users/af73740918cc410189ccf8a30f81be21/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:53.009943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c4349-01ee-450d-ac13-9b22555743cc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:53.010227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c4349-01ee-450d-ac13-9b22555743cc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:53.010498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c4349-01ee-450d-ac13-9b22555743cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:53.101319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-010c4349-01ee-450d-ac13-9b22555743cc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:53.105626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-010c4349-01ee-450d-ac13-9b22555743cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:53.126848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b48255c1-83d4-477b-96fa-ce05517656e9 None None] MFA Rules not processed for user `b94c58e3dae4494e8f4cd626b6bbc336`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:53.130873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b48255c1-83d4-477b-96fa-ce05517656e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:53.329615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:53.330994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:53.365250 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 878/1784] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:53.365250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48255c1-83d4-477b-96fa-ce05517656e9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:53.370422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b48255c1-83d4-477b-96fa-ce05517656e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:53.429738 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 907/1785] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:53.439668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c8889-6e74-41a3-a1a5-2ed2044cbebf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:53.440000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c8889-6e74-41a3-a1a5-2ed2044cbebf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:53.440222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c8889-6e74-41a3-a1a5-2ed2044cbebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:53.575474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-447c8889-6e74-41a3-a1a5-2ed2044cbebf None None] MFA Rules not processed for user `af73740918cc410189ccf8a30f81be21`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:53.585720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-447c8889-6e74-41a3-a1a5-2ed2044cbebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:53.646933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48255c1-83d4-477b-96fa-ce05517656e9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:53.665445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58f5a1-ddd6-462c-8dae-e1aa18aac76b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:53.666240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f5a1-ddd6-462c-8dae-e1aa18aac76b service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:53.666596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f5a1-ddd6-462c-8dae-e1aa18aac76b service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:53.666912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58f5a1-ddd6-462c-8dae-e1aa18aac76b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:53.840762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58f5a1-ddd6-462c-8dae-e1aa18aac76b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:53.848725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58f5a1-ddd6-462c-8dae-e1aa18aac76b service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:53.869991 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 879/1786] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:13:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:13:53.879810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58f5a1-ddd6-462c-8dae-e1aa18aac76b service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:53.879810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7d58f5a1-ddd6-462c-8dae-e1aa18aac76b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:53.959436 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 908/1787] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:53.962415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c8889-6e74-41a3-a1a5-2ed2044cbebf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:53.984052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-447c8889-6e74-41a3-a1a5-2ed2044cbebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:54.136376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58f5a1-ddd6-462c-8dae-e1aa18aac76b service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:54.144676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90663a3-12fa-4293-8fd8-732fa431e566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:54.145615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90663a3-12fa-4293-8fd8-732fa431e566 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.145950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90663a3-12fa-4293-8fd8-732fa431e566 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.146788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90663a3-12fa-4293-8fd8-732fa431e566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.169108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c8889-6e74-41a3-a1a5-2ed2044cbebf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:54.172390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90663a3-12fa-4293-8fd8-732fa431e566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:54.174550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90663a3-12fa-4293-8fd8-732fa431e566 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:54.181426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11a09-bb25-4e3e-8341-f91990a041e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:54.184416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11a09-bb25-4e3e-8341-f91990a041e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.184925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11a09-bb25-4e3e-8341-f91990a041e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.185335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11a09-bb25-4e3e-8341-f91990a041e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.201438 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 880/1788] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:54.202828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90663a3-12fa-4293-8fd8-732fa431e566 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:54.207150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a11a09-bb25-4e3e-8341-f91990a041e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:54.210176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c90663a3-12fa-4293-8fd8-732fa431e566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:54.212492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a11a09-bb25-4e3e-8341-f91990a041e9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:54.242965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90663a3-12fa-4293-8fd8-732fa431e566 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:54.258295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:54.259105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.259569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.259849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] PATH_INFO: `/v3/users/bde77323678a499ea443e370ee328177` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.262622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde77323678a499ea443e370ee328177)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:54.268056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:54.282579 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 909/1789] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:54.310628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11a09-bb25-4e3e-8341-f91990a041e9 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:54.328166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:54.334927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11a09-bb25-4e3e-8341-f91990a041e9 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:54.366799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f58bcc-b1cb-4661-bdfc-84e7cd0226a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:54.367731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58bcc-b1cb-4661-bdfc-84e7cd0226a1 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.371972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58bcc-b1cb-4661-bdfc-84e7cd0226a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.372496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f58bcc-b1cb-4661-bdfc-84e7cd0226a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.400109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f58bcc-b1cb-4661-bdfc-84e7cd0226a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:54.403652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f58bcc-b1cb-4661-bdfc-84e7cd0226a1 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:54.431413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde77323678a499ea443e370ee328177'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:54.439063 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 910/1790] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:54 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:54.484198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde77323678a499ea443e370ee328177'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:54.537160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde77323678a499ea443e370ee328177'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:54.562376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f58bcc-b1cb-4661-bdfc-84e7cd0226a1 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:54.575719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde77323678a499ea443e370ee328177'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:54.579389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f58bcc-b1cb-4661-bdfc-84e7cd0226a1 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:54.582125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d731e157-9a85-4b37-9db0-3df8909ce7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde77323678a499ea443e370ee328177'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:54.587469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575410e-fb8e-4d3b-9a8a-28b3b1cf2ee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:54.588309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575410e-fb8e-4d3b-9a8a-28b3b1cf2ee1 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.588622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575410e-fb8e-4d3b-9a8a-28b3b1cf2ee1 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.589156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575410e-fb8e-4d3b-9a8a-28b3b1cf2ee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.591495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9575410e-fb8e-4d3b-9a8a-28b3b1cf2ee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:54.595002 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 881/1791] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:54 2022] DELETE /identity/v3/users/bde77323678a499ea443e370ee328177 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:54.600573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e772-11eb-440a-bdf1-8dfc1f29453a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:54.601480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e772-11eb-440a-bdf1-8dfc1f29453a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:54.602193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4e772-11eb-440a-bdf1-8dfc1f29453a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:54.646704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4af4e772-11eb-440a-bdf1-8dfc1f29453a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:54.647817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4af4e772-11eb-440a-bdf1-8dfc1f29453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:54.728889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575410e-fb8e-4d3b-9a8a-28b3b1cf2ee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:54.731669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575410e-fb8e-4d3b-9a8a-28b3b1cf2ee1 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:54.744472 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 911/1792] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:13:54.840655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575410e-fb8e-4d3b-9a8a-28b3b1cf2ee1 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:54.846490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9575410e-fb8e-4d3b-9a8a-28b3b1cf2ee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:54.900628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575410e-fb8e-4d3b-9a8a-28b3b1cf2ee1 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:54.924109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:54.957903 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 882/1793] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:55.066018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:55.073159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:55.074354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:55.076096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] PATH_INFO: `/v3/users/281f421daf9d49bfb5db36b3edcb2b96` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:55.085178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] RBAC: Authorizing `identity:delete_user(user_id=281f421daf9d49bfb5db36b3edcb2b96)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:55.093302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:55.121454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4e772-11eb-440a-bdf1-8dfc1f29453a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:55.126363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4af4e772-11eb-440a-bdf1-8dfc1f29453a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:55.322449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281f421daf9d49bfb5db36b3edcb2b96'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:55.322449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281f421daf9d49bfb5db36b3edcb2b96'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:55.347261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281f421daf9d49bfb5db36b3edcb2b96'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:55.370847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4e772-11eb-440a-bdf1-8dfc1f29453a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:55.381590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281f421daf9d49bfb5db36b3edcb2b96'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:55.382685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbdace-8196-4c60-aa22-d17b0b80a1d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:55.383794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbdace-8196-4c60-aa22-d17b0b80a1d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:55.385645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbdace-8196-4c60-aa22-d17b0b80a1d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:55.386355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbdace-8196-4c60-aa22-d17b0b80a1d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:55.413381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbdace-8196-4c60-aa22-d17b0b80a1d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:55.416478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbdace-8196-4c60-aa22-d17b0b80a1d3 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:55.420636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281f421daf9d49bfb5db36b3edcb2b96'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:55.436975 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 912/1794] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:54 2022] DELETE /identity/v3/users/281f421daf9d49bfb5db36b3edcb2b96 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:55.438158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:55.446819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:55.493316 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 883/1795] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:55.501617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c5cb-6bbe-4b75-b951-208cb4e404fb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:55.508668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c5cb-6bbe-4b75-b951-208cb4e404fb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:55.511837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0c5cb-6bbe-4b75-b951-208cb4e404fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:55.671402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a3e0c5cb-6bbe-4b75-b951-208cb4e404fb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:55.673722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a3e0c5cb-6bbe-4b75-b951-208cb4e404fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:55.732988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddcffa-e3f8-419f-9b8d-88f806f0b63d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:55.761321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:55.762091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:55.769585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:55.770165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] PATH_INFO: `/v3/users/4b4962b8db314402b1a2e4ca05734b55` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:55.774434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4962b8db314402b1a2e4ca05734b55)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:55.781628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:55.854501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:55.910805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:55.976383 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 884/1796] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:55.978106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d0d73-bcf6-457f-8e84-cfb1260b661d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:55.978397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d0d73-bcf6-457f-8e84-cfb1260b661d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:55.978668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d0d73-bcf6-457f-8e84-cfb1260b661d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:55.998157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4962b8db314402b1a2e4ca05734b55'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:55.998968 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 885/1797] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:13:55 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:13:56.001839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4962b8db314402b1a2e4ca05734b55'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:56.015517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4962b8db314402b1a2e4ca05734b55'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:56.036360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4962b8db314402b1a2e4ca05734b55'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:56.081110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4962b8db314402b1a2e4ca05734b55'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:56.113170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2260d-0843-434c-bb74-1f14797f1b7b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.113459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2260d-0843-434c-bb74-1f14797f1b7b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.113954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2260d-0843-434c-bb74-1f14797f1b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.117294 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 913/1798] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:55 2022] DELETE /identity/v3/users/4b4962b8db314402b1a2e4ca05734b55 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:56.160042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:56.163880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:56.170326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f5b2260d-0843-434c-bb74-1f14797f1b7b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:56.173171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f5b2260d-0843-434c-bb74-1f14797f1b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:56.331914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b49d62-36d9-48eb-a4f8-22c43eefb4a1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:56.342356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de565c-93eb-422b-9273-ffe213ed9664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:56.343028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de565c-93eb-422b-9273-ffe213ed9664 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.343361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de565c-93eb-422b-9273-ffe213ed9664 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.343620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de565c-93eb-422b-9273-ffe213ed9664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.351967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d7de565c-93eb-422b-9273-ffe213ed9664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:56.544120 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 886/1799] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:56.551373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8cb34-b0db-42c9-9e9d-9b03aee52444 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.551869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8cb34-b0db-42c9-9e9d-9b03aee52444 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.552350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8cb34-b0db-42c9-9e9d-9b03aee52444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.629615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de565c-93eb-422b-9273-ffe213ed9664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:56.649991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de565c-93eb-422b-9273-ffe213ed9664 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:56.692263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3ff8cb34-b0db-42c9-9e9d-9b03aee52444 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:56.700184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3ff8cb34-b0db-42c9-9e9d-9b03aee52444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:56.736945 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 914/1800] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:13:56.738457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de565c-93eb-422b-9273-ffe213ed9664 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:56.751488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de565c-93eb-422b-9273-ffe213ed9664 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:56.767468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8dcd5-c212-4526-95da-558f2be33070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:56.768569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8dcd5-c212-4526-95da-558f2be33070 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:56.769237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8dcd5-c212-4526-95da-558f2be33070 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:56.769761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8dcd5-c212-4526-95da-558f2be33070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:56.793250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8dcd5-c212-4526-95da-558f2be33070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:56.798086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8dcd5-c212-4526-95da-558f2be33070 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:56.837037 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 915/1801] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:56.946049 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 887/1802] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:13:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:57.096015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8dcd5-c212-4526-95da-558f2be33070 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:57.099064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-04a8dcd5-c212-4526-95da-558f2be33070 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:57.157130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8dcd5-c212-4526-95da-558f2be33070 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:57.173301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204dec9-8973-41c9-84e4-94768b54110d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:57.174006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204dec9-8973-41c9-84e4-94768b54110d service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:57.174269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204dec9-8973-41c9-84e4-94768b54110d service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:57.174682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204dec9-8973-41c9-84e4-94768b54110d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:57.198777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204dec9-8973-41c9-84e4-94768b54110d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:57.200632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204dec9-8973-41c9-84e4-94768b54110d service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:57.244469 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 916/1803] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:58.316630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94135b9-5b06-4a59-9435-1a43f4e0a22a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:58.317621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94135b9-5b06-4a59-9435-1a43f4e0a22a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:58.318112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94135b9-5b06-4a59-9435-1a43f4e0a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:58.378225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d94135b9-5b06-4a59-9435-1a43f4e0a22a None None] MFA Rules not processed for user `2aadabeb4fc04e67a6c6ada79308dcae`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:13:58.381184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d94135b9-5b06-4a59-9435-1a43f4e0a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:58.484592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204dec9-8973-41c9-84e4-94768b54110d service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:58.489647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d204dec9-8973-41c9-84e4-94768b54110d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:58.549062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204dec9-8973-41c9-84e4-94768b54110d service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:58.566498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:58.572736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:58.574861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:58.575671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:58.584999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] PATH_INFO: `/v3/projects/d6dc848a4b494887b7f32e2bc7d0b796` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:58.588788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6dc848a4b494887b7f32e2bc7d0b796)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:58.596206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:58.602406 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 888/1804] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:13:58 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:13:58.612505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94135b9-5b06-4a59-9435-1a43f4e0a22a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:58.622981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d94135b9-5b06-4a59-9435-1a43f4e0a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:58.706210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:58.753819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94135b9-5b06-4a59-9435-1a43f4e0a22a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:58.791720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6dc848a4b494887b7f32e2bc7d0b796', 'request_id': 'req-f4fb6231-3d19-45e4-adf5-b99acde5b22b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:58.828133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6dc848a4b494887b7f32e2bc7d0b796', 'request_id': 'req-f4fb6231-3d19-45e4-adf5-b99acde5b22b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:58.852364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6dc848a4b494887b7f32e2bc7d0b796', 'request_id': 'req-f4fb6231-3d19-45e4-adf5-b99acde5b22b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:58.876674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] The token cache is being invalidate because project d6dc848a4b494887b7f32e2bc7d0b796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:13:58.877135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:58.878596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:58.891217 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 917/1805] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:58 2022] DELETE /identity/v3/projects/d6dc848a4b494887b7f32e2bc7d0b796 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:13:58.896307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:58.899501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:59.058076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:59.059077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:59.059515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:59.060067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] PATH_INFO: `/v3/projects/d60397af79964a1b8cacfd1def77ab97` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:59.075400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60397af79964a1b8cacfd1def77ab97)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:59.085271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:59.234685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60397af79964a1b8cacfd1def77ab97', 'request_id': 'req-26553ec5-6086-4683-95a4-3468f3de83c2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:59.261427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60397af79964a1b8cacfd1def77ab97', 'request_id': 'req-26553ec5-6086-4683-95a4-3468f3de83c2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:59.274143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60397af79964a1b8cacfd1def77ab97', 'request_id': 'req-26553ec5-6086-4683-95a4-3468f3de83c2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:59.288994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb6231-3d19-45e4-adf5-b99acde5b22b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:59.317906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] The token cache is being invalidate because project d60397af79964a1b8cacfd1def77ab97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:13:59.318727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:59.319674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:59.323700 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 889/1806] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:58 2022] DELETE /identity/v3/projects/d60397af79964a1b8cacfd1def77ab97 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:13:59.326306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:59.328244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:59.544957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c013c7-353d-4e45-b0a9-32c0dfbf2871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:59.546191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c013c7-353d-4e45-b0a9-32c0dfbf2871 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:59.546741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c013c7-353d-4e45-b0a9-32c0dfbf2871 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:59.547578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c013c7-353d-4e45-b0a9-32c0dfbf2871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:59.551472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-63c013c7-353d-4e45-b0a9-32c0dfbf2871 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:59.617300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26553ec5-6086-4683-95a4-3468f3de83c2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:59.642538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:59.643151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:59.643487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:59.643849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] PATH_INFO: `/v3/users/cd9bb00de36a482ba29a9427506656c3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:59.655110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd9bb00de36a482ba29a9427506656c3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:59.657315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:59.699077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:59.752491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c013c7-353d-4e45-b0a9-32c0dfbf2871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:59.755858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c013c7-353d-4e45-b0a9-32c0dfbf2871 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:59.793211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:59.812135 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 918/1807] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:13:58 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 920 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:13:59.815972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c013c7-353d-4e45-b0a9-32c0dfbf2871 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:13:59.825195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-63c013c7-353d-4e45-b0a9-32c0dfbf2871 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:13:59.879565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c013c7-353d-4e45-b0a9-32c0dfbf2871 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:13:59.902251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd9bb00de36a482ba29a9427506656c3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:13:59.902873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:13:59.908656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:13:59.909289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:13:59.912604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] PATH_INFO: `/v3/projects/313e78337dd0491bb7628aa388ba40e8` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:13:59.919910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=313e78337dd0491bb7628aa388ba40e8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:13:59.930272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:13:59.947021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd9bb00de36a482ba29a9427506656c3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.094940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd9bb00de36a482ba29a9427506656c3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.119607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd9bb00de36a482ba29a9427506656c3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.121414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd9bb00de36a482ba29a9427506656c3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.152286 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 890/1808] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:13:59 2022] DELETE /identity/v3/users/cd9bb00de36a482ba29a9427506656c3 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:00.154471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '313e78337dd0491bb7628aa388ba40e8', 'request_id': 'req-568f8a45-703f-437f-af01-c338f524d978'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.165158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:00.180666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:00.205167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '313e78337dd0491bb7628aa388ba40e8', 'request_id': 'req-568f8a45-703f-437f-af01-c338f524d978'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.229334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '313e78337dd0491bb7628aa388ba40e8', 'request_id': 'req-568f8a45-703f-437f-af01-c338f524d978'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.276019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] The token cache is being invalidate because project 313e78337dd0491bb7628aa388ba40e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:00.276651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.278233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-568f8a45-703f-437f-af01-c338f524d978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.288445 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 919/1809] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:59 2022] DELETE /identity/v3/projects/313e78337dd0491bb7628aa388ba40e8 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:00.304939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe0499-ec4a-4011-bcf3-cd195b4205df None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:00.305677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe0499-ec4a-4011-bcf3-cd195b4205df None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:00.306338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe0499-ec4a-4011-bcf3-cd195b4205df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:00.407623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6ebe0499-ec4a-4011-bcf3-cd195b4205df None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:00.409190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6ebe0499-ec4a-4011-bcf3-cd195b4205df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:00.493737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bd5c7-5b79-43c6-b262-06c20e3be139 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:00.508472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:00.509146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:00.510444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:00.510804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] PATH_INFO: `/v3/users/1ca2d5d864d642a793214d0205552f7b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:00.513337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca2d5d864d642a793214d0205552f7b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:00.519883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:00.557347 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 920/1810] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Aug 30 04:14:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:00.558958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe0499-ec4a-4011-bcf3-cd195b4205df None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:00.565556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6ebe0499-ec4a-4011-bcf3-cd195b4205df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:00.626871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca2d5d864d642a793214d0205552f7b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.644202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca2d5d864d642a793214d0205552f7b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.683028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca2d5d864d642a793214d0205552f7b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.703867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca2d5d864d642a793214d0205552f7b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.704730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca2d5d864d642a793214d0205552f7b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:00.717811 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 891/1811] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:00 2022] DELETE /identity/v3/users/1ca2d5d864d642a793214d0205552f7b => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:00.720023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:00.729279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:00.772158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe0499-ec4a-4011-bcf3-cd195b4205df None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:00.807950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:00.817962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:00.915882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e249f04-6352-413d-98bd-3c78098bd35d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:00.929662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:00.930654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:00.932572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:00.932978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] PATH_INFO: `/v3/projects/b5ff5d874a014ecc9916a3a39cffb5de` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:00.935540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ff5d874a014ecc9916a3a39cffb5de)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:00.938492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:00.955946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f760480-5c47-4453-83a3-337ccdc6d531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:00.957066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f760480-5c47-4453-83a3-337ccdc6d531 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:00.957802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f760480-5c47-4453-83a3-337ccdc6d531 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:00.958703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f760480-5c47-4453-83a3-337ccdc6d531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:00.964159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4f760480-5c47-4453-83a3-337ccdc6d531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:01.226070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f760480-5c47-4453-83a3-337ccdc6d531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:01.234772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f760480-5c47-4453-83a3-337ccdc6d531 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:01.244005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ff5d874a014ecc9916a3a39cffb5de', 'request_id': 'req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:01.276745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ff5d874a014ecc9916a3a39cffb5de', 'request_id': 'req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:01.288854 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 921/1812] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:00 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:01.290800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f760480-5c47-4453-83a3-337ccdc6d531 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:01.293467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4f760480-5c47-4453-83a3-337ccdc6d531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:01.323854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f760480-5c47-4453-83a3-337ccdc6d531 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:01.337911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ff5d874a014ecc9916a3a39cffb5de', 'request_id': 'req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:01.418755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] The token cache is being invalidate because project b5ff5d874a014ecc9916a3a39cffb5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:01.419288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:01.425181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:01.432334 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 892/1813] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:00 2022] DELETE /identity/v3/projects/b5ff5d874a014ecc9916a3a39cffb5de => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:01.432334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:01.450455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:01.639317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:01.640388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:01.641152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:01.641815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] PATH_INFO: `/v3/users/b94c58e3dae4494e8f4cd626b6bbc336` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:01.647607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94c58e3dae4494e8f4cd626b6bbc336)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:01.658397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:01.764315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0654f-a4c3-4a0b-8fcd-216d3a225a95 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:01.774725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06958f5-9f47-4335-8f7c-5434b8b54bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:01.775829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06958f5-9f47-4335-8f7c-5434b8b54bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:01.776703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06958f5-9f47-4335-8f7c-5434b8b54bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:01.777466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06958f5-9f47-4335-8f7c-5434b8b54bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:01.782743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f06958f5-9f47-4335-8f7c-5434b8b54bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:01.810848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06958f5-9f47-4335-8f7c-5434b8b54bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:01.812719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06958f5-9f47-4335-8f7c-5434b8b54bb4 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:01.847076 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 893/1814] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:01.851025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06958f5-9f47-4335-8f7c-5434b8b54bb4 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:01.855412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f06958f5-9f47-4335-8f7c-5434b8b54bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:01.882945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94c58e3dae4494e8f4cd626b6bbc336'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:01.886129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94c58e3dae4494e8f4cd626b6bbc336'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:01.893695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06958f5-9f47-4335-8f7c-5434b8b54bb4 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:01.915288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:01.915653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:01.917143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:01.917581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:01.918034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] PATH_INFO: `/v3/projects/7b1c98aa20d149e0b0635375340755c7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:01.919631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b1c98aa20d149e0b0635375340755c7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:01.921769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:01.944432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94c58e3dae4494e8f4cd626b6bbc336'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:01.966831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94c58e3dae4494e8f4cd626b6bbc336'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.042551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94c58e3dae4494e8f4cd626b6bbc336'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.065384 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 922/1815] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:01 2022] DELETE /identity/v3/users/b94c58e3dae4494e8f4cd626b6bbc336 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:02.066528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:02.072484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:02.152076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1c98aa20d149e0b0635375340755c7', 'request_id': 'req-c72b8cc6-2787-443c-ae3c-d571450e1e81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.158227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:02.178944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1c98aa20d149e0b0635375340755c7', 'request_id': 'req-c72b8cc6-2787-443c-ae3c-d571450e1e81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.197198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1c98aa20d149e0b0635375340755c7', 'request_id': 'req-c72b8cc6-2787-443c-ae3c-d571450e1e81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.247774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] The token cache is being invalidate because project 7b1c98aa20d149e0b0635375340755c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:02.248188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.254360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.272867 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 894/1816] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:01 2022] DELETE /identity/v3/projects/7b1c98aa20d149e0b0635375340755c7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:02.278376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:02.285999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:02.308788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bcf8a-8d3c-4917-9391-d34da8831be5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:02.620550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b8cc6-2787-443c-ae3c-d571450e1e81 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:02.653809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:02.656715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:02.657119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:02.657292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] PATH_INFO: `/v3/projects/28efd2873e1c40818dffa8a46958529c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:02.661615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] RBAC: Authorizing `identity:delete_project(project_id=28efd2873e1c40818dffa8a46958529c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:02.687072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:02.727081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:02.728039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:02.728039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:02.728342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] PATH_INFO: `/v3/users/af73740918cc410189ccf8a30f81be21` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:02.735795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af73740918cc410189ccf8a30f81be21)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:02.738573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:02.833707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28efd2873e1c40818dffa8a46958529c', 'request_id': 'req-b9c0229c-dc17-4c58-9b42-9e256e28931b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.862345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af73740918cc410189ccf8a30f81be21'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.864508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af73740918cc410189ccf8a30f81be21'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.865691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28efd2873e1c40818dffa8a46958529c', 'request_id': 'req-b9c0229c-dc17-4c58-9b42-9e256e28931b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.876515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28efd2873e1c40818dffa8a46958529c', 'request_id': 'req-b9c0229c-dc17-4c58-9b42-9e256e28931b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.897441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af73740918cc410189ccf8a30f81be21'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.913544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] The token cache is being invalidate because project 28efd2873e1c40818dffa8a46958529c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:02.913835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.915537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b9c0229c-dc17-4c58-9b42-9e256e28931b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.919687 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 895/1817] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:02 2022] DELETE /identity/v3/projects/28efd2873e1c40818dffa8a46958529c => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:02.925394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5489856-f733-465d-a660-5c732f58e2d6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:02.925836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af73740918cc410189ccf8a30f81be21'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.926642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5489856-f733-465d-a660-5c732f58e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:02.926642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5489856-f733-465d-a660-5c732f58e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:02.960676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f5489856-f733-465d-a660-5c732f58e2d6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:02.963141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f5489856-f733-465d-a660-5c732f58e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:02.966112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:02.977017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f24b0f69-2f58-425d-861d-a7472c409f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af73740918cc410189ccf8a30f81be21'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:02.998738 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 923/1818] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:02 2022] DELETE /identity/v3/users/af73740918cc410189ccf8a30f81be21 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:03.000346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9c39c-7d12-4029-8d60-a64f18e4a443 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.000643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9c39c-7d12-4029-8d60-a64f18e4a443 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.000917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9c39c-7d12-4029-8d60-a64f18e4a443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.071255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1cd9c39c-7d12-4029-8d60-a64f18e4a443 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:03.072554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1cd9c39c-7d12-4029-8d60-a64f18e4a443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:03.213334 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 896/1819] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:03.225842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870cee7-ed76-40c2-b25e-af73469c313e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.226432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870cee7-ed76-40c2-b25e-af73469c313e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.226911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3870cee7-ed76-40c2-b25e-af73469c313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.252219 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 924/1820] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:03.268625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9fc9-8d0f-4763-81d7-3ad5898de6d4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.269942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9fc9-8d0f-4763-81d7-3ad5898de6d4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.270641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9fc9-8d0f-4763-81d7-3ad5898de6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.358269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a3cb9fc9-8d0f-4763-81d7-3ad5898de6d4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:03.369670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a3cb9fc9-8d0f-4763-81d7-3ad5898de6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:03.380752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3870cee7-ed76-40c2-b25e-af73469c313e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:03.393663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3870cee7-ed76-40c2-b25e-af73469c313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:03.411090 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 925/1821] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:03.416002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb9fc9-8d0f-4763-81d7-3ad5898de6d4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:03.465823 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 897/1822] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:03.468126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870cee7-ed76-40c2-b25e-af73469c313e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:03.469048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb9fc9-8d0f-4763-81d7-3ad5898de6d4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:03.509477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:03.513757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f1f4d-626b-4161-a70c-6a8a297eb97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:03.515547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f1f4d-626b-4161-a70c-6a8a297eb97a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.521957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3870cee7-ed76-40c2-b25e-af73469c313e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:03.552960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411a376-15ef-4c5f-a6b8-8df62f08fee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:03.552960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411a376-15ef-4c5f-a6b8-8df62f08fee9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.552960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411a376-15ef-4c5f-a6b8-8df62f08fee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.552960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411a376-15ef-4c5f-a6b8-8df62f08fee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.553627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411a376-15ef-4c5f-a6b8-8df62f08fee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:03.553627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411a376-15ef-4c5f-a6b8-8df62f08fee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:03.553627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411a376-15ef-4c5f-a6b8-8df62f08fee9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:03.566471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f1f4d-626b-4161-a70c-6a8a297eb97a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.567458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f1f4d-626b-4161-a70c-6a8a297eb97a admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.571964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f1f4d-626b-4161-a70c-6a8a297eb97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:03.574451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f1f4d-626b-4161-a70c-6a8a297eb97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:03.588575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f1f4d-626b-4161-a70c-6a8a297eb97a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:03.607425 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 898/1823] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:03.608491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411a376-15ef-4c5f-a6b8-8df62f08fee9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:03.645341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411a376-15ef-4c5f-a6b8-8df62f08fee9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:03.675144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3443ec-cd87-4bc7-af48-3d4b01386104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:03.676258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3443ec-cd87-4bc7-af48-3d4b01386104 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.676581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3443ec-cd87-4bc7-af48-3d4b01386104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.677728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3443ec-cd87-4bc7-af48-3d4b01386104 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.684140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3443ec-cd87-4bc7-af48-3d4b01386104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:03.684140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3443ec-cd87-4bc7-af48-3d4b01386104 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:03.692775 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 926/1824] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:14:03.697531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f1f4d-626b-4161-a70c-6a8a297eb97a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:03.753104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f1f4d-626b-4161-a70c-6a8a297eb97a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:03.772807 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 899/1825] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:03 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:03.774759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3443ec-cd87-4bc7-af48-3d4b01386104 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:03.777575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc19c9-8bc9-434c-9cce-1b38903c4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:03.779920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc19c9-8bc9-434c-9cce-1b38903c4985 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:03.780991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc19c9-8bc9-434c-9cce-1b38903c4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:03.781820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc19c9-8bc9-434c-9cce-1b38903c4985 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:03.786784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc19c9-8bc9-434c-9cce-1b38903c4985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:03.802114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc19c9-8bc9-434c-9cce-1b38903c4985 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:03.946475 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 927/1826] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:03 2022] POST /identity/v3/projects => generated 401 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:03.953461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc19c9-8bc9-434c-9cce-1b38903c4985 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:04.061703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3443ec-cd87-4bc7-af48-3d4b01386104 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.217189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc19c9-8bc9-434c-9cce-1b38903c4985 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.229021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b343969-bc6d-4e38-b8d0-52fb5bfd8358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.229756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b343969-bc6d-4e38-b8d0-52fb5bfd8358 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.230114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b343969-bc6d-4e38-b8d0-52fb5bfd8358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.230374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b343969-bc6d-4e38-b8d0-52fb5bfd8358 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.231051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b343969-bc6d-4e38-b8d0-52fb5bfd8358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:04.235609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b343969-bc6d-4e38-b8d0-52fb5bfd8358 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:04.341768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fedb8-5450-4dd4-9a89-8bb01e6d44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.346286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fedb8-5450-4dd4-9a89-8bb01e6d44aa admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.349913 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 928/1827] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:03 2022] POST /identity/v3/users => generated 301 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:04.350209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fedb8-5450-4dd4-9a89-8bb01e6d44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.350940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b343969-bc6d-4e38-b8d0-52fb5bfd8358 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:04.354074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fedb8-5450-4dd4-9a89-8bb01e6d44aa admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.356384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fedb8-5450-4dd4-9a89-8bb01e6d44aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:04.365444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5b343969-bc6d-4e38-b8d0-52fb5bfd8358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:04.372421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fedb8-5450-4dd4-9a89-8bb01e6d44aa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:04.405241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b343969-bc6d-4e38-b8d0-52fb5bfd8358 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.418931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.421241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.422885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.423437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] PATH_INFO: `/v3/projects/75756fbb887a43948d81707eee3c6e43` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.429306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75756fbb887a43948d81707eee3c6e43)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:04.437420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:04.486828 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 900/1828] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:03 2022] POST /identity/v3/users => generated 294 bytes in 713 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:04.492453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fedb8-5450-4dd4-9a89-8bb01e6d44aa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:04.545776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fedb8-5450-4dd4-9a89-8bb01e6d44aa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.577608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142fcb8-655f-4b85-bc2b-cb9c3b455e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.582183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142fcb8-655f-4b85-bc2b-cb9c3b455e4c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.582823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142fcb8-655f-4b85-bc2b-cb9c3b455e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.583351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142fcb8-655f-4b85-bc2b-cb9c3b455e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.587142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142fcb8-655f-4b85-bc2b-cb9c3b455e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:04.595785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142fcb8-655f-4b85-bc2b-cb9c3b455e4c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:04.602939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:04.631001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75756fbb887a43948d81707eee3c6e43', 'request_id': 'req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:04.641517 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 901/1829] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:04.643544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142fcb8-655f-4b85-bc2b-cb9c3b455e4c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:04.649191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75756fbb887a43948d81707eee3c6e43', 'request_id': 'req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:04.667991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75756fbb887a43948d81707eee3c6e43', 'request_id': 'req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:04.697182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] The token cache is being invalidate because project 75756fbb887a43948d81707eee3c6e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:04.697521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:04.698532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:04.703170 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 929/1830] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:04 2022] DELETE /identity/v3/projects/75756fbb887a43948d81707eee3c6e43 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:04.709374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:04.710410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:04.724346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142fcb8-655f-4b85-bc2b-cb9c3b455e4c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.904926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80cb5f-a839-4fc3-bfa3-86300b9d10d3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:04.918869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea18f9f-f793-45ab-835b-bb9bae2e309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.919962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea18f9f-f793-45ab-835b-bb9bae2e309b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.920253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea18f9f-f793-45ab-835b-bb9bae2e309b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.920528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea18f9f-f793-45ab-835b-bb9bae2e309b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.922296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea18f9f-f793-45ab-835b-bb9bae2e309b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:04.930858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:04.931383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea18f9f-f793-45ab-835b-bb9bae2e309b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:04.970803 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 930/1831] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:04.975128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a497cd-34d3-47cf-87e5-a817ee3553b3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.978726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a497cd-34d3-47cf-87e5-a817ee3553b3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.979308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a497cd-34d3-47cf-87e5-a817ee3553b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:04.991334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40273d49-1097-424c-ab87-fe373694e738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:04.992255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40273d49-1097-424c-ab87-fe373694e738 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:04.992688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40273d49-1097-424c-ab87-fe373694e738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:04.993102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40273d49-1097-424c-ab87-fe373694e738 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.009245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40273d49-1097-424c-ab87-fe373694e738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:05.030217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-58a497cd-34d3-47cf-87e5-a817ee3553b3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:05.031184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40273d49-1097-424c-ab87-fe373694e738 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:05.032958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-58a497cd-34d3-47cf-87e5-a817ee3553b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:05.055895 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 931/1832] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:05.057168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a497cd-34d3-47cf-87e5-a817ee3553b3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:05.078097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a497cd-34d3-47cf-87e5-a817ee3553b3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:05.086874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907e506-4a7d-4aa0-b092-095bab9932c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:05.087803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907e506-4a7d-4aa0-b092-095bab9932c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.088387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907e506-4a7d-4aa0-b092-095bab9932c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.088827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907e506-4a7d-4aa0-b092-095bab9932c9 admin admin] PATH_INFO: `/v3/projects/3e735137c4aa4068af2f3ac3e1aeb091/users/21ff63936f09401e84f3055b9d0a00b9/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.114608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907e506-4a7d-4aa0-b092-095bab9932c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e735137c4aa4068af2f3ac3e1aeb091, user_id=21ff63936f09401e84f3055b9d0a00b9, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:05.116886 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 902/1833] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:05.119039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907e506-4a7d-4aa0-b092-095bab9932c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:05.119394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b056d05-a2ae-462c-8b04-f73032db38fc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.119943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b056d05-a2ae-462c-8b04-f73032db38fc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.120446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b056d05-a2ae-462c-8b04-f73032db38fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.159211 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 932/1834] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:05 2022] PUT /identity/v3/projects/3e735137c4aa4068af2f3ac3e1aeb091/users/21ff63936f09401e84f3055b9d0a00b9/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:05.163143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907e506-4a7d-4aa0-b092-095bab9932c9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:05.166085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d907e506-4a7d-4aa0-b092-095bab9932c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:05.211740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3b056d05-a2ae-462c-8b04-f73032db38fc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:05.221201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3b056d05-a2ae-462c-8b04-f73032db38fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:05.305227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907e506-4a7d-4aa0-b092-095bab9932c9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:05.320718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb488280-020c-4b7b-9d51-6e8c590f6a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:05.324386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488280-020c-4b7b-9d51-6e8c590f6a55 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.324853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488280-020c-4b7b-9d51-6e8c590f6a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.325073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488280-020c-4b7b-9d51-6e8c590f6a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.327911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb488280-020c-4b7b-9d51-6e8c590f6a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:05.330893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb488280-020c-4b7b-9d51-6e8c590f6a55 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:05.375515 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 933/1835] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:05.377311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12775464-7a05-4a4a-b667-a37e48cd5d81 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.377721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12775464-7a05-4a4a-b667-a37e48cd5d81 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.377949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12775464-7a05-4a4a-b667-a37e48cd5d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.417608 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 903/1836] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:05.418555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b056d05-a2ae-462c-8b04-f73032db38fc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:05.439635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b056d05-a2ae-462c-8b04-f73032db38fc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:05.454399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e552-e949-49dc-b7b1-91fe4a46181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:05.456949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e552-e949-49dc-b7b1-91fe4a46181f admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.457320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e552-e949-49dc-b7b1-91fe4a46181f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.460229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-12775464-7a05-4a4a-b667-a37e48cd5d81 None None] MFA Rules not processed for user `21ff63936f09401e84f3055b9d0a00b9`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:05.461166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37e552-e949-49dc-b7b1-91fe4a46181f admin admin] PATH_INFO: `/v3/projects/b6931ec1046e457fb1a271bee7a75514/users/bf7c15d8a7d346338027aa00493088c5/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.464084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-12775464-7a05-4a4a-b667-a37e48cd5d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:05.507272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37e552-e949-49dc-b7b1-91fe4a46181f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6931ec1046e457fb1a271bee7a75514, user_id=bf7c15d8a7d346338027aa00493088c5, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:05.515644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a37e552-e949-49dc-b7b1-91fe4a46181f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:05.518379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:05.549893 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 904/1837] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:05 2022] PUT /identity/v3/projects/b6931ec1046e457fb1a271bee7a75514/users/bf7c15d8a7d346338027aa00493088c5/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:05.553294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e552-e949-49dc-b7b1-91fe4a46181f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:05.694688 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 934/1838] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:05 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:05.694688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16827-2925-4965-a4dc-a3f4781a42f2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:05.694688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16827-2925-4965-a4dc-a3f4781a42f2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:05.696314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16827-2925-4965-a4dc-a3f4781a42f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:05.776968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ecd16827-2925-4965-a4dc-a3f4781a42f2 None None] MFA Rules not processed for user `bf7c15d8a7d346338027aa00493088c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:05.779704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ecd16827-2925-4965-a4dc-a3f4781a42f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:05.992056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37e552-e949-49dc-b7b1-91fe4a46181f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.056974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328d305-4183-445d-a9f1-b07910ff5474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.064348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328d305-4183-445d-a9f1-b07910ff5474 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.070998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328d305-4183-445d-a9f1-b07910ff5474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.071941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328d305-4183-445d-a9f1-b07910ff5474 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.081257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328d305-4183-445d-a9f1-b07910ff5474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:06.082089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328d305-4183-445d-a9f1-b07910ff5474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.091009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328d305-4183-445d-a9f1-b07910ff5474 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.188278 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 905/1839] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 636 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:06.191356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328d305-4183-445d-a9f1-b07910ff5474 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.262523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328d305-4183-445d-a9f1-b07910ff5474 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.281945 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 935/1840] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 591 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:06.282584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a356dc5-be62-44fc-8821-0565d7114594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.283555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd16827-2925-4965-a4dc-a3f4781a42f2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.284249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a356dc5-be62-44fc-8821-0565d7114594 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.286306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a356dc5-be62-44fc-8821-0565d7114594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.287998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ecd16827-2925-4965-a4dc-a3f4781a42f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:06.288211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a356dc5-be62-44fc-8821-0565d7114594 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.289419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a356dc5-be62-44fc-8821-0565d7114594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.296326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a356dc5-be62-44fc-8821-0565d7114594 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.355231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd16827-2925-4965-a4dc-a3f4781a42f2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.389441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.395173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.395533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.396310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] PATH_INFO: `/v3/projects/dd7cf90f35e545bbb1e2dd3caf37f6ad` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.408378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7cf90f35e545bbb1e2dd3caf37f6ad)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.412615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.462914 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 906/1841] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:06 2022] POST /identity/v3/projects => generated 403 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:06.464039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a356dc5-be62-44fc-8821-0565d7114594 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.586415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:06.639451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a356dc5-be62-44fc-8821-0565d7114594 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:06.705383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7cf90f35e545bbb1e2dd3caf37f6ad', 'request_id': 'req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:06.740329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7cf90f35e545bbb1e2dd3caf37f6ad', 'request_id': 'req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:06.769564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7cf90f35e545bbb1e2dd3caf37f6ad', 'request_id': 'req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:06.770305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29e025-c7a0-479e-9de3-c08a5883fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:06.771718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29e025-c7a0-479e-9de3-c08a5883fe34 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:06.771893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29e025-c7a0-479e-9de3-c08a5883fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:06.775713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29e025-c7a0-479e-9de3-c08a5883fe34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:06.777494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29e025-c7a0-479e-9de3-c08a5883fe34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:06.783307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29e025-c7a0-479e-9de3-c08a5883fe34 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:06.827626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] The token cache is being invalidate because project dd7cf90f35e545bbb1e2dd3caf37f6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:06.828044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:06.832492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:06.839291 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 936/1842] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:06 2022] DELETE /identity/v3/projects/dd7cf90f35e545bbb1e2dd3caf37f6ad => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:06.844371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.850885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:06.882669 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 907/1843] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:06 2022] POST /identity/v3/projects => generated 381 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:06.883629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29e025-c7a0-479e-9de3-c08a5883fe34 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:06.894881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0a29e025-c7a0-479e-9de3-c08a5883fe34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:06.902490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d23d4-7eb2-45ee-81a6-05f93da9a746 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.001138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:07.111010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884a5a-cc2a-4187-af37-6f21b33f88d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.113668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884a5a-cc2a-4187-af37-6f21b33f88d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.114470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884a5a-cc2a-4187-af37-6f21b33f88d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.115579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884a5a-cc2a-4187-af37-6f21b33f88d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.117131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd884a5a-cc2a-4187-af37-6f21b33f88d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.123661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd884a5a-cc2a-4187-af37-6f21b33f88d9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.161988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29e025-c7a0-479e-9de3-c08a5883fe34 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.169333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46454b3c-9b6f-4e11-927e-2a27da2b745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.170376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454b3c-9b6f-4e11-927e-2a27da2b745a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.170823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454b3c-9b6f-4e11-927e-2a27da2b745a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.171314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46454b3c-9b6f-4e11-927e-2a27da2b745a admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.172239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46454b3c-9b6f-4e11-927e-2a27da2b745a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.176999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46454b3c-9b6f-4e11-927e-2a27da2b745a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.213773 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 908/1844] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:06 2022] POST /identity/v3/users => generated 308 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:07.216724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89cc6f-af20-4e74-a040-b15939795dac None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.217569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89cc6f-af20-4e74-a040-b15939795dac None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.218175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89cc6f-af20-4e74-a040-b15939795dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.250757 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 937/1845] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:06 2022] POST /identity/v3/projects => generated 385 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:07.252605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fc89cc6f-af20-4e74-a040-b15939795dac None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:07.255442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884a5a-cc2a-4187-af37-6f21b33f88d9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.264463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dd884a5a-cc2a-4187-af37-6f21b33f88d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:07.276586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fc89cc6f-af20-4e74-a040-b15939795dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:07.447351 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 909/1846] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:07.447351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89cc6f-af20-4e74-a040-b15939795dac None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.447647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884a5a-cc2a-4187-af37-6f21b33f88d9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.454536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:07.475224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89cc6f-af20-4e74-a040-b15939795dac None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.476604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015315a1-a910-40e8-b449-76e14a1d2026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.478188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015315a1-a910-40e8-b449-76e14a1d2026 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.479196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015315a1-a910-40e8-b449-76e14a1d2026 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.479874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015315a1-a910-40e8-b449-76e14a1d2026 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.481413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015315a1-a910-40e8-b449-76e14a1d2026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.482353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ea963-0739-4a0d-b369-4e0d8aaeb1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.484094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea963-0739-4a0d-b369-4e0d8aaeb1bf admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.484487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea963-0739-4a0d-b369-4e0d8aaeb1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.484950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea963-0739-4a0d-b369-4e0d8aaeb1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.485841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ea963-0739-4a0d-b369-4e0d8aaeb1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.488417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ea963-0739-4a0d-b369-4e0d8aaeb1bf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.500156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015315a1-a910-40e8-b449-76e14a1d2026 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.511778 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 910/1847] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:07.512923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ea963-0739-4a0d-b369-4e0d8aaeb1bf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.529713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ea963-0739-4a0d-b369-4e0d8aaeb1bf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.536872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51226a0e-ae8b-4cb6-823e-03944cdf7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.537651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226a0e-ae8b-4cb6-823e-03944cdf7a96 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.538062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226a0e-ae8b-4cb6-823e-03944cdf7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.538562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226a0e-ae8b-4cb6-823e-03944cdf7a96 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.539366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51226a0e-ae8b-4cb6-823e-03944cdf7a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.543168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51226a0e-ae8b-4cb6-823e-03944cdf7a96 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.584490 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 911/1848] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:07 2022] POST /identity/v3/users => generated 299 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:07.585845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf14bb-599f-448b-a1ef-f884967c099e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.586163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf14bb-599f-448b-a1ef-f884967c099e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.586438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf14bb-599f-448b-a1ef-f884967c099e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.588399 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 938/1849] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:07 2022] POST /identity/v3/users => generated 291 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:07.590167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015315a1-a910-40e8-b449-76e14a1d2026 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.612126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015315a1-a910-40e8-b449-76e14a1d2026 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.621970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebb597-d279-46ef-b7c1-0fcff15b9bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.623382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebb597-d279-46ef-b7c1-0fcff15b9bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.624178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebb597-d279-46ef-b7c1-0fcff15b9bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.624726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebb597-d279-46ef-b7c1-0fcff15b9bd4 admin admin] PATH_INFO: `/v3/projects/04a05769fa7846de844b2b73b5a7f962/users/de94a2e4eae240158b04ee1bdb8910ce/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.640115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-dfcf14bb-599f-448b-a1ef-f884967c099e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:07.641690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dfcf14bb-599f-448b-a1ef-f884967c099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:07.658331 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 912/1850] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:07.659226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf14bb-599f-448b-a1ef-f884967c099e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.668961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebb597-d279-46ef-b7c1-0fcff15b9bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a05769fa7846de844b2b73b5a7f962, user_id=de94a2e4eae240158b04ee1bdb8910ce, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.680222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebb597-d279-46ef-b7c1-0fcff15b9bd4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.708975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf14bb-599f-448b-a1ef-f884967c099e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.718555 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 939/1851] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:07 2022] PUT /identity/v3/projects/04a05769fa7846de844b2b73b5a7f962/users/de94a2e4eae240158b04ee1bdb8910ce/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:07.721477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebb597-d279-46ef-b7c1-0fcff15b9bd4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.839321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebb597-d279-46ef-b7c1-0fcff15b9bd4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.847161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6523d-e945-4c42-88e5-5e7229b36266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.848489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6523d-e945-4c42-88e5-5e7229b36266 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.849218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6523d-e945-4c42-88e5-5e7229b36266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.849723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b6523d-e945-4c42-88e5-5e7229b36266 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.850880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6523d-e945-4c42-88e5-5e7229b36266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.853780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b6523d-e945-4c42-88e5-5e7229b36266 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.854124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a54ec0-dca3-4674-a8f1-ede70e6ff301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.854755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a54ec0-dca3-4674-a8f1-ede70e6ff301 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.855033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a54ec0-dca3-4674-a8f1-ede70e6ff301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.858648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a54ec0-dca3-4674-a8f1-ede70e6ff301 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.859653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a54ec0-dca3-4674-a8f1-ede70e6ff301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.864177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a54ec0-dca3-4674-a8f1-ede70e6ff301 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.882273 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 940/1852] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:07.883957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6523d-e945-4c42-88e5-5e7229b36266 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.896242 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 913/1853] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:07.896242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a54ec0-dca3-4674-a8f1-ede70e6ff301 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.923729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a54ec0-dca3-4674-a8f1-ede70e6ff301 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.923949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b6523d-e945-4c42-88e5-5e7229b36266 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:07.933610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25594341-03f2-4f12-a956-1a3e6db59ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.935002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25594341-03f2-4f12-a956-1a3e6db59ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.935483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25594341-03f2-4f12-a956-1a3e6db59ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.935886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bcdd6-1c35-4541-8728-1051f9485d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:07.936027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25594341-03f2-4f12-a956-1a3e6db59ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.936523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bcdd6-1c35-4541-8728-1051f9485d69 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:07.936816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bcdd6-1c35-4541-8728-1051f9485d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:07.937115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274bcdd6-1c35-4541-8728-1051f9485d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:07.937346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25594341-03f2-4f12-a956-1a3e6db59ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:07.938184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25594341-03f2-4f12-a956-1a3e6db59ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.940547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bcdd6-1c35-4541-8728-1051f9485d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:07.941904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25594341-03f2-4f12-a956-1a3e6db59ca6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.958943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274bcdd6-1c35-4541-8728-1051f9485d69 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:07.978909 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 941/1854] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:07.980785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25594341-03f2-4f12-a956-1a3e6db59ca6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:07.997602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:08.010957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25594341-03f2-4f12-a956-1a3e6db59ca6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.027774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21515b-9750-493b-8362-e08749aff90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.029192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21515b-9750-493b-8362-e08749aff90f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.029655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21515b-9750-493b-8362-e08749aff90f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.030365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21515b-9750-493b-8362-e08749aff90f admin admin] PATH_INFO: `/v3/projects/7cf51cb34f3c455eb8d22864d730231d/users/274c219756a64992aadd37a89b12077a/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.056598 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 914/1855] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:08.068556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bcdd6-1c35-4541-8728-1051f9485d69 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.098001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21515b-9750-493b-8362-e08749aff90f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf51cb34f3c455eb8d22864d730231d, user_id=274c219756a64992aadd37a89b12077a, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.112566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21515b-9750-493b-8362-e08749aff90f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.116748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274bcdd6-1c35-4541-8728-1051f9485d69 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.133909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96063e6f-c7d8-4241-9715-f57c5be544e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.135566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96063e6f-c7d8-4241-9715-f57c5be544e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.136087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96063e6f-c7d8-4241-9715-f57c5be544e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.136888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96063e6f-c7d8-4241-9715-f57c5be544e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.138248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96063e6f-c7d8-4241-9715-f57c5be544e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.141392 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 942/1856] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:07 2022] PUT /identity/v3/projects/7cf51cb34f3c455eb8d22864d730231d/users/274c219756a64992aadd37a89b12077a/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:08.142328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21515b-9750-493b-8362-e08749aff90f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.148820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96063e6f-c7d8-4241-9715-f57c5be544e6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.193920 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 915/1857] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:08.193920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96063e6f-c7d8-4241-9715-f57c5be544e6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.216205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96063e6f-c7d8-4241-9715-f57c5be544e6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.282615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21515b-9750-493b-8362-e08749aff90f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.297662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5d806-e662-4798-b8d7-4e5978a10695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.298525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5d806-e662-4798-b8d7-4e5978a10695 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.298683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5d806-e662-4798-b8d7-4e5978a10695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.298959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5d806-e662-4798-b8d7-4e5978a10695 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.299707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5d806-e662-4798-b8d7-4e5978a10695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.302223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5d806-e662-4798-b8d7-4e5978a10695 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.317638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70b8b8-835e-4c0b-848b-5a96fb9366d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.319574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70b8b8-835e-4c0b-848b-5a96fb9366d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.319789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70b8b8-835e-4c0b-848b-5a96fb9366d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.320072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70b8b8-835e-4c0b-848b-5a96fb9366d8 admin admin] PATH_INFO: `/v3/projects/04a05769fa7846de844b2b73b5a7f962/users/de94a2e4eae240158b04ee1bdb8910ce/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.323418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70b8b8-835e-4c0b-848b-5a96fb9366d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a05769fa7846de844b2b73b5a7f962, user_id=de94a2e4eae240158b04ee1bdb8910ce, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.326780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70b8b8-835e-4c0b-848b-5a96fb9366d8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.350864 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 916/1858] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:08 2022] PUT /identity/v3/projects/04a05769fa7846de844b2b73b5a7f962/users/de94a2e4eae240158b04ee1bdb8910ce/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:08.356388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70b8b8-835e-4c0b-848b-5a96fb9366d8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.379006 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 943/1859] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:08 2022] POST /identity/v3/projects => generated 395 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:08.379006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5d806-e662-4798-b8d7-4e5978a10695 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.456706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:08.520039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70b8b8-835e-4c0b-848b-5a96fb9366d8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.530114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9d33-08d8-4556-8545-a484d40b973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.530959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9d33-08d8-4556-8545-a484d40b973c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.532188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9d33-08d8-4556-8545-a484d40b973c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.532188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9d33-08d8-4556-8545-a484d40b973c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.532509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5d806-e662-4798-b8d7-4e5978a10695 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:08.533190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9d33-08d8-4556-8545-a484d40b973c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.534037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c9d33-08d8-4556-8545-a484d40b973c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.550677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13568e21-1bd5-4808-a75a-483e0291a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:08.552177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13568e21-1bd5-4808-a75a-483e0291a50a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.553361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13568e21-1bd5-4808-a75a-483e0291a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.553361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13568e21-1bd5-4808-a75a-483e0291a50a admin admin] PATH_INFO: `/v3/projects/a16526c9c8104f0ba6314f8b839e42ea/users/299371ae14cb4c369ba9e4143223c9ba/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.564874 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 917/1860] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:08.565998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9655c47-0beb-4e82-9e0c-393aa2f95e44 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:08.566356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9655c47-0beb-4e82-9e0c-393aa2f95e44 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:08.566673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9655c47-0beb-4e82-9e0c-393aa2f95e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:08.615384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13568e21-1bd5-4808-a75a-483e0291a50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16526c9c8104f0ba6314f8b839e42ea, user_id=299371ae14cb4c369ba9e4143223c9ba, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:08.624073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13568e21-1bd5-4808-a75a-483e0291a50a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:08.650498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f9655c47-0beb-4e82-9e0c-393aa2f95e44 None None] MFA Rules not processed for user `de94a2e4eae240158b04ee1bdb8910ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:08.652976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f9655c47-0beb-4e82-9e0c-393aa2f95e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:08.660271 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 944/1861] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:08 2022] PUT /identity/v3/projects/a16526c9c8104f0ba6314f8b839e42ea/users/299371ae14cb4c369ba9e4143223c9ba/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:08.660856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13568e21-1bd5-4808-a75a-483e0291a50a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.885014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:08.901534 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 918/1862] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:08 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:08.902937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9655c47-0beb-4e82-9e0c-393aa2f95e44 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:08.950826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13568e21-1bd5-4808-a75a-483e0291a50a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:09.000836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e085788-2e82-472f-ac86-d8faa82a45df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:09.003654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085788-2e82-472f-ac86-d8faa82a45df admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.004547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085788-2e82-472f-ac86-d8faa82a45df admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.004922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e085788-2e82-472f-ac86-d8faa82a45df admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.007144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e085788-2e82-472f-ac86-d8faa82a45df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:09.010666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e085788-2e82-472f-ac86-d8faa82a45df admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:09.110971 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 945/1863] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:08 2022] POST /identity/v3/users => generated 298 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:09.115148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6054fa-ee28-42ca-862f-5cd77ed43a59 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.115680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6054fa-ee28-42ca-862f-5cd77ed43a59 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.117029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6054fa-ee28-42ca-862f-5cd77ed43a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.168893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9655c47-0beb-4e82-9e0c-393aa2f95e44 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:09.182376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dc081-bb77-4057-9b24-992d9c4eb095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:09.184639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dc081-bb77-4057-9b24-992d9c4eb095 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.185103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dc081-bb77-4057-9b24-992d9c4eb095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.185306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2a6054fa-ee28-42ca-862f-5cd77ed43a59 None None] MFA Rules not processed for user `299371ae14cb4c369ba9e4143223c9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:09.187047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2a6054fa-ee28-42ca-862f-5cd77ed43a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:09.223688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dc081-bb77-4057-9b24-992d9c4eb095 admin admin] PATH_INFO: `/v3/projects/7cf51cb34f3c455eb8d22864d730231d/users/274c219756a64992aadd37a89b12077a/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.246710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dc081-bb77-4057-9b24-992d9c4eb095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf51cb34f3c455eb8d22864d730231d, user_id=274c219756a64992aadd37a89b12077a, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:09.280866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dc081-bb77-4057-9b24-992d9c4eb095 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:09.353956 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 919/1864] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:08 2022] PUT /identity/v3/projects/7cf51cb34f3c455eb8d22864d730231d/users/274c219756a64992aadd37a89b12077a/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:09.353956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd78b3-e85b-4eee-955c-a5d2d8b8827f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.360304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd78b3-e85b-4eee-955c-a5d2d8b8827f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.363658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd78b3-e85b-4eee-955c-a5d2d8b8827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.456932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d6bd78b3-e85b-4eee-955c-a5d2d8b8827f None None] MFA Rules not processed for user `3845aed02101447aa07fabd6a600498f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:09.463402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d6bd78b3-e85b-4eee-955c-a5d2d8b8827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:09.485751 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 946/1865] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:09.491845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6054fa-ee28-42ca-862f-5cd77ed43a59 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:09.494700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2a6054fa-ee28-42ca-862f-5cd77ed43a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:09.668586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6054fa-ee28-42ca-862f-5cd77ed43a59 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:09.685294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:09.716425 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 920/1866] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:09.737440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd78b3-e85b-4eee-955c-a5d2d8b8827f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:09.804807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:09.822681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b29274-45d5-4188-b8da-9af1364df965 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:09.823620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b29274-45d5-4188-b8da-9af1364df965 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.824012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b29274-45d5-4188-b8da-9af1364df965 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.824375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b29274-45d5-4188-b8da-9af1364df965 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.930676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd78b3-e85b-4eee-955c-a5d2d8b8827f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:09.944625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf555d4a-3fb4-49db-8c45-7ef8bbc8e366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:09.945640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf555d4a-3fb4-49db-8c45-7ef8bbc8e366 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.946096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf555d4a-3fb4-49db-8c45-7ef8bbc8e366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.946473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf555d4a-3fb4-49db-8c45-7ef8bbc8e366 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:09.947436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf555d4a-3fb4-49db-8c45-7ef8bbc8e366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:09.952575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf555d4a-3fb4-49db-8c45-7ef8bbc8e366 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:09.994017 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 921/1867] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:09.996106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c031e63-52cb-46ee-b729-c3de286366b4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:09.996502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c031e63-52cb-46ee-b729-c3de286366b4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:09.996971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c031e63-52cb-46ee-b729-c3de286366b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.006469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b29274-45d5-4188-b8da-9af1364df965 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:10.010598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b29274-45d5-4188-b8da-9af1364df965 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:10.040218 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 947/1868] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:09 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:10.041385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b29274-45d5-4188-b8da-9af1364df965 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:10.065063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b29274-45d5-4188-b8da-9af1364df965 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:10.068169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4c031e63-52cb-46ee-b729-c3de286366b4 None None] MFA Rules not processed for user `274c219756a64992aadd37a89b12077a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:10.070157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4c031e63-52cb-46ee-b729-c3de286366b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:10.079763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b3fac-13be-4b15-9d1c-c96414ac2029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:10.080609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3fac-13be-4b15-9d1c-c96414ac2029 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:10.081038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3fac-13be-4b15-9d1c-c96414ac2029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:10.081476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b3fac-13be-4b15-9d1c-c96414ac2029 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.082358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b3fac-13be-4b15-9d1c-c96414ac2029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:10.085831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b3fac-13be-4b15-9d1c-c96414ac2029 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:10.169843 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 948/1869] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:10 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:10.170430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b3fac-13be-4b15-9d1c-c96414ac2029 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:10.307016 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 922/1870] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:10.307016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c031e63-52cb-46ee-b729-c3de286366b4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:10.323632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c031e63-52cb-46ee-b729-c3de286366b4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:10.359163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b3fac-13be-4b15-9d1c-c96414ac2029 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:10.383345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe25d8-9236-4d0f-9512-face2c7ba706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:10.384484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe25d8-9236-4d0f-9512-face2c7ba706 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:10.385080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe25d8-9236-4d0f-9512-face2c7ba706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:10.385380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe25d8-9236-4d0f-9512-face2c7ba706 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.386652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe25d8-9236-4d0f-9512-face2c7ba706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:10.389795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe25d8-9236-4d0f-9512-face2c7ba706 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:10.427112 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 949/1871] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:10.428752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe25d8-9236-4d0f-9512-face2c7ba706 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:10.440887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0dfe25d8-9236-4d0f-9512-face2c7ba706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:10.467825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3926b5-fbf1-4fcc-b57d-1d86dc2d6d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:10.469326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3926b5-fbf1-4fcc-b57d-1d86dc2d6d92 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:10.469923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3926b5-fbf1-4fcc-b57d-1d86dc2d6d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:10.470672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3926b5-fbf1-4fcc-b57d-1d86dc2d6d92 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.473419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3926b5-fbf1-4fcc-b57d-1d86dc2d6d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:10.479748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3926b5-fbf1-4fcc-b57d-1d86dc2d6d92 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:10.572618 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 923/1872] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:10 2022] POST /identity/v3/users => generated 298 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:10.576783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f9e4-fbc2-4d4a-94e1-afdabfe3cc54 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:10.577015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f9e4-fbc2-4d4a-94e1-afdabfe3cc54 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:10.577336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f9e4-fbc2-4d4a-94e1-afdabfe3cc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.625548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:10.646910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3bf0f9e4-fbc2-4d4a-94e1-afdabfe3cc54 None None] MFA Rules not processed for user `bf7c15d8a7d346338027aa00493088c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:10.648308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3bf0f9e4-fbc2-4d4a-94e1-afdabfe3cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:10.664568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe25d8-9236-4d0f-9512-face2c7ba706 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:10.688972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf741-198a-46eb-803f-453fb64065f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:10.690129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf741-198a-46eb-803f-453fb64065f9 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:10.690129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf741-198a-46eb-803f-453fb64065f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:10.690437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadf741-198a-46eb-803f-453fb64065f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.694549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8fadf741-198a-46eb-803f-453fb64065f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:10.709607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:10.799446 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 924/1873] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:10.804760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0f9e4-fbc2-4d4a-94e1-afdabfe3cc54 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:10.815047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadf741-198a-46eb-803f-453fb64065f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:10.817017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadf741-198a-46eb-803f-453fb64065f9 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:10.825043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0f9e4-fbc2-4d4a-94e1-afdabfe3cc54 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:10.829636 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 950/1874] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:10 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:10.831807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fd786-821d-4b26-a069-cf02440c1ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:10.833058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd786-821d-4b26-a069-cf02440c1ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:10.833499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd786-821d-4b26-a069-cf02440c1ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:10.833962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fd786-821d-4b26-a069-cf02440c1ff7 admin admin] PATH_INFO: `/v3/projects/e8076f41372349b88b744ae6ec9ff809/users/f1aaece6a5264bd69829bca58f4673e6/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.842225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf741-198a-46eb-803f-453fb64065f9 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:10.867278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fd786-821d-4b26-a069-cf02440c1ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8076f41372349b88b744ae6ec9ff809, user_id=f1aaece6a5264bd69829bca58f4673e6, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:10.869505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadf741-198a-46eb-803f-453fb64065f9 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:10.887183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da36f9-5926-472a-8746-c6f62791c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:10.887494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fd786-821d-4b26-a069-cf02440c1ff7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:10.887690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da36f9-5926-472a-8746-c6f62791c070 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:10.887690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da36f9-5926-472a-8746-c6f62791c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:10.887690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da36f9-5926-472a-8746-c6f62791c070 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.888137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da36f9-5926-472a-8746-c6f62791c070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:10.889973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da36f9-5926-472a-8746-c6f62791c070 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:10.913267 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 951/1875] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:10.922107 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 925/1876] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:10 2022] PUT /identity/v3/projects/e8076f41372349b88b744ae6ec9ff809/users/f1aaece6a5264bd69829bca58f4673e6/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:10.923840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da36f9-5926-472a-8746-c6f62791c070 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:10.941579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221a933-37f1-48b4-928c-ae071eea2b6a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:10.942096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221a933-37f1-48b4-928c-ae071eea2b6a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:10.942736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221a933-37f1-48b4-928c-ae071eea2b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:10.946498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da36f9-5926-472a-8746-c6f62791c070 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.001839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c221a933-37f1-48b4-928c-ae071eea2b6a None None] MFA Rules not processed for user `f1aaece6a5264bd69829bca58f4673e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:11.001839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c221a933-37f1-48b4-928c-ae071eea2b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:11.020993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758c595-0322-42bd-9f2c-90e275ba6731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.021692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c595-0322-42bd-9f2c-90e275ba6731 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.022320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c595-0322-42bd-9f2c-90e275ba6731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.022320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758c595-0322-42bd-9f2c-90e275ba6731 admin admin] PATH_INFO: `/v3/projects/a820d6aab0f14aa99af64ed5891452c4/users/6f4bef7f993a42489b7867be19126909/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.047250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758c595-0322-42bd-9f2c-90e275ba6731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a820d6aab0f14aa99af64ed5891452c4, user_id=6f4bef7f993a42489b7867be19126909, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.051271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758c595-0322-42bd-9f2c-90e275ba6731 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.074791 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 952/1877] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:10 2022] PUT /identity/v3/projects/a820d6aab0f14aa99af64ed5891452c4/users/6f4bef7f993a42489b7867be19126909/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:11.077050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758c595-0322-42bd-9f2c-90e275ba6731 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.145989 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 926/1878] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:11.149515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221a933-37f1-48b4-928c-ae071eea2b6a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.168584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221a933-37f1-48b4-928c-ae071eea2b6a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.188219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758c595-0322-42bd-9f2c-90e275ba6731 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.195751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b0c00-dfd8-49ef-8566-c22ec0c10c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.196576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b0c00-dfd8-49ef-8566-c22ec0c10c2b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.197050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b0c00-dfd8-49ef-8566-c22ec0c10c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.197488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b0c00-dfd8-49ef-8566-c22ec0c10c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.198483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b0c00-dfd8-49ef-8566-c22ec0c10c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.202636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b0c00-dfd8-49ef-8566-c22ec0c10c2b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.229272 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 953/1879] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:11.233856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b0c00-dfd8-49ef-8566-c22ec0c10c2b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.262292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b0c00-dfd8-49ef-8566-c22ec0c10c2b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.271874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da710b64-37e0-4ff0-819f-95286d3acac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.273084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da710b64-37e0-4ff0-819f-95286d3acac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.273518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da710b64-37e0-4ff0-819f-95286d3acac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.274013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da710b64-37e0-4ff0-819f-95286d3acac7 admin admin] PATH_INFO: `/v3/projects/a820d6aab0f14aa99af64ed5891452c4/users/6f4bef7f993a42489b7867be19126909/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.278297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da710b64-37e0-4ff0-819f-95286d3acac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a820d6aab0f14aa99af64ed5891452c4, user_id=6f4bef7f993a42489b7867be19126909, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.283719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da710b64-37e0-4ff0-819f-95286d3acac7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.288781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf9065-8cec-44be-881c-93e397dd664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.290739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9065-8cec-44be-881c-93e397dd664a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.291233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9065-8cec-44be-881c-93e397dd664a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.292067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9065-8cec-44be-881c-93e397dd664a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.293291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9065-8cec-44be-881c-93e397dd664a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.296722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9065-8cec-44be-881c-93e397dd664a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.313947 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 954/1880] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:11 2022] PUT /identity/v3/projects/a820d6aab0f14aa99af64ed5891452c4/users/6f4bef7f993a42489b7867be19126909/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:11.328210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e197db3-5e32-4d6d-9f13-221dfb24767d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.328671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e197db3-5e32-4d6d-9f13-221dfb24767d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.330309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e197db3-5e32-4d6d-9f13-221dfb24767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.348903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:11.375455 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 927/1881] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:11 2022] POST /identity/v3/projects => generated 391 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:14:11.380622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf9065-8cec-44be-881c-93e397dd664a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.380998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2e197db3-5e32-4d6d-9f13-221dfb24767d None None] MFA Rules not processed for user `6f4bef7f993a42489b7867be19126909`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:11.382480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2e197db3-5e32-4d6d-9f13-221dfb24767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:11.386329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:11.493525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf9065-8cec-44be-881c-93e397dd664a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.497203 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 955/1882] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:11.498350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e197db3-5e32-4d6d-9f13-221dfb24767d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.504765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93844b7f-e960-4e2d-816b-4e58749064ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.505522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844b7f-e960-4e2d-816b-4e58749064ee service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.505789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844b7f-e960-4e2d-816b-4e58749064ee service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.506200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93844b7f-e960-4e2d-816b-4e58749064ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.508180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-93844b7f-e960-4e2d-816b-4e58749064ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:11.579678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e197db3-5e32-4d6d-9f13-221dfb24767d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.585894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4907d-c1e6-4e90-9f00-0fe949a3dcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.586548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4907d-c1e6-4e90-9f00-0fe949a3dcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.586824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4907d-c1e6-4e90-9f00-0fe949a3dcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.587093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4907d-c1e6-4e90-9f00-0fe949a3dcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.587756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4907d-c1e6-4e90-9f00-0fe949a3dcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.589929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4907d-c1e6-4e90-9f00-0fe949a3dcf8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.610582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93844b7f-e960-4e2d-816b-4e58749064ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.614257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93844b7f-e960-4e2d-816b-4e58749064ee service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.617939 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 956/1883] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:11 2022] POST /identity/v3/users => generated 302 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:11.619348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569282d-9d83-4b8d-9841-f3d438983c88 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.619636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569282d-9d83-4b8d-9841-f3d438983c88 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.620557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569282d-9d83-4b8d-9841-f3d438983c88 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.621931 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 957/1884] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:11.623279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569282d-9d83-4b8d-9841-f3d438983c88 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.636793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569282d-9d83-4b8d-9841-f3d438983c88 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.638336 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 928/1885] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:11.641003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b17ed-4810-4301-b8da-7a7ee07671e3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.641515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b17ed-4810-4301-b8da-7a7ee07671e3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.641908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132069-5360-477d-8ebd-3cb73593fdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.642121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b17ed-4810-4301-b8da-7a7ee07671e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.642549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132069-5360-477d-8ebd-3cb73593fdef admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.642828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132069-5360-477d-8ebd-3cb73593fdef admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.643097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132069-5360-477d-8ebd-3cb73593fdef admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.643910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba132069-5360-477d-8ebd-3cb73593fdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.646244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba132069-5360-477d-8ebd-3cb73593fdef admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.658805 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 958/1886] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:14:11.664486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132069-5360-477d-8ebd-3cb73593fdef admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.675813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-258b17ed-4810-4301-b8da-7a7ee07671e3 None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:11.676138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132069-5360-477d-8ebd-3cb73593fdef admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.678763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-258b17ed-4810-4301-b8da-7a7ee07671e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:11.686361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525472f6-f93e-49b8-af2f-3f3dc37b5fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.687730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525472f6-f93e-49b8-af2f-3f3dc37b5fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.688578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525472f6-f93e-49b8-af2f-3f3dc37b5fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.690523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525472f6-f93e-49b8-af2f-3f3dc37b5fe7 admin admin] PATH_INFO: `/v3/projects/4b27b5c3b7b54b84a85f5a5a02031d58/users/3421e1b1e86d4355a89161a9ce16933e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.721464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525472f6-f93e-49b8-af2f-3f3dc37b5fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b27b5c3b7b54b84a85f5a5a02031d58, user_id=3421e1b1e86d4355a89161a9ce16933e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.728207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525472f6-f93e-49b8-af2f-3f3dc37b5fe7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.752856 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 959/1887] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:11 2022] PUT /identity/v3/projects/4b27b5c3b7b54b84a85f5a5a02031d58/users/3421e1b1e86d4355a89161a9ce16933e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:11.759043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525472f6-f93e-49b8-af2f-3f3dc37b5fe7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.785695 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 929/1888] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:14:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:11.846877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:11.847386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b17ed-4810-4301-b8da-7a7ee07671e3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.849216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-258b17ed-4810-4301-b8da-7a7ee07671e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:11.863852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b17ed-4810-4301-b8da-7a7ee07671e3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.899302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525472f6-f93e-49b8-af2f-3f3dc37b5fe7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.911821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddac4ab-4365-4ace-8577-f352878b7b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.912470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddac4ab-4365-4ace-8577-f352878b7b74 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.912808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddac4ab-4365-4ace-8577-f352878b7b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.913016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddac4ab-4365-4ace-8577-f352878b7b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.913688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddac4ab-4365-4ace-8577-f352878b7b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.915469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddac4ab-4365-4ace-8577-f352878b7b74 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.934152 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 960/1889] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:14:11.940658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddac4ab-4365-4ace-8577-f352878b7b74 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:11.947241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:11.958113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddac4ab-4365-4ace-8577-f352878b7b74 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:11.963487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edfa70-704f-4ea9-8d8a-ff5439b65b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.964062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07235efb-cdb9-44d5-868f-1b7017db73cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:11.964895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07235efb-cdb9-44d5-868f-1b7017db73cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.965413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07235efb-cdb9-44d5-868f-1b7017db73cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.965725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edfa70-704f-4ea9-8d8a-ff5439b65b7b service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:11.965924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07235efb-cdb9-44d5-868f-1b7017db73cd admin admin] PATH_INFO: `/v3/projects/4b27b5c3b7b54b84a85f5a5a02031d58/users/3421e1b1e86d4355a89161a9ce16933e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.966648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edfa70-704f-4ea9-8d8a-ff5439b65b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:11.967599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edfa70-704f-4ea9-8d8a-ff5439b65b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:11.968319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07235efb-cdb9-44d5-868f-1b7017db73cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b27b5c3b7b54b84a85f5a5a02031d58, user_id=3421e1b1e86d4355a89161a9ce16933e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.971394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07235efb-cdb9-44d5-868f-1b7017db73cd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:11.984254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edfa70-704f-4ea9-8d8a-ff5439b65b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:11.987561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edfa70-704f-4ea9-8d8a-ff5439b65b7b service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:12.003306 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 961/1890] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:11 2022] PUT /identity/v3/projects/4b27b5c3b7b54b84a85f5a5a02031d58/users/3421e1b1e86d4355a89161a9ce16933e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:12.003640 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 930/1891] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:12.006219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d0264-5bd2-4903-ae2d-dff189363c15 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.006707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d0264-5bd2-4903-ae2d-dff189363c15 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.007176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d0264-5bd2-4903-ae2d-dff189363c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.060353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e84d0264-5bd2-4903-ae2d-dff189363c15 None None] MFA Rules not processed for user `3421e1b1e86d4355a89161a9ce16933e`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:12.062498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e84d0264-5bd2-4903-ae2d-dff189363c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:12.162070 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 962/1892] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:12.167014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edfa70-704f-4ea9-8d8a-ff5439b65b7b service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.179829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edfa70-704f-4ea9-8d8a-ff5439b65b7b service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:12.245264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4fd3a-d475-4b7f-9538-7a05bfcd4e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:12.246048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4fd3a-d475-4b7f-9538-7a05bfcd4e64 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.246393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4fd3a-d475-4b7f-9538-7a05bfcd4e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.246735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4fd3a-d475-4b7f-9538-7a05bfcd4e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.247459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4fd3a-d475-4b7f-9538-7a05bfcd4e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:12.249546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4fd3a-d475-4b7f-9538-7a05bfcd4e64 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:12.282313 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 931/1893] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:12 2022] POST /identity/v3/projects => generated 391 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:14:12.287082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d0264-5bd2-4903-ae2d-dff189363c15 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.298622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d0264-5bd2-4903-ae2d-dff189363c15 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:12.453812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cefcc-ce94-4c08-bb9c-b0f0b3f49b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:12.455320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cefcc-ce94-4c08-bb9c-b0f0b3f49b00 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.456027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cefcc-ce94-4c08-bb9c-b0f0b3f49b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.456877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cefcc-ce94-4c08-bb9c-b0f0b3f49b00 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.459126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cefcc-ce94-4c08-bb9c-b0f0b3f49b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:12.463828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cefcc-ce94-4c08-bb9c-b0f0b3f49b00 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:12.511002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4fd3a-d475-4b7f-9538-7a05bfcd4e64 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.518381 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 963/1894] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:12 2022] POST /identity/v3/users => generated 296 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:12.528873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4fd3a-d475-4b7f-9538-7a05bfcd4e64 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:12.536101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec2911-1a1f-49a7-9870-2b988e10e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:12.536920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec2911-1a1f-49a7-9870-2b988e10e05f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.537321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec2911-1a1f-49a7-9870-2b988e10e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.537747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec2911-1a1f-49a7-9870-2b988e10e05f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.538457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec2911-1a1f-49a7-9870-2b988e10e05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:12.540918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec2911-1a1f-49a7-9870-2b988e10e05f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:12.558586 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 932/1895] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:12.560985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cefcc-ce94-4c08-bb9c-b0f0b3f49b00 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.573897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cefcc-ce94-4c08-bb9c-b0f0b3f49b00 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:12.581636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79fce5-a954-46e9-aafd-d4dbd2b5de11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:12.582427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79fce5-a954-46e9-aafd-d4dbd2b5de11 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.582570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79fce5-a954-46e9-aafd-d4dbd2b5de11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.583059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79fce5-a954-46e9-aafd-d4dbd2b5de11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.583854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79fce5-a954-46e9-aafd-d4dbd2b5de11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:12.586094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79fce5-a954-46e9-aafd-d4dbd2b5de11 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:12.603023 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 964/1896] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:12.604423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec2911-1a1f-49a7-9870-2b988e10e05f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.643270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79fce5-a954-46e9-aafd-d4dbd2b5de11 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:12.649349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec2911-1a1f-49a7-9870-2b988e10e05f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:12.680537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee7cca-4739-4d4c-91e9-43a18c82f634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:12.686261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee7cca-4739-4d4c-91e9-43a18c82f634 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.686880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee7cca-4739-4d4c-91e9-43a18c82f634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.687541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee7cca-4739-4d4c-91e9-43a18c82f634 admin admin] PATH_INFO: `/v3/projects/8108c7c9a24f4d74aa520cd7c37a3307/users/6ad9f8969ca0454897bbde49a287baec/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.783459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee7cca-4739-4d4c-91e9-43a18c82f634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8108c7c9a24f4d74aa520cd7c37a3307, user_id=6ad9f8969ca0454897bbde49a287baec, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:12.796576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:12.797582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee7cca-4739-4d4c-91e9-43a18c82f634 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:12.872548 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 933/1897] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:12 2022] PUT /identity/v3/projects/8108c7c9a24f4d74aa520cd7c37a3307/users/6ad9f8969ca0454897bbde49a287baec/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:12.885390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1c8e1-bc30-47ef-b841-7cca4744bfea None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:12.888398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1c8e1-bc30-47ef-b841-7cca4744bfea None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:12.890566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1c8e1-bc30-47ef-b841-7cca4744bfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:12.967525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79fce5-a954-46e9-aafd-d4dbd2b5de11 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:12.980353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c4b1c8e1-bc30-47ef-b841-7cca4744bfea None None] MFA Rules not processed for user `6ad9f8969ca0454897bbde49a287baec`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:12.981978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c4b1c8e1-bc30-47ef-b841-7cca4744bfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:13.166321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ab145-69e2-4228-8490-316d6327693d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:13.167785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ab145-69e2-4228-8490-316d6327693d service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.168784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ab145-69e2-4228-8490-316d6327693d service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.170348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ab145-69e2-4228-8490-316d6327693d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.243320 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 934/1898] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:13.347178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ab145-69e2-4228-8490-316d6327693d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:13.350119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ab145-69e2-4228-8490-316d6327693d service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:13.369236 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 965/1899] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:13.491085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1c8e1-bc30-47ef-b841-7cca4744bfea None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:13.505361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1c8e1-bc30-47ef-b841-7cca4744bfea None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:13.512345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84faba-4f92-4bc6-9e38-994a505c8c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:13.513398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84faba-4f92-4bc6-9e38-994a505c8c21 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.513398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84faba-4f92-4bc6-9e38-994a505c8c21 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.513709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84faba-4f92-4bc6-9e38-994a505c8c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.579759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:13.659971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84faba-4f92-4bc6-9e38-994a505c8c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:13.662661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84faba-4f92-4bc6-9e38-994a505c8c21 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:13.691150 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 935/1900] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:13.880176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedec09-6200-4074-b478-7babf8ddc164 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.880929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedec09-6200-4074-b478-7babf8ddc164 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.881287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedec09-6200-4074-b478-7babf8ddc164 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.884100 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 966/1901] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:14:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:14:13.889601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84faba-4f92-4bc6-9e38-994a505c8c21 service nova] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:14:13.903832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84faba-4f92-4bc6-9e38-994a505c8c21 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:13.914862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84faba-4f92-4bc6-9e38-994a505c8c21 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:13.920551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d98d1-0cae-4495-b8c2-9d24b745d1ba tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3421e1b1e86d4355a89161a9ce16933e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b27b5c3b7b54b84a85f5a5a02031d58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:13.921248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d98d1-0cae-4495-b8c2-9d24b745d1ba tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:13.921523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d98d1-0cae-4495-b8c2-9d24b745d1ba tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:13.921790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d98d1-0cae-4495-b8c2-9d24b745d1ba tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] PATH_INFO: `/v3/projects/e8076f41372349b88b744ae6ec9ff809` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:13.923198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d98d1-0cae-4495-b8c2-9d24b745d1ba tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorizing `identity:get_project(project_id=e8076f41372349b88b744ae6ec9ff809)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:13.925798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d98d1-0cae-4495-b8c2-9d24b745d1ba tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:13.927937 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 936/1902] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:14:13 2022] GET /identity/v3/projects/e8076f41372349b88b744ae6ec9ff809 => generated 395 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:14.023866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734755-e773-4d43-aa57-6536e1304e60 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.024220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734755-e773-4d43-aa57-6536e1304e60 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.024558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea734755-e773-4d43-aa57-6536e1304e60 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.026564 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 967/1903] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:14:14.032096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d98d1-0cae-4495-b8c2-9d24b745d1ba tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:14:14.045471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d98d1-0cae-4495-b8c2-9d24b745d1ba tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:14.056215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d98d1-0cae-4495-b8c2-9d24b745d1ba tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:14.065540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1059-87fe-4a63-b728-e1aa23c42dbd tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3421e1b1e86d4355a89161a9ce16933e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b27b5c3b7b54b84a85f5a5a02031d58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:14.067272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1059-87fe-4a63-b728-e1aa23c42dbd tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.067732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1059-87fe-4a63-b728-e1aa23c42dbd tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.068036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1059-87fe-4a63-b728-e1aa23c42dbd tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] PATH_INFO: `/v3/projects/e8076f41372349b88b744ae6ec9ff809` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.069353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c1059-87fe-4a63-b728-e1aa23c42dbd tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorizing `identity:get_project(project_id=e8076f41372349b88b744ae6ec9ff809)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:14.071476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c1059-87fe-4a63-b728-e1aa23c42dbd tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:14.073373 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 937/1904] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:14:14 2022] GET /identity/v3/projects/e8076f41372349b88b744ae6ec9ff809 => generated 395 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:14.117394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0655-36e1-4f1c-b857-b2c7d0aea9f0 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.117708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0655-36e1-4f1c-b857-b2c7d0aea9f0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.117854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0655-36e1-4f1c-b857-b2c7d0aea9f0 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.119417 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 968/1905] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:14.129677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1059-87fe-4a63-b728-e1aa23c42dbd tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:14:14.153460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1059-87fe-4a63-b728-e1aa23c42dbd tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:14.170170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1059-87fe-4a63-b728-e1aa23c42dbd tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:14.179295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09142bea-9828-4367-943d-e2a98745d2aa tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3421e1b1e86d4355a89161a9ce16933e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b27b5c3b7b54b84a85f5a5a02031d58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:14.180215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09142bea-9828-4367-943d-e2a98745d2aa tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.180697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09142bea-9828-4367-943d-e2a98745d2aa tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.181275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09142bea-9828-4367-943d-e2a98745d2aa tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] PATH_INFO: `/v3/projects/e8076f41372349b88b744ae6ec9ff809` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.182926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09142bea-9828-4367-943d-e2a98745d2aa tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorizing `identity:get_project(project_id=e8076f41372349b88b744ae6ec9ff809)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:14.186265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09142bea-9828-4367-943d-e2a98745d2aa tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:14.188571 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 938/1906] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:14:14 2022] GET /identity/v3/projects/e8076f41372349b88b744ae6ec9ff809 => generated 395 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:14.714120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d0655-36e1-4f1c-b857-b2c7d0aea9f0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:14.830496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d0655-36e1-4f1c-b857-b2c7d0aea9f0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:14.838988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:14.840888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:14.840888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:14.842106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] PATH_INFO: `/v3/users/21ff63936f09401e84f3055b9d0a00b9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:14.843567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ff63936f09401e84f3055b9d0a00b9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:14.846078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:14.849897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:14.934479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ff63936f09401e84f3055b9d0a00b9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:14.937184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ff63936f09401e84f3055b9d0a00b9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:14.957541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ff63936f09401e84f3055b9d0a00b9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:14.972429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ff63936f09401e84f3055b9d0a00b9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:14.999867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ff63936f09401e84f3055b9d0a00b9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:15.012491 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 969/1907] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:14 2022] DELETE /identity/v3/users/21ff63936f09401e84f3055b9d0a00b9 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:15.023356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6474-d938-4008-b6c7-3b0f19b4d2dc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:15.024079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6474-d938-4008-b6c7-3b0f19b4d2dc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:15.039140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6474-d938-4008-b6c7-3b0f19b4d2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:15.067943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:15.070167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:15.143077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fc5a6474-d938-4008-b6c7-3b0f19b4d2dc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:15.148743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fc5a6474-d938-4008-b6c7-3b0f19b4d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:15.328678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b08b2-d129-47c1-9c12-9a6b771e2b7e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:15.350037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:15.351684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:15.352663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:15.353897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] PATH_INFO: `/v3/users/299371ae14cb4c369ba9e4143223c9ba` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:15.358118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299371ae14cb4c369ba9e4143223c9ba)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:15.362566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:15.400929 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 939/1908] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:15.442336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6474-d938-4008-b6c7-3b0f19b4d2dc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:15.443917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fc5a6474-d938-4008-b6c7-3b0f19b4d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:15.606144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299371ae14cb4c369ba9e4143223c9ba'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:15.608984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299371ae14cb4c369ba9e4143223c9ba'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:15.652705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299371ae14cb4c369ba9e4143223c9ba'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:15.667161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6474-d938-4008-b6c7-3b0f19b4d2dc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:15.687540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299371ae14cb4c369ba9e4143223c9ba'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:15.689226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc360e7-34d3-4faa-befe-c98aa85696fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:15.690112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc360e7-34d3-4faa-befe-c98aa85696fd service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:15.691198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc360e7-34d3-4faa-befe-c98aa85696fd service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:15.691781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc360e7-34d3-4faa-befe-c98aa85696fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:15.694371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9fc360e7-34d3-4faa-befe-c98aa85696fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:15.749007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299371ae14cb4c369ba9e4143223c9ba'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:15.761959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:15.769124 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 970/1909] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:15 2022] DELETE /identity/v3/users/299371ae14cb4c369ba9e4143223c9ba => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:15.771685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:15.773797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:15.787552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:15.856417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc360e7-34d3-4faa-befe-c98aa85696fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:15.859803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc360e7-34d3-4faa-befe-c98aa85696fd service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:15.889017 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 940/1910] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:15 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:15.891461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8386-6ca5-4ef9-9001-9f15e708b8ad None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:15.892015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8386-6ca5-4ef9-9001-9f15e708b8ad None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:15.892554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c8386-6ca5-4ef9-9001-9f15e708b8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:15.905280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf791b-8ff6-4fcf-8b79-bbdc5b770987 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:15.916499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5c7c4-5ae9-49fa-9ed4-d101e805482c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:15.916499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5c7c4-5ae9-49fa-9ed4-d101e805482c service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:15.919060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5c7c4-5ae9-49fa-9ed4-d101e805482c service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:15.919060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5c7c4-5ae9-49fa-9ed4-d101e805482c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:15.921761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9ee5c7c4-5ae9-49fa-9ed4-d101e805482c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:15.937577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d29c8386-6ca5-4ef9-9001-9f15e708b8ad None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:15.940239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d29c8386-6ca5-4ef9-9001-9f15e708b8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:16.059140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5c7c4-5ae9-49fa-9ed4-d101e805482c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:16.060900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5c7c4-5ae9-49fa-9ed4-d101e805482c service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:16.077279 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 971/1911] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:16.133512 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 941/1912] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:16.156235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5c7c4-5ae9-49fa-9ed4-d101e805482c service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:16.176159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5c7c4-5ae9-49fa-9ed4-d101e805482c service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:16.192018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:16.198805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:16.200248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:16.200716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:16.237951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:16.243395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:16.276707 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 972/1913] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:17.021297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d986-5f9e-4bc8-b3c4-b3747ba1c9d1 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:17.021667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d986-5f9e-4bc8-b3c4-b3747ba1c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:17.022147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec55d986-5f9e-4bc8-b3c4-b3747ba1c9d1 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:17.025007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 942/1914] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:14:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:17.030784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:14:17.033365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:17.086119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55d986-5f9e-4bc8-b3c4-b3747ba1c9d1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:17.091485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ec55d986-5f9e-4bc8-b3c4-b3747ba1c9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:17.138722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec55d986-5f9e-4bc8-b3c4-b3747ba1c9d1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:17.155209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:17.156712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:17.158915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:17.159721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] PATH_INFO: `/v3/projects/3e735137c4aa4068af2f3ac3e1aeb091` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:17.167785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e735137c4aa4068af2f3ac3e1aeb091)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:17.172309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:17.239619 n-d-820368-36 devstack@keystone.service[82098]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 30 04:14:17.240189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:17.242496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:17.341202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e735137c4aa4068af2f3ac3e1aeb091', 'request_id': 'req-79b94f12-38d0-4fdd-805c-b4b8d36b4094'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:17.363403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:17.368544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e735137c4aa4068af2f3ac3e1aeb091', 'request_id': 'req-79b94f12-38d0-4fdd-805c-b4b8d36b4094'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:17.383070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e735137c4aa4068af2f3ac3e1aeb091', 'request_id': 'req-79b94f12-38d0-4fdd-805c-b4b8d36b4094'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:17.476132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] The token cache is being invalidate because project 3e735137c4aa4068af2f3ac3e1aeb091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:17.478716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:17.486848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:17.491966 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 943/1915] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:17 2022] DELETE /identity/v3/projects/3e735137c4aa4068af2f3ac3e1aeb091 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:17.498684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:17.505006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:17.552022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfea8b-ab22-48b9-958a-1f4bc6067e02 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:17.817481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283c0e0-7f65-44a0-b7b1-693792c21e5e tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3421e1b1e86d4355a89161a9ce16933e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b27b5c3b7b54b84a85f5a5a02031d58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:17.818200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283c0e0-7f65-44a0-b7b1-693792c21e5e tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:17.818478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283c0e0-7f65-44a0-b7b1-693792c21e5e tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:17.818751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283c0e0-7f65-44a0-b7b1-693792c21e5e tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] PATH_INFO: `/v3/projects/e8076f41372349b88b744ae6ec9ff809` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:17.820606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283c0e0-7f65-44a0-b7b1-693792c21e5e tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorizing `identity:get_project(project_id=e8076f41372349b88b744ae6ec9ff809)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:17.822772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283c0e0-7f65-44a0-b7b1-693792c21e5e tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:17.828172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b94f12-38d0-4fdd-805c-b4b8d36b4094 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:17.828491 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 973/1916] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:14:17 2022] GET /identity/v3/projects/e8076f41372349b88b744ae6ec9ff809 => generated 395 bytes in 798 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:17.830029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283c0e0-7f65-44a0-b7b1-693792c21e5e tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:17.842017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c283c0e0-7f65-44a0-b7b1-693792c21e5e tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:17.849455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:17.849963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:17.851144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:17.851508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] PATH_INFO: `/v3/users/de94a2e4eae240158b04ee1bdb8910ce` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:17.855464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de94a2e4eae240158b04ee1bdb8910ce)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:17.857505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:17.865445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:17.922298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283c0e0-7f65-44a0-b7b1-693792c21e5e tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:17.936689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:17.940473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:17.941040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:17.942758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] PATH_INFO: `/v3/projects/a16526c9c8104f0ba6314f8b839e42ea` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:17.945545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16526c9c8104f0ba6314f8b839e42ea)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:17.951251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:17.991618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de94a2e4eae240158b04ee1bdb8910ce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.013979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de94a2e4eae240158b04ee1bdb8910ce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.062901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de94a2e4eae240158b04ee1bdb8910ce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.084932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de94a2e4eae240158b04ee1bdb8910ce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.086500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d67fc5b0-ac83-4e27-85d0-fec24e13ec36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de94a2e4eae240158b04ee1bdb8910ce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.108393 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 944/1917] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:17 2022] DELETE /identity/v3/users/de94a2e4eae240158b04ee1bdb8910ce => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:18.113625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a223-c626-4764-949e-5c84da09038c None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.114440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a223-c626-4764-949e-5c84da09038c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.115274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a223-c626-4764-949e-5c84da09038c None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.119121 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 945/1918] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:14:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:18.127913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16526c9c8104f0ba6314f8b839e42ea', 'request_id': 'req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.138379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a7f3f-76bf-44cc-a5b2-1019f4ed5f8d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.140041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16526c9c8104f0ba6314f8b839e42ea', 'request_id': 'req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.140252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a7f3f-76bf-44cc-a5b2-1019f4ed5f8d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.140983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a7f3f-76bf-44cc-a5b2-1019f4ed5f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.160186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16526c9c8104f0ba6314f8b839e42ea', 'request_id': 'req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.184397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] The token cache is being invalidate because project a16526c9c8104f0ba6314f8b839e42ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:18.186101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.188521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.191506 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 974/1919] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:17 2022] DELETE /identity/v3/projects/a16526c9c8104f0ba6314f8b839e42ea => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:18.201211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:18.204719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:18.221953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9c3a7f3f-76bf-44cc-a5b2-1019f4ed5f8d None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:18.225569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c3a7f3f-76bf-44cc-a5b2-1019f4ed5f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:18.378397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c6c7e-6b3f-4ac7-ba8f-d81059a8c2e9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:18.404821 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 946/1920] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:14:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:18.432207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:18.552331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:18.553382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:18.553849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:18.554243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] PATH_INFO: `/v3/users/6f4bef7f993a42489b7867be19126909` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:18.556076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4bef7f993a42489b7867be19126909)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:18.559698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:18.661422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4bef7f993a42489b7867be19126909'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.662489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4bef7f993a42489b7867be19126909'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.700212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4bef7f993a42489b7867be19126909'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.719784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4bef7f993a42489b7867be19126909'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.775438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8357998c-e453-4a10-9188-6b1d5652f751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4bef7f993a42489b7867be19126909'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:18.791389 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 975/1921] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:18 2022] DELETE /identity/v3/users/6f4bef7f993a42489b7867be19126909 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:19.000647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a7f3f-76bf-44cc-a5b2-1019f4ed5f8d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.003288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c3a7f3f-76bf-44cc-a5b2-1019f4ed5f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:19.027631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a7f3f-76bf-44cc-a5b2-1019f4ed5f8d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.106842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.107963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.108488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.108950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.111178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:19.124114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.125979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.128572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.144224 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 947/1922] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:19.227421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c7e0b-9bc2-4b07-a60a-4929672dabfa None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.227752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c7e0b-9bc2-4b07-a60a-4929672dabfa None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.228037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c7e0b-9bc2-4b07-a60a-4929672dabfa None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.230504 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 976/1923] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:19.235692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:14:19.237674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:19.257694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.259869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:19.265823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c7e0b-9bc2-4b07-a60a-4929672dabfa None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.268106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e96c7e0b-9bc2-4b07-a60a-4929672dabfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:19.436049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c7e0b-9bc2-4b07-a60a-4929672dabfa None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.446191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.446983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.447321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.447647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] PATH_INFO: `/v3/projects/04a05769fa7846de844b2b73b5a7f962` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.448961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a05769fa7846de844b2b73b5a7f962)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.451273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.485245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aedd36d-3c26-4435-a2ac-9cbf8643e616 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.492201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b212d7-e26b-4be1-8387-3b96ac045559 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3421e1b1e86d4355a89161a9ce16933e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b27b5c3b7b54b84a85f5a5a02031d58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.492972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b212d7-e26b-4be1-8387-3b96ac045559 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.493301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b212d7-e26b-4be1-8387-3b96ac045559 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.493528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b212d7-e26b-4be1-8387-3b96ac045559 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] PATH_INFO: `/v3/projects/e8076f41372349b88b744ae6ec9ff809` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.495520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b212d7-e26b-4be1-8387-3b96ac045559 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorizing `identity:get_project(project_id=e8076f41372349b88b744ae6ec9ff809)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.497834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b212d7-e26b-4be1-8387-3b96ac045559 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.500149 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 948/1924] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:14:19 2022] GET /identity/v3/projects/e8076f41372349b88b744ae6ec9ff809 => generated 395 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:19.558982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.591640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a05769fa7846de844b2b73b5a7f962', 'request_id': 'req-05bcb97d-8519-423c-980f-0c12c837275e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:19.608551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a05769fa7846de844b2b73b5a7f962', 'request_id': 'req-05bcb97d-8519-423c-980f-0c12c837275e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:19.625131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a05769fa7846de844b2b73b5a7f962', 'request_id': 'req-05bcb97d-8519-423c-980f-0c12c837275e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:19.643991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b212d7-e26b-4be1-8387-3b96ac045559 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.647124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-75b212d7-e26b-4be1-8387-3b96ac045559 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:19.662987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] The token cache is being invalidate because project 04a05769fa7846de844b2b73b5a7f962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:19.664477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:19.664830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05bcb97d-8519-423c-980f-0c12c837275e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:19.668025 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 977/1925] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:19 2022] DELETE /identity/v3/projects/04a05769fa7846de844b2b73b5a7f962 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:19.673840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b212d7-e26b-4be1-8387-3b96ac045559 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:19.676039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd48620-ecba-4ec3-9b01-becc3741f29a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.676356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd48620-ecba-4ec3-9b01-becc3741f29a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.685204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd48620-ecba-4ec3-9b01-becc3741f29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.723743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5fd48620-ecba-4ec3-9b01-becc3741f29a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:19.732157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5fd48620-ecba-4ec3-9b01-becc3741f29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:19.817171 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 978/1926] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:19.817481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:19.818211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.818559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.818897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] PATH_INFO: `/v3/projects/a820d6aab0f14aa99af64ed5891452c4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.819083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4bfed-08a4-40e5-819e-df8f3690208b None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.819384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4bfed-08a4-40e5-819e-df8f3690208b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.819836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4bfed-08a4-40e5-819e-df8f3690208b None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.820363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a820d6aab0f14aa99af64ed5891452c4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:19.821666 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 979/1927] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:19.822592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:19.826351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb33490-e020-4740-8da5-a81e07f8e700 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:19.826667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb33490-e020-4740-8da5-a81e07f8e700 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:19.826964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb33490-e020-4740-8da5-a81e07f8e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:19.851690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1eb33490-e020-4740-8da5-a81e07f8e700 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:19.853271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1eb33490-e020-4740-8da5-a81e07f8e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:19.867411 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 980/1928] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:19.868647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb33490-e020-4740-8da5-a81e07f8e700 None None] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:14:19.870339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1eb33490-e020-4740-8da5-a81e07f8e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:19.895042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a820d6aab0f14aa99af64ed5891452c4', 'request_id': 'req-86b21419-740d-4508-aa4c-0319452087dc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:19.909071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a820d6aab0f14aa99af64ed5891452c4', 'request_id': 'req-86b21419-740d-4508-aa4c-0319452087dc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:19.921053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a820d6aab0f14aa99af64ed5891452c4', 'request_id': 'req-86b21419-740d-4508-aa4c-0319452087dc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:19.939805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] The token cache is being invalidate because project a820d6aab0f14aa99af64ed5891452c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:19.940661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:19.941899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:19.946104 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 949/1929] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:19 2022] DELETE /identity/v3/projects/a820d6aab0f14aa99af64ed5891452c4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:19.947159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.951114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:19.988261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb33490-e020-4740-8da5-a81e07f8e700 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:19.989605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1eb33490-e020-4740-8da5-a81e07f8e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:20.007147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:20.059676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:20.064681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b21419-740d-4508-aa4c-0319452087dc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.073065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35499b5b-bf1c-4a57-96c9-69051440d3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.073908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35499b5b-bf1c-4a57-96c9-69051440d3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.074222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35499b5b-bf1c-4a57-96c9-69051440d3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.074536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35499b5b-bf1c-4a57-96c9-69051440d3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.075233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35499b5b-bf1c-4a57-96c9-69051440d3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:20.075577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35499b5b-bf1c-4a57-96c9-69051440d3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.077782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35499b5b-bf1c-4a57-96c9-69051440d3a9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.080716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb33490-e020-4740-8da5-a81e07f8e700 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.097377 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 950/1930] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:20.097377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f0e5-daba-453b-b67d-59e110128d8a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.097377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f0e5-daba-453b-b67d-59e110128d8a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.097377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786f0e5-daba-453b-b67d-59e110128d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.124981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6786f0e5-daba-453b-b67d-59e110128d8a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:20.125591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6786f0e5-daba-453b-b67d-59e110128d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:20.138863 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 951/1931] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:20.139850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786f0e5-daba-453b-b67d-59e110128d8a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.153460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786f0e5-daba-453b-b67d-59e110128d8a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.159082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d2e4e-528b-4a78-83b1-75768d9ed99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.159947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d2e4e-528b-4a78-83b1-75768d9ed99d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.160289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d2e4e-528b-4a78-83b1-75768d9ed99d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.160730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d2e4e-528b-4a78-83b1-75768d9ed99d admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.161447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d2e4e-528b-4a78-83b1-75768d9ed99d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.164018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d2e4e-528b-4a78-83b1-75768d9ed99d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.172327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25954e-d0ed-4707-bf92-e54600487443 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3421e1b1e86d4355a89161a9ce16933e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4b27b5c3b7b54b84a85f5a5a02031d58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.173434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25954e-d0ed-4707-bf92-e54600487443 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.173936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25954e-d0ed-4707-bf92-e54600487443 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.175091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25954e-d0ed-4707-bf92-e54600487443 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] PATH_INFO: `/v3/projects/8108c7c9a24f4d74aa520cd7c37a3307` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.177788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25954e-d0ed-4707-bf92-e54600487443 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorizing `identity:get_project(project_id=8108c7c9a24f4d74aa520cd7c37a3307)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.182038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c25954e-d0ed-4707-bf92-e54600487443 tempest-FlavorsAccessNegativeTestJSON-92077954 tempest-FlavorsAccessNegativeTestJSON-92077954-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.183989 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 981/1932] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:14:19 2022] GET /identity/v3/projects/8108c7c9a24f4d74aa520cd7c37a3307 => generated 391 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:20.185057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5c1b7-71cb-41de-9189-e55b48e7145e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.185514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5c1b7-71cb-41de-9189-e55b48e7145e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.186337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5c1b7-71cb-41de-9189-e55b48e7145e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.222370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-77c5c1b7-71cb-41de-9189-e55b48e7145e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:20.224579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-77c5c1b7-71cb-41de-9189-e55b48e7145e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:20.226127 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 952/1933] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:20 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:20.228262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d2e4e-528b-4a78-83b1-75768d9ed99d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.320109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d2e4e-528b-4a78-83b1-75768d9ed99d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.329991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138fd15-1bbd-4049-aaa2-a9502f4c404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.332155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138fd15-1bbd-4049-aaa2-a9502f4c404a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.332656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138fd15-1bbd-4049-aaa2-a9502f4c404a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.333168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138fd15-1bbd-4049-aaa2-a9502f4c404a admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.334246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138fd15-1bbd-4049-aaa2-a9502f4c404a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.337280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138fd15-1bbd-4049-aaa2-a9502f4c404a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.343351 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 982/1934] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:20.348304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5c1b7-71cb-41de-9189-e55b48e7145e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.362754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5c1b7-71cb-41de-9189-e55b48e7145e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.373047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbe26b-4abc-4961-bb0b-a6a84763026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.373790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbe26b-4abc-4961-bb0b-a6a84763026e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.374217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbe26b-4abc-4961-bb0b-a6a84763026e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.374465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbe26b-4abc-4961-bb0b-a6a84763026e admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.375499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbe26b-4abc-4961-bb0b-a6a84763026e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:20.375499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbe26b-4abc-4961-bb0b-a6a84763026e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.377440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbe26b-4abc-4961-bb0b-a6a84763026e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.390944 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 953/1935] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:20 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:20.397043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138fd15-1bbd-4049-aaa2-a9502f4c404a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.404989 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 983/1936] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:20.409564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbe26b-4abc-4961-bb0b-a6a84763026e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.416146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138fd15-1bbd-4049-aaa2-a9502f4c404a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.423476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbe26b-4abc-4961-bb0b-a6a84763026e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.423671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f842-7372-4823-a125-c87e7dbb3ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.424761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f842-7372-4823-a125-c87e7dbb3ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.425438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f842-7372-4823-a125-c87e7dbb3ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.425762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527f842-7372-4823-a125-c87e7dbb3ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.426700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527f842-7372-4823-a125-c87e7dbb3ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.428621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527f842-7372-4823-a125-c87e7dbb3ce9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.428886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af741e46-8fe4-4cb5-b89f-74f028170717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.429794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af741e46-8fe4-4cb5-b89f-74f028170717 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.430173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af741e46-8fe4-4cb5-b89f-74f028170717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.430445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af741e46-8fe4-4cb5-b89f-74f028170717 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.431228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af741e46-8fe4-4cb5-b89f-74f028170717 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.433308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af741e46-8fe4-4cb5-b89f-74f028170717 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.444145 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 954/1937] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:20.448192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f842-7372-4823-a125-c87e7dbb3ce9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.462054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527f842-7372-4823-a125-c87e7dbb3ce9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.475030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3c103-6fdb-46e1-908d-73367e4adb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.475731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3c103-6fdb-46e1-908d-73367e4adb1b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.476078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3c103-6fdb-46e1-908d-73367e4adb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.476410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e3c103-6fdb-46e1-908d-73367e4adb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.477467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3c103-6fdb-46e1-908d-73367e4adb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.479642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e3c103-6fdb-46e1-908d-73367e4adb1b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.481918 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 984/1938] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:20 2022] POST /identity/v3/projects => generated 397 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:20.485850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af741e46-8fe4-4cb5-b89f-74f028170717 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.493566 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 955/1939] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:20.501590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3c103-6fdb-46e1-908d-73367e4adb1b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.518694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e3c103-6fdb-46e1-908d-73367e4adb1b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.626845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af741e46-8fe4-4cb5-b89f-74f028170717 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.633298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:20.636220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426e41-b6b0-4686-bcae-3f4df587c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.637280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426e41-b6b0-4686-bcae-3f4df587c4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.637280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426e41-b6b0-4686-bcae-3f4df587c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.637490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab426e41-b6b0-4686-bcae-3f4df587c4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.639207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab426e41-b6b0-4686-bcae-3f4df587c4d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.643814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab426e41-b6b0-4686-bcae-3f4df587c4d3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.656830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:20.674212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a5442-3d27-49d7-8e34-ec990d31a067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.676542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a5442-3d27-49d7-8e34-ec990d31a067 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.679905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a5442-3d27-49d7-8e34-ec990d31a067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.680492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a5442-3d27-49d7-8e34-ec990d31a067 admin admin] PATH_INFO: `/v3/projects/8305930a593e4b2b92b860db57765f99/users/d723ccd736984ffba1c924baa0a85c9c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.694817 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 985/1940] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:20 2022] POST /identity/v3/users => generated 299 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:14:20.695896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426e41-b6b0-4686-bcae-3f4df587c4d3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.699299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ab426e41-b6b0-4686-bcae-3f4df587c4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:20.704023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a5442-3d27-49d7-8e34-ec990d31a067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8305930a593e4b2b92b860db57765f99, user_id=d723ccd736984ffba1c924baa0a85c9c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.708950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a5442-3d27-49d7-8e34-ec990d31a067 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.716990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab426e41-b6b0-4686-bcae-3f4df587c4d3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.724842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.725659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.726105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.726441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] PATH_INFO: `/v3/users/f1aaece6a5264bd69829bca58f4673e6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.728585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1aaece6a5264bd69829bca58f4673e6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.730772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.732377 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 956/1941] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:20 2022] PUT /identity/v3/projects/8305930a593e4b2b92b860db57765f99/users/d723ccd736984ffba1c924baa0a85c9c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:20.734107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a5442-3d27-49d7-8e34-ec990d31a067 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.834140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1aaece6a5264bd69829bca58f4673e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:20.835746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1aaece6a5264bd69829bca58f4673e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:20.854081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1aaece6a5264bd69829bca58f4673e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:20.865928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a5442-3d27-49d7-8e34-ec990d31a067 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:20.873086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fc0bb-354e-4219-9aec-b62f8a664db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:20.873791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc0bb-354e-4219-9aec-b62f8a664db4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.874126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1aaece6a5264bd69829bca58f4673e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:20.874653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc0bb-354e-4219-9aec-b62f8a664db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.874941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fc0bb-354e-4219-9aec-b62f8a664db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.875690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fc0bb-354e-4219-9aec-b62f8a664db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:20.878912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fc0bb-354e-4219-9aec-b62f8a664db4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:20.891979 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 957/1942] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:20.894032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97831d-925c-47c8-9dbe-56bf76d77151 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.894319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97831d-925c-47c8-9dbe-56bf76d77151 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.894635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97831d-925c-47c8-9dbe-56bf76d77151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.913424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f99e8a96-e630-4b6e-bded-21bf4108dcb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1aaece6a5264bd69829bca58f4673e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:20.925726 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 986/1943] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:20 2022] DELETE /identity/v3/users/f1aaece6a5264bd69829bca58f4673e6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:20.932333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf760ba-02e9-4282-ad23-7a7300d2cc34 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:20.932617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf760ba-02e9-4282-ad23-7a7300d2cc34 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:20.932894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf760ba-02e9-4282-ad23-7a7300d2cc34 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:20.935877 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 987/1944] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:14:20 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:20.936716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf760ba-02e9-4282-ad23-7a7300d2cc34 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:20.948412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0bf760ba-02e9-4282-ad23-7a7300d2cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:20.959169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2b97831d-925c-47c8-9dbe-56bf76d77151 None None] MFA Rules not processed for user `d723ccd736984ffba1c924baa0a85c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:20.960601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2b97831d-925c-47c8-9dbe-56bf76d77151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:21.098395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf760ba-02e9-4282-ad23-7a7300d2cc34 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:21.102656 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 958/1945] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:21.102656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d67e9-ee62-4a85-bede-38ff79696156 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.102656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d67e9-ee62-4a85-bede-38ff79696156 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.105232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d67e9-ee62-4a85-bede-38ff79696156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.110694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d11a1-b913-4895-b71e-0f87030a0220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:21.111566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d11a1-b913-4895-b71e-0f87030a0220 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.111566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d11a1-b913-4895-b71e-0f87030a0220 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.111845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d11a1-b913-4895-b71e-0f87030a0220 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.112874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d11a1-b913-4895-b71e-0f87030a0220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:21.114674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d11a1-b913-4895-b71e-0f87030a0220 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:21.156426 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 988/1946] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:21.158503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8852-14bd-4c41-80a4-c08999cc11ea None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.158790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8852-14bd-4c41-80a4-c08999cc11ea None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.159558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc8852-14bd-4c41-80a4-c08999cc11ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.163578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7c1d67e9-ee62-4a85-bede-38ff79696156 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:21.165093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7c1d67e9-ee62-4a85-bede-38ff79696156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:21.179558 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 959/1947] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:21.181664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d67e9-ee62-4a85-bede-38ff79696156 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:21.183302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7c1d67e9-ee62-4a85-bede-38ff79696156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:21.186668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5fcc8852-14bd-4c41-80a4-c08999cc11ea None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:21.188594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5fcc8852-14bd-4c41-80a4-c08999cc11ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:21.198619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d67e9-ee62-4a85-bede-38ff79696156 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:21.204516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4a842-6e59-4c90-8c03-9f7ae0f0bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:21.205402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4a842-6e59-4c90-8c03-9f7ae0f0bd8e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.206010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4a842-6e59-4c90-8c03-9f7ae0f0bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.206496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4a842-6e59-4c90-8c03-9f7ae0f0bd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.207505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4a842-6e59-4c90-8c03-9f7ae0f0bd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:21.210846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4a842-6e59-4c90-8c03-9f7ae0f0bd8e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:21.268889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:21.293489 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 960/1948] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:21 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:21.295177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4a842-6e59-4c90-8c03-9f7ae0f0bd8e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:21.303203 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 989/1949] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:14:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:21.305645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8852-14bd-4c41-80a4-c08999cc11ea None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:21.308461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5fcc8852-14bd-4c41-80a4-c08999cc11ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:21.391253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc8852-14bd-4c41-80a4-c08999cc11ea None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:21.403508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:21.461787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4a842-6e59-4c90-8c03-9f7ae0f0bd8e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:21.463972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b5e2-d81e-4ff1-88f3-6a5ad24bb6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:21.465567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b5e2-d81e-4ff1-88f3-6a5ad24bb6ae service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.465852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b5e2-d81e-4ff1-88f3-6a5ad24bb6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.466162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3b5e2-d81e-4ff1-88f3-6a5ad24bb6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.475986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6a44a-2617-4416-87c4-4b6ab32e098f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:21.477218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a44a-2617-4416-87c4-4b6ab32e098f admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.478467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3b5e2-d81e-4ff1-88f3-6a5ad24bb6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:21.479815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a44a-2617-4416-87c4-4b6ab32e098f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.480095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6a44a-2617-4416-87c4-4b6ab32e098f admin admin] PATH_INFO: `/v3/projects/9c438e1a55db4516963d20083cc302ce/users/f7f37ef893ca4894a6ddc764c501473c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.480648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3b5e2-d81e-4ff1-88f3-6a5ad24bb6ae service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:21.496256 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 990/1950] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:21.497353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b5e2-d81e-4ff1-88f3-6a5ad24bb6ae service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:21.509445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3b5e2-d81e-4ff1-88f3-6a5ad24bb6ae service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:21.510414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6a44a-2617-4416-87c4-4b6ab32e098f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c438e1a55db4516963d20083cc302ce, user_id=f7f37ef893ca4894a6ddc764c501473c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:21.515484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6a44a-2617-4416-87c4-4b6ab32e098f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:21.517152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d57c-f679-4a83-afb6-7bb7021bd0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:21.522561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d57c-f679-4a83-afb6-7bb7021bd0fa admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.522853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d57c-f679-4a83-afb6-7bb7021bd0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.523187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8d57c-f679-4a83-afb6-7bb7021bd0fa admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.526113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d57c-f679-4a83-afb6-7bb7021bd0fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:21.529019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8d57c-f679-4a83-afb6-7bb7021bd0fa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:21.553682 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 961/1951] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:21 2022] PUT /identity/v3/projects/9c438e1a55db4516963d20083cc302ce/users/f7f37ef893ca4894a6ddc764c501473c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:21.555797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39a150-4b7f-4fa2-88a8-39f20de02ce6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.556137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39a150-4b7f-4fa2-88a8-39f20de02ce6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.556412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39a150-4b7f-4fa2-88a8-39f20de02ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.593178 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 991/1952] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:21 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:21.594444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d57c-f679-4a83-afb6-7bb7021bd0fa admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:21.594591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5f39a150-4b7f-4fa2-88a8-39f20de02ce6 None None] MFA Rules not processed for user `f7f37ef893ca4894a6ddc764c501473c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:21.596558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5f39a150-4b7f-4fa2-88a8-39f20de02ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:21.616828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8d57c-f679-4a83-afb6-7bb7021bd0fa admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:21.707687 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 962/1953] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:21 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:21.708689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39a150-4b7f-4fa2-88a8-39f20de02ce6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:21.766164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762797c-b9b9-4c74-975e-97b9919fd330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:21.766646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762797c-b9b9-4c74-975e-97b9919fd330 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.767375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762797c-b9b9-4c74-975e-97b9919fd330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.767375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762797c-b9b9-4c74-975e-97b9919fd330 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.767845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762797c-b9b9-4c74-975e-97b9919fd330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:21.769628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762797c-b9b9-4c74-975e-97b9919fd330 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:21.787113 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 992/1954] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:21.790242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762797c-b9b9-4c74-975e-97b9919fd330 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:21.804320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762797c-b9b9-4c74-975e-97b9919fd330 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:21.811746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd94a9-ef67-47fd-bc87-133092d8413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:21.812601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd94a9-ef67-47fd-bc87-133092d8413b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.814732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd94a9-ef67-47fd-bc87-133092d8413b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.815100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd94a9-ef67-47fd-bc87-133092d8413b admin admin] PATH_INFO: `/v3/projects/e05c28b49da141379c04f68274aa28f5/users/ebffb14d441a48f98c175dff3ce5bccf/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.861126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39a150-4b7f-4fa2-88a8-39f20de02ce6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:21.865256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd94a9-ef67-47fd-bc87-133092d8413b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05c28b49da141379c04f68274aa28f5, user_id=ebffb14d441a48f98c175dff3ce5bccf, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:21.869286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd94a9-ef67-47fd-bc87-133092d8413b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:21.872423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2bfa5-c346-4dce-86a9-317c852596b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:21.873306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2bfa5-c346-4dce-86a9-317c852596b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:21.873622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2bfa5-c346-4dce-86a9-317c852596b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:21.874318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2bfa5-c346-4dce-86a9-317c852596b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:21.875443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2bfa5-c346-4dce-86a9-317c852596b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:21.878161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2bfa5-c346-4dce-86a9-317c852596b0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:21.891761 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 993/1955] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:21 2022] PUT /identity/v3/projects/e05c28b49da141379c04f68274aa28f5/users/ebffb14d441a48f98c175dff3ce5bccf/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:21.896740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd94a9-ef67-47fd-bc87-133092d8413b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:21.930036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:21.984081 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 963/1956] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:21 2022] POST /identity/v3/projects => generated 399 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:21.985724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2bfa5-c346-4dce-86a9-317c852596b0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:21.990511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f9c2bfa5-c346-4dce-86a9-317c852596b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:22.022706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd94a9-ef67-47fd-bc87-133092d8413b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.108435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31e1fd-e990-4931-9773-d0c356d8a3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.109347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31e1fd-e990-4931-9773-d0c356d8a3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.109838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31e1fd-e990-4931-9773-d0c356d8a3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.110210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31e1fd-e990-4931-9773-d0c356d8a3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.112231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31e1fd-e990-4931-9773-d0c356d8a3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.113333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31e1fd-e990-4931-9773-d0c356d8a3e0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.138068 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 994/1957] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:14:22.138068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31e1fd-e990-4931-9773-d0c356d8a3e0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:22.151419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31e1fd-e990-4931-9773-d0c356d8a3e0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.158470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a81ae-b96b-495d-91ec-c11653cdbea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.159463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a81ae-b96b-495d-91ec-c11653cdbea5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.160990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a81ae-b96b-495d-91ec-c11653cdbea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.161324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a81ae-b96b-495d-91ec-c11653cdbea5 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.162110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a81ae-b96b-495d-91ec-c11653cdbea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.164163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a81ae-b96b-495d-91ec-c11653cdbea5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.170498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:22.200574 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 995/1958] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:22 2022] POST /identity/v3/users => generated 306 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:22.200574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a81ae-b96b-495d-91ec-c11653cdbea5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:22.226141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a81ae-b96b-495d-91ec-c11653cdbea5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.233915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349003-32e7-4c35-905d-37a7335ee73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.235192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349003-32e7-4c35-905d-37a7335ee73e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.236018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349003-32e7-4c35-905d-37a7335ee73e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.236304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24349003-32e7-4c35-905d-37a7335ee73e admin admin] PATH_INFO: `/v3/projects/e05c28b49da141379c04f68274aa28f5/users/ebffb14d441a48f98c175dff3ce5bccf/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.239644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24349003-32e7-4c35-905d-37a7335ee73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05c28b49da141379c04f68274aa28f5, user_id=ebffb14d441a48f98c175dff3ce5bccf, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.245455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24349003-32e7-4c35-905d-37a7335ee73e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.280434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2bfa5-c346-4dce-86a9-317c852596b0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.289710 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 996/1959] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:22 2022] PUT /identity/v3/projects/e05c28b49da141379c04f68274aa28f5/users/ebffb14d441a48f98c175dff3ce5bccf/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:22.298158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349003-32e7-4c35-905d-37a7335ee73e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:22.400879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24349003-32e7-4c35-905d-37a7335ee73e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.409278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a82dd-b762-4a57-96d2-f1342ee85f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.410139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a82dd-b762-4a57-96d2-f1342ee85f9f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.410422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a82dd-b762-4a57-96d2-f1342ee85f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.410692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a82dd-b762-4a57-96d2-f1342ee85f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.411371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a82dd-b762-4a57-96d2-f1342ee85f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.412996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a82dd-b762-4a57-96d2-f1342ee85f9f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.425642 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 997/1960] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:22.427039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5afab-bbaa-4614-9ccb-05567a82818a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.427326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5afab-bbaa-4614-9ccb-05567a82818a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.427598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5afab-bbaa-4614-9ccb-05567a82818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.438519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0d518-c5b1-4acf-87dc-07cf0d97a00b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.439293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0d518-c5b1-4acf-87dc-07cf0d97a00b service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.439697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0d518-c5b1-4acf-87dc-07cf0d97a00b service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.440166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0d518-c5b1-4acf-87dc-07cf0d97a00b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.457268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0d518-c5b1-4acf-87dc-07cf0d97a00b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.461335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b0d518-c5b1-4acf-87dc-07cf0d97a00b service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.462879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-36b5afab-bbaa-4614-9ccb-05567a82818a None None] MFA Rules not processed for user `ebffb14d441a48f98c175dff3ce5bccf`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:22.464019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-36b5afab-bbaa-4614-9ccb-05567a82818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:22.470199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:22.488535 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 964/1961] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:22.490187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0d518-c5b1-4acf-87dc-07cf0d97a00b service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:22.493464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-77b0d518-c5b1-4acf-87dc-07cf0d97a00b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:22.541120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0d518-c5b1-4acf-87dc-07cf0d97a00b service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.544107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.545548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.546203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.546824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] PATH_INFO: `/v3/projects/e8076f41372349b88b744ae6ec9ff809` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.549316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8076f41372349b88b744ae6ec9ff809)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.553074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.592287 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 998/1962] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:22.594135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5afab-bbaa-4614-9ccb-05567a82818a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:22.612215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5afab-bbaa-4614-9ccb-05567a82818a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.622335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c455e4-b20a-4359-a01d-1f24e17a90e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.623389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c455e4-b20a-4359-a01d-1f24e17a90e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.624008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c455e4-b20a-4359-a01d-1f24e17a90e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.624393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c455e4-b20a-4359-a01d-1f24e17a90e8 admin admin] PATH_INFO: `/v3/projects/5189753e89334929959ce5df90ed74ec/users/a65e3d4bf2224d18b90213c53be12c51/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.655612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c455e4-b20a-4359-a01d-1f24e17a90e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5189753e89334929959ce5df90ed74ec, user_id=a65e3d4bf2224d18b90213c53be12c51, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.660087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c455e4-b20a-4359-a01d-1f24e17a90e8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.670035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8076f41372349b88b744ae6ec9ff809', 'request_id': 'req-b17e07b3-a390-4544-8679-55b5527700e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:22.680530 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 999/1963] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:22 2022] PUT /identity/v3/projects/5189753e89334929959ce5df90ed74ec/users/a65e3d4bf2224d18b90213c53be12c51/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:22.681480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c455e4-b20a-4359-a01d-1f24e17a90e8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:22.689953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8076f41372349b88b744ae6ec9ff809', 'request_id': 'req-b17e07b3-a390-4544-8679-55b5527700e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:22.702415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8076f41372349b88b744ae6ec9ff809', 'request_id': 'req-b17e07b3-a390-4544-8679-55b5527700e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:22.716953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] The token cache is being invalidate because project e8076f41372349b88b744ae6ec9ff809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:22.717497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:22.718425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:22.724076 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 965/1964] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:22 2022] DELETE /identity/v3/projects/e8076f41372349b88b744ae6ec9ff809 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:22.725273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:22.726893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:22.782399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c455e4-b20a-4359-a01d-1f24e17a90e8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.783572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:22.789349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1161-e062-4d5e-a3a7-c529ef9c78a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.790299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1161-e062-4d5e-a3a7-c529ef9c78a0 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.790676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1161-e062-4d5e-a3a7-c529ef9c78a0 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.791071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c1161-e062-4d5e-a3a7-c529ef9c78a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.793568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bd1c1161-e062-4d5e-a3a7-c529ef9c78a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:22.809706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e07b3-a390-4544-8679-55b5527700e0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.896027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5516a4e-2fa1-43d9-a040-3d7b784b991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.896918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5516a4e-2fa1-43d9-a040-3d7b784b991e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.897232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5516a4e-2fa1-43d9-a040-3d7b784b991e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.897601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5516a4e-2fa1-43d9-a040-3d7b784b991e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.898535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5516a4e-2fa1-43d9-a040-3d7b784b991e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.900308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5516a4e-2fa1-43d9-a040-3d7b784b991e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.903994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c1161-e062-4d5e-a3a7-c529ef9c78a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.905797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c1161-e062-4d5e-a3a7-c529ef9c78a0 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.912799 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 966/1965] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:22.913649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5516a4e-2fa1-43d9-a040-3d7b784b991e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:22.915560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c5516a4e-2fa1-43d9-a040-3d7b784b991e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:22.924653 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1000/1966] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:22.926451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1161-e062-4d5e-a3a7-c529ef9c78a0 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:22.947416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c1161-e062-4d5e-a3a7-c529ef9c78a0 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.949038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5516a4e-2fa1-43d9-a040-3d7b784b991e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:22.956933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb256c7-800e-422f-8613-b4be49cbd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.957667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb256c7-800e-422f-8613-b4be49cbd774 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.957977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb256c7-800e-422f-8613-b4be49cbd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.958251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb256c7-800e-422f-8613-b4be49cbd774 admin admin] PATH_INFO: `/v3/projects/5189753e89334929959ce5df90ed74ec/users/a65e3d4bf2224d18b90213c53be12c51/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.963151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb256c7-800e-422f-8613-b4be49cbd774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5189753e89334929959ce5df90ed74ec, user_id=a65e3d4bf2224d18b90213c53be12c51, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.963337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:22.964426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:22.965766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:22.965922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb256c7-800e-422f-8613-b4be49cbd774 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.966474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] PATH_INFO: `/v3/users/3421e1b1e86d4355a89161a9ce16933e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:22.969388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3421e1b1e86d4355a89161a9ce16933e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:22.974835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:22.980631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:22.993223 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1001/1967] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:22 2022] PUT /identity/v3/projects/5189753e89334929959ce5df90ed74ec/users/a65e3d4bf2224d18b90213c53be12c51/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:23.013520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb256c7-800e-422f-8613-b4be49cbd774 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:23.015781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5eb256c7-800e-422f-8613-b4be49cbd774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:23.132832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3421e1b1e86d4355a89161a9ce16933e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:23.143420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3421e1b1e86d4355a89161a9ce16933e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:23.164644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3421e1b1e86d4355a89161a9ce16933e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:23.178054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3421e1b1e86d4355a89161a9ce16933e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:23.180185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7f2dce7-0291-4ca4-9ad0-6da14d5ff61a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3421e1b1e86d4355a89161a9ce16933e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:23.203515 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 967/1968] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:22 2022] DELETE /identity/v3/users/3421e1b1e86d4355a89161a9ce16933e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:23.210138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612912f5-2ba1-4caf-88ac-c02b3ce80869 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:23.214196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb256c7-800e-422f-8613-b4be49cbd774 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:23.214752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612912f5-2ba1-4caf-88ac-c02b3ce80869 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:23.215240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612912f5-2ba1-4caf-88ac-c02b3ce80869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.268484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-612912f5-2ba1-4caf-88ac-c02b3ce80869 None None] MFA Rules not processed for user `a65e3d4bf2224d18b90213c53be12c51`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:23.270831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-612912f5-2ba1-4caf-88ac-c02b3ce80869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:23.402437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:23.413786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ddfd5-55d8-4081-97f7-484c80b566b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:23.414486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ddfd5-55d8-4081-97f7-484c80b566b0 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:23.414759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ddfd5-55d8-4081-97f7-484c80b566b0 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:23.415030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ddfd5-55d8-4081-97f7-484c80b566b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.421926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-481ddfd5-55d8-4081-97f7-484c80b566b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:23.472719 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 968/1969] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:23 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:23.572324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ddfd5-55d8-4081-97f7-484c80b566b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:23.574523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ddfd5-55d8-4081-97f7-484c80b566b0 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:23.605422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1002/1970] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:23.647527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612912f5-2ba1-4caf-88ac-c02b3ce80869 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:23.654207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-612912f5-2ba1-4caf-88ac-c02b3ce80869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:23.703579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612912f5-2ba1-4caf-88ac-c02b3ce80869 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:23.710973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07e215-0686-4547-bb54-91f646b4d138 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:23.711719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07e215-0686-4547-bb54-91f646b4d138 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:23.712143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07e215-0686-4547-bb54-91f646b4d138 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:23.712346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07e215-0686-4547-bb54-91f646b4d138 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:23.714249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2f07e215-0686-4547-bb54-91f646b4d138 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:23.824928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07e215-0686-4547-bb54-91f646b4d138 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:23.827068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07e215-0686-4547-bb54-91f646b4d138 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:23.838185 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 969/1971] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:23 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:23.945944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ddfd5-55d8-4081-97f7-484c80b566b0 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:23.947553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-481ddfd5-55d8-4081-97f7-484c80b566b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:24.009717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:24.058025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ddfd5-55d8-4081-97f7-484c80b566b0 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:24.063134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:24.063812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:24.064086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:24.064353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] PATH_INFO: `/v3/projects/4b27b5c3b7b54b84a85f5a5a02031d58` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:24.066564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b27b5c3b7b54b84a85f5a5a02031d58)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:24.068826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:24.162479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b27b5c3b7b54b84a85f5a5a02031d58', 'request_id': 'req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:24.177387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b27b5c3b7b54b84a85f5a5a02031d58', 'request_id': 'req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:24.194732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b27b5c3b7b54b84a85f5a5a02031d58', 'request_id': 'req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:24.245412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] The token cache is being invalidate because project 4b27b5c3b7b54b84a85f5a5a02031d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:24.250445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:24.251233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:24.254403 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1003/1972] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:23 2022] DELETE /identity/v3/projects/4b27b5c3b7b54b84a85f5a5a02031d58 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:24.260506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07e215-0686-4547-bb54-91f646b4d138 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:24.282724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07e215-0686-4547-bb54-91f646b4d138 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:24.363744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:24.364962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:24.481464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:24.481464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:24.481464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:24.481464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] PATH_INFO: `/v3/users/6ad9f8969ca0454897bbde49a287baec` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:24.484509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad9f8969ca0454897bbde49a287baec)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:24.488943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:24.535012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d1a4d-cf9e-4df7-b58f-4601e1f315c4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:24.546970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10ad43-3148-4a91-b6c4-5089779027a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:24.546970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10ad43-3148-4a91-b6c4-5089779027a9 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:24.546970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10ad43-3148-4a91-b6c4-5089779027a9 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:24.546970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10ad43-3148-4a91-b6c4-5089779027a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:24.550225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3a10ad43-3148-4a91-b6c4-5089779027a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:24.616370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad9f8969ca0454897bbde49a287baec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:24.648941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad9f8969ca0454897bbde49a287baec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:24.681531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad9f8969ca0454897bbde49a287baec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:24.695163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad9f8969ca0454897bbde49a287baec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:24.696492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad9f8969ca0454897bbde49a287baec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:24.702719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:24.705810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:24.712032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10ad43-3148-4a91-b6c4-5089779027a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:24.714356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10ad43-3148-4a91-b6c4-5089779027a9 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:24.723317 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 970/1973] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:24 2022] DELETE /identity/v3/users/6ad9f8969ca0454897bbde49a287baec => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:24.739179 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1004/1974] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:24 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:25.142503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:25.145575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:25.345726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa74eed-07eb-4bfe-8a05-e0350aac9def admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:25.353238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:25.354375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.354825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.355274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] PATH_INFO: `/v3/projects/8108c7c9a24f4d74aa520cd7c37a3307` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.356694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8108c7c9a24f4d74aa520cd7c37a3307)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:25.359065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:25.435995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8108c7c9a24f4d74aa520cd7c37a3307', 'request_id': 'req-8790a014-fdca-41eb-93ce-7ed57e9782f0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:25.448192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8108c7c9a24f4d74aa520cd7c37a3307', 'request_id': 'req-8790a014-fdca-41eb-93ce-7ed57e9782f0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:25.460673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8108c7c9a24f4d74aa520cd7c37a3307', 'request_id': 'req-8790a014-fdca-41eb-93ce-7ed57e9782f0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:25.482546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] The token cache is being invalidate because project 8108c7c9a24f4d74aa520cd7c37a3307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:25.483214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:25.484668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8790a014-fdca-41eb-93ce-7ed57e9782f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:25.487050 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 971/1975] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:25 2022] DELETE /identity/v3/projects/8108c7c9a24f4d74aa520cd7c37a3307 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:25.498639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96118-d064-4c3c-bdad-e46b2ad88f4c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.499389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96118-d064-4c3c-bdad-e46b2ad88f4c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.499884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d96118-d064-4c3c-bdad-e46b2ad88f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.526799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-62d96118-d064-4c3c-bdad-e46b2ad88f4c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:25.528706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-62d96118-d064-4c3c-bdad-e46b2ad88f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:25.614037 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1005/1976] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:25.623212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c5aa-caf0-4df6-a006-4449b31117a4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.623463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c5aa-caf0-4df6-a006-4449b31117a4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.623761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1c5aa-caf0-4df6-a006-4449b31117a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.650301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-90f1c5aa-caf0-4df6-a006-4449b31117a4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:25.651859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-90f1c5aa-caf0-4df6-a006-4449b31117a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:25.662730 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 972/1977] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:25.667905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d96118-d064-4c3c-bdad-e46b2ad88f4c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:25.689706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d96118-d064-4c3c-bdad-e46b2ad88f4c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:25.696562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42adac-4874-4d5b-9b2c-3bb1e850c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:25.697457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42adac-4874-4d5b-9b2c-3bb1e850c4fa admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.697828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42adac-4874-4d5b-9b2c-3bb1e850c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.698231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42adac-4874-4d5b-9b2c-3bb1e850c4fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.699167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42adac-4874-4d5b-9b2c-3bb1e850c4fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:25.699640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42adac-4874-4d5b-9b2c-3bb1e850c4fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:25.702132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42adac-4874-4d5b-9b2c-3bb1e850c4fa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:25.717728 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1006/1978] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:25.722908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1c5aa-caf0-4df6-a006-4449b31117a4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:25.736725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1c5aa-caf0-4df6-a006-4449b31117a4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:25.750251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd80e3-0e4a-47f4-b210-f749bd5a9c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:25.751897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd80e3-0e4a-47f4-b210-f749bd5a9c82 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.752431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd80e3-0e4a-47f4-b210-f749bd5a9c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.753970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd80e3-0e4a-47f4-b210-f749bd5a9c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.755333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd80e3-0e4a-47f4-b210-f749bd5a9c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:25.769113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd80e3-0e4a-47f4-b210-f749bd5a9c82 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:25.819084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42adac-4874-4d5b-9b2c-3bb1e850c4fa admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:25.822725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6f42adac-4874-4d5b-9b2c-3bb1e850c4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:25.824148 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 973/1979] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:25 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:25.830334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd80e3-0e4a-47f4-b210-f749bd5a9c82 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:25.858416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42adac-4874-4d5b-9b2c-3bb1e850c4fa admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:25.966771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd80e3-0e4a-47f4-b210-f749bd5a9c82 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:25.978190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e18e0-5887-44e9-bc66-2834b179e61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:25.979291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e18e0-5887-44e9-bc66-2834b179e61f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:25.979901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e18e0-5887-44e9-bc66-2834b179e61f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:25.980465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e18e0-5887-44e9-bc66-2834b179e61f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:25.981675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e18e0-5887-44e9-bc66-2834b179e61f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:25.986926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e18e0-5887-44e9-bc66-2834b179e61f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.010878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:26.050237 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 974/1980] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:25 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:26.053353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e18e0-5887-44e9-bc66-2834b179e61f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.078470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e18e0-5887-44e9-bc66-2834b179e61f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.088789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f7e1e-eca3-47e3-a014-1cfd93edb017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.089991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7e1e-eca3-47e3-a014-1cfd93edb017 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.090719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7e1e-eca3-47e3-a014-1cfd93edb017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.091232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f7e1e-eca3-47e3-a014-1cfd93edb017 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.092956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f7e1e-eca3-47e3-a014-1cfd93edb017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.097997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f7e1e-eca3-47e3-a014-1cfd93edb017 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.103870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.105170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.105736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.106538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] PATH_INFO: `/v3/users/d723ccd736984ffba1c924baa0a85c9c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.108698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d723ccd736984ffba1c924baa0a85c9c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.114233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.126119 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 975/1981] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:14:26.130906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f7e1e-eca3-47e3-a014-1cfd93edb017 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.147487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f7e1e-eca3-47e3-a014-1cfd93edb017 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.155696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1e053-3cf1-450a-b9f2-638c1abd29a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.156354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1e053-3cf1-450a-b9f2-638c1abd29a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.156680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1e053-3cf1-450a-b9f2-638c1abd29a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.156936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1e053-3cf1-450a-b9f2-638c1abd29a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.157739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1e053-3cf1-450a-b9f2-638c1abd29a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.160297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1e053-3cf1-450a-b9f2-638c1abd29a9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.172558 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 976/1982] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:26.180956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1e053-3cf1-450a-b9f2-638c1abd29a9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.193057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1e053-3cf1-450a-b9f2-638c1abd29a9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.198541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a48ef-33be-4f89-bf54-74e917582c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.199646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a48ef-33be-4f89-bf54-74e917582c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.199646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a48ef-33be-4f89-bf54-74e917582c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.199922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a48ef-33be-4f89-bf54-74e917582c21 admin admin] PATH_INFO: `/v3/projects/d795cc50847841b19c68f532dce88ccd/users/f3588a6205d341288a8b4a1c5018e5bf/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.202404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd723ccd736984ffba1c924baa0a85c9c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:26.203456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd723ccd736984ffba1c924baa0a85c9c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:26.217455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd723ccd736984ffba1c924baa0a85c9c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:26.222271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a48ef-33be-4f89-bf54-74e917582c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d795cc50847841b19c68f532dce88ccd, user_id=f3588a6205d341288a8b4a1c5018e5bf, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.226268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a48ef-33be-4f89-bf54-74e917582c21 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.230569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd723ccd736984ffba1c924baa0a85c9c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:26.250141 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 977/1983] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:26 2022] PUT /identity/v3/projects/d795cc50847841b19c68f532dce88ccd/users/f3588a6205d341288a8b4a1c5018e5bf/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:26.255906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4346fb0-3ebf-4a6c-9e7e-a31f019d7633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd723ccd736984ffba1c924baa0a85c9c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:26.264679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:26.271764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef007f76-9166-4973-952e-192ab3984fef None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.272272 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1007/1984] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:25 2022] DELETE /identity/v3/users/d723ccd736984ffba1c924baa0a85c9c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:26.274250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef007f76-9166-4973-952e-192ab3984fef None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.274893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef007f76-9166-4973-952e-192ab3984fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.280581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e910f2b-d3cf-47de-baba-739ec183125b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.281594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e910f2b-d3cf-47de-baba-739ec183125b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.282343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e910f2b-d3cf-47de-baba-739ec183125b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.317034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ef007f76-9166-4973-952e-192ab3984fef None None] MFA Rules not processed for user `f3588a6205d341288a8b4a1c5018e5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:26.320816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ef007f76-9166-4973-952e-192ab3984fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:26.327365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2e910f2b-d3cf-47de-baba-739ec183125b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:26.330283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2e910f2b-d3cf-47de-baba-739ec183125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:26.415466 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 978/1985] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:26.420511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef007f76-9166-4973-952e-192ab3984fef None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.422020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ef007f76-9166-4973-952e-192ab3984fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:26.448028 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1008/1986] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:26.455733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e910f2b-d3cf-47de-baba-739ec183125b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.457316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2e910f2b-d3cf-47de-baba-739ec183125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:26.508888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef007f76-9166-4973-952e-192ab3984fef None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.514458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd850d4-a647-4ae2-a5bb-cda3c9b2380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.514795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd850d4-a647-4ae2-a5bb-cda3c9b2380a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.515080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd850d4-a647-4ae2-a5bb-cda3c9b2380a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.515343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd850d4-a647-4ae2-a5bb-cda3c9b2380a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.515996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd850d4-a647-4ae2-a5bb-cda3c9b2380a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.518032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd850d4-a647-4ae2-a5bb-cda3c9b2380a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.545800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e910f2b-d3cf-47de-baba-739ec183125b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.553384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92eca1-c1a2-4ce6-9346-4fb86b688029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.554990 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 979/1987] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:26 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:14:26.555123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92eca1-c1a2-4ce6-9346-4fb86b688029 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.555123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92eca1-c1a2-4ce6-9346-4fb86b688029 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.555591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92eca1-c1a2-4ce6-9346-4fb86b688029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.559058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd850d4-a647-4ae2-a5bb-cda3c9b2380a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.573695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92eca1-c1a2-4ce6-9346-4fb86b688029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.576665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92eca1-c1a2-4ce6-9346-4fb86b688029 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.587779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:26.597545 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1009/1988] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:26.665090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd850d4-a647-4ae2-a5bb-cda3c9b2380a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.673978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb43219-1a03-4c3e-8d2e-9c46a6b51ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.675081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb43219-1a03-4c3e-8d2e-9c46a6b51ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.675612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb43219-1a03-4c3e-8d2e-9c46a6b51ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.676515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb43219-1a03-4c3e-8d2e-9c46a6b51ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.677765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb43219-1a03-4c3e-8d2e-9c46a6b51ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.681810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb43219-1a03-4c3e-8d2e-9c46a6b51ab1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.725950 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 980/1989] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:26 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:14:26.729260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92eca1-c1a2-4ce6-9346-4fb86b688029 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.752563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92eca1-c1a2-4ce6-9346-4fb86b688029 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.763861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a866a-f5cd-45cf-a4bd-a6ad24cad60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.765112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a866a-f5cd-45cf-a4bd-a6ad24cad60b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.767651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a866a-f5cd-45cf-a4bd-a6ad24cad60b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.767651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a866a-f5cd-45cf-a4bd-a6ad24cad60b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.767651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a866a-f5cd-45cf-a4bd-a6ad24cad60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.771317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57a866a-f5cd-45cf-a4bd-a6ad24cad60b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.794354 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1010/1990] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:26.798956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb43219-1a03-4c3e-8d2e-9c46a6b51ab1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.819386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb43219-1a03-4c3e-8d2e-9c46a6b51ab1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:26.827118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067218-462c-4afd-aa88-62eccdbe1fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:26.828299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067218-462c-4afd-aa88-62eccdbe1fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:26.828639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067218-462c-4afd-aa88-62eccdbe1fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:26.829016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb067218-462c-4afd-aa88-62eccdbe1fc0 admin admin] PATH_INFO: `/v3/projects/3e41d22831bd4eaab0de60d0c886b991/users/d693d13407024479a978508333e77a50/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:26.859971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067218-462c-4afd-aa88-62eccdbe1fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e41d22831bd4eaab0de60d0c886b991, user_id=d693d13407024479a978508333e77a50, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:26.867268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb067218-462c-4afd-aa88-62eccdbe1fc0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:26.917481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a866a-f5cd-45cf-a4bd-a6ad24cad60b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.925535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b57a866a-f5cd-45cf-a4bd-a6ad24cad60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:26.959780 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 981/1991] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:26 2022] PUT /identity/v3/projects/3e41d22831bd4eaab0de60d0c886b991/users/d693d13407024479a978508333e77a50/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:26.969762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067218-462c-4afd-aa88-62eccdbe1fc0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:26.976188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a866a-f5cd-45cf-a4bd-a6ad24cad60b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:27.110899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:27.115960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.117505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.118185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] PATH_INFO: `/v3/users/f7f37ef893ca4894a6ddc764c501473c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.121787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb067218-462c-4afd-aa88-62eccdbe1fc0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:27.125191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7f37ef893ca4894a6ddc764c501473c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:27.132080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:27.133142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447780c-46e5-4f1c-b397-512b1e90e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:27.134709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447780c-46e5-4f1c-b397-512b1e90e113 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.135923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447780c-46e5-4f1c-b397-512b1e90e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.137986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447780c-46e5-4f1c-b397-512b1e90e113 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.139576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447780c-46e5-4f1c-b397-512b1e90e113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:27.143840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447780c-46e5-4f1c-b397-512b1e90e113 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:27.193670 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 982/1992] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:27.195727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447780c-46e5-4f1c-b397-512b1e90e113 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:27.200383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f447780c-46e5-4f1c-b397-512b1e90e113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:27.266430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:27.298266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7f37ef893ca4894a6ddc764c501473c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:27.300379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7f37ef893ca4894a6ddc764c501473c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:27.317197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7f37ef893ca4894a6ddc764c501473c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:27.349582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447780c-46e5-4f1c-b397-512b1e90e113 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:27.350384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7f37ef893ca4894a6ddc764c501473c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:27.359903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c2c8a-9971-44cc-8e9c-36e223d035b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:27.361135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c2c8a-9971-44cc-8e9c-36e223d035b4 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.361481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c2c8a-9971-44cc-8e9c-36e223d035b4 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.361950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c2c8a-9971-44cc-8e9c-36e223d035b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.364446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-024c2c8a-9971-44cc-8e9c-36e223d035b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:27.400125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:27.405312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7f37ef893ca4894a6ddc764c501473c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:27.451592 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1011/1993] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:26 2022] DELETE /identity/v3/users/f7f37ef893ca4894a6ddc764c501473c => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:27.454806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:27.462880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:27.562992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e891a13-c66c-409e-9e70-eb70832acf2d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:27.589091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:27.589299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c2c8a-9971-44cc-8e9c-36e223d035b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:27.592050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.594972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.596106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] PATH_INFO: `/v3/projects/8305930a593e4b2b92b860db57765f99` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.600350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8305930a593e4b2b92b860db57765f99)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:27.600730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c2c8a-9971-44cc-8e9c-36e223d035b4 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:27.605605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:27.638452 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 983/1994] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:27.640943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c2c8a-9971-44cc-8e9c-36e223d035b4 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:27.662615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c2c8a-9971-44cc-8e9c-36e223d035b4 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:27.683548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb51a5-e203-4754-8ee4-3aabd8419aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:27.683548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb51a5-e203-4754-8ee4-3aabd8419aae admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.683548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb51a5-e203-4754-8ee4-3aabd8419aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.683548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb51a5-e203-4754-8ee4-3aabd8419aae admin admin] PATH_INFO: `/v3/projects/3e41d22831bd4eaab0de60d0c886b991/users/d693d13407024479a978508333e77a50/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.688153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb51a5-e203-4754-8ee4-3aabd8419aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e41d22831bd4eaab0de60d0c886b991, user_id=d693d13407024479a978508333e77a50, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:27.693016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb51a5-e203-4754-8ee4-3aabd8419aae admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:27.731614 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 984/1995] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:27 2022] PUT /identity/v3/projects/3e41d22831bd4eaab0de60d0c886b991/users/d693d13407024479a978508333e77a50/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:27.733007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078d4d-ad30-4e71-8d96-f853c701c396 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.733291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078d4d-ad30-4e71-8d96-f853c701c396 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.733562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078d4d-ad30-4e71-8d96-f853c701c396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.743910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8305930a593e4b2b92b860db57765f99', 'request_id': 'req-f0331714-ce3f-436c-8b99-5fcfccc85169'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:27.762351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8305930a593e4b2b92b860db57765f99', 'request_id': 'req-f0331714-ce3f-436c-8b99-5fcfccc85169'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:27.779466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b4078d4d-ad30-4e71-8d96-f853c701c396 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:27.781165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8305930a593e4b2b92b860db57765f99', 'request_id': 'req-f0331714-ce3f-436c-8b99-5fcfccc85169'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:27.785594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b4078d4d-ad30-4e71-8d96-f853c701c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:27.804225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] The token cache is being invalidate because project 8305930a593e4b2b92b860db57765f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:27.804610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:27.805458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f0331714-ce3f-436c-8b99-5fcfccc85169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:27.809626 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1012/1996] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:27 2022] DELETE /identity/v3/projects/8305930a593e4b2b92b860db57765f99 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:27.811240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78cab2-05d0-402e-9b23-45d7c8715638 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.811524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78cab2-05d0-402e-9b23-45d7c8715638 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.811793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78cab2-05d0-402e-9b23-45d7c8715638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.878313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7c78cab2-05d0-402e-9b23-45d7c8715638 None None] MFA Rules not processed for user `d693d13407024479a978508333e77a50`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:27.880491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c78cab2-05d0-402e-9b23-45d7c8715638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:27.938918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:27.944418 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 985/1997] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:27.946860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078d4d-ad30-4e71-8d96-f853c701c396 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:27.948818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b4078d4d-ad30-4e71-8d96-f853c701c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:27.964956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078d4d-ad30-4e71-8d96-f853c701c396 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:27.972258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:27.973402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:27.974023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:27.974499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] PATH_INFO: `/v3/users/ebffb14d441a48f98c175dff3ce5bccf` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:27.977012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebffb14d441a48f98c175dff3ce5bccf)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:27.980209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:28.035074 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1013/1998] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:28.075428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebffb14d441a48f98c175dff3ce5bccf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:28.090317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78cab2-05d0-402e-9b23-45d7c8715638 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:28.091836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c78cab2-05d0-402e-9b23-45d7c8715638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:28.098787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebffb14d441a48f98c175dff3ce5bccf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:28.124435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebffb14d441a48f98c175dff3ce5bccf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:28.149106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebffb14d441a48f98c175dff3ce5bccf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:28.149951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebffb14d441a48f98c175dff3ce5bccf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:28.165416 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 986/1999] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:27 2022] DELETE /identity/v3/users/ebffb14d441a48f98c175dff3ce5bccf => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:28.217574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78cab2-05d0-402e-9b23-45d7c8715638 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:28.284890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212006e2-84f2-4111-8c48-82b6a8d225af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:28.285195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212006e2-84f2-4111-8c48-82b6a8d225af service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:28.285195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212006e2-84f2-4111-8c48-82b6a8d225af service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:28.285617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212006e2-84f2-4111-8c48-82b6a8d225af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:28.287947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-212006e2-84f2-4111-8c48-82b6a8d225af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:28.377858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212006e2-84f2-4111-8c48-82b6a8d225af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:28.379691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212006e2-84f2-4111-8c48-82b6a8d225af service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:28.390999 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1014/2000] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:28.573100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:28.574645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:28.596256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:28.687628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b87b47-365e-4c05-a6f9-15c9565017b0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:28.694635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895910da-dfd7-4b35-b993-855f1e3b6fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:28.696121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895910da-dfd7-4b35-b993-855f1e3b6fa6 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:28.696121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895910da-dfd7-4b35-b993-855f1e3b6fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:28.696121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895910da-dfd7-4b35-b993-855f1e3b6fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:28.699122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-895910da-dfd7-4b35-b993-855f1e3b6fa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:28.868466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895910da-dfd7-4b35-b993-855f1e3b6fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:28.871010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895910da-dfd7-4b35-b993-855f1e3b6fa6 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:28.889967 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 987/2001] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:28.923271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212006e2-84f2-4111-8c48-82b6a8d225af service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:28.925016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-212006e2-84f2-4111-8c48-82b6a8d225af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:28.948932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212006e2-84f2-4111-8c48-82b6a8d225af service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:28.958791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:28.959778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:28.961079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:28.961079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] PATH_INFO: `/v3/projects/e05c28b49da141379c04f68274aa28f5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:28.962923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05c28b49da141379c04f68274aa28f5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:28.967637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:29.069108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:29.116871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05c28b49da141379c04f68274aa28f5', 'request_id': 'req-64521371-cd9b-451a-b931-aee332af8a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:29.130989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05c28b49da141379c04f68274aa28f5', 'request_id': 'req-64521371-cd9b-451a-b931-aee332af8a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:29.150318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05c28b49da141379c04f68274aa28f5', 'request_id': 'req-64521371-cd9b-451a-b931-aee332af8a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:29.212667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] The token cache is being invalidate because project e05c28b49da141379c04f68274aa28f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:29.213440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:29.215872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-64521371-cd9b-451a-b931-aee332af8a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:29.220012 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1015/2002] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:28 2022] DELETE /identity/v3/projects/e05c28b49da141379c04f68274aa28f5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:29.223166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ba59-02ae-495a-ba75-58a8253cc106 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.223500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ba59-02ae-495a-ba75-58a8253cc106 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.223954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6ba59-02ae-495a-ba75-58a8253cc106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.229760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51075e-2387-4e5d-9fc5-8defd5c352f3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.230519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51075e-2387-4e5d-9fc5-8defd5c352f3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.234161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51075e-2387-4e5d-9fc5-8defd5c352f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.251649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-54a6ba59-02ae-495a-ba75-58a8253cc106 None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:29.253530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-54a6ba59-02ae-495a-ba75-58a8253cc106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:29.309043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4d51075e-2387-4e5d-9fc5-8defd5c352f3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:29.311250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4d51075e-2387-4e5d-9fc5-8defd5c352f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:29.339359 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 988/2003] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:14:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:29.344948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6ba59-02ae-495a-ba75-58a8253cc106 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:29.346776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-54a6ba59-02ae-495a-ba75-58a8253cc106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:29.360053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6ba59-02ae-495a-ba75-58a8253cc106 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:29.364554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fa9bb-05c4-48e5-a834-f331c9057bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:29.365374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fa9bb-05c4-48e5-a834-f331c9057bdd service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.366324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fa9bb-05c4-48e5-a834-f331c9057bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.366785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fa9bb-05c4-48e5-a834-f331c9057bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.378647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fa9bb-05c4-48e5-a834-f331c9057bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:29.385496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fa9bb-05c4-48e5-a834-f331c9057bdd service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:29.396841 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 989/2004] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:29.397836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fa9bb-05c4-48e5-a834-f331c9057bdd service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:29.399421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4a7fa9bb-05c4-48e5-a834-f331c9057bdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:29.503432 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1016/2005] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:29.517325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51075e-2387-4e5d-9fc5-8defd5c352f3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:29.521457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4d51075e-2387-4e5d-9fc5-8defd5c352f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:29.523789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:29.546202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51075e-2387-4e5d-9fc5-8defd5c352f3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:29.553380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:29.554195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.554548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.555053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] PATH_INFO: `/v3/projects/9c438e1a55db4516963d20083cc302ce` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.556455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c438e1a55db4516963d20083cc302ce)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:29.558905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:29.600210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fa9bb-05c4-48e5-a834-f331c9057bdd service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:29.616910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40b83c-e6ab-47e3-a3dc-5d5547ada293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:29.618339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40b83c-e6ab-47e3-a3dc-5d5547ada293 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.619104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40b83c-e6ab-47e3-a3dc-5d5547ada293 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.619813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40b83c-e6ab-47e3-a3dc-5d5547ada293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.625111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6a40b83c-e6ab-47e3-a3dc-5d5547ada293 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:29.690203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c438e1a55db4516963d20083cc302ce', 'request_id': 'req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:29.700053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c438e1a55db4516963d20083cc302ce', 'request_id': 'req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:29.719765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c438e1a55db4516963d20083cc302ce', 'request_id': 'req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:29.746040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] The token cache is being invalidate because project 9c438e1a55db4516963d20083cc302ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:29.746378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:29.747918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-817a6cc1-d7a0-49bf-9fd1-99b9a72e03c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:29.750007 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1017/2006] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:29 2022] DELETE /identity/v3/projects/9c438e1a55db4516963d20083cc302ce => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:29.751484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2ce7-12f2-4de7-98fe-f6ad5b2bce2e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.752046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2ce7-12f2-4de7-98fe-f6ad5b2bce2e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.752480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2ce7-12f2-4de7-98fe-f6ad5b2bce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.777931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c34d2ce7-12f2-4de7-98fe-f6ad5b2bce2e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:29.779231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c34d2ce7-12f2-4de7-98fe-f6ad5b2bce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:29.848673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40b83c-e6ab-47e3-a3dc-5d5547ada293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:29.851127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:29.854528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40b83c-e6ab-47e3-a3dc-5d5547ada293 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:29.890355 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 990/2007] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:29.892585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40b83c-e6ab-47e3-a3dc-5d5547ada293 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:29.924823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40b83c-e6ab-47e3-a3dc-5d5547ada293 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:29.934457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:29.935031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:29.935452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:29.935867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] PATH_INFO: `/v3/users/a65e3d4bf2224d18b90213c53be12c51` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:29.937981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65e3d4bf2224d18b90213c53be12c51)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:29.944012 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1018/2008] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:29.944012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d2ce7-12f2-4de7-98fe-f6ad5b2bce2e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:29.944617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:29.945935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c34d2ce7-12f2-4de7-98fe-f6ad5b2bce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:30.075600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d2ce7-12f2-4de7-98fe-f6ad5b2bce2e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.076561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65e3d4bf2224d18b90213c53be12c51'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:30.090849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0522c-9077-42c3-8f0f-88cb73015612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.091828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0522c-9077-42c3-8f0f-88cb73015612 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.092299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0522c-9077-42c3-8f0f-88cb73015612 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.092747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0522c-9077-42c3-8f0f-88cb73015612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.099208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-96c0522c-9077-42c3-8f0f-88cb73015612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:30.113855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65e3d4bf2224d18b90213c53be12c51'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:30.160925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65e3d4bf2224d18b90213c53be12c51'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:30.176836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65e3d4bf2224d18b90213c53be12c51'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:30.177848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f946ae94-2a29-47bc-89d6-6417b747ac43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65e3d4bf2224d18b90213c53be12c51'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:30.187779 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 991/2009] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:29 2022] DELETE /identity/v3/users/a65e3d4bf2224d18b90213c53be12c51 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:30.191226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd141e3e-2b13-46bf-8210-2588a5bc263c None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.191962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd141e3e-2b13-46bf-8210-2588a5bc263c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.193434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd141e3e-2b13-46bf-8210-2588a5bc263c None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.201545 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 992/2010] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:14:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:30.202895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd141e3e-2b13-46bf-8210-2588a5bc263c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.205558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fd141e3e-2b13-46bf-8210-2588a5bc263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:30.264565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0522c-9077-42c3-8f0f-88cb73015612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.271996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0522c-9077-42c3-8f0f-88cb73015612 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.297753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:30.307812 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1019/2011] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:30.311323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3cdd8-4803-4aa2-9765-fdb6de258533 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.312034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3cdd8-4803-4aa2-9765-fdb6de258533 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.312834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3cdd8-4803-4aa2-9765-fdb6de258533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.325250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd141e3e-2b13-46bf-8210-2588a5bc263c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.338790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87693d8d-7c95-4151-9ae4-15f702be75fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.340125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87693d8d-7c95-4151-9ae4-15f702be75fb admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.341425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87693d8d-7c95-4151-9ae4-15f702be75fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.342035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87693d8d-7c95-4151-9ae4-15f702be75fb admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.343035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87693d8d-7c95-4151-9ae4-15f702be75fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:30.343583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87693d8d-7c95-4151-9ae4-15f702be75fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.348927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87693d8d-7c95-4151-9ae4-15f702be75fb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.396260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-eaf3cdd8-4803-4aa2-9765-fdb6de258533 None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:30.398606 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 993/2012] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:30.399107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eaf3cdd8-4803-4aa2-9765-fdb6de258533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:30.409568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87693d8d-7c95-4151-9ae4-15f702be75fb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.450893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87693d8d-7c95-4151-9ae4-15f702be75fb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.468319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee01e8-6388-4dcb-af5f-0cc3d82b5239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.469383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee01e8-6388-4dcb-af5f-0cc3d82b5239 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.470105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee01e8-6388-4dcb-af5f-0cc3d82b5239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.470565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee01e8-6388-4dcb-af5f-0cc3d82b5239 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.471975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee01e8-6388-4dcb-af5f-0cc3d82b5239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.481429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee01e8-6388-4dcb-af5f-0cc3d82b5239 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.534912 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 994/2013] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:30 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:30.539548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee01e8-6388-4dcb-af5f-0cc3d82b5239 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.544519 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1020/2014] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:14:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:30.567440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3cdd8-4803-4aa2-9765-fdb6de258533 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.572691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eaf3cdd8-4803-4aa2-9765-fdb6de258533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:30.607564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3cdd8-4803-4aa2-9765-fdb6de258533 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.686748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:30.734262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee01e8-6388-4dcb-af5f-0cc3d82b5239 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.756217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad848-f442-4b66-be64-1b4d118537d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.758665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad848-f442-4b66-be64-1b4d118537d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.759133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad848-f442-4b66-be64-1b4d118537d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.759816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aad848-f442-4b66-be64-1b4d118537d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.763758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aad848-f442-4b66-be64-1b4d118537d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.776852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aad848-f442-4b66-be64-1b4d118537d8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.791440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834a04a-f9cf-479c-a605-8beeba761fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.792445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834a04a-f9cf-479c-a605-8beeba761fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.795132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834a04a-f9cf-479c-a605-8beeba761fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.796583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834a04a-f9cf-479c-a605-8beeba761fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.808120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834a04a-f9cf-479c-a605-8beeba761fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.811543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834a04a-f9cf-479c-a605-8beeba761fc5 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.824932 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1021/2015] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:30.842328 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 995/2016] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:30 2022] POST /identity/v3/users => generated 286 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:30.848340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834a04a-f9cf-479c-a605-8beeba761fc5 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.870919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834a04a-f9cf-479c-a605-8beeba761fc5 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.878132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358ef3b-d064-43b4-b28f-408ca4e4eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.880356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358ef3b-d064-43b4-b28f-408ca4e4eecd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.881816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358ef3b-d064-43b4-b28f-408ca4e4eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.882332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358ef3b-d064-43b4-b28f-408ca4e4eecd admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.884085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358ef3b-d064-43b4-b28f-408ca4e4eecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.886035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358ef3b-d064-43b4-b28f-408ca4e4eecd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.901363 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1022/2017] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:30.907761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad848-f442-4b66-be64-1b4d118537d8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.923257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aad848-f442-4b66-be64-1b4d118537d8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.929794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6528ef-c68e-4efb-ac9b-13c12f85adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.932841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6528ef-c68e-4efb-ac9b-13c12f85adb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.933192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6528ef-c68e-4efb-ac9b-13c12f85adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.933535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6528ef-c68e-4efb-ac9b-13c12f85adb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:30.934390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6528ef-c68e-4efb-ac9b-13c12f85adb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:30.936147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6528ef-c68e-4efb-ac9b-13c12f85adb1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:30.949508 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 996/2018] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:14:30.955691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358ef3b-d064-43b4-b28f-408ca4e4eecd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:30.971799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358ef3b-d064-43b4-b28f-408ca4e4eecd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:30.982891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f0852-c1d9-48da-94b7-06107a8c242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:30.983617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f0852-c1d9-48da-94b7-06107a8c242c admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:30.983892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f0852-c1d9-48da-94b7-06107a8c242c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:30.984162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f0852-c1d9-48da-94b7-06107a8c242c admin admin] PATH_INFO: `/v3/projects/fb902a62020246c8ade79bd43ff6755f/users/0b4617ac955e438c979ca0938ee117c1/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.004587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f0852-c1d9-48da-94b7-06107a8c242c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb902a62020246c8ade79bd43ff6755f, user_id=0b4617ac955e438c979ca0938ee117c1, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.007410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f0852-c1d9-48da-94b7-06107a8c242c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.047617 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1023/2019] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:30 2022] PUT /identity/v3/projects/fb902a62020246c8ade79bd43ff6755f/users/0b4617ac955e438c979ca0938ee117c1/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:31.055174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9badc-b548-47a7-ad07-302601c9749a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.057049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9badc-b548-47a7-ad07-302601c9749a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.057557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9badc-b548-47a7-ad07-302601c9749a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.125229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b7e9badc-b548-47a7-ad07-302601c9749a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:31.129715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b7e9badc-b548-47a7-ad07-302601c9749a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:31.247003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f0852-c1d9-48da-94b7-06107a8c242c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.251405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f06f0852-c1d9-48da-94b7-06107a8c242c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:31.289363 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 997/2020] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:31.320745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61382d6c-b71f-46f5-8904-6a88c6649453 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.321198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61382d6c-b71f-46f5-8904-6a88c6649453 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.321385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61382d6c-b71f-46f5-8904-6a88c6649453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.349335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-61382d6c-b71f-46f5-8904-6a88c6649453 None None] MFA Rules not processed for user `bf7c15d8a7d346338027aa00493088c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:31.351772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-61382d6c-b71f-46f5-8904-6a88c6649453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:31.410350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f0852-c1d9-48da-94b7-06107a8c242c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.422922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:31.430888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8d9f-8d26-48d5-80b1-845f0fdad3a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.431626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8d9f-8d26-48d5-80b1-845f0fdad3a2 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.432430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8d9f-8d26-48d5-80b1-845f0fdad3a2 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.432767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8d9f-8d26-48d5-80b1-845f0fdad3a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.437975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-61ea8d9f-8d26-48d5-80b1-845f0fdad3a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:31.456066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea8d9f-8d26-48d5-80b1-845f0fdad3a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.458123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea8d9f-8d26-48d5-80b1-845f0fdad3a2 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.482657 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1024/2021] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:31.483974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8d9f-8d26-48d5-80b1-845f0fdad3a2 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.492320 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 998/2022] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:31.492320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61382d6c-b71f-46f5-8904-6a88c6649453 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.496723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-61382d6c-b71f-46f5-8904-6a88c6649453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:31.549235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61382d6c-b71f-46f5-8904-6a88c6649453 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.561228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.562226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.562676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.562997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] PATH_INFO: `/v3/users/f3588a6205d341288a8b4a1c5018e5bf` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.564319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3588a6205d341288a8b4a1c5018e5bf)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.570401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.626153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8d9f-8d26-48d5-80b1-845f0fdad3a2 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.633809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a30da-fa2c-49ff-af8b-ca43fd5bb4cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.637939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a30da-fa2c-49ff-af8b-ca43fd5bb4cd service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.637939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a30da-fa2c-49ff-af8b-ca43fd5bb4cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.637939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a30da-fa2c-49ff-af8b-ca43fd5bb4cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.672163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a30da-fa2c-49ff-af8b-ca43fd5bb4cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.674055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a30da-fa2c-49ff-af8b-ca43fd5bb4cd service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.687687 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1025/2023] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:31.700219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a30da-fa2c-49ff-af8b-ca43fd5bb4cd service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:31.704435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2e0a30da-fa2c-49ff-af8b-ca43fd5bb4cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:31.707769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3588a6205d341288a8b4a1c5018e5bf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:31.732391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3588a6205d341288a8b4a1c5018e5bf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:31.738660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a30da-fa2c-49ff-af8b-ca43fd5bb4cd service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:31.756793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3588a6205d341288a8b4a1c5018e5bf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:31.777758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:31.780489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.781557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.782438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] PATH_INFO: `/v3/projects/5189753e89334929959ce5df90ed74ec` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.786040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3588a6205d341288a8b4a1c5018e5bf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:31.786908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5189753e89334929959ce5df90ed74ec)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:31.787876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3738446c-5200-49c0-9c88-cb82b4d650dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3588a6205d341288a8b4a1c5018e5bf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:31.790618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:31.805604 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 999/2024] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:31 2022] DELETE /identity/v3/users/f3588a6205d341288a8b4a1c5018e5bf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:31.815680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ad922-6e3c-4a79-9987-350c6f06abdc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:31.815902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ad922-6e3c-4a79-9987-350c6f06abdc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:31.816568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ad922-6e3c-4a79-9987-350c6f06abdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:31.870304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:31.895415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-386ad922-6e3c-4a79-9987-350c6f06abdc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:31.897733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-386ad922-6e3c-4a79-9987-350c6f06abdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:31.949230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5189753e89334929959ce5df90ed74ec', 'request_id': 'req-88d7cd60-6528-41e6-8006-dd1b9770bf3d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:31.967271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5189753e89334929959ce5df90ed74ec', 'request_id': 'req-88d7cd60-6528-41e6-8006-dd1b9770bf3d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:31.984514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5189753e89334929959ce5df90ed74ec', 'request_id': 'req-88d7cd60-6528-41e6-8006-dd1b9770bf3d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:32.005850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] The token cache is being invalidate because project 5189753e89334929959ce5df90ed74ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:32.006633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:32.008758 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1000/2025] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:32.010667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9778c3-157f-4db0-bced-3e03c60c0fc9 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.011202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9778c3-157f-4db0-bced-3e03c60c0fc9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.011480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9778c3-157f-4db0-bced-3e03c60c0fc9 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.012843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-88d7cd60-6528-41e6-8006-dd1b9770bf3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:32.016686 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1001/2026] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:14:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:14:32.017820 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1026/2027] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:31 2022] DELETE /identity/v3/projects/5189753e89334929959ce5df90ed74ec => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:32.021677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9778c3-157f-4db0-bced-3e03c60c0fc9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.023883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5a9778c3-157f-4db0-bced-3e03c60c0fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:32.024588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be843b-fb98-4f5f-9f7d-710926fea83e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.025067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be843b-fb98-4f5f-9f7d-710926fea83e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.025614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be843b-fb98-4f5f-9f7d-710926fea83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.075354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f9be843b-fb98-4f5f-9f7d-710926fea83e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:32.080296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f9be843b-fb98-4f5f-9f7d-710926fea83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:32.097628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9778c3-157f-4db0-bced-3e03c60c0fc9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.118128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e88476-8036-45ef-83b7-e58bacd0ea82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.119107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88476-8036-45ef-83b7-e58bacd0ea82 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.119565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88476-8036-45ef-83b7-e58bacd0ea82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.120278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e88476-8036-45ef-83b7-e58bacd0ea82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.124663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-23e88476-8036-45ef-83b7-e58bacd0ea82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:32.159115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:32.255427 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1027/2028] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:32.257983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545570c-45c2-4656-b9bb-1d9160fa611d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.259053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545570c-45c2-4656-b9bb-1d9160fa611d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.259862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545570c-45c2-4656-b9bb-1d9160fa611d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.278933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e88476-8036-45ef-83b7-e58bacd0ea82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.280282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e88476-8036-45ef-83b7-e58bacd0ea82 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.295517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1545570c-45c2-4656-b9bb-1d9160fa611d None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:32.297479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1545570c-45c2-4656-b9bb-1d9160fa611d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:32.321401 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1002/2029] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:32.324798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc1d5b-c3d4-4c0b-a0b3-14aa693ea86e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.325222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc1d5b-c3d4-4c0b-a0b3-14aa693ea86e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.325513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc1d5b-c3d4-4c0b-a0b3-14aa693ea86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.363698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e8fc1d5b-c3d4-4c0b-a0b3-14aa693ea86e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:32.365625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e8fc1d5b-c3d4-4c0b-a0b3-14aa693ea86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:32.380157 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1003/2030] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:32.381972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc1d5b-c3d4-4c0b-a0b3-14aa693ea86e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.398217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc1d5b-c3d4-4c0b-a0b3-14aa693ea86e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.406891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40060415-dec7-4212-acb1-759f04b8b359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.407272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060415-dec7-4212-acb1-759f04b8b359 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.407628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060415-dec7-4212-acb1-759f04b8b359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.407998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060415-dec7-4212-acb1-759f04b8b359 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.409561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40060415-dec7-4212-acb1-759f04b8b359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:32.430473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40060415-dec7-4212-acb1-759f04b8b359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.434873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40060415-dec7-4212-acb1-759f04b8b359 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.445856 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1028/2031] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:14:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:32.459365 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1004/2032] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:32.462623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545570c-45c2-4656-b9bb-1d9160fa611d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.478552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545570c-45c2-4656-b9bb-1d9160fa611d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.484416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27212d8-eea2-4e6e-98ea-7d85cd4ecbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.485322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27212d8-eea2-4e6e-98ea-7d85cd4ecbfc admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.485608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27212d8-eea2-4e6e-98ea-7d85cd4ecbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.485914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27212d8-eea2-4e6e-98ea-7d85cd4ecbfc admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.486690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27212d8-eea2-4e6e-98ea-7d85cd4ecbfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.489075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27212d8-eea2-4e6e-98ea-7d85cd4ecbfc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.514340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40060415-dec7-4212-acb1-759f04b8b359 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.532927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-40060415-dec7-4212-acb1-759f04b8b359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:32.535910 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1029/2033] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:32 2022] POST /identity/v3/projects => generated 391 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:32.541640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27212d8-eea2-4e6e-98ea-7d85cd4ecbfc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.568745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40060415-dec7-4212-acb1-759f04b8b359 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.605461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:32.741725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbced3cc-bd7f-4d09-acab-ae44ac89035c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.742460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbced3cc-bd7f-4d09-acab-ae44ac89035c service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.742736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbced3cc-bd7f-4d09-acab-ae44ac89035c service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.743004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbced3cc-bd7f-4d09-acab-ae44ac89035c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.746575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27212d8-eea2-4e6e-98ea-7d85cd4ecbfc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.765583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb3bdd-066b-455e-8cb7-38189fe9e955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.767243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb3bdd-066b-455e-8cb7-38189fe9e955 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.767918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb3bdd-066b-455e-8cb7-38189fe9e955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.768980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb3bdd-066b-455e-8cb7-38189fe9e955 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.773847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb3bdd-066b-455e-8cb7-38189fe9e955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.781508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb3bdd-066b-455e-8cb7-38189fe9e955 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.892611 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1030/2034] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:32 2022] POST /identity/v3/users => generated 296 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:32.893729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb3bdd-066b-455e-8cb7-38189fe9e955 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.914929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb3bdd-066b-455e-8cb7-38189fe9e955 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.922209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24b68a-993d-420e-b11c-e6d48968ea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.925419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24b68a-993d-420e-b11c-e6d48968ea3b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.925783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24b68a-993d-420e-b11c-e6d48968ea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.926049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f24b68a-993d-420e-b11c-e6d48968ea3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.926674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24b68a-993d-420e-b11c-e6d48968ea3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.929483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f24b68a-993d-420e-b11c-e6d48968ea3b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.932960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbced3cc-bd7f-4d09-acab-ae44ac89035c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.940816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbced3cc-bd7f-4d09-acab-ae44ac89035c service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:32.949027 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1031/2035] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:32.959078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24b68a-993d-420e-b11c-e6d48968ea3b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:32.979029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f24b68a-993d-420e-b11c-e6d48968ea3b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:32.979708 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1005/2036] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:32.990142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a812d8-8a67-4a99-a6da-ebc196f13353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:32.990772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a812d8-8a67-4a99-a6da-ebc196f13353 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:32.991085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a812d8-8a67-4a99-a6da-ebc196f13353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:32.991345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a812d8-8a67-4a99-a6da-ebc196f13353 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:32.992202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a812d8-8a67-4a99-a6da-ebc196f13353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:32.996182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a812d8-8a67-4a99-a6da-ebc196f13353 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:33.022134 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1032/2037] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:33.024804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbced3cc-bd7f-4d09-acab-ae44ac89035c service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:33.038565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbced3cc-bd7f-4d09-acab-ae44ac89035c service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:33.044334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86832ad7-a35f-48ef-b89b-b48943580fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:33.045023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86832ad7-a35f-48ef-b89b-b48943580fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:33.045296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86832ad7-a35f-48ef-b89b-b48943580fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:33.045562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86832ad7-a35f-48ef-b89b-b48943580fd7 admin admin] PATH_INFO: `/v3/projects/7534c71789114569a025aa4cc6e016d6/users/ca877c5c1a8f4ffd86235018b672f567/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.088074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86832ad7-a35f-48ef-b89b-b48943580fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7534c71789114569a025aa4cc6e016d6, user_id=ca877c5c1a8f4ffd86235018b672f567, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:33.091196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86832ad7-a35f-48ef-b89b-b48943580fd7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:33.136817 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1006/2038] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:33 2022] PUT /identity/v3/projects/7534c71789114569a025aa4cc6e016d6/users/ca877c5c1a8f4ffd86235018b672f567/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:33.147713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3251ca3-57cc-41b2-b3a1-6321d8b5ba81 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:33.148383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3251ca3-57cc-41b2-b3a1-6321d8b5ba81 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:33.148660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3251ca3-57cc-41b2-b3a1-6321d8b5ba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.179762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86832ad7-a35f-48ef-b89b-b48943580fd7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:33.182916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-86832ad7-a35f-48ef-b89b-b48943580fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:33.203233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:33.235523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e3251ca3-57cc-41b2-b3a1-6321d8b5ba81 None None] MFA Rules not processed for user `ca877c5c1a8f4ffd86235018b672f567`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:33.236961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e3251ca3-57cc-41b2-b3a1-6321d8b5ba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:33.455665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86832ad7-a35f-48ef-b89b-b48943580fd7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:33.473254 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1033/2039] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:33.478176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3251ca3-57cc-41b2-b3a1-6321d8b5ba81 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:33.483024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:33.485438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:33.489476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:33.493383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] PATH_INFO: `/v3/projects/d795cc50847841b19c68f532dce88ccd` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.496406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d795cc50847841b19c68f532dce88ccd)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:33.503145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3251ca3-57cc-41b2-b3a1-6321d8b5ba81 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:33.510766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:33.525354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd548b2f-38a9-491f-9344-5fa283470563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:33.526120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548b2f-38a9-491f-9344-5fa283470563 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:33.526341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548b2f-38a9-491f-9344-5fa283470563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:33.526620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548b2f-38a9-491f-9344-5fa283470563 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.527304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd548b2f-38a9-491f-9344-5fa283470563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:33.540397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd548b2f-38a9-491f-9344-5fa283470563 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:33.598257 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1034/2040] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:33 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:33.602723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd548b2f-38a9-491f-9344-5fa283470563 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:33.761275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:33.795746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd548b2f-38a9-491f-9344-5fa283470563 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:33.827101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd795cc50847841b19c68f532dce88ccd', 'request_id': 'req-75bf7f58-b09e-4892-92bf-4df94ff17689'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:33.852639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd795cc50847841b19c68f532dce88ccd', 'request_id': 'req-75bf7f58-b09e-4892-92bf-4df94ff17689'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:33.868163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd795cc50847841b19c68f532dce88ccd', 'request_id': 'req-75bf7f58-b09e-4892-92bf-4df94ff17689'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:33.899565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] The token cache is being invalidate because project d795cc50847841b19c68f532dce88ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:33.900285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:33.902579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:33.907069 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1007/2041] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:33 2022] DELETE /identity/v3/projects/d795cc50847841b19c68f532dce88ccd => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:33.912473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:33.914428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:33.989574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d958ad-2f81-41f8-bda5-f9c52e881511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:33.992264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d958ad-2f81-41f8-bda5-f9c52e881511 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:33.992969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d958ad-2f81-41f8-bda5-f9c52e881511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:33.994363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d958ad-2f81-41f8-bda5-f9c52e881511 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:33.998611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d958ad-2f81-41f8-bda5-f9c52e881511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.005822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d958ad-2f81-41f8-bda5-f9c52e881511 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.108311 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1035/2042] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:33 2022] POST /identity/v3/users => generated 303 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:34.118019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d958ad-2f81-41f8-bda5-f9c52e881511 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.126925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-98d958ad-2f81-41f8-bda5-f9c52e881511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:34.143371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf7f58-b09e-4892-92bf-4df94ff17689 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.156643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.160724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.161398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.162026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] PATH_INFO: `/v3/users/d693d13407024479a978508333e77a50` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.164792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d693d13407024479a978508333e77a50)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.168800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d958ad-2f81-41f8-bda5-f9c52e881511 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.169056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.184813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17102abe-8fc3-43ce-9bdc-455aa63d67ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.187382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17102abe-8fc3-43ce-9bdc-455aa63d67ec admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.188192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17102abe-8fc3-43ce-9bdc-455aa63d67ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.189003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17102abe-8fc3-43ce-9bdc-455aa63d67ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.191426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17102abe-8fc3-43ce-9bdc-455aa63d67ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.198441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17102abe-8fc3-43ce-9bdc-455aa63d67ec admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.236730 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1036/2043] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:34.257163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17102abe-8fc3-43ce-9bdc-455aa63d67ec admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.292170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:34.296209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17102abe-8fc3-43ce-9bdc-455aa63d67ec admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.307515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10188d3-e75f-4fdf-a804-f33bb6f43996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.308629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10188d3-e75f-4fdf-a804-f33bb6f43996 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.308967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10188d3-e75f-4fdf-a804-f33bb6f43996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.309489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10188d3-e75f-4fdf-a804-f33bb6f43996 admin admin] PATH_INFO: `/v3/projects/82c848277db34491821408a78da37182/users/0f5ddb909f384cb2a4b32ff6a2164f4f/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.322687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd693d13407024479a978508333e77a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:34.332200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10188d3-e75f-4fdf-a804-f33bb6f43996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c848277db34491821408a78da37182, user_id=0f5ddb909f384cb2a4b32ff6a2164f4f, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.335655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10188d3-e75f-4fdf-a804-f33bb6f43996 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.356442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd693d13407024479a978508333e77a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:34.373648 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1037/2044] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:34 2022] PUT /identity/v3/projects/82c848277db34491821408a78da37182/users/0f5ddb909f384cb2a4b32ff6a2164f4f/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:34.378654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10188d3-e75f-4fdf-a804-f33bb6f43996 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.423998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd693d13407024479a978508333e77a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:34.452756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd693d13407024479a978508333e77a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:34.454679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd693d13407024479a978508333e77a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:34.475984 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1008/2045] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:33 2022] DELETE /identity/v3/users/d693d13407024479a978508333e77a50 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:34.587569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10188d3-e75f-4fdf-a804-f33bb6f43996 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.836104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0819b3b-9caa-4ce0-a395-62903c5c101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.838472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819b3b-9caa-4ce0-a395-62903c5c101b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.839331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819b3b-9caa-4ce0-a395-62903c5c101b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.840660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0819b3b-9caa-4ce0-a395-62903c5c101b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.842852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0819b3b-9caa-4ce0-a395-62903c5c101b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.850343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0819b3b-9caa-4ce0-a395-62903c5c101b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:34.858005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:34.896761 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1038/2046] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:34.898597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:34.900929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:34.956335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9bfa3b-269c-4fac-a263-047ca1216870 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:34.975588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3002f-e128-4b9e-82c1-d67d560a3b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:34.976678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3002f-e128-4b9e-82c1-d67d560a3b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:34.977105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3002f-e128-4b9e-82c1-d67d560a3b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:34.977573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3002f-e128-4b9e-82c1-d67d560a3b22 admin admin] PATH_INFO: `/v3/projects/82c848277db34491821408a78da37182/users/0f5ddb909f384cb2a4b32ff6a2164f4f/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:34.983215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3002f-e128-4b9e-82c1-d67d560a3b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c848277db34491821408a78da37182, user_id=0f5ddb909f384cb2a4b32ff6a2164f4f, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:34.996502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3002f-e128-4b9e-82c1-d67d560a3b22 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:35.037592 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1009/2047] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:34 2022] PUT /identity/v3/projects/82c848277db34491821408a78da37182/users/0f5ddb909f384cb2a4b32ff6a2164f4f/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:35.042857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4323e-fb63-49ee-8b2f-6f68b306dce7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.043652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4323e-fb63-49ee-8b2f-6f68b306dce7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.043652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4323e-fb63-49ee-8b2f-6f68b306dce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.093564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c9c4323e-fb63-49ee-8b2f-6f68b306dce7 None None] MFA Rules not processed for user `0f5ddb909f384cb2a4b32ff6a2164f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:35.098300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c9c4323e-fb63-49ee-8b2f-6f68b306dce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:35.238191 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1039/2048] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:35.285261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3002f-e128-4b9e-82c1-d67d560a3b22 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:35.287932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-79a3002f-e128-4b9e-82c1-d67d560a3b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:35.497768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3002f-e128-4b9e-82c1-d67d560a3b22 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:35.511569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda2142c-9b7c-4c25-957e-622cb189d6b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:35.512702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2142c-9b7c-4c25-957e-622cb189d6b9 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.513208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2142c-9b7c-4c25-957e-622cb189d6b9 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.515060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda2142c-9b7c-4c25-957e-622cb189d6b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.528159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2142c-9b7c-4c25-957e-622cb189d6b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:35.531266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda2142c-9b7c-4c25-957e-622cb189d6b9 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:35.546445 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1010/2049] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:35.685813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4323e-fb63-49ee-8b2f-6f68b306dce7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:35.890483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4323e-fb63-49ee-8b2f-6f68b306dce7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:35.918436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:35.919827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:35.920109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:35.920392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] PATH_INFO: `/v3/users/ca877c5c1a8f4ffd86235018b672f567` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:35.922135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca877c5c1a8f4ffd86235018b672f567)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:35.924307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:36.104925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca877c5c1a8f4ffd86235018b672f567'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:36.107821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca877c5c1a8f4ffd86235018b672f567'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:36.150594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca877c5c1a8f4ffd86235018b672f567'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:36.179331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca877c5c1a8f4ffd86235018b672f567'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:36.268546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca877c5c1a8f4ffd86235018b672f567'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:36.275019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:36.291783 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1040/2050] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:35 2022] DELETE /identity/v3/users/ca877c5c1a8f4ffd86235018b672f567 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:36.296611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe3c09-f54b-44f9-8427-49e58a66bf99 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:36.298776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe3c09-f54b-44f9-8427-49e58a66bf99 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:36.299305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe3c09-f54b-44f9-8427-49e58a66bf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:36.332017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-73fe3c09-f54b-44f9-8427-49e58a66bf99 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:36.333269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-73fe3c09-f54b-44f9-8427-49e58a66bf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:36.482085 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1011/2051] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:36.558766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:36.562662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:36.715401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e63a7-7b44-4243-9f39-eb687a630c35 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:36.723796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c9638-9210-4bb0-b0b1-d7ab1c0d6e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:36.726552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c9638-9210-4bb0-b0b1-d7ab1c0d6e36 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:36.726917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c9638-9210-4bb0-b0b1-d7ab1c0d6e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:36.727196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c9638-9210-4bb0-b0b1-d7ab1c0d6e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:36.743256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c9638-9210-4bb0-b0b1-d7ab1c0d6e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:36.744730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c9638-9210-4bb0-b0b1-d7ab1c0d6e36 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:36.756848 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1041/2052] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:37.353379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe3c09-f54b-44f9-8427-49e58a66bf99 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:37.355040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-73fe3c09-f54b-44f9-8427-49e58a66bf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:37.373920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe3c09-f54b-44f9-8427-49e58a66bf99 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:37.391590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:37.392677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:37.393425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:37.393847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] PATH_INFO: `/v3/projects/3e41d22831bd4eaab0de60d0c886b991` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:37.397852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e41d22831bd4eaab0de60d0c886b991)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:37.402271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:37.464009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:37.528077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e41d22831bd4eaab0de60d0c886b991', 'request_id': 'req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:37.562375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e41d22831bd4eaab0de60d0c886b991', 'request_id': 'req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:37.571431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e41d22831bd4eaab0de60d0c886b991', 'request_id': 'req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:37.601095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] The token cache is being invalidate because project 3e41d22831bd4eaab0de60d0c886b991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:37.601394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:37.604597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf9a5e9b-11a2-476d-906a-ab6f0a65a3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:37.613940 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1012/2053] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:37 2022] DELETE /identity/v3/projects/3e41d22831bd4eaab0de60d0c886b991 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:37.617195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45377d-2b45-4ebb-a947-eb1128d2eb8b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:37.618190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45377d-2b45-4ebb-a947-eb1128d2eb8b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:37.618606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45377d-2b45-4ebb-a947-eb1128d2eb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:37.658438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bc45377d-2b45-4ebb-a947-eb1128d2eb8b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:37.661448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bc45377d-2b45-4ebb-a947-eb1128d2eb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:37.901937 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1042/2054] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:37.915551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c08a-cead-48bf-9570-cb284a237206 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:37.916016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c08a-cead-48bf-9570-cb284a237206 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:37.917314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c08a-cead-48bf-9570-cb284a237206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:37.973255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b022c08a-cead-48bf-9570-cb284a237206 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:37.976464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b022c08a-cead-48bf-9570-cb284a237206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:38.000153 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1013/2055] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:38.018913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45377d-2b45-4ebb-a947-eb1128d2eb8b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.042820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45377d-2b45-4ebb-a947-eb1128d2eb8b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.053914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ec320-e173-4370-b293-362ea29d6163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.054993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ec320-e173-4370-b293-362ea29d6163 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.055466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ec320-e173-4370-b293-362ea29d6163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.055944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147ec320-e173-4370-b293-362ea29d6163 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.057174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ec320-e173-4370-b293-362ea29d6163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:38.057709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ec320-e173-4370-b293-362ea29d6163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.064291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147ec320-e173-4370-b293-362ea29d6163 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.095004 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1043/2056] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:38.104137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022c08a-cead-48bf-9570-cb284a237206 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.137106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022c08a-cead-48bf-9570-cb284a237206 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.157286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f975b7-c9eb-4182-bbb7-25050063769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.158862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f975b7-c9eb-4182-bbb7-25050063769f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.159493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f975b7-c9eb-4182-bbb7-25050063769f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.160243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f975b7-c9eb-4182-bbb7-25050063769f admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.161756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f975b7-c9eb-4182-bbb7-25050063769f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.165927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f975b7-c9eb-4182-bbb7-25050063769f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.286176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ec320-e173-4370-b293-362ea29d6163 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.294061 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1014/2057] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:38 2022] POST /identity/v3/projects => generated 407 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:38.323337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147ec320-e173-4370-b293-362ea29d6163 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.508025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eaa8a4-150c-48a7-8ceb-380a0e49e31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.510725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eaa8a4-150c-48a7-8ceb-380a0e49e31f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.511221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eaa8a4-150c-48a7-8ceb-380a0e49e31f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.511706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eaa8a4-150c-48a7-8ceb-380a0e49e31f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.515353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eaa8a4-150c-48a7-8ceb-380a0e49e31f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.525139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eaa8a4-150c-48a7-8ceb-380a0e49e31f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.624599 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1044/2058] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:38 2022] POST /identity/v3/users => generated 304 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:38.630670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f975b7-c9eb-4182-bbb7-25050063769f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.669055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f975b7-c9eb-4182-bbb7-25050063769f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.675514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eaa8a4-150c-48a7-8ceb-380a0e49e31f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.680165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e1eaa8a4-150c-48a7-8ceb-380a0e49e31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:38.688501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11a223-37de-45c4-911d-4948c4764492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.689964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11a223-37de-45c4-911d-4948c4764492 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.694861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11a223-37de-45c4-911d-4948c4764492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.695669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11a223-37de-45c4-911d-4948c4764492 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.696989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11a223-37de-45c4-911d-4948c4764492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.712960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eaa8a4-150c-48a7-8ceb-380a0e49e31f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.713805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad11a223-37de-45c4-911d-4948c4764492 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.731266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.732191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.732191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.732467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] PATH_INFO: `/v3/users/7e1165ea52e04e6088ea6d0cad09b96a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.743730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1165ea52e04e6088ea6d0cad09b96a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.746397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.767852 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1015/2059] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:38.770236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11a223-37de-45c4-911d-4948c4764492 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.794955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:38.820350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11a223-37de-45c4-911d-4948c4764492 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.847982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079b18f-beed-4a49-b401-3e8b58f4aa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.849046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b18f-beed-4a49-b401-3e8b58f4aa99 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.849473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b18f-beed-4a49-b401-3e8b58f4aa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.850153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b18f-beed-4a49-b401-3e8b58f4aa99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.850976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079b18f-beed-4a49-b401-3e8b58f4aa99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:38.853181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079b18f-beed-4a49-b401-3e8b58f4aa99 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:38.883453 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1016/2060] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:38.885968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079b18f-beed-4a49-b401-3e8b58f4aa99 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:38.911381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079b18f-beed-4a49-b401-3e8b58f4aa99 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:38.921321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375b8b5-ce43-4505-b3a3-539dc858531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:38.922932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375b8b5-ce43-4505-b3a3-539dc858531a admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:38.923671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375b8b5-ce43-4505-b3a3-539dc858531a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:38.924404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375b8b5-ce43-4505-b3a3-539dc858531a admin admin] PATH_INFO: `/v3/projects/7295729b36004db294d8cc5e4a168d52/users/c81a619e7cd5435f9a302edda99bdc4e/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:38.959075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1165ea52e04e6088ea6d0cad09b96a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:38.960059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1165ea52e04e6088ea6d0cad09b96a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:38.984744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1165ea52e04e6088ea6d0cad09b96a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:39.009817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1165ea52e04e6088ea6d0cad09b96a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:39.016828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375b8b5-ce43-4505-b3a3-539dc858531a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7295729b36004db294d8cc5e4a168d52, user_id=c81a619e7cd5435f9a302edda99bdc4e, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:39.025048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375b8b5-ce43-4505-b3a3-539dc858531a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:39.053856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3d2943a-6dde-4eda-9bc8-9f9457e6d3e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1165ea52e04e6088ea6d0cad09b96a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:39.068222 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1045/2061] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:38 2022] DELETE /identity/v3/users/7e1165ea52e04e6088ea6d0cad09b96a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:39.075251 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1017/2062] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:38 2022] PUT /identity/v3/projects/7295729b36004db294d8cc5e4a168d52/users/c81a619e7cd5435f9a302edda99bdc4e/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:39.077188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b6c3-bf6d-4617-be17-0d3df2da7030 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.077648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b6c3-bf6d-4617-be17-0d3df2da7030 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.078080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b6c3-bf6d-4617-be17-0d3df2da7030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.091829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30482e4-7e42-4c85-9308-9561092c2d3c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.092820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30482e4-7e42-4c85-9308-9561092c2d3c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.093203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30482e4-7e42-4c85-9308-9561092c2d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.124255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2297b6c3-bf6d-4617-be17-0d3df2da7030 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:39.131926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2297b6c3-bf6d-4617-be17-0d3df2da7030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:39.142404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b30482e4-7e42-4c85-9308-9561092c2d3c None None] MFA Rules not processed for user `c81a619e7cd5435f9a302edda99bdc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:39.145450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b30482e4-7e42-4c85-9308-9561092c2d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:39.272940 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1018/2063] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:39 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:39.280693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30482e4-7e42-4c85-9308-9561092c2d3c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.283029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b30482e4-7e42-4c85-9308-9561092c2d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:39.328860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:39.394152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30482e4-7e42-4c85-9308-9561092c2d3c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.407788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136250a7-47d7-4abd-84e6-4da284fd3fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.412252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136250a7-47d7-4abd-84e6-4da284fd3fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.412252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136250a7-47d7-4abd-84e6-4da284fd3fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.412539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136250a7-47d7-4abd-84e6-4da284fd3fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.414305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136250a7-47d7-4abd-84e6-4da284fd3fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:39.421037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136250a7-47d7-4abd-84e6-4da284fd3fd0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:39.474535 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1046/2064] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:39.512084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297b6c3-bf6d-4617-be17-0d3df2da7030 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.514705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2297b6c3-bf6d-4617-be17-0d3df2da7030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:39.524637 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1019/2065] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:39 2022] POST /identity/v3/projects => generated 409 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:39.528411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136250a7-47d7-4abd-84e6-4da284fd3fd0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.659249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297b6c3-bf6d-4617-be17-0d3df2da7030 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.847035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:39.861674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136250a7-47d7-4abd-84e6-4da284fd3fd0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:39.865750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f18009-9fec-46ee-a4eb-5da7b90f0dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.866596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f18009-9fec-46ee-a4eb-5da7b90f0dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.866979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f18009-9fec-46ee-a4eb-5da7b90f0dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.868116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f18009-9fec-46ee-a4eb-5da7b90f0dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.884896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538209a-68e5-4370-ab11-80433e4692be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:39.886490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538209a-68e5-4370-ab11-80433e4692be admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:39.887686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538209a-68e5-4370-ab11-80433e4692be admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:39.889681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538209a-68e5-4370-ab11-80433e4692be admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:39.893526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538209a-68e5-4370-ab11-80433e4692be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:39.904597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538209a-68e5-4370-ab11-80433e4692be admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:39.905667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f18009-9fec-46ee-a4eb-5da7b90f0dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:39.907577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f18009-9fec-46ee-a4eb-5da7b90f0dc7 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:39.941103 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1047/2066] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:39.980039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f18009-9fec-46ee-a4eb-5da7b90f0dc7 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:39.982323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d2f18009-9fec-46ee-a4eb-5da7b90f0dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:39.991153 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1020/2067] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:39 2022] POST /identity/v3/users => generated 311 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:39.996212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538209a-68e5-4370-ab11-80433e4692be admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.018640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f18009-9fec-46ee-a4eb-5da7b90f0dc7 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.030838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538209a-68e5-4370-ab11-80433e4692be admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.031093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.031774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.032608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.034246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] PATH_INFO: `/v3/projects/7534c71789114569a025aa4cc6e016d6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.036107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7534c71789114569a025aa4cc6e016d6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.046301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.046974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67512a85-ce19-42c7-b934-082c5b8c8689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.049801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67512a85-ce19-42c7-b934-082c5b8c8689 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.051074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67512a85-ce19-42c7-b934-082c5b8c8689 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.051439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67512a85-ce19-42c7-b934-082c5b8c8689 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.078600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67512a85-ce19-42c7-b934-082c5b8c8689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.080401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67512a85-ce19-42c7-b934-082c5b8c8689 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.119085 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1021/2068] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:40.125177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67512a85-ce19-42c7-b934-082c5b8c8689 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.168758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67512a85-ce19-42c7-b934-082c5b8c8689 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.179737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4365ce-0951-479c-837e-a8e7d968f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.180807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4365ce-0951-479c-837e-a8e7d968f6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.181147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4365ce-0951-479c-837e-a8e7d968f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.181464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4365ce-0951-479c-837e-a8e7d968f6ee admin admin] PATH_INFO: `/v3/projects/eb3ef413dd78411e8e648fbf448c909b/users/38a3a60fdba04d2e9bfe49120534557b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.238537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4365ce-0951-479c-837e-a8e7d968f6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3ef413dd78411e8e648fbf448c909b, user_id=38a3a60fdba04d2e9bfe49120534557b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.249791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4365ce-0951-479c-837e-a8e7d968f6ee admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.256516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7534c71789114569a025aa4cc6e016d6', 'request_id': 'req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.281778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7534c71789114569a025aa4cc6e016d6', 'request_id': 'req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.286369 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1022/2069] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:40 2022] PUT /identity/v3/projects/eb3ef413dd78411e8e648fbf448c909b/users/38a3a60fdba04d2e9bfe49120534557b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:40.297515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7534c71789114569a025aa4cc6e016d6', 'request_id': 'req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.300031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4365ce-0951-479c-837e-a8e7d968f6ee admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.392817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] The token cache is being invalidate because project 7534c71789114569a025aa4cc6e016d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:40.394855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.396050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.400959 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1048/2070] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:39 2022] DELETE /identity/v3/projects/7534c71789114569a025aa4cc6e016d6 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:40.403275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.409260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:40.492718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4365ce-0951-479c-837e-a8e7d968f6ee admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.513475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16b4a-a413-4391-a941-ac08ea44b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.514158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16b4a-a413-4391-a941-ac08ea44b19a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.514438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16b4a-a413-4391-a941-ac08ea44b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.514710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16b4a-a413-4391-a941-ac08ea44b19a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.515379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a16b4a-a413-4391-a941-ac08ea44b19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.517063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a16b4a-a413-4391-a941-ac08ea44b19a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.549916 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1023/2071] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:14:40.549916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16b4a-a413-4391-a941-ac08ea44b19a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.556658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b0a16b4a-a413-4391-a941-ac08ea44b19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:40.567429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:40.582907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16b4a-a413-4391-a941-ac08ea44b19a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.599326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.599975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.600150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.600444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] PATH_INFO: `/v3/users/0f5ddb909f384cb2a4b32ff6a2164f4f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.601656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5ddb909f384cb2a4b32ff6a2164f4f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.603757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.632671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc6e4d-52ba-46ab-b533-112fdbfe152b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:40.648161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:40.648846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.649118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.649379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] PATH_INFO: `/v3/users/d387739ecdf14841a888667e6d09b1e0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.650961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d387739ecdf14841a888667e6d09b1e0)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:40.653276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:40.712222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5ddb909f384cb2a4b32ff6a2164f4f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.739201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5ddb909f384cb2a4b32ff6a2164f4f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.789457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5ddb909f384cb2a4b32ff6a2164f4f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.808456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd387739ecdf14841a888667e6d09b1e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.812719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5ddb909f384cb2a4b32ff6a2164f4f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.815048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5ddb909f384cb2a4b32ff6a2164f4f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.818154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd387739ecdf14841a888667e6d09b1e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.833771 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1024/2072] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:40 2022] DELETE /identity/v3/users/0f5ddb909f384cb2a4b32ff6a2164f4f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:40.835815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:40.848517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:40.857808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd387739ecdf14841a888667e6d09b1e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.884335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd387739ecdf14841a888667e6d09b1e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.907154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:40.911194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb08baf2-13a9-42d1-a69f-50900c5d2c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd387739ecdf14841a888667e6d09b1e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:40.927440 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1049/2073] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:40 2022] DELETE /identity/v3/users/d387739ecdf14841a888667e6d09b1e0 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:40.929166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e9afc-5313-4569-87f5-d5d48c7ff7ba None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:40.929554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e9afc-5313-4569-87f5-d5d48c7ff7ba None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:40.929984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e9afc-5313-4569-87f5-d5d48c7ff7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:40.979606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-801e9afc-5313-4569-87f5-d5d48c7ff7ba None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:40.981215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-801e9afc-5313-4569-87f5-d5d48c7ff7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:41.020510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee139c8f-9bb1-46ee-bd78-6c354c68e8da admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:41.125674 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1050/2074] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:41.148361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa551df8-3305-40f2-b20d-b60de5eb9696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.149067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa551df8-3305-40f2-b20d-b60de5eb9696 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.149362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa551df8-3305-40f2-b20d-b60de5eb9696 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.149606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa551df8-3305-40f2-b20d-b60de5eb9696 admin admin] PATH_INFO: `/v3/projects/eb3ef413dd78411e8e648fbf448c909b/users/38a3a60fdba04d2e9bfe49120534557b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.154590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa551df8-3305-40f2-b20d-b60de5eb9696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3ef413dd78411e8e648fbf448c909b, user_id=38a3a60fdba04d2e9bfe49120534557b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.157751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa551df8-3305-40f2-b20d-b60de5eb9696 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:41.175806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e9afc-5313-4569-87f5-d5d48c7ff7ba None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:41.180582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-801e9afc-5313-4569-87f5-d5d48c7ff7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:41.195647 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1025/2075] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:40 2022] PUT /identity/v3/projects/eb3ef413dd78411e8e648fbf448c909b/users/38a3a60fdba04d2e9bfe49120534557b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:41.208604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604a4b2-d4af-4b15-918a-ff726d962a12 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.209233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604a4b2-d4af-4b15-918a-ff726d962a12 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.209428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604a4b2-d4af-4b15-918a-ff726d962a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.312765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1604a4b2-d4af-4b15-918a-ff726d962a12 None None] MFA Rules not processed for user `38a3a60fdba04d2e9bfe49120534557b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:41.319542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1604a4b2-d4af-4b15-918a-ff726d962a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:41.347306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:41.371352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e9afc-5313-4569-87f5-d5d48c7ff7ba None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:41.499189 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1026/2076] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:41 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:41.500263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604a4b2-d4af-4b15-918a-ff726d962a12 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:41.503103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1604a4b2-d4af-4b15-918a-ff726d962a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:41.582290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c0cbe-3456-4281-9299-34c7c3e92f61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.583268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c0cbe-3456-4281-9299-34c7c3e92f61 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.583701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c0cbe-3456-4281-9299-34c7c3e92f61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.584143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c0cbe-3456-4281-9299-34c7c3e92f61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.704429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c0cbe-3456-4281-9299-34c7c3e92f61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.706653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c0cbe-3456-4281-9299-34c7c3e92f61 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:41.714258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:41.733736 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1051/2077] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:41.792562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604a4b2-d4af-4b15-918a-ff726d962a12 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:41.806698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.808817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.809559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.810431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] PATH_INFO: `/v3/users/c81a619e7cd5435f9a302edda99bdc4e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.813273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c81a619e7cd5435f9a302edda99bdc4e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.823518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:41.938158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c0cbe-3456-4281-9299-34c7c3e92f61 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:41.939892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-809c0cbe-3456-4281-9299-34c7c3e92f61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:41.967698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c0cbe-3456-4281-9299-34c7c3e92f61 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:41.984784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:41.985808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:41.986159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:41.986539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] PATH_INFO: `/v3/projects/6df60b6010674bf5bf594fef89f7b52d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:41.992946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df60b6010674bf5bf594fef89f7b52d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:41.998828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.005555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c81a619e7cd5435f9a302edda99bdc4e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.018479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c81a619e7cd5435f9a302edda99bdc4e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.050828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c81a619e7cd5435f9a302edda99bdc4e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.074872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c81a619e7cd5435f9a302edda99bdc4e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.075666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-880b2557-2469-41d6-97c0-9551660b8dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c81a619e7cd5435f9a302edda99bdc4e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.084834 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1027/2078] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:41 2022] DELETE /identity/v3/users/c81a619e7cd5435f9a302edda99bdc4e => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:42.089740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f57f44-a964-4f69-90fb-52e5ea4f403b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.090059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f57f44-a964-4f69-90fb-52e5ea4f403b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.090330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f57f44-a964-4f69-90fb-52e5ea4f403b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.154914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-69f57f44-a964-4f69-90fb-52e5ea4f403b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:42.158233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-69f57f44-a964-4f69-90fb-52e5ea4f403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:42.198519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:42.203178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df60b6010674bf5bf594fef89f7b52d', 'request_id': 'req-8d5938ca-a653-49bb-833d-e4d7407a1eaf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.232196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df60b6010674bf5bf594fef89f7b52d', 'request_id': 'req-8d5938ca-a653-49bb-833d-e4d7407a1eaf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.269754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df60b6010674bf5bf594fef89f7b52d', 'request_id': 'req-8d5938ca-a653-49bb-833d-e4d7407a1eaf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.308807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] The token cache is being invalidate because project 6df60b6010674bf5bf594fef89f7b52d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:42.314673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.320111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.325847 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1052/2079] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:41 2022] DELETE /identity/v3/projects/6df60b6010674bf5bf594fef89f7b52d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:42.327160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.333681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:42.362903 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1028/2080] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:42.370328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f57f44-a964-4f69-90fb-52e5ea4f403b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.372826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-69f57f44-a964-4f69-90fb-52e5ea4f403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:42.408505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f57f44-a964-4f69-90fb-52e5ea4f403b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:42.414955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:42.417001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.417001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.417001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] PATH_INFO: `/v3/users/814227e779a64f70916ebe4e0372fdbe` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.420628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814227e779a64f70916ebe4e0372fdbe)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:42.425117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.502205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5938ca-a653-49bb-833d-e4d7407a1eaf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:42.517458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:42.518350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.518797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.519074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] PATH_INFO: `/v3/projects/82c848277db34491821408a78da37182` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.523698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c848277db34491821408a78da37182)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:42.525555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.540441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814227e779a64f70916ebe4e0372fdbe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.569816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814227e779a64f70916ebe4e0372fdbe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.625514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814227e779a64f70916ebe4e0372fdbe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.643975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c848277db34491821408a78da37182', 'request_id': 'req-9cfa969a-6e97-4617-8393-cac3296ad8f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.660009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814227e779a64f70916ebe4e0372fdbe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.661123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814227e779a64f70916ebe4e0372fdbe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.661559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c848277db34491821408a78da37182', 'request_id': 'req-9cfa969a-6e97-4617-8393-cac3296ad8f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.673732 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1029/2081] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:42 2022] DELETE /identity/v3/users/814227e779a64f70916ebe4e0372fdbe => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:42.676619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:42.679058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c848277db34491821408a78da37182', 'request_id': 'req-9cfa969a-6e97-4617-8393-cac3296ad8f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.682041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:42.709841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] The token cache is being invalidate because project 82c848277db34491821408a78da37182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:42.710320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.711201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9cfa969a-6e97-4617-8393-cac3296ad8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:42.722403 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1053/2082] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:42 2022] DELETE /identity/v3/projects/82c848277db34491821408a78da37182 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:42.724123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd670b-d263-436d-a10f-1fa498fdc075 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.724411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd670b-d263-436d-a10f-1fa498fdc075 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.724830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd670b-d263-436d-a10f-1fa498fdc075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.773458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bcbd670b-d263-436d-a10f-1fa498fdc075 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:42.776755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bcbd670b-d263-436d-a10f-1fa498fdc075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:42.782778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f076f1c-7e94-4c22-9fd4-bbb30f54aa69 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:42.803223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:42.804517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c46973-aa82-40ed-a0f4-1b3cb2d3ffd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:42.805395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c46973-aa82-40ed-a0f4-1b3cb2d3ffd8 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.805610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c46973-aa82-40ed-a0f4-1b3cb2d3ffd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.805898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c46973-aa82-40ed-a0f4-1b3cb2d3ffd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.810931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c7c46973-aa82-40ed-a0f4-1b3cb2d3ffd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:42.924865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:42.944759 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1054/2083] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:42.952596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650737-2456-4e88-b722-04327af255fd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:42.953029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650737-2456-4e88-b722-04327af255fd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:42.953305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650737-2456-4e88-b722-04327af255fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:42.982559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c46973-aa82-40ed-a0f4-1b3cb2d3ffd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:42.984068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c46973-aa82-40ed-a0f4-1b3cb2d3ffd8 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:42.996956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-74650737-2456-4e88-b722-04327af255fd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:42.998839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-74650737-2456-4e88-b722-04327af255fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:43.010566 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1030/2084] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:43.018052 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1055/2085] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:43.023135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c46973-aa82-40ed-a0f4-1b3cb2d3ffd8 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.044240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c46973-aa82-40ed-a0f4-1b3cb2d3ffd8 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.063868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4942-cb36-4119-82c9-bf6bbd74f0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.065593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4942-cb36-4119-82c9-bf6bbd74f0bf admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.066185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4942-cb36-4119-82c9-bf6bbd74f0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.066607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4942-cb36-4119-82c9-bf6bbd74f0bf admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.067439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4942-cb36-4119-82c9-bf6bbd74f0bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:43.067890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4942-cb36-4119-82c9-bf6bbd74f0bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.069698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4942-cb36-4119-82c9-bf6bbd74f0bf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.107105 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1031/2086] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:43.115792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650737-2456-4e88-b722-04327af255fd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.137847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650737-2456-4e88-b722-04327af255fd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.151070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479a854-659a-450c-b05c-8b956c32fa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.153068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479a854-659a-450c-b05c-8b956c32fa34 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.153598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479a854-659a-450c-b05c-8b956c32fa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.154072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479a854-659a-450c-b05c-8b956c32fa34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.154961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479a854-659a-450c-b05c-8b956c32fa34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.157545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479a854-659a-450c-b05c-8b956c32fa34 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.202212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4942-cb36-4119-82c9-bf6bbd74f0bf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.206510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1cce4942-cb36-4119-82c9-bf6bbd74f0bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:43.248065 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1056/2087] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:43 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:43.249440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479a854-659a-450c-b05c-8b956c32fa34 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.271122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4942-cb36-4119-82c9-bf6bbd74f0bf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.457570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.459502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.460033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.460330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] PATH_INFO: `/v3/projects/2339ba8063d147fba0ec29bdada0c503` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.463267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2339ba8063d147fba0ec29bdada0c503)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.467327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.503278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479a854-659a-450c-b05c-8b956c32fa34 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.524278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18840-82c9-4874-b9a1-9097c182f556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.525347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18840-82c9-4874-b9a1-9097c182f556 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.526090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18840-82c9-4874-b9a1-9097c182f556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.526303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18840-82c9-4874-b9a1-9097c182f556 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.527460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c18840-82c9-4874-b9a1-9097c182f556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.540095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c18840-82c9-4874-b9a1-9097c182f556 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.588675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2339ba8063d147fba0ec29bdada0c503', 'request_id': 'req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:43.623234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2339ba8063d147fba0ec29bdada0c503', 'request_id': 'req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:43.656350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2339ba8063d147fba0ec29bdada0c503', 'request_id': 'req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:43.657813 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1057/2088] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:43 2022] POST /identity/v3/users => generated 293 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:43.662329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18840-82c9-4874-b9a1-9097c182f556 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.689751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18840-82c9-4874-b9a1-9097c182f556 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.700013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] The token cache is being invalidate because project 2339ba8063d147fba0ec29bdada0c503 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:43.701171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:43.704639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:43.716174 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1032/2089] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:43 2022] DELETE /identity/v3/projects/2339ba8063d147fba0ec29bdada0c503 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:43.718409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.722613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:43.807023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f1edd-7958-4e58-9423-1b6e71a9599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.807867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f1edd-7958-4e58-9423-1b6e71a9599e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.808253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f1edd-7958-4e58-9423-1b6e71a9599e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.808621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f1edd-7958-4e58-9423-1b6e71a9599e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.809702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f1edd-7958-4e58-9423-1b6e71a9599e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.811644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f1edd-7958-4e58-9423-1b6e71a9599e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.824335 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1058/2090] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:14:43.828789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f1edd-7958-4e58-9423-1b6e71a9599e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.831579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4d5f1edd-7958-4e58-9423-1b6e71a9599e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:43.846767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f1edd-7958-4e58-9423-1b6e71a9599e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.853308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63427c54-624d-4d80-bce2-94e80613e403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.855172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427c54-624d-4d80-bce2-94e80613e403 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.855686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427c54-624d-4d80-bce2-94e80613e403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.856171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63427c54-624d-4d80-bce2-94e80613e403 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.857092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63427c54-624d-4d80-bce2-94e80613e403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.859332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63427c54-624d-4d80-bce2-94e80613e403 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.867895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:43.888555 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1059/2091] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:43.896604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63427c54-624d-4d80-bce2-94e80613e403 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:43.925148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63427c54-624d-4d80-bce2-94e80613e403 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.949078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08d51d-5746-4ad1-aeec-a2c0fdcccda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.954302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08d51d-5746-4ad1-aeec-a2c0fdcccda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.955033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08d51d-5746-4ad1-aeec-a2c0fdcccda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.956302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08d51d-5746-4ad1-aeec-a2c0fdcccda7 admin admin] PATH_INFO: `/v3/projects/eeff500d4e4b4cf9aa60e9755dacb874/users/16efb85f7d9c4660a3b4175e1fbf96db/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.967754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc0c5d-66d1-4813-96a3-f9808cf7f3d2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:43.975722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:43.980616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:43.981669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:43.982080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] PATH_INFO: `/v3/users/7b925d0eb232429f9893a76d287bbc30` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:43.983594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b925d0eb232429f9893a76d287bbc30)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:43.985989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:43.988167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:44.004648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08d51d-5746-4ad1-aeec-a2c0fdcccda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeff500d4e4b4cf9aa60e9755dacb874, user_id=16efb85f7d9c4660a3b4175e1fbf96db, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:44.008546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c08d51d-5746-4ad1-aeec-a2c0fdcccda7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:44.037932 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1060/2092] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:43 2022] PUT /identity/v3/projects/eeff500d4e4b4cf9aa60e9755dacb874/users/16efb85f7d9c4660a3b4175e1fbf96db/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:44.037932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08d51d-5746-4ad1-aeec-a2c0fdcccda7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.051591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4c08d51d-5746-4ad1-aeec-a2c0fdcccda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:44.109936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b925d0eb232429f9893a76d287bbc30'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.142197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b925d0eb232429f9893a76d287bbc30'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.177694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b925d0eb232429f9893a76d287bbc30'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.194564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b925d0eb232429f9893a76d287bbc30'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.195019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50db3c74-ed32-4950-99be-f8c7550634bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b925d0eb232429f9893a76d287bbc30'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.217302 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1033/2093] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:43 2022] DELETE /identity/v3/users/7b925d0eb232429f9893a76d287bbc30 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:44.218803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc5c17-44f9-4ec7-9d19-900175ee010b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.223406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc5c17-44f9-4ec7-9d19-900175ee010b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.225681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc5c17-44f9-4ec7-9d19-900175ee010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.269598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08d51d-5746-4ad1-aeec-a2c0fdcccda7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:44.331485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9fcc5c17-44f9-4ec7-9d19-900175ee010b None None] MFA Rules not processed for user `16efb85f7d9c4660a3b4175e1fbf96db`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:44.336361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9fcc5c17-44f9-4ec7-9d19-900175ee010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:44.474740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:44.476830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.477373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.477979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] PATH_INFO: `/v3/projects/fd027031e01a46e7bd65e4feae501a7e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.480288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd027031e01a46e7bd65e4feae501a7e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:44.484037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:44.541535 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1034/2094] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:44.543270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc5c17-44f9-4ec7-9d19-900175ee010b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.548356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9fcc5c17-44f9-4ec7-9d19-900175ee010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:44.574161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc5c17-44f9-4ec7-9d19-900175ee010b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:44.584771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:44.586000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.586468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.586915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] PATH_INFO: `/v3/projects/7295729b36004db294d8cc5e4a168d52` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.589610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7295729b36004db294d8cc5e4a168d52)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:44.592607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:44.632513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd027031e01a46e7bd65e4feae501a7e', 'request_id': 'req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.652386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd027031e01a46e7bd65e4feae501a7e', 'request_id': 'req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.668871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd027031e01a46e7bd65e4feae501a7e', 'request_id': 'req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.698427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7295729b36004db294d8cc5e4a168d52', 'request_id': 'req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.701129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] The token cache is being invalidate because project fd027031e01a46e7bd65e4feae501a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:44.702020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.703155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.704962 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1061/2095] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:44 2022] DELETE /identity/v3/projects/fd027031e01a46e7bd65e4feae501a7e => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:44.706592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.711741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:44.717048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7295729b36004db294d8cc5e4a168d52', 'request_id': 'req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.730266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7295729b36004db294d8cc5e4a168d52', 'request_id': 'req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.735636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:44.736621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:44.754628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] The token cache is being invalidate because project 7295729b36004db294d8cc5e4a168d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:44.755917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.757795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e12a77a-fec3-42f8-ae0d-8f2a0d1705b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:44.766554 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1035/2096] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:44 2022] DELETE /identity/v3/projects/7295729b36004db294d8cc5e4a168d52 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:44.770152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a5202-9811-4d51-8dbf-204ebe4e2053 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.771154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a5202-9811-4d51-8dbf-204ebe4e2053 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.771926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a5202-9811-4d51-8dbf-204ebe4e2053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.797771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-325a5202-9811-4d51-8dbf-204ebe4e2053 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:44.799611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-325a5202-9811-4d51-8dbf-204ebe4e2053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:44.828012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e7370c-fdf4-4a6c-8a88-52d18fecfe0d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:44.929797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e1695-80a7-4769-8bee-6950a721582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:44.930820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e1695-80a7-4769-8bee-6950a721582b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.930820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e1695-80a7-4769-8bee-6950a721582b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.931077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e1695-80a7-4769-8bee-6950a721582b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.931707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e1695-80a7-4769-8bee-6950a721582b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:44.933859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e1695-80a7-4769-8bee-6950a721582b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:44.942570 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1036/2097] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:44.944142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a5202-9811-4d51-8dbf-204ebe4e2053 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:44.946573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-325a5202-9811-4d51-8dbf-204ebe4e2053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:44.972799 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1062/2098] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:44 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:44.974415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be611326-bc22-46da-9584-0738659a054b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:44.974752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be611326-bc22-46da-9584-0738659a054b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:44.975042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be611326-bc22-46da-9584-0738659a054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:44.977132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a5202-9811-4d51-8dbf-204ebe4e2053 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.004993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-be611326-bc22-46da-9584-0738659a054b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:45.005767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-be611326-bc22-46da-9584-0738659a054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:45.157432 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1063/2099] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:45.157432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be611326-bc22-46da-9584-0738659a054b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.157721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-be611326-bc22-46da-9584-0738659a054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:45.184973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be611326-bc22-46da-9584-0738659a054b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.190609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff54d-3c4e-44c0-befc-9ba01753234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.191710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff54d-3c4e-44c0-befc-9ba01753234a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.192122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff54d-3c4e-44c0-befc-9ba01753234a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.192438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dff54d-3c4e-44c0-befc-9ba01753234a admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.193094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.193560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff54d-3c4e-44c0-befc-9ba01753234a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.194411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.195152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.195541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dff54d-3c4e-44c0-befc-9ba01753234a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.195993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] PATH_INFO: `/v3/users/38a3a60fdba04d2e9bfe49120534557b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.198824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a3a60fdba04d2e9bfe49120534557b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.203933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.231076 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1064/2100] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:45 2022] POST /identity/v3/users => generated 299 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:45.235351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff54d-3c4e-44c0-befc-9ba01753234a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.237508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-22dff54d-3c4e-44c0-befc-9ba01753234a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:45.252178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dff54d-3c4e-44c0-befc-9ba01753234a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.259949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.260295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.260513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.260748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] PATH_INFO: `/v3/projects/726a5c48ccd34cf7838e983827ab8680` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.262037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=726a5c48ccd34cf7838e983827ab8680)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.264044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.310524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:45.360692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '726a5c48ccd34cf7838e983827ab8680', 'request_id': 'req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:45.372897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '726a5c48ccd34cf7838e983827ab8680', 'request_id': 'req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:45.377976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a3a60fdba04d2e9bfe49120534557b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:45.398477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '726a5c48ccd34cf7838e983827ab8680', 'request_id': 'req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:45.399333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a3a60fdba04d2e9bfe49120534557b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:45.429196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a3a60fdba04d2e9bfe49120534557b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:45.430577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] The token cache is being invalidate because project 726a5c48ccd34cf7838e983827ab8680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:45.431027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:45.431820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:45.437709 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1065/2101] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:45 2022] DELETE /identity/v3/projects/726a5c48ccd34cf7838e983827ab8680 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:45.437709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.438802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:45.447183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a3a60fdba04d2e9bfe49120534557b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:45.448856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a3a60fdba04d2e9bfe49120534557b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:45.463526 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1037/2102] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:44 2022] DELETE /identity/v3/users/38a3a60fdba04d2e9bfe49120534557b => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:45.465587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.471454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:45.514533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:45.563838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578a5e4-a6d5-4c9c-a50c-62a82bda5ff7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.650935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32ba13-69ef-4156-bb9e-7e628c7ae675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.652527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ba13-69ef-4156-bb9e-7e628c7ae675 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.653274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ba13-69ef-4156-bb9e-7e628c7ae675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.654062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32ba13-69ef-4156-bb9e-7e628c7ae675 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.655849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ba13-69ef-4156-bb9e-7e628c7ae675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:45.656744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ba13-69ef-4156-bb9e-7e628c7ae675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.660915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32ba13-69ef-4156-bb9e-7e628c7ae675 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.703962 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1066/2103] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:45.706748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231d18-ebbf-41a7-859b-e775758b0470 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.707017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3452d95-2195-4d59-8b42-08dc927188f3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.707278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231d18-ebbf-41a7-859b-e775758b0470 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.707278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb231d18-ebbf-41a7-859b-e775758b0470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.730121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9439b-4be3-4bc9-8a6f-acdff7e46106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.744893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9439b-4be3-4bc9-8a6f-acdff7e46106 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.744893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9439b-4be3-4bc9-8a6f-acdff7e46106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.744893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9439b-4be3-4bc9-8a6f-acdff7e46106 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.744893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9439b-4be3-4bc9-8a6f-acdff7e46106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.744893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9439b-4be3-4bc9-8a6f-acdff7e46106 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.745561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bb231d18-ebbf-41a7-859b-e775758b0470 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:45.751130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bb231d18-ebbf-41a7-859b-e775758b0470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:45.770941 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1038/2104] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:45 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:45.775598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9439b-4be3-4bc9-8a6f-acdff7e46106 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.780478 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1067/2105] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:45.781408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231d18-ebbf-41a7-859b-e775758b0470 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.784006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ce9439b-4be3-4bc9-8a6f-acdff7e46106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:45.810488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb231d18-ebbf-41a7-859b-e775758b0470 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.814060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9439b-4be3-4bc9-8a6f-acdff7e46106 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:45.820360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fee9c-ec53-47f0-97b8-e7214a6983c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.820846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fee9c-ec53-47f0-97b8-e7214a6983c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.821122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fee9c-ec53-47f0-97b8-e7214a6983c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.821392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fee9c-ec53-47f0-97b8-e7214a6983c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.822173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fee9c-ec53-47f0-97b8-e7214a6983c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.824081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fee9c-ec53-47f0-97b8-e7214a6983c5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.829318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8c3e9-96ca-4915-b46c-e448554a6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:45.830921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c3e9-96ca-4915-b46c-e448554a6ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.831377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c3e9-96ca-4915-b46c-e448554a6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.831840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8c3e9-96ca-4915-b46c-e448554a6ed6 admin admin] PATH_INFO: `/v3/projects/80bbd390d91d46cfbf157267f37b0f5f/users/bf23c930c9b540d2a4e1a0ca947edf4c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.869333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8c3e9-96ca-4915-b46c-e448554a6ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80bbd390d91d46cfbf157267f37b0f5f, user_id=bf23c930c9b540d2a4e1a0ca947edf4c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:45.874032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8c3e9-96ca-4915-b46c-e448554a6ed6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:45.887065 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1039/2106] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:45 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:45.896442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3226b-003b-4f02-9ae9-1b5ebeec6c54 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:45.896704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3226b-003b-4f02-9ae9-1b5ebeec6c54 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:45.896987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3226b-003b-4f02-9ae9-1b5ebeec6c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:45.925857 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1068/2107] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:45 2022] PUT /identity/v3/projects/80bbd390d91d46cfbf157267f37b0f5f/users/bf23c930c9b540d2a4e1a0ca947edf4c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:45.925857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8c3e9-96ca-4915-b46c-e448554a6ed6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:45.930652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-45f3226b-003b-4f02-9ae9-1b5ebeec6c54 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:45.932520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-45f3226b-003b-4f02-9ae9-1b5ebeec6c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:45.997315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:46.122302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8c3e9-96ca-4915-b46c-e448554a6ed6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.128726 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1040/2108] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:46.129796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3226b-003b-4f02-9ae9-1b5ebeec6c54 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.138303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af7a59-394f-4463-b8e2-b10e97437356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.138964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af7a59-394f-4463-b8e2-b10e97437356 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.139253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af7a59-394f-4463-b8e2-b10e97437356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.141345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af7a59-394f-4463-b8e2-b10e97437356 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.141345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af7a59-394f-4463-b8e2-b10e97437356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.146343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af7a59-394f-4463-b8e2-b10e97437356 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.156800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3226b-003b-4f02-9ae9-1b5ebeec6c54 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.170965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ef19-0ac6-4c64-ac66-c3ae435ba758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.173082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ef19-0ac6-4c64-ac66-c3ae435ba758 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.174304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ef19-0ac6-4c64-ac66-c3ae435ba758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.174304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240ef19-0ac6-4c64-ac66-c3ae435ba758 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.180559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240ef19-0ac6-4c64-ac66-c3ae435ba758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.185394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240ef19-0ac6-4c64-ac66-c3ae435ba758 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.209679 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1069/2109] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:45 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:46.209679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af7a59-394f-4463-b8e2-b10e97437356 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.227918 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1041/2110] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:46.229636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ef19-0ac6-4c64-ac66-c3ae435ba758 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.230093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af7a59-394f-4463-b8e2-b10e97437356 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.245353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd5ad9-2de0-455c-a3c7-a3eaaeb8f4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.247050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd5ad9-2de0-455c-a3c7-a3eaaeb8f4fd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.247839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd5ad9-2de0-455c-a3c7-a3eaaeb8f4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.248533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd5ad9-2de0-455c-a3c7-a3eaaeb8f4fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.251200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd5ad9-2de0-455c-a3c7-a3eaaeb8f4fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:46.252172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd5ad9-2de0-455c-a3c7-a3eaaeb8f4fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.256551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd5ad9-2de0-455c-a3c7-a3eaaeb8f4fd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.260440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240ef19-0ac6-4c64-ac66-c3ae435ba758 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.274969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498cb8a-ccd9-4310-be79-052e87f4f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.275358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498cb8a-ccd9-4310-be79-052e87f4f7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.275575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498cb8a-ccd9-4310-be79-052e87f4f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.276037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498cb8a-ccd9-4310-be79-052e87f4f7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.277231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498cb8a-ccd9-4310-be79-052e87f4f7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.286768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498cb8a-ccd9-4310-be79-052e87f4f7b7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.305159 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1070/2111] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:46.308615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd5ad9-2de0-455c-a3c7-a3eaaeb8f4fd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.327539 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1042/2112] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:46.328469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498cb8a-ccd9-4310-be79-052e87f4f7b7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.352559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498cb8a-ccd9-4310-be79-052e87f4f7b7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.354661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd5ad9-2de0-455c-a3c7-a3eaaeb8f4fd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.366253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b4e7f-8aaa-4575-bccd-c107b2702712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.369694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b4e7f-8aaa-4575-bccd-c107b2702712 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.377543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b4e7f-8aaa-4575-bccd-c107b2702712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.378972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b4e7f-8aaa-4575-bccd-c107b2702712 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.379174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d208-e0fb-4953-ada4-1892a1965259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.380192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d208-e0fb-4953-ada4-1892a1965259 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.380687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d208-e0fb-4953-ada4-1892a1965259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.381274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b4e7f-8aaa-4575-bccd-c107b2702712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.384600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d208-e0fb-4953-ada4-1892a1965259 admin admin] PATH_INFO: `/v3/projects/80bbd390d91d46cfbf157267f37b0f5f/users/bf23c930c9b540d2a4e1a0ca947edf4c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.390705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b4e7f-8aaa-4575-bccd-c107b2702712 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.404210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977d208-e0fb-4953-ada4-1892a1965259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80bbd390d91d46cfbf157267f37b0f5f, user_id=bf23c930c9b540d2a4e1a0ca947edf4c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.419615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977d208-e0fb-4953-ada4-1892a1965259 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.454624 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1043/2113] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:46 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:46.459299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b4e7f-8aaa-4575-bccd-c107b2702712 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.465013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-571b4e7f-8aaa-4575-bccd-c107b2702712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:46.467421 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1071/2114] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:46 2022] PUT /identity/v3/projects/80bbd390d91d46cfbf157267f37b0f5f/users/bf23c930c9b540d2a4e1a0ca947edf4c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:46.471328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d208-e0fb-4953-ada4-1892a1965259 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.659074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d208-e0fb-4953-ada4-1892a1965259 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.684461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:46.730096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b4e7f-8aaa-4575-bccd-c107b2702712 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.737296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.738372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.738372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.738372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] PATH_INFO: `/v3/projects/eb3ef413dd78411e8e648fbf448c909b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.739705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3ef413dd78411e8e648fbf448c909b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.743089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.790503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db508a-3c07-4d15-968f-c23a86ae09ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.790994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db508a-3c07-4d15-968f-c23a86ae09ea admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.791279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db508a-3c07-4d15-968f-c23a86ae09ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.791553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db508a-3c07-4d15-968f-c23a86ae09ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.792426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db508a-3c07-4d15-968f-c23a86ae09ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.794142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db508a-3c07-4d15-968f-c23a86ae09ea admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:46.825098 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1072/2115] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:46.825098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db508a-3c07-4d15-968f-c23a86ae09ea admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:46.845114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3ef413dd78411e8e648fbf448c909b', 'request_id': 'req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:46.846599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db508a-3c07-4d15-968f-c23a86ae09ea admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:46.874014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3ef413dd78411e8e648fbf448c909b', 'request_id': 'req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:46.885958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3ef413dd78411e8e648fbf448c909b', 'request_id': 'req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:46.906613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] The token cache is being invalidate because project eb3ef413dd78411e8e648fbf448c909b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:46.907894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:46.910792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d31c5b20-9cc3-4f1d-a4a4-6c05352e8c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:46.912514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:46.922682 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1044/2116] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:46 2022] DELETE /identity/v3/projects/eb3ef413dd78411e8e648fbf448c909b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:46.924523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de57cb-9297-4245-aaf9-54cb7f1fbc19 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.927963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de57cb-9297-4245-aaf9-54cb7f1fbc19 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.933242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de57cb-9297-4245-aaf9-54cb7f1fbc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.992555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-32de57cb-9297-4245-aaf9-54cb7f1fbc19 None None] MFA Rules not processed for user `bf23c930c9b540d2a4e1a0ca947edf4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:46.993744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67395f-bd28-4226-850c-64a421e915e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:46.994569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67395f-bd28-4226-850c-64a421e915e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:46.994849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67395f-bd28-4226-850c-64a421e915e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:46.995122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67395f-bd28-4226-850c-64a421e915e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:46.995853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67395f-bd28-4226-850c-64a421e915e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:46.996249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-32de57cb-9297-4245-aaf9-54cb7f1fbc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:46.997859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67395f-bd28-4226-850c-64a421e915e7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.038327 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1073/2117] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:46 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:47.039170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67395f-bd28-4226-850c-64a421e915e7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.048167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5d67395f-bd28-4226-850c-64a421e915e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:47.096050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67395f-bd28-4226-850c-64a421e915e7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.125035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa5a47-ac33-4e6d-b284-c12d920a51ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.127883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa5a47-ac33-4e6d-b284-c12d920a51ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.128435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa5a47-ac33-4e6d-b284-c12d920a51ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.129407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa5a47-ac33-4e6d-b284-c12d920a51ff admin admin] PATH_INFO: `/v3/projects/44f35a2c3c4045008c2bbbafd22d0027/users/468e1cd6502a4c34b7b4a34b794f64f1/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.137209 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1045/2118] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:47.141507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2efb-5661-4bdf-8d63-90b8c7f3e025 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.142472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2efb-5661-4bdf-8d63-90b8c7f3e025 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.143548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2efb-5661-4bdf-8d63-90b8c7f3e025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.194665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa5a47-ac33-4e6d-b284-c12d920a51ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f35a2c3c4045008c2bbbafd22d0027, user_id=468e1cd6502a4c34b7b4a34b794f64f1, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:47.201030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa5a47-ac33-4e6d-b284-c12d920a51ff admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.215904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-67fb2efb-5661-4bdf-8d63-90b8c7f3e025 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:47.218838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-67fb2efb-5661-4bdf-8d63-90b8c7f3e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:47.233533 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1074/2119] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:47 2022] PUT /identity/v3/projects/44f35a2c3c4045008c2bbbafd22d0027/users/468e1cd6502a4c34b7b4a34b794f64f1/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:47.235288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa5a47-ac33-4e6d-b284-c12d920a51ff admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.251424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b8fa5a47-ac33-4e6d-b284-c12d920a51ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:47.386019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:47.412584 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1046/2120] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:47.413579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2efb-5661-4bdf-8d63-90b8c7f3e025 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.415195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-67fb2efb-5661-4bdf-8d63-90b8c7f3e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:47.444268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa5a47-ac33-4e6d-b284-c12d920a51ff admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.457128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bf426-2856-413d-847e-5ea102450f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.459414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf426-2856-413d-847e-5ea102450f86 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.459914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf426-2856-413d-847e-5ea102450f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.460501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bf426-2856-413d-847e-5ea102450f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.462696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bf426-2856-413d-847e-5ea102450f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:47.466800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bf426-2856-413d-847e-5ea102450f86 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.499840 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1075/2121] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:47.499840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29765dbf-5afd-4009-b807-4af760c3e402 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.499840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29765dbf-5afd-4009-b807-4af760c3e402 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.499840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29765dbf-5afd-4009-b807-4af760c3e402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.554001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-29765dbf-5afd-4009-b807-4af760c3e402 None None] MFA Rules not processed for user `468e1cd6502a4c34b7b4a34b794f64f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:47.555570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-29765dbf-5afd-4009-b807-4af760c3e402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:47.619966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2efb-5661-4bdf-8d63-90b8c7f3e025 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.632806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7447dc-e01e-42b0-9966-51a80d8aa18c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.634286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7447dc-e01e-42b0-9966-51a80d8aa18c service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.634960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7447dc-e01e-42b0-9966-51a80d8aa18c service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.635602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7447dc-e01e-42b0-9966-51a80d8aa18c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.687822 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1076/2122] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:47.689308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b59462-a371-4cb1-aea6-adc2c31e49cf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.689636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b59462-a371-4cb1-aea6-adc2c31e49cf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.689945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b59462-a371-4cb1-aea6-adc2c31e49cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.714563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-17b59462-a371-4cb1-aea6-adc2c31e49cf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:47.715814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-17b59462-a371-4cb1-aea6-adc2c31e49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:47.737916 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1077/2123] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:47.737916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b59462-a371-4cb1-aea6-adc2c31e49cf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.746178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b59462-a371-4cb1-aea6-adc2c31e49cf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.748689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27548ba2-c67b-4d54-bb18-b2a50d3d3bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.748689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27548ba2-c67b-4d54-bb18-b2a50d3d3bbf admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.748689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27548ba2-c67b-4d54-bb18-b2a50d3d3bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.748689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27548ba2-c67b-4d54-bb18-b2a50d3d3bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.749448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27548ba2-c67b-4d54-bb18-b2a50d3d3bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:47.750357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27548ba2-c67b-4d54-bb18-b2a50d3d3bbf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.760676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7447dc-e01e-42b0-9966-51a80d8aa18c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:47.763003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7447dc-e01e-42b0-9966-51a80d8aa18c service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.766448 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1078/2124] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:47.768014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a65a-d09a-4bb4-9296-bbb270042f96 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.768732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a65a-d09a-4bb4-9296-bbb270042f96 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.768945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68a65a-d09a-4bb4-9296-bbb270042f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.777482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:47.779450 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1047/2125] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:47.780066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7447dc-e01e-42b0-9966-51a80d8aa18c service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.795742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7447dc-e01e-42b0-9966-51a80d8aa18c service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:47.801170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f324c52-34a5-4e69-a5c6-c70d1fb75227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:47.801803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324c52-34a5-4e69-a5c6-c70d1fb75227 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:47.802136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324c52-34a5-4e69-a5c6-c70d1fb75227 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:47.802410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f324c52-34a5-4e69-a5c6-c70d1fb75227 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:47.803151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f324c52-34a5-4e69-a5c6-c70d1fb75227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:47.805210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f324c52-34a5-4e69-a5c6-c70d1fb75227 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:47.824482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-db68a65a-d09a-4bb4-9296-bbb270042f96 None None] MFA Rules not processed for user `0b4617ac955e438c979ca0938ee117c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:47.828018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-db68a65a-d09a-4bb4-9296-bbb270042f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:47.859202 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1048/2126] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:47 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:47.861895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f324c52-34a5-4e69-a5c6-c70d1fb75227 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.928457 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1079/2127] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:47.935086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68a65a-d09a-4bb4-9296-bbb270042f96 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:47.948083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68a65a-d09a-4bb4-9296-bbb270042f96 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.034016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f324c52-34a5-4e69-a5c6-c70d1fb75227 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.044736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efa814-eb58-4622-8d55-694b0b1c6792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.047187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efa814-eb58-4622-8d55-694b0b1c6792 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.047187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efa814-eb58-4622-8d55-694b0b1c6792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.047849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efa814-eb58-4622-8d55-694b0b1c6792 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.051097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efa814-eb58-4622-8d55-694b0b1c6792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:48.051545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efa814-eb58-4622-8d55-694b0b1c6792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.055163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efa814-eb58-4622-8d55-694b0b1c6792 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.069637 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1049/2128] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:48.075076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efa814-eb58-4622-8d55-694b0b1c6792 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.080696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:48.087835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efa814-eb58-4622-8d55-694b0b1c6792 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.088393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41a78e-24dd-4482-a75a-613f0b1bf943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.090902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41a78e-24dd-4482-a75a-613f0b1bf943 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.091751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41a78e-24dd-4482-a75a-613f0b1bf943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.092449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41a78e-24dd-4482-a75a-613f0b1bf943 admin admin] PATH_INFO: `/v3/projects/f6ce0645bb594623b0655f1b6803c541/users/344f93e2f51e4f75b1ff45cf1e49336a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.097542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7634c46-e73f-4e08-bccc-d9034957e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.098377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7634c46-e73f-4e08-bccc-d9034957e435 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.098863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7634c46-e73f-4e08-bccc-d9034957e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.099345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7634c46-e73f-4e08-bccc-d9034957e435 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.100704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7634c46-e73f-4e08-bccc-d9034957e435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.105079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7634c46-e73f-4e08-bccc-d9034957e435 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.134480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41a78e-24dd-4482-a75a-613f0b1bf943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ce0645bb594623b0655f1b6803c541, user_id=344f93e2f51e4f75b1ff45cf1e49336a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.142283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41a78e-24dd-4482-a75a-613f0b1bf943 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.154910 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1050/2129] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:48 2022] POST /identity/v3/users => generated 301 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:48.154910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7634c46-e73f-4e08-bccc-d9034957e435 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.156271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d7634c46-e73f-4e08-bccc-d9034957e435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:48.179564 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1080/2130] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:47 2022] PUT /identity/v3/projects/f6ce0645bb594623b0655f1b6803c541/users/344f93e2f51e4f75b1ff45cf1e49336a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:48.179906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7634c46-e73f-4e08-bccc-d9034957e435 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.182342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41a78e-24dd-4482-a75a-613f0b1bf943 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.307417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41a78e-24dd-4482-a75a-613f0b1bf943 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.315270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dfa7f-9e19-459b-b0c4-1a94e71509d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.316527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dfa7f-9e19-459b-b0c4-1a94e71509d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.316763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dfa7f-9e19-459b-b0c4-1a94e71509d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.317225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dfa7f-9e19-459b-b0c4-1a94e71509d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.321452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dfa7f-9e19-459b-b0c4-1a94e71509d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.328938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad6c32-5a14-4cce-b9c4-c787af4abe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.330914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad6c32-5a14-4cce-b9c4-c787af4abe5f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.332056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad6c32-5a14-4cce-b9c4-c787af4abe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.333084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad6c32-5a14-4cce-b9c4-c787af4abe5f admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.336024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82dfa7f-9e19-459b-b0c4-1a94e71509d3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.337647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad6c32-5a14-4cce-b9c4-c787af4abe5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.342967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad6c32-5a14-4cce-b9c4-c787af4abe5f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.409647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:48.419563 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1051/2131] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:48 2022] POST /identity/v3/projects => generated 371 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:48.425643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad6c32-5a14-4cce-b9c4-c787af4abe5f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.438791 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1081/2132] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:48 2022] POST /identity/v3/projects => generated 391 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:48.441692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e567f-903e-4732-8e48-9e750c56c53a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.443141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e567f-903e-4732-8e48-9e750c56c53a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.443865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e567f-903e-4732-8e48-9e750c56c53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.534053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ec4e567f-903e-4732-8e48-9e750c56c53a None None] MFA Rules not processed for user `344f93e2f51e4f75b1ff45cf1e49336a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:48.535352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ec4e567f-903e-4732-8e48-9e750c56c53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:48.612869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad6c32-5a14-4cce-b9c4-c787af4abe5f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.637290 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1082/2133] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:48.638849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e567f-903e-4732-8e48-9e750c56c53a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.755814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329ea2-ae62-4b98-a94a-ca15a7b0bbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.756897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329ea2-ae62-4b98-a94a-ca15a7b0bbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.757700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329ea2-ae62-4b98-a94a-ca15a7b0bbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.760630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329ea2-ae62-4b98-a94a-ca15a7b0bbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.761964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329ea2-ae62-4b98-a94a-ca15a7b0bbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.763072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e567f-903e-4732-8e48-9e750c56c53a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.765246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329ea2-ae62-4b98-a94a-ca15a7b0bbd0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.771423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1383a-019b-4eec-a964-072f92745787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.772580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1383a-019b-4eec-a964-072f92745787 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.772966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1383a-019b-4eec-a964-072f92745787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.773407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1383a-019b-4eec-a964-072f92745787 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.774641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1383a-019b-4eec-a964-072f92745787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.778847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1383a-019b-4eec-a964-072f92745787 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.782948 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1052/2134] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:48.784674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329ea2-ae62-4b98-a94a-ca15a7b0bbd0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.798317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329ea2-ae62-4b98-a94a-ca15a7b0bbd0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.805263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5e70b-4b5f-479d-9608-1b8a1e40a625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.806262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5e70b-4b5f-479d-9608-1b8a1e40a625 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.806641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5e70b-4b5f-479d-9608-1b8a1e40a625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.806982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5e70b-4b5f-479d-9608-1b8a1e40a625 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.807844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5e70b-4b5f-479d-9608-1b8a1e40a625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.810480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5e70b-4b5f-479d-9608-1b8a1e40a625 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.823819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:48.826078 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1083/2135] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:48 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:48.827712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1383a-019b-4eec-a964-072f92745787 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.832624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7af1383a-019b-4eec-a964-072f92745787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:48.849090 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1053/2136] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:48 2022] POST /identity/v3/users => generated 296 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:48.850539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5e70b-4b5f-479d-9608-1b8a1e40a625 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:48.864487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1383a-019b-4eec-a964-072f92745787 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.866501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5e70b-4b5f-479d-9608-1b8a1e40a625 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:48.874045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.875481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.875963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.876428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] PATH_INFO: `/v3/users/16efb85f7d9c4660a3b4175e1fbf96db` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.877529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f88a1-3af0-4ee6-8be1-2fff9d5bfac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:48.878901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16efb85f7d9c4660a3b4175e1fbf96db)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.880118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f88a1-3af0-4ee6-8be1-2fff9d5bfac6 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:48.880758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f88a1-3af0-4ee6-8be1-2fff9d5bfac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:48.881654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f88a1-3af0-4ee6-8be1-2fff9d5bfac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:48.882138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f88a1-3af0-4ee6-8be1-2fff9d5bfac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:48.885173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.886243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f88a1-3af0-4ee6-8be1-2fff9d5bfac6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:48.944384 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1054/2137] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:48 2022] POST /identity/v3/projects => generated 393 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:48.946180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f88a1-3af0-4ee6-8be1-2fff9d5bfac6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.002968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16efb85f7d9c4660a3b4175e1fbf96db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:49.003871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16efb85f7d9c4660a3b4175e1fbf96db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:49.018068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16efb85f7d9c4660a3b4175e1fbf96db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:49.029039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16efb85f7d9c4660a3b4175e1fbf96db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:49.046788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.054341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16efb85f7d9c4660a3b4175e1fbf96db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:49.071596 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1084/2138] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:48 2022] DELETE /identity/v3/users/16efb85f7d9c4660a3b4175e1fbf96db => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:49.073362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.077091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:49.090180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f88a1-3af0-4ee6-8be1-2fff9d5bfac6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.179198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd178ea0-97b8-434d-b1b2-03781c145e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.180342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd178ea0-97b8-434d-b1b2-03781c145e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.180342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd178ea0-97b8-434d-b1b2-03781c145e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.180621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd178ea0-97b8-434d-b1b2-03781c145e37 admin admin] PATH_INFO: `/v3/projects/87ed75d938864fedb97131e31abbff62/users/ed4b67e42b314246bcda005fa20116c4/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.200905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd178ea0-97b8-434d-b1b2-03781c145e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ed75d938864fedb97131e31abbff62, user_id=ed4b67e42b314246bcda005fa20116c4, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.203321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd178ea0-97b8-434d-b1b2-03781c145e37 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.220060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05046654-f761-4148-b392-51ad1b0d2921 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.222359 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1055/2139] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:48 2022] PUT /identity/v3/projects/87ed75d938864fedb97131e31abbff62/users/ed4b67e42b314246bcda005fa20116c4/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:49.223919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd178ea0-97b8-434d-b1b2-03781c145e37 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.225812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cd178ea0-97b8-434d-b1b2-03781c145e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:49.328658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd178ea0-97b8-434d-b1b2-03781c145e37 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.334890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441f3d9-00de-493b-8bb5-9fc1b45570d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.335522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441f3d9-00de-493b-8bb5-9fc1b45570d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.335796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441f3d9-00de-493b-8bb5-9fc1b45570d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.336083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441f3d9-00de-493b-8bb5-9fc1b45570d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.336709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441f3d9-00de-493b-8bb5-9fc1b45570d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.338448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4441f3d9-00de-493b-8bb5-9fc1b45570d9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.344868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.351795 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1056/2140] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:49.353259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441f3d9-00de-493b-8bb5-9fc1b45570d9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.355609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4441f3d9-00de-493b-8bb5-9fc1b45570d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:49.358770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82782def-7342-48f6-bb94-cfbf4c41dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.360450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782def-7342-48f6-bb94-cfbf4c41dc62 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.361252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782def-7342-48f6-bb94-cfbf4c41dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.361860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782def-7342-48f6-bb94-cfbf4c41dc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.362731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82782def-7342-48f6-bb94-cfbf4c41dc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.365988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82782def-7342-48f6-bb94-cfbf4c41dc62 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.372982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4441f3d9-00de-493b-8bb5-9fc1b45570d9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.378804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8555080-00ad-4f8f-b42e-41630c510182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.379431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8555080-00ad-4f8f-b42e-41630c510182 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.380153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8555080-00ad-4f8f-b42e-41630c510182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.380153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8555080-00ad-4f8f-b42e-41630c510182 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.381088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8555080-00ad-4f8f-b42e-41630c510182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.382732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8555080-00ad-4f8f-b42e-41630c510182 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.385267 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1085/2141] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:49.387731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433577c-d453-4953-8ea1-e2a11ceabd73 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.387874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433577c-d453-4953-8ea1-e2a11ceabd73 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.388664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433577c-d453-4953-8ea1-e2a11ceabd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.419880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5433577c-d453-4953-8ea1-e2a11ceabd73 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:49.425163 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1057/2142] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:49 2022] POST /identity/v3/users => generated 303 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:49.425779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5433577c-d453-4953-8ea1-e2a11ceabd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:49.427122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8555080-00ad-4f8f-b42e-41630c510182 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.427122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d8555080-00ad-4f8f-b42e-41630c510182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:49.437987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8555080-00ad-4f8f-b42e-41630c510182 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.439043 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1086/2143] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:49.441805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433577c-d453-4953-8ea1-e2a11ceabd73 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.449834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70eb5d-8eed-4ab6-9323-726bd6279e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.450935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70eb5d-8eed-4ab6-9323-726bd6279e98 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.450935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70eb5d-8eed-4ab6-9323-726bd6279e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.451185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70eb5d-8eed-4ab6-9323-726bd6279e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.451791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70eb5d-8eed-4ab6-9323-726bd6279e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.453709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70eb5d-8eed-4ab6-9323-726bd6279e98 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.463840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433577c-d453-4953-8ea1-e2a11ceabd73 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.469547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c96df-6154-4545-b060-ab3f4ead9275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.470225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c96df-6154-4545-b060-ab3f4ead9275 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.470489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c96df-6154-4545-b060-ab3f4ead9275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.470857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c96df-6154-4545-b060-ab3f4ead9275 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.471610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c96df-6154-4545-b060-ab3f4ead9275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.474157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c96df-6154-4545-b060-ab3f4ead9275 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.477186 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1058/2144] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:49.478656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70eb5d-8eed-4ab6-9323-726bd6279e98 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.495270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70eb5d-8eed-4ab6-9323-726bd6279e98 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.502724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909ad6d-73d8-46c4-a2fb-aac7338ce378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.503555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909ad6d-73d8-46c4-a2fb-aac7338ce378 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.504950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909ad6d-73d8-46c4-a2fb-aac7338ce378 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.505244 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1087/2145] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:49.506096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909ad6d-73d8-46c4-a2fb-aac7338ce378 admin admin] PATH_INFO: `/v3/projects/0965b23050524d06b3fe3d3349f51b80/users/b636296d33514d3b9dc8c03398b7410b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.506923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c96df-6154-4545-b060-ab3f4ead9275 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.529390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c96df-6154-4545-b060-ab3f4ead9275 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.533334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909ad6d-73d8-46c4-a2fb-aac7338ce378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0965b23050524d06b3fe3d3349f51b80, user_id=b636296d33514d3b9dc8c03398b7410b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.536644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909ad6d-73d8-46c4-a2fb-aac7338ce378 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.537856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27270d46-0956-42ba-8e3e-4d699f2b4bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.538975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27270d46-0956-42ba-8e3e-4d699f2b4bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.539458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27270d46-0956-42ba-8e3e-4d699f2b4bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.539944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27270d46-0956-42ba-8e3e-4d699f2b4bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.540966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27270d46-0956-42ba-8e3e-4d699f2b4bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.543468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27270d46-0956-42ba-8e3e-4d699f2b4bc1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.558407 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1059/2146] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:49 2022] PUT /identity/v3/projects/0965b23050524d06b3fe3d3349f51b80/users/b636296d33514d3b9dc8c03398b7410b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:49.559332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909ad6d-73d8-46c4-a2fb-aac7338ce378 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.561250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7909ad6d-73d8-46c4-a2fb-aac7338ce378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:49.567997 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1088/2147] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:49.567997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27270d46-0956-42ba-8e3e-4d699f2b4bc1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.591855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27270d46-0956-42ba-8e3e-4d699f2b4bc1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.670037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909ad6d-73d8-46c4-a2fb-aac7338ce378 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.678280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac78ec-5753-4183-8713-951cf892c233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.678970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac78ec-5753-4183-8713-951cf892c233 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.679433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac78ec-5753-4183-8713-951cf892c233 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.679917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac78ec-5753-4183-8713-951cf892c233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.697561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde75869-f049-4411-a0bc-63734c951aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.698813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde75869-f049-4411-a0bc-63734c951aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.699331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde75869-f049-4411-a0bc-63734c951aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.699768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde75869-f049-4411-a0bc-63734c951aa4 admin admin] PATH_INFO: `/v3/projects/87ed75d938864fedb97131e31abbff62/users/ed4b67e42b314246bcda005fa20116c4/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.703434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde75869-f049-4411-a0bc-63734c951aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ed75d938864fedb97131e31abbff62, user_id=ed4b67e42b314246bcda005fa20116c4, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.708919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde75869-f049-4411-a0bc-63734c951aa4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.727750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.750934 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1089/2148] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:49 2022] PUT /identity/v3/projects/87ed75d938864fedb97131e31abbff62/users/ed4b67e42b314246bcda005fa20116c4/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:49.750934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde75869-f049-4411-a0bc-63734c951aa4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.823186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac78ec-5753-4183-8713-951cf892c233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:49.824704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac78ec-5753-4183-8713-951cf892c233 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:49.839887 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1060/2149] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:49.840831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac78ec-5753-4183-8713-951cf892c233 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:49.860975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac78ec-5753-4183-8713-951cf892c233 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.929097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde75869-f049-4411-a0bc-63734c951aa4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:49.944764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064cbbf-e763-466c-8ef8-cf52e79cdabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:49.946011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064cbbf-e763-466c-8ef8-cf52e79cdabb admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:49.946497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064cbbf-e763-466c-8ef8-cf52e79cdabb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:49.946968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064cbbf-e763-466c-8ef8-cf52e79cdabb admin admin] PATH_INFO: `/v3/projects/b642a546a54f44af8a1af9be3b7e3367/users/fbecd69d82634c898a7d90d64c2b4a92/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:49.996530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064cbbf-e763-466c-8ef8-cf52e79cdabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b642a546a54f44af8a1af9be3b7e3367, user_id=fbecd69d82634c898a7d90d64c2b4a92, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.004798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064cbbf-e763-466c-8ef8-cf52e79cdabb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.041502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:50.060030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68fdccc-30b1-4b30-93b9-0497e6243394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:50.061612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fdccc-30b1-4b30-93b9-0497e6243394 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.062019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fdccc-30b1-4b30-93b9-0497e6243394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.062363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68fdccc-30b1-4b30-93b9-0497e6243394 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.064792 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1090/2150] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:49 2022] PUT /identity/v3/projects/b642a546a54f44af8a1af9be3b7e3367/users/fbecd69d82634c898a7d90d64c2b4a92/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:50.066806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064cbbf-e763-466c-8ef8-cf52e79cdabb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:50.077071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fdccc-30b1-4b30-93b9-0497e6243394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.079357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68fdccc-30b1-4b30-93b9-0497e6243394 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.095942 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1061/2151] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:49 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:50.098511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b82fae-1043-48b8-9c57-6b02a70b1d43 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.098956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b82fae-1043-48b8-9c57-6b02a70b1d43 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.099719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b82fae-1043-48b8-9c57-6b02a70b1d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.180691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-28b82fae-1043-48b8-9c57-6b02a70b1d43 None None] MFA Rules not processed for user `ed4b67e42b314246bcda005fa20116c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:50.183385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-28b82fae-1043-48b8-9c57-6b02a70b1d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:50.285409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064cbbf-e763-466c-8ef8-cf52e79cdabb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:50.301184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112d529-d612-49c6-b03e-44c6dc063fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:50.302672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112d529-d612-49c6-b03e-44c6dc063fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.303235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112d529-d612-49c6-b03e-44c6dc063fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.304156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112d529-d612-49c6-b03e-44c6dc063fbb admin admin] PATH_INFO: `/v3/projects/e3700ad9bb0f48ada482ba8c2dcd70c8/users/a474cdee0fff4b0587ba7205072d6b91/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.342190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112d529-d612-49c6-b03e-44c6dc063fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3700ad9bb0f48ada482ba8c2dcd70c8, user_id=a474cdee0fff4b0587ba7205072d6b91, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.349410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112d529-d612-49c6-b03e-44c6dc063fbb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.381616 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1062/2153] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:50.382819 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1091/2153] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:50 2022] PUT /identity/v3/projects/e3700ad9bb0f48ada482ba8c2dcd70c8/users/a474cdee0fff4b0587ba7205072d6b91/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:50.384373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112d529-d612-49c6-b03e-44c6dc063fbb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:50.402286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886799a5-4364-497c-8957-6813516e526c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.403777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886799a5-4364-497c-8957-6813516e526c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.404424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886799a5-4364-497c-8957-6813516e526c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.504744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112d529-d612-49c6-b03e-44c6dc063fbb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:50.512079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424653c4-e313-4055-ab35-b3dea05cdbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:50.513722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424653c4-e313-4055-ab35-b3dea05cdbd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.515815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424653c4-e313-4055-ab35-b3dea05cdbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.516104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424653c4-e313-4055-ab35-b3dea05cdbd2 admin admin] PATH_INFO: `/v3/projects/0965b23050524d06b3fe3d3349f51b80/users/b636296d33514d3b9dc8c03398b7410b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.518581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-886799a5-4364-497c-8957-6813516e526c None None] MFA Rules not processed for user `fbecd69d82634c898a7d90d64c2b4a92`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:50.522228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-886799a5-4364-497c-8957-6813516e526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:50.525491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424653c4-e313-4055-ab35-b3dea05cdbd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0965b23050524d06b3fe3d3349f51b80, user_id=b636296d33514d3b9dc8c03398b7410b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.532412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424653c4-e313-4055-ab35-b3dea05cdbd2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.553263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:50.567495 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1092/2154] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:50 2022] PUT /identity/v3/projects/0965b23050524d06b3fe3d3349f51b80/users/b636296d33514d3b9dc8c03398b7410b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:50.571664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424653c4-e313-4055-ab35-b3dea05cdbd2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:50.755621 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1063/2155] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:50.757633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667683-fd55-4089-8268-3cd5075a1c78 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.758110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667683-fd55-4089-8268-3cd5075a1c78 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.758525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50667683-fd55-4089-8268-3cd5075a1c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.801027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-50667683-fd55-4089-8268-3cd5075a1c78 None None] MFA Rules not processed for user `468e1cd6502a4c34b7b4a34b794f64f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:50.802332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-50667683-fd55-4089-8268-3cd5075a1c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:50.810314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424653c4-e313-4055-ab35-b3dea05cdbd2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:50.817688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4c16e-2591-4388-9c3a-c05dca0b24a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:50.819035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4c16e-2591-4388-9c3a-c05dca0b24a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.819610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4c16e-2591-4388-9c3a-c05dca0b24a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.819892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4c16e-2591-4388-9c3a-c05dca0b24a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.820900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4c16e-2591-4388-9c3a-c05dca0b24a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.823020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4c16e-2591-4388-9c3a-c05dca0b24a8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.842115 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1093/2156] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:50 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:50.842115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4c16e-2591-4388-9c3a-c05dca0b24a8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:50.850893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4c16e-2591-4388-9c3a-c05dca0b24a8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:50.860018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c18b1-2f15-49f6-a8b6-2f7444d3faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:50.860834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c18b1-2f15-49f6-a8b6-2f7444d3faa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:50.861185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c18b1-2f15-49f6-a8b6-2f7444d3faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:50.861578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c18b1-2f15-49f6-a8b6-2f7444d3faa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:50.863301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c18b1-2f15-49f6-a8b6-2f7444d3faa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:50.865423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c18b1-2f15-49f6-a8b6-2f7444d3faa6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:50.908263 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1094/2157] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:50 2022] POST /identity/v3/projects => generated 393 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:50.910543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c18b1-2f15-49f6-a8b6-2f7444d3faa6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:50.913832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ec9c18b1-2f15-49f6-a8b6-2f7444d3faa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:50.985734 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1064/2158] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:50.989023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50667683-fd55-4089-8268-3cd5075a1c78 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.024602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c18b1-2f15-49f6-a8b6-2f7444d3faa6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.034919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.035784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.036166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.037300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] PATH_INFO: `/v3/projects/eeff500d4e4b4cf9aa60e9755dacb874` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.038824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeff500d4e4b4cf9aa60e9755dacb874)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.039836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50667683-fd55-4089-8268-3cd5075a1c78 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.041062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.060239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c97dd-1a4c-4386-bb82-a9bf6c451487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.061449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c97dd-1a4c-4386-bb82-a9bf6c451487 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.061953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c97dd-1a4c-4386-bb82-a9bf6c451487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.062592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c97dd-1a4c-4386-bb82-a9bf6c451487 admin admin] PATH_INFO: `/v3/projects/e3700ad9bb0f48ada482ba8c2dcd70c8/users/a474cdee0fff4b0587ba7205072d6b91/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.067368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c97dd-1a4c-4386-bb82-a9bf6c451487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3700ad9bb0f48ada482ba8c2dcd70c8, user_id=a474cdee0fff4b0587ba7205072d6b91, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.072994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c97dd-1a4c-4386-bb82-a9bf6c451487 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.108600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:51.126106 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1065/2159] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:50 2022] PUT /identity/v3/projects/e3700ad9bb0f48ada482ba8c2dcd70c8/users/a474cdee0fff4b0587ba7205072d6b91/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:51.137323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c97dd-1a4c-4386-bb82-a9bf6c451487 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.151507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeff500d4e4b4cf9aa60e9755dacb874', 'request_id': 'req-81d2c01a-d583-47cd-ac7c-7939e71369c6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:51.162513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeff500d4e4b4cf9aa60e9755dacb874', 'request_id': 'req-81d2c01a-d583-47cd-ac7c-7939e71369c6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:51.177805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeff500d4e4b4cf9aa60e9755dacb874', 'request_id': 'req-81d2c01a-d583-47cd-ac7c-7939e71369c6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:51.201601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] The token cache is being invalidate because project eeff500d4e4b4cf9aa60e9755dacb874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:51.201601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:51.202406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:51.211165 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1095/2160] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:50 2022] DELETE /identity/v3/projects/eeff500d4e4b4cf9aa60e9755dacb874 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:51.212302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.215475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:51.225434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:51.379040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c97dd-1a4c-4386-bb82-a9bf6c451487 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.401248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2c01a-d583-47cd-ac7c-7939e71369c6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.410214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb3360-7481-43a4-a293-47f53d2bfc23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.411274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3360-7481-43a4-a293-47f53d2bfc23 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.411656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3360-7481-43a4-a293-47f53d2bfc23 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.412026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb3360-7481-43a4-a293-47f53d2bfc23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.414607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1dcb3360-7481-43a4-a293-47f53d2bfc23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:51.537279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a36f7-60dc-4f16-8512-64a072bb28e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.538128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a36f7-60dc-4f16-8512-64a072bb28e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.538276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a36f7-60dc-4f16-8512-64a072bb28e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.538496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a36f7-60dc-4f16-8512-64a072bb28e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.541922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a36f7-60dc-4f16-8512-64a072bb28e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.545925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a36f7-60dc-4f16-8512-64a072bb28e9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.550035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb3360-7481-43a4-a293-47f53d2bfc23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.552149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb3360-7481-43a4-a293-47f53d2bfc23 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.565769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1096/2161] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:51.567324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb96c22-4c7c-4d8c-959b-5fc483d60f7d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.567716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb96c22-4c7c-4d8c-959b-5fc483d60f7d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.568106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb96c22-4c7c-4d8c-959b-5fc483d60f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.609682 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1066/2162] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:51 2022] POST /identity/v3/users => generated 303 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:51.610626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1cb96c22-4c7c-4d8c-959b-5fc483d60f7d None None] MFA Rules not processed for user `a474cdee0fff4b0587ba7205072d6b91`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:51.612146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a36f7-60dc-4f16-8512-64a072bb28e9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.613286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1cb96c22-4c7c-4d8c-959b-5fc483d60f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:51.616402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8e7a36f7-60dc-4f16-8512-64a072bb28e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:51.676064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a36f7-60dc-4f16-8512-64a072bb28e9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.719383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.720340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.725788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.726408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] PATH_INFO: `/v3/users/bf23c930c9b540d2a4e1a0ca947edf4c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.728306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf23c930c9b540d2a4e1a0ca947edf4c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.730642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.740200 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1097/2163] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:51.746848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb96c22-4c7c-4d8c-959b-5fc483d60f7d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.748949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1cb96c22-4c7c-4d8c-959b-5fc483d60f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:51.769302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb96c22-4c7c-4d8c-959b-5fc483d60f7d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.776619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7116a-a731-4853-8bc7-5c4d5fc4bc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.777621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7116a-a731-4853-8bc7-5c4d5fc4bc38 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.778035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7116a-a731-4853-8bc7-5c4d5fc4bc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.778393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7116a-a731-4853-8bc7-5c4d5fc4bc38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.779215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7116a-a731-4853-8bc7-5c4d5fc4bc38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.781464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7116a-a731-4853-8bc7-5c4d5fc4bc38 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.802903 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1098/2164] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:51.809915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7116a-a731-4853-8bc7-5c4d5fc4bc38 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.811384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf23c930c9b540d2a4e1a0ca947edf4c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:51.822436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf23c930c9b540d2a4e1a0ca947edf4c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:51.829748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7116a-a731-4853-8bc7-5c4d5fc4bc38 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:51.840265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51b847-7ecc-40f9-93ae-5ffd81a25a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:51.841449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51b847-7ecc-40f9-93ae-5ffd81a25a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:51.842045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51b847-7ecc-40f9-93ae-5ffd81a25a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:51.842602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51b847-7ecc-40f9-93ae-5ffd81a25a17 admin admin] PATH_INFO: `/v3/projects/7128709e38804f9dbfffb1548a52a3ec/users/c289de3eaaad401aaca399ed47027075/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:51.849111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf23c930c9b540d2a4e1a0ca947edf4c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:51.862713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf23c930c9b540d2a4e1a0ca947edf4c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:51.864121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf23c930c9b540d2a4e1a0ca947edf4c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:51.873140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:51.873767 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1067/2165] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:51 2022] DELETE /identity/v3/users/bf23c930c9b540d2a4e1a0ca947edf4c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:51.879692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51b847-7ecc-40f9-93ae-5ffd81a25a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7128709e38804f9dbfffb1548a52a3ec, user_id=c289de3eaaad401aaca399ed47027075, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:51.885580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51b847-7ecc-40f9-93ae-5ffd81a25a17 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:51.922180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1099/2166] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:51 2022] PUT /identity/v3/projects/7128709e38804f9dbfffb1548a52a3ec/users/c289de3eaaad401aaca399ed47027075/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:51.925314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:51.927329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:51.963797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:52.123126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c896f-27bf-4cff-9007-996400d7c644 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:52.205009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51b847-7ecc-40f9-93ae-5ffd81a25a17 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:52.210901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ea51b847-7ecc-40f9-93ae-5ffd81a25a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:52.297611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa05521-90ae-4876-b2c7-6ddfb4d0320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:52.298901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa05521-90ae-4876-b2c7-6ddfb4d0320d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.299759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa05521-90ae-4876-b2c7-6ddfb4d0320d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.300457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa05521-90ae-4876-b2c7-6ddfb4d0320d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.301568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa05521-90ae-4876-b2c7-6ddfb4d0320d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:52.303436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa05521-90ae-4876-b2c7-6ddfb4d0320d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:52.337412 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1068/2167] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:52.339743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa05521-90ae-4876-b2c7-6ddfb4d0320d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:52.358568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa05521-90ae-4876-b2c7-6ddfb4d0320d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:52.382268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a868e-6ed7-4f3d-bdf1-b22329e76f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:52.383762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a868e-6ed7-4f3d-bdf1-b22329e76f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.385431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a868e-6ed7-4f3d-bdf1-b22329e76f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.387385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a868e-6ed7-4f3d-bdf1-b22329e76f6c admin admin] PATH_INFO: `/v3/projects/7128709e38804f9dbfffb1548a52a3ec/users/c289de3eaaad401aaca399ed47027075/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.391826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a868e-6ed7-4f3d-bdf1-b22329e76f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7128709e38804f9dbfffb1548a52a3ec, user_id=c289de3eaaad401aaca399ed47027075, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:52.412656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a868e-6ed7-4f3d-bdf1-b22329e76f6c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:52.444565 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1069/2168] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:52 2022] PUT /identity/v3/projects/7128709e38804f9dbfffb1548a52a3ec/users/c289de3eaaad401aaca399ed47027075/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:52.455457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a8d10-cf06-4d43-8df1-1472eb195d62 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.456077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a8d10-cf06-4d43-8df1-1472eb195d62 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.457036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a8d10-cf06-4d43-8df1-1472eb195d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.537671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-224a8d10-cf06-4d43-8df1-1472eb195d62 None None] MFA Rules not processed for user `c289de3eaaad401aaca399ed47027075`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:52.539522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-224a8d10-cf06-4d43-8df1-1472eb195d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:52.579649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51b847-7ecc-40f9-93ae-5ffd81a25a17 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:52.695408 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1070/2169] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:52.696362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a8d10-cf06-4d43-8df1-1472eb195d62 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:52.700027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-224a8d10-cf06-4d43-8df1-1472eb195d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:52.738939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63c85e-36a3-46ac-8cff-5be5490462fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:52.739858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63c85e-36a3-46ac-8cff-5be5490462fa service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.740514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63c85e-36a3-46ac-8cff-5be5490462fa service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.742161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63c85e-36a3-46ac-8cff-5be5490462fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.747356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4d63c85e-36a3-46ac-8cff-5be5490462fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:52.768457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:52.908858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a8d10-cf06-4d43-8df1-1472eb195d62 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:52.928165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:52.929276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.929999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.930453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] PATH_INFO: `/v3/projects/80bbd390d91d46cfbf157267f37b0f5f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:52.932896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80bbd390d91d46cfbf157267f37b0f5f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:52.938033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:52.953291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63c85e-36a3-46ac-8cff-5be5490462fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:52.955418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63c85e-36a3-46ac-8cff-5be5490462fa service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:52.981011 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1100/2170] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:52.995570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c8c7-96bb-42d1-a11a-1378eb6ca384 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:52.995860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c8c7-96bb-42d1-a11a-1378eb6ca384 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:52.996135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612c8c7-96bb-42d1-a11a-1378eb6ca384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.077123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6612c8c7-96bb-42d1-a11a-1378eb6ca384 None None] MFA Rules not processed for user `fbecd69d82634c898a7d90d64c2b4a92`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:53.080379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6612c8c7-96bb-42d1-a11a-1378eb6ca384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:53.089270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80bbd390d91d46cfbf157267f37b0f5f', 'request_id': 'req-005b1624-aff4-4946-bdef-a687558e8609'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:53.101361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80bbd390d91d46cfbf157267f37b0f5f', 'request_id': 'req-005b1624-aff4-4946-bdef-a687558e8609'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:53.120864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80bbd390d91d46cfbf157267f37b0f5f', 'request_id': 'req-005b1624-aff4-4946-bdef-a687558e8609'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:53.134838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:53.135983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] The token cache is being invalidate because project 80bbd390d91d46cfbf157267f37b0f5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:53.136280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:53.137721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-005b1624-aff4-4946-bdef-a687558e8609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:53.140379 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1071/2171] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:52 2022] DELETE /identity/v3/projects/80bbd390d91d46cfbf157267f37b0f5f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:53.148277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c404c9-4a8a-43d7-b3bf-7c5bbbab963a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.149042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c404c9-4a8a-43d7-b3bf-7c5bbbab963a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.149600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c404c9-4a8a-43d7-b3bf-7c5bbbab963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.186681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-59c404c9-4a8a-43d7-b3bf-7c5bbbab963a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:53.189294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-59c404c9-4a8a-43d7-b3bf-7c5bbbab963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:53.223209 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1101/2172] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:53.411741 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1072/2173] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:53.420451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038cc75-93b7-4ba4-95e5-b009b682af0e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.420881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038cc75-93b7-4ba4-95e5-b009b682af0e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.421284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038cc75-93b7-4ba4-95e5-b009b682af0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.474701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5038cc75-93b7-4ba4-95e5-b009b682af0e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:53.476881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5038cc75-93b7-4ba4-95e5-b009b682af0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:53.497966 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1102/2174] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:14:53.503778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c404c9-4a8a-43d7-b3bf-7c5bbbab963a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.522417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c404c9-4a8a-43d7-b3bf-7c5bbbab963a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.533155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96759af1-3515-416a-ae62-0877df5f2ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.533935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96759af1-3515-416a-ae62-0877df5f2ebb admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.534219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96759af1-3515-416a-ae62-0877df5f2ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.534491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96759af1-3515-416a-ae62-0877df5f2ebb admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.535219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96759af1-3515-416a-ae62-0877df5f2ebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:14:53.535522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96759af1-3515-416a-ae62-0877df5f2ebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.537249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96759af1-3515-416a-ae62-0877df5f2ebb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:53.561614 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1073/2175] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:14:53.562788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038cc75-93b7-4ba4-95e5-b009b682af0e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.574602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038cc75-93b7-4ba4-95e5-b009b682af0e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.587952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532ec6f-4bd6-4c4a-b64e-610aa114dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.589013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532ec6f-4bd6-4c4a-b64e-610aa114dc4a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.589158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532ec6f-4bd6-4c4a-b64e-610aa114dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.589440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532ec6f-4bd6-4c4a-b64e-610aa114dc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.590346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532ec6f-4bd6-4c4a-b64e-610aa114dc4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.592650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532ec6f-4bd6-4c4a-b64e-610aa114dc4a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:53.677058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96759af1-3515-416a-ae62-0877df5f2ebb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.694908 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1103/2176] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:53 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:14:53.697324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96759af1-3515-416a-ae62-0877df5f2ebb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.801703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:53.828950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708092f7-a055-4206-a7a8-434f2025c846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.829838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708092f7-a055-4206-a7a8-434f2025c846 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.830439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708092f7-a055-4206-a7a8-434f2025c846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.830638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708092f7-a055-4206-a7a8-434f2025c846 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.833918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708092f7-a055-4206-a7a8-434f2025c846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.836256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708092f7-a055-4206-a7a8-434f2025c846 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:53.869196 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1074/2177] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:53 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:53.870596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532ec6f-4bd6-4c4a-b64e-610aa114dc4a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.882214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532ec6f-4bd6-4c4a-b64e-610aa114dc4a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.887585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38490fc2-96c0-4688-acdb-fc69aa1ce373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.888851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38490fc2-96c0-4688-acdb-fc69aa1ce373 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.889270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38490fc2-96c0-4688-acdb-fc69aa1ce373 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.889860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38490fc2-96c0-4688-acdb-fc69aa1ce373 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.890749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38490fc2-96c0-4688-acdb-fc69aa1ce373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.894567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38490fc2-96c0-4688-acdb-fc69aa1ce373 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:53.912435 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1104/2178] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:53.916862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708092f7-a055-4206-a7a8-434f2025c846 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.944806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708092f7-a055-4206-a7a8-434f2025c846 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:53.952396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef01060-6daa-463b-b228-8ecc0cc3aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:53.953507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef01060-6daa-463b-b228-8ecc0cc3aa9c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:53.954758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef01060-6daa-463b-b228-8ecc0cc3aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:53.955065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef01060-6daa-463b-b228-8ecc0cc3aa9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:53.955992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef01060-6daa-463b-b228-8ecc0cc3aa9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:53.959927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef01060-6daa-463b-b228-8ecc0cc3aa9c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:53.977450 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1075/2179] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:14:53.989253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38490fc2-96c0-4688-acdb-fc69aa1ce373 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:53.998238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef01060-6daa-463b-b228-8ecc0cc3aa9c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.000188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ef01060-6daa-463b-b228-8ecc0cc3aa9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:54.003668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38490fc2-96c0-4688-acdb-fc69aa1ce373 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.011783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5ef1c-f3fc-4c67-a25e-a36beab6f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.013358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5ef1c-f3fc-4c67-a25e-a36beab6f94f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.014494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5ef1c-f3fc-4c67-a25e-a36beab6f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.015130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5ef1c-f3fc-4c67-a25e-a36beab6f94f admin admin] PATH_INFO: `/v3/projects/4ffb6cf41bb245dd978e470c113d5dd1/users/104e2125688b4e1aa584716b2b7ae01c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.039577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5ef1c-f3fc-4c67-a25e-a36beab6f94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffb6cf41bb245dd978e470c113d5dd1, user_id=104e2125688b4e1aa584716b2b7ae01c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:54.043010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5ef1c-f3fc-4c67-a25e-a36beab6f94f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:54.083349 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1105/2180] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:53 2022] PUT /identity/v3/projects/4ffb6cf41bb245dd978e470c113d5dd1/users/104e2125688b4e1aa584716b2b7ae01c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:54.098780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a381c4-9b4e-45c5-ad2c-5c7ec0f32cd7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.099070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a381c4-9b4e-45c5-ad2c-5c7ec0f32cd7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.099434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a381c4-9b4e-45c5-ad2c-5c7ec0f32cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.160855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-81a381c4-9b4e-45c5-ad2c-5c7ec0f32cd7 None None] MFA Rules not processed for user `104e2125688b4e1aa584716b2b7ae01c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:54.165106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef01060-6daa-463b-b228-8ecc0cc3aa9c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.166845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-81a381c4-9b4e-45c5-ad2c-5c7ec0f32cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:54.354922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb6d7b-e321-4421-a5ae-f6bcc4ecfe19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.356240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb6d7b-e321-4421-a5ae-f6bcc4ecfe19 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.356951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb6d7b-e321-4421-a5ae-f6bcc4ecfe19 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.357777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb6d7b-e321-4421-a5ae-f6bcc4ecfe19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.371294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-72eb6d7b-e321-4421-a5ae-f6bcc4ecfe19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:54.408589 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1106/2181] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:54 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:54.410388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a381c4-9b4e-45c5-ad2c-5c7ec0f32cd7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.416961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-81a381c4-9b4e-45c5-ad2c-5c7ec0f32cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:54.523203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.530746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb6d7b-e321-4421-a5ae-f6bcc4ecfe19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:54.536257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb6d7b-e321-4421-a5ae-f6bcc4ecfe19 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:54.557902 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1076/2182] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:54.559712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb6d7b-e321-4421-a5ae-f6bcc4ecfe19 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.561097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.588932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a381c4-9b4e-45c5-ad2c-5c7ec0f32cd7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.601413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.602278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.602562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.602821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] PATH_INFO: `/v3/users/344f93e2f51e4f75b1ff45cf1e49336a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.604898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344f93e2f51e4f75b1ff45cf1e49336a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:54.607089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:54.754317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344f93e2f51e4f75b1ff45cf1e49336a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:54.754956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344f93e2f51e4f75b1ff45cf1e49336a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:54.764588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344f93e2f51e4f75b1ff45cf1e49336a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:54.778064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344f93e2f51e4f75b1ff45cf1e49336a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:54.787926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb6d7b-e321-4421-a5ae-f6bcc4ecfe19 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.796148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e8b6a-f211-4ef5-be94-af3d31d07dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.796802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e8b6a-f211-4ef5-be94-af3d31d07dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.797084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e8b6a-f211-4ef5-be94-af3d31d07dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.797357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e8b6a-f211-4ef5-be94-af3d31d07dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.798388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e8b6a-f211-4ef5-be94-af3d31d07dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:54.801455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e8b6a-f211-4ef5-be94-af3d31d07dd4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:54.802628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bdb8280d-306f-4521-9a31-9602c206b8f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344f93e2f51e4f75b1ff45cf1e49336a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:54.817286 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1107/2183] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:54 2022] DELETE /identity/v3/users/344f93e2f51e4f75b1ff45cf1e49336a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:54.819163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546187f-6c83-4650-8f6e-f477eaef713c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.819497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546187f-6c83-4650-8f6e-f477eaef713c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.820383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546187f-6c83-4650-8f6e-f477eaef713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.844840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2546187f-6c83-4650-8f6e-f477eaef713c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:54.846422 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1077/2184] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:14:54 2022] POST /identity/v3/projects => generated 403 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:54.846654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2546187f-6c83-4650-8f6e-f477eaef713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:54.848159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e8b6a-f211-4ef5-be94-af3d31d07dd4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.850209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-721e8b6a-f211-4ef5-be94-af3d31d07dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:54.939392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e8b6a-f211-4ef5-be94-af3d31d07dd4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:54.944600 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1108/2185] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:54.951212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c9e8-d7c8-4182-b4bd-d86a1cf65e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:54.953651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546187f-6c83-4650-8f6e-f477eaef713c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:54.954408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c9e8-d7c8-4182-b4bd-d86a1cf65e3a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:54.954987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c9e8-d7c8-4182-b4bd-d86a1cf65e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:54.955421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48c9e8-d7c8-4182-b4bd-d86a1cf65e3a admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:54.956477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2546187f-6c83-4650-8f6e-f477eaef713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:54.960442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48c9e8-d7c8-4182-b4bd-d86a1cf65e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:54.963740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48c9e8-d7c8-4182-b4bd-d86a1cf65e3a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.019620 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1078/2186] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:14:54 2022] POST /identity/v3/users => generated 308 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:14:55.024826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c9e8-d7c8-4182-b4bd-d86a1cf65e3a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:55.093934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48c9e8-d7c8-4182-b4bd-d86a1cf65e3a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.116231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546187f-6c83-4650-8f6e-f477eaef713c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.124087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944b81-7d2d-4dfc-aa9a-f35345bea4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.125587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944b81-7d2d-4dfc-aa9a-f35345bea4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.127853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944b81-7d2d-4dfc-aa9a-f35345bea4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.128527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48944b81-7d2d-4dfc-aa9a-f35345bea4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.140772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f896cb-3d25-4d96-9dcd-5b0bcd8d481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.141695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f896cb-3d25-4d96-9dcd-5b0bcd8d481d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.142251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f896cb-3d25-4d96-9dcd-5b0bcd8d481d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.143089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f896cb-3d25-4d96-9dcd-5b0bcd8d481d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.144991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f896cb-3d25-4d96-9dcd-5b0bcd8d481d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.152225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48944b81-7d2d-4dfc-aa9a-f35345bea4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.152478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f896cb-3d25-4d96-9dcd-5b0bcd8d481d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.154446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48944b81-7d2d-4dfc-aa9a-f35345bea4f6 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.183901 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1109/2187] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:55.195227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944b81-7d2d-4dfc-aa9a-f35345bea4f6 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:55.196546 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1079/2188] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:55.210700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48944b81-7d2d-4dfc-aa9a-f35345bea4f6 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.219550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e73b9-9493-4ec3-8e12-bf5270570739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.220469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e73b9-9493-4ec3-8e12-bf5270570739 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.220848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e73b9-9493-4ec3-8e12-bf5270570739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.222219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e73b9-9493-4ec3-8e12-bf5270570739 admin admin] PATH_INFO: `/v3/projects/1a8bbafaf3a046e9b459bee936d94e3f/users/ccf004de298e492192daafec7a82b612/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.247261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:55.252414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e73b9-9493-4ec3-8e12-bf5270570739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8bbafaf3a046e9b459bee936d94e3f, user_id=ccf004de298e492192daafec7a82b612, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.257726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e73b9-9493-4ec3-8e12-bf5270570739 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.298561 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1110/2189] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:55 2022] PUT /identity/v3/projects/1a8bbafaf3a046e9b459bee936d94e3f/users/ccf004de298e492192daafec7a82b612/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:55.304769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f896cb-3d25-4d96-9dcd-5b0bcd8d481d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:55.324302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f896cb-3d25-4d96-9dcd-5b0bcd8d481d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.498974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd65410-c515-4495-a4a0-386f2c80522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.504510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65410-c515-4495-a4a0-386f2c80522e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.504851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65410-c515-4495-a4a0-386f2c80522e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.505090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd65410-c515-4495-a4a0-386f2c80522e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.507280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd65410-c515-4495-a4a0-386f2c80522e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.513831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd65410-c515-4495-a4a0-386f2c80522e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.519266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:55.563505 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1080/2190] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:14:55.568857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e73b9-9493-4ec3-8e12-bf5270570739 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:55.591303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e73b9-9493-4ec3-8e12-bf5270570739 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:55.603962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38e454-51cb-4cab-b93c-8382fa9534ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:55.609602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38e454-51cb-4cab-b93c-8382fa9534ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.610704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38e454-51cb-4cab-b93c-8382fa9534ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.614043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38e454-51cb-4cab-b93c-8382fa9534ea admin admin] PATH_INFO: `/v3/projects/1a8bbafaf3a046e9b459bee936d94e3f/users/ccf004de298e492192daafec7a82b612/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.624728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38e454-51cb-4cab-b93c-8382fa9534ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8bbafaf3a046e9b459bee936d94e3f, user_id=ccf004de298e492192daafec7a82b612, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:55.656531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38e454-51cb-4cab-b93c-8382fa9534ea admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:55.688789 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1111/2191] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:14:55 2022] PUT /identity/v3/projects/1a8bbafaf3a046e9b459bee936d94e3f/users/ccf004de298e492192daafec7a82b612/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:55.702355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66fc3-5ae2-4a23-97b7-72426c410da5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:55.702975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66fc3-5ae2-4a23-97b7-72426c410da5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:55.703533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d66fc3-5ae2-4a23-97b7-72426c410da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:55.810932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-08d66fc3-5ae2-4a23-97b7-72426c410da5 None None] MFA Rules not processed for user `ccf004de298e492192daafec7a82b612`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:55.818309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-08d66fc3-5ae2-4a23-97b7-72426c410da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:56.042389 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1081/2192] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:55 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:56.288986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38e454-51cb-4cab-b93c-8382fa9534ea admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:56.291378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9f38e454-51cb-4cab-b93c-8382fa9534ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:56.397732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38e454-51cb-4cab-b93c-8382fa9534ea admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:56.408250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25534958-0d0d-4adb-b7eb-6831000dd882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:56.409055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25534958-0d0d-4adb-b7eb-6831000dd882 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:56.409841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25534958-0d0d-4adb-b7eb-6831000dd882 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:56.410310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25534958-0d0d-4adb-b7eb-6831000dd882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:56.422249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25534958-0d0d-4adb-b7eb-6831000dd882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:56.424935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25534958-0d0d-4adb-b7eb-6831000dd882 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:56.445314 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1112/2193] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:56 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:14:57.122981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d66fc3-5ae2-4a23-97b7-72426c410da5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:57.124698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-08d66fc3-5ae2-4a23-97b7-72426c410da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:57.364338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d66fc3-5ae2-4a23-97b7-72426c410da5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:57.376556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:57.378268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:57.378967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:57.379767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] PATH_INFO: `/v3/projects/f6ce0645bb594623b0655f1b6803c541` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:57.382428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ce0645bb594623b0655f1b6803c541)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:57.386548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:57.534598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ce0645bb594623b0655f1b6803c541', 'request_id': 'req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:57.578129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ce0645bb594623b0655f1b6803c541', 'request_id': 'req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:57.638974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ce0645bb594623b0655f1b6803c541', 'request_id': 'req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:57.728547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] The token cache is being invalidate because project f6ce0645bb594623b0655f1b6803c541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:14:57.729197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:57.734771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:57.743280 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1082/2194] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:57 2022] DELETE /identity/v3/projects/f6ce0645bb594623b0655f1b6803c541 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:57.748759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25534958-0d0d-4adb-b7eb-6831000dd882 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:57.770941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25534958-0d0d-4adb-b7eb-6831000dd882 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:57.981410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:57.982626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:57.983135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:57.983620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] PATH_INFO: `/v3/users/a474cdee0fff4b0587ba7205072d6b91` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:57.986372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a474cdee0fff4b0587ba7205072d6b91)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:57.990119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:58.146615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a474cdee0fff4b0587ba7205072d6b91'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:58.147953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a474cdee0fff4b0587ba7205072d6b91'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:58.161030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a474cdee0fff4b0587ba7205072d6b91'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:58.177184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a474cdee0fff4b0587ba7205072d6b91'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:58.182061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:58.213922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a474cdee0fff4b0587ba7205072d6b91'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:58.244858 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1113/2195] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:57 2022] DELETE /identity/v3/users/a474cdee0fff4b0587ba7205072d6b91 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:14:58.940148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:58.946343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:58.983617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:59.119644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7ea36-2d7b-4bdc-be39-b91fa2b09717 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:59.275787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51db7e-a7f3-4af8-a161-2039990c6a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:59.277576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51db7e-a7f3-4af8-a161-2039990c6a5b service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:59.278064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51db7e-a7f3-4af8-a161-2039990c6a5b service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:59.278492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51db7e-a7f3-4af8-a161-2039990c6a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:59.282480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bc51db7e-a7f3-4af8-a161-2039990c6a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:59.378803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51db7e-a7f3-4af8-a161-2039990c6a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:59.381585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51db7e-a7f3-4af8-a161-2039990c6a5b service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:59.392678 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1083/2196] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:14:58 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:14:59.415802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:59.421081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:59.509636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a617a36-334a-443c-8086-3fee6bab3c25 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:14:59.521445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:14:59.522511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:59.522869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:59.523232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] PATH_INFO: `/v3/users/104e2125688b4e1aa584716b2b7ae01c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:59.526627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=104e2125688b4e1aa584716b2b7ae01c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:14:59.528814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:14:59.635688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104e2125688b4e1aa584716b2b7ae01c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:59.635688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104e2125688b4e1aa584716b2b7ae01c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:59.659603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104e2125688b4e1aa584716b2b7ae01c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:59.679223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104e2125688b4e1aa584716b2b7ae01c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:59.737474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104e2125688b4e1aa584716b2b7ae01c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:14:59.761106 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1114/2197] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:14:59 2022] DELETE /identity/v3/users/104e2125688b4e1aa584716b2b7ae01c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:14:59.763858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410f97a-917a-4ff0-a074-2f52b20e9546 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:14:59.764336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410f97a-917a-4ff0-a074-2f52b20e9546 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:14:59.764822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410f97a-917a-4ff0-a074-2f52b20e9546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:14:59.828266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b410f97a-917a-4ff0-a074-2f52b20e9546 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:14:59.829605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b410f97a-917a-4ff0-a074-2f52b20e9546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:14:59.942944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:59.977754 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1084/2198] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:14:59.984367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:14:59.987045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:00.006857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410f97a-917a-4ff0-a074-2f52b20e9546 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.009465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b410f97a-917a-4ff0-a074-2f52b20e9546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:00.073201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb9d7-aa3b-49d9-9dfc-e467e5b31c6f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.095740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.096631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.096913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.097185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] PATH_INFO: `/v3/projects/e3700ad9bb0f48ada482ba8c2dcd70c8` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.098765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3700ad9bb0f48ada482ba8c2dcd70c8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.100737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.191516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3700ad9bb0f48ada482ba8c2dcd70c8', 'request_id': 'req-b551eee5-cf3c-4fbd-887c-01a21a624610'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:00.200756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3700ad9bb0f48ada482ba8c2dcd70c8', 'request_id': 'req-b551eee5-cf3c-4fbd-887c-01a21a624610'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:00.204677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:00.215276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3700ad9bb0f48ada482ba8c2dcd70c8', 'request_id': 'req-b551eee5-cf3c-4fbd-887c-01a21a624610'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:00.215524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410f97a-917a-4ff0-a074-2f52b20e9546 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.233771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] The token cache is being invalidate because project e3700ad9bb0f48ada482ba8c2dcd70c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:15:00.234402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:00.235364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b551eee5-cf3c-4fbd-887c-01a21a624610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:00.237812 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1115/2199] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:14:59 2022] DELETE /identity/v3/projects/e3700ad9bb0f48ada482ba8c2dcd70c8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:00.243651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0623e1a-fdbe-4aca-ab47-9b2213d4614d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.244458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0623e1a-fdbe-4aca-ab47-9b2213d4614d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.244973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0623e1a-fdbe-4aca-ab47-9b2213d4614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.279712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c0623e1a-fdbe-4aca-ab47-9b2213d4614d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:00.281328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c0623e1a-fdbe-4aca-ab47-9b2213d4614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:00.351143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86c7e5-611f-4719-b8f5-af6d26c7f16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.352587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86c7e5-611f-4719-b8f5-af6d26c7f16b service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.353069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86c7e5-611f-4719-b8f5-af6d26c7f16b service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.353541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86c7e5-611f-4719-b8f5-af6d26c7f16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.359640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5c86c7e5-611f-4719-b8f5-af6d26c7f16b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:00.381611 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1116/2200] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:00.383742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af731048-6978-4773-acf7-060b88d2a307 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.384320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af731048-6978-4773-acf7-060b88d2a307 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.384797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af731048-6978-4773-acf7-060b88d2a307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.404023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86c7e5-611f-4719-b8f5-af6d26c7f16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.407461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86c7e5-611f-4719-b8f5-af6d26c7f16b service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.419077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-af731048-6978-4773-acf7-060b88d2a307 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:00.420467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-af731048-6978-4773-acf7-060b88d2a307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:00.435911 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1085/2201] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:15:00.437406 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1117/2202] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:00.445800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86c7e5-611f-4719-b8f5-af6d26c7f16b service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.464403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86c7e5-611f-4719-b8f5-af6d26c7f16b service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.474957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2fd7-9e98-437c-b441-7c70ce2eff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.476390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2fd7-9e98-437c-b441-7c70ce2eff8f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.477082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2fd7-9e98-437c-b441-7c70ce2eff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.477766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2fd7-9e98-437c-b441-7c70ce2eff8f admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.480074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2fd7-9e98-437c-b441-7c70ce2eff8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:00.483434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2fd7-9e98-437c-b441-7c70ce2eff8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.489780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2fd7-9e98-437c-b441-7c70ce2eff8f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.563921 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1086/2203] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:00.568866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af731048-6978-4773-acf7-060b88d2a307 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.581442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af731048-6978-4773-acf7-060b88d2a307 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.604054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec0aad-3698-4cfd-bafa-7a9c20603d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.605340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec0aad-3698-4cfd-bafa-7a9c20603d54 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.606059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec0aad-3698-4cfd-bafa-7a9c20603d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.607573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec0aad-3698-4cfd-bafa-7a9c20603d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.609220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec0aad-3698-4cfd-bafa-7a9c20603d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.614868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec0aad-3698-4cfd-bafa-7a9c20603d54 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.711043 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1118/2204] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:15:00 2022] POST /identity/v3/projects => generated 405 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:15:00.716033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2fd7-9e98-437c-b441-7c70ce2eff8f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.747091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2fd7-9e98-437c-b441-7c70ce2eff8f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.864796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b607f7-125f-4994-a614-f7388a8dc609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.866213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b607f7-125f-4994-a614-f7388a8dc609 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.866490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b607f7-125f-4994-a614-f7388a8dc609 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.866949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b607f7-125f-4994-a614-f7388a8dc609 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.868030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b607f7-125f-4994-a614-f7388a8dc609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.873802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b607f7-125f-4994-a614-f7388a8dc609 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:00.934734 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1087/2205] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:00 2022] POST /identity/v3/users => generated 303 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:00.939891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec0aad-3698-4cfd-bafa-7a9c20603d54 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:00.959255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec0aad-3698-4cfd-bafa-7a9c20603d54 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:00.972731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966904-ce1c-481f-84b0-ce3c3dc05a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:00.973975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966904-ce1c-481f-84b0-ce3c3dc05a86 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:00.974297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966904-ce1c-481f-84b0-ce3c3dc05a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:00.974660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10966904-ce1c-481f-84b0-ce3c3dc05a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:00.976331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10966904-ce1c-481f-84b0-ce3c3dc05a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:00.978437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10966904-ce1c-481f-84b0-ce3c3dc05a86 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.000816 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1119/2206] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:01.001737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b607f7-125f-4994-a614-f7388a8dc609 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.016754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b607f7-125f-4994-a614-f7388a8dc609 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.023087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0240a3-4c21-4df4-9e74-1643f2308e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.023732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0240a3-4c21-4df4-9e74-1643f2308e0a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.024014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0240a3-4c21-4df4-9e74-1643f2308e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.024287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0240a3-4c21-4df4-9e74-1643f2308e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.025028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0240a3-4c21-4df4-9e74-1643f2308e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.026885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0240a3-4c21-4df4-9e74-1643f2308e0a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.052860 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1088/2207] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:01.058462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966904-ce1c-481f-84b0-ce3c3dc05a86 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.081509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10966904-ce1c-481f-84b0-ce3c3dc05a86 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.090982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9575e8d-5a21-439c-aa65-6d14427a02bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.092932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575e8d-5a21-439c-aa65-6d14427a02bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.093529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575e8d-5a21-439c-aa65-6d14427a02bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.094159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9575e8d-5a21-439c-aa65-6d14427a02bb admin admin] PATH_INFO: `/v3/projects/a410d7250e5f4a22bc4f15c833e2c518/users/7d35a310048549c9a9e4cf8118c6962a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.135137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9575e8d-5a21-439c-aa65-6d14427a02bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a410d7250e5f4a22bc4f15c833e2c518, user_id=7d35a310048549c9a9e4cf8118c6962a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.140292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9575e8d-5a21-439c-aa65-6d14427a02bb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.176620 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1120/2208] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:01 2022] PUT /identity/v3/projects/a410d7250e5f4a22bc4f15c833e2c518/users/7d35a310048549c9a9e4cf8118c6962a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:01.183807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f1771-4387-46a3-85af-791368607f7b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.186024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f1771-4387-46a3-85af-791368607f7b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.188644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f1771-4387-46a3-85af-791368607f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.254812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3e3f1771-4387-46a3-85af-791368607f7b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:01.258484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3e3f1771-4387-46a3-85af-791368607f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:01.285811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:01.470224 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1089/2209] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:01.490875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9575e8d-5a21-439c-aa65-6d14427a02bb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.493407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b9575e8d-5a21-439c-aa65-6d14427a02bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:01.568769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f1771-4387-46a3-85af-791368607f7b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.571037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3e3f1771-4387-46a3-85af-791368607f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:01.603974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f1771-4387-46a3-85af-791368607f7b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.624989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.626322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.626775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.627287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] PATH_INFO: `/v3/projects/4ffb6cf41bb245dd978e470c113d5dd1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.629682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffb6cf41bb245dd978e470c113d5dd1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.630836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9575e8d-5a21-439c-aa65-6d14427a02bb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.633456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.641189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f4cb-ed14-41e3-b2ff-d5d9adc72873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.642584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f4cb-ed14-41e3-b2ff-d5d9adc72873 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.643485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f4cb-ed14-41e3-b2ff-d5d9adc72873 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.643976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f4cb-ed14-41e3-b2ff-d5d9adc72873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.664617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1f4cb-ed14-41e3-b2ff-d5d9adc72873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.667735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1f4cb-ed14-41e3-b2ff-d5d9adc72873 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:01.687547 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1121/2210] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:01.750168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffb6cf41bb245dd978e470c113d5dd1', 'request_id': 'req-f89aaa15-e1c5-46c9-946f-30feffea967a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:01.763540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffb6cf41bb245dd978e470c113d5dd1', 'request_id': 'req-f89aaa15-e1c5-46c9-946f-30feffea967a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:01.776220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffb6cf41bb245dd978e470c113d5dd1', 'request_id': 'req-f89aaa15-e1c5-46c9-946f-30feffea967a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:01.800065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] The token cache is being invalidate because project 4ffb6cf41bb245dd978e470c113d5dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:15:01.800812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:01.802118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:01.808056 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1090/2211] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:15:01 2022] DELETE /identity/v3/projects/4ffb6cf41bb245dd978e470c113d5dd1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:15:01.810764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f4cb-ed14-41e3-b2ff-d5d9adc72873 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:01.830559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f4cb-ed14-41e3-b2ff-d5d9adc72873 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:01.870644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:01.963125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:01.965033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:01.965380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:01.965739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] PATH_INFO: `/v3/users/ccf004de298e492192daafec7a82b612` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:01.967948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf004de298e492192daafec7a82b612)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:01.970933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:02.108189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf004de298e492192daafec7a82b612'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:02.110540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf004de298e492192daafec7a82b612'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:02.142013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf004de298e492192daafec7a82b612'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:02.162142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf004de298e492192daafec7a82b612'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:02.202901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e53b7235-2295-4276-b2f3-ee350b9fbd88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf004de298e492192daafec7a82b612'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:02.222862 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1122/2212] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:15:01 2022] DELETE /identity/v3/users/ccf004de298e492192daafec7a82b612 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:03.211614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:03.214568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:03.261284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aaa15-e1c5-46c9-946f-30feffea967a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:03.445916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:03.446597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:03.446871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:03.447142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] PATH_INFO: `/v3/projects/1a8bbafaf3a046e9b459bee936d94e3f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:03.452074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8bbafaf3a046e9b459bee936d94e3f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:03.454145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:03.535975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:03.548373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8bbafaf3a046e9b459bee936d94e3f', 'request_id': 'req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:03.567545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8bbafaf3a046e9b459bee936d94e3f', 'request_id': 'req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:03.579536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8bbafaf3a046e9b459bee936d94e3f', 'request_id': 'req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:03.614067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] The token cache is being invalidate because project 1a8bbafaf3a046e9b459bee936d94e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:15:03.614348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:03.615642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b29cfde6-bdc6-44dc-8df4-50805c4eaaa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:03.624553 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1091/2213] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:15:03 2022] DELETE /identity/v3/projects/1a8bbafaf3a046e9b459bee936d94e3f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:03.628147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc327-4183-43bb-b2ff-892c79b65eb1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:03.630060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc327-4183-43bb-b2ff-892c79b65eb1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:03.630674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfc327-4183-43bb-b2ff-892c79b65eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:03.700701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f6dfc327-4183-43bb-b2ff-892c79b65eb1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:03.703915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f6dfc327-4183-43bb-b2ff-892c79b65eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:03.888937 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1123/2214] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:03.899930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3073f5-41b0-45de-ac85-fc5968e1469a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:03.900311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3073f5-41b0-45de-ac85-fc5968e1469a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:03.900627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3073f5-41b0-45de-ac85-fc5968e1469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:03.942562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ca3073f5-41b0-45de-ac85-fc5968e1469a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:03.944753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ca3073f5-41b0-45de-ac85-fc5968e1469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:03.959337 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1092/2215] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:15:03.966026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfc327-4183-43bb-b2ff-892c79b65eb1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:03.982196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfc327-4183-43bb-b2ff-892c79b65eb1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:03.989050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aa688-ed42-470b-937f-1b8a656e9f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:03.990458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aa688-ed42-470b-937f-1b8a656e9f1e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:03.991797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aa688-ed42-470b-937f-1b8a656e9f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:03.992233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182aa688-ed42-470b-937f-1b8a656e9f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:03.993174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182aa688-ed42-470b-937f-1b8a656e9f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:03.993649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182aa688-ed42-470b-937f-1b8a656e9f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:03.995997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182aa688-ed42-470b-937f-1b8a656e9f1e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.025796 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1124/2216] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:04.028289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3073f5-41b0-45de-ac85-fc5968e1469a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:04.058078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3073f5-41b0-45de-ac85-fc5968e1469a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.079411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799deaf-60ae-4e91-811a-1d317ab8015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.081395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799deaf-60ae-4e91-811a-1d317ab8015d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.082446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799deaf-60ae-4e91-811a-1d317ab8015d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.083210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799deaf-60ae-4e91-811a-1d317ab8015d admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.086410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799deaf-60ae-4e91-811a-1d317ab8015d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.092625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799deaf-60ae-4e91-811a-1d317ab8015d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.193068 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1093/2217] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:15:04 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:04.210071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aa688-ed42-470b-937f-1b8a656e9f1e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:04.246523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182aa688-ed42-470b-937f-1b8a656e9f1e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.379017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:04.547600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87646b-253f-41ff-b4e5-c2a1508e4e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.548853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87646b-253f-41ff-b4e5-c2a1508e4e36 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.549480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87646b-253f-41ff-b4e5-c2a1508e4e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.550392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87646b-253f-41ff-b4e5-c2a1508e4e36 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.551709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87646b-253f-41ff-b4e5-c2a1508e4e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.557209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87646b-253f-41ff-b4e5-c2a1508e4e36 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.600208 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1125/2218] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:04 2022] POST /identity/v3/users => generated 287 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:04.606270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799deaf-60ae-4e91-811a-1d317ab8015d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:04.620022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799deaf-60ae-4e91-811a-1d317ab8015d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.626332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3402241-c94b-453d-a655-872998716b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.627467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3402241-c94b-453d-a655-872998716b8b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.628059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3402241-c94b-453d-a655-872998716b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.628727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3402241-c94b-453d-a655-872998716b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.629793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3402241-c94b-453d-a655-872998716b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.632532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3402241-c94b-453d-a655-872998716b8b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.654617 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1094/2219] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:15:04.662707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87646b-253f-41ff-b4e5-c2a1508e4e36 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:04.688893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87646b-253f-41ff-b4e5-c2a1508e4e36 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.699544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd427d-9382-4bc7-aaf0-6eeab4d2c369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.700663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd427d-9382-4bc7-aaf0-6eeab4d2c369 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.701465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd427d-9382-4bc7-aaf0-6eeab4d2c369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.703125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd427d-9382-4bc7-aaf0-6eeab4d2c369 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.705211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd427d-9382-4bc7-aaf0-6eeab4d2c369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.708794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd427d-9382-4bc7-aaf0-6eeab4d2c369 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.740491 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1126/2220] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:04.747369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3402241-c94b-453d-a655-872998716b8b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:04.772352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3402241-c94b-453d-a655-872998716b8b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:04.784484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac5427-34ef-46c2-9687-28933666db98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:04.787692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5427-34ef-46c2-9687-28933666db98 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.787692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5427-34ef-46c2-9687-28933666db98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.788043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac5427-34ef-46c2-9687-28933666db98 admin admin] PATH_INFO: `/v3/projects/75957496d08548f0b483ea06bc03dbcb/users/3b2fb19322bd4f96a847c34ec1fe43d7/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.834653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac5427-34ef-46c2-9687-28933666db98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75957496d08548f0b483ea06bc03dbcb, user_id=3b2fb19322bd4f96a847c34ec1fe43d7, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:04.841195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac5427-34ef-46c2-9687-28933666db98 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:04.879591 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1095/2221] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:04 2022] PUT /identity/v3/projects/75957496d08548f0b483ea06bc03dbcb/users/3b2fb19322bd4f96a847c34ec1fe43d7/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:04.899022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658f65-9d79-41b4-ab0e-12862b8c22e2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:04.899524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658f65-9d79-41b4-ab0e-12862b8c22e2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:04.899919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5658f65-9d79-41b4-ab0e-12862b8c22e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:04.956530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c5658f65-9d79-41b4-ab0e-12862b8c22e2 None None] MFA Rules not processed for user `3b2fb19322bd4f96a847c34ec1fe43d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:04.958645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c5658f65-9d79-41b4-ab0e-12862b8c22e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:05.121122 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1127/2222] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:05.557562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac5427-34ef-46c2-9687-28933666db98 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:05.574257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-78ac5427-34ef-46c2-9687-28933666db98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:05.946858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac5427-34ef-46c2-9687-28933666db98 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:05.978750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64aa428-5527-447c-bb49-25eb536c1086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:05.980662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aa428-5527-447c-bb49-25eb536c1086 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:05.981417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aa428-5527-447c-bb49-25eb536c1086 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:05.982050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64aa428-5527-447c-bb49-25eb536c1086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:06.033154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64aa428-5527-447c-bb49-25eb536c1086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:06.037051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64aa428-5527-447c-bb49-25eb536c1086 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:06.096936 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1096/2223] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:06.971212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb275064-0960-46fc-aeb4-a4abbb990b79 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:06.972768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb275064-0960-46fc-aeb4-a4abbb990b79 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:06.973546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb275064-0960-46fc-aeb4-a4abbb990b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.040291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fb275064-0960-46fc-aeb4-a4abbb990b79 None None] MFA Rules not processed for user `b636296d33514d3b9dc8c03398b7410b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:07.042811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fb275064-0960-46fc-aeb4-a4abbb990b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:07.328566 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1128/2224] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:07.346014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063970f0-fd62-4970-bb23-becddf19d5a2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:07.348353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063970f0-fd62-4970-bb23-becddf19d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:07.349625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063970f0-fd62-4970-bb23-becddf19d5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.413376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-063970f0-fd62-4970-bb23-becddf19d5a2 None None] MFA Rules not processed for user `0b4617ac955e438c979ca0938ee117c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:07.416053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-063970f0-fd62-4970-bb23-becddf19d5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:07.619774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:07.655694 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1097/2225] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:15:07.678042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb275064-0960-46fc-aeb4-a4abbb990b79 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:07.679960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fb275064-0960-46fc-aeb4-a4abbb990b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:07.707057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb275064-0960-46fc-aeb4-a4abbb990b79 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:07.714559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b8ac8-5e73-4f50-a685-c97bdecbe792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:07.715761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b8ac8-5e73-4f50-a685-c97bdecbe792 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:07.715761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b8ac8-5e73-4f50-a685-c97bdecbe792 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:07.715761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b8ac8-5e73-4f50-a685-c97bdecbe792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:07.722113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-972b8ac8-5e73-4f50-a685-c97bdecbe792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:07.769651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b8ac8-5e73-4f50-a685-c97bdecbe792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:07.772740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b8ac8-5e73-4f50-a685-c97bdecbe792 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:07.805600 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1129/2226] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:09.812118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f5dc-19a3-402a-a4eb-865110e8a76a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:09.812724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f5dc-19a3-402a-a4eb-865110e8a76a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:09.814533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0f5dc-19a3-402a-a4eb-865110e8a76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:09.894576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-73f0f5dc-19a3-402a-a4eb-865110e8a76a None None] MFA Rules not processed for user `3845aed02101447aa07fabd6a600498f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:09.898150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-73f0f5dc-19a3-402a-a4eb-865110e8a76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:10.047897 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1098/2227] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:15:13.759552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b8ac8-5e73-4f50-a685-c97bdecbe792 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:13.835221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:14.143447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b8ac8-5e73-4f50-a685-c97bdecbe792 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:14.149689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:14.150636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:14.151445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:14.151948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] PATH_INFO: `/v3/users/3b2fb19322bd4f96a847c34ec1fe43d7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:14.153739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2fb19322bd4f96a847c34ec1fe43d7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:14.156113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:14.270125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2fb19322bd4f96a847c34ec1fe43d7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:14.271458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2fb19322bd4f96a847c34ec1fe43d7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:14.287447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2fb19322bd4f96a847c34ec1fe43d7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:14.303121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2fb19322bd4f96a847c34ec1fe43d7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:14.363305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2fb19322bd4f96a847c34ec1fe43d7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:14.381259 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1130/2228] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:15:13 2022] DELETE /identity/v3/users/3b2fb19322bd4f96a847c34ec1fe43d7 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:14.382256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ee32-2d2c-4af2-bc35-5f91378d7398 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:14.382788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ee32-2d2c-4af2-bc35-5f91378d7398 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:14.382788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ee32-2d2c-4af2-bc35-5f91378d7398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:14.429687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c181ee32-2d2c-4af2-bc35-5f91378d7398 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:14.430970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c181ee32-2d2c-4af2-bc35-5f91378d7398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:14.744741 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1099/2229] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:14.763375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:14.770238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:14.949038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d383b0-5988-4b5f-864c-576cd5f747f0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:14.953376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74574df-e4cd-4f35-a43b-235b70253430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:14.955018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74574df-e4cd-4f35-a43b-235b70253430 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:14.955018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74574df-e4cd-4f35-a43b-235b70253430 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:14.955018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74574df-e4cd-4f35-a43b-235b70253430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:14.977097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74574df-e4cd-4f35-a43b-235b70253430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:14.978644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74574df-e4cd-4f35-a43b-235b70253430 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:15.007144 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1131/2230] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:15.124360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c467ead-baa5-4ba4-9bfd-32ecd3400fcd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:15.124625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c467ead-baa5-4ba4-9bfd-32ecd3400fcd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:15.124907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c467ead-baa5-4ba4-9bfd-32ecd3400fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:15.206090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1c467ead-baa5-4ba4-9bfd-32ecd3400fcd None None] MFA Rules not processed for user `7d35a310048549c9a9e4cf8118c6962a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:15.234027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1c467ead-baa5-4ba4-9bfd-32ecd3400fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:15.462276 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1100/2231] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:15 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:15.470227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74574df-e4cd-4f35-a43b-235b70253430 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:15.472945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d74574df-e4cd-4f35-a43b-235b70253430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:15.515365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74574df-e4cd-4f35-a43b-235b70253430 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:15.549970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c11815-08e6-44c2-ade5-cdb3361c0c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:15.551328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c11815-08e6-44c2-ade5-cdb3361c0c95 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:15.551812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c11815-08e6-44c2-ade5-cdb3361c0c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:15.552284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c11815-08e6-44c2-ade5-cdb3361c0c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:15.553454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c11815-08e6-44c2-ade5-cdb3361c0c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:15.572137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c11815-08e6-44c2-ade5-cdb3361c0c95 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:15.757705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c467ead-baa5-4ba4-9bfd-32ecd3400fcd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:15.759922 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1132/2232] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:15:15 2022] POST /identity/v3/projects => generated 403 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:15.784309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c467ead-baa5-4ba4-9bfd-32ecd3400fcd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:15.880780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:15.988002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380968b3-2182-46e8-aea5-456aaf6b553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:15.988787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380968b3-2182-46e8-aea5-456aaf6b553b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:15.989146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380968b3-2182-46e8-aea5-456aaf6b553b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:15.989422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380968b3-2182-46e8-aea5-456aaf6b553b admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:15.990150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380968b3-2182-46e8-aea5-456aaf6b553b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:15.992784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380968b3-2182-46e8-aea5-456aaf6b553b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:16.052388 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1101/2233] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:15 2022] POST /identity/v3/users => generated 308 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:16.060715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c11815-08e6-44c2-ade5-cdb3361c0c95 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:16.110378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c11815-08e6-44c2-ade5-cdb3361c0c95 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:16.126673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cb3c3-ca2e-405c-b5a4-317da5e67b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:16.128501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cb3c3-ca2e-405c-b5a4-317da5e67b85 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.129177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cb3c3-ca2e-405c-b5a4-317da5e67b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.134725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cb3c3-ca2e-405c-b5a4-317da5e67b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.136643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cb3c3-ca2e-405c-b5a4-317da5e67b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:16.143187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cb3c3-ca2e-405c-b5a4-317da5e67b85 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:16.177051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:16.210227 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1133/2234] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:16.210675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380968b3-2182-46e8-aea5-456aaf6b553b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:16.230921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380968b3-2182-46e8-aea5-456aaf6b553b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:16.245316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424feb7-9f72-4eba-89ae-7b0546c69925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:16.245316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424feb7-9f72-4eba-89ae-7b0546c69925 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.245316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424feb7-9f72-4eba-89ae-7b0546c69925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.245316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424feb7-9f72-4eba-89ae-7b0546c69925 admin admin] PATH_INFO: `/v3/projects/0ab3e52f209e4d3ba268c56faf21a540/users/43cede8112334cf49d77551ec553eeb9/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.283852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424feb7-9f72-4eba-89ae-7b0546c69925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab3e52f209e4d3ba268c56faf21a540, user_id=43cede8112334cf49d77551ec553eeb9, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:16.290715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424feb7-9f72-4eba-89ae-7b0546c69925 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:16.334374 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1102/2235] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:16 2022] PUT /identity/v3/projects/0ab3e52f209e4d3ba268c56faf21a540/users/43cede8112334cf49d77551ec553eeb9/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:16.336186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cb3c3-ca2e-405c-b5a4-317da5e67b85 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:16.363702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cb3c3-ca2e-405c-b5a4-317da5e67b85 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:16.527001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daa386-3c8a-43ff-8397-bd6be81caa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:16.527564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa386-3c8a-43ff-8397-bd6be81caa82 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.528390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa386-3c8a-43ff-8397-bd6be81caa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.528707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daa386-3c8a-43ff-8397-bd6be81caa82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.529542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daa386-3c8a-43ff-8397-bd6be81caa82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:16.538667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daa386-3c8a-43ff-8397-bd6be81caa82 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:16.573650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424feb7-9f72-4eba-89ae-7b0546c69925 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:16.583947 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1134/2236] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:16.621332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424feb7-9f72-4eba-89ae-7b0546c69925 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:16.656159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15235369-b302-479b-9783-c30c207cb24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:16.657484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15235369-b302-479b-9783-c30c207cb24e admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:16.664417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15235369-b302-479b-9783-c30c207cb24e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:16.665236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15235369-b302-479b-9783-c30c207cb24e admin admin] PATH_INFO: `/v3/projects/0ab3e52f209e4d3ba268c56faf21a540/users/43cede8112334cf49d77551ec553eeb9/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:16.669583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15235369-b302-479b-9783-c30c207cb24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab3e52f209e4d3ba268c56faf21a540, user_id=43cede8112334cf49d77551ec553eeb9, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:16.690850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15235369-b302-479b-9783-c30c207cb24e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:16.728422 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1103/2237] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:16 2022] PUT /identity/v3/projects/0ab3e52f209e4d3ba268c56faf21a540/users/43cede8112334cf49d77551ec553eeb9/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:15:18.770473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daa386-3c8a-43ff-8397-bd6be81caa82 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:18.773746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51daa386-3c8a-43ff-8397-bd6be81caa82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:18.813847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daa386-3c8a-43ff-8397-bd6be81caa82 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:19.150509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:19.153184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:19.156998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:19.161208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] PATH_INFO: `/v3/projects/75957496d08548f0b483ea06bc03dbcb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:19.165760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75957496d08548f0b483ea06bc03dbcb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:19.177948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:19.439893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75957496d08548f0b483ea06bc03dbcb', 'request_id': 'req-fbb39045-1c9f-48f0-958a-aefb4740a8f9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:19.468875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75957496d08548f0b483ea06bc03dbcb', 'request_id': 'req-fbb39045-1c9f-48f0-958a-aefb4740a8f9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:19.495638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75957496d08548f0b483ea06bc03dbcb', 'request_id': 'req-fbb39045-1c9f-48f0-958a-aefb4740a8f9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:19.550599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] The token cache is being invalidate because project 75957496d08548f0b483ea06bc03dbcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:15:19.551083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:19.561315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:19.576422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1135/2238] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:15:18 2022] DELETE /identity/v3/projects/75957496d08548f0b483ea06bc03dbcb => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:15:19.584344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db699ac-4bc3-4f4d-af1a-8c2dbda34712 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:19.585772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db699ac-4bc3-4f4d-af1a-8c2dbda34712 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:19.586612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db699ac-4bc3-4f4d-af1a-8c2dbda34712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:19.588661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:19.592892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:19.710231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7db699ac-4bc3-4f4d-af1a-8c2dbda34712 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:19.722010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7db699ac-4bc3-4f4d-af1a-8c2dbda34712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:19.764673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:20.000314 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1104/2239] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:20.006484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb8458-6751-4d56-97aa-e721c81fcbe5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.007717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb8458-6751-4d56-97aa-e721c81fcbe5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.010456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb8458-6751-4d56-97aa-e721c81fcbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.073845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb39045-1c9f-48f0-958a-aefb4740a8f9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.094098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-46eb8458-6751-4d56-97aa-e721c81fcbe5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:20.095695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-46eb8458-6751-4d56-97aa-e721c81fcbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:20.118670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d48d8e-123a-41c3-99e4-15f179a7cf7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:20.120367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d48d8e-123a-41c3-99e4-15f179a7cf7d service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.121050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d48d8e-123a-41c3-99e4-15f179a7cf7d service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.121537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d48d8e-123a-41c3-99e4-15f179a7cf7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.123876 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1105/2240] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:20.132695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b7d48d8e-123a-41c3-99e4-15f179a7cf7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:20.133264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb8458-6751-4d56-97aa-e721c81fcbe5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:20.172523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb8458-6751-4d56-97aa-e721c81fcbe5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.193673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b20aa3-4572-4e8d-8be5-f15912dfd8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:20.194353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b20aa3-4572-4e8d-8be5-f15912dfd8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.194787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b20aa3-4572-4e8d-8be5-f15912dfd8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.195202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b20aa3-4572-4e8d-8be5-f15912dfd8a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.196468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b20aa3-4572-4e8d-8be5-f15912dfd8a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:20.200758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b20aa3-4572-4e8d-8be5-f15912dfd8a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:20.216986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b20aa3-4572-4e8d-8be5-f15912dfd8a5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:20.298809 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1106/2241] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:20.318124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b20aa3-4572-4e8d-8be5-f15912dfd8a5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:20.346485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b20aa3-4572-4e8d-8be5-f15912dfd8a5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.372353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31bada-a82b-402c-bf03-c04b43a347a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:20.373006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31bada-a82b-402c-bf03-c04b43a347a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.373323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31bada-a82b-402c-bf03-c04b43a347a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.373570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31bada-a82b-402c-bf03-c04b43a347a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.375588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31bada-a82b-402c-bf03-c04b43a347a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:20.377772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa31bada-a82b-402c-bf03-c04b43a347a4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:20.409705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d48d8e-123a-41c3-99e4-15f179a7cf7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:20.413380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d48d8e-123a-41c3-99e4-15f179a7cf7d service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:20.446643 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1136/2242] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 859 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:20.452724 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1107/2243] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:15:20 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:20.459270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d48d8e-123a-41c3-99e4-15f179a7cf7d service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:20.534028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d48d8e-123a-41c3-99e4-15f179a7cf7d service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:20.899996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1170-ae5f-42c9-96f3-eba09a31e1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:20.901029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1170-ae5f-42c9-96f3-eba09a31e1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:20.901450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1170-ae5f-42c9-96f3-eba09a31e1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:20.902388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea1170-ae5f-42c9-96f3-eba09a31e1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:20.907476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea1170-ae5f-42c9-96f3-eba09a31e1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:20.912444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea1170-ae5f-42c9-96f3-eba09a31e1f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:21.018459 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1137/2244] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:20 2022] POST /identity/v3/users => generated 289 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:21.023110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31bada-a82b-402c-bf03-c04b43a347a4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:21.039581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31bada-a82b-402c-bf03-c04b43a347a4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:21.064215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdedce4-343e-414c-89dc-a767eb6a009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:21.065026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdedce4-343e-414c-89dc-a767eb6a009f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.065303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdedce4-343e-414c-89dc-a767eb6a009f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.065572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdedce4-343e-414c-89dc-a767eb6a009f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.066354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdedce4-343e-414c-89dc-a767eb6a009f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:21.074897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdedce4-343e-414c-89dc-a767eb6a009f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:21.120366 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1108/2245] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:21.125827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1170-ae5f-42c9-96f3-eba09a31e1f2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:21.168077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea1170-ae5f-42c9-96f3-eba09a31e1f2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:21.217499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d812-a2cb-4c82-92ff-1a3f4e3330bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:21.224981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d812-a2cb-4c82-92ff-1a3f4e3330bc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.233022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d812-a2cb-4c82-92ff-1a3f4e3330bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.234298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9952d812-a2cb-4c82-92ff-1a3f4e3330bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.237315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d812-a2cb-4c82-92ff-1a3f4e3330bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:21.241091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9952d812-a2cb-4c82-92ff-1a3f4e3330bc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:21.310590 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1138/2246] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:21.313950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdedce4-343e-414c-89dc-a767eb6a009f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:21.341820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdedce4-343e-414c-89dc-a767eb6a009f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:21.369277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e6422-c16f-4abf-94b9-d8e2cdad4a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:21.372779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6422-c16f-4abf-94b9-d8e2cdad4a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.374517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6422-c16f-4abf-94b9-d8e2cdad4a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.374905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e6422-c16f-4abf-94b9-d8e2cdad4a06 admin admin] PATH_INFO: `/v3/projects/8e0a0d597e274ccf828af9a1f53d8d88/users/2522d8c9bc70492d8987a363171f1de9/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.435244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d812-a2cb-4c82-92ff-1a3f4e3330bc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:21.438567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9952d812-a2cb-4c82-92ff-1a3f4e3330bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:21.450932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e6422-c16f-4abf-94b9-d8e2cdad4a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0a0d597e274ccf828af9a1f53d8d88, user_id=2522d8c9bc70492d8987a363171f1de9, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:21.458613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e6422-c16f-4abf-94b9-d8e2cdad4a06 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:21.499775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9952d812-a2cb-4c82-92ff-1a3f4e3330bc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:21.517912 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1109/2247] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:21 2022] PUT /identity/v3/projects/8e0a0d597e274ccf828af9a1f53d8d88/users/2522d8c9bc70492d8987a363171f1de9/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:21.519506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4dae8-8066-435b-a918-e7816da45e72 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.519788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4dae8-8066-435b-a918-e7816da45e72 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.520058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4dae8-8066-435b-a918-e7816da45e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.548522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:21.598919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-38d4dae8-8066-435b-a918-e7816da45e72 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:21.600272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-38d4dae8-8066-435b-a918-e7816da45e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:21.725939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:21.812957 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1110/2248] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:21.829756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:21.831155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:21.831930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:21.832616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] PATH_INFO: `/v3/users/bf7c15d8a7d346338027aa00493088c5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:21.839225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7c15d8a7d346338027aa00493088c5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:21.842776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:21.880756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4dae8-8066-435b-a918-e7816da45e72 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:21.883522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-38d4dae8-8066-435b-a918-e7816da45e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:22.032438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7c15d8a7d346338027aa00493088c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:22.033283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7c15d8a7d346338027aa00493088c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:22.045094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7c15d8a7d346338027aa00493088c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:22.059601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7c15d8a7d346338027aa00493088c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:22.082222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c267394-22af-40bd-a337-cef60137a783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7c15d8a7d346338027aa00493088c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:22.098619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1139/2249] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:15:21 2022] DELETE /identity/v3/users/bf7c15d8a7d346338027aa00493088c5 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:22.120524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb6f2-a36f-4191-9f07-392efd19d36b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:22.121268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb6f2-a36f-4191-9f07-392efd19d36b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:22.123315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bb6f2-a36f-4191-9f07-392efd19d36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:22.174742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-566bb6f2-a36f-4191-9f07-392efd19d36b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:22.177614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-566bb6f2-a36f-4191-9f07-392efd19d36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:22.225776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4dae8-8066-435b-a918-e7816da45e72 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:22.279536 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1140/2250] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:22.308053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb6f2-a36f-4191-9f07-392efd19d36b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:22.311335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-566bb6f2-a36f-4191-9f07-392efd19d36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:22.428550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503680aa-40f9-47b6-8427-99a995c08649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:22.429928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503680aa-40f9-47b6-8427-99a995c08649 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:22.430576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503680aa-40f9-47b6-8427-99a995c08649 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:22.431269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503680aa-40f9-47b6-8427-99a995c08649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:22.438619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-503680aa-40f9-47b6-8427-99a995c08649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:22.452107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bb6f2-a36f-4191-9f07-392efd19d36b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:22.456955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc97268-c6e0-4150-8eb2-ea7b3923cd2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:22.458073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97268-c6e0-4150-8eb2-ea7b3923cd2e service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:22.458427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97268-c6e0-4150-8eb2-ea7b3923cd2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:22.458766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc97268-c6e0-4150-8eb2-ea7b3923cd2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:22.489400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc97268-c6e0-4150-8eb2-ea7b3923cd2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:22.491014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503680aa-40f9-47b6-8427-99a995c08649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:22.493031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc97268-c6e0-4150-8eb2-ea7b3923cd2e service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:22.496100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503680aa-40f9-47b6-8427-99a995c08649 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:22.516262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:22.526512 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1141/2251] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:22.564030 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1111/2252] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:23.690423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc97268-c6e0-4150-8eb2-ea7b3923cd2e service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:23.692389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-abc97268-c6e0-4150-8eb2-ea7b3923cd2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:23.718760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc97268-c6e0-4150-8eb2-ea7b3923cd2e service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:23.736693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:23.737463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:23.737761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:23.738111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] PATH_INFO: `/v3/projects/b6931ec1046e457fb1a271bee7a75514` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:23.744620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6931ec1046e457fb1a271bee7a75514)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:23.749314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:23.880985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6931ec1046e457fb1a271bee7a75514', 'request_id': 'req-07c4c561-837a-460c-a5d0-daa229973572'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:23.890144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6931ec1046e457fb1a271bee7a75514', 'request_id': 'req-07c4c561-837a-460c-a5d0-daa229973572'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:23.902612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6931ec1046e457fb1a271bee7a75514', 'request_id': 'req-07c4c561-837a-460c-a5d0-daa229973572'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:23.920596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] The token cache is being invalidate because project b6931ec1046e457fb1a271bee7a75514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:15:23.921120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:23.922075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:23.924253 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1142/2253] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:15:23 2022] DELETE /identity/v3/projects/b6931ec1046e457fb1a271bee7a75514 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:23.930114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503680aa-40f9-47b6-8427-99a995c08649 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:23.956629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503680aa-40f9-47b6-8427-99a995c08649 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:24.142625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:24.143401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:24.143678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:24.143943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] PATH_INFO: `/v3/users/274c219756a64992aadd37a89b12077a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:24.145626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=274c219756a64992aadd37a89b12077a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:24.148276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:24.151450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:24.254809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '274c219756a64992aadd37a89b12077a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:24.295026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '274c219756a64992aadd37a89b12077a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:24.321124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '274c219756a64992aadd37a89b12077a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:24.339774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '274c219756a64992aadd37a89b12077a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:24.341973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-16aaaa28-c807-4fda-bb35-969ca7664637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '274c219756a64992aadd37a89b12077a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:24.373088 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1112/2254] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:15:23 2022] DELETE /identity/v3/users/274c219756a64992aadd37a89b12077a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:26.276741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:26.283031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:26.297758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4c561-837a-460c-a5d0-daa229973572 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:26.387041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:26.387747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:26.388061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:26.388309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] PATH_INFO: `/v3/projects/7cf51cb34f3c455eb8d22864d730231d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:26.390457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf51cb34f3c455eb8d22864d730231d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:26.395309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:26.526214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf51cb34f3c455eb8d22864d730231d', 'request_id': 'req-5257eb53-019f-4a17-a91a-0ff43df03025'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:26.549011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf51cb34f3c455eb8d22864d730231d', 'request_id': 'req-5257eb53-019f-4a17-a91a-0ff43df03025'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:26.571225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf51cb34f3c455eb8d22864d730231d', 'request_id': 'req-5257eb53-019f-4a17-a91a-0ff43df03025'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:26.599259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] The token cache is being invalidate because project 7cf51cb34f3c455eb8d22864d730231d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:15:26.599547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:26.601104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5257eb53-019f-4a17-a91a-0ff43df03025 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:26.603791 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1143/2255] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:15:26 2022] DELETE /identity/v3/projects/7cf51cb34f3c455eb8d22864d730231d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:26.610713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cd78a-10f5-4a7a-89f3-605724af45de None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:26.612345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cd78a-10f5-4a7a-89f3-605724af45de None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:26.613390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cd78a-10f5-4a7a-89f3-605724af45de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:26.660123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4f4cd78a-10f5-4a7a-89f3-605724af45de None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:26.660123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4f4cd78a-10f5-4a7a-89f3-605724af45de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:26.760146 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1113/2256] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:26.770481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a8b3a-3c42-498c-af55-1a06817e2356 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:26.770796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a8b3a-3c42-498c-af55-1a06817e2356 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:26.771076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a8b3a-3c42-498c-af55-1a06817e2356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:26.823177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a0126-065c-4af0-963c-f72f34284b8f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:26.823686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a0126-065c-4af0-963c-f72f34284b8f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:26.824188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a0126-065c-4af0-963c-f72f34284b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:26.843714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4e3a8b3a-3c42-498c-af55-1a06817e2356 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:26.849585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4e3a8b3a-3c42-498c-af55-1a06817e2356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:26.884706 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1144/2257] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:26.887862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a8b3a-3c42-498c-af55-1a06817e2356 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:26.904990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a8b3a-3c42-498c-af55-1a06817e2356 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:26.915522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a39b8-f470-4ab0-bd10-d312e0928e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:26.916550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a39b8-f470-4ab0-bd10-d312e0928e3a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:26.917070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a39b8-f470-4ab0-bd10-d312e0928e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:26.917547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a39b8-f470-4ab0-bd10-d312e0928e3a admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:26.918674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a39b8-f470-4ab0-bd10-d312e0928e3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:26.919217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a39b8-f470-4ab0-bd10-d312e0928e3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:26.922558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a39b8-f470-4ab0-bd10-d312e0928e3a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:26.924623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2d2a0126-065c-4af0-963c-f72f34284b8f None None] MFA Rules not processed for user `885331f5db0b4ad78e75b4653bb89b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:26.927615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:26.938983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2d2a0126-065c-4af0-963c-f72f34284b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:26.970534 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1145/2258] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:26.971876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a39b8-f470-4ab0-bd10-d312e0928e3a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:27.013813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a39b8-f470-4ab0-bd10-d312e0928e3a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:27.026392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f3fd5-3594-47f1-bb6e-d86fa52cd225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:27.027045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f3fd5-3594-47f1-bb6e-d86fa52cd225 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.028193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f3fd5-3594-47f1-bb6e-d86fa52cd225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.028470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f3fd5-3594-47f1-bb6e-d86fa52cd225 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.029147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f3fd5-3594-47f1-bb6e-d86fa52cd225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:27.033211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f3fd5-3594-47f1-bb6e-d86fa52cd225 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:27.055478 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1114/2259] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:15:27.155017 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1146/2260] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:15:26 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:27.158112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a0126-065c-4af0-963c-f72f34284b8f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:27.215894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a0126-065c-4af0-963c-f72f34284b8f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:27.377562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:27.479571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82ac3c-3f39-4e3c-8641-3b7157618898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:27.480588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82ac3c-3f39-4e3c-8641-3b7157618898 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.481049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82ac3c-3f39-4e3c-8641-3b7157618898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.481549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82ac3c-3f39-4e3c-8641-3b7157618898 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.482649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82ac3c-3f39-4e3c-8641-3b7157618898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:27.487198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab82ac3c-3f39-4e3c-8641-3b7157618898 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:27.550723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f3fd5-3594-47f1-bb6e-d86fa52cd225 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:27.553244 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1115/2261] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:27 2022] POST /identity/v3/users => generated 288 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:27.580513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f3fd5-3594-47f1-bb6e-d86fa52cd225 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:27.607549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476acee0-1f20-4941-b263-765b92658f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:27.608613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476acee0-1f20-4941-b263-765b92658f03 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.609135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476acee0-1f20-4941-b263-765b92658f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.609574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476acee0-1f20-4941-b263-765b92658f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.612583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476acee0-1f20-4941-b263-765b92658f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:27.617504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476acee0-1f20-4941-b263-765b92658f03 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:27.648768 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1147/2262] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:27.651552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82ac3c-3f39-4e3c-8641-3b7157618898 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:27.669049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82ac3c-3f39-4e3c-8641-3b7157618898 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:27.687928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc660b59-dd4f-4783-95d1-420bc02de30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:27.688527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc660b59-dd4f-4783-95d1-420bc02de30f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.688815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc660b59-dd4f-4783-95d1-420bc02de30f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.689088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc660b59-dd4f-4783-95d1-420bc02de30f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.689968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc660b59-dd4f-4783-95d1-420bc02de30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:27.692683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc660b59-dd4f-4783-95d1-420bc02de30f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:27.721348 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1116/2263] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:27.727036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476acee0-1f20-4941-b263-765b92658f03 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:27.743823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476acee0-1f20-4941-b263-765b92658f03 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:27.778666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482dbf7-2496-4a8d-995d-79c98be77daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:27.781579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482dbf7-2496-4a8d-995d-79c98be77daf admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.782025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482dbf7-2496-4a8d-995d-79c98be77daf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.782301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482dbf7-2496-4a8d-995d-79c98be77daf admin admin] PATH_INFO: `/v3/projects/1a5014ae6b724898ba704631dffc905e/users/9b0798604dd64d0ebd663b79785dc13a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.832464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482dbf7-2496-4a8d-995d-79c98be77daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a5014ae6b724898ba704631dffc905e, user_id=9b0798604dd64d0ebd663b79785dc13a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:27.847781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482dbf7-2496-4a8d-995d-79c98be77daf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:27.895678 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1148/2264] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:27 2022] PUT /identity/v3/projects/1a5014ae6b724898ba704631dffc905e/users/9b0798604dd64d0ebd663b79785dc13a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:27.899203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb98d5-2a94-4ff8-afae-bb53758adc77 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.900295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb98d5-2a94-4ff8-afae-bb53758adc77 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.900810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb98d5-2a94-4ff8-afae-bb53758adc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:27.953650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5deb98d5-2a94-4ff8-afae-bb53758adc77 None None] MFA Rules not processed for user `9b0798604dd64d0ebd663b79785dc13a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:27.955461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5deb98d5-2a94-4ff8-afae-bb53758adc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:27.970688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9e856-3e7b-498b-8847-b048799a1904 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:27.970688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9e856-3e7b-498b-8847-b048799a1904 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:27.970932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9e856-3e7b-498b-8847-b048799a1904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.070355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b5c9e856-3e7b-498b-8847-b048799a1904 None None] MFA Rules not processed for user `468e1cd6502a4c34b7b4a34b794f64f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:28.071958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b5c9e856-3e7b-498b-8847-b048799a1904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:28.073946 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1117/2265] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:28.074937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb98d5-2a94-4ff8-afae-bb53758adc77 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:28.173947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb98d5-2a94-4ff8-afae-bb53758adc77 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:28.187534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f8936-67ad-434d-894e-21787cd3ef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:28.188938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f8936-67ad-434d-894e-21787cd3ef89 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:28.189238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f8936-67ad-434d-894e-21787cd3ef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:28.189512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f8936-67ad-434d-894e-21787cd3ef89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.191637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f8936-67ad-434d-894e-21787cd3ef89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:28.199547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f8936-67ad-434d-894e-21787cd3ef89 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:28.247367 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1149/2266] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:15:28.279078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9e856-3e7b-498b-8847-b048799a1904 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:28.289243 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1118/2267] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:15:28 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:28.300129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9e856-3e7b-498b-8847-b048799a1904 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:28.438330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c603480-0202-4bdd-bcb9-b4b397be1134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:28.439140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c603480-0202-4bdd-bcb9-b4b397be1134 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:28.439658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c603480-0202-4bdd-bcb9-b4b397be1134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:28.440030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c603480-0202-4bdd-bcb9-b4b397be1134 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.440828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c603480-0202-4bdd-bcb9-b4b397be1134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:28.443736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c603480-0202-4bdd-bcb9-b4b397be1134 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:28.499340 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1150/2268] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:28 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:28.504264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f8936-67ad-434d-894e-21787cd3ef89 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:28.518348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f8936-67ad-434d-894e-21787cd3ef89 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:28.526977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ebca8-b452-4425-a573-1611498dfb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:28.527856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ebca8-b452-4425-a573-1611498dfb9b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:28.528138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ebca8-b452-4425-a573-1611498dfb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:28.528410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ebca8-b452-4425-a573-1611498dfb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.529091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ebca8-b452-4425-a573-1611498dfb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:28.530892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ebca8-b452-4425-a573-1611498dfb9b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:28.548640 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1119/2269] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:28.550362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c603480-0202-4bdd-bcb9-b4b397be1134 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:28.594553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c603480-0202-4bdd-bcb9-b4b397be1134 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:28.618876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc10a6b-ebf5-4957-98e2-71f71bf4431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:28.620137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10a6b-ebf5-4957-98e2-71f71bf4431a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:28.620524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10a6b-ebf5-4957-98e2-71f71bf4431a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:28.620881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc10a6b-ebf5-4957-98e2-71f71bf4431a admin admin] PATH_INFO: `/v3/projects/ae8cb988227d477187897ed3768e88a5/users/e2358de40933489bb9d4356d0d6e9500/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.674982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc10a6b-ebf5-4957-98e2-71f71bf4431a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8cb988227d477187897ed3768e88a5, user_id=e2358de40933489bb9d4356d0d6e9500, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:28.682857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc10a6b-ebf5-4957-98e2-71f71bf4431a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:28.726264 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1151/2270] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:28 2022] PUT /identity/v3/projects/ae8cb988227d477187897ed3768e88a5/users/e2358de40933489bb9d4356d0d6e9500/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:28.732153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ebca8-b452-4425-a573-1611498dfb9b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:28.762784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ebca8-b452-4425-a573-1611498dfb9b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:28.776561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:28.929820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4231ac-ef2d-424c-ad42-01f3c8b3ee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:28.930345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4231ac-ef2d-424c-ad42-01f3c8b3ee92 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:28.930704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4231ac-ef2d-424c-ad42-01f3c8b3ee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:28.931089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4231ac-ef2d-424c-ad42-01f3c8b3ee92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:28.931958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4231ac-ef2d-424c-ad42-01f3c8b3ee92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:28.935345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4231ac-ef2d-424c-ad42-01f3c8b3ee92 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:28.954589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc10a6b-ebf5-4957-98e2-71f71bf4431a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:28.956868 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1120/2271] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:28.988930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc10a6b-ebf5-4957-98e2-71f71bf4431a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:29.002725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565409f-b78e-4444-a3d4-2eb87e10807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:29.003592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565409f-b78e-4444-a3d4-2eb87e10807e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:29.004686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565409f-b78e-4444-a3d4-2eb87e10807e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:29.005095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565409f-b78e-4444-a3d4-2eb87e10807e admin admin] PATH_INFO: `/v3/projects/ae8cb988227d477187897ed3768e88a5/users/e2358de40933489bb9d4356d0d6e9500/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:29.008392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565409f-b78e-4444-a3d4-2eb87e10807e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8cb988227d477187897ed3768e88a5, user_id=e2358de40933489bb9d4356d0d6e9500, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:29.011995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565409f-b78e-4444-a3d4-2eb87e10807e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:29.014968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:29.054623 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1152/2272] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:28 2022] PUT /identity/v3/projects/ae8cb988227d477187897ed3768e88a5/users/e2358de40933489bb9d4356d0d6e9500/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:29.058063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d643969-3c37-45ba-811e-2e30f4f7c43b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:29.058676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d643969-3c37-45ba-811e-2e30f4f7c43b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:29.059279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d643969-3c37-45ba-811e-2e30f4f7c43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:29.129002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8d643969-3c37-45ba-811e-2e30f4f7c43b None None] MFA Rules not processed for user `e2358de40933489bb9d4356d0d6e9500`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:29.131692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8d643969-3c37-45ba-811e-2e30f4f7c43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:29.335605 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1121/2273] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:15:29.342177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565409f-b78e-4444-a3d4-2eb87e10807e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:29.362405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565409f-b78e-4444-a3d4-2eb87e10807e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:29.377086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b816-19cd-4d02-a065-a8154bf17410 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:29.378118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b816-19cd-4d02-a065-a8154bf17410 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:29.378408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b816-19cd-4d02-a065-a8154bf17410 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:29.378688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b816-19cd-4d02-a065-a8154bf17410 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:29.382787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608b816-19cd-4d02-a065-a8154bf17410 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:29.383149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608b816-19cd-4d02-a065-a8154bf17410 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:29.385529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608b816-19cd-4d02-a065-a8154bf17410 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:29.421172 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1153/2274] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:29.426688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d643969-3c37-45ba-811e-2e30f4f7c43b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:29.440327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d643969-3c37-45ba-811e-2e30f4f7c43b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:29.462784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafa93d-6153-4f99-8fe3-43798b6c7eb3 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:29.464406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafa93d-6153-4f99-8fe3-43798b6c7eb3 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:29.465235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafa93d-6153-4f99-8fe3-43798b6c7eb3 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:29.466058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafa93d-6153-4f99-8fe3-43798b6c7eb3 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:29.467680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafa93d-6153-4f99-8fe3-43798b6c7eb3 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:29.480752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafa93d-6153-4f99-8fe3-43798b6c7eb3 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:29.585363 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1122/2275] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:15:29 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:29.589726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b816-19cd-4d02-a065-a8154bf17410 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:29.604056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b816-19cd-4d02-a065-a8154bf17410 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:29.749213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab7237-68b6-4e1b-8a4f-7a959f529979 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:29.750685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab7237-68b6-4e1b-8a4f-7a959f529979 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:29.751636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab7237-68b6-4e1b-8a4f-7a959f529979 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:29.752120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab7237-68b6-4e1b-8a4f-7a959f529979 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:29.753315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab7237-68b6-4e1b-8a4f-7a959f529979 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:29.753987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab7237-68b6-4e1b-8a4f-7a959f529979 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:29.770815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab7237-68b6-4e1b-8a4f-7a959f529979 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:29.830601 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1154/2276] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:31.570074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafa93d-6153-4f99-8fe3-43798b6c7eb3 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:31.573812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5dafa93d-6153-4f99-8fe3-43798b6c7eb3 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:31.985178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafa93d-6153-4f99-8fe3-43798b6c7eb3 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:32.003473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6ffd1-caec-4416-8fb0-6709f8913011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:32.004170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6ffd1-caec-4416-8fb0-6709f8913011 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:32.004512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6ffd1-caec-4416-8fb0-6709f8913011 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:32.004862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6ffd1-caec-4416-8fb0-6709f8913011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:32.031158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:32.059730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6ffd1-caec-4416-8fb0-6709f8913011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:32.073689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6ffd1-caec-4416-8fb0-6709f8913011 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:32.121053 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1123/2277] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:32.206748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa46de8-546a-4829-b17d-cbf903af7d89 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:32.207405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa46de8-546a-4829-b17d-cbf903af7d89 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:32.207757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa46de8-546a-4829-b17d-cbf903af7d89 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:32.210066 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1155/2278] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:32.231884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6ffd1-caec-4416-8fb0-6709f8913011 service nova] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:15:32.304761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6ffd1-caec-4416-8fb0-6709f8913011 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:32.369003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6ffd1-caec-4416-8fb0-6709f8913011 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:32.381631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9609-1fe3-49fb-b61f-f2de663ef41c tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:32.384732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9609-1fe3-49fb-b61f-f2de663ef41c tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:32.385023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9609-1fe3-49fb-b61f-f2de663ef41c tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:32.385358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9609-1fe3-49fb-b61f-f2de663ef41c tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/projects/85419395c5de4aa2b5673dbd5dc14f00` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:32.404934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac9609-1fe3-49fb-b61f-f2de663ef41c tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:get_project(project_id=85419395c5de4aa2b5673dbd5dc14f00)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:32.412717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac9609-1fe3-49fb-b61f-f2de663ef41c tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:32.432742 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1124/2279] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:15:32 2022] GET /identity/v3/projects/85419395c5de4aa2b5673dbd5dc14f00 => generated 369 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:33.746451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea2a64-3768-4020-b5c8-1911426c85cd None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.747897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea2a64-3768-4020-b5c8-1911426c85cd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.748442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea2a64-3768-4020-b5c8-1911426c85cd None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.750230 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1156/2280] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:15:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:15:33.765774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9609-1fe3-49fb-b61f-f2de663ef41c tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:15:33.768677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fcac9609-1fe3-49fb-b61f-f2de663ef41c tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:33.793787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9609-1fe3-49fb-b61f-f2de663ef41c tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:33.830536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9609-1fe3-49fb-b61f-f2de663ef41c tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:33.845615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c862dae-f25a-4c72-8e67-9e81970412c2 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:33.848478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c862dae-f25a-4c72-8e67-9e81970412c2 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:33.848478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c862dae-f25a-4c72-8e67-9e81970412c2 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:33.848478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c862dae-f25a-4c72-8e67-9e81970412c2 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/projects/85419395c5de4aa2b5673dbd5dc14f00` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:33.851729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c862dae-f25a-4c72-8e67-9e81970412c2 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:get_project(project_id=85419395c5de4aa2b5673dbd5dc14f00)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:33.855582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c862dae-f25a-4c72-8e67-9e81970412c2 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:33.863795 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1125/2281] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:15:33 2022] GET /identity/v3/projects/85419395c5de4aa2b5673dbd5dc14f00 => generated 369 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:15:34.069849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea2a64-3768-4020-b5c8-1911426c85cd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:34.071370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c862dae-f25a-4c72-8e67-9e81970412c2 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:34.102203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c862dae-f25a-4c72-8e67-9e81970412c2 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:34.115175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea2a64-3768-4020-b5c8-1911426c85cd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:34.136207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825438de-9805-4994-aee3-770f6c84344f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:34.139084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179926d2-11f1-4d42-8f72-aff13dd86198 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:34.143133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179926d2-11f1-4d42-8f72-aff13dd86198 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.143777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825438de-9805-4994-aee3-770f6c84344f service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.145436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825438de-9805-4994-aee3-770f6c84344f service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.146070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825438de-9805-4994-aee3-770f6c84344f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.146975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179926d2-11f1-4d42-8f72-aff13dd86198 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.148825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179926d2-11f1-4d42-8f72-aff13dd86198 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.150832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179926d2-11f1-4d42-8f72-aff13dd86198 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:34.153433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-825438de-9805-4994-aee3-770f6c84344f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:34.153954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179926d2-11f1-4d42-8f72-aff13dd86198 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:34.157575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179926d2-11f1-4d42-8f72-aff13dd86198 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:34.203635 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1157/2282] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:34.206126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179926d2-11f1-4d42-8f72-aff13dd86198 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:34.234192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179926d2-11f1-4d42-8f72-aff13dd86198 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:34.255185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec7341-e424-4756-a115-833c43cea030 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:34.255931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec7341-e424-4756-a115-833c43cea030 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.259229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec7341-e424-4756-a115-833c43cea030 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.259707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec7341-e424-4756-a115-833c43cea030 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.260902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec7341-e424-4756-a115-833c43cea030 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:34.267999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec7341-e424-4756-a115-833c43cea030 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:34.334436 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1158/2283] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:34 2022] POST /identity/v3/users => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:15:34.336447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec7341-e424-4756-a115-833c43cea030 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:34.373657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec7341-e424-4756-a115-833c43cea030 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:34.380817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825438de-9805-4994-aee3-770f6c84344f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:34.384729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825438de-9805-4994-aee3-770f6c84344f service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:34.391788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16853a51-57f9-43d9-9bb8-745a6984cfe6 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:34.392802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16853a51-57f9-43d9-9bb8-745a6984cfe6 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.393287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16853a51-57f9-43d9-9bb8-745a6984cfe6 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.393779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16853a51-57f9-43d9-9bb8-745a6984cfe6 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.395080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16853a51-57f9-43d9-9bb8-745a6984cfe6 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:34.398614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16853a51-57f9-43d9-9bb8-745a6984cfe6 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:34.410816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16853a51-57f9-43d9-9bb8-745a6984cfe6 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:34.416922 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1126/2284] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:34.471130 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1159/2285] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:34.516504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228cbe-d3b4-4593-a0dd-743053f466b7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:34.516845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228cbe-d3b4-4593-a0dd-743053f466b7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:34.517130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228cbe-d3b4-4593-a0dd-743053f466b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:34.578838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d8228cbe-d3b4-4593-a0dd-743053f466b7 None None] MFA Rules not processed for user `fbecd69d82634c898a7d90d64c2b4a92`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:34.580403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d8228cbe-d3b4-4593-a0dd-743053f466b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:34.785044 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1127/2286] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:35.138283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51ef9d-78af-47af-b8ae-2dfb75d2cabd None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:35.139768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51ef9d-78af-47af-b8ae-2dfb75d2cabd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:35.140473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51ef9d-78af-47af-b8ae-2dfb75d2cabd None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:35.144422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1160/2287] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:15:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:15:35.150969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228cbe-d3b4-4593-a0dd-743053f466b7 None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:15:35.200076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228cbe-d3b4-4593-a0dd-743053f466b7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:35.249519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228cbe-d3b4-4593-a0dd-743053f466b7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:35.280047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e0df1-2a7a-4f59-b339-8cb688f220a0 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:35.281042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0df1-2a7a-4f59-b339-8cb688f220a0 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:35.281558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0df1-2a7a-4f59-b339-8cb688f220a0 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:35.283289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e0df1-2a7a-4f59-b339-8cb688f220a0 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/projects/85419395c5de4aa2b5673dbd5dc14f00` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:35.292049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e0df1-2a7a-4f59-b339-8cb688f220a0 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:get_project(project_id=85419395c5de4aa2b5673dbd5dc14f00)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:35.307095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e0df1-2a7a-4f59-b339-8cb688f220a0 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:35.313946 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1128/2288] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:15:35 2022] GET /identity/v3/projects/85419395c5de4aa2b5673dbd5dc14f00 => generated 369 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:36.626766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986b210-e6c1-4d09-bb6e-f050a21b1cd6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:36.627363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986b210-e6c1-4d09-bb6e-f050a21b1cd6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:36.627690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986b210-e6c1-4d09-bb6e-f050a21b1cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:36.689053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0986b210-e6c1-4d09-bb6e-f050a21b1cd6 None None] MFA Rules not processed for user `43cede8112334cf49d77551ec553eeb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:36.692261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0986b210-e6c1-4d09-bb6e-f050a21b1cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:36.836344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d1199-0e32-4857-8d95-aada3b9adbb4 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:36.837009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d1199-0e32-4857-8d95-aada3b9adbb4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:36.837790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d1199-0e32-4857-8d95-aada3b9adbb4 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:36.841137 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1129/2289] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:15:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:36.852501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d1199-0e32-4857-8d95-aada3b9adbb4 None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:15:36.883811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d1199-0e32-4857-8d95-aada3b9adbb4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:36.885423 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1161/2290] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:36.906981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d1199-0e32-4857-8d95-aada3b9adbb4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:36.918907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293d99f-c8b9-4451-8262-a06eaa43f455 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:36.921352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293d99f-c8b9-4451-8262-a06eaa43f455 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:36.922316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293d99f-c8b9-4451-8262-a06eaa43f455 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:36.922803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293d99f-c8b9-4451-8262-a06eaa43f455 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/projects/85419395c5de4aa2b5673dbd5dc14f00` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:36.924376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293d99f-c8b9-4451-8262-a06eaa43f455 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:get_project(project_id=85419395c5de4aa2b5673dbd5dc14f00)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:36.929634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293d99f-c8b9-4451-8262-a06eaa43f455 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:36.932857 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1130/2291] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:15:36 2022] GET /identity/v3/projects/85419395c5de4aa2b5673dbd5dc14f00 => generated 369 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:36.995203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986b210-e6c1-4d09-bb6e-f050a21b1cd6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:37.015797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986b210-e6c1-4d09-bb6e-f050a21b1cd6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:37.029795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:37.030541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:37.032153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:37.033511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/users/c48b711eca874ccdbea30092f90cacd7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:37.064199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:37.071425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c48b711eca874ccdbea30092f90cacd7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:37.086303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:37.270665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c48b711eca874ccdbea30092f90cacd7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:37.274925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c48b711eca874ccdbea30092f90cacd7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:37.314725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c48b711eca874ccdbea30092f90cacd7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:37.350613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c48b711eca874ccdbea30092f90cacd7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:37.408965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c48b711eca874ccdbea30092f90cacd7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:37.427887 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1162/2292] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:15:36 2022] DELETE /identity/v3/users/c48b711eca874ccdbea30092f90cacd7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:37.433003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293d99f-c8b9-4451-8262-a06eaa43f455 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:37.434968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f293d99f-c8b9-4451-8262-a06eaa43f455 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:37.466914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293d99f-c8b9-4451-8262-a06eaa43f455 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:37.671454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:37.686520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2358de40933489bb9d4356d0d6e9500', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae8cb988227d477187897ed3768e88a5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:37.687204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:37.687486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:37.687761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] PATH_INFO: `/v3/projects/85419395c5de4aa2b5673dbd5dc14f00` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:37.693847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorizing `identity:delete_project(project_id=85419395c5de4aa2b5673dbd5dc14f00)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:37.695917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:37.809323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85419395c5de4aa2b5673dbd5dc14f00', 'request_id': 'req-25dabdab-82f4-4a7a-9b4c-3a32313357f5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:37.832825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85419395c5de4aa2b5673dbd5dc14f00', 'request_id': 'req-25dabdab-82f4-4a7a-9b4c-3a32313357f5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:37.843703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85419395c5de4aa2b5673dbd5dc14f00', 'request_id': 'req-25dabdab-82f4-4a7a-9b4c-3a32313357f5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:37.874433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] The token cache is being invalidate because project 85419395c5de4aa2b5673dbd5dc14f00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:15:37.874919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:37.876866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25dabdab-82f4-4a7a-9b4c-3a32313357f5 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:37.890566 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1131/2293] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:15:37 2022] DELETE /identity/v3/projects/85419395c5de4aa2b5673dbd5dc14f00 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:37.894553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:37.898457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:38.197784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265afbd7-2916-4fa1-992a-7445a8022644 tempest-QuotasAdminTestV236-789301390 tempest-QuotasAdminTestV236-789301390-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:38.324402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:38.325517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:38.325796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:38.326115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] PATH_INFO: `/v3/users/9b0798604dd64d0ebd663b79785dc13a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:38.331197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0798604dd64d0ebd663b79785dc13a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:38.337840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:38.393064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:38.480024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0798604dd64d0ebd663b79785dc13a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:38.480744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0798604dd64d0ebd663b79785dc13a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:38.497675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0798604dd64d0ebd663b79785dc13a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:38.517608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0798604dd64d0ebd663b79785dc13a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:38.552369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0798604dd64d0ebd663b79785dc13a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:38.591817 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1163/2294] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:15:37 2022] DELETE /identity/v3/users/9b0798604dd64d0ebd663b79785dc13a => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:38.599184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6655ca8-8917-446d-a2a5-9a63b5864c37 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:38.600158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6655ca8-8917-446d-a2a5-9a63b5864c37 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:38.600910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6655ca8-8917-446d-a2a5-9a63b5864c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:38.692479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e6655ca8-8917-446d-a2a5-9a63b5864c37 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:38.694544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e6655ca8-8917-446d-a2a5-9a63b5864c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:38.940241 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1132/2295] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:38.962985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:38.964667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:39.120760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d8166-ab13-4ce7-a6f4-c90259e65e90 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:39.134150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f22e5-5333-4866-acb0-84937e8426de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:39.134811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f22e5-5333-4866-acb0-84937e8426de service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:39.137111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f22e5-5333-4866-acb0-84937e8426de service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:39.137455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f22e5-5333-4866-acb0-84937e8426de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:39.165495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f22e5-5333-4866-acb0-84937e8426de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:39.167252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f22e5-5333-4866-acb0-84937e8426de service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:39.182262 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1164/2296] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:40.480274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6655ca8-8917-446d-a2a5-9a63b5864c37 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:40.482034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e6655ca8-8917-446d-a2a5-9a63b5864c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:40.505412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6655ca8-8917-446d-a2a5-9a63b5864c37 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:40.524035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:40.525816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:40.526291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:40.526977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] PATH_INFO: `/v3/projects/1a5014ae6b724898ba704631dffc905e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:40.533241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a5014ae6b724898ba704631dffc905e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:40.540401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:40.735818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a5014ae6b724898ba704631dffc905e', 'request_id': 'req-14673abc-3aaa-4e50-8c21-9da193389c71'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:40.775151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a5014ae6b724898ba704631dffc905e', 'request_id': 'req-14673abc-3aaa-4e50-8c21-9da193389c71'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:40.823114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a5014ae6b724898ba704631dffc905e', 'request_id': 'req-14673abc-3aaa-4e50-8c21-9da193389c71'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:40.856724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] The token cache is being invalidate because project 1a5014ae6b724898ba704631dffc905e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:15:40.859480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:40.860569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:40.873614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f22e5-5333-4866-acb0-84937e8426de service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:40.874794 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1133/2297] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:15:40 2022] DELETE /identity/v3/projects/1a5014ae6b724898ba704631dffc905e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:40.928856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f22e5-5333-4866-acb0-84937e8426de service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:41.067535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:41.068480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:41.070021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:41.070021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] PATH_INFO: `/v3/users/e2358de40933489bb9d4356d0d6e9500` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:41.074608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2358de40933489bb9d4356d0d6e9500)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:41.077965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:41.302241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2358de40933489bb9d4356d0d6e9500'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:41.304553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2358de40933489bb9d4356d0d6e9500'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:41.306726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:41.319945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2358de40933489bb9d4356d0d6e9500'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:41.354864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2358de40933489bb9d4356d0d6e9500'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:41.395332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2358de40933489bb9d4356d0d6e9500'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:41.443169 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1165/2298] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:15:40 2022] DELETE /identity/v3/users/e2358de40933489bb9d4356d0d6e9500 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:42.561111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:42.563430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:42.598692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:42.715188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14673abc-3aaa-4e50-8c21-9da193389c71 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:42.828216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a06ac-c85e-4d1f-8005-853104524eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:42.829139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a06ac-c85e-4d1f-8005-853104524eba service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:42.829522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a06ac-c85e-4d1f-8005-853104524eba service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:42.829939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a06ac-c85e-4d1f-8005-853104524eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:42.833071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c34a06ac-c85e-4d1f-8005-853104524eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:42.933138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a06ac-c85e-4d1f-8005-853104524eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:42.936820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a06ac-c85e-4d1f-8005-853104524eba service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:42.962213 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1134/2299] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:43.537652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:43.544120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:43.764346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ab4da-b261-42aa-aa09-097ff3457b05 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:43.776697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:43.777578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:43.777982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:43.778449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] PATH_INFO: `/v3/projects/ae8cb988227d477187897ed3768e88a5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:43.779828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8cb988227d477187897ed3768e88a5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:43.781980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:43.876054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8cb988227d477187897ed3768e88a5', 'request_id': 'req-459f940c-a3a0-450a-99da-0fa4e7913163'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:43.903260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8cb988227d477187897ed3768e88a5', 'request_id': 'req-459f940c-a3a0-450a-99da-0fa4e7913163'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:43.917509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8cb988227d477187897ed3768e88a5', 'request_id': 'req-459f940c-a3a0-450a-99da-0fa4e7913163'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:43.933975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] The token cache is being invalidate because project ae8cb988227d477187897ed3768e88a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:15:43.934434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:43.935753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-459f940c-a3a0-450a-99da-0fa4e7913163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:15:43.937977 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1166/2300] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:15:43 2022] DELETE /identity/v3/projects/ae8cb988227d477187897ed3768e88a5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:43.945637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7507c47-9d42-4228-a2b2-b7cda50d5986 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:43.946846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7507c47-9d42-4228-a2b2-b7cda50d5986 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:43.947424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7507c47-9d42-4228-a2b2-b7cda50d5986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:43.985649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e7507c47-9d42-4228-a2b2-b7cda50d5986 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:43.987623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e7507c47-9d42-4228-a2b2-b7cda50d5986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:44.156297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:44.233938 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1135/2301] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:15:44.248117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db38a4-fc90-4018-b109-914bd9349f00 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:44.248678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db38a4-fc90-4018-b109-914bd9349f00 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:44.249105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db38a4-fc90-4018-b109-914bd9349f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:44.360658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-04db38a4-fc90-4018-b109-914bd9349f00 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:44.363874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-04db38a4-fc90-4018-b109-914bd9349f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:44.387831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7507c47-9d42-4228-a2b2-b7cda50d5986 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:44.394633 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1167/2302] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:44.404299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7507c47-9d42-4228-a2b2-b7cda50d5986 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:44.424759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0257cc8-e84b-431d-aeea-93e0123607c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:44.425394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257cc8-e84b-431d-aeea-93e0123607c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:44.426009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257cc8-e84b-431d-aeea-93e0123607c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:44.426447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0257cc8-e84b-431d-aeea-93e0123607c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:44.431836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0257cc8-e84b-431d-aeea-93e0123607c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:15:44.432131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0257cc8-e84b-431d-aeea-93e0123607c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:44.433796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0257cc8-e84b-431d-aeea-93e0123607c9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:44.474013 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1136/2303] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:15:44.480507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db38a4-fc90-4018-b109-914bd9349f00 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:44.566952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db38a4-fc90-4018-b109-914bd9349f00 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:44.602189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0a5a-8406-4b71-b952-2763a59a2033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:44.603399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0a5a-8406-4b71-b952-2763a59a2033 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:44.603958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0a5a-8406-4b71-b952-2763a59a2033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:44.604490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0a5a-8406-4b71-b952-2763a59a2033 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:44.606121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b0a5a-8406-4b71-b952-2763a59a2033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:44.611710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b0a5a-8406-4b71-b952-2763a59a2033 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:44.778249 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1168/2304] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:15:44 2022] POST /identity/v3/projects => generated 375 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:44.784611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0257cc8-e84b-431d-aeea-93e0123607c9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:44.808785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0257cc8-e84b-431d-aeea-93e0123607c9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:44.937655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9454343-8aa1-4b37-b540-9cd68ff8abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:44.939927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9454343-8aa1-4b37-b540-9cd68ff8abe8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:44.940211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9454343-8aa1-4b37-b540-9cd68ff8abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:44.940495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9454343-8aa1-4b37-b540-9cd68ff8abe8 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:44.941610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9454343-8aa1-4b37-b540-9cd68ff8abe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:44.944727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9454343-8aa1-4b37-b540-9cd68ff8abe8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:45.002095 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1137/2305] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:44 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:45.002592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0a5a-8406-4b71-b952-2763a59a2033 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:45.021900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0a5a-8406-4b71-b952-2763a59a2033 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:45.031575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46434f27-3984-46f3-b8cb-cc9bb5ac2a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:45.032335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46434f27-3984-46f3-b8cb-cc9bb5ac2a98 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.032620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46434f27-3984-46f3-b8cb-cc9bb5ac2a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.033513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46434f27-3984-46f3-b8cb-cc9bb5ac2a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.034346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46434f27-3984-46f3-b8cb-cc9bb5ac2a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:45.042879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46434f27-3984-46f3-b8cb-cc9bb5ac2a98 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:45.067513 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1169/2306] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:45.068188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9454343-8aa1-4b37-b540-9cd68ff8abe8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:45.082771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9454343-8aa1-4b37-b540-9cd68ff8abe8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:45.107707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254f59b-eb7d-4676-a488-f9a0cfe86430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:45.108869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f59b-eb7d-4676-a488-f9a0cfe86430 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.109157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f59b-eb7d-4676-a488-f9a0cfe86430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.109968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f59b-eb7d-4676-a488-f9a0cfe86430 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.110707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254f59b-eb7d-4676-a488-f9a0cfe86430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:45.118167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254f59b-eb7d-4676-a488-f9a0cfe86430 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:45.152744 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1138/2307] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:15:45.155106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46434f27-3984-46f3-b8cb-cc9bb5ac2a98 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:45.173186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46434f27-3984-46f3-b8cb-cc9bb5ac2a98 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:45.194813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590a220-e84c-41e2-affb-fdaabb1efc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:45.196151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a220-e84c-41e2-affb-fdaabb1efc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.196151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a220-e84c-41e2-affb-fdaabb1efc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.196151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590a220-e84c-41e2-affb-fdaabb1efc3a admin admin] PATH_INFO: `/v3/projects/699807c4380945e8a997a112a0fa94e0/users/2bb4d535f8fb4c8fabb68a76ee062f44/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.216216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:45.221498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590a220-e84c-41e2-affb-fdaabb1efc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=699807c4380945e8a997a112a0fa94e0, user_id=2bb4d535f8fb4c8fabb68a76ee062f44, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:45.233280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590a220-e84c-41e2-affb-fdaabb1efc3a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:45.262749 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1170/2308] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:45 2022] PUT /identity/v3/projects/699807c4380945e8a997a112a0fa94e0/users/2bb4d535f8fb4c8fabb68a76ee062f44/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:45.271020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dfbba-a06f-4931-8516-c3ebcc96f734 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.271020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dfbba-a06f-4931-8516-c3ebcc96f734 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.271020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dfbba-a06f-4931-8516-c3ebcc96f734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.278350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8002a2-bd79-4aa5-b7f1-4fbcea136c65 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.278573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8002a2-bd79-4aa5-b7f1-4fbcea136c65 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.278886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8002a2-bd79-4aa5-b7f1-4fbcea136c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.347378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1a5dfbba-a06f-4931-8516-c3ebcc96f734 None None] MFA Rules not processed for user `2522d8c9bc70492d8987a363171f1de9`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:45.348913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1a5dfbba-a06f-4931-8516-c3ebcc96f734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:45.353419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3b8002a2-bd79-4aa5-b7f1-4fbcea136c65 None None] MFA Rules not processed for user `2bb4d535f8fb4c8fabb68a76ee062f44`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:45.356813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3b8002a2-bd79-4aa5-b7f1-4fbcea136c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:45.470699 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1139/2309] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:45.491911 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1171/2310] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:45.496754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dfbba-a06f-4931-8516-c3ebcc96f734 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:45.590132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:45.637747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dfbba-a06f-4931-8516-c3ebcc96f734 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:45.646103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51295d-7a42-4665-a027-5d1da4954ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:45.647940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51295d-7a42-4665-a027-5d1da4954ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.648609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51295d-7a42-4665-a027-5d1da4954ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.649095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51295d-7a42-4665-a027-5d1da4954ed8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.650115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51295d-7a42-4665-a027-5d1da4954ed8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:45.652609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51295d-7a42-4665-a027-5d1da4954ed8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:45.712328 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1140/2311] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:15:45 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:15:45.716477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8002a2-bd79-4aa5-b7f1-4fbcea136c65 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:45.774758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8002a2-bd79-4aa5-b7f1-4fbcea136c65 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:45.909581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51295d-7a42-4665-a027-5d1da4954ed8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:45.911992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fa51295d-7a42-4665-a027-5d1da4954ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:45.969461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b76b3d-10bc-4eee-af53-124157b582dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:45.970698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b76b3d-10bc-4eee-af53-124157b582dc admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:45.970989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b76b3d-10bc-4eee-af53-124157b582dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:45.972409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b76b3d-10bc-4eee-af53-124157b582dc admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:45.973323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b76b3d-10bc-4eee-af53-124157b582dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:45.980103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b76b3d-10bc-4eee-af53-124157b582dc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:46.029719 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1172/2312] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:15:45 2022] POST /identity/v3/users => generated 295 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:15:46.032909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b76b3d-10bc-4eee-af53-124157b582dc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:46.047168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b76b3d-10bc-4eee-af53-124157b582dc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:46.054383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b03b1-dc79-4fbc-a82d-e5260db90a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:46.055081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b03b1-dc79-4fbc-a82d-e5260db90a7e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.055404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b03b1-dc79-4fbc-a82d-e5260db90a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.055780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b03b1-dc79-4fbc-a82d-e5260db90a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.056623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b03b1-dc79-4fbc-a82d-e5260db90a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:46.059763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b03b1-dc79-4fbc-a82d-e5260db90a7e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:46.073922 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1173/2313] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:15:46.077693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b03b1-dc79-4fbc-a82d-e5260db90a7e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:46.098684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51295d-7a42-4665-a027-5d1da4954ed8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:46.104980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b03b1-dc79-4fbc-a82d-e5260db90a7e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:46.117960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c609f3-b6c7-46d5-834a-1a92f6eea0b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:46.118142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e78e86-7653-4997-bd7a-8ef88cbce01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:46.118270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c609f3-b6c7-46d5-834a-1a92f6eea0b2 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.118433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c609f3-b6c7-46d5-834a-1a92f6eea0b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.118536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78e86-7653-4997-bd7a-8ef88cbce01a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.118671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c609f3-b6c7-46d5-834a-1a92f6eea0b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.118771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78e86-7653-4997-bd7a-8ef88cbce01a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.118930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e78e86-7653-4997-bd7a-8ef88cbce01a admin admin] PATH_INFO: `/v3/projects/9cd6bcc9ae944f6b80a6d32652f2f8b8/users/0a0380b4330642e8a3ba9c00d6cbf36d/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.163364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e78e86-7653-4997-bd7a-8ef88cbce01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd6bcc9ae944f6b80a6d32652f2f8b8, user_id=0a0380b4330642e8a3ba9c00d6cbf36d, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:46.165572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e78e86-7653-4997-bd7a-8ef88cbce01a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:46.197519 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1174/2314] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:46 2022] PUT /identity/v3/projects/9cd6bcc9ae944f6b80a6d32652f2f8b8/users/0a0380b4330642e8a3ba9c00d6cbf36d/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:46.199073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e78e86-7653-4997-bd7a-8ef88cbce01a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:46.268335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c609f3-b6c7-46d5-834a-1a92f6eea0b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:46.268335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c609f3-b6c7-46d5-834a-1a92f6eea0b2 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:46.289301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:46.294876 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1141/2315] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:15:46.333068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e78e86-7653-4997-bd7a-8ef88cbce01a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:46.339891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34caf9-d224-4825-b3a2-000dce041ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:46.340838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34caf9-d224-4825-b3a2-000dce041ebc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.341238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34caf9-d224-4825-b3a2-000dce041ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.341638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34caf9-d224-4825-b3a2-000dce041ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.342712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34caf9-d224-4825-b3a2-000dce041ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:46.344944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34caf9-d224-4825-b3a2-000dce041ebc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:46.367317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c609f3-b6c7-46d5-834a-1a92f6eea0b2 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:46.368441 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1175/2316] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:15:46.386753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c609f3-b6c7-46d5-834a-1a92f6eea0b2 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:46.399824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21654-a346-44da-a5ae-abfa724ced6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:46.400536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21654-a346-44da-a5ae-abfa724ced6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.400816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21654-a346-44da-a5ae-abfa724ced6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.401089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21654-a346-44da-a5ae-abfa724ced6f admin admin] PATH_INFO: `/v3/projects/9cd6bcc9ae944f6b80a6d32652f2f8b8/users/0a0380b4330642e8a3ba9c00d6cbf36d/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.409585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21654-a346-44da-a5ae-abfa724ced6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd6bcc9ae944f6b80a6d32652f2f8b8, user_id=0a0380b4330642e8a3ba9c00d6cbf36d, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:46.412561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21654-a346-44da-a5ae-abfa724ced6f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:46.446898 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1142/2317] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:15:46 2022] PUT /identity/v3/projects/9cd6bcc9ae944f6b80a6d32652f2f8b8/users/0a0380b4330642e8a3ba9c00d6cbf36d/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:15:46.460217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c684d-ebb1-475c-a7fe-1bd5e64e6b0d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.460667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c684d-ebb1-475c-a7fe-1bd5e64e6b0d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.460826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c684d-ebb1-475c-a7fe-1bd5e64e6b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.529188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-950c684d-ebb1-475c-a7fe-1bd5e64e6b0d None None] MFA Rules not processed for user `0a0380b4330642e8a3ba9c00d6cbf36d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:46.530979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-950c684d-ebb1-475c-a7fe-1bd5e64e6b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:46.734619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1176/2318] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:46.764632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267afd9-220a-4d4c-b24f-5386971b0346 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:46.764898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267afd9-220a-4d4c-b24f-5386971b0346 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:46.765181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267afd9-220a-4d4c-b24f-5386971b0346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:46.829049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8267afd9-220a-4d4c-b24f-5386971b0346 None None] MFA Rules not processed for user `2bb4d535f8fb4c8fabb68a76ee062f44`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:46.830743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8267afd9-220a-4d4c-b24f-5386971b0346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:46.984037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:47.035155 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1143/2319] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:48.721150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c684d-ebb1-475c-a7fe-1bd5e64e6b0d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:48.726922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-950c684d-ebb1-475c-a7fe-1bd5e64e6b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:48.936733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c684d-ebb1-475c-a7fe-1bd5e64e6b0d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:48.948843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646d219-efd7-41b2-8920-25bd2f41c2d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:48.950321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d219-efd7-41b2-8920-25bd2f41c2d3 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:48.951057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d219-efd7-41b2-8920-25bd2f41c2d3 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:48.951527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d219-efd7-41b2-8920-25bd2f41c2d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:48.967090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646d219-efd7-41b2-8920-25bd2f41c2d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:48.969124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646d219-efd7-41b2-8920-25bd2f41c2d3 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:49.009758 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1177/2320] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:51.216223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee1858-8256-4c51-abd2-1e2cccc97ae6 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:51.216676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee1858-8256-4c51-abd2-1e2cccc97ae6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:51.216755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee1858-8256-4c51-abd2-1e2cccc97ae6 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:51.218454 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1144/2321] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:51.227066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0144-aef1-4897-970c-5a78f084f791 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:51.227637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0144-aef1-4897-970c-5a78f084f791 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:51.227637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d0144-aef1-4897-970c-5a78f084f791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:51.294533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-731d0144-aef1-4897-970c-5a78f084f791 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:51.296996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-731d0144-aef1-4897-970c-5a78f084f791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:51.401859 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1178/2322] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:15:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:51.464966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee1858-8256-4c51-abd2-1e2cccc97ae6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:51.467539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b3ee1858-8256-4c51-abd2-1e2cccc97ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:51.610037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee1858-8256-4c51-abd2-1e2cccc97ae6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:51.616985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05a671-6d88-42b7-9e9b-970392885648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:51.618117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05a671-6d88-42b7-9e9b-970392885648 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:51.618599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05a671-6d88-42b7-9e9b-970392885648 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:51.619087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05a671-6d88-42b7-9e9b-970392885648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:51.636034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05a671-6d88-42b7-9e9b-970392885648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:51.638823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05a671-6d88-42b7-9e9b-970392885648 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:51.666933 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1145/2323] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:51.699617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f70bde-d1e6-4c07-952c-ee2e910b573d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:51.699904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f70bde-d1e6-4c07-952c-ee2e910b573d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:51.700176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f70bde-d1e6-4c07-952c-ee2e910b573d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:51.753602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d0f70bde-d1e6-4c07-952c-ee2e910b573d None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:51.755023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d0f70bde-d1e6-4c07-952c-ee2e910b573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:51.789142 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1179/2324] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:15:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:15:51.991405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05a671-6d88-42b7-9e9b-970392885648 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:52.005079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05a671-6d88-42b7-9e9b-970392885648 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:52.011686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebca7e7-e113-4e54-bf51-cd10d224c766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:52.012694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca7e7-e113-4e54-bf51-cd10d224c766 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:52.013715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca7e7-e113-4e54-bf51-cd10d224c766 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:52.014443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebca7e7-e113-4e54-bf51-cd10d224c766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:52.029535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebca7e7-e113-4e54-bf51-cd10d224c766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:52.032844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebca7e7-e113-4e54-bf51-cd10d224c766 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:52.049573 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1146/2325] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:15:52.272095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40f37-1b38-478d-8db9-6e89affa2497 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:52.274226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40f37-1b38-478d-8db9-6e89affa2497 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:52.275056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec40f37-1b38-478d-8db9-6e89affa2497 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:52.278856 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1180/2326] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:15:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:15:52.295068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1d69e-9011-49d4-8725-d802ea294349 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:52.296392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1d69e-9011-49d4-8725-d802ea294349 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:52.296392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1d69e-9011-49d4-8725-d802ea294349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:52.322345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-36d1d69e-9011-49d4-8725-d802ea294349 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:52.323766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-36d1d69e-9011-49d4-8725-d802ea294349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:52.441103 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1147/2327] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:15:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:15:52.466041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40f37-1b38-478d-8db9-6e89affa2497 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:15:52.468748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8ec40f37-1b38-478d-8db9-6e89affa2497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:52.516300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec40f37-1b38-478d-8db9-6e89affa2497 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:15:52.524911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35223281-fd83-40f6-bcfb-cfb944520344 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:15:52.526160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35223281-fd83-40f6-bcfb-cfb944520344 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:52.526774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35223281-fd83-40f6-bcfb-cfb944520344 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:52.527558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35223281-fd83-40f6-bcfb-cfb944520344 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:52.595633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35223281-fd83-40f6-bcfb-cfb944520344 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:15:52.598897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35223281-fd83-40f6-bcfb-cfb944520344 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:15:52.623015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dce5d-58f9-4764-88e6-bd3d317641c4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:15:52.623843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dce5d-58f9-4764-88e6-bd3d317641c4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:15:52.624966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dce5d-58f9-4764-88e6-bd3d317641c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:15:52.646367 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1181/2328] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:15:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:15:52.723524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0f9dce5d-58f9-4764-88e6-bd3d317641c4 None None] MFA Rules not processed for user `2522d8c9bc70492d8987a363171f1de9`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:15:52.725744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0f9dce5d-58f9-4764-88e6-bd3d317641c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:15:52.936633 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1148/2329] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:15:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:02.356140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d8e90-679c-4050-b6e0-dbb0851b7890 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.356803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d8e90-679c-4050-b6e0-dbb0851b7890 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.356803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d8e90-679c-4050-b6e0-dbb0851b7890 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.358321 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1182/2330] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:16:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:16:02.379253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ece6e-17f5-4995-8d6d-1616405535f7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.380872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ece6e-17f5-4995-8d6d-1616405535f7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.381573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ece6e-17f5-4995-8d6d-1616405535f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.461338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-754ece6e-17f5-4995-8d6d-1616405535f7 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:02.464141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-754ece6e-17f5-4995-8d6d-1616405535f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:02.494491 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1149/2331] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:16:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:02.526755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d8e90-679c-4050-b6e0-dbb0851b7890 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:02.543226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d8e90-679c-4050-b6e0-dbb0851b7890 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:02.548305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f0a7c-ecb4-49d3-8cdc-eb8f0ec77ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:02.549250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f0a7c-ecb4-49d3-8cdc-eb8f0ec77ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:02.549910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f0a7c-ecb4-49d3-8cdc-eb8f0ec77ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:02.550339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f0a7c-ecb4-49d3-8cdc-eb8f0ec77ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:02.565478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f0a7c-ecb4-49d3-8cdc-eb8f0ec77ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:02.568743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f0a7c-ecb4-49d3-8cdc-eb8f0ec77ba9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:02.592094 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1183/2332] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:04.127061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ece6e-17f5-4995-8d6d-1616405535f7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:04.129838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-754ece6e-17f5-4995-8d6d-1616405535f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:04.159432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:04.237850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ece6e-17f5-4995-8d6d-1616405535f7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:04.244675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:04.245434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:04.245831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:04.246204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] PATH_INFO: `/v3/users/7d35a310048549c9a9e4cf8118c6962a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:04.247471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d35a310048549c9a9e4cf8118c6962a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:04.249645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:04.310369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d35a310048549c9a9e4cf8118c6962a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:04.318183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d35a310048549c9a9e4cf8118c6962a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:04.332240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d35a310048549c9a9e4cf8118c6962a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:04.341793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d35a310048549c9a9e4cf8118c6962a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:04.342521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d35a310048549c9a9e4cf8118c6962a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:04.349713 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1150/2333] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:04 2022] DELETE /identity/v3/users/7d35a310048549c9a9e4cf8118c6962a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:04.546408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f0a7c-ecb4-49d3-8cdc-eb8f0ec77ba9 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:04.562980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:04.570080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f0a7c-ecb4-49d3-8cdc-eb8f0ec77ba9 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:04.722167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:04.722167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:04.722362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:04.722459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] PATH_INFO: `/v3/projects/a410d7250e5f4a22bc4f15c833e2c518` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:04.723633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a410d7250e5f4a22bc4f15c833e2c518)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:04.725856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:04.789596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a410d7250e5f4a22bc4f15c833e2c518', 'request_id': 'req-984f0888-4493-428c-a8e0-3fc99d0b4c01'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:04.794920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a410d7250e5f4a22bc4f15c833e2c518', 'request_id': 'req-984f0888-4493-428c-a8e0-3fc99d0b4c01'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:04.796756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:04.799223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:04.805269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a410d7250e5f4a22bc4f15c833e2c518', 'request_id': 'req-984f0888-4493-428c-a8e0-3fc99d0b4c01'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:04.817283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393d9b9-8dbd-465a-8f04-4807ef1f5f93 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:04.819645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] The token cache is being invalidate because project a410d7250e5f4a22bc4f15c833e2c518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:04.819957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:04.820616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:04.822365 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1184/2334] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:04 2022] DELETE /identity/v3/projects/a410d7250e5f4a22bc4f15c833e2c518 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:04.830032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:04.833076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:04.916117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:04.916828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:04.917111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:04.917382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] PATH_INFO: `/v3/users/468e1cd6502a4c34b7b4a34b794f64f1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:04.919198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=468e1cd6502a4c34b7b4a34b794f64f1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:04.922050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:04.932302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f0888-4493-428c-a8e0-3fc99d0b4c01 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:04.940902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:04.943199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:04.944345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:04.944779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] PATH_INFO: `/v3/users/43cede8112334cf49d77551ec553eeb9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:04.946338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=43cede8112334cf49d77551ec553eeb9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:04.948802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:05.004946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:05.028184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '468e1cd6502a4c34b7b4a34b794f64f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.028981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:05.041792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '468e1cd6502a4c34b7b4a34b794f64f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.052284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43cede8112334cf49d77551ec553eeb9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.053022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43cede8112334cf49d77551ec553eeb9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.062898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '468e1cd6502a4c34b7b4a34b794f64f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.075956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43cede8112334cf49d77551ec553eeb9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.077957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '468e1cd6502a4c34b7b4a34b794f64f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.080784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5e6e3c0a-1d77-4816-b051-35d46a79cd93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '468e1cd6502a4c34b7b4a34b794f64f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.092332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43cede8112334cf49d77551ec553eeb9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.102882 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1151/2335] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:04 2022] DELETE /identity/v3/users/468e1cd6502a4c34b7b4a34b794f64f1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:05.107683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef93bd-1c2d-41d0-90c0-2d8f94c0a72f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.108791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef93bd-1c2d-41d0-90c0-2d8f94c0a72f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.108791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef93bd-1c2d-41d0-90c0-2d8f94c0a72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.125724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43cede8112334cf49d77551ec553eeb9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.139376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cbef93bd-1c2d-41d0-90c0-2d8f94c0a72f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:05.140751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cbef93bd-1c2d-41d0-90c0-2d8f94c0a72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:05.151263 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1185/2336] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:04 2022] DELETE /identity/v3/users/43cede8112334cf49d77551ec553eeb9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:05.213858 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1152/2337] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:05.251053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:05.252790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:05.367950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c597f-6b8f-4c04-b1d4-d17e6c501aaf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:05.385640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa2146-a406-4cac-b1a3-d2b38b8dba4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:05.386467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa2146-a406-4cac-b1a3-d2b38b8dba4c service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.386747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa2146-a406-4cac-b1a3-d2b38b8dba4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.387016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa2146-a406-4cac-b1a3-d2b38b8dba4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.472598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa2146-a406-4cac-b1a3-d2b38b8dba4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:05.474799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa2146-a406-4cac-b1a3-d2b38b8dba4c service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:05.490991 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1186/2338] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:05.645394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef93bd-1c2d-41d0-90c0-2d8f94c0a72f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:05.647071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cbef93bd-1c2d-41d0-90c0-2d8f94c0a72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:05.663050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef93bd-1c2d-41d0-90c0-2d8f94c0a72f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:05.668008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:05.668918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.669184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.669639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] PATH_INFO: `/v3/projects/0ab3e52f209e4d3ba268c56faf21a540` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.671145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab3e52f209e4d3ba268c56faf21a540)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:05.673318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:05.779160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab3e52f209e4d3ba268c56faf21a540', 'request_id': 'req-a0f5357e-7b12-4d30-90fd-685d0cf0668b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.805713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab3e52f209e4d3ba268c56faf21a540', 'request_id': 'req-a0f5357e-7b12-4d30-90fd-685d0cf0668b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.820298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab3e52f209e4d3ba268c56faf21a540', 'request_id': 'req-a0f5357e-7b12-4d30-90fd-685d0cf0668b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.844355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] The token cache is being invalidate because project 0ab3e52f209e4d3ba268c56faf21a540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:05.844882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.845731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:05.853317 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1153/2339] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:05 2022] DELETE /identity/v3/projects/0ab3e52f209e4d3ba268c56faf21a540 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:05.860209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5f5a4-a2c3-43b3-bdfb-ebac3885ac80 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:05.860755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5f5a4-a2c3-43b3-bdfb-ebac3885ac80 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:05.860938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5f5a4-a2c3-43b3-bdfb-ebac3885ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:05.914632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cfb5f5a4-a2c3-43b3-bdfb-ebac3885ac80 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:05.915987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cfb5f5a4-a2c3-43b3-bdfb-ebac3885ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:05.961500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:05.963271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:06.051271 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1187/2340] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:06.053553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee10672-85a6-4eef-8b5e-59ff7c6f1bc0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.053834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee10672-85a6-4eef-8b5e-59ff7c6f1bc0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.054243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee10672-85a6-4eef-8b5e-59ff7c6f1bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.062124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:06.070367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:06.105468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-aee10672-85a6-4eef-8b5e-59ff7c6f1bc0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:06.108563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aee10672-85a6-4eef-8b5e-59ff7c6f1bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:06.135944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5357e-7b12-4d30-90fd-685d0cf0668b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.144899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.150022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.150714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.151483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] PATH_INFO: `/v3/projects/44f35a2c3c4045008c2bbbafd22d0027` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.154610 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1188/2341] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:06.155931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f35a2c3c4045008c2bbbafd22d0027)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.159321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee10672-85a6-4eef-8b5e-59ff7c6f1bc0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.161857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.179176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee10672-85a6-4eef-8b5e-59ff7c6f1bc0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.191431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b4aa8-8b9f-494d-bdf7-5d9fc26bc6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.192083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b4aa8-8b9f-494d-bdf7-5d9fc26bc6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.192360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b4aa8-8b9f-494d-bdf7-5d9fc26bc6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.192884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b4aa8-8b9f-494d-bdf7-5d9fc26bc6a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.193628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b4aa8-8b9f-494d-bdf7-5d9fc26bc6a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:06.195180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b4aa8-8b9f-494d-bdf7-5d9fc26bc6a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.201105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b4aa8-8b9f-494d-bdf7-5d9fc26bc6a6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.225294 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1189/2342] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:06.229655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b4aa8-8b9f-494d-bdf7-5d9fc26bc6a6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.239911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f35a2c3c4045008c2bbbafd22d0027', 'request_id': 'req-3a9c575c-f5e2-41c2-a658-b0eed9f95164'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:06.251578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f35a2c3c4045008c2bbbafd22d0027', 'request_id': 'req-3a9c575c-f5e2-41c2-a658-b0eed9f95164'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:06.251785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b4aa8-8b9f-494d-bdf7-5d9fc26bc6a6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.261320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f35a2c3c4045008c2bbbafd22d0027', 'request_id': 'req-3a9c575c-f5e2-41c2-a658-b0eed9f95164'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:06.278770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] The token cache is being invalidate because project 44f35a2c3c4045008c2bbbafd22d0027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:06.279063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:06.279934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:06.284493 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1154/2343] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:05 2022] DELETE /identity/v3/projects/44f35a2c3c4045008c2bbbafd22d0027 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:06.285803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.288308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:06.364790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd065-2ccc-47a0-bc8f-249d33489fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.367246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd065-2ccc-47a0-bc8f-249d33489fdb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.367774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd065-2ccc-47a0-bc8f-249d33489fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.368050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd065-2ccc-47a0-bc8f-249d33489fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.368720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd065-2ccc-47a0-bc8f-249d33489fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.374237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd065-2ccc-47a0-bc8f-249d33489fdb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.391500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c575c-f5e2-41c2-a658-b0eed9f95164 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.397754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.398750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.399026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.399296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] PATH_INFO: `/v3/users/ed4b67e42b314246bcda005fa20116c4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.400679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4b67e42b314246bcda005fa20116c4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.402913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.432481 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1190/2344] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:06 2022] POST /identity/v3/projects => generated 391 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:06.440648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd065-2ccc-47a0-bc8f-249d33489fdb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.444669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-01dfd065-2ccc-47a0-bc8f-249d33489fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:06.505057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4b67e42b314246bcda005fa20116c4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:06.527538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4b67e42b314246bcda005fa20116c4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:06.560541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd065-2ccc-47a0-bc8f-249d33489fdb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.561310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:06.567149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1862-1cdc-4c6a-82b2-bd28cd775f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.567553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1862-1cdc-4c6a-82b2-bd28cd775f98 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.568151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1862-1cdc-4c6a-82b2-bd28cd775f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.568678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1862-1cdc-4c6a-82b2-bd28cd775f98 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.570392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af1862-1cdc-4c6a-82b2-bd28cd775f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.570971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4b67e42b314246bcda005fa20116c4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:06.572608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af1862-1cdc-4c6a-82b2-bd28cd775f98 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.583580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4b67e42b314246bcda005fa20116c4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:06.584580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4b67e42b314246bcda005fa20116c4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:06.598049 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1155/2345] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:06 2022] DELETE /identity/v3/users/ed4b67e42b314246bcda005fa20116c4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:06.622753 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1191/2346] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:06 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:06.625434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.627013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:06.764383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf904a3-f249-485d-88dd-3edd2416be65 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.792934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad8ac4-8855-48b9-b048-3221ac832409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.798024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8ac4-8855-48b9-b048-3221ac832409 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.798664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8ac4-8855-48b9-b048-3221ac832409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.799020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad8ac4-8855-48b9-b048-3221ac832409 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.799895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad8ac4-8855-48b9-b048-3221ac832409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.804158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad8ac4-8855-48b9-b048-3221ac832409 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.821981 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1156/2347] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:06.824537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1862-1cdc-4c6a-82b2-bd28cd775f98 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.839040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1862-1cdc-4c6a-82b2-bd28cd775f98 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.842184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06755b5-a323-4364-af0b-60748433ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.842647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06755b5-a323-4364-af0b-60748433ed5f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.842925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06755b5-a323-4364-af0b-60748433ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.843202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06755b5-a323-4364-af0b-60748433ed5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.843865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06755b5-a323-4364-af0b-60748433ed5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.845607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06755b5-a323-4364-af0b-60748433ed5f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.863983 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1192/2348] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:06.872895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad8ac4-8855-48b9-b048-3221ac832409 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:06.884602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad8ac4-8855-48b9-b048-3221ac832409 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:06.893643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb16dda-26bc-4f86-8a71-11272553b41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:06.894846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16dda-26bc-4f86-8a71-11272553b41a admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.895408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16dda-26bc-4f86-8a71-11272553b41a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.896218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb16dda-26bc-4f86-8a71-11272553b41a admin admin] PATH_INFO: `/v3/projects/e0ef8256626f4e4a96a5f107837e48bd/users/37fcb1984b1f491bb3aafc19186a7de6/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:06.935597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb16dda-26bc-4f86-8a71-11272553b41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ef8256626f4e4a96a5f107837e48bd, user_id=37fcb1984b1f491bb3aafc19186a7de6, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:06.939390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb16dda-26bc-4f86-8a71-11272553b41a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:06.961932 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1157/2349] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:06 2022] PUT /identity/v3/projects/e0ef8256626f4e4a96a5f107837e48bd/users/37fcb1984b1f491bb3aafc19186a7de6/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:06.971149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff778c9-38f8-45e4-974e-a007068e080b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:06.971437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff778c9-38f8-45e4-974e-a007068e080b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:06.971709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff778c9-38f8-45e4-974e-a007068e080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.004070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fff778c9-38f8-45e4-974e-a007068e080b None None] MFA Rules not processed for user `37fcb1984b1f491bb3aafc19186a7de6`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:07.005474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fff778c9-38f8-45e4-974e-a007068e080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:07.058476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:07.111943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb16dda-26bc-4f86-8a71-11272553b41a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.119545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-acb16dda-26bc-4f86-8a71-11272553b41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:07.127504 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1193/2350] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:07.135116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff778c9-38f8-45e4-974e-a007068e080b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.232613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb16dda-26bc-4f86-8a71-11272553b41a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.247090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.247771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.248541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.248824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] PATH_INFO: `/v3/projects/87ed75d938864fedb97131e31abbff62` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.250434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ed75d938864fedb97131e31abbff62)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:07.252489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:07.312747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff778c9-38f8-45e4-974e-a007068e080b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.322867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bec27-d331-4b42-bfee-106c534fb0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.325140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bec27-d331-4b42-bfee-106c534fb0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.325767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bec27-d331-4b42-bfee-106c534fb0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.326458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bec27-d331-4b42-bfee-106c534fb0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.327775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bec27-d331-4b42-bfee-106c534fb0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:07.332130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bec27-d331-4b42-bfee-106c534fb0c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:07.383885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ed75d938864fedb97131e31abbff62', 'request_id': 'req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:07.402444 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1194/2351] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:07 2022] POST /identity/v3/projects => generated 391 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:07.404301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ed75d938864fedb97131e31abbff62', 'request_id': 'req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:07.405517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bec27-d331-4b42-bfee-106c534fb0c9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.423414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ed75d938864fedb97131e31abbff62', 'request_id': 'req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:07.426909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:07.475802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] The token cache is being invalidate because project 87ed75d938864fedb97131e31abbff62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:07.476506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:07.480211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93c4c8c7-818d-4a9f-8943-ca7e59e95b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:07.486434 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1158/2352] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:07 2022] DELETE /identity/v3/projects/87ed75d938864fedb97131e31abbff62 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:07.495948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc60e8-a7a7-4a3d-a44e-8df70495d2ba None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.496694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc60e8-a7a7-4a3d-a44e-8df70495d2ba None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.497229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc60e8-a7a7-4a3d-a44e-8df70495d2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.576824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-58cc60e8-a7a7-4a3d-a44e-8df70495d2ba None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:07.599730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-58cc60e8-a7a7-4a3d-a44e-8df70495d2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:07.680251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bec27-d331-4b42-bfee-106c534fb0c9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.701806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523be3f-3484-46b4-b2a9-f865a3471504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.704153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523be3f-3484-46b4-b2a9-f865a3471504 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.705342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523be3f-3484-46b4-b2a9-f865a3471504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.708040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523be3f-3484-46b4-b2a9-f865a3471504 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.710197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523be3f-3484-46b4-b2a9-f865a3471504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:07.718764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523be3f-3484-46b4-b2a9-f865a3471504 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:07.784051 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1195/2353] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:07 2022] POST /identity/v3/users => generated 302 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:07.785809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523be3f-3484-46b4-b2a9-f865a3471504 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.787220 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1159/2354] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:07.791490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3e876-1f75-4a2a-9a12-c4037804b147 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.791490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3e876-1f75-4a2a-9a12-c4037804b147 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.791490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3e876-1f75-4a2a-9a12-c4037804b147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.795358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a523be3f-3484-46b4-b2a9-f865a3471504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:07.829372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-87b3e876-1f75-4a2a-9a12-c4037804b147 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:07.830703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-87b3e876-1f75-4a2a-9a12-c4037804b147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:07.840868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523be3f-3484-46b4-b2a9-f865a3471504 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.845857 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1160/2355] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:07.846875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3e876-1f75-4a2a-9a12-c4037804b147 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.863636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a32ab-0ef0-48cc-bf0f-69ca2b758154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.865018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a32ab-0ef0-48cc-bf0f-69ca2b758154 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.865774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a32ab-0ef0-48cc-bf0f-69ca2b758154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.866023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a32ab-0ef0-48cc-bf0f-69ca2b758154 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.867124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a32ab-0ef0-48cc-bf0f-69ca2b758154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:07.870329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a32ab-0ef0-48cc-bf0f-69ca2b758154 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:07.876818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3e876-1f75-4a2a-9a12-c4037804b147 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.884913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c1b44-dc43-407a-bf5f-629a31a88a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.885623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c1b44-dc43-407a-bf5f-629a31a88a91 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.886409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c1b44-dc43-407a-bf5f-629a31a88a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.886715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c1b44-dc43-407a-bf5f-629a31a88a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.887420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c1b44-dc43-407a-bf5f-629a31a88a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:07.890866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c1b44-dc43-407a-bf5f-629a31a88a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:07.892573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c1b44-dc43-407a-bf5f-629a31a88a91 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:07.902515 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1196/2356] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:07.912465 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1161/2357] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:07.913273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a32ab-0ef0-48cc-bf0f-69ca2b758154 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.918231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c1b44-dc43-407a-bf5f-629a31a88a91 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:07.935769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c1b44-dc43-407a-bf5f-629a31a88a91 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.938220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a32ab-0ef0-48cc-bf0f-69ca2b758154 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:07.947369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28b9c3-39e4-4bbd-ba9e-624cd197ef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.956757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cef2b-9bec-482e-ae92-4ee9e71bcac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:07.957624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cef2b-9bec-482e-ae92-4ee9e71bcac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.958037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cef2b-9bec-482e-ae92-4ee9e71bcac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.958448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cef2b-9bec-482e-ae92-4ee9e71bcac2 admin admin] PATH_INFO: `/v3/projects/fc38f63570864fd9ac6ec6d43e7986e6/users/42e76bc6e556419a8aecc982352abdd7/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.964457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28b9c3-39e4-4bbd-ba9e-624cd197ef0c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:07.964457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28b9c3-39e4-4bbd-ba9e-624cd197ef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:07.964780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28b9c3-39e4-4bbd-ba9e-624cd197ef0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:07.979558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28b9c3-39e4-4bbd-ba9e-624cd197ef0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:07.983410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f28b9c3-39e4-4bbd-ba9e-624cd197ef0c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:07.992791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cef2b-9bec-482e-ae92-4ee9e71bcac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc38f63570864fd9ac6ec6d43e7986e6, user_id=42e76bc6e556419a8aecc982352abdd7, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.010131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cef2b-9bec-482e-ae92-4ee9e71bcac2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.039616 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1197/2358] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:07 2022] PUT /identity/v3/projects/fc38f63570864fd9ac6ec6d43e7986e6/users/42e76bc6e556419a8aecc982352abdd7/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:08.044347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cef2b-9bec-482e-ae92-4ee9e71bcac2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:08.048076 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1162/2359] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:07 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:08.051028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28b9c3-39e4-4bbd-ba9e-624cd197ef0c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:08.090040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:08.205000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28b9c3-39e4-4bbd-ba9e-624cd197ef0c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.211800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba65e8-b083-47a4-9dca-2e838ddddef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.212439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba65e8-b083-47a4-9dca-2e838ddddef1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.213014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba65e8-b083-47a4-9dca-2e838ddddef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.213299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba65e8-b083-47a4-9dca-2e838ddddef1 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.214042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba65e8-b083-47a4-9dca-2e838ddddef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.215788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cef2b-9bec-482e-ae92-4ee9e71bcac2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.216087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba65e8-b083-47a4-9dca-2e838ddddef1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.221665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326416b-3a5c-4eda-9586-d53a2042bf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.222875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326416b-3a5c-4eda-9586-d53a2042bf41 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.223299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326416b-3a5c-4eda-9586-d53a2042bf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.223753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326416b-3a5c-4eda-9586-d53a2042bf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.226576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326416b-3a5c-4eda-9586-d53a2042bf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.229766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326416b-3a5c-4eda-9586-d53a2042bf41 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.245716 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1198/2360] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:08.249460 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1163/2361] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:08 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:08.251170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326416b-3a5c-4eda-9586-d53a2042bf41 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:08.252396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba65e8-b083-47a4-9dca-2e838ddddef1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:08.266904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326416b-3a5c-4eda-9586-d53a2042bf41 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.269156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba65e8-b083-47a4-9dca-2e838ddddef1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.275285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af80ba1-c465-48bd-a2ec-2931ad8a2142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.276924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80ba1-c465-48bd-a2ec-2931ad8a2142 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.277353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80ba1-c465-48bd-a2ec-2931ad8a2142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.277546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f5a38-7c8e-4c66-84bf-5b5cd78fabc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.277958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af80ba1-c465-48bd-a2ec-2931ad8a2142 admin admin] PATH_INFO: `/v3/projects/fc38f63570864fd9ac6ec6d43e7986e6/users/42e76bc6e556419a8aecc982352abdd7/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.278741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f5a38-7c8e-4c66-84bf-5b5cd78fabc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.279099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f5a38-7c8e-4c66-84bf-5b5cd78fabc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.279640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f5a38-7c8e-4c66-84bf-5b5cd78fabc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.280615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f5a38-7c8e-4c66-84bf-5b5cd78fabc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.281202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af80ba1-c465-48bd-a2ec-2931ad8a2142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc38f63570864fd9ac6ec6d43e7986e6, user_id=42e76bc6e556419a8aecc982352abdd7, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.284527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f5a38-7c8e-4c66-84bf-5b5cd78fabc6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.287315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af80ba1-c465-48bd-a2ec-2931ad8a2142 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.306652 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1199/2363] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:08 2022] PUT /identity/v3/projects/fc38f63570864fd9ac6ec6d43e7986e6/users/42e76bc6e556419a8aecc982352abdd7/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:08.306975 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1164/2363] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:08.311159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f5a38-7c8e-4c66-84bf-5b5cd78fabc6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:08.317007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e1bd-6efc-41b6-8a48-d86bad043b50 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.317297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e1bd-6efc-41b6-8a48-d86bad043b50 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.317568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e1bd-6efc-41b6-8a48-d86bad043b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.323538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f5a38-7c8e-4c66-84bf-5b5cd78fabc6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.348459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9942e1bd-6efc-41b6-8a48-d86bad043b50 None None] MFA Rules not processed for user `42e76bc6e556419a8aecc982352abdd7`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:08.350402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9942e1bd-6efc-41b6-8a48-d86bad043b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:08.356227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:08.416280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f18f4-fa32-4cd9-b5cb-d38de20010dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.416975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f18f4-fa32-4cd9-b5cb-d38de20010dc admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.417259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f18f4-fa32-4cd9-b5cb-d38de20010dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.417539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f18f4-fa32-4cd9-b5cb-d38de20010dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.418249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f18f4-fa32-4cd9-b5cb-d38de20010dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.420120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f18f4-fa32-4cd9-b5cb-d38de20010dc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.431940 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1165/2364] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:16:08.436492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f18f4-fa32-4cd9-b5cb-d38de20010dc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:08.446831 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1200/2365] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:08.447907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f18f4-fa32-4cd9-b5cb-d38de20010dc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.453934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d476dd2-2e41-4cc9-862e-a8f5d57f9e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.454628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476dd2-2e41-4cc9-862e-a8f5d57f9e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.454912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476dd2-2e41-4cc9-862e-a8f5d57f9e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.455178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476dd2-2e41-4cc9-862e-a8f5d57f9e4d admin admin] PATH_INFO: `/v3/projects/a951461e378b448895fc246887887b18/users/3e31ae31e0f4455c9e163e1ee9b91198/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.460486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e1bd-6efc-41b6-8a48-d86bad043b50 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:08.462189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9942e1bd-6efc-41b6-8a48-d86bad043b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:08.472773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d476dd2-2e41-4cc9-862e-a8f5d57f9e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a951461e378b448895fc246887887b18, user_id=3e31ae31e0f4455c9e163e1ee9b91198, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.476049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d476dd2-2e41-4cc9-862e-a8f5d57f9e4d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.498892 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1166/2366] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:08 2022] PUT /identity/v3/projects/a951461e378b448895fc246887887b18/users/3e31ae31e0f4455c9e163e1ee9b91198/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:08.511795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a68e-9ba7-4716-abf8-57c66ea95fee None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.511795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a68e-9ba7-4716-abf8-57c66ea95fee None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.511987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0a68e-9ba7-4716-abf8-57c66ea95fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.552687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a9a0a68e-9ba7-4716-abf8-57c66ea95fee None None] MFA Rules not processed for user `3e31ae31e0f4455c9e163e1ee9b91198`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:08.554079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a9a0a68e-9ba7-4716-abf8-57c66ea95fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:08.576300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e1bd-6efc-41b6-8a48-d86bad043b50 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.603105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:08.685707 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1167/2367] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:08.690882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0a68e-9ba7-4716-abf8-57c66ea95fee None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:08.712608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e370c-ab73-48b3-a897-256ac47c41ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.713333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e370c-ab73-48b3-a897-256ac47c41ee service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.713518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e370c-ab73-48b3-a897-256ac47c41ee service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.715968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e370c-ab73-48b3-a897-256ac47c41ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.718068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4e1e370c-ab73-48b3-a897-256ac47c41ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:08.789049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0a68e-9ba7-4716-abf8-57c66ea95fee None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.799124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4bada-3d51-4f5c-9850-5cce08549621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.799124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4bada-3d51-4f5c-9850-5cce08549621 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.799124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4bada-3d51-4f5c-9850-5cce08549621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.799124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4bada-3d51-4f5c-9850-5cce08549621 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.799749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4bada-3d51-4f5c-9850-5cce08549621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.803597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4bada-3d51-4f5c-9850-5cce08549621 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.809538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e370c-ab73-48b3-a897-256ac47c41ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.812772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e370c-ab73-48b3-a897-256ac47c41ee service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:08.832820 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1201/2368] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:08.858052 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1168/2369] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:08 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:08.860492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e370c-ab73-48b3-a897-256ac47c41ee service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:08.879422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e370c-ab73-48b3-a897-256ac47c41ee service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:08.974575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b37b26-7634-48e2-930a-5c714cfe8cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:08.975524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b37b26-7634-48e2-930a-5c714cfe8cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:08.975839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b37b26-7634-48e2-930a-5c714cfe8cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:08.976087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b37b26-7634-48e2-930a-5c714cfe8cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:08.976746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b37b26-7634-48e2-930a-5c714cfe8cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:08.978762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b37b26-7634-48e2-930a-5c714cfe8cb4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:09.012176 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1202/2370] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:08 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:09.016572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4bada-3d51-4f5c-9850-5cce08549621 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:09.030408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4bada-3d51-4f5c-9850-5cce08549621 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:09.046468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680ecee-3b4f-4b66-9f4e-f18651df426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:09.047867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680ecee-3b4f-4b66-9f4e-f18651df426a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:09.048457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680ecee-3b4f-4b66-9f4e-f18651df426a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:09.049215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680ecee-3b4f-4b66-9f4e-f18651df426a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:09.050275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680ecee-3b4f-4b66-9f4e-f18651df426a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:09.053103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680ecee-3b4f-4b66-9f4e-f18651df426a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:09.070532 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1169/2371] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:09.075684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b37b26-7634-48e2-930a-5c714cfe8cb4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:09.090945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b37b26-7634-48e2-930a-5c714cfe8cb4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:09.097308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2a0ec-b409-4d53-a55c-b00cffb5e59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:09.098032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2a0ec-b409-4d53-a55c-b00cffb5e59f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:09.098293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2a0ec-b409-4d53-a55c-b00cffb5e59f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:09.098562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2a0ec-b409-4d53-a55c-b00cffb5e59f admin admin] PATH_INFO: `/v3/projects/9364fb82ed8c48a39ad46a158308ad6a/users/ba4d8d2a08194704b8934447d298fd8e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:09.120085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2a0ec-b409-4d53-a55c-b00cffb5e59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9364fb82ed8c48a39ad46a158308ad6a, user_id=ba4d8d2a08194704b8934447d298fd8e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:09.123407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2a0ec-b409-4d53-a55c-b00cffb5e59f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:09.150215 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1203/2372] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:09 2022] PUT /identity/v3/projects/9364fb82ed8c48a39ad46a158308ad6a/users/ba4d8d2a08194704b8934447d298fd8e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:09.154121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680ecee-3b4f-4b66-9f4e-f18651df426a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:09.160714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:09.168643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680ecee-3b4f-4b66-9f4e-f18651df426a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:09.262282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45235b57-5a13-4e7e-9d83-4729ec1bc7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:09.263207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45235b57-5a13-4e7e-9d83-4729ec1bc7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:09.263504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45235b57-5a13-4e7e-9d83-4729ec1bc7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:09.263759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45235b57-5a13-4e7e-9d83-4729ec1bc7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:09.264596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45235b57-5a13-4e7e-9d83-4729ec1bc7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:09.266543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45235b57-5a13-4e7e-9d83-4729ec1bc7f9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:09.304758 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1170/2373] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:09.318615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2a0ec-b409-4d53-a55c-b00cffb5e59f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:09.341027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2a0ec-b409-4d53-a55c-b00cffb5e59f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:09.349597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3a1ba-df1d-4a60-9b01-a916c95d8894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:09.350756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3a1ba-df1d-4a60-9b01-a916c95d8894 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:09.351037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3a1ba-df1d-4a60-9b01-a916c95d8894 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:09.351312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3a1ba-df1d-4a60-9b01-a916c95d8894 admin admin] PATH_INFO: `/v3/projects/9364fb82ed8c48a39ad46a158308ad6a/users/ba4d8d2a08194704b8934447d298fd8e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:09.353467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3a1ba-df1d-4a60-9b01-a916c95d8894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9364fb82ed8c48a39ad46a158308ad6a, user_id=ba4d8d2a08194704b8934447d298fd8e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:09.356248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3a1ba-df1d-4a60-9b01-a916c95d8894 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:09.374720 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1204/2374] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:09 2022] PUT /identity/v3/projects/9364fb82ed8c48a39ad46a158308ad6a/users/ba4d8d2a08194704b8934447d298fd8e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:09.388564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d41d3-1b32-4741-8396-1d69f61be3a1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:09.388931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d41d3-1b32-4741-8396-1d69f61be3a1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:09.389135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d41d3-1b32-4741-8396-1d69f61be3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:09.470128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-390d41d3-1b32-4741-8396-1d69f61be3a1 None None] MFA Rules not processed for user `ba4d8d2a08194704b8934447d298fd8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:09.471931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-390d41d3-1b32-4741-8396-1d69f61be3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:09.580195 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1171/2375] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:09 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:09.702540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3a1ba-df1d-4a60-9b01-a916c95d8894 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:09.721610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:09.811197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3a1ba-df1d-4a60-9b01-a916c95d8894 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:09.820291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7af7-e7b2-4c93-8421-9d6b3a12cfc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:09.821028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7af7-e7b2-4c93-8421-9d6b3a12cfc1 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:09.821383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7af7-e7b2-4c93-8421-9d6b3a12cfc1 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:09.823216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7af7-e7b2-4c93-8421-9d6b3a12cfc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:09.836185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef7af7-e7b2-4c93-8421-9d6b3a12cfc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:09.838631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef7af7-e7b2-4c93-8421-9d6b3a12cfc1 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:09.852728 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1205/2376] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:09.915095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d41d3-1b32-4741-8396-1d69f61be3a1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:09.929849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d41d3-1b32-4741-8396-1d69f61be3a1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:09.936449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bd1f-8e22-41b0-ac95-fdabf358ea78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:09.937368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bd1f-8e22-41b0-ac95-fdabf358ea78 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:09.937566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bd1f-8e22-41b0-ac95-fdabf358ea78 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:09.937785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bd1f-8e22-41b0-ac95-fdabf358ea78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:10.047947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52bd1f-8e22-41b0-ac95-fdabf358ea78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:10.049942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52bd1f-8e22-41b0-ac95-fdabf358ea78 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:10.075554 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1172/2377] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:10.460256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7af7-e7b2-4c93-8421-9d6b3a12cfc1 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:10.478675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7af7-e7b2-4c93-8421-9d6b3a12cfc1 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:10.495887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21cbe4-c8a1-47e8-b86b-ba6e9d1453ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:10.496647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21cbe4-c8a1-47e8-b86b-ba6e9d1453ae service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:10.496923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21cbe4-c8a1-47e8-b86b-ba6e9d1453ae service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:10.497193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21cbe4-c8a1-47e8-b86b-ba6e9d1453ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:10.499309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3b21cbe4-c8a1-47e8-b86b-ba6e9d1453ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:10.592562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21cbe4-c8a1-47e8-b86b-ba6e9d1453ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:10.595592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21cbe4-c8a1-47e8-b86b-ba6e9d1453ae service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:10.612912 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1206/2378] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:11.005930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bd1f-8e22-41b0-ac95-fdabf358ea78 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:11.028625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:11.088501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bd1f-8e22-41b0-ac95-fdabf358ea78 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:11.093267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:11.093923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:11.094198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:11.094465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] PATH_INFO: `/v3/users/3e31ae31e0f4455c9e163e1ee9b91198` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:11.095575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e31ae31e0f4455c9e163e1ee9b91198)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:11.097527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:11.175358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e31ae31e0f4455c9e163e1ee9b91198'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:11.183252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e31ae31e0f4455c9e163e1ee9b91198'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:11.196176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e31ae31e0f4455c9e163e1ee9b91198'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:11.204933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e31ae31e0f4455c9e163e1ee9b91198'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:11.206150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e31ae31e0f4455c9e163e1ee9b91198'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:11.213014 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1173/2379] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:11 2022] DELETE /identity/v3/users/3e31ae31e0f4455c9e163e1ee9b91198 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:11.217646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6820f-ac9b-4f1d-9e37-1063fd3cf23b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:11.218054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6820f-ac9b-4f1d-9e37-1063fd3cf23b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:11.218396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6820f-ac9b-4f1d-9e37-1063fd3cf23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:11.238871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a9e6820f-ac9b-4f1d-9e37-1063fd3cf23b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:11.240268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a9e6820f-ac9b-4f1d-9e37-1063fd3cf23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:11.314909 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1207/2380] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:11.326574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:11.328492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:11.437745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7b576-f176-458c-8224-0e72a112ec91 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:11.454639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd952c38-e108-4fb6-8ef0-58e351986291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:11.455435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd952c38-e108-4fb6-8ef0-58e351986291 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:11.455855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd952c38-e108-4fb6-8ef0-58e351986291 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:11.456139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd952c38-e108-4fb6-8ef0-58e351986291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:11.470665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd952c38-e108-4fb6-8ef0-58e351986291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:11.472167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd952c38-e108-4fb6-8ef0-58e351986291 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:11.485257 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1174/2381] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:11.815850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6820f-ac9b-4f1d-9e37-1063fd3cf23b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:11.815850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a9e6820f-ac9b-4f1d-9e37-1063fd3cf23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:11.824583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6820f-ac9b-4f1d-9e37-1063fd3cf23b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:11.828408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45e95d-54dc-4482-9cd2-1e28b9000c54 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:11.828693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45e95d-54dc-4482-9cd2-1e28b9000c54 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:11.828950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45e95d-54dc-4482-9cd2-1e28b9000c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:11.839230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:11.839905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:11.840168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:11.840443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] PATH_INFO: `/v3/projects/a951461e378b448895fc246887887b18` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:11.842200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a951461e378b448895fc246887887b18)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:11.844407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:11.864067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8a45e95d-54dc-4482-9cd2-1e28b9000c54 None None] MFA Rules not processed for user `0b4617ac955e438c979ca0938ee117c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:11.865394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8a45e95d-54dc-4482-9cd2-1e28b9000c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:11.911571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:11.928989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:11.944309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a951461e378b448895fc246887887b18', 'request_id': 'req-77c3691f-ec91-4635-bd36-8cfcfcba3453'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:11.958466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a951461e378b448895fc246887887b18', 'request_id': 'req-77c3691f-ec91-4635-bd36-8cfcfcba3453'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:11.964704 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1175/2382] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:11.971454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a951461e378b448895fc246887887b18', 'request_id': 'req-77c3691f-ec91-4635-bd36-8cfcfcba3453'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:11.988814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] The token cache is being invalidate because project a951461e378b448895fc246887887b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:11.989110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:11.990358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:11.991893 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1208/2383] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:11 2022] DELETE /identity/v3/projects/a951461e378b448895fc246887887b18 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:11.996131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45e95d-54dc-4482-9cd2-1e28b9000c54 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:12.009062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45e95d-54dc-4482-9cd2-1e28b9000c54 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:12.110710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:12.111309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:12.111589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:12.111855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] PATH_INFO: `/v3/users/ba4d8d2a08194704b8934447d298fd8e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:12.113067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba4d8d2a08194704b8934447d298fd8e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:12.116191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:12.194735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba4d8d2a08194704b8934447d298fd8e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:12.210205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba4d8d2a08194704b8934447d298fd8e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:12.223664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba4d8d2a08194704b8934447d298fd8e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:12.235326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba4d8d2a08194704b8934447d298fd8e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:12.235977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb764fea-1053-4c7a-8085-66ecae4d3b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba4d8d2a08194704b8934447d298fd8e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:12.262377 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1176/2384] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:11 2022] DELETE /identity/v3/users/ba4d8d2a08194704b8934447d298fd8e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:12.810429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:12.816771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:12.852473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3691f-ec91-4635-bd36-8cfcfcba3453 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:12.954087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:12.955030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:12.955308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:12.955578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] PATH_INFO: `/v3/projects/9364fb82ed8c48a39ad46a158308ad6a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:12.956927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9364fb82ed8c48a39ad46a158308ad6a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:12.959472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:13.040208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9364fb82ed8c48a39ad46a158308ad6a', 'request_id': 'req-7908e5f1-cb1d-4a46-910e-382e74ef1b24'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:13.047465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9364fb82ed8c48a39ad46a158308ad6a', 'request_id': 'req-7908e5f1-cb1d-4a46-910e-382e74ef1b24'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:13.056256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9364fb82ed8c48a39ad46a158308ad6a', 'request_id': 'req-7908e5f1-cb1d-4a46-910e-382e74ef1b24'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:13.068906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] The token cache is being invalidate because project 9364fb82ed8c48a39ad46a158308ad6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:13.069272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:13.069902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7908e5f1-cb1d-4a46-910e-382e74ef1b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:13.071445 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1209/2385] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:12 2022] DELETE /identity/v3/projects/9364fb82ed8c48a39ad46a158308ad6a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:13.076577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c384-9e4a-435d-979a-008228f7239d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:13.077613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c384-9e4a-435d-979a-008228f7239d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:13.078228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c384-9e4a-435d-979a-008228f7239d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:13.099973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0d25c384-9e4a-435d-979a-008228f7239d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:13.101316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0d25c384-9e4a-435d-979a-008228f7239d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:13.175848 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1177/2386] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:13.183763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d949-6f2c-4159-8d33-f9da82687371 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:13.184052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d949-6f2c-4159-8d33-f9da82687371 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:13.184370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d949-6f2c-4159-8d33-f9da82687371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:13.205190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e0f9d949-6f2c-4159-8d33-f9da82687371 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:13.206548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e0f9d949-6f2c-4159-8d33-f9da82687371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:13.216639 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1210/2387] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:13.221222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25c384-9e4a-435d-979a-008228f7239d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:13.227921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:13.232170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25c384-9e4a-435d-979a-008228f7239d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:13.238167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea84ac-7dc5-488c-9555-38ebe748f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:13.238792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea84ac-7dc5-488c-9555-38ebe748f338 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:13.239239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea84ac-7dc5-488c-9555-38ebe748f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:13.239505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea84ac-7dc5-488c-9555-38ebe748f338 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:13.240281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea84ac-7dc5-488c-9555-38ebe748f338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:13.240586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea84ac-7dc5-488c-9555-38ebe748f338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:13.242771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea84ac-7dc5-488c-9555-38ebe748f338 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:13.263671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d949-6f2c-4159-8d33-f9da82687371 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:13.266088 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1178/2388] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:13.275467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d949-6f2c-4159-8d33-f9da82687371 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:13.282399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc03af-14c3-496f-bb34-6cafce4c9c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:13.283581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc03af-14c3-496f-bb34-6cafce4c9c41 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:13.284905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc03af-14c3-496f-bb34-6cafce4c9c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:13.285186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc03af-14c3-496f-bb34-6cafce4c9c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:13.286345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc03af-14c3-496f-bb34-6cafce4c9c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:13.290937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc03af-14c3-496f-bb34-6cafce4c9c41 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:13.323164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1211/2389] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:13 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:13.327588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea84ac-7dc5-488c-9555-38ebe748f338 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:13.344104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea84ac-7dc5-488c-9555-38ebe748f338 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:13.421648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388d8f4-3b06-4143-9fbf-025696175b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:13.422572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388d8f4-3b06-4143-9fbf-025696175b53 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:13.422849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388d8f4-3b06-4143-9fbf-025696175b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:13.423112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388d8f4-3b06-4143-9fbf-025696175b53 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:13.423751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388d8f4-3b06-4143-9fbf-025696175b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:13.426566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388d8f4-3b06-4143-9fbf-025696175b53 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:13.462389 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1179/2390] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:13 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:13.472350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc03af-14c3-496f-bb34-6cafce4c9c41 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:13.489047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc03af-14c3-496f-bb34-6cafce4c9c41 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:13.498356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa4919-5f1c-403e-a374-cd1bfe396ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:13.498967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa4919-5f1c-403e-a374-cd1bfe396ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:13.499241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa4919-5f1c-403e-a374-cd1bfe396ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:13.499588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa4919-5f1c-403e-a374-cd1bfe396ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:13.500297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa4919-5f1c-403e-a374-cd1bfe396ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:13.510230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa4919-5f1c-403e-a374-cd1bfe396ce3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:13.525578 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1212/2391] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:13.529579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388d8f4-3b06-4143-9fbf-025696175b53 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:13.545839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388d8f4-3b06-4143-9fbf-025696175b53 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:13.555655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b6622-36c8-4e70-8ea0-f53223b87b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:13.556955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b6622-36c8-4e70-8ea0-f53223b87b2f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:13.557562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b6622-36c8-4e70-8ea0-f53223b87b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:13.558266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b6622-36c8-4e70-8ea0-f53223b87b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:13.559173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b6622-36c8-4e70-8ea0-f53223b87b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:13.561048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b6622-36c8-4e70-8ea0-f53223b87b2f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:13.579139 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1180/2392] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:13.583714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa4919-5f1c-403e-a374-cd1bfe396ce3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:13.597053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:13.606401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa4919-5f1c-403e-a374-cd1bfe396ce3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:13.614247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfe56f-dfff-4b86-a452-86a9dc344e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:13.615006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfe56f-dfff-4b86-a452-86a9dc344e21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:13.615947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfe56f-dfff-4b86-a452-86a9dc344e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:13.615947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfe56f-dfff-4b86-a452-86a9dc344e21 admin admin] PATH_INFO: `/v3/projects/3caefa6310054ae7ab6c31d54fea75f2/users/25e71ce234c744f5b6ed29ed1a4d2172/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:13.635288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfe56f-dfff-4b86-a452-86a9dc344e21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3caefa6310054ae7ab6c31d54fea75f2, user_id=25e71ce234c744f5b6ed29ed1a4d2172, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:13.638191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfe56f-dfff-4b86-a452-86a9dc344e21 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:13.658515 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1213/2393] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:13 2022] PUT /identity/v3/projects/3caefa6310054ae7ab6c31d54fea75f2/users/25e71ce234c744f5b6ed29ed1a4d2172/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:13.669546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a4f93-e122-4702-9d8f-d666a33408a1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:13.669849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a4f93-e122-4702-9d8f-d666a33408a1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:13.670202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a4f93-e122-4702-9d8f-d666a33408a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:13.703210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-523a4f93-e122-4702-9d8f-d666a33408a1 None None] MFA Rules not processed for user `25e71ce234c744f5b6ed29ed1a4d2172`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:13.705560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-523a4f93-e122-4702-9d8f-d666a33408a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:13.790931 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1181/2394] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:13.793557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfe56f-dfff-4b86-a452-86a9dc344e21 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:13.915272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfe56f-dfff-4b86-a452-86a9dc344e21 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:13.930605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b4471-31d8-4e65-aa13-5301e82d4287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:13.931250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b4471-31d8-4e65-aa13-5301e82d4287 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:13.931524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b4471-31d8-4e65-aa13-5301e82d4287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:13.931789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b4471-31d8-4e65-aa13-5301e82d4287 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:13.932439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b4471-31d8-4e65-aa13-5301e82d4287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:13.934427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b4471-31d8-4e65-aa13-5301e82d4287 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:13.970718 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1214/2395] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:13 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:13.972837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a4f93-e122-4702-9d8f-d666a33408a1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:13.988487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a4f93-e122-4702-9d8f-d666a33408a1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:14.076445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219658c-f684-4347-92f1-ee620b43257f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:14.077409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219658c-f684-4347-92f1-ee620b43257f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:14.078722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219658c-f684-4347-92f1-ee620b43257f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:14.078722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219658c-f684-4347-92f1-ee620b43257f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:14.078722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219658c-f684-4347-92f1-ee620b43257f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:14.080855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219658c-f684-4347-92f1-ee620b43257f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:14.092066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:14.113590 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1182/2396] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:13 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:14.117744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b4471-31d8-4e65-aa13-5301e82d4287 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:14.138429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b4471-31d8-4e65-aa13-5301e82d4287 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:14.147402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853da7b-166f-4f57-ae4a-15a141a7a10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:14.149160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853da7b-166f-4f57-ae4a-15a141a7a10e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:14.149489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853da7b-166f-4f57-ae4a-15a141a7a10e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:14.150019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853da7b-166f-4f57-ae4a-15a141a7a10e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:14.150771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853da7b-166f-4f57-ae4a-15a141a7a10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:14.152318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853da7b-166f-4f57-ae4a-15a141a7a10e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:14.187794 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1215/2397] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:14.191542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219658c-f684-4347-92f1-ee620b43257f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:14.204918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219658c-f684-4347-92f1-ee620b43257f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:14.225899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2ec3f-859f-4464-82e8-e1fa5343413d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:14.226745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2ec3f-859f-4464-82e8-e1fa5343413d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:14.227021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2ec3f-859f-4464-82e8-e1fa5343413d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:14.227292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2ec3f-859f-4464-82e8-e1fa5343413d admin admin] PATH_INFO: `/v3/projects/53baaa5303854b56928ffe1e56e46ba7/users/8f8a4728c2bf4a49b3a7c61521b91203/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:14.245328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2ec3f-859f-4464-82e8-e1fa5343413d admin admin] RBAC: Authorizing `identity:create_grant(project_id=53baaa5303854b56928ffe1e56e46ba7, user_id=8f8a4728c2bf4a49b3a7c61521b91203, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:14.248832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2ec3f-859f-4464-82e8-e1fa5343413d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:14.270160 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1183/2398] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:14 2022] PUT /identity/v3/projects/53baaa5303854b56928ffe1e56e46ba7/users/8f8a4728c2bf4a49b3a7c61521b91203/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:14.272086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853da7b-166f-4f57-ae4a-15a141a7a10e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:14.294497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853da7b-166f-4f57-ae4a-15a141a7a10e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:14.378982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b77326-e8e9-4a9b-9205-b35d7aea38d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:14.379682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b77326-e8e9-4a9b-9205-b35d7aea38d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:14.379962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b77326-e8e9-4a9b-9205-b35d7aea38d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:14.380229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b77326-e8e9-4a9b-9205-b35d7aea38d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:14.381830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b77326-e8e9-4a9b-9205-b35d7aea38d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:14.384240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b77326-e8e9-4a9b-9205-b35d7aea38d0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:14.414824 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1216/2399] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:14.419062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2ec3f-859f-4464-82e8-e1fa5343413d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:14.443631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2ec3f-859f-4464-82e8-e1fa5343413d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:14.453170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6118-cc13-4172-bf2a-81c88a150d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:14.453170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6118-cc13-4172-bf2a-81c88a150d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:14.453540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6118-cc13-4172-bf2a-81c88a150d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:14.453711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b6118-cc13-4172-bf2a-81c88a150d9a admin admin] PATH_INFO: `/v3/projects/53baaa5303854b56928ffe1e56e46ba7/users/8f8a4728c2bf4a49b3a7c61521b91203/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:14.459903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b6118-cc13-4172-bf2a-81c88a150d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53baaa5303854b56928ffe1e56e46ba7, user_id=8f8a4728c2bf4a49b3a7c61521b91203, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:14.464806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b6118-cc13-4172-bf2a-81c88a150d9a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:14.515874 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1184/2400] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:14 2022] PUT /identity/v3/projects/53baaa5303854b56928ffe1e56e46ba7/users/8f8a4728c2bf4a49b3a7c61521b91203/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:14.530655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cccb49-6a54-4bc7-b7ed-246cbebe77cd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:14.532695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cccb49-6a54-4bc7-b7ed-246cbebe77cd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:14.534069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cccb49-6a54-4bc7-b7ed-246cbebe77cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:14.603478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-63cccb49-6a54-4bc7-b7ed-246cbebe77cd None None] MFA Rules not processed for user `8f8a4728c2bf4a49b3a7c61521b91203`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:14.604882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-63cccb49-6a54-4bc7-b7ed-246cbebe77cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:14.703341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:14.753932 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1217/2401] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:14.931437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6118-cc13-4172-bf2a-81c88a150d9a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:14.933700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aa1b6118-cc13-4172-bf2a-81c88a150d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:15.079233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b6118-cc13-4172-bf2a-81c88a150d9a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:15.087563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e949-bdf6-4d0a-b024-fba68fa7d5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:15.088193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e949-bdf6-4d0a-b024-fba68fa7d5d8 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:15.088465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e949-bdf6-4d0a-b024-fba68fa7d5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:15.088730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e949-bdf6-4d0a-b024-fba68fa7d5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:15.116134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e949-bdf6-4d0a-b024-fba68fa7d5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:15.122403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e949-bdf6-4d0a-b024-fba68fa7d5d8 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:15.138903 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1185/2402] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:16.432143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cccb49-6a54-4bc7-b7ed-246cbebe77cd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.474358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e949-bdf6-4d0a-b024-fba68fa7d5d8 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:16.475889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7368e949-bdf6-4d0a-b024-fba68fa7d5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.592040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e949-bdf6-4d0a-b024-fba68fa7d5d8 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.601755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.603098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.603605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.604298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] PATH_INFO: `/v3/users/2bb4d535f8fb4c8fabb68a76ee062f44` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.606374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb4d535f8fb4c8fabb68a76ee062f44)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.609362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.622284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cccb49-6a54-4bc7-b7ed-246cbebe77cd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:16.628361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:16.629019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.629341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.629625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] PATH_INFO: `/v3/users/25e71ce234c744f5b6ed29ed1a4d2172` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.630961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e71ce234c744f5b6ed29ed1a4d2172)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:16.633018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:16.728831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:16.743341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb4d535f8fb4c8fabb68a76ee062f44'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:16.750778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e71ce234c744f5b6ed29ed1a4d2172'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:16.752418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e71ce234c744f5b6ed29ed1a4d2172'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:16.758067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb4d535f8fb4c8fabb68a76ee062f44'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:16.767461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e71ce234c744f5b6ed29ed1a4d2172'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:16.780247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e71ce234c744f5b6ed29ed1a4d2172'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:16.783642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb4d535f8fb4c8fabb68a76ee062f44'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:16.797169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b64e023-ef95-4583-8807-45e193a46c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e71ce234c744f5b6ed29ed1a4d2172'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:16.806796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb4d535f8fb4c8fabb68a76ee062f44'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:16.810415 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1218/2403] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:16 2022] DELETE /identity/v3/users/25e71ce234c744f5b6ed29ed1a4d2172 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:16.810932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbee93c2-22d1-45cb-9ab6-e0477a50548d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb4d535f8fb4c8fabb68a76ee062f44'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:16.812548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756971-e763-41c0-aee9-91b918cf19e1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.812936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756971-e763-41c0-aee9-91b918cf19e1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.813259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756971-e763-41c0-aee9-91b918cf19e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.830288 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1186/2404] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:16 2022] DELETE /identity/v3/users/2bb4d535f8fb4c8fabb68a76ee062f44 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:16.836210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35a11-07cf-4858-a58b-70deb371a634 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:16.836868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35a11-07cf-4858-a58b-70deb371a634 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:16.840045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b35a11-07cf-4858-a58b-70deb371a634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:16.854049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-51756971-e763-41c0-aee9-91b918cf19e1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.855224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51756971-e763-41c0-aee9-91b918cf19e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.874744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-36b35a11-07cf-4858-a58b-70deb371a634 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:16.877458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-36b35a11-07cf-4858-a58b-70deb371a634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:16.922833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:16.983663 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1219/2405] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:17.000132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756971-e763-41c0-aee9-91b918cf19e1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.004053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51756971-e763-41c0-aee9-91b918cf19e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:17.049548 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1187/2406] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:17.083527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35a11-07cf-4858-a58b-70deb371a634 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:17.085574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-36b35a11-07cf-4858-a58b-70deb371a634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:17.182882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756971-e763-41c0-aee9-91b918cf19e1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.194846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223855a-d0de-4dd5-a900-62f97d59bc73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.195558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223855a-d0de-4dd5-a900-62f97d59bc73 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.195836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223855a-d0de-4dd5-a900-62f97d59bc73 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.196093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223855a-d0de-4dd5-a900-62f97d59bc73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.218652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223855a-d0de-4dd5-a900-62f97d59bc73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.225416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223855a-d0de-4dd5-a900-62f97d59bc73 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.239193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b35a11-07cf-4858-a58b-70deb371a634 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:17.246493 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1220/2407] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:17.249600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9467fe0-2a12-4ece-994d-656ba41e76b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:17.251320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9467fe0-2a12-4ece-994d-656ba41e76b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:17.251772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9467fe0-2a12-4ece-994d-656ba41e76b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:17.252256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9467fe0-2a12-4ece-994d-656ba41e76b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:17.266628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9467fe0-2a12-4ece-994d-656ba41e76b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:17.268656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9467fe0-2a12-4ece-994d-656ba41e76b4 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:17.282000 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1188/2408] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:18.400432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223855a-d0de-4dd5-a900-62f97d59bc73 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.405239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6223855a-d0de-4dd5-a900-62f97d59bc73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.432766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223855a-d0de-4dd5-a900-62f97d59bc73 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.439238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.440214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.440660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.441020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] PATH_INFO: `/v3/projects/3caefa6310054ae7ab6c31d54fea75f2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.443871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3caefa6310054ae7ab6c31d54fea75f2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.451086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9467fe0-2a12-4ece-994d-656ba41e76b4 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.456502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e9467fe0-2a12-4ece-994d-656ba41e76b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.461371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.472194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9467fe0-2a12-4ece-994d-656ba41e76b4 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.479837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.481081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.481999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.482464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] PATH_INFO: `/v3/projects/699807c4380945e8a997a112a0fa94e0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.483916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=699807c4380945e8a997a112a0fa94e0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.486314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.568667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '699807c4380945e8a997a112a0fa94e0', 'request_id': 'req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.569810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3caefa6310054ae7ab6c31d54fea75f2', 'request_id': 'req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.575539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:18.582623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '699807c4380945e8a997a112a0fa94e0', 'request_id': 'req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.585805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3caefa6310054ae7ab6c31d54fea75f2', 'request_id': 'req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.593747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '699807c4380945e8a997a112a0fa94e0', 'request_id': 'req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.604284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3caefa6310054ae7ab6c31d54fea75f2', 'request_id': 'req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.621561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] The token cache is being invalidate because project 699807c4380945e8a997a112a0fa94e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:18.621898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.622637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.623937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] The token cache is being invalidate because project 3caefa6310054ae7ab6c31d54fea75f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:18.624459 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1189/2409] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:18 2022] DELETE /identity/v3/projects/699807c4380945e8a997a112a0fa94e0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:18.624597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.625315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.627793 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1221/2410] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:18 2022] DELETE /identity/v3/projects/3caefa6310054ae7ab6c31d54fea75f2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:18.631494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.632847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:18.640138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.642046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:18.770758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a918a08-09f5-43ca-84fa-cb4aee6a38e6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.779502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25e1b2-a179-4d5b-8837-0f8774b37cb0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:18.780643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.781400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.782564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.782906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] PATH_INFO: `/v3/users/0a0380b4330642e8a3ba9c00d6cbf36d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.784241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0380b4330642e8a3ba9c00d6cbf36d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.785344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:18.786038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:18.786333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:18.786624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] PATH_INFO: `/v3/users/8f8a4728c2bf4a49b3a7c61521b91203` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:18.788117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.788259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8a4728c2bf4a49b3a7c61521b91203)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:18.794071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:18.832551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:18.869081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0380b4330642e8a3ba9c00d6cbf36d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.874204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8a4728c2bf4a49b3a7c61521b91203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.874963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8a4728c2bf4a49b3a7c61521b91203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.877930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0380b4330642e8a3ba9c00d6cbf36d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.883091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8a4728c2bf4a49b3a7c61521b91203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.892505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8a4728c2bf4a49b3a7c61521b91203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.893944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0380b4330642e8a3ba9c00d6cbf36d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.904784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0380b4330642e8a3ba9c00d6cbf36d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.906881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0380b4330642e8a3ba9c00d6cbf36d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.912459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc6b3401-d780-4dfe-b781-5d706d8d8b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8a4728c2bf4a49b3a7c61521b91203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:18.915296 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1190/2411] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:18 2022] DELETE /identity/v3/users/0a0380b4330642e8a3ba9c00d6cbf36d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:18.921812 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1222/2412] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:18 2022] DELETE /identity/v3/users/8f8a4728c2bf4a49b3a7c61521b91203 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:19.001679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.003156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:19.154762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305cc0d5-97e8-4a67-8ab8-68e80a581555 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.166787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:19.260480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.261378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.261655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.261956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] PATH_INFO: `/v3/users/37fcb1984b1f491bb3aafc19186a7de6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.263239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37fcb1984b1f491bb3aafc19186a7de6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.265198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.357244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37fcb1984b1f491bb3aafc19186a7de6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.382372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37fcb1984b1f491bb3aafc19186a7de6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.400285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37fcb1984b1f491bb3aafc19186a7de6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.412875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37fcb1984b1f491bb3aafc19186a7de6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.412875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37fcb1984b1f491bb3aafc19186a7de6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.421922 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1191/2413] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:18 2022] DELETE /identity/v3/users/37fcb1984b1f491bb3aafc19186a7de6 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:19.426293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84577c-6cd2-4d05-82c7-73ced00f9618 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.427582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84577c-6cd2-4d05-82c7-73ced00f9618 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.428190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84577c-6cd2-4d05-82c7-73ced00f9618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.451599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3f84577c-6cd2-4d05-82c7-73ced00f9618 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:19.452922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3f84577c-6cd2-4d05-82c7-73ced00f9618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:19.535718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.537512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:19.577851 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1223/2414] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:19.599990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84577c-6cd2-4d05-82c7-73ced00f9618 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.601634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3f84577c-6cd2-4d05-82c7-73ced00f9618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:19.675050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bde89-9c24-445e-af99-64337f27e7b4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.680960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.681629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.681930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.682377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] PATH_INFO: `/v3/users/fbecd69d82634c898a7d90d64c2b4a92` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.683579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbecd69d82634c898a7d90d64c2b4a92)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.688081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.734171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84577c-6cd2-4d05-82c7-73ced00f9618 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.737440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:19.749299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330a442-52e3-4bd6-8502-d1eaa0016ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.750313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330a442-52e3-4bd6-8502-d1eaa0016ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.750666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330a442-52e3-4bd6-8502-d1eaa0016ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.751158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330a442-52e3-4bd6-8502-d1eaa0016ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.763341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbecd69d82634c898a7d90d64c2b4a92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.763579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330a442-52e3-4bd6-8502-d1eaa0016ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.764911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330a442-52e3-4bd6-8502-d1eaa0016ba9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.774045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbecd69d82634c898a7d90d64c2b4a92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.778121 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1224/2415] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:19.779023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330a442-52e3-4bd6-8502-d1eaa0016ba9 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.780390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5330a442-52e3-4bd6-8502-d1eaa0016ba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:19.794972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330a442-52e3-4bd6-8502-d1eaa0016ba9 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.801557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:19.802279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.802754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.803293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] PATH_INFO: `/v3/projects/9cd6bcc9ae944f6b80a6d32652f2f8b8` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.805311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd6bcc9ae944f6b80a6d32652f2f8b8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:19.807698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:19.810035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbecd69d82634c898a7d90d64c2b4a92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.822369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbecd69d82634c898a7d90d64c2b4a92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.823114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbecd69d82634c898a7d90d64c2b4a92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.834364 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1192/2416] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:19 2022] DELETE /identity/v3/users/fbecd69d82634c898a7d90d64c2b4a92 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:19.834364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:19.838983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:19.870200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:19.879401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd6bcc9ae944f6b80a6d32652f2f8b8', 'request_id': 'req-152ffefd-7337-44ba-adff-b756b8c07acb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.890554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd6bcc9ae944f6b80a6d32652f2f8b8', 'request_id': 'req-152ffefd-7337-44ba-adff-b756b8c07acb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.901195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd6bcc9ae944f6b80a6d32652f2f8b8', 'request_id': 'req-152ffefd-7337-44ba-adff-b756b8c07acb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.918923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] The token cache is being invalidate because project 9cd6bcc9ae944f6b80a6d32652f2f8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:19.920067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.920225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-152ffefd-7337-44ba-adff-b756b8c07acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:19.922520 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1225/2417] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:19 2022] DELETE /identity/v3/projects/9cd6bcc9ae944f6b80a6d32652f2f8b8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:19.923304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb453a4-1b3e-4322-9d9e-c8d3119866cc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:19.923586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb453a4-1b3e-4322-9d9e-c8d3119866cc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:19.923860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb453a4-1b3e-4322-9d9e-c8d3119866cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:19.944612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bfa9b-5f49-4f4f-bad1-412debd9ad02 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:19.962762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-deb453a4-1b3e-4322-9d9e-c8d3119866cc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:19.963917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-deb453a4-1b3e-4322-9d9e-c8d3119866cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.014938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.015673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.015945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.016210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] PATH_INFO: `/v3/projects/53baaa5303854b56928ffe1e56e46ba7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.017438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53baaa5303854b56928ffe1e56e46ba7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.019542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.043896 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1226/2418] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:20.045348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75507dac-eb00-4ca5-8602-0e5e1a90082c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.045634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75507dac-eb00-4ca5-8602-0e5e1a90082c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.045910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75507dac-eb00-4ca5-8602-0e5e1a90082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.071624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-75507dac-eb00-4ca5-8602-0e5e1a90082c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:20.072864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-75507dac-eb00-4ca5-8602-0e5e1a90082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.073609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53baaa5303854b56928ffe1e56e46ba7', 'request_id': 'req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.082604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53baaa5303854b56928ffe1e56e46ba7', 'request_id': 'req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.084391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:20.092660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53baaa5303854b56928ffe1e56e46ba7', 'request_id': 'req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.113913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] The token cache is being invalidate because project 53baaa5303854b56928ffe1e56e46ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:20.114222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.114912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.116962 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1193/2419] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:19 2022] DELETE /identity/v3/projects/53baaa5303854b56928ffe1e56e46ba7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:20.117946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.122248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.154298 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1227/2420] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:20.155255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75507dac-eb00-4ca5-8602-0e5e1a90082c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.162033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-75507dac-eb00-4ca5-8602-0e5e1a90082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.198544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8267b0-a1f5-4639-a3b8-d354b8b8355c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.204492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.205248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.205586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.205952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] PATH_INFO: `/v3/projects/e0ef8256626f4e4a96a5f107837e48bd` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.207270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ef8256626f4e4a96a5f107837e48bd)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.209576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.226939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75507dac-eb00-4ca5-8602-0e5e1a90082c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.230857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46792c0f-e2e1-4138-bbd2-fbf838c9e3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.231558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46792c0f-e2e1-4138-bbd2-fbf838c9e3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.231946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46792c0f-e2e1-4138-bbd2-fbf838c9e3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.232275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46792c0f-e2e1-4138-bbd2-fbf838c9e3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.234194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-46792c0f-e2e1-4138-bbd2-fbf838c9e3f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.248050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46792c0f-e2e1-4138-bbd2-fbf838c9e3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.250066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46792c0f-e2e1-4138-bbd2-fbf838c9e3f7 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.264169 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1228/2421] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:20.265614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8272b-780a-4d77-941c-55669b4135a6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.265996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8272b-780a-4d77-941c-55669b4135a6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.266346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8272b-780a-4d77-941c-55669b4135a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.269192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ef8256626f4e4a96a5f107837e48bd', 'request_id': 'req-c39e6a2b-815e-416f-bfe4-10d5abe222f8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.293733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cdc8272b-780a-4d77-941c-55669b4135a6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:20.294040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ef8256626f4e4a96a5f107837e48bd', 'request_id': 'req-c39e6a2b-815e-416f-bfe4-10d5abe222f8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.294688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cdc8272b-780a-4d77-941c-55669b4135a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.300895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:20.304052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ef8256626f4e4a96a5f107837e48bd', 'request_id': 'req-c39e6a2b-815e-416f-bfe4-10d5abe222f8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.319925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] The token cache is being invalidate because project e0ef8256626f4e4a96a5f107837e48bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:20.320352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.322757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c39e6a2b-815e-416f-bfe4-10d5abe222f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.325344 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1194/2422] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:20 2022] DELETE /identity/v3/projects/e0ef8256626f4e4a96a5f107837e48bd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:20.326803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb091-2fe3-4af3-8e70-2e6706e2d9fb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.327631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb091-2fe3-4af3-8e70-2e6706e2d9fb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.328680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb091-2fe3-4af3-8e70-2e6706e2d9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.351925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-06eeb091-2fe3-4af3-8e70-2e6706e2d9fb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:20.353204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-06eeb091-2fe3-4af3-8e70-2e6706e2d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.363373 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1229/2423] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:20.364254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8272b-780a-4d77-941c-55669b4135a6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.367325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cdc8272b-780a-4d77-941c-55669b4135a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.380204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8272b-780a-4d77-941c-55669b4135a6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.385919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.386663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.386962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.387234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] PATH_INFO: `/v3/users/42e76bc6e556419a8aecc982352abdd7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.388401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e76bc6e556419a8aecc982352abdd7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.390405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.429502 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1195/2424] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:20.431158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706e048-fccb-416e-9bac-393f36b5cd19 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.431158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706e048-fccb-416e-9bac-393f36b5cd19 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.431367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706e048-fccb-416e-9bac-393f36b5cd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.456786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6706e048-fccb-416e-9bac-393f36b5cd19 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:20.458091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6706e048-fccb-416e-9bac-393f36b5cd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.459260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e76bc6e556419a8aecc982352abdd7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.460210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e76bc6e556419a8aecc982352abdd7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.467945 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1196/2425] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:20.469057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e76bc6e556419a8aecc982352abdd7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.469279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706e048-fccb-416e-9bac-393f36b5cd19 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.479857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706e048-fccb-416e-9bac-393f36b5cd19 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.481987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e76bc6e556419a8aecc982352abdd7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.484736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7205f-4acf-4bf1-81b1-d55e0631ec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.485446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7205f-4acf-4bf1-81b1-d55e0631ec8a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.485796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7205f-4acf-4bf1-81b1-d55e0631ec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.486168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7205f-4acf-4bf1-81b1-d55e0631ec8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.486826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7205f-4acf-4bf1-81b1-d55e0631ec8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:20.487119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7205f-4acf-4bf1-81b1-d55e0631ec8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.488738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7205f-4acf-4bf1-81b1-d55e0631ec8a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.492313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:20.512384 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1197/2426] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:20.512384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7205f-4acf-4bf1-81b1-d55e0631ec8a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.512880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e76bc6e556419a8aecc982352abdd7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.521586 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1230/2427] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:20 2022] DELETE /identity/v3/users/42e76bc6e556419a8aecc982352abdd7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:20.522499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.529642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.533152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7205f-4acf-4bf1-81b1-d55e0631ec8a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.594417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d7cc6-387c-479b-9e8c-a7b65cbc60bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.595204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d7cc6-387c-479b-9e8c-a7b65cbc60bd admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.595336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d7cc6-387c-479b-9e8c-a7b65cbc60bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.595554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d7cc6-387c-479b-9e8c-a7b65cbc60bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.596232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d7cc6-387c-479b-9e8c-a7b65cbc60bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:20.596536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d7cc6-387c-479b-9e8c-a7b65cbc60bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.598357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d7cc6-387c-479b-9e8c-a7b65cbc60bd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.612749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17406d-27eb-40dc-bf78-018a813e3b86 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.617861 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1198/2428] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:20.617861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d7cc6-387c-479b-9e8c-a7b65cbc60bd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.620889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-820d7cc6-387c-479b-9e8c-a7b65cbc60bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.623347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.623347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.623585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.626336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] PATH_INFO: `/v3/projects/b642a546a54f44af8a1af9be3b7e3367` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.627834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b642a546a54f44af8a1af9be3b7e3367)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.631814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.642844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d7cc6-387c-479b-9e8c-a7b65cbc60bd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.651961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaa304-0743-4b1d-bb11-4ecc60c3acc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.652590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaa304-0743-4b1d-bb11-4ecc60c3acc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.652862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaa304-0743-4b1d-bb11-4ecc60c3acc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.653122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaa304-0743-4b1d-bb11-4ecc60c3acc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.653984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaa304-0743-4b1d-bb11-4ecc60c3acc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.656262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcaa304-0743-4b1d-bb11-4ecc60c3acc7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.694760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:20.701865 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1199/2429] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:20 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:20.703011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaa304-0743-4b1d-bb11-4ecc60c3acc7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.705466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fbcaa304-0743-4b1d-bb11-4ecc60c3acc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.722371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b642a546a54f44af8a1af9be3b7e3367', 'request_id': 'req-9708178a-70d3-494f-9bec-fe4f10b8eb90'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.734335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b642a546a54f44af8a1af9be3b7e3367', 'request_id': 'req-9708178a-70d3-494f-9bec-fe4f10b8eb90'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.747258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b642a546a54f44af8a1af9be3b7e3367', 'request_id': 'req-9708178a-70d3-494f-9bec-fe4f10b8eb90'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.769173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] The token cache is being invalidate because project b642a546a54f44af8a1af9be3b7e3367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:20.769487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.770314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:20.775223 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1231/2430] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:20 2022] DELETE /identity/v3/projects/b642a546a54f44af8a1af9be3b7e3367 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:20.775223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.775223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.800391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaa304-0743-4b1d-bb11-4ecc60c3acc7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.852262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708178a-70d3-494f-9bec-fe4f10b8eb90 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.858328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4aa2b-95ae-4818-8b98-a32e21349844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.859098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4aa2b-95ae-4818-8b98-a32e21349844 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.859389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4aa2b-95ae-4818-8b98-a32e21349844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.859662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4aa2b-95ae-4818-8b98-a32e21349844 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.860908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4aa2b-95ae-4818-8b98-a32e21349844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.863215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4aa2b-95ae-4818-8b98-a32e21349844 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.874159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3aa86c-0897-40c3-8a9a-b1b59051f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.874934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aa86c-0897-40c3-8a9a-b1b59051f5ba admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.875275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aa86c-0897-40c3-8a9a-b1b59051f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.875603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aa86c-0897-40c3-8a9a-b1b59051f5ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.876744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3aa86c-0897-40c3-8a9a-b1b59051f5ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.878454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3aa86c-0897-40c3-8a9a-b1b59051f5ba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:20.895091 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1232/2431] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:20 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:20.895977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4aa2b-95ae-4818-8b98-a32e21349844 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.899115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1dd4aa2b-95ae-4818-8b98-a32e21349844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.902673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:20.915332 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1200/2432] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:20 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:20.915332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3aa86c-0897-40c3-8a9a-b1b59051f5ba admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:20.915736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4aa2b-95ae-4818-8b98-a32e21349844 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:20.917691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9b3aa86c-0897-40c3-8a9a-b1b59051f5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:20.987585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:20.988501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:20.988908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:20.989187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] PATH_INFO: `/v3/projects/fc38f63570864fd9ac6ec6d43e7986e6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:20.990455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc38f63570864fd9ac6ec6d43e7986e6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:20.992602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.000425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3aa86c-0897-40c3-8a9a-b1b59051f5ba admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.006225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.006881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.007252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.007512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] PATH_INFO: `/v3/users/c289de3eaaad401aaca399ed47027075` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.008967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c289de3eaaad401aaca399ed47027075)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.010959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.064649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:21.068848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc38f63570864fd9ac6ec6d43e7986e6', 'request_id': 'req-0e19e7d3-e7bf-4050-87d5-36ec31597178'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.082198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c289de3eaaad401aaca399ed47027075'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.084173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc38f63570864fd9ac6ec6d43e7986e6', 'request_id': 'req-0e19e7d3-e7bf-4050-87d5-36ec31597178'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.091055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c289de3eaaad401aaca399ed47027075'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.095294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc38f63570864fd9ac6ec6d43e7986e6', 'request_id': 'req-0e19e7d3-e7bf-4050-87d5-36ec31597178'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.105348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c289de3eaaad401aaca399ed47027075'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.108193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] The token cache is being invalidate because project fc38f63570864fd9ac6ec6d43e7986e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:21.108492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.109466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.111077 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1233/2433] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:20 2022] DELETE /identity/v3/projects/fc38f63570864fd9ac6ec6d43e7986e6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:21.111855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.113432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.117288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c289de3eaaad401aaca399ed47027075'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.117969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c289de3eaaad401aaca399ed47027075'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.126333 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1201/2434] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:20 2022] DELETE /identity/v3/users/c289de3eaaad401aaca399ed47027075 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:21.130054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.131639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.200602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19e7d3-e7bf-4050-87d5-36ec31597178 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.217044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1bc11-6f41-4838-86c3-6ea93d81d4ab admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.222896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca675d-d6c2-4df5-af68-21416dd9d8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.223796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca675d-d6c2-4df5-af68-21416dd9d8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.224223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca675d-d6c2-4df5-af68-21416dd9d8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.224716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca675d-d6c2-4df5-af68-21416dd9d8d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.225536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca675d-d6c2-4df5-af68-21416dd9d8d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.228122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca675d-d6c2-4df5-af68-21416dd9d8d4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.278290 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1202/2435] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:21.279903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1f6fc-da02-4cfc-b590-408c63645f2e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.281075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1f6fc-da02-4cfc-b590-408c63645f2e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.282172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1f6fc-da02-4cfc-b590-408c63645f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.286567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901e8d6-97b5-4842-aba5-04a3bff052b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.287429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901e8d6-97b5-4842-aba5-04a3bff052b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.287706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901e8d6-97b5-4842-aba5-04a3bff052b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.287970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901e8d6-97b5-4842-aba5-04a3bff052b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.288632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901e8d6-97b5-4842-aba5-04a3bff052b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.290556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901e8d6-97b5-4842-aba5-04a3bff052b5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.306192 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1234/2436] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:21.306851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901e8d6-97b5-4842-aba5-04a3bff052b5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.321207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901e8d6-97b5-4842-aba5-04a3bff052b5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.329369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0fd1f6fc-da02-4cfc-b590-408c63645f2e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:21.331062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fd1f6fc-da02-4cfc-b590-408c63645f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.349464 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1203/2437] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:21.351285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1f6fc-da02-4cfc-b590-408c63645f2e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.352850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fd1f6fc-da02-4cfc-b590-408c63645f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.353237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70446a1-3ef8-4601-a60a-6337acc8042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.355567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70446a1-3ef8-4601-a60a-6337acc8042c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.356511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70446a1-3ef8-4601-a60a-6337acc8042c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.356511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70446a1-3ef8-4601-a60a-6337acc8042c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.356912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70446a1-3ef8-4601-a60a-6337acc8042c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.360891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:21.362498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70446a1-3ef8-4601-a60a-6337acc8042c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.368524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1f6fc-da02-4cfc-b590-408c63645f2e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.378000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca4ddf-9c3e-4375-882e-04f5223eaa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.379102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca4ddf-9c3e-4375-882e-04f5223eaa59 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.379593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca4ddf-9c3e-4375-882e-04f5223eaa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.380095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca4ddf-9c3e-4375-882e-04f5223eaa59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.381191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca4ddf-9c3e-4375-882e-04f5223eaa59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.386231 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1235/2438] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:21.387560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca4ddf-9c3e-4375-882e-04f5223eaa59 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.392426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47a3a3-2d65-47ba-a598-1b169243d123 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.392735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47a3a3-2d65-47ba-a598-1b169243d123 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.393010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47a3a3-2d65-47ba-a598-1b169243d123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.401284 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1204/2439] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:21.402694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca4ddf-9c3e-4375-882e-04f5223eaa59 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.418304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca4ddf-9c3e-4375-882e-04f5223eaa59 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.425508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5487e-1a75-4eef-bb26-004b5f2ffe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.426518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5487e-1a75-4eef-bb26-004b5f2ffe96 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.427243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5487e-1a75-4eef-bb26-004b5f2ffe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.427706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5487e-1a75-4eef-bb26-004b5f2ffe96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.428905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5487e-1a75-4eef-bb26-004b5f2ffe96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.432377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2c47a3a3-2d65-47ba-a598-1b169243d123 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:21.433644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c47a3a3-2d65-47ba-a598-1b169243d123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.436947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5487e-1a75-4eef-bb26-004b5f2ffe96 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.443022 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1236/2440] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:21.447035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47a3a3-2d65-47ba-a598-1b169243d123 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.452785 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1205/2441] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:21.453794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5487e-1a75-4eef-bb26-004b5f2ffe96 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.456145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47a3a3-2d65-47ba-a598-1b169243d123 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.461791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d64cd-fb75-461a-ae7f-649a522f8e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.463077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d64cd-fb75-461a-ae7f-649a522f8e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.463358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d64cd-fb75-461a-ae7f-649a522f8e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.463631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d64cd-fb75-461a-ae7f-649a522f8e83 admin admin] PATH_INFO: `/v3/projects/63475d6211364b38bc3972b7473108c3/users/e21e2dd174ae4c99b8c413d1c19d0a2a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.467271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5487e-1a75-4eef-bb26-004b5f2ffe96 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.472736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc6f5-fbf6-4842-959a-608c555d8ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.474745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc6f5-fbf6-4842-959a-608c555d8ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.475354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc6f5-fbf6-4842-959a-608c555d8ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.475778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbc6f5-fbf6-4842-959a-608c555d8ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.476711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbc6f5-fbf6-4842-959a-608c555d8ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:21.477266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbc6f5-fbf6-4842-959a-608c555d8ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.479894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbc6f5-fbf6-4842-959a-608c555d8ec8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.480655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d64cd-fb75-461a-ae7f-649a522f8e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63475d6211364b38bc3972b7473108c3, user_id=e21e2dd174ae4c99b8c413d1c19d0a2a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.484111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d64cd-fb75-461a-ae7f-649a522f8e83 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.495225 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1206/2442] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:21.496914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc6f5-fbf6-4842-959a-608c555d8ec8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.502246 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1237/2443] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:21 2022] PUT /identity/v3/projects/63475d6211364b38bc3972b7473108c3/users/e21e2dd174ae4c99b8c413d1c19d0a2a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:21.503176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d64cd-fb75-461a-ae7f-649a522f8e83 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.520804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbc6f5-fbf6-4842-959a-608c555d8ec8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.553739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:21.580864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d64cd-fb75-461a-ae7f-649a522f8e83 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.589922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a00bc-75f4-4f30-84ae-f83f5837605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.590270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff988f2-989d-429f-8ef6-ad4caa353e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.590796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a00bc-75f4-4f30-84ae-f83f5837605b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.591050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff988f2-989d-429f-8ef6-ad4caa353e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.591355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a00bc-75f4-4f30-84ae-f83f5837605b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.591470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff988f2-989d-429f-8ef6-ad4caa353e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.591783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff988f2-989d-429f-8ef6-ad4caa353e4d admin admin] PATH_INFO: `/v3/projects/9834901a2d274b8bbb03a609f6c393bc/users/65f1f426d88d4b9bb069d3db3c6d84f3/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.591912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a00bc-75f4-4f30-84ae-f83f5837605b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.592613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a00bc-75f4-4f30-84ae-f83f5837605b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.594685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a00bc-75f4-4f30-84ae-f83f5837605b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.631636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff988f2-989d-429f-8ef6-ad4caa353e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9834901a2d274b8bbb03a609f6c393bc, user_id=65f1f426d88d4b9bb069d3db3c6d84f3, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.634897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff988f2-989d-429f-8ef6-ad4caa353e4d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.644296 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1238/2444] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:21.645819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234b41-7659-4577-bb75-8e57beed54fe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.646168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234b41-7659-4577-bb75-8e57beed54fe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.646550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234b41-7659-4577-bb75-8e57beed54fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.659496 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1207/2445] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:21 2022] PUT /identity/v3/projects/9834901a2d274b8bbb03a609f6c393bc/users/65f1f426d88d4b9bb069d3db3c6d84f3/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:21.660340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff988f2-989d-429f-8ef6-ad4caa353e4d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.666580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-50234b41-7659-4577-bb75-8e57beed54fe None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:21.667813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-50234b41-7659-4577-bb75-8e57beed54fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.670304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fff988f2-989d-429f-8ef6-ad4caa353e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.737067 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1239/2446] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:21.737067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234b41-7659-4577-bb75-8e57beed54fe None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.749119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff988f2-989d-429f-8ef6-ad4caa353e4d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.750426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234b41-7659-4577-bb75-8e57beed54fe None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.755042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.755380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5ff74-9687-4ac2-8dce-a87d77d703e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.756198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.756401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5ff74-9687-4ac2-8dce-a87d77d703e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.756945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.757066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5ff74-9687-4ac2-8dce-a87d77d703e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.757308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5ff74-9687-4ac2-8dce-a87d77d703e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.757683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] PATH_INFO: `/v3/projects/7128709e38804f9dbfffb1548a52a3ec` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.758013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5ff74-9687-4ac2-8dce-a87d77d703e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.759396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7128709e38804f9dbfffb1548a52a3ec)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:21.760318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5ff74-9687-4ac2-8dce-a87d77d703e6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.761696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:21.786113 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1240/2447] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/users => generated 292 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:21.787858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a29f-592c-4c0d-9b9b-95c653b1d06b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.788284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a29f-592c-4c0d-9b9b-95c653b1d06b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.788695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782a29f-592c-4c0d-9b9b-95c653b1d06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.823394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b782a29f-592c-4c0d-9b9b-95c653b1d06b None None] MFA Rules not processed for user `65f1f426d88d4b9bb069d3db3c6d84f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:21.825474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b782a29f-592c-4c0d-9b9b-95c653b1d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.826697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7128709e38804f9dbfffb1548a52a3ec', 'request_id': 'req-58531d07-0bfe-4441-8607-47c2625cfb68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.829393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:21.837945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7128709e38804f9dbfffb1548a52a3ec', 'request_id': 'req-58531d07-0bfe-4441-8607-47c2625cfb68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.850770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7128709e38804f9dbfffb1548a52a3ec', 'request_id': 'req-58531d07-0bfe-4441-8607-47c2625cfb68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.863948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] The token cache is being invalidate because project 7128709e38804f9dbfffb1548a52a3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:21.864333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.865114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:21.867870 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1208/2448] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:21 2022] DELETE /identity/v3/projects/7128709e38804f9dbfffb1548a52a3ec => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:21.868276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.870985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.916523 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1241/2449] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:21.918036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782a29f-592c-4c0d-9b9b-95c653b1d06b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:21.919605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b782a29f-592c-4c0d-9b9b-95c653b1d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.947625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58531d07-0bfe-4441-8607-47c2625cfb68 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:21.952006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df4a94-e0c2-4241-a582-93f57077aec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:21.952647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4a94-e0c2-4241-a582-93f57077aec6 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:21.952926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4a94-e0c2-4241-a582-93f57077aec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:21.953204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4a94-e0c2-4241-a582-93f57077aec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:21.955263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-39df4a94-e0c2-4241-a582-93f57077aec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:21.978988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:22.022759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782a29f-592c-4c0d-9b9b-95c653b1d06b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.030680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dbd05b-647f-4afa-b66c-98ab1f90c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.031866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd05b-647f-4afa-b66c-98ab1f90c6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.032144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd05b-647f-4afa-b66c-98ab1f90c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.032626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dbd05b-647f-4afa-b66c-98ab1f90c6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.033037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbd05b-647f-4afa-b66c-98ab1f90c6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.034718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dbd05b-647f-4afa-b66c-98ab1f90c6c2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.049684 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1242/2450] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:22.051835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd8703-1778-430f-ab16-3f56861a1c45 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.052338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd8703-1778-430f-ab16-3f56861a1c45 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.052986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd8703-1778-430f-ab16-3f56861a1c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.056351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df4a94-e0c2-4241-a582-93f57077aec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.057834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df4a94-e0c2-4241-a582-93f57077aec6 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.068450 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1209/2451] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:22.069460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df4a94-e0c2-4241-a582-93f57077aec6 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.071009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-39df4a94-e0c2-4241-a582-93f57077aec6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:22.074398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ffbd8703-1778-430f-ab16-3f56861a1c45 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:22.075792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ffbd8703-1778-430f-ab16-3f56861a1c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:22.084606 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1243/2452] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:22.085392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df4a94-e0c2-4241-a582-93f57077aec6 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.085621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd8703-1778-430f-ab16-3f56861a1c45 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.095561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd8703-1778-430f-ab16-3f56861a1c45 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.096141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dbff0-7741-44be-ac63-680544c01a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.096875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dbff0-7741-44be-ac63-680544c01a78 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.097164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dbff0-7741-44be-ac63-680544c01a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.097771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dbff0-7741-44be-ac63-680544c01a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.098113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dbff0-7741-44be-ac63-680544c01a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.101031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dbff0-7741-44be-ac63-680544c01a78 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.101604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a972e5-48c8-4c68-a5e4-eca30a009f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.102360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a972e5-48c8-4c68-a5e4-eca30a009f83 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.102735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a972e5-48c8-4c68-a5e4-eca30a009f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.103095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a972e5-48c8-4c68-a5e4-eca30a009f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.103845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a972e5-48c8-4c68-a5e4-eca30a009f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.105538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a972e5-48c8-4c68-a5e4-eca30a009f83 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.117912 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1244/2453] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:22.119517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0e81-f98d-4091-adcc-12475d4fddeb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.119893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0e81-f98d-4091-adcc-12475d4fddeb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.120862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c0e81-f98d-4091-adcc-12475d4fddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.146935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-676c0e81-f98d-4091-adcc-12475d4fddeb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:22.148946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-676c0e81-f98d-4091-adcc-12475d4fddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:22.156025 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1210/2454] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:22 2022] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:22.157298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dbff0-7741-44be-ac63-680544c01a78 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.165950 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1245/2455] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:22.167423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0e81-f98d-4091-adcc-12475d4fddeb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.208418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c0e81-f98d-4091-adcc-12475d4fddeb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.245673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dbff0-7741-44be-ac63-680544c01a78 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.256280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fa339-186e-42a3-91e7-232c1e9ee1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.257624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fa339-186e-42a3-91e7-232c1e9ee1df admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.258092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fa339-186e-42a3-91e7-232c1e9ee1df admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.258598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fa339-186e-42a3-91e7-232c1e9ee1df admin admin] PATH_INFO: `/v3/projects/da590949542e44baa0808b5f4e73fa20/users/bb9f4c8f290947ac996f0415b8b74d5a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.286389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:22.290681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fa339-186e-42a3-91e7-232c1e9ee1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=da590949542e44baa0808b5f4e73fa20, user_id=bb9f4c8f290947ac996f0415b8b74d5a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.291162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd10ed-2808-4332-b59f-25839deac899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.291837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd10ed-2808-4332-b59f-25839deac899 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.292117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd10ed-2808-4332-b59f-25839deac899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.292390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd10ed-2808-4332-b59f-25839deac899 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.293209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd10ed-2808-4332-b59f-25839deac899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.294536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fa339-186e-42a3-91e7-232c1e9ee1df admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.296079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd10ed-2808-4332-b59f-25839deac899 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.314503 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1211/2456] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:22 2022] PUT /identity/v3/projects/da590949542e44baa0808b5f4e73fa20/users/bb9f4c8f290947ac996f0415b8b74d5a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:22.315693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fa339-186e-42a3-91e7-232c1e9ee1df admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.339390 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1246/2457] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:22 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:22.340827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723b5f-8911-4840-afa2-b66a31c08d25 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.341167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723b5f-8911-4840-afa2-b66a31c08d25 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.341438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723b5f-8911-4840-afa2-b66a31c08d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.367387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9b723b5f-8911-4840-afa2-b66a31c08d25 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:22.368837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9b723b5f-8911-4840-afa2-b66a31c08d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:22.442086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fa339-186e-42a3-91e7-232c1e9ee1df admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.449538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b5bf6-4a6e-4399-8926-c37b2d72ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.450785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b5bf6-4a6e-4399-8926-c37b2d72ecef admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.452223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b5bf6-4a6e-4399-8926-c37b2d72ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.452223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b5bf6-4a6e-4399-8926-c37b2d72ecef admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.452639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b5bf6-4a6e-4399-8926-c37b2d72ecef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:22.452929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b5bf6-4a6e-4399-8926-c37b2d72ecef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.454760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b5bf6-4a6e-4399-8926-c37b2d72ecef admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.467237 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1247/2458] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:22.469054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b723b5f-8911-4840-afa2-b66a31c08d25 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.479438 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1212/2459] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:22.480655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b5bf6-4a6e-4399-8926-c37b2d72ecef admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.483117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b723b5f-8911-4840-afa2-b66a31c08d25 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.490999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda2be6-b250-4bb9-be86-4d1fb919059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.492088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda2be6-b250-4bb9-be86-4d1fb919059e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.492689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda2be6-b250-4bb9-be86-4d1fb919059e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.493131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda2be6-b250-4bb9-be86-4d1fb919059e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.495461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b5bf6-4a6e-4399-8926-c37b2d72ecef admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.496088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda2be6-b250-4bb9-be86-4d1fb919059e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.498468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda2be6-b250-4bb9-be86-4d1fb919059e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.503459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c44a-7265-4bbc-b5bf-4801d4226583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.504265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c44a-7265-4bbc-b5bf-4801d4226583 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.504642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c44a-7265-4bbc-b5bf-4801d4226583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.505018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c44a-7265-4bbc-b5bf-4801d4226583 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.506198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c44a-7265-4bbc-b5bf-4801d4226583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.508294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c44a-7265-4bbc-b5bf-4801d4226583 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.522652 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1248/2460] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:22.524020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda2be6-b250-4bb9-be86-4d1fb919059e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.528753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7fda2be6-b250-4bb9-be86-4d1fb919059e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:22.574781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:22.575311 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1213/2461] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:22 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:22.576233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c44a-7265-4bbc-b5bf-4801d4226583 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.660463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda2be6-b250-4bb9-be86-4d1fb919059e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.672651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c44a-7265-4bbc-b5bf-4801d4226583 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.691001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f9b51-7364-4e7e-9f03-0ca6282f9b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.691693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f9b51-7364-4e7e-9f03-0ca6282f9b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.691967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f9b51-7364-4e7e-9f03-0ca6282f9b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.692305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f9b51-7364-4e7e-9f03-0ca6282f9b13 admin admin] PATH_INFO: `/v3/projects/2951ef67c538409f84d21abf179c0a04/users/dafbe8a894654b0eb184e52f5813e042/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.718054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f9b51-7364-4e7e-9f03-0ca6282f9b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2951ef67c538409f84d21abf179c0a04, user_id=dafbe8a894654b0eb184e52f5813e042, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.721111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f9b51-7364-4e7e-9f03-0ca6282f9b13 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.739555 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1214/2462] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:22 2022] PUT /identity/v3/projects/2951ef67c538409f84d21abf179c0a04/users/dafbe8a894654b0eb184e52f5813e042/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:22.740760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f9b51-7364-4e7e-9f03-0ca6282f9b13 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.745866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93e11d-6e10-4850-82da-8c4ce394e2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.746854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93e11d-6e10-4850-82da-8c4ce394e2eb service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.747130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93e11d-6e10-4850-82da-8c4ce394e2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.747395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93e11d-6e10-4850-82da-8c4ce394e2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.760672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93e11d-6e10-4850-82da-8c4ce394e2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.762325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93e11d-6e10-4850-82da-8c4ce394e2eb service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.776843 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1249/2463] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:22.778022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93e11d-6e10-4850-82da-8c4ce394e2eb service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.793427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93e11d-6e10-4850-82da-8c4ce394e2eb service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.820654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:22.861682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f9b51-7364-4e7e-9f03-0ca6282f9b13 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.876027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee866-7d9b-4403-80a8-41cecba6f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.876566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee866-7d9b-4403-80a8-41cecba6f07b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.876859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee866-7d9b-4403-80a8-41cecba6f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.878197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cee866-7d9b-4403-80a8-41cecba6f07b admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.878906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee866-7d9b-4403-80a8-41cecba6f07b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.880909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cee866-7d9b-4403-80a8-41cecba6f07b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.933775 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1215/2464] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:22 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:22.938997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee866-7d9b-4403-80a8-41cecba6f07b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.941450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075456be-5754-4e51-a78a-2c0d0d9def9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.942215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075456be-5754-4e51-a78a-2c0d0d9def9c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.942589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075456be-5754-4e51-a78a-2c0d0d9def9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.942888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075456be-5754-4e51-a78a-2c0d0d9def9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.944362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075456be-5754-4e51-a78a-2c0d0d9def9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.946408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075456be-5754-4e51-a78a-2c0d0d9def9c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.955471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cee866-7d9b-4403-80a8-41cecba6f07b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:22.962088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84194d-db56-4bd0-b8da-f9705c2d6e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:22.962710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84194d-db56-4bd0-b8da-f9705c2d6e67 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:22.962983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84194d-db56-4bd0-b8da-f9705c2d6e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:22.963247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84194d-db56-4bd0-b8da-f9705c2d6e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:22.963898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84194d-db56-4bd0-b8da-f9705c2d6e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:22.965790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84194d-db56-4bd0-b8da-f9705c2d6e67 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:22.978992 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1216/2465] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:16:22.982016 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1250/2466] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:22.984689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84194d-db56-4bd0-b8da-f9705c2d6e67 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:22.986423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075456be-5754-4e51-a78a-2c0d0d9def9c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:23.000270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84194d-db56-4bd0-b8da-f9705c2d6e67 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:23.000702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075456be-5754-4e51-a78a-2c0d0d9def9c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:23.007329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967f852-d89a-4546-b0cc-32f7caf096d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:23.008169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967f852-d89a-4546-b0cc-32f7caf096d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:23.008440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967f852-d89a-4546-b0cc-32f7caf096d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:23.008563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece76be-bbb6-46d2-b657-223acb257fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:23.008757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967f852-d89a-4546-b0cc-32f7caf096d4 admin admin] PATH_INFO: `/v3/projects/2951ef67c538409f84d21abf179c0a04/users/dafbe8a894654b0eb184e52f5813e042/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:23.009424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece76be-bbb6-46d2-b657-223acb257fae admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:23.009766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece76be-bbb6-46d2-b657-223acb257fae admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:23.010727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece76be-bbb6-46d2-b657-223acb257fae admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:23.010834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967f852-d89a-4546-b0cc-32f7caf096d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2951ef67c538409f84d21abf179c0a04, user_id=dafbe8a894654b0eb184e52f5813e042, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:23.011454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece76be-bbb6-46d2-b657-223acb257fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:23.013118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece76be-bbb6-46d2-b657-223acb257fae admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:23.013680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967f852-d89a-4546-b0cc-32f7caf096d4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:23.027646 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1217/2467] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:23.032071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece76be-bbb6-46d2-b657-223acb257fae admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:23.040242 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1251/2468] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:22 2022] PUT /identity/v3/projects/2951ef67c538409f84d21abf179c0a04/users/dafbe8a894654b0eb184e52f5813e042/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:23.043840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece76be-bbb6-46d2-b657-223acb257fae admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:23.051929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57573a-2cbd-4345-b700-7e40fed4ba23 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:23.052230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57573a-2cbd-4345-b700-7e40fed4ba23 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:23.052487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57573a-2cbd-4345-b700-7e40fed4ba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:23.089438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8b57573a-2cbd-4345-b700-7e40fed4ba23 None None] MFA Rules not processed for user `dafbe8a894654b0eb184e52f5813e042`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:23.090912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8b57573a-2cbd-4345-b700-7e40fed4ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:23.113500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d27693-3647-41c8-8326-d56ab42f272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:23.114974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d27693-3647-41c8-8326-d56ab42f272e admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:23.114974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d27693-3647-41c8-8326-d56ab42f272e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:23.114974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d27693-3647-41c8-8326-d56ab42f272e admin admin] PATH_INFO: `/v3/projects/e8331c7b142a4c40bc8bf3899e6c2f07/users/54d87dc0b719496ebc52a26d69beef8b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:23.136850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d27693-3647-41c8-8326-d56ab42f272e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8331c7b142a4c40bc8bf3899e6c2f07, user_id=54d87dc0b719496ebc52a26d69beef8b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:23.140509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d27693-3647-41c8-8326-d56ab42f272e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:23.158334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:23.160509 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1218/2469] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:23 2022] PUT /identity/v3/projects/e8331c7b142a4c40bc8bf3899e6c2f07/users/54d87dc0b719496ebc52a26d69beef8b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:23.175046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cdb26-c8fc-4fca-85e4-464de1a7f048 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:23.175327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cdb26-c8fc-4fca-85e4-464de1a7f048 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:23.176600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cdb26-c8fc-4fca-85e4-464de1a7f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:23.192846 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1252/2470] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:23.211647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7d8cdb26-c8fc-4fca-85e4-464de1a7f048 None None] MFA Rules not processed for user `54d87dc0b719496ebc52a26d69beef8b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:23.213083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7d8cdb26-c8fc-4fca-85e4-464de1a7f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:23.216601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57573a-2cbd-4345-b700-7e40fed4ba23 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:23.219456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8b57573a-2cbd-4345-b700-7e40fed4ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:23.342801 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1219/2471] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:23.366451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57573a-2cbd-4345-b700-7e40fed4ba23 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:23.456507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cdb26-c8fc-4fca-85e4-464de1a7f048 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:23.459199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7d8cdb26-c8fc-4fca-85e4-464de1a7f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:23.468122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4528e1-0236-4a35-8ce4-3ae649613f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:23.468958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4528e1-0236-4a35-8ce4-3ae649613f78 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:23.469235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4528e1-0236-4a35-8ce4-3ae649613f78 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:23.469725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4528e1-0236-4a35-8ce4-3ae649613f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:23.502133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:23.566548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4528e1-0236-4a35-8ce4-3ae649613f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:23.569621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4528e1-0236-4a35-8ce4-3ae649613f78 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:23.581703 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1253/2472] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:23.585505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cdb26-c8fc-4fca-85e4-464de1a7f048 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:23.595888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50de548a-79f3-4981-83b8-d9688b937bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:23.596612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de548a-79f3-4981-83b8-d9688b937bd9 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:23.596945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de548a-79f3-4981-83b8-d9688b937bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:23.597280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de548a-79f3-4981-83b8-d9688b937bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:23.639674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de548a-79f3-4981-83b8-d9688b937bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:23.639674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50de548a-79f3-4981-83b8-d9688b937bd9 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:23.672004 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1220/2473] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:23.742353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4528e1-0236-4a35-8ce4-3ae649613f78 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:23.782643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:23.904234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4528e1-0236-4a35-8ce4-3ae649613f78 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:23.911854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:23.912768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:23.913147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:23.913560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] PATH_INFO: `/v3/users/65f1f426d88d4b9bb069d3db3c6d84f3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:23.914902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f1f426d88d4b9bb069d3db3c6d84f3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:23.917634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:24.052276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f1f426d88d4b9bb069d3db3c6d84f3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.054647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f1f426d88d4b9bb069d3db3c6d84f3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.073307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f1f426d88d4b9bb069d3db3c6d84f3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.093418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f1f426d88d4b9bb069d3db3c6d84f3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.123314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f1f426d88d4b9bb069d3db3c6d84f3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.140459 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1254/2474] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:23 2022] DELETE /identity/v3/users/65f1f426d88d4b9bb069d3db3c6d84f3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:24.142571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ad5a2-a04b-4ef3-9abf-bc4e05274b0a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.143070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ad5a2-a04b-4ef3-9abf-bc4e05274b0a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.143210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ad5a2-a04b-4ef3-9abf-bc4e05274b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.190439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-968ad5a2-a04b-4ef3-9abf-bc4e05274b0a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:24.191846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-968ad5a2-a04b-4ef3-9abf-bc4e05274b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:24.309333 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1221/2475] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:24.320442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:24.321950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:24.433699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d5ab8-1036-4b8b-b7c1-a646cade6e5b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:24.438424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a219ae5-9404-4f72-9a64-da9228f06bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:24.439177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a219ae5-9404-4f72-9a64-da9228f06bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.439452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a219ae5-9404-4f72-9a64-da9228f06bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.439715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a219ae5-9404-4f72-9a64-da9228f06bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.455743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a219ae5-9404-4f72-9a64-da9228f06bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:24.459230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a219ae5-9404-4f72-9a64-da9228f06bb7 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:24.475492 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1255/2476] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:24.843898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ad5a2-a04b-4ef3-9abf-bc4e05274b0a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:24.846060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-968ad5a2-a04b-4ef3-9abf-bc4e05274b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:24.875439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ad5a2-a04b-4ef3-9abf-bc4e05274b0a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:24.883548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:24.884181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:24.884415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:24.884679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] PATH_INFO: `/v3/projects/9834901a2d274b8bbb03a609f6c393bc` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:24.885846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9834901a2d274b8bbb03a609f6c393bc)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:24.888179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:24.946493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9834901a2d274b8bbb03a609f6c393bc', 'request_id': 'req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.957268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9834901a2d274b8bbb03a609f6c393bc', 'request_id': 'req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.967500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9834901a2d274b8bbb03a609f6c393bc', 'request_id': 'req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.980974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] The token cache is being invalidate because project 9834901a2d274b8bbb03a609f6c393bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:24.981919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.982347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:24.984074 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1222/2477] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:24 2022] DELETE /identity/v3/projects/9834901a2d274b8bbb03a609f6c393bc => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:24.990245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a219ae5-9404-4f72-9a64-da9228f06bb7 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.002705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a219ae5-9404-4f72-9a64-da9228f06bb7 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.085248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:25.111200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.112021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.116275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.116635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] PATH_INFO: `/v3/users/dafbe8a894654b0eb184e52f5813e042` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.118216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dafbe8a894654b0eb184e52f5813e042)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.120303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.220877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dafbe8a894654b0eb184e52f5813e042'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:25.220877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dafbe8a894654b0eb184e52f5813e042'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:25.223773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.226289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:25.232632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dafbe8a894654b0eb184e52f5813e042'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:25.242862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dafbe8a894654b0eb184e52f5813e042'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:25.244627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d5cff-65bb-4b3c-b472-9962a9f36c01 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.253089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.253758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.254148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.254423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] PATH_INFO: `/v3/users/54d87dc0b719496ebc52a26d69beef8b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.255592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d87dc0b719496ebc52a26d69beef8b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.257683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.260975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e82a8672-c627-4fb2-8780-708ab430b0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dafbe8a894654b0eb184e52f5813e042'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:25.275030 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1256/2478] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:24 2022] DELETE /identity/v3/users/dafbe8a894654b0eb184e52f5813e042 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:25.347311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:25.395275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d87dc0b719496ebc52a26d69beef8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:25.413181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d87dc0b719496ebc52a26d69beef8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:25.438822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d87dc0b719496ebc52a26d69beef8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:25.453527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d87dc0b719496ebc52a26d69beef8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:25.454480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d87dc0b719496ebc52a26d69beef8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:25.467682 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1223/2479] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:25 2022] DELETE /identity/v3/users/54d87dc0b719496ebc52a26d69beef8b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:25.469679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0aab1-6120-4acb-a640-a5d6f21ea226 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.470084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0aab1-6120-4acb-a640-a5d6f21ea226 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.470434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0aab1-6120-4acb-a640-a5d6f21ea226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.516927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-54d0aab1-6120-4acb-a640-a5d6f21ea226 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:25.519154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-54d0aab1-6120-4acb-a640-a5d6f21ea226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:25.657116 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1257/2480] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:25.675817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.677443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:25.809999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfc1917-f095-4704-a704-226225ab7df2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.823902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e359bd-1664-45ba-a966-8b7f1c1e7559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.825425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e359bd-1664-45ba-a966-8b7f1c1e7559 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.825815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e359bd-1664-45ba-a966-8b7f1c1e7559 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.826390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e359bd-1664-45ba-a966-8b7f1c1e7559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.839632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e359bd-1664-45ba-a966-8b7f1c1e7559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.842964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e359bd-1664-45ba-a966-8b7f1c1e7559 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.851178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0aab1-6120-4acb-a640-a5d6f21ea226 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:25.852721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-54d0aab1-6120-4acb-a640-a5d6f21ea226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:25.859580 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1224/2481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:25.872427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0aab1-6120-4acb-a640-a5d6f21ea226 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:25.879879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:25.881093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:25.881637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:25.882191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] PATH_INFO: `/v3/projects/2951ef67c538409f84d21abf179c0a04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:25.883720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2951ef67c538409f84d21abf179c0a04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:25.885819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:25.987256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2951ef67c538409f84d21abf179c0a04', 'request_id': 'req-625dd05e-27ee-4936-8532-78d2131284bf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:26.012765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2951ef67c538409f84d21abf179c0a04', 'request_id': 'req-625dd05e-27ee-4936-8532-78d2131284bf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:26.021025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:26.044872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2951ef67c538409f84d21abf179c0a04', 'request_id': 'req-625dd05e-27ee-4936-8532-78d2131284bf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:26.090461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] The token cache is being invalidate because project 2951ef67c538409f84d21abf179c0a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:26.091176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:26.093628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-625dd05e-27ee-4936-8532-78d2131284bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:26.101748 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1258/2482] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:25 2022] DELETE /identity/v3/projects/2951ef67c538409f84d21abf179c0a04 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:26.104255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf61699-2dde-45de-b191-fb9931787e3d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.104647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf61699-2dde-45de-b191-fb9931787e3d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.105144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf61699-2dde-45de-b191-fb9931787e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.190377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-dbf61699-2dde-45de-b191-fb9931787e3d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:26.192173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dbf61699-2dde-45de-b191-fb9931787e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:26.347215 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1225/2483] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:26.356602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9359d-fdb9-42b7-b884-acf388fd1bb6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.356885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9359d-fdb9-42b7-b884-acf388fd1bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.357562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9359d-fdb9-42b7-b884-acf388fd1bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.417592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f0f9359d-fdb9-42b7-b884-acf388fd1bb6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:26.420517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f0f9359d-fdb9-42b7-b884-acf388fd1bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:26.443870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf61699-2dde-45de-b191-fb9931787e3d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.445402 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1259/2484] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:26.456513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf61699-2dde-45de-b191-fb9931787e3d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.482780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c09509-87ad-4d6f-b329-573a75dbe97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.483809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c09509-87ad-4d6f-b329-573a75dbe97a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.484602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c09509-87ad-4d6f-b329-573a75dbe97a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.485050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c09509-87ad-4d6f-b329-573a75dbe97a admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.486518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c09509-87ad-4d6f-b329-573a75dbe97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:26.486987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c09509-87ad-4d6f-b329-573a75dbe97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.488807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c09509-87ad-4d6f-b329-573a75dbe97a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.507742 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1226/2485] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:26.512025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9359d-fdb9-42b7-b884-acf388fd1bb6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.526371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9359d-fdb9-42b7-b884-acf388fd1bb6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.538339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71e40-9595-482a-a937-2d5cba21edb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.540123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71e40-9595-482a-a937-2d5cba21edb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.540706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71e40-9595-482a-a937-2d5cba21edb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.540990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e71e40-9595-482a-a937-2d5cba21edb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.543252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71e40-9595-482a-a937-2d5cba21edb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.547663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e71e40-9595-482a-a937-2d5cba21edb3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.551060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c09509-87ad-4d6f-b329-573a75dbe97a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.552950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-76c09509-87ad-4d6f-b329-573a75dbe97a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:26.580708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c09509-87ad-4d6f-b329-573a75dbe97a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.596045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.597140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.597661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.598174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] PATH_INFO: `/v3/projects/e8331c7b142a4c40bc8bf3899e6c2f07` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.601080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8331c7b142a4c40bc8bf3899e6c2f07)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.605977 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1260/2486] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:26 2022] POST /identity/v3/projects => generated 409 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:26.609077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.614067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71e40-9595-482a-a937-2d5cba21edb3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.697163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:26.712195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8331c7b142a4c40bc8bf3899e6c2f07', 'request_id': 'req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:26.716155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e71e40-9595-482a-a937-2d5cba21edb3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.731030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8331c7b142a4c40bc8bf3899e6c2f07', 'request_id': 'req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:26.747969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8331c7b142a4c40bc8bf3899e6c2f07', 'request_id': 'req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:26.774046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] The token cache is being invalidate because project e8331c7b142a4c40bc8bf3899e6c2f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:26.774426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:26.775156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0eb4a1fc-dbbb-4e8c-b7f4-c94ac4fd1830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:26.788651 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1227/2487] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:26 2022] DELETE /identity/v3/projects/e8331c7b142a4c40bc8bf3899e6c2f07 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:26.790478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba05947-35b5-4516-8816-68b2089646a5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.790779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba05947-35b5-4516-8816-68b2089646a5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.791075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba05947-35b5-4516-8816-68b2089646a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.801625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977eb8d-8760-4020-917b-bb8e423e49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.802603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977eb8d-8760-4020-917b-bb8e423e49d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.803091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977eb8d-8760-4020-917b-bb8e423e49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.803470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977eb8d-8760-4020-917b-bb8e423e49d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.804224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977eb8d-8760-4020-917b-bb8e423e49d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.806344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977eb8d-8760-4020-917b-bb8e423e49d9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.817636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-aba05947-35b5-4516-8816-68b2089646a5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:26.819016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aba05947-35b5-4516-8816-68b2089646a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:26.841310 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1228/2488] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:26.841587 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1261/2489] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:26 2022] POST /identity/v3/users => generated 305 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:26.843765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba05947-35b5-4516-8816-68b2089646a5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.844803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3db95-47e5-4c03-b318-8119ec36756f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.845128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aba05947-35b5-4516-8816-68b2089646a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:26.846410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3db95-47e5-4c03-b318-8119ec36756f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.847132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3db95-47e5-4c03-b318-8119ec36756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.859357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba05947-35b5-4516-8816-68b2089646a5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.865521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da2202-3526-4b42-91bf-140973b175b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.866812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da2202-3526-4b42-91bf-140973b175b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.867086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da2202-3526-4b42-91bf-140973b175b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.867476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da2202-3526-4b42-91bf-140973b175b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.868502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da2202-3526-4b42-91bf-140973b175b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.870340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da2202-3526-4b42-91bf-140973b175b7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.887946 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1229/2490] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:26.888794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-18a3db95-47e5-4c03-b318-8119ec36756f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:26.889597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da2202-3526-4b42-91bf-140973b175b7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.890995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-18a3db95-47e5-4c03-b318-8119ec36756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:26.904587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da2202-3526-4b42-91bf-140973b175b7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.913075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950c488-1126-461f-9bc5-49ca637aa80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.914220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950c488-1126-461f-9bc5-49ca637aa80a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.914360 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1262/2491] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:26.914771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950c488-1126-461f-9bc5-49ca637aa80a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.915200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950c488-1126-461f-9bc5-49ca637aa80a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.916039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950c488-1126-461f-9bc5-49ca637aa80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.916156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3db95-47e5-4c03-b318-8119ec36756f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.919165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950c488-1126-461f-9bc5-49ca637aa80a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.934813 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1230/2492] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:26.935722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950c488-1126-461f-9bc5-49ca637aa80a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.957109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950c488-1126-461f-9bc5-49ca637aa80a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.957457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3db95-47e5-4c03-b318-8119ec36756f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:26.963663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf5f7e-2a28-4bd2-b536-18afe5111340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.964385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf5f7e-2a28-4bd2-b536-18afe5111340 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.964768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf5f7e-2a28-4bd2-b536-18afe5111340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.965043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf5f7e-2a28-4bd2-b536-18afe5111340 admin admin] PATH_INFO: `/v3/projects/b40730fa20e34d0685cdde82c0cdf05d/users/dc158c8af53f4a2c83c8d6c981cb484f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.965159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d851b8-9d25-469c-97aa-b95b93341fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:26.965741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d851b8-9d25-469c-97aa-b95b93341fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:26.966047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d851b8-9d25-469c-97aa-b95b93341fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:26.966891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d851b8-9d25-469c-97aa-b95b93341fd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:26.967576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d851b8-9d25-469c-97aa-b95b93341fd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:26.967873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d851b8-9d25-469c-97aa-b95b93341fd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.969999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d851b8-9d25-469c-97aa-b95b93341fd7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:26.988362 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1263/2493] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:16:26.989308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d851b8-9d25-469c-97aa-b95b93341fd7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:26.993472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf5f7e-2a28-4bd2-b536-18afe5111340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40730fa20e34d0685cdde82c0cdf05d, user_id=dc158c8af53f4a2c83c8d6c981cb484f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:26.997618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf5f7e-2a28-4bd2-b536-18afe5111340 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.000837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d851b8-9d25-469c-97aa-b95b93341fd7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.006373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dfb46-9d91-445b-8abb-8a33d4b64e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.007075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dfb46-9d91-445b-8abb-8a33d4b64e2b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.007349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dfb46-9d91-445b-8abb-8a33d4b64e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.007717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873dfb46-9d91-445b-8abb-8a33d4b64e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.008733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dfb46-9d91-445b-8abb-8a33d4b64e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.010837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873dfb46-9d91-445b-8abb-8a33d4b64e2b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.035538 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1231/2494] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:26 2022] PUT /identity/v3/projects/b40730fa20e34d0685cdde82c0cdf05d/users/dc158c8af53f4a2c83c8d6c981cb484f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:27.037991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3f9d-c562-4c71-895a-7bf1bd13e43b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.038377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3f9d-c562-4c71-895a-7bf1bd13e43b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.038857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd3f9d-c562-4c71-895a-7bf1bd13e43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.058955 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1264/2495] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:26 2022] POST /identity/v3/projects => generated 397 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:27.065408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dfb46-9d91-445b-8abb-8a33d4b64e2b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.102065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-81fd3f9d-c562-4c71-895a-7bf1bd13e43b None None] MFA Rules not processed for user `dc158c8af53f4a2c83c8d6c981cb484f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:27.103899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:27.108526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-81fd3f9d-c562-4c71-895a-7bf1bd13e43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.237716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873dfb46-9d91-445b-8abb-8a33d4b64e2b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.270017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9a218-5c5c-45b9-9d71-e024cac00d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.272467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9a218-5c5c-45b9-9d71-e024cac00d49 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.276828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9a218-5c5c-45b9-9d71-e024cac00d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.277093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9a218-5c5c-45b9-9d71-e024cac00d49 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.277804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9a218-5c5c-45b9-9d71-e024cac00d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.292307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9a218-5c5c-45b9-9d71-e024cac00d49 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.347984 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1265/2496] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:27 2022] POST /identity/v3/users => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:27.349027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9a218-5c5c-45b9-9d71-e024cac00d49 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.365284 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1232/2497] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:27 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:27.369835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd3f9d-c562-4c71-895a-7bf1bd13e43b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.374832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9a218-5c5c-45b9-9d71-e024cac00d49 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.385466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd3f9d-c562-4c71-895a-7bf1bd13e43b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.389303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fb04b-71c4-4932-92b8-7fc15ee4d26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.389980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb04b-71c4-4932-92b8-7fc15ee4d26b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.390261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb04b-71c4-4932-92b8-7fc15ee4d26b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.390527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fb04b-71c4-4932-92b8-7fc15ee4d26b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.391186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fb04b-71c4-4932-92b8-7fc15ee4d26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.392490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ed5b1-d5ed-4ee3-b9c9-988449f1ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.392811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fb04b-71c4-4932-92b8-7fc15ee4d26b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.393921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ed5b1-d5ed-4ee3-b9c9-988449f1ee56 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.394341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ed5b1-d5ed-4ee3-b9c9-988449f1ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.395478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ed5b1-d5ed-4ee3-b9c9-988449f1ee56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.396308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ed5b1-d5ed-4ee3-b9c9-988449f1ee56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.399070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ed5b1-d5ed-4ee3-b9c9-988449f1ee56 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.420795 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1266/2498] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:27.426231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fb04b-71c4-4932-92b8-7fc15ee4d26b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.444327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fb04b-71c4-4932-92b8-7fc15ee4d26b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.448440 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1233/2499] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:27 2022] POST /identity/v3/projects => generated 407 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:27.449336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ed5b1-d5ed-4ee3-b9c9-988449f1ee56 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.563436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:27.577278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57427db-7dc9-449f-8789-5d48ab4277b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.577278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57427db-7dc9-449f-8789-5d48ab4277b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.577278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57427db-7dc9-449f-8789-5d48ab4277b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.578095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57427db-7dc9-449f-8789-5d48ab4277b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.578095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57427db-7dc9-449f-8789-5d48ab4277b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.579783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57427db-7dc9-449f-8789-5d48ab4277b8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.616823 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1267/2500] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:27.620902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57427db-7dc9-449f-8789-5d48ab4277b8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.645819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ed5b1-d5ed-4ee3-b9c9-988449f1ee56 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.653567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57427db-7dc9-449f-8789-5d48ab4277b8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.659348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8779177-13eb-45c7-b5e9-db74a86a3398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.660903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8779177-13eb-45c7-b5e9-db74a86a3398 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.661178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8779177-13eb-45c7-b5e9-db74a86a3398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.661516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8779177-13eb-45c7-b5e9-db74a86a3398 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.663490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8779177-13eb-45c7-b5e9-db74a86a3398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.666148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8779177-13eb-45c7-b5e9-db74a86a3398 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.670626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f90a8-aa3f-4773-a2f7-4d4ef24010e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.671314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f90a8-aa3f-4773-a2f7-4d4ef24010e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.671640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f90a8-aa3f-4773-a2f7-4d4ef24010e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.671920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f90a8-aa3f-4773-a2f7-4d4ef24010e7 admin admin] PATH_INFO: `/v3/projects/5143ccea80d342a197c74a2e71a5f80a/users/326ddfe51e68488c8b2bdb3953f7ac95/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.717939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f90a8-aa3f-4773-a2f7-4d4ef24010e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5143ccea80d342a197c74a2e71a5f80a, user_id=326ddfe51e68488c8b2bdb3953f7ac95, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.724622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f90a8-aa3f-4773-a2f7-4d4ef24010e7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.736685 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1234/2501] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:27 2022] POST /identity/v3/users => generated 310 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:16:27.743371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8779177-13eb-45c7-b5e9-db74a86a3398 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.755415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8779177-13eb-45c7-b5e9-db74a86a3398 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.779633 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1268/2502] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:27 2022] PUT /identity/v3/projects/5143ccea80d342a197c74a2e71a5f80a/users/326ddfe51e68488c8b2bdb3953f7ac95/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:27.782871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44faa2f-9207-43ec-8645-24c1e2ae81f5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.783560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44faa2f-9207-43ec-8645-24c1e2ae81f5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.784205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44faa2f-9207-43ec-8645-24c1e2ae81f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.868726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd6c66-d5a9-4465-8edd-190e08123a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.869824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd6c66-d5a9-4465-8edd-190e08123a96 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.870276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd6c66-d5a9-4465-8edd-190e08123a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.870706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd6c66-d5a9-4465-8edd-190e08123a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.871628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd6c66-d5a9-4465-8edd-190e08123a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.874337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd6c66-d5a9-4465-8edd-190e08123a96 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.874807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a44faa2f-9207-43ec-8645-24c1e2ae81f5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:27.876520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a44faa2f-9207-43ec-8645-24c1e2ae81f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.895141 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1235/2503] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:27.902348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd6c66-d5a9-4465-8edd-190e08123a96 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.923422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd6c66-d5a9-4465-8edd-190e08123a96 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:27.928370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e095f6d-d04a-4233-9cc6-a7b89d891829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:27.929355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e095f6d-d04a-4233-9cc6-a7b89d891829 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:27.929931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e095f6d-d04a-4233-9cc6-a7b89d891829 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:27.930403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e095f6d-d04a-4233-9cc6-a7b89d891829 admin admin] PATH_INFO: `/v3/projects/d56cb5477a4e41e9b85364c23a4ebed1/users/21f9ad4c4bf84298b7d2c3c4b0c522bc/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:27.937318 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1269/2504] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:27.938990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44faa2f-9207-43ec-8645-24c1e2ae81f5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:27.942675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a44faa2f-9207-43ec-8645-24c1e2ae81f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:27.966188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e095f6d-d04a-4233-9cc6-a7b89d891829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56cb5477a4e41e9b85364c23a4ebed1, user_id=21f9ad4c4bf84298b7d2c3c4b0c522bc, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:27.969268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e095f6d-d04a-4233-9cc6-a7b89d891829 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:27.996456 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1236/2505] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:27 2022] PUT /identity/v3/projects/d56cb5477a4e41e9b85364c23a4ebed1/users/21f9ad4c4bf84298b7d2c3c4b0c522bc/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:27.998097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e095f6d-d04a-4233-9cc6-a7b89d891829 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:28.040937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44faa2f-9207-43ec-8645-24c1e2ae81f5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:28.057219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:28.161596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cfaba-d139-4b3e-ac28-f1e8182a4698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:28.162481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cfaba-d139-4b3e-ac28-f1e8182a4698 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.162625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cfaba-d139-4b3e-ac28-f1e8182a4698 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.164111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cfaba-d139-4b3e-ac28-f1e8182a4698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:28.194710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e095f6d-d04a-4233-9cc6-a7b89d891829 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:28.216251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c246e-2ac0-419d-94bb-aff4a73c5651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:28.216890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c246e-2ac0-419d-94bb-aff4a73c5651 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.217167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c246e-2ac0-419d-94bb-aff4a73c5651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.217438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c246e-2ac0-419d-94bb-aff4a73c5651 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:28.218132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c246e-2ac0-419d-94bb-aff4a73c5651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:28.224303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c246e-2ac0-419d-94bb-aff4a73c5651 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:28.251107 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1237/2506] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:28.260475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c246e-2ac0-419d-94bb-aff4a73c5651 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:28.288193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c246e-2ac0-419d-94bb-aff4a73c5651 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:28.295597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cfaba-d139-4b3e-ac28-f1e8182a4698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:28.297505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cfaba-d139-4b3e-ac28-f1e8182a4698 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:28.306007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b9b60-11dd-4178-aadd-a35492c7c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:28.306992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b9b60-11dd-4178-aadd-a35492c7c834 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.307416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b9b60-11dd-4178-aadd-a35492c7c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.307998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b9b60-11dd-4178-aadd-a35492c7c834 admin admin] PATH_INFO: `/v3/projects/d56cb5477a4e41e9b85364c23a4ebed1/users/21f9ad4c4bf84298b7d2c3c4b0c522bc/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:28.310712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b9b60-11dd-4178-aadd-a35492c7c834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56cb5477a4e41e9b85364c23a4ebed1, user_id=21f9ad4c4bf84298b7d2c3c4b0c522bc, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:28.318124 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1270/2507] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:28.318655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b9b60-11dd-4178-aadd-a35492c7c834 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:28.362596 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1238/2508] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:28 2022] PUT /identity/v3/projects/d56cb5477a4e41e9b85364c23a4ebed1/users/21f9ad4c4bf84298b7d2c3c4b0c522bc/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:28.376191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34369-3338-42a6-b352-0af24bbc7867 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:28.376637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34369-3338-42a6-b352-0af24bbc7867 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:28.376946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34369-3338-42a6-b352-0af24bbc7867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:28.437186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-53d34369-3338-42a6-b352-0af24bbc7867 None None] MFA Rules not processed for user `21f9ad4c4bf84298b7d2c3c4b0c522bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:28.439267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-53d34369-3338-42a6-b352-0af24bbc7867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:28.601924 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1271/2509] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:28 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:28.876772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b9b60-11dd-4178-aadd-a35492c7c834 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:28.879370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f41b9b60-11dd-4178-aadd-a35492c7c834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:28.920715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:29.089773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b9b60-11dd-4178-aadd-a35492c7c834 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:29.115002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea76f72-4600-4c5a-b6cc-eb9976170e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:29.115892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea76f72-4600-4c5a-b6cc-eb9976170e6e service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:29.117076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea76f72-4600-4c5a-b6cc-eb9976170e6e service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:29.117652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea76f72-4600-4c5a-b6cc-eb9976170e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:29.165523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea76f72-4600-4c5a-b6cc-eb9976170e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:29.171963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea76f72-4600-4c5a-b6cc-eb9976170e6e service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:29.199887 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1239/2510] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:28 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:29.614591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34369-3338-42a6-b352-0af24bbc7867 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:29.616473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-53d34369-3338-42a6-b352-0af24bbc7867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:29.674656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34369-3338-42a6-b352-0af24bbc7867 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:29.684608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e145e32-6ffa-4fda-ba07-8fa519f674b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:29.685578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e145e32-6ffa-4fda-ba07-8fa519f674b2 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:29.686151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e145e32-6ffa-4fda-ba07-8fa519f674b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:29.686576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e145e32-6ffa-4fda-ba07-8fa519f674b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:29.798207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:29.811458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e145e32-6ffa-4fda-ba07-8fa519f674b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:29.813201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e145e32-6ffa-4fda-ba07-8fa519f674b2 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:29.833660 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1272/2511] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:29 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:30.521462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea76f72-4600-4c5a-b6cc-eb9976170e6e service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:30.706301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea76f72-4600-4c5a-b6cc-eb9976170e6e service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:30.716918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:30.717582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:30.717858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:30.720385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] PATH_INFO: `/v3/users/dc158c8af53f4a2c83c8d6c981cb484f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:30.725127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc158c8af53f4a2c83c8d6c981cb484f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:30.727798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:30.844970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc158c8af53f4a2c83c8d6c981cb484f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:30.857160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc158c8af53f4a2c83c8d6c981cb484f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:30.891082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc158c8af53f4a2c83c8d6c981cb484f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:30.918984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc158c8af53f4a2c83c8d6c981cb484f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:30.921013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc158c8af53f4a2c83c8d6c981cb484f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:30.936366 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1240/2512] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:30 2022] DELETE /identity/v3/users/dc158c8af53f4a2c83c8d6c981cb484f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:30.943078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ed381-4a98-4041-8585-87c60312a96b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:30.945097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ed381-4a98-4041-8585-87c60312a96b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:30.945581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ed381-4a98-4041-8585-87c60312a96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:30.977195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8b2ed381-4a98-4041-8585-87c60312a96b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:30.979342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8b2ed381-4a98-4041-8585-87c60312a96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:31.129259 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1273/2513] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:31.175483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:31.177568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:31.301189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:31.382619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8554c-c861-4078-ad2d-3f88fe69df46 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:31.399385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79003bf2-5b78-489c-9c68-fc5045aa9c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:31.402878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79003bf2-5b78-489c-9c68-fc5045aa9c32 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:31.404576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79003bf2-5b78-489c-9c68-fc5045aa9c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:31.406221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79003bf2-5b78-489c-9c68-fc5045aa9c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:31.430460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79003bf2-5b78-489c-9c68-fc5045aa9c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:31.432741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79003bf2-5b78-489c-9c68-fc5045aa9c32 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:31.463010 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1241/2514] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:33.261747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ed381-4a98-4041-8585-87c60312a96b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:33.264349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8b2ed381-4a98-4041-8585-87c60312a96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:33.297687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ed381-4a98-4041-8585-87c60312a96b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:33.324795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:33.327974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:33.330339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:33.331426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] PATH_INFO: `/v3/projects/b40730fa20e34d0685cdde82c0cdf05d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:33.337214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40730fa20e34d0685cdde82c0cdf05d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:33.344681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:33.463455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40730fa20e34d0685cdde82c0cdf05d', 'request_id': 'req-40a1cd53-734b-4377-a97f-2291d8bc0caa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.481286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40730fa20e34d0685cdde82c0cdf05d', 'request_id': 'req-40a1cd53-734b-4377-a97f-2291d8bc0caa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.503513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40730fa20e34d0685cdde82c0cdf05d', 'request_id': 'req-40a1cd53-734b-4377-a97f-2291d8bc0caa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.547550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] The token cache is being invalidate because project b40730fa20e34d0685cdde82c0cdf05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:33.547711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.548461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.561595 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1274/2515] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:33 2022] DELETE /identity/v3/projects/b40730fa20e34d0685cdde82c0cdf05d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:33.562454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79003bf2-5b78-489c-9c68-fc5045aa9c32 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:33.585443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79003bf2-5b78-489c-9c68-fc5045aa9c32 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:33.713522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:33.715262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:33.715544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:33.715815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] PATH_INFO: `/v3/users/21f9ad4c4bf84298b7d2c3c4b0c522bc` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:33.721364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f9ad4c4bf84298b7d2c3c4b0c522bc)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:33.728404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:33.857774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f9ad4c4bf84298b7d2c3c4b0c522bc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.878582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f9ad4c4bf84298b7d2c3c4b0c522bc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.918590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f9ad4c4bf84298b7d2c3c4b0c522bc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.939059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f9ad4c4bf84298b7d2c3c4b0c522bc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.939976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d4a5cc7-b1fb-4013-b9c2-66b99e186ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f9ad4c4bf84298b7d2c3c4b0c522bc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:33.954372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1242/2516] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:33 2022] DELETE /identity/v3/users/21f9ad4c4bf84298b7d2c3c4b0c522bc => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:34.899636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:34.901282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:35.088358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1cd53-734b-4377-a97f-2291d8bc0caa admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:35.111493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:35.303193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc43e80-e1bc-44cf-99f7-6c85dd15ece3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:35.305845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc43e80-e1bc-44cf-99f7-6c85dd15ece3 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.306340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc43e80-e1bc-44cf-99f7-6c85dd15ece3 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.307379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc43e80-e1bc-44cf-99f7-6c85dd15ece3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.312076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7cc43e80-e1bc-44cf-99f7-6c85dd15ece3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:35.392528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc43e80-e1bc-44cf-99f7-6c85dd15ece3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:35.394293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc43e80-e1bc-44cf-99f7-6c85dd15ece3 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:35.441993 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1275/2517] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:35.670223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ab3b7-0328-4645-bdde-52e2e7cafb47 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:35.670819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ab3b7-0328-4645-bdde-52e2e7cafb47 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:35.670819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ab3b7-0328-4645-bdde-52e2e7cafb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:35.713450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3d7ab3b7-0328-4645-bdde-52e2e7cafb47 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:35.714789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3d7ab3b7-0328-4645-bdde-52e2e7cafb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:35.816715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:35.898158 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1243/2518] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:16:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:35.928465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc43e80-e1bc-44cf-99f7-6c85dd15ece3 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:35.929959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7cc43e80-e1bc-44cf-99f7-6c85dd15ece3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:36.050904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc43e80-e1bc-44cf-99f7-6c85dd15ece3 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.061148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488eb7-0ffd-4658-8034-dfb13f5fb0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.061849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488eb7-0ffd-4658-8034-dfb13f5fb0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.062155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488eb7-0ffd-4658-8034-dfb13f5fb0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.062427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a488eb7-0ffd-4658-8034-dfb13f5fb0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.089855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a488eb7-0ffd-4658-8034-dfb13f5fb0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.091474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a488eb7-0ffd-4658-8034-dfb13f5fb0e8 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.127789 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1276/2519] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:36.202970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0795c-fb67-4950-af91-5f33bbbfbdbf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.203632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0795c-fb67-4950-af91-5f33bbbfbdbf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.204363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0795c-fb67-4950-af91-5f33bbbfbdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.263366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4ca0795c-fb67-4950-af91-5f33bbbfbdbf None None] MFA Rules not processed for user `e21e2dd174ae4c99b8c413d1c19d0a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:36.265091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4ca0795c-fb67-4950-af91-5f33bbbfbdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:36.385986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488eb7-0ffd-4658-8034-dfb13f5fb0e8 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.387470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4a488eb7-0ffd-4658-8034-dfb13f5fb0e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:36.430901 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1244/2520] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:36.448022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0795c-fb67-4950-af91-5f33bbbfbdbf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:36.452564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4ca0795c-fb67-4950-af91-5f33bbbfbdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:36.499859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0795c-fb67-4950-af91-5f33bbbfbdbf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.533329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c1a20-0df8-4d7b-a5df-a1fcd7d0016a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.536129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1a20-0df8-4d7b-a5df-a1fcd7d0016a service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.536350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a488eb7-0ffd-4658-8034-dfb13f5fb0e8 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:36.537428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1a20-0df8-4d7b-a5df-a1fcd7d0016a service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.539089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c1a20-0df8-4d7b-a5df-a1fcd7d0016a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.551693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c1a20-0df8-4d7b-a5df-a1fcd7d0016a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.553917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c1a20-0df8-4d7b-a5df-a1fcd7d0016a service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.557850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:36.558556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.558839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.559113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] PATH_INFO: `/v3/projects/d56cb5477a4e41e9b85364c23a4ebed1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.563833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56cb5477a4e41e9b85364c23a4ebed1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:36.570410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:36.585867 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1245/2521] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:36.687329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:36.689315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56cb5477a4e41e9b85364c23a4ebed1', 'request_id': 'req-a63a847c-7086-42ef-a863-82b5132c1759'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:36.701975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56cb5477a4e41e9b85364c23a4ebed1', 'request_id': 'req-a63a847c-7086-42ef-a863-82b5132c1759'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:36.719460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56cb5477a4e41e9b85364c23a4ebed1', 'request_id': 'req-a63a847c-7086-42ef-a863-82b5132c1759'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:36.735400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] The token cache is being invalidate because project d56cb5477a4e41e9b85364c23a4ebed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:36.735989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:36.738093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63a847c-7086-42ef-a863-82b5132c1759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:36.746103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d53e0-8ff9-426a-8941-7da1ad43de66 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.746662 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1277/2522] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:36 2022] DELETE /identity/v3/projects/d56cb5477a4e41e9b85364c23a4ebed1 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:36.746798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d53e0-8ff9-426a-8941-7da1ad43de66 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.746961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d53e0-8ff9-426a-8941-7da1ad43de66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:36.787271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-913d53e0-8ff9-426a-8941-7da1ad43de66 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:36.789033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-913d53e0-8ff9-426a-8941-7da1ad43de66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:36.933116 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1246/2523] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:36.946662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97816f-9a97-4ccf-ae93-6f7348883a69 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:36.947618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97816f-9a97-4ccf-ae93-6f7348883a69 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:36.948084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97816f-9a97-4ccf-ae93-6f7348883a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.021944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ba97816f-9a97-4ccf-ae93-6f7348883a69 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:37.023517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ba97816f-9a97-4ccf-ae93-6f7348883a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:37.051562 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1278/2524] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:37.052331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d53e0-8ff9-426a-8941-7da1ad43de66 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.068022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d53e0-8ff9-426a-8941-7da1ad43de66 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.084446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60528ff-388d-44b3-9800-53663b244de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.089818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60528ff-388d-44b3-9800-53663b244de6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.092384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60528ff-388d-44b3-9800-53663b244de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.092980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60528ff-388d-44b3-9800-53663b244de6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.095444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60528ff-388d-44b3-9800-53663b244de6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:37.096799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60528ff-388d-44b3-9800-53663b244de6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.111268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60528ff-388d-44b3-9800-53663b244de6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.147499 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1247/2525] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:37.153513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97816f-9a97-4ccf-ae93-6f7348883a69 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.169306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551100-1e7a-4c75-acf6-1c40766f199c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.169817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551100-1e7a-4c75-acf6-1c40766f199c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.170308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08551100-1e7a-4c75-acf6-1c40766f199c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.184417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97816f-9a97-4ccf-ae93-6f7348883a69 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.197051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aca786-cda2-4d3a-92cc-6df89dbba8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.198012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aca786-cda2-4d3a-92cc-6df89dbba8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.198785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aca786-cda2-4d3a-92cc-6df89dbba8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.199220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aca786-cda2-4d3a-92cc-6df89dbba8b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.200154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aca786-cda2-4d3a-92cc-6df89dbba8b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.202308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aca786-cda2-4d3a-92cc-6df89dbba8b4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.236630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-08551100-1e7a-4c75-acf6-1c40766f199c None None] MFA Rules not processed for user `bb9f4c8f290947ac996f0415b8b74d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:37.241811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-08551100-1e7a-4c75-acf6-1c40766f199c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:37.278295 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1279/2526] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:37 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:37.283616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aca786-cda2-4d3a-92cc-6df89dbba8b4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.328666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:37.408248 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1248/2527] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:37.415176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08551100-1e7a-4c75-acf6-1c40766f199c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.417167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-08551100-1e7a-4c75-acf6-1c40766f199c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:37.451717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08551100-1e7a-4c75-acf6-1c40766f199c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.456761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aca786-cda2-4d3a-92cc-6df89dbba8b4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.469001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc3b3c-dd22-48e6-ad74-09f2208a8cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.469834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3b3c-dd22-48e6-ad74-09f2208a8cca admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.470238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3b3c-dd22-48e6-ad74-09f2208a8cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.470602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc3b3c-dd22-48e6-ad74-09f2208a8cca admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.471445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc3b3c-dd22-48e6-ad74-09f2208a8cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.474388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3002b-64bd-4d21-b29c-421d1bf7937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.474621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc3b3c-dd22-48e6-ad74-09f2208a8cca admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.475143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3002b-64bd-4d21-b29c-421d1bf7937d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.475474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3002b-64bd-4d21-b29c-421d1bf7937d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.475751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3002b-64bd-4d21-b29c-421d1bf7937d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.476444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3002b-64bd-4d21-b29c-421d1bf7937d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.479181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3002b-64bd-4d21-b29c-421d1bf7937d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.542324 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1280/2528] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:37 2022] POST /identity/v3/users => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:37.546959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3002b-64bd-4d21-b29c-421d1bf7937d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.585919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3002b-64bd-4d21-b29c-421d1bf7937d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.606453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aa77e-4d8c-4e52-9add-ed2fc6ca30c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.607384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aa77e-4d8c-4e52-9add-ed2fc6ca30c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.607663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aa77e-4d8c-4e52-9add-ed2fc6ca30c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.607936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080aa77e-4d8c-4e52-9add-ed2fc6ca30c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.608616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080aa77e-4d8c-4e52-9add-ed2fc6ca30c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.610368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080aa77e-4d8c-4e52-9add-ed2fc6ca30c6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.634577 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1249/2529] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:37 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:37.649465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc3b3c-dd22-48e6-ad74-09f2208a8cca admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.661162 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1281/2530] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:37.662565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aa77e-4d8c-4e52-9add-ed2fc6ca30c6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.699731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080aa77e-4d8c-4e52-9add-ed2fc6ca30c6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.877713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc3b3c-dd22-48e6-ad74-09f2208a8cca admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.878911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3dac4-26ef-40f2-b88b-5da1974c5551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.879748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3dac4-26ef-40f2-b88b-5da1974c5551 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.879906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3dac4-26ef-40f2-b88b-5da1974c5551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.880078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3dac4-26ef-40f2-b88b-5da1974c5551 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.882198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3dac4-26ef-40f2-b88b-5da1974c5551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.883343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3dac4-26ef-40f2-b88b-5da1974c5551 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.895606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0202e6-4edd-4c59-a960-a20c67ae3c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.896517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0202e6-4edd-4c59-a960-a20c67ae3c48 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.897048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0202e6-4edd-4c59-a960-a20c67ae3c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.897468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0202e6-4edd-4c59-a960-a20c67ae3c48 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.899302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0202e6-4edd-4c59-a960-a20c67ae3c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.901364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0202e6-4edd-4c59-a960-a20c67ae3c48 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:37.916224 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1282/2531] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:37.917267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3dac4-26ef-40f2-b88b-5da1974c5551 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.941001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3dac4-26ef-40f2-b88b-5da1974c5551 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.948531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e98cd-fdd2-4be9-a5a9-f6e7897cb2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:37.950059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e98cd-fdd2-4be9-a5a9-f6e7897cb2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:37.950524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e98cd-fdd2-4be9-a5a9-f6e7897cb2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:37.950942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e98cd-fdd2-4be9-a5a9-f6e7897cb2e0 admin admin] PATH_INFO: `/v3/projects/925c286a58a5485981c726198f30cf01/users/0463c6e9e1c641a7b97d397fd72af9db/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:37.963797 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1250/2532] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:37 2022] POST /identity/v3/users => generated 298 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:37.967588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0202e6-4edd-4c59-a960-a20c67ae3c48 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:37.984214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0202e6-4edd-4c59-a960-a20c67ae3c48 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:37.993119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e98cd-fdd2-4be9-a5a9-f6e7897cb2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925c286a58a5485981c726198f30cf01, user_id=0463c6e9e1c641a7b97d397fd72af9db, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:37.996994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e98cd-fdd2-4be9-a5a9-f6e7897cb2e0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.000960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7e449-cdd0-44c1-a99b-70a3b8082e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:38.001843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7e449-cdd0-44c1-a99b-70a3b8082e60 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.002327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7e449-cdd0-44c1-a99b-70a3b8082e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.002742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7e449-cdd0-44c1-a99b-70a3b8082e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.003571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7e449-cdd0-44c1-a99b-70a3b8082e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:38.005426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7e449-cdd0-44c1-a99b-70a3b8082e60 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.020011 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1251/2533] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:38.028380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:38.030047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7e449-cdd0-44c1-a99b-70a3b8082e60 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:38.049409 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1283/2534] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:37 2022] PUT /identity/v3/projects/925c286a58a5485981c726198f30cf01/users/0463c6e9e1c641a7b97d397fd72af9db/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:38.051159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcdf57-a49b-49bf-8f01-097c44d13359 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.052118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcdf57-a49b-49bf-8f01-097c44d13359 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.053392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcdf57-a49b-49bf-8f01-097c44d13359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.070402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7e449-cdd0-44c1-a99b-70a3b8082e60 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:38.109995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-67fcdf57-a49b-49bf-8f01-097c44d13359 None None] MFA Rules not processed for user `0463c6e9e1c641a7b97d397fd72af9db`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:38.117226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-67fcdf57-a49b-49bf-8f01-097c44d13359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:38.222245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694793ec-5bcd-4c6c-9588-cb9e2d66eb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:38.223256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694793ec-5bcd-4c6c-9588-cb9e2d66eb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.223683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694793ec-5bcd-4c6c-9588-cb9e2d66eb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.224099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694793ec-5bcd-4c6c-9588-cb9e2d66eb1f admin admin] PATH_INFO: `/v3/projects/a5648de0d3344676ae5573fd9472ec61/users/7193519296024afdb72ef0802d2dfb50/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.257624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694793ec-5bcd-4c6c-9588-cb9e2d66eb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5648de0d3344676ae5573fd9472ec61, user_id=7193519296024afdb72ef0802d2dfb50, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:38.267186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694793ec-5bcd-4c6c-9588-cb9e2d66eb1f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.281406 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1284/2535] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:38.283002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcdf57-a49b-49bf-8f01-097c44d13359 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:38.297784 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1252/2536] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:38 2022] PUT /identity/v3/projects/a5648de0d3344676ae5573fd9472ec61/users/7193519296024afdb72ef0802d2dfb50/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:38.301722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694793ec-5bcd-4c6c-9588-cb9e2d66eb1f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:38.306097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcdf57-a49b-49bf-8f01-097c44d13359 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:38.323712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:38.442299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694793ec-5bcd-4c6c-9588-cb9e2d66eb1f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:38.444814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78666634-c73b-4a0a-b2a0-6bc38deecb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:38.445760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78666634-c73b-4a0a-b2a0-6bc38deecb25 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.446304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78666634-c73b-4a0a-b2a0-6bc38deecb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.446725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78666634-c73b-4a0a-b2a0-6bc38deecb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.448348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78666634-c73b-4a0a-b2a0-6bc38deecb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:38.451048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78666634-c73b-4a0a-b2a0-6bc38deecb25 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.460647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc159e-fd61-4d8f-9614-0ba904bf083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:38.461671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc159e-fd61-4d8f-9614-0ba904bf083a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.462149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc159e-fd61-4d8f-9614-0ba904bf083a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.463041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc159e-fd61-4d8f-9614-0ba904bf083a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.464106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc159e-fd61-4d8f-9614-0ba904bf083a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:38.465980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc159e-fd61-4d8f-9614-0ba904bf083a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.491909 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1253/2537] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:38.499036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc159e-fd61-4d8f-9614-0ba904bf083a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:38.510386 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1285/2538] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:38 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:38.512727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78666634-c73b-4a0a-b2a0-6bc38deecb25 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:38.527346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc159e-fd61-4d8f-9614-0ba904bf083a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:38.655835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec733-bda3-479d-81ef-b1524afc6f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:38.656559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec733-bda3-479d-81ef-b1524afc6f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.656835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec733-bda3-479d-81ef-b1524afc6f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.657106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ec733-bda3-479d-81ef-b1524afc6f00 admin admin] PATH_INFO: `/v3/projects/a5648de0d3344676ae5573fd9472ec61/users/7193519296024afdb72ef0802d2dfb50/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.657460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78666634-c73b-4a0a-b2a0-6bc38deecb25 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:38.659134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ec733-bda3-479d-81ef-b1524afc6f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5648de0d3344676ae5573fd9472ec61, user_id=7193519296024afdb72ef0802d2dfb50, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:38.665021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ec733-bda3-479d-81ef-b1524afc6f00 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.671920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee5331-eac6-4547-bb8b-51a09b3fbbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:38.672896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee5331-eac6-4547-bb8b-51a09b3fbbbb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.673356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee5331-eac6-4547-bb8b-51a09b3fbbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.673912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee5331-eac6-4547-bb8b-51a09b3fbbbb admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.674739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee5331-eac6-4547-bb8b-51a09b3fbbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:38.676721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee5331-eac6-4547-bb8b-51a09b3fbbbb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.684445 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1254/2539] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:38 2022] PUT /identity/v3/projects/a5648de0d3344676ae5573fd9472ec61/users/7193519296024afdb72ef0802d2dfb50/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:38.739541 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1286/2540] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:38 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:38.740756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec733-bda3-479d-81ef-b1524afc6f00 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:38.911883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ec733-bda3-479d-81ef-b1524afc6f00 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:38.927811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d452d-397b-4560-8280-20cfe4750bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:38.928538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d452d-397b-4560-8280-20cfe4750bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:38.928807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d452d-397b-4560-8280-20cfe4750bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:38.929071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d452d-397b-4560-8280-20cfe4750bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:38.929836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d452d-397b-4560-8280-20cfe4750bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:38.931644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d452d-397b-4560-8280-20cfe4750bf9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:38.985451 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1255/2541] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:38.989430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee5331-eac6-4547-bb8b-51a09b3fbbbb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:38.995895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:39.007584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee5331-eac6-4547-bb8b-51a09b3fbbbb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:39.019721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57643364-9593-4010-946a-a33530c44ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:39.020246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643364-9593-4010-946a-a33530c44ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.021134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643364-9593-4010-946a-a33530c44ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.021494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643364-9593-4010-946a-a33530c44ee1 admin admin] PATH_INFO: `/v3/projects/ae9955bf9953407898a147fe8f69883d/users/8032ec1349034a15b32b0af8ff407f83/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.073253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57643364-9593-4010-946a-a33530c44ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9955bf9953407898a147fe8f69883d, user_id=8032ec1349034a15b32b0af8ff407f83, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:39.080811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57643364-9593-4010-946a-a33530c44ee1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:39.109864 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1287/2542] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:38 2022] PUT /identity/v3/projects/ae9955bf9953407898a147fe8f69883d/users/8032ec1349034a15b32b0af8ff407f83/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:39.114532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d452d-397b-4560-8280-20cfe4750bf9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:39.134901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d452d-397b-4560-8280-20cfe4750bf9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:39.193655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:39.233858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c59a8-0fd0-4704-817d-62add41aae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:39.234783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c59a8-0fd0-4704-817d-62add41aae6a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.235055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c59a8-0fd0-4704-817d-62add41aae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.235320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c59a8-0fd0-4704-817d-62add41aae6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.235988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c59a8-0fd0-4704-817d-62add41aae6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:39.241303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c59a8-0fd0-4704-817d-62add41aae6a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:39.271722 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1256/2543] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:39.277245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57643364-9593-4010-946a-a33530c44ee1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:39.290712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57643364-9593-4010-946a-a33530c44ee1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:39.296754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a0eda-b73f-4e4b-976d-f9e077a4ba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:39.297446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0eda-b73f-4e4b-976d-f9e077a4ba7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.297723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0eda-b73f-4e4b-976d-f9e077a4ba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.298159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0eda-b73f-4e4b-976d-f9e077a4ba7b admin admin] PATH_INFO: `/v3/projects/ae9955bf9953407898a147fe8f69883d/users/8032ec1349034a15b32b0af8ff407f83/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.300436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a0eda-b73f-4e4b-976d-f9e077a4ba7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9955bf9953407898a147fe8f69883d, user_id=8032ec1349034a15b32b0af8ff407f83, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:39.303329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a0eda-b73f-4e4b-976d-f9e077a4ba7b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:39.320460 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1288/2544] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:39 2022] PUT /identity/v3/projects/ae9955bf9953407898a147fe8f69883d/users/8032ec1349034a15b32b0af8ff407f83/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:39.330605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e10d50-01fb-42bd-9301-1e7191527d6a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.331235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e10d50-01fb-42bd-9301-1e7191527d6a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.331603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e10d50-01fb-42bd-9301-1e7191527d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.408728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f0e10d50-01fb-42bd-9301-1e7191527d6a None None] MFA Rules not processed for user `8032ec1349034a15b32b0af8ff407f83`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:39.414658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f0e10d50-01fb-42bd-9301-1e7191527d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.570265 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1257/2545] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:39.587810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a0eda-b73f-4e4b-976d-f9e077a4ba7b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:39.589625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5e7a0eda-b73f-4e4b-976d-f9e077a4ba7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:39.819570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a0eda-b73f-4e4b-976d-f9e077a4ba7b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:39.833867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f6e68-6d34-40dc-9e71-5729e3b1bba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:39.834686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f6e68-6d34-40dc-9e71-5729e3b1bba0 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:39.834961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f6e68-6d34-40dc-9e71-5729e3b1bba0 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:39.835226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f6e68-6d34-40dc-9e71-5729e3b1bba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:39.856130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f6e68-6d34-40dc-9e71-5729e3b1bba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:39.857734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f6e68-6d34-40dc-9e71-5729e3b1bba0 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:39.905799 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1289/2546] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:41.150121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783fe79-9165-45b3-a54e-373954567611 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:41.151029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783fe79-9165-45b3-a54e-373954567611 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:41.151444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783fe79-9165-45b3-a54e-373954567611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:41.219310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6783fe79-9165-45b3-a54e-373954567611 None None] MFA Rules not processed for user `885331f5db0b4ad78e75b4653bb89b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:41.225459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6783fe79-9165-45b3-a54e-373954567611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:41.418251 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1258/2547] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:42.318764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f6e68-6d34-40dc-9e71-5729e3b1bba0 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:42.424709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f6e68-6d34-40dc-9e71-5729e3b1bba0 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:42.431823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:42.432634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:42.433006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:42.433435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] PATH_INFO: `/v3/users/0463c6e9e1c641a7b97d397fd72af9db` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.434835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0463c6e9e1c641a7b97d397fd72af9db)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:42.438256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:42.525412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0463c6e9e1c641a7b97d397fd72af9db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:42.526258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0463c6e9e1c641a7b97d397fd72af9db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:42.533298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:42.553480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0463c6e9e1c641a7b97d397fd72af9db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:42.575946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0463c6e9e1c641a7b97d397fd72af9db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:42.594232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0463c6e9e1c641a7b97d397fd72af9db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:42.612529 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1290/2548] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:42 2022] DELETE /identity/v3/users/0463c6e9e1c641a7b97d397fd72af9db => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:42.614891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3964dd5-3cab-469e-a0f3-f6dbdf23990e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:42.615375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3964dd5-3cab-469e-a0f3-f6dbdf23990e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:42.615484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3964dd5-3cab-469e-a0f3-f6dbdf23990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.638502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c3964dd5-3cab-469e-a0f3-f6dbdf23990e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:42.639802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c3964dd5-3cab-469e-a0f3-f6dbdf23990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:42.741478 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1259/2549] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:42.755144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:42.757321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:42.909967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e4d45-e1ab-4673-bf58-d7ddd9edc7d1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:42.924085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a792f7-490c-4ad3-b2ea-4c416d983d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:42.925954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a792f7-490c-4ad3-b2ea-4c416d983d4e service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:42.926597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a792f7-490c-4ad3-b2ea-4c416d983d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:42.926930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a792f7-490c-4ad3-b2ea-4c416d983d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:42.951097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a792f7-490c-4ad3-b2ea-4c416d983d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:42.952832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a792f7-490c-4ad3-b2ea-4c416d983d4e service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:42.980027 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1291/2550] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:43.472406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3964dd5-3cab-469e-a0f3-f6dbdf23990e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:43.474504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c3964dd5-3cab-469e-a0f3-f6dbdf23990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:43.504230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:43.510972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3964dd5-3cab-469e-a0f3-f6dbdf23990e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:43.539318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:43.540382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.541045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.542363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] PATH_INFO: `/v3/projects/925c286a58a5485981c726198f30cf01` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.544502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] RBAC: Authorizing `identity:delete_project(project_id=925c286a58a5485981c726198f30cf01)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:43.547137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:43.662147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925c286a58a5485981c726198f30cf01', 'request_id': 'req-4e529e3a-9efb-47f4-b880-00b307eac75d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:43.700419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925c286a58a5485981c726198f30cf01', 'request_id': 'req-4e529e3a-9efb-47f4-b880-00b307eac75d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:43.711976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925c286a58a5485981c726198f30cf01', 'request_id': 'req-4e529e3a-9efb-47f4-b880-00b307eac75d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:43.746045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] The token cache is being invalidate because project 925c286a58a5485981c726198f30cf01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:43.746720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:43.749725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:43.754381 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1260/2551] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:43 2022] DELETE /identity/v3/projects/925c286a58a5485981c726198f30cf01 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:43.759060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a792f7-490c-4ad3-b2ea-4c416d983d4e service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:43.774367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a792f7-490c-4ad3-b2ea-4c416d983d4e service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:43.917111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:43.922883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:43.925644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:43.926710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:43.926990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:43.927258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] PATH_INFO: `/v3/users/8032ec1349034a15b32b0af8ff407f83` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:43.928620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8032ec1349034a15b32b0af8ff407f83)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:43.932205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:44.018425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8032ec1349034a15b32b0af8ff407f83'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:44.019441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8032ec1349034a15b32b0af8ff407f83'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:44.033217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8032ec1349034a15b32b0af8ff407f83'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:44.064386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8032ec1349034a15b32b0af8ff407f83'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:44.087532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e529e3a-9efb-47f4-b880-00b307eac75d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:44.088599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:44.095376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66af4e2-2820-4005-8ae5-a89e5c0f8da0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:44.096463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66af4e2-2820-4005-8ae5-a89e5c0f8da0 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.096943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66af4e2-2820-4005-8ae5-a89e5c0f8da0 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.097407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66af4e2-2820-4005-8ae5-a89e5c0f8da0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.100218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a66af4e2-2820-4005-8ae5-a89e5c0f8da0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:44.101438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8032ec1349034a15b32b0af8ff407f83'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:44.125561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66af4e2-2820-4005-8ae5-a89e5c0f8da0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:44.127662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66af4e2-2820-4005-8ae5-a89e5c0f8da0 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:44.130866 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1292/2552] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:16:43 2022] DELETE /identity/v3/users/8032ec1349034a15b32b0af8ff407f83 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:44.151282 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1261/2553] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:44.608868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:44.610406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:44.733295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9deff7-e1ab-4300-9869-33e22425a979 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:44.739863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:44.740550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.741102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.741211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] PATH_INFO: `/v3/projects/ae9955bf9953407898a147fe8f69883d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.742616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9955bf9953407898a147fe8f69883d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:44.744840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:44.840998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9955bf9953407898a147fe8f69883d', 'request_id': 'req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:44.856716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9955bf9953407898a147fe8f69883d', 'request_id': 'req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:44.887756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9955bf9953407898a147fe8f69883d', 'request_id': 'req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:44.919556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] The token cache is being invalidate because project ae9955bf9953407898a147fe8f69883d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:16:44.920248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:44.921248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1fa5d8cb-4598-4f46-95e4-5cd2b3aa3d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:16:44.923342 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1293/2554] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:44 2022] DELETE /identity/v3/projects/ae9955bf9953407898a147fe8f69883d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:44.928545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f74b-6586-408c-9145-56200121c859 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:44.929406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f74b-6586-408c-9145-56200121c859 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:44.930403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8f74b-6586-408c-9145-56200121c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:44.956118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1ed8f74b-6586-408c-9145-56200121c859 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:44.957763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ed8f74b-6586-408c-9145-56200121c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:45.127432 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1262/2555] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:45.128779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b1b16-af42-479c-9a85-020db179349a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.129091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b1b16-af42-479c-9a85-020db179349a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.129484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b1b16-af42-479c-9a85-020db179349a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.187397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-436b1b16-af42-479c-9a85-020db179349a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:45.190320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-436b1b16-af42-479c-9a85-020db179349a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:45.211635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f74b-6586-408c-9145-56200121c859 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.212114 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1294/2556] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:45.236343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8f74b-6586-408c-9145-56200121c859 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.242836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fee50-af2f-4318-b4e0-f4d3c787c983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.243873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fee50-af2f-4318-b4e0-f4d3c787c983 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.245193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fee50-af2f-4318-b4e0-f4d3c787c983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.245646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92fee50-af2f-4318-b4e0-f4d3c787c983 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.246565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fee50-af2f-4318-b4e0-f4d3c787c983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:16:45.247024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fee50-af2f-4318-b4e0-f4d3c787c983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.248912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92fee50-af2f-4318-b4e0-f4d3c787c983 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.285541 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1263/2557] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:16:45.291214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b1b16-af42-479c-9a85-020db179349a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.305071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b1b16-af42-479c-9a85-020db179349a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.314886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3266fe-d048-43f3-9ec9-393e1eb0bc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.315621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3266fe-d048-43f3-9ec9-393e1eb0bc5f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.315898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3266fe-d048-43f3-9ec9-393e1eb0bc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.316749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3266fe-d048-43f3-9ec9-393e1eb0bc5f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.317314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3266fe-d048-43f3-9ec9-393e1eb0bc5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.326906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3266fe-d048-43f3-9ec9-393e1eb0bc5f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.374351 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1295/2558] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:45 2022] POST /identity/v3/projects => generated 395 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:45.379505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fee50-af2f-4318-b4e0-f4d3c787c983 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.400267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:45.414416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92fee50-af2f-4318-b4e0-f4d3c787c983 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.536574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af258d31-b282-429a-ba75-9c9080cb3fc6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.536914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af258d31-b282-429a-ba75-9c9080cb3fc6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.537134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af258d31-b282-429a-ba75-9c9080cb3fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.597151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd67370-f4bc-43c6-905b-c8375b92c239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.597770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd67370-f4bc-43c6-905b-c8375b92c239 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.598080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd67370-f4bc-43c6-905b-c8375b92c239 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.599925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd67370-f4bc-43c6-905b-c8375b92c239 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.601910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd67370-f4bc-43c6-905b-c8375b92c239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.607839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd67370-f4bc-43c6-905b-c8375b92c239 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.611960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-af258d31-b282-429a-ba75-9c9080cb3fc6 None None] MFA Rules not processed for user `326ddfe51e68488c8b2bdb3953f7ac95`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:45.613532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-af258d31-b282-429a-ba75-9c9080cb3fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:45.659397 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1264/2559] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:45 2022] POST /identity/v3/users => generated 298 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:45.661384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd67370-f4bc-43c6-905b-c8375b92c239 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.681808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd67370-f4bc-43c6-905b-c8375b92c239 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.690188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5cde-5833-4e5d-8143-6aa4a683febb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.691123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5cde-5833-4e5d-8143-6aa4a683febb admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.692600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5cde-5833-4e5d-8143-6aa4a683febb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.693016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5cde-5833-4e5d-8143-6aa4a683febb admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.695740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb5cde-5833-4e5d-8143-6aa4a683febb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.697648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb5cde-5833-4e5d-8143-6aa4a683febb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.722268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:45.731405 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1265/2560] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:45.738316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5cde-5833-4e5d-8143-6aa4a683febb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.759576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5cde-5833-4e5d-8143-6aa4a683febb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.764214 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1296/2561] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:45.775239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbe38c-8fdf-4814-b829-92bb0ed031e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.775682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8b44d-c7dd-43f6-8d9e-39677658335c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.776040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8b44d-c7dd-43f6-8d9e-39677658335c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.776413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8b44d-c7dd-43f6-8d9e-39677658335c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.777279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe38c-8fdf-4814-b829-92bb0ed031e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.777742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe38c-8fdf-4814-b829-92bb0ed031e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.778379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe38c-8fdf-4814-b829-92bb0ed031e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.779541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbe38c-8fdf-4814-b829-92bb0ed031e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.781786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbe38c-8fdf-4814-b829-92bb0ed031e9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.799383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4bd8b44d-c7dd-43f6-8d9e-39677658335c None None] MFA Rules not processed for user `326ddfe51e68488c8b2bdb3953f7ac95`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:45.803393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4bd8b44d-c7dd-43f6-8d9e-39677658335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:45.806728 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1266/2562] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:45.807751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbe38c-8fdf-4814-b829-92bb0ed031e9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.824545 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1297/2563] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:45.832481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbe38c-8fdf-4814-b829-92bb0ed031e9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.832763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8b44d-c7dd-43f6-8d9e-39677658335c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:45.834753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4bd8b44d-c7dd-43f6-8d9e-39677658335c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:45.838137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f5937-9e05-493c-b65a-1254178a82df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:45.839355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f5937-9e05-493c-b65a-1254178a82df admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.839729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f5937-9e05-493c-b65a-1254178a82df admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.840090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f5937-9e05-493c-b65a-1254178a82df admin admin] PATH_INFO: `/v3/projects/c61056a3bd6e462e96a5c27a887d710f/users/e37ffb070d2443f7b8bcf1ed61041a6d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.882686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f5937-9e05-493c-b65a-1254178a82df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61056a3bd6e462e96a5c27a887d710f, user_id=e37ffb070d2443f7b8bcf1ed61041a6d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:45.886172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f5937-9e05-493c-b65a-1254178a82df admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:45.912040 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1267/2564] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:45 2022] PUT /identity/v3/projects/c61056a3bd6e462e96a5c27a887d710f/users/e37ffb070d2443f7b8bcf1ed61041a6d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:45.914818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374c89-ab46-4f04-a1e3-3e9b61a53af4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:45.915315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374c89-ab46-4f04-a1e3-3e9b61a53af4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:45.915718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35374c89-ab46-4f04-a1e3-3e9b61a53af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:45.945131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8b44d-c7dd-43f6-8d9e-39677658335c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:45.949548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-35374c89-ab46-4f04-a1e3-3e9b61a53af4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:45.950968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-35374c89-ab46-4f04-a1e3-3e9b61a53af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:46.067496 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1268/2565] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:46.090499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35374c89-ab46-4f04-a1e3-3e9b61a53af4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:46.092317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-35374c89-ab46-4f04-a1e3-3e9b61a53af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:46.097405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10a115-a5a6-485e-9fd9-a829d4627bcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:46.098230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10a115-a5a6-485e-9fd9-a829d4627bcd service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.098576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10a115-a5a6-485e-9fd9-a829d4627bcd service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.098919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10a115-a5a6-485e-9fd9-a829d4627bcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:46.216223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:46.227726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35374c89-ab46-4f04-a1e3-3e9b61a53af4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:46.233379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62cc6d-b7b9-4187-98de-7035eb1e5eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:46.234464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62cc6d-b7b9-4187-98de-7035eb1e5eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:46.235001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10a115-a5a6-485e-9fd9-a829d4627bcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:46.235354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62cc6d-b7b9-4187-98de-7035eb1e5eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:46.235881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62cc6d-b7b9-4187-98de-7035eb1e5eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:46.236837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10a115-a5a6-485e-9fd9-a829d4627bcd service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:46.251932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62cc6d-b7b9-4187-98de-7035eb1e5eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:46.256369 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1298/2566] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:46.274553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62cc6d-b7b9-4187-98de-7035eb1e5eb4 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:46.296526 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1269/2567] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:16:54.809676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0acb0-b1a7-42f9-8af3-2dfbab6cd715 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:54.810363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0acb0-b1a7-42f9-8af3-2dfbab6cd715 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:54.810872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0acb0-b1a7-42f9-8af3-2dfbab6cd715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:54.873580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:54.897810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f9d0acb0-b1a7-42f9-8af3-2dfbab6cd715 None None] MFA Rules not processed for user `7193519296024afdb72ef0802d2dfb50`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:54.899578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f9d0acb0-b1a7-42f9-8af3-2dfbab6cd715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:55.088748 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1299/2568] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:16:55.702550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62cc6d-b7b9-4187-98de-7035eb1e5eb4 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:55.704891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8d62cc6d-b7b9-4187-98de-7035eb1e5eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:55.759888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62cc6d-b7b9-4187-98de-7035eb1e5eb4 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:55.770635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f544e-4f38-4fd6-a85a-aec7bef33fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:55.771381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f544e-4f38-4fd6-a85a-aec7bef33fa2 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:55.771725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f544e-4f38-4fd6-a85a-aec7bef33fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:55.772916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f544e-4f38-4fd6-a85a-aec7bef33fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:55.775760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c19f544e-4f38-4fd6-a85a-aec7bef33fa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:55.895818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f544e-4f38-4fd6-a85a-aec7bef33fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:55.898923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f544e-4f38-4fd6-a85a-aec7bef33fa2 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:55.916311 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1270/2569] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:16:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:58.214458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542a7a-1443-469c-8691-90a0c89c867f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.215328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542a7a-1443-469c-8691-90a0c89c867f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.215773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10542a7a-1443-469c-8691-90a0c89c867f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.274911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-10542a7a-1443-469c-8691-90a0c89c867f None None] MFA Rules not processed for user `e37ffb070d2443f7b8bcf1ed61041a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:58.276657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-10542a7a-1443-469c-8691-90a0c89c867f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:58.377066 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1300/2570] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:16:58.382128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f544e-4f38-4fd6-a85a-aec7bef33fa2 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:58.395499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f544e-4f38-4fd6-a85a-aec7bef33fa2 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:58.412643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c23a-f3f7-4399-88a6-d19e9d963fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:58.413350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c23a-f3f7-4399-88a6-d19e9d963fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.413624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c23a-f3f7-4399-88a6-d19e9d963fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.413992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4c23a-f3f7-4399-88a6-d19e9d963fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.414587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4c23a-f3f7-4399-88a6-d19e9d963fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:58.424684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4c23a-f3f7-4399-88a6-d19e9d963fb3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:58.490088 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1271/2571] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:16:58 2022] POST /identity/v3/projects => generated 395 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:58.494206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10542a7a-1443-469c-8691-90a0c89c867f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:58.519848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10542a7a-1443-469c-8691-90a0c89c867f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:58.631989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c27b7-e50e-4ed4-86bf-4101e6c9084f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:58.633195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c27b7-e50e-4ed4-86bf-4101e6c9084f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.633696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c27b7-e50e-4ed4-86bf-4101e6c9084f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.634272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c27b7-e50e-4ed4-86bf-4101e6c9084f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.635334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c27b7-e50e-4ed4-86bf-4101e6c9084f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:58.638011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c27b7-e50e-4ed4-86bf-4101e6c9084f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:58.698466 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1301/2572] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:16:58 2022] POST /identity/v3/users => generated 304 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:16:58.702648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c23a-f3f7-4399-88a6-d19e9d963fb3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:58.716409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4c23a-f3f7-4399-88a6-d19e9d963fb3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:58.722815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afa33f-37f7-4e6a-9d54-26c87c88208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:58.724233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afa33f-37f7-4e6a-9d54-26c87c88208b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.724893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afa33f-37f7-4e6a-9d54-26c87c88208b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.725506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afa33f-37f7-4e6a-9d54-26c87c88208b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.726525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afa33f-37f7-4e6a-9d54-26c87c88208b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:58.728400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afa33f-37f7-4e6a-9d54-26c87c88208b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:58.745440 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1272/2573] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:58.749506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c27b7-e50e-4ed4-86bf-4101e6c9084f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:58.762163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c27b7-e50e-4ed4-86bf-4101e6c9084f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:58.780560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c0b2a-8ebc-4f7f-bc3c-9ebb1b889f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:58.781253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c0b2a-8ebc-4f7f-bc3c-9ebb1b889f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:58.781525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c0b2a-8ebc-4f7f-bc3c-9ebb1b889f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:58.781789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c0b2a-8ebc-4f7f-bc3c-9ebb1b889f48 admin admin] PATH_INFO: `/v3/projects/487fccb69f7842969e601bdfa5f6288d/users/bba9704be908476fb5c2a81bae27f234/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:58.805796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:58.810750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c0b2a-8ebc-4f7f-bc3c-9ebb1b889f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487fccb69f7842969e601bdfa5f6288d, user_id=bba9704be908476fb5c2a81bae27f234, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:58.813707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c0b2a-8ebc-4f7f-bc3c-9ebb1b889f48 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:58.846004 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1302/2574] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:58 2022] PUT /identity/v3/projects/487fccb69f7842969e601bdfa5f6288d/users/bba9704be908476fb5c2a81bae27f234/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:16:58.850137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afa33f-37f7-4e6a-9d54-26c87c88208b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:58.873358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afa33f-37f7-4e6a-9d54-26c87c88208b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.033069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f7810-001f-473c-af76-bca839b4a566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.036107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f7810-001f-473c-af76-bca839b4a566 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.037289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f7810-001f-473c-af76-bca839b4a566 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.038211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f7810-001f-473c-af76-bca839b4a566 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.040423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f7810-001f-473c-af76-bca839b4a566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.056087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f7810-001f-473c-af76-bca839b4a566 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.089419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c0b2a-8ebc-4f7f-bc3c-9ebb1b889f48 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:16:59.090870 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1273/2575] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:16:59.106326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c0b2a-8ebc-4f7f-bc3c-9ebb1b889f48 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:16:59.122162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8d83a-90e8-481d-9bab-44b831524a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:16:59.127282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8d83a-90e8-481d-9bab-44b831524a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.127678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8d83a-90e8-481d-9bab-44b831524a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.128043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8d83a-90e8-481d-9bab-44b831524a2f admin admin] PATH_INFO: `/v3/projects/487fccb69f7842969e601bdfa5f6288d/users/bba9704be908476fb5c2a81bae27f234/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.135506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8d83a-90e8-481d-9bab-44b831524a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=487fccb69f7842969e601bdfa5f6288d, user_id=bba9704be908476fb5c2a81bae27f234, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:16:59.139281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e8d83a-90e8-481d-9bab-44b831524a2f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:16:59.167350 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1303/2576] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:16:59 2022] PUT /identity/v3/projects/487fccb69f7842969e601bdfa5f6288d/users/bba9704be908476fb5c2a81bae27f234/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:16:59.797029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5f3ea-42da-4dea-bc75-498fd7b03419 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:16:59.797625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5f3ea-42da-4dea-bc75-498fd7b03419 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:16:59.797625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5f3ea-42da-4dea-bc75-498fd7b03419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:16:59.822929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a8c5f3ea-42da-4dea-bc75-498fd7b03419 None None] MFA Rules not processed for user `bb9f4c8f290947ac996f0415b8b74d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:16:59.824173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a8c5f3ea-42da-4dea-bc75-498fd7b03419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:16:59.884210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:59.895244 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1274/2577] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:16:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:02.107664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d687e20-c7d1-4c35-9501-bce30653c988 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:02.109102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d687e20-c7d1-4c35-9501-bce30653c988 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:02.109540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d687e20-c7d1-4c35-9501-bce30653c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:02.139526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8d687e20-c7d1-4c35-9501-bce30653c988 None None] MFA Rules not processed for user `0b4617ac955e438c979ca0938ee117c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:02.145324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8d687e20-c7d1-4c35-9501-bce30653c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:02.256454 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1304/2578] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:08.335068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e716b5-996b-47d9-9fb0-8a373090a23d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.335836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e716b5-996b-47d9-9fb0-8a373090a23d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.335836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e716b5-996b-47d9-9fb0-8a373090a23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.379165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-21e716b5-996b-47d9-9fb0-8a373090a23d None None] MFA Rules not processed for user `bba9704be908476fb5c2a81bae27f234`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:08.380604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-21e716b5-996b-47d9-9fb0-8a373090a23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.522067 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1275/2579] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:08.531982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90966d2e-f4a4-4c79-b970-6f70cce8cb91 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:08.532569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90966d2e-f4a4-4c79-b970-6f70cce8cb91 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:08.532569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90966d2e-f4a4-4c79-b970-6f70cce8cb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:08.571456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-90966d2e-f4a4-4c79-b970-6f70cce8cb91 None None] MFA Rules not processed for user `e37ffb070d2443f7b8bcf1ed61041a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:08.572699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-90966d2e-f4a4-4c79-b970-6f70cce8cb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:08.686601 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1305/2580] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:11.637996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e716b5-996b-47d9-9fb0-8a373090a23d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:11.638699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962e937-b057-4b21-a1ce-f409ecbf2820 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.639515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962e937-b057-4b21-a1ce-f409ecbf2820 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.640075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962e937-b057-4b21-a1ce-f409ecbf2820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.664979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c962e937-b057-4b21-a1ce-f409ecbf2820 None None] MFA Rules not processed for user `326ddfe51e68488c8b2bdb3953f7ac95`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:11.666972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c962e937-b057-4b21-a1ce-f409ecbf2820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:11.788527 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1306/2581] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:11 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:11.824158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e716b5-996b-47d9-9fb0-8a373090a23d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:11.830942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d078b-5d4f-43b8-8568-fe3f899abad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:11.831982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d078b-5d4f-43b8-8568-fe3f899abad8 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:11.832621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d078b-5d4f-43b8-8568-fe3f899abad8 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:11.835044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d078b-5d4f-43b8-8568-fe3f899abad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:11.850136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d078b-5d4f-43b8-8568-fe3f899abad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:11.853060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d078b-5d4f-43b8-8568-fe3f899abad8 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:11.870063 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1276/2582] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:11 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:20.626655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962e937-b057-4b21-a1ce-f409ecbf2820 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:20.628554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c962e937-b057-4b21-a1ce-f409ecbf2820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:20.684324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:20.740261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962e937-b057-4b21-a1ce-f409ecbf2820 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:20.747049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:20.748014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:20.748387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:20.748716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] PATH_INFO: `/v3/users/e21e2dd174ae4c99b8c413d1c19d0a2a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:20.750847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21e2dd174ae4c99b8c413d1c19d0a2a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:20.752999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:20.861325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21e2dd174ae4c99b8c413d1c19d0a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:20.864197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21e2dd174ae4c99b8c413d1c19d0a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:20.881210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21e2dd174ae4c99b8c413d1c19d0a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:20.894178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21e2dd174ae4c99b8c413d1c19d0a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:20.926807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd58e253-4793-400f-861d-64e9fa529d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21e2dd174ae4c99b8c413d1c19d0a2a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:20.944670 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1307/2583] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:20 2022] DELETE /identity/v3/users/e21e2dd174ae4c99b8c413d1c19d0a2a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:21.288608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d078b-5d4f-43b8-8568-fe3f899abad8 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:21.327663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d078b-5d4f-43b8-8568-fe3f899abad8 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:21.468732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:21.471425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:21.472638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:21.472638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] PATH_INFO: `/v3/projects/63475d6211364b38bc3972b7473108c3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:21.478972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63475d6211364b38bc3972b7473108c3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:21.481131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:21.501314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:21.577511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63475d6211364b38bc3972b7473108c3', 'request_id': 'req-57133713-1a27-4369-bfcc-ba55ff6225e6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:21.591316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63475d6211364b38bc3972b7473108c3', 'request_id': 'req-57133713-1a27-4369-bfcc-ba55ff6225e6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:21.601508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63475d6211364b38bc3972b7473108c3', 'request_id': 'req-57133713-1a27-4369-bfcc-ba55ff6225e6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:21.643278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] The token cache is being invalidate because project 63475d6211364b38bc3972b7473108c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:21.643626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:21.645043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-57133713-1a27-4369-bfcc-ba55ff6225e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:21.646958 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1277/2584] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:21 2022] DELETE /identity/v3/projects/63475d6211364b38bc3972b7473108c3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:21.653663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bd5cf-8aa0-4ad8-a56c-5094c59bc2e2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:21.654275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bd5cf-8aa0-4ad8-a56c-5094c59bc2e2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:21.654275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15bd5cf-8aa0-4ad8-a56c-5094c59bc2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:21.681682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a15bd5cf-8aa0-4ad8-a56c-5094c59bc2e2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:21.683452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a15bd5cf-8aa0-4ad8-a56c-5094c59bc2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:21.794588 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1308/2585] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:21.803060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055860de-4e17-475b-ab4c-2cb74e62db90 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:21.803349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055860de-4e17-475b-ab4c-2cb74e62db90 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:21.803625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055860de-4e17-475b-ab4c-2cb74e62db90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:21.861034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-055860de-4e17-475b-ab4c-2cb74e62db90 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:21.862498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-055860de-4e17-475b-ab4c-2cb74e62db90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:21.877735 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1278/2586] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:21.879151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bd5cf-8aa0-4ad8-a56c-5094c59bc2e2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:21.896481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15bd5cf-8aa0-4ad8-a56c-5094c59bc2e2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:21.910297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc87db5-183a-4af6-8a19-f629014b753b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:21.911064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc87db5-183a-4af6-8a19-f629014b753b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:21.911549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc87db5-183a-4af6-8a19-f629014b753b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:21.911869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc87db5-183a-4af6-8a19-f629014b753b admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:21.914900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc87db5-183a-4af6-8a19-f629014b753b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:21.915539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc87db5-183a-4af6-8a19-f629014b753b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:21.919015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc87db5-183a-4af6-8a19-f629014b753b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:21.959829 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1309/2587] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:21.964574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055860de-4e17-475b-ab4c-2cb74e62db90 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:21.980637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055860de-4e17-475b-ab4c-2cb74e62db90 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:21.994395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386bf5-16e9-4c27-98ec-b7bae4fe2c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:21.995297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386bf5-16e9-4c27-98ec-b7bae4fe2c71 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:21.995677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386bf5-16e9-4c27-98ec-b7bae4fe2c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:21.996043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386bf5-16e9-4c27-98ec-b7bae4fe2c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:21.996801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff386bf5-16e9-4c27-98ec-b7bae4fe2c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:22.002295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff386bf5-16e9-4c27-98ec-b7bae4fe2c71 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:22.084117 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1279/2588] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:21 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:22.084743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc87db5-183a-4af6-8a19-f629014b753b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:22.103714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc87db5-183a-4af6-8a19-f629014b753b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:22.249582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:22.281809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c8cf9-0834-4651-b862-daac6bee302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:22.282471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c8cf9-0834-4651-b862-daac6bee302f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:22.282748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c8cf9-0834-4651-b862-daac6bee302f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:22.283018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c8cf9-0834-4651-b862-daac6bee302f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:22.284256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c8cf9-0834-4651-b862-daac6bee302f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:22.287320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c8cf9-0834-4651-b862-daac6bee302f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:22.323465 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1310/2589] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:22 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:17:22.325006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386bf5-16e9-4c27-98ec-b7bae4fe2c71 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:22.372404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386bf5-16e9-4c27-98ec-b7bae4fe2c71 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:22.382476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91c82-1cd9-4766-bebe-a0c1bc331cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:22.383304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91c82-1cd9-4766-bebe-a0c1bc331cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:22.383725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91c82-1cd9-4766-bebe-a0c1bc331cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:22.384147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef91c82-1cd9-4766-bebe-a0c1bc331cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:22.385263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef91c82-1cd9-4766-bebe-a0c1bc331cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:22.387407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef91c82-1cd9-4766-bebe-a0c1bc331cc2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:22.404783 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1280/2590] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:22.405763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c8cf9-0834-4651-b862-daac6bee302f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:22.426312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c8cf9-0834-4651-b862-daac6bee302f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:22.432355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0e9e0-7c17-4f22-98b0-1e69e46ecca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:22.432985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e9e0-7c17-4f22-98b0-1e69e46ecca2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:22.433264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e9e0-7c17-4f22-98b0-1e69e46ecca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:22.433535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e9e0-7c17-4f22-98b0-1e69e46ecca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:22.434285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0e9e0-7c17-4f22-98b0-1e69e46ecca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:22.436213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0e9e0-7c17-4f22-98b0-1e69e46ecca2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:22.450580 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1311/2591] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:22.454736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91c82-1cd9-4766-bebe-a0c1bc331cc2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:22.466864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef91c82-1cd9-4766-bebe-a0c1bc331cc2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:22.473813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3fcc5-ec16-4073-b57c-d322e312c0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:22.475949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3fcc5-ec16-4073-b57c-d322e312c0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:22.476348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3fcc5-ec16-4073-b57c-d322e312c0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:22.476862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3fcc5-ec16-4073-b57c-d322e312c0cd admin admin] PATH_INFO: `/v3/projects/3e87ae4cc51243798be7af2ba7278786/users/7b6db36eb9c94341be5d69f932256067/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:22.499001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3fcc5-ec16-4073-b57c-d322e312c0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e87ae4cc51243798be7af2ba7278786, user_id=7b6db36eb9c94341be5d69f932256067, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:22.502615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3fcc5-ec16-4073-b57c-d322e312c0cd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:22.525523 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1281/2592] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:22 2022] PUT /identity/v3/projects/3e87ae4cc51243798be7af2ba7278786/users/7b6db36eb9c94341be5d69f932256067/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:22.531456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51520688-d62f-4453-84e2-c338a293b233 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:22.532301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51520688-d62f-4453-84e2-c338a293b233 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:22.532301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51520688-d62f-4453-84e2-c338a293b233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:22.571974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-51520688-d62f-4453-84e2-c338a293b233 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:22.574387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51520688-d62f-4453-84e2-c338a293b233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:22.698321 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1312/2593] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:22.750209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3fcc5-ec16-4073-b57c-d322e312c0cd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:22.753286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b3f3fcc5-ec16-4073-b57c-d322e312c0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:22.910229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3fcc5-ec16-4073-b57c-d322e312c0cd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:22.919229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fcf85-bbf8-427b-bb35-9d9aa8f3ebeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:22.919878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fcf85-bbf8-427b-bb35-9d9aa8f3ebeb service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:22.920150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fcf85-bbf8-427b-bb35-9d9aa8f3ebeb service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:22.920421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fcf85-bbf8-427b-bb35-9d9aa8f3ebeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:22.950521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fcf85-bbf8-427b-bb35-9d9aa8f3ebeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:22.952741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fcf85-bbf8-427b-bb35-9d9aa8f3ebeb service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:22.967743 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1282/2594] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:29.450899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51520688-d62f-4453-84e2-c338a293b233 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:29.452507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51520688-d62f-4453-84e2-c338a293b233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:29.667057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51520688-d62f-4453-84e2-c338a293b233 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:29.698042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd50b1-b324-4c01-8a62-bece21dc81e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:29.699033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd50b1-b324-4c01-8a62-bece21dc81e8 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:29.699503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd50b1-b324-4c01-8a62-bece21dc81e8 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:29.699931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd50b1-b324-4c01-8a62-bece21dc81e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:29.702502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-53cd50b1-b324-4c01-8a62-bece21dc81e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:29.875421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:29.902920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd50b1-b324-4c01-8a62-bece21dc81e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:29.904561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cd50b1-b324-4c01-8a62-bece21dc81e8 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:29.926966 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1313/2595] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:29 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:32.811615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b953-52ee-4129-b2e2-5ebf8e75caae None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:32.812092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b953-52ee-4129-b2e2-5ebf8e75caae None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:32.812386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b953-52ee-4129-b2e2-5ebf8e75caae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:32.853198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3736b953-52ee-4129-b2e2-5ebf8e75caae None None] MFA Rules not processed for user `7b6db36eb9c94341be5d69f932256067`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:32.854905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3736b953-52ee-4129-b2e2-5ebf8e75caae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:32.897231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:32.965707 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1283/2596] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:33.167712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd50b1-b324-4c01-8a62-bece21dc81e8 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:33.183922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd50b1-b324-4c01-8a62-bece21dc81e8 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:33.193096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda9310-b530-471e-87e5-19fc8373a7fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:33.194179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda9310-b530-471e-87e5-19fc8373a7fa service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:33.195281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda9310-b530-471e-87e5-19fc8373a7fa service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:33.196097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda9310-b530-471e-87e5-19fc8373a7fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:33.206677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda9310-b530-471e-87e5-19fc8373a7fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:33.208850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda9310-b530-471e-87e5-19fc8373a7fa service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:33.233119 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1314/2597] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:36.564642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fd278-2e20-4bce-b6f1-41380bf1acad None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:36.565126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fd278-2e20-4bce-b6f1-41380bf1acad None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:36.565126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fd278-2e20-4bce-b6f1-41380bf1acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:36.595498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-619fd278-2e20-4bce-b6f1-41380bf1acad None None] MFA Rules not processed for user `7b6db36eb9c94341be5d69f932256067`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:36.596742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-619fd278-2e20-4bce-b6f1-41380bf1acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:36.613415 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1284/2598] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:37.278588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d32f2-d821-4bc8-85bb-9e5ee84350f0 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:37.279237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d32f2-d821-4bc8-85bb-9e5ee84350f0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:37.279392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d32f2-d821-4bc8-85bb-9e5ee84350f0 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:37.281544 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1315/2599] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 04:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:17:37.303293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f4696-e6e9-4dd4-b53a-18e2e19e5079 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:37.304097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f4696-e6e9-4dd4-b53a-18e2e19e5079 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:37.304705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f4696-e6e9-4dd4-b53a-18e2e19e5079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:37.357084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-477f4696-e6e9-4dd4-b53a-18e2e19e5079 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:37.360585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-477f4696-e6e9-4dd4-b53a-18e2e19e5079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:37.494235 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1285/2600] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 04:17:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:37.512729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d32f2-d821-4bc8-85bb-9e5ee84350f0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:37.519364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cc1d32f2-d821-4bc8-85bb-9e5ee84350f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:37.546012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d32f2-d821-4bc8-85bb-9e5ee84350f0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:37.566559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f716-ba3b-45e5-8872-6f8fe4c75a68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:37.567363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f716-ba3b-45e5-8872-6f8fe4c75a68 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:37.567643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f716-ba3b-45e5-8872-6f8fe4c75a68 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:37.568084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f716-ba3b-45e5-8872-6f8fe4c75a68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:37.587070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9f716-ba3b-45e5-8872-6f8fe4c75a68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:37.589313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9f716-ba3b-45e5-8872-6f8fe4c75a68 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:37.604991 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1316/2601] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:37.614082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f4696-e6e9-4dd4-b53a-18e2e19e5079 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:37.617726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-477f4696-e6e9-4dd4-b53a-18e2e19e5079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:37.663286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f4696-e6e9-4dd4-b53a-18e2e19e5079 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:37.690290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:37.690954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:37.691422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:37.692060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] PATH_INFO: `/v3/users/3845aed02101447aa07fabd6a600498f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:37.695585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3845aed02101447aa07fabd6a600498f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:37.697719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:37.794324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3845aed02101447aa07fabd6a600498f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:37.808509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3845aed02101447aa07fabd6a600498f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:37.825777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3845aed02101447aa07fabd6a600498f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:37.839640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3845aed02101447aa07fabd6a600498f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:37.840622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3845aed02101447aa07fabd6a600498f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:37.851176 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1286/2602] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:37 2022] DELETE /identity/v3/users/3845aed02101447aa07fabd6a600498f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:38.701697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f716-ba3b-45e5-8872-6f8fe4c75a68 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:38.743296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f716-ba3b-45e5-8872-6f8fe4c75a68 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:39.012619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:39.013637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:39.014119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:39.015785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] PATH_INFO: `/v3/projects/218b6606ee6242b5919b9f76d7582c2d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:39.019973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=218b6606ee6242b5919b9f76d7582c2d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:39.023911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:39.258952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '218b6606ee6242b5919b9f76d7582c2d', 'request_id': 'req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:39.279066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '218b6606ee6242b5919b9f76d7582c2d', 'request_id': 'req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:39.305669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '218b6606ee6242b5919b9f76d7582c2d', 'request_id': 'req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:39.341455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] The token cache is being invalidate because project 218b6606ee6242b5919b9f76d7582c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:39.341661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:39.344865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:39.350663 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1317/2603] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:38 2022] DELETE /identity/v3/projects/218b6606ee6242b5919b9f76d7582c2d => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:39.352158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:39.354541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:39.373758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84f91-252e-424f-b2d7-d190193c62b6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:39.440081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:39.531198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:39.533610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:39.534658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:39.535667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] PATH_INFO: `/v3/users/2aadabeb4fc04e67a6c6ada79308dcae` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:39.539708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aadabeb4fc04e67a6c6ada79308dcae)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:39.543023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:39.686598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aadabeb4fc04e67a6c6ada79308dcae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:39.717693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aadabeb4fc04e67a6c6ada79308dcae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:39.759783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aadabeb4fc04e67a6c6ada79308dcae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:39.782626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aadabeb4fc04e67a6c6ada79308dcae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:39.783864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fcc945ca-ec30-4a69-b0ef-fe4f97b14ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aadabeb4fc04e67a6c6ada79308dcae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:39.799980 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1287/2604] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:39 2022] DELETE /identity/v3/users/2aadabeb4fc04e67a6c6ada79308dcae => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:40.673582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:40.676718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:40.710937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45d13-ca2b-4b2a-a355-8ae04e9e2012 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:40.854204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:40.879830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:40.880548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:40.880823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:40.881097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] PATH_INFO: `/v3/projects/f6503365f6cf40fea47d7433f776f55c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:40.883216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6503365f6cf40fea47d7433f776f55c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:40.885198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:41.062492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6503365f6cf40fea47d7433f776f55c', 'request_id': 'req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:41.077393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6503365f6cf40fea47d7433f776f55c', 'request_id': 'req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:41.107308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6503365f6cf40fea47d7433f776f55c', 'request_id': 'req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:41.129584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] The token cache is being invalidate because project f6503365f6cf40fea47d7433f776f55c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:41.129993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:41.131309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f7cf5d73-9ddc-4d37-9bd3-bec5b632a2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:41.133186 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1318/2605] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:40 2022] DELETE /identity/v3/projects/f6503365f6cf40fea47d7433f776f55c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:41.138727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5576e90-2ea2-4599-87e5-422a16692fbd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.140438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5576e90-2ea2-4599-87e5-422a16692fbd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.141282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5576e90-2ea2-4599-87e5-422a16692fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.198684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b5576e90-2ea2-4599-87e5-422a16692fbd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:41.203477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b5576e90-2ea2-4599-87e5-422a16692fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:41.416431 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1288/2606] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:41.418707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000114bf-f07c-4e61-8818-3c3e2eb407f9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.418995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000114bf-f07c-4e61-8818-3c3e2eb407f9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.419268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000114bf-f07c-4e61-8818-3c3e2eb407f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.477123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-000114bf-f07c-4e61-8818-3c3e2eb407f9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:41.478112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-000114bf-f07c-4e61-8818-3c3e2eb407f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:41.504398 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1319/2607] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:41.506241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5576e90-2ea2-4599-87e5-422a16692fbd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.525691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5576e90-2ea2-4599-87e5-422a16692fbd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:41.540648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0905f49-25c3-43ab-ac4c-43a73deb7135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:41.541320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0905f49-25c3-43ab-ac4c-43a73deb7135 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.541595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0905f49-25c3-43ab-ac4c-43a73deb7135 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.541858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0905f49-25c3-43ab-ac4c-43a73deb7135 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.542567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0905f49-25c3-43ab-ac4c-43a73deb7135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:41.542863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0905f49-25c3-43ab-ac4c-43a73deb7135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:41.545619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0905f49-25c3-43ab-ac4c-43a73deb7135 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:41.581936 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1289/2608] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:41.585604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000114bf-f07c-4e61-8818-3c3e2eb407f9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.628190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000114bf-f07c-4e61-8818-3c3e2eb407f9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:41.636746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468e59d-b71d-4bf1-948f-b3f23a43c162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:41.639053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468e59d-b71d-4bf1-948f-b3f23a43c162 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.639471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468e59d-b71d-4bf1-948f-b3f23a43c162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.640753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468e59d-b71d-4bf1-948f-b3f23a43c162 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.641832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468e59d-b71d-4bf1-948f-b3f23a43c162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:41.649384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468e59d-b71d-4bf1-948f-b3f23a43c162 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:41.694550 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1320/2609] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:41 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:41.702076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0905f49-25c3-43ab-ac4c-43a73deb7135 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.732406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0905f49-25c3-43ab-ac4c-43a73deb7135 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:41.826401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:41.901070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646edd6-f9d7-42fd-8613-5683c527b499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:41.902832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646edd6-f9d7-42fd-8613-5683c527b499 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:41.903998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646edd6-f9d7-42fd-8613-5683c527b499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:41.906116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646edd6-f9d7-42fd-8613-5683c527b499 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:41.906967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646edd6-f9d7-42fd-8613-5683c527b499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:41.909672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646edd6-f9d7-42fd-8613-5683c527b499 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:41.956734 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1290/2610] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:41 2022] POST /identity/v3/users => generated 296 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:41.958190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468e59d-b71d-4bf1-948f-b3f23a43c162 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:41.983633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468e59d-b71d-4bf1-948f-b3f23a43c162 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.001206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380109a0-63b8-43bc-9cab-6fb8bca15428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.003447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380109a0-63b8-43bc-9cab-6fb8bca15428 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.003887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380109a0-63b8-43bc-9cab-6fb8bca15428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.006764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380109a0-63b8-43bc-9cab-6fb8bca15428 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.007728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380109a0-63b8-43bc-9cab-6fb8bca15428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.015001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380109a0-63b8-43bc-9cab-6fb8bca15428 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.090060 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1321/2611] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:42.094862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646edd6-f9d7-42fd-8613-5683c527b499 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.114106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646edd6-f9d7-42fd-8613-5683c527b499 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.134297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ab433-bd33-414a-9ebb-3ca2beee6740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.135207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab433-bd33-414a-9ebb-3ca2beee6740 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.135790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab433-bd33-414a-9ebb-3ca2beee6740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.136286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ab433-bd33-414a-9ebb-3ca2beee6740 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.137407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ab433-bd33-414a-9ebb-3ca2beee6740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.139273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ab433-bd33-414a-9ebb-3ca2beee6740 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.164060 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1291/2612] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:42.165360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380109a0-63b8-43bc-9cab-6fb8bca15428 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.184461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380109a0-63b8-43bc-9cab-6fb8bca15428 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.190457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abc187-158a-4823-8a01-3bddcd0a5184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.191355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abc187-158a-4823-8a01-3bddcd0a5184 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.191633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abc187-158a-4823-8a01-3bddcd0a5184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.191904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93abc187-158a-4823-8a01-3bddcd0a5184 admin admin] PATH_INFO: `/v3/projects/79c1a9a4eb7c4329a33cbe646da4038e/users/d2338f8b259f42a5af56df2f5450fe65/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.221988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abc187-158a-4823-8a01-3bddcd0a5184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c1a9a4eb7c4329a33cbe646da4038e, user_id=d2338f8b259f42a5af56df2f5450fe65, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.225849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93abc187-158a-4823-8a01-3bddcd0a5184 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.245421 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1322/2613] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:42 2022] PUT /identity/v3/projects/79c1a9a4eb7c4329a33cbe646da4038e/users/d2338f8b259f42a5af56df2f5450fe65/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:42.257285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c05b7b-7304-4ace-ade7-dbb6e174c217 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.257808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c05b7b-7304-4ace-ade7-dbb6e174c217 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.258297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c05b7b-7304-4ace-ade7-dbb6e174c217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.348292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-73c05b7b-7304-4ace-ade7-dbb6e174c217 None None] MFA Rules not processed for user `d2338f8b259f42a5af56df2f5450fe65`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:42.349578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-73c05b7b-7304-4ace-ade7-dbb6e174c217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:42.458966 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1292/2614] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:42.464274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abc187-158a-4823-8a01-3bddcd0a5184 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.572646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93abc187-158a-4823-8a01-3bddcd0a5184 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.581322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e7c02-1548-4b93-9bac-c941b23d74c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.582011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e7c02-1548-4b93-9bac-c941b23d74c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.582285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e7c02-1548-4b93-9bac-c941b23d74c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.582552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e7c02-1548-4b93-9bac-c941b23d74c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.583477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e7c02-1548-4b93-9bac-c941b23d74c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.587021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e7c02-1548-4b93-9bac-c941b23d74c0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.651147 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1323/2615] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:42 2022] POST /identity/v3/projects => generated 391 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:42.655805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c05b7b-7304-4ace-ade7-dbb6e174c217 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.672056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c05b7b-7304-4ace-ade7-dbb6e174c217 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.836970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d191e-0ca5-4264-8570-a15b6c7119d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.838359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d191e-0ca5-4264-8570-a15b6c7119d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.839410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d191e-0ca5-4264-8570-a15b6c7119d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.841540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d191e-0ca5-4264-8570-a15b6c7119d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.845460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d191e-0ca5-4264-8570-a15b6c7119d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.851305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d191e-0ca5-4264-8570-a15b6c7119d9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.920498 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1293/2616] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:42 2022] POST /identity/v3/users => generated 302 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:42.923201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e7c02-1548-4b93-9bac-c941b23d74c0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.938104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e7c02-1548-4b93-9bac-c941b23d74c0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.944595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965417b-a0c3-45f2-a901-e1af7db746c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.946085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965417b-a0c3-45f2-a901-e1af7db746c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.946396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965417b-a0c3-45f2-a901-e1af7db746c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.946675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965417b-a0c3-45f2-a901-e1af7db746c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:42.947346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965417b-a0c3-45f2-a901-e1af7db746c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:42.949140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965417b-a0c3-45f2-a901-e1af7db746c7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:42.951229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:42.968836 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1324/2617] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:42.973626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d191e-0ca5-4264-8570-a15b6c7119d9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:42.986251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d191e-0ca5-4264-8570-a15b6c7119d9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:42.991453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dbed1-6bef-40ad-a276-24740558112b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:42.992210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dbed1-6bef-40ad-a276-24740558112b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:42.992494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dbed1-6bef-40ad-a276-24740558112b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:42.992768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dbed1-6bef-40ad-a276-24740558112b admin admin] PATH_INFO: `/v3/projects/5e1b88d9a171438bbb298adefe7963b7/users/a6c5963ac70548ffbd90feb1e89163fb/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.013109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dbed1-6bef-40ad-a276-24740558112b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1b88d9a171438bbb298adefe7963b7, user_id=a6c5963ac70548ffbd90feb1e89163fb, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.020648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dbed1-6bef-40ad-a276-24740558112b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.038321 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1294/2618] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:42 2022] PUT /identity/v3/projects/5e1b88d9a171438bbb298adefe7963b7/users/a6c5963ac70548ffbd90feb1e89163fb/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:43.041159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965417b-a0c3-45f2-a901-e1af7db746c7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:43.054004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965417b-a0c3-45f2-a901-e1af7db746c7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:43.323241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e5535-d832-4dc1-b09b-b54f988cb8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:43.323983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5535-d832-4dc1-b09b-b54f988cb8df admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.324332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5535-d832-4dc1-b09b-b54f988cb8df admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.324710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e5535-d832-4dc1-b09b-b54f988cb8df admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.325439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e5535-d832-4dc1-b09b-b54f988cb8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.327659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e5535-d832-4dc1-b09b-b54f988cb8df admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.345865 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1325/2619] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:43 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:43.347125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dbed1-6bef-40ad-a276-24740558112b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:43.364800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dbed1-6bef-40ad-a276-24740558112b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:43.379970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2360d-7235-49a6-ba52-7763fefb31d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:43.380622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2360d-7235-49a6-ba52-7763fefb31d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.380901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2360d-7235-49a6-ba52-7763fefb31d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.381167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2360d-7235-49a6-ba52-7763fefb31d7 admin admin] PATH_INFO: `/v3/projects/5e1b88d9a171438bbb298adefe7963b7/users/a6c5963ac70548ffbd90feb1e89163fb/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.386277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2360d-7235-49a6-ba52-7763fefb31d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1b88d9a171438bbb298adefe7963b7, user_id=a6c5963ac70548ffbd90feb1e89163fb, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:43.389068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2360d-7235-49a6-ba52-7763fefb31d7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:43.401284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:43.440173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1700b-e26a-4f4d-ac2f-c6d7e58eeb71 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:43.440376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1700b-e26a-4f4d-ac2f-c6d7e58eeb71 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:43.440625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1700b-e26a-4f4d-ac2f-c6d7e58eeb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:43.445625 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1295/2620] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:43 2022] PUT /identity/v3/projects/5e1b88d9a171438bbb298adefe7963b7/users/a6c5963ac70548ffbd90feb1e89163fb/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:43.510197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-10e1700b-e26a-4f4d-ac2f-c6d7e58eeb71 None None] MFA Rules not processed for user `a6c5963ac70548ffbd90feb1e89163fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:43.511905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-10e1700b-e26a-4f4d-ac2f-c6d7e58eeb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:43.712340 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1326/2621] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:44.016169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2360d-7235-49a6-ba52-7763fefb31d7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:44.167988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2360d-7235-49a6-ba52-7763fefb31d7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:44.181306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:44.182061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:44.182340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:44.183007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] PATH_INFO: `/v3/users/d2338f8b259f42a5af56df2f5450fe65` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:44.186027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2338f8b259f42a5af56df2f5450fe65)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:44.188163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:44.320641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2338f8b259f42a5af56df2f5450fe65'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:44.340214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2338f8b259f42a5af56df2f5450fe65'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:44.366886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2338f8b259f42a5af56df2f5450fe65'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:44.386709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2338f8b259f42a5af56df2f5450fe65'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:44.387970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2338f8b259f42a5af56df2f5450fe65'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:44.403152 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1296/2622] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:44 2022] DELETE /identity/v3/users/d2338f8b259f42a5af56df2f5450fe65 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:44.408667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fca4d1-463a-46bf-bc75-4dc4388e0b9e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:44.409320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fca4d1-463a-46bf-bc75-4dc4388e0b9e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:44.409320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fca4d1-463a-46bf-bc75-4dc4388e0b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:44.436838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-42fca4d1-463a-46bf-bc75-4dc4388e0b9e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:44.438448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-42fca4d1-463a-46bf-bc75-4dc4388e0b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:44.608659 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1327/2623] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:44.614616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:44.616089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:44.788171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d5ac8-b575-414e-b8cf-20d22c05836e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:44.798031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3b237-3ae4-47d9-9186-4389c86dfe4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:44.800839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3b237-3ae4-47d9-9186-4389c86dfe4d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:44.801376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3b237-3ae4-47d9-9186-4389c86dfe4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:44.801834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3b237-3ae4-47d9-9186-4389c86dfe4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:44.826069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3b237-3ae4-47d9-9186-4389c86dfe4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:44.827559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3b237-3ae4-47d9-9186-4389c86dfe4d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:44.859610 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1297/2624] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:46.335123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fca4d1-463a-46bf-bc75-4dc4388e0b9e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:46.337266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-42fca4d1-463a-46bf-bc75-4dc4388e0b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:46.359027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fca4d1-463a-46bf-bc75-4dc4388e0b9e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:46.374682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:46.375646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:46.376097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:46.376573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] PATH_INFO: `/v3/projects/79c1a9a4eb7c4329a33cbe646da4038e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:46.383279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c1a9a4eb7c4329a33cbe646da4038e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:46.385266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:46.426035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:46.512412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c1a9a4eb7c4329a33cbe646da4038e', 'request_id': 'req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.538799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c1a9a4eb7c4329a33cbe646da4038e', 'request_id': 'req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.560531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c1a9a4eb7c4329a33cbe646da4038e', 'request_id': 'req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.588275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] The token cache is being invalidate because project 79c1a9a4eb7c4329a33cbe646da4038e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:46.588582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.591037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.594696 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1328/2625] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:46 2022] DELETE /identity/v3/projects/79c1a9a4eb7c4329a33cbe646da4038e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:46.600567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3b237-3ae4-47d9-9186-4389c86dfe4d service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:46.630685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3b237-3ae4-47d9-9186-4389c86dfe4d service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:46.677650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:46.837253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:46.838506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:46.838990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:46.839459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] PATH_INFO: `/v3/users/a6c5963ac70548ffbd90feb1e89163fb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:46.840966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c5963ac70548ffbd90feb1e89163fb)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:46.846873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:46.952623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c5963ac70548ffbd90feb1e89163fb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.975530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c5963ac70548ffbd90feb1e89163fb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:46.997278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c5963ac70548ffbd90feb1e89163fb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.012959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c5963ac70548ffbd90feb1e89163fb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.014460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3989901-8360-4a1c-80ff-fda1cb3486a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c5963ac70548ffbd90feb1e89163fb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:47.028724 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1298/2626] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:46 2022] DELETE /identity/v3/users/a6c5963ac70548ffbd90feb1e89163fb => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:47.959987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:47.963724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:47.987667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe6e4a-fca8-46da-a4d1-875ba7f9c5e4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.124473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.125489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.126265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.126759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] PATH_INFO: `/v3/projects/5e1b88d9a171438bbb298adefe7963b7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.128663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e1b88d9a171438bbb298adefe7963b7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.132219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.222698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e1b88d9a171438bbb298adefe7963b7', 'request_id': 'req-da0ba825-7cc2-4f93-9106-f69392b254e7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:48.232683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e1b88d9a171438bbb298adefe7963b7', 'request_id': 'req-da0ba825-7cc2-4f93-9106-f69392b254e7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:48.247760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e1b88d9a171438bbb298adefe7963b7', 'request_id': 'req-da0ba825-7cc2-4f93-9106-f69392b254e7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:48.276245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] The token cache is being invalidate because project 5e1b88d9a171438bbb298adefe7963b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:48.277090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:48.278928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da0ba825-7cc2-4f93-9106-f69392b254e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:48.282075 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1329/2627] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:47 2022] DELETE /identity/v3/projects/5e1b88d9a171438bbb298adefe7963b7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:48.288252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9d7c9-dcba-4a7d-b987-e09e215e54e8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.288905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9d7c9-dcba-4a7d-b987-e09e215e54e8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.289644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9d7c9-dcba-4a7d-b987-e09e215e54e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.327458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fcc9d7c9-dcba-4a7d-b987-e09e215e54e8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:48.329812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fcc9d7c9-dcba-4a7d-b987-e09e215e54e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:48.441632 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1299/2628] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:48.450134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e1a32-c351-4d97-b6e0-e8ca83d09784 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.451127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e1a32-c351-4d97-b6e0-e8ca83d09784 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.451569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e1a32-c351-4d97-b6e0-e8ca83d09784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.496584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-573e1a32-c351-4d97-b6e0-e8ca83d09784 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:48.499916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-573e1a32-c351-4d97-b6e0-e8ca83d09784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:48.526807 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1330/2629] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:48.529541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9d7c9-dcba-4a7d-b987-e09e215e54e8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.540947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9d7c9-dcba-4a7d-b987-e09e215e54e8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.554839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e38c-4506-48f6-b0aa-7cac68284895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.556620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e38c-4506-48f6-b0aa-7cac68284895 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.559192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e38c-4506-48f6-b0aa-7cac68284895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.562207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e38c-4506-48f6-b0aa-7cac68284895 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.563302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0e38c-4506-48f6-b0aa-7cac68284895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:48.564652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0e38c-4506-48f6-b0aa-7cac68284895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.568788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0e38c-4506-48f6-b0aa-7cac68284895 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.599440 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1300/2630] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:17:48.601570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e1a32-c351-4d97-b6e0-e8ca83d09784 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.617275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e1a32-c351-4d97-b6e0-e8ca83d09784 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.624028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d4013-99fc-4bb9-8a1d-838bb967a13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.625020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d4013-99fc-4bb9-8a1d-838bb967a13c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.625546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d4013-99fc-4bb9-8a1d-838bb967a13c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.626044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d4013-99fc-4bb9-8a1d-838bb967a13c admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.627171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d4013-99fc-4bb9-8a1d-838bb967a13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.629338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d4013-99fc-4bb9-8a1d-838bb967a13c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.673971 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1331/2631] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/projects => generated 391 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:48.675247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e38c-4506-48f6-b0aa-7cac68284895 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.686995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e38c-4506-48f6-b0aa-7cac68284895 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.737266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:48.827482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a28c1b-7122-4c4e-82a3-5a4c060806e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.828278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28c1b-7122-4c4e-82a3-5a4c060806e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.828391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28c1b-7122-4c4e-82a3-5a4c060806e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.834996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a28c1b-7122-4c4e-82a3-5a4c060806e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.836080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a28c1b-7122-4c4e-82a3-5a4c060806e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.838155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a28c1b-7122-4c4e-82a3-5a4c060806e2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.892750 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1301/2632] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:48 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:48.898489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d4013-99fc-4bb9-8a1d-838bb967a13c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:48.909436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:48.919080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d4013-99fc-4bb9-8a1d-838bb967a13c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:48.936251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd61901-63f7-4910-9450-13ad2fa8d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:48.939205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd61901-63f7-4910-9450-13ad2fa8d1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:48.940720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd61901-63f7-4910-9450-13ad2fa8d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:48.941618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd61901-63f7-4910-9450-13ad2fa8d1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:48.942818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd61901-63f7-4910-9450-13ad2fa8d1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:48.949922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd61901-63f7-4910-9450-13ad2fa8d1d8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:48.997574 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1332/2633] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:48.999953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a28c1b-7122-4c4e-82a3-5a4c060806e2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.033232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a28c1b-7122-4c4e-82a3-5a4c060806e2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.062210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013dfcd-1484-4fee-8071-67ee9bfdedfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.062859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013dfcd-1484-4fee-8071-67ee9bfdedfc admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.063141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013dfcd-1484-4fee-8071-67ee9bfdedfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.063413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013dfcd-1484-4fee-8071-67ee9bfdedfc admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.065228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013dfcd-1484-4fee-8071-67ee9bfdedfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.067218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013dfcd-1484-4fee-8071-67ee9bfdedfc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.094772 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1302/2634] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:49.100565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd61901-63f7-4910-9450-13ad2fa8d1d8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.151806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd61901-63f7-4910-9450-13ad2fa8d1d8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.174916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa77d21-9868-471e-af6b-670bba9f94e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.177978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa77d21-9868-471e-af6b-670bba9f94e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.178485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa77d21-9868-471e-af6b-670bba9f94e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.180680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa77d21-9868-471e-af6b-670bba9f94e6 admin admin] PATH_INFO: `/v3/projects/25debb621b854ce48bc85f166962a9f6/users/dc59196ea2ad44df8feb2f68cf4b8626/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.232721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa77d21-9868-471e-af6b-670bba9f94e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25debb621b854ce48bc85f166962a9f6, user_id=dc59196ea2ad44df8feb2f68cf4b8626, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.236000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa77d21-9868-471e-af6b-670bba9f94e6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.263554 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1333/2635] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:49 2022] PUT /identity/v3/projects/25debb621b854ce48bc85f166962a9f6/users/dc59196ea2ad44df8feb2f68cf4b8626/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:49.274465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1c6c-486d-4f5d-a03c-4c2fa8a7e46e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.274854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1c6c-486d-4f5d-a03c-4c2fa8a7e46e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.275547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1c6c-486d-4f5d-a03c-4c2fa8a7e46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.315038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9b8c1c6c-486d-4f5d-a03c-4c2fa8a7e46e None None] MFA Rules not processed for user `dc59196ea2ad44df8feb2f68cf4b8626`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:49.316624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9b8c1c6c-486d-4f5d-a03c-4c2fa8a7e46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:49.424022 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1303/2636] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:49.430387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa77d21-9868-471e-af6b-670bba9f94e6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.513711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa77d21-9868-471e-af6b-670bba9f94e6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.522611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79c6d0-4587-44c9-a5a1-3defe1a37135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.524004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79c6d0-4587-44c9-a5a1-3defe1a37135 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.524004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79c6d0-4587-44c9-a5a1-3defe1a37135 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.524321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79c6d0-4587-44c9-a5a1-3defe1a37135 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.526709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79c6d0-4587-44c9-a5a1-3defe1a37135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.533410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79c6d0-4587-44c9-a5a1-3defe1a37135 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.573728 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1334/2637] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:49 2022] POST /identity/v3/projects => generated 391 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:49.575257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1c6c-486d-4f5d-a03c-4c2fa8a7e46e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.589414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1c6c-486d-4f5d-a03c-4c2fa8a7e46e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.702417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1bc9-e45e-473a-837a-5f207f27df92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.705772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1bc9-e45e-473a-837a-5f207f27df92 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.707306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1bc9-e45e-473a-837a-5f207f27df92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.707744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1bc9-e45e-473a-837a-5f207f27df92 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.708839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1bc9-e45e-473a-837a-5f207f27df92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.712493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1bc9-e45e-473a-837a-5f207f27df92 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.761023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1304/2638] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:49 2022] POST /identity/v3/users => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:49.764945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79c6d0-4587-44c9-a5a1-3defe1a37135 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.781372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79c6d0-4587-44c9-a5a1-3defe1a37135 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.796375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0d088-77e3-40f5-9e67-b0b15587a1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.797039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d088-77e3-40f5-9e67-b0b15587a1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.797472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d088-77e3-40f5-9e67-b0b15587a1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.797865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d088-77e3-40f5-9e67-b0b15587a1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.798836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d088-77e3-40f5-9e67-b0b15587a1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.800734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d088-77e3-40f5-9e67-b0b15587a1d1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.817306 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1335/2639] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:49.818784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1bc9-e45e-473a-837a-5f207f27df92 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.833018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1bc9-e45e-473a-837a-5f207f27df92 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:49.840846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff316-aecc-4f42-bd28-b205ea901c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:49.841544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff316-aecc-4f42-bd28-b205ea901c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:49.841817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff316-aecc-4f42-bd28-b205ea901c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:49.842235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ff316-aecc-4f42-bd28-b205ea901c42 admin admin] PATH_INFO: `/v3/projects/7f01cf3f37344e48b80e29d903bc3317/users/9648af0b2e584fb6bdbf348d9d505371/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:49.865795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ff316-aecc-4f42-bd28-b205ea901c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f01cf3f37344e48b80e29d903bc3317, user_id=9648af0b2e584fb6bdbf348d9d505371, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:49.871469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ff316-aecc-4f42-bd28-b205ea901c42 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:49.884354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:49.891245 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1305/2640] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:49 2022] PUT /identity/v3/projects/7f01cf3f37344e48b80e29d903bc3317/users/9648af0b2e584fb6bdbf348d9d505371/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:49.895376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0d088-77e3-40f5-9e67-b0b15587a1d1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:49.923007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0d088-77e3-40f5-9e67-b0b15587a1d1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:50.018200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629a0a1-99a9-49ba-b960-7538dbc0e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:50.022754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629a0a1-99a9-49ba-b960-7538dbc0e422 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:50.024292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629a0a1-99a9-49ba-b960-7538dbc0e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:50.026737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629a0a1-99a9-49ba-b960-7538dbc0e422 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:50.027934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629a0a1-99a9-49ba-b960-7538dbc0e422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:50.030571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629a0a1-99a9-49ba-b960-7538dbc0e422 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:50.059612 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1336/2641] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:50.061460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff316-aecc-4f42-bd28-b205ea901c42 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:50.083768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ff316-aecc-4f42-bd28-b205ea901c42 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:50.095743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccbe14-ad9a-4465-9bb7-5516c648ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:50.097828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccbe14-ad9a-4465-9bb7-5516c648ea29 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:50.098414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccbe14-ad9a-4465-9bb7-5516c648ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:50.100439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccbe14-ad9a-4465-9bb7-5516c648ea29 admin admin] PATH_INFO: `/v3/projects/7f01cf3f37344e48b80e29d903bc3317/users/9648af0b2e584fb6bdbf348d9d505371/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:50.112265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccbe14-ad9a-4465-9bb7-5516c648ea29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f01cf3f37344e48b80e29d903bc3317, user_id=9648af0b2e584fb6bdbf348d9d505371, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:50.118834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccbe14-ad9a-4465-9bb7-5516c648ea29 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:50.158160 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1306/2642] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:50 2022] PUT /identity/v3/projects/7f01cf3f37344e48b80e29d903bc3317/users/9648af0b2e584fb6bdbf348d9d505371/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:50.166672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce42120-b564-4b08-add1-7aba212f8cef None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:50.167283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce42120-b564-4b08-add1-7aba212f8cef None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:50.168022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce42120-b564-4b08-add1-7aba212f8cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:50.207332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b489c-d3fe-4da9-887f-e856cc8b27da None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:50.207712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b489c-d3fe-4da9-887f-e856cc8b27da None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:50.207883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b489c-d3fe-4da9-887f-e856cc8b27da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:50.211035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-dce42120-b564-4b08-add1-7aba212f8cef None None] MFA Rules not processed for user `9648af0b2e584fb6bdbf348d9d505371`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:50.212987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dce42120-b564-4b08-add1-7aba212f8cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:50.235226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f70b489c-d3fe-4da9-887f-e856cc8b27da None None] MFA Rules not processed for user `e37ffb070d2443f7b8bcf1ed61041a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:50.236464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f70b489c-d3fe-4da9-887f-e856cc8b27da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:50.267485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:50.317173 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1307/2643] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:50 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:50.337014 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1337/2644] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:52.214109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b489c-d3fe-4da9-887f-e856cc8b27da None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:52.215639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f70b489c-d3fe-4da9-887f-e856cc8b27da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:52.765351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b489c-d3fe-4da9-887f-e856cc8b27da None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:52.778375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d00699-5cb2-41a8-9fff-5b391606f7fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:52.779722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d00699-5cb2-41a8-9fff-5b391606f7fb service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:52.781036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d00699-5cb2-41a8-9fff-5b391606f7fb service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:52.781510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d00699-5cb2-41a8-9fff-5b391606f7fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:52.807521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d00699-5cb2-41a8-9fff-5b391606f7fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:52.810954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d00699-5cb2-41a8-9fff-5b391606f7fb service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:52.848401 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1308/2645] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:52 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:54.011515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cfbe2-f93e-442a-9ab3-ff8596e929fe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:54.012470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cfbe2-f93e-442a-9ab3-ff8596e929fe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:54.012971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cfbe2-f93e-442a-9ab3-ff8596e929fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:54.039802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e75cfbe2-f93e-442a-9ab3-ff8596e929fe None None] MFA Rules not processed for user `885331f5db0b4ad78e75b4653bb89b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:54.041520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e75cfbe2-f93e-442a-9ab3-ff8596e929fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:54.107300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d00699-5cb2-41a8-9fff-5b391606f7fb service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:54.239971 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1338/2646] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:54.285034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d00699-5cb2-41a8-9fff-5b391606f7fb service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:54.333540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:54.334239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:54.334519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:54.334791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] PATH_INFO: `/v3/users/dc59196ea2ad44df8feb2f68cf4b8626` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:54.343199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc59196ea2ad44df8feb2f68cf4b8626)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:54.355186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:54.429388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:54.528543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc59196ea2ad44df8feb2f68cf4b8626'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:54.586661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc59196ea2ad44df8feb2f68cf4b8626'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:54.628405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc59196ea2ad44df8feb2f68cf4b8626'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:54.652748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc59196ea2ad44df8feb2f68cf4b8626'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:54.653117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc59196ea2ad44df8feb2f68cf4b8626'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:54.665176 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1309/2647] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:54 2022] DELETE /identity/v3/users/dc59196ea2ad44df8feb2f68cf4b8626 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:54.669797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b651b5-6f6a-42ef-95f8-435e148f4792 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:54.671044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b651b5-6f6a-42ef-95f8-435e148f4792 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:54.671044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b651b5-6f6a-42ef-95f8-435e148f4792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:54.711919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c4b651b5-6f6a-42ef-95f8-435e148f4792 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:54.714345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c4b651b5-6f6a-42ef-95f8-435e148f4792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:54.894151 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1339/2648] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:54.952248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:54.953615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:55.069213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6a1a5-93c6-4ea3-a798-d5060a24e51e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:55.073069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03b0e0-0691-4a06-8b91-01c82877f6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:55.073694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03b0e0-0691-4a06-8b91-01c82877f6ac service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:55.074053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03b0e0-0691-4a06-8b91-01c82877f6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:55.074319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03b0e0-0691-4a06-8b91-01c82877f6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:55.087977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03b0e0-0691-4a06-8b91-01c82877f6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:55.091413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03b0e0-0691-4a06-8b91-01c82877f6ac service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:55.104984 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1310/2649] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:17:55.396390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b651b5-6f6a-42ef-95f8-435e148f4792 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:55.397810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c4b651b5-6f6a-42ef-95f8-435e148f4792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:55.430113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b651b5-6f6a-42ef-95f8-435e148f4792 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:55.441430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:55.441762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:55.442173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:55.442459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] PATH_INFO: `/v3/users/2522d8c9bc70492d8987a363171f1de9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:55.446418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2522d8c9bc70492d8987a363171f1de9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:55.449928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:55.570917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2522d8c9bc70492d8987a363171f1de9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.589321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2522d8c9bc70492d8987a363171f1de9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.610800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2522d8c9bc70492d8987a363171f1de9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.652155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2522d8c9bc70492d8987a363171f1de9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.654696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:55.733397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2522d8c9bc70492d8987a363171f1de9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:55.765840 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1340/2650] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:55 2022] DELETE /identity/v3/users/2522d8c9bc70492d8987a363171f1de9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:55.980280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03b0e0-0691-4a06-8b91-01c82877f6ac service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:55.984514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9a03b0e0-0691-4a06-8b91-01c82877f6ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:56.101722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03b0e0-0691-4a06-8b91-01c82877f6ac service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.218245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.219861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:56.248716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.249941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.250206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.256610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] PATH_INFO: `/v3/projects/25debb621b854ce48bc85f166962a9f6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.260954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25debb621b854ce48bc85f166962a9f6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.266188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.417006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:56.451591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25debb621b854ce48bc85f166962a9f6', 'request_id': 'req-d6f6c386-6156-4e9b-863d-581c52809144'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:56.487172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25debb621b854ce48bc85f166962a9f6', 'request_id': 'req-d6f6c386-6156-4e9b-863d-581c52809144'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:56.493690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f3fa3-acb9-4f62-9ca0-eca1986552c6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.512596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25debb621b854ce48bc85f166962a9f6', 'request_id': 'req-d6f6c386-6156-4e9b-863d-581c52809144'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:56.551202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] The token cache is being invalidate because project 25debb621b854ce48bc85f166962a9f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:56.551557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:56.555684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:56.561432 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1311/2651] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:55 2022] DELETE /identity/v3/projects/25debb621b854ce48bc85f166962a9f6 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:56.565519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:56.571792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:56.774771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.775063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c386-6156-4e9b-863d-581c52809144 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:56.784825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.785773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:56.787710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:56.788009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.789245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] PATH_INFO: `/v3/users/9648af0b2e584fb6bdbf348d9d505371` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.789406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:56.789965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] PATH_INFO: `/v3/projects/8e0a0d597e274ccf828af9a1f53d8d88` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:56.793609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0a0d597e274ccf828af9a1f53d8d88)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.795452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9648af0b2e584fb6bdbf348d9d505371)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:56.805957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:56.813198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:57.017773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9648af0b2e584fb6bdbf348d9d505371'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.051568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9648af0b2e584fb6bdbf348d9d505371'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.072367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9648af0b2e584fb6bdbf348d9d505371'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.081405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0a0d597e274ccf828af9a1f53d8d88', 'request_id': 'req-1d2694ae-be8c-4bde-aeee-6174a23bb476'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.085898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9648af0b2e584fb6bdbf348d9d505371'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.086639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-22b9abc1-1c86-40a2-a5f3-96abac107f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9648af0b2e584fb6bdbf348d9d505371'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.094848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0a0d597e274ccf828af9a1f53d8d88', 'request_id': 'req-1d2694ae-be8c-4bde-aeee-6174a23bb476'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.100701 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1312/2652] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:17:56 2022] DELETE /identity/v3/users/9648af0b2e584fb6bdbf348d9d505371 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:57.111273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0a0d597e274ccf828af9a1f53d8d88', 'request_id': 'req-1d2694ae-be8c-4bde-aeee-6174a23bb476'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.135808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] The token cache is being invalidate because project 8e0a0d597e274ccf828af9a1f53d8d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:57.136058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.136784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1d2694ae-be8c-4bde-aeee-6174a23bb476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:57.138788 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1341/2653] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:56 2022] DELETE /identity/v3/projects/8e0a0d597e274ccf828af9a1f53d8d88 => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:57.145824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c41b8-8c24-4263-81e9-a80b9f28d016 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:57.146108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c41b8-8c24-4263-81e9-a80b9f28d016 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:57.146291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c41b8-8c24-4263-81e9-a80b9f28d016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:57.181260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f62c41b8-8c24-4263-81e9-a80b9f28d016 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:57.182610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f62c41b8-8c24-4263-81e9-a80b9f28d016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:57.267368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:57.305794 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1313/2654] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:57.317743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22f60-942c-4102-aef7-81c5fa6b927e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:57.318126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22f60-942c-4102-aef7-81c5fa6b927e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:57.318479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22f60-942c-4102-aef7-81c5fa6b927e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:57.352265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-eea22f60-942c-4102-aef7-81c5fa6b927e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:57.367254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eea22f60-942c-4102-aef7-81c5fa6b927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:57.381867 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1342/2655] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:17:57.384041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c41b8-8c24-4263-81e9-a80b9f28d016 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:57.399852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c41b8-8c24-4263-81e9-a80b9f28d016 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:57.408620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03003-62b1-46b5-9cac-37c50945d9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:57.409739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03003-62b1-46b5-9cac-37c50945d9ee admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:57.410250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03003-62b1-46b5-9cac-37c50945d9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:57.410718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e03003-62b1-46b5-9cac-37c50945d9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:57.412385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e03003-62b1-46b5-9cac-37c50945d9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:57.412914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e03003-62b1-46b5-9cac-37c50945d9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:57.415861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e03003-62b1-46b5-9cac-37c50945d9ee admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:57.435631 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1314/2656] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:17:57.441487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea22f60-942c-4102-aef7-81c5fa6b927e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:57.456039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea22f60-942c-4102-aef7-81c5fa6b927e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:57.469967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb59ec-0f6d-40de-a3b2-1b4de3df44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:57.471025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb59ec-0f6d-40de-a3b2-1b4de3df44ff admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:57.471495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb59ec-0f6d-40de-a3b2-1b4de3df44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:57.471929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb59ec-0f6d-40de-a3b2-1b4de3df44ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:57.472756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb59ec-0f6d-40de-a3b2-1b4de3df44ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:57.475347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb59ec-0f6d-40de-a3b2-1b4de3df44ff admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:57.498233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:57.550407 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1343/2657] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:57 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:57.556514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03003-62b1-46b5-9cac-37c50945d9ee admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:57.571397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e03003-62b1-46b5-9cac-37c50945d9ee admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:57.778038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746439b5-7084-4ef5-a4a2-b326c674e164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:57.778733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746439b5-7084-4ef5-a4a2-b326c674e164 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:57.779273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746439b5-7084-4ef5-a4a2-b326c674e164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:57.779563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746439b5-7084-4ef5-a4a2-b326c674e164 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:57.780364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746439b5-7084-4ef5-a4a2-b326c674e164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:57.784791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746439b5-7084-4ef5-a4a2-b326c674e164 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:57.829368 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1315/2658] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:57 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:57.830686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb59ec-0f6d-40de-a3b2-1b4de3df44ff admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:57.881957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb59ec-0f6d-40de-a3b2-1b4de3df44ff admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:57.916560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e40124-6616-4be2-a990-cd148a2b86f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:57.918008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e40124-6616-4be2-a990-cd148a2b86f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:57.918693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e40124-6616-4be2-a990-cd148a2b86f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:57.919390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e40124-6616-4be2-a990-cd148a2b86f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:57.923394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e40124-6616-4be2-a990-cd148a2b86f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:57.926482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e40124-6616-4be2-a990-cd148a2b86f9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:57.979231 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1344/2659] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:17:57.983797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746439b5-7084-4ef5-a4a2-b326c674e164 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:57.996864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746439b5-7084-4ef5-a4a2-b326c674e164 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:58.004844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb4286-36f4-4dce-b344-faaba27c0cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:58.005842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb4286-36f4-4dce-b344-faaba27c0cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:58.006366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb4286-36f4-4dce-b344-faaba27c0cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:58.006783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb4286-36f4-4dce-b344-faaba27c0cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:58.007818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb4286-36f4-4dce-b344-faaba27c0cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:58.009848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb4286-36f4-4dce-b344-faaba27c0cb2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:58.028397 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1316/2660] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:17:58.036086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e40124-6616-4be2-a990-cd148a2b86f9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:58.064355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e40124-6616-4be2-a990-cd148a2b86f9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:58.087885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81422a18-6458-43a2-9d81-8c647b08bfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:58.093759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81422a18-6458-43a2-9d81-8c647b08bfc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:58.094594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81422a18-6458-43a2-9d81-8c647b08bfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:58.095294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81422a18-6458-43a2-9d81-8c647b08bfc5 admin admin] PATH_INFO: `/v3/projects/fa0d67fd528740208334473b4625dac8/users/15d9145717cd4745871196a3d9d70c68/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:58.159143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81422a18-6458-43a2-9d81-8c647b08bfc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0d67fd528740208334473b4625dac8, user_id=15d9145717cd4745871196a3d9d70c68, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:58.164733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81422a18-6458-43a2-9d81-8c647b08bfc5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:58.218948 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1345/2661] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:17:58 2022] PUT /identity/v3/projects/fa0d67fd528740208334473b4625dac8/users/15d9145717cd4745871196a3d9d70c68/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:17:58.220800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6b357-e064-4cbb-87d9-9682ccee6ea9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:58.221147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6b357-e064-4cbb-87d9-9682ccee6ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:58.221486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6b357-e064-4cbb-87d9-9682ccee6ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:58.255538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-95b6b357-e064-4cbb-87d9-9682ccee6ea9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:58.257378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-95b6b357-e064-4cbb-87d9-9682ccee6ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:58.514648 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1317/2662] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:58.533178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81422a18-6458-43a2-9d81-8c647b08bfc5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:58.535876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-81422a18-6458-43a2-9d81-8c647b08bfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:58.739054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81422a18-6458-43a2-9d81-8c647b08bfc5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:58.746535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888544f-6a34-43b1-996b-cee0dce2d0a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:58.747627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888544f-6a34-43b1-996b-cee0dce2d0a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:58.748257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888544f-6a34-43b1-996b-cee0dce2d0a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:58.750592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888544f-6a34-43b1-996b-cee0dce2d0a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:58.768316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888544f-6a34-43b1-996b-cee0dce2d0a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:58.770827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888544f-6a34-43b1-996b-cee0dce2d0a4 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:58.810064 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1346/2663] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:17:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:17:58.956820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6b357-e064-4cbb-87d9-9682ccee6ea9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:58.970904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-95b6b357-e064-4cbb-87d9-9682ccee6ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:59.042890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6b357-e064-4cbb-87d9-9682ccee6ea9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.055505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.057064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.058457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.058972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] PATH_INFO: `/v3/projects/7f01cf3f37344e48b80e29d903bc3317` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.071735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f01cf3f37344e48b80e29d903bc3317)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:59.076916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:59.276242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:59.285819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f01cf3f37344e48b80e29d903bc3317', 'request_id': 'req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:59.317581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f01cf3f37344e48b80e29d903bc3317', 'request_id': 'req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:59.338805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f01cf3f37344e48b80e29d903bc3317', 'request_id': 'req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:59.380649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] The token cache is being invalidate because project 7f01cf3f37344e48b80e29d903bc3317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:17:59.381300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:59.383795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-27356a76-8dc1-44fb-b2ec-3bfba93aa15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:17:59.386488 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1318/2664] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:17:58 2022] DELETE /identity/v3/projects/7f01cf3f37344e48b80e29d903bc3317 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:17:59.394406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6081833-5fbb-43ba-936a-2afd3073e7a0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.394907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6081833-5fbb-43ba-936a-2afd3073e7a0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.395371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6081833-5fbb-43ba-936a-2afd3073e7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.498103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d6081833-5fbb-43ba-936a-2afd3073e7a0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:59.505227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d6081833-5fbb-43ba-936a-2afd3073e7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:59.673602 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1347/2665] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:59.687441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf103c-ea13-45f2-848f-14669b73483d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.688273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf103c-ea13-45f2-848f-14669b73483d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.690153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf103c-ea13-45f2-848f-14669b73483d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.716494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1ccf103c-ea13-45f2-848f-14669b73483d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:17:59.720880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ccf103c-ea13-45f2-848f-14669b73483d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:17:59.744299 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1319/2666] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:17:59.750351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6081833-5fbb-43ba-936a-2afd3073e7a0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:59.764875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6081833-5fbb-43ba-936a-2afd3073e7a0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.773579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efbc91-5e83-454f-94df-997d5d721d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.774841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efbc91-5e83-454f-94df-997d5d721d5d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.775809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efbc91-5e83-454f-94df-997d5d721d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.776403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efbc91-5e83-454f-94df-997d5d721d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.777723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efbc91-5e83-454f-94df-997d5d721d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:17:59.778812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efbc91-5e83-454f-94df-997d5d721d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:59.781056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efbc91-5e83-454f-94df-997d5d721d5d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:59.801426 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1348/2667] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:17:59.807808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf103c-ea13-45f2-848f-14669b73483d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:59.829576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf103c-ea13-45f2-848f-14669b73483d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:17:59.839789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111bd02-e3bf-49d5-92dd-75b06e04d4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:17:59.842760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111bd02-e3bf-49d5-92dd-75b06e04d4fd admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:17:59.843501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111bd02-e3bf-49d5-92dd-75b06e04d4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:17:59.844280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111bd02-e3bf-49d5-92dd-75b06e04d4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:17:59.845628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111bd02-e3bf-49d5-92dd-75b06e04d4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:17:59.849599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111bd02-e3bf-49d5-92dd-75b06e04d4fd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:17:59.938552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efbc91-5e83-454f-94df-997d5d721d5d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:17:59.938777 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1320/2668] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:17:59 2022] POST /identity/v3/projects => generated 409 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:17:59.964800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efbc91-5e83-454f-94df-997d5d721d5d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:00.129362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:00.158351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f899295-f05a-4aee-a9e7-f09114222e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:00.159197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f899295-f05a-4aee-a9e7-f09114222e58 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:00.159475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f899295-f05a-4aee-a9e7-f09114222e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:00.159747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f899295-f05a-4aee-a9e7-f09114222e58 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:00.160537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f899295-f05a-4aee-a9e7-f09114222e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:00.163671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f899295-f05a-4aee-a9e7-f09114222e58 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:00.205995 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1349/2669] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:17:59 2022] POST /identity/v3/users => generated 305 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:18:00.210066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111bd02-e3bf-49d5-92dd-75b06e04d4fd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:00.234832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111bd02-e3bf-49d5-92dd-75b06e04d4fd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:00.252235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfffb-6edb-435c-a795-a961825406a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:00.256813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfffb-6edb-435c-a795-a961825406a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:00.263057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfffb-6edb-435c-a795-a961825406a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:00.264466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfffb-6edb-435c-a795-a961825406a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:00.266886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfffb-6edb-435c-a795-a961825406a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:00.278762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfffb-6edb-435c-a795-a961825406a3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:00.343095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f899295-f05a-4aee-a9e7-f09114222e58 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:00.343409 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1321/2670] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:00.362789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f899295-f05a-4aee-a9e7-f09114222e58 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:00.382939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d33394-6792-4434-8d91-a58c90a4002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:00.384178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d33394-6792-4434-8d91-a58c90a4002a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:00.384658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d33394-6792-4434-8d91-a58c90a4002a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:00.384855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d33394-6792-4434-8d91-a58c90a4002a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:00.388984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d33394-6792-4434-8d91-a58c90a4002a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:00.391693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d33394-6792-4434-8d91-a58c90a4002a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:00.883513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfffb-6edb-435c-a795-a961825406a3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:00.897796 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1350/2671] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 556 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:00.902798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfffb-6edb-435c-a795-a961825406a3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:00.915993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0c407-8e54-484f-9132-38f56f68f867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:00.922418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0c407-8e54-484f-9132-38f56f68f867 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:00.923061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0c407-8e54-484f-9132-38f56f68f867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:00.923628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0c407-8e54-484f-9132-38f56f68f867 admin admin] PATH_INFO: `/v3/projects/60b53aeee76341c5b0125f62f746ccc1/users/5a4485711d8245f8b67748ba8022d8f2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:00.958995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0c407-8e54-484f-9132-38f56f68f867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b53aeee76341c5b0125f62f746ccc1, user_id=5a4485711d8245f8b67748ba8022d8f2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:00.965056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0c407-8e54-484f-9132-38f56f68f867 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.009562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16d65-b3e2-4db0-abc7-daf6a8ed3763 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.010141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16d65-b3e2-4db0-abc7-daf6a8ed3763 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.010507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16d65-b3e2-4db0-abc7-daf6a8ed3763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.013456 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1322/2672] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:00 2022] PUT /identity/v3/projects/60b53aeee76341c5b0125f62f746ccc1/users/5a4485711d8245f8b67748ba8022d8f2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:18:01.057401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-dab16d65-b3e2-4db0-abc7-daf6a8ed3763 None None] MFA Rules not processed for user `5a4485711d8245f8b67748ba8022d8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:01.059074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dab16d65-b3e2-4db0-abc7-daf6a8ed3763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:01.288125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1351/2673] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:01.294539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0c407-8e54-484f-9132-38f56f68f867 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.573257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0c407-8e54-484f-9132-38f56f68f867 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:01.592782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eff3da-2602-403c-8c1a-61f66d601f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:01.595407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eff3da-2602-403c-8c1a-61f66d601f18 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:01.595904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eff3da-2602-403c-8c1a-61f66d601f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:01.596356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eff3da-2602-403c-8c1a-61f66d601f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:01.599882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eff3da-2602-403c-8c1a-61f66d601f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:01.636436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eff3da-2602-403c-8c1a-61f66d601f18 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:01.800560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16d65-b3e2-4db0-abc7-daf6a8ed3763 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:01.805581 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1323/2674] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/projects => generated 409 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:01.827223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16d65-b3e2-4db0-abc7-daf6a8ed3763 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:02.025991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb632e-0d02-46ff-80db-bf09bbfda344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:02.027428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb632e-0d02-46ff-80db-bf09bbfda344 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.028643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb632e-0d02-46ff-80db-bf09bbfda344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.028924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb632e-0d02-46ff-80db-bf09bbfda344 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.031783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb632e-0d02-46ff-80db-bf09bbfda344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.037191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb632e-0d02-46ff-80db-bf09bbfda344 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.123785 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1352/2675] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:01 2022] POST /identity/v3/users => generated 311 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:02.129244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eff3da-2602-403c-8c1a-61f66d601f18 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:02.191913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eff3da-2602-403c-8c1a-61f66d601f18 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:02.223634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93e6fb-2717-4930-9d4f-2f8ecdec0bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:02.224435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93e6fb-2717-4930-9d4f-2f8ecdec0bdd admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.224694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93e6fb-2717-4930-9d4f-2f8ecdec0bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.224992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93e6fb-2717-4930-9d4f-2f8ecdec0bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.226024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93e6fb-2717-4930-9d4f-2f8ecdec0bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.228716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93e6fb-2717-4930-9d4f-2f8ecdec0bdd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.290297 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1324/2676] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:02.294837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb632e-0d02-46ff-80db-bf09bbfda344 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:02.318586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb632e-0d02-46ff-80db-bf09bbfda344 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:02.327517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2add988-7b36-4503-9da0-21991e2f9cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:02.328731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2add988-7b36-4503-9da0-21991e2f9cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.328731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2add988-7b36-4503-9da0-21991e2f9cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.329008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2add988-7b36-4503-9da0-21991e2f9cc3 admin admin] PATH_INFO: `/v3/projects/76e7aa8988ee407a820d8abb926e458a/users/e94b890451c7433ea5efaa1219e6cf5d/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.380022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2add988-7b36-4503-9da0-21991e2f9cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e7aa8988ee407a820d8abb926e458a, user_id=e94b890451c7433ea5efaa1219e6cf5d, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.385619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2add988-7b36-4503-9da0-21991e2f9cc3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.444793 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1353/2677] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:02 2022] PUT /identity/v3/projects/76e7aa8988ee407a820d8abb926e458a/users/e94b890451c7433ea5efaa1219e6cf5d/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:02.447907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93e6fb-2717-4930-9d4f-2f8ecdec0bdd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:02.470743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93e6fb-2717-4930-9d4f-2f8ecdec0bdd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:02.674559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:02.719129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa8c9e-8885-408b-aa0f-265fac1cef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:02.719763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa8c9e-8885-408b-aa0f-265fac1cef4b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.720037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa8c9e-8885-408b-aa0f-265fac1cef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.720324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa8c9e-8885-408b-aa0f-265fac1cef4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.720968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa8c9e-8885-408b-aa0f-265fac1cef4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.723415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa8c9e-8885-408b-aa0f-265fac1cef4b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.743199 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1325/2678] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:02.747596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2add988-7b36-4503-9da0-21991e2f9cc3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:02.779505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2add988-7b36-4503-9da0-21991e2f9cc3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:02.797057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238ab31-43ce-49c4-ba70-0aae14ea9132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:02.797721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238ab31-43ce-49c4-ba70-0aae14ea9132 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.798121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238ab31-43ce-49c4-ba70-0aae14ea9132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.798392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238ab31-43ce-49c4-ba70-0aae14ea9132 admin admin] PATH_INFO: `/v3/projects/76e7aa8988ee407a820d8abb926e458a/users/e94b890451c7433ea5efaa1219e6cf5d/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.800781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238ab31-43ce-49c4-ba70-0aae14ea9132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e7aa8988ee407a820d8abb926e458a, user_id=e94b890451c7433ea5efaa1219e6cf5d, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:02.804140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238ab31-43ce-49c4-ba70-0aae14ea9132 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:02.817566 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1354/2679] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:02 2022] PUT /identity/v3/projects/76e7aa8988ee407a820d8abb926e458a/users/e94b890451c7433ea5efaa1219e6cf5d/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:02.830583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf36e7-5c0b-4f67-ae4a-2ad5cb48297b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:02.832492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf36e7-5c0b-4f67-ae4a-2ad5cb48297b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:02.833213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf36e7-5c0b-4f67-ae4a-2ad5cb48297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:02.877334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-18cf36e7-5c0b-4f67-ae4a-2ad5cb48297b None None] MFA Rules not processed for user `e94b890451c7433ea5efaa1219e6cf5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:02.878632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-18cf36e7-5c0b-4f67-ae4a-2ad5cb48297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:03.000386 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1326/2680] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:02 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:03.951274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238ab31-43ce-49c4-ba70-0aae14ea9132 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:03.954749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d238ab31-43ce-49c4-ba70-0aae14ea9132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:03.964865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:04.112041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238ab31-43ce-49c4-ba70-0aae14ea9132 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:04.123637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd5c9c-cc08-45f6-9be0-094d8e60b344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:04.124861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd5c9c-cc08-45f6-9be0-094d8e60b344 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:04.125571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd5c9c-cc08-45f6-9be0-094d8e60b344 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:04.126097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd5c9c-cc08-45f6-9be0-094d8e60b344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:04.140530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd5c9c-cc08-45f6-9be0-094d8e60b344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:04.142841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd5c9c-cc08-45f6-9be0-094d8e60b344 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:04.186581 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1355/2681] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:03 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:04.904948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf36e7-5c0b-4f67-ae4a-2ad5cb48297b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:04.906752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-18cf36e7-5c0b-4f67-ae4a-2ad5cb48297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:04.962564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf36e7-5c0b-4f67-ae4a-2ad5cb48297b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:04.996575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89ded1-91ca-4ef4-81be-0636d62510d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:04.997442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89ded1-91ca-4ef4-81be-0636d62510d5 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:04.997724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89ded1-91ca-4ef4-81be-0636d62510d5 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:04.998207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89ded1-91ca-4ef4-81be-0636d62510d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:05.154962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89ded1-91ca-4ef4-81be-0636d62510d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:05.158689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89ded1-91ca-4ef4-81be-0636d62510d5 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:05.182866 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1327/2682] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:04 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:05.996541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd5c9c-cc08-45f6-9be0-094d8e60b344 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:06.203316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd5c9c-cc08-45f6-9be0-094d8e60b344 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:06.220977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:06.221659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:06.221965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:06.222386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] PATH_INFO: `/v3/users/5a4485711d8245f8b67748ba8022d8f2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:06.227540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4485711d8245f8b67748ba8022d8f2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:06.235903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:06.357684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4485711d8245f8b67748ba8022d8f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.358769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4485711d8245f8b67748ba8022d8f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.378643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4485711d8245f8b67748ba8022d8f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.400879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4485711d8245f8b67748ba8022d8f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.427240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4485711d8245f8b67748ba8022d8f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:06.445764 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1356/2683] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:05 2022] DELETE /identity/v3/users/5a4485711d8245f8b67748ba8022d8f2 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:06.447434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e45d-6d7b-416f-9121-ec49268124fa None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:06.448286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e45d-6d7b-416f-9121-ec49268124fa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:06.448718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7e45d-6d7b-416f-9121-ec49268124fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:06.509288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-afb7e45d-6d7b-416f-9121-ec49268124fa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:06.513894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-afb7e45d-6d7b-416f-9121-ec49268124fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:06.675659 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1328/2684] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:06.712320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:06.716204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:06.753623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:06.988180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fde81-4986-46d9-a4f0-f582aa7c18e5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:07.010865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c56428-80f6-4e4b-a65f-298d7de1c1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:07.012373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c56428-80f6-4e4b-a65f-298d7de1c1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:07.012834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c56428-80f6-4e4b-a65f-298d7de1c1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:07.014284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c56428-80f6-4e4b-a65f-298d7de1c1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:07.040080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c56428-80f6-4e4b-a65f-298d7de1c1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:07.042674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c56428-80f6-4e4b-a65f-298d7de1c1e9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:07.055691 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1357/2685] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:08.912583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7e45d-6d7b-416f-9121-ec49268124fa None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:08.915783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-afb7e45d-6d7b-416f-9121-ec49268124fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:08.964965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7e45d-6d7b-416f-9121-ec49268124fa None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:09.003225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:09.004587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.005080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.005566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] PATH_INFO: `/v3/projects/60b53aeee76341c5b0125f62f746ccc1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.023960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b53aeee76341c5b0125f62f746ccc1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:09.028581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:09.044363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:09.266941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b53aeee76341c5b0125f62f746ccc1', 'request_id': 'req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:09.301579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b53aeee76341c5b0125f62f746ccc1', 'request_id': 'req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:09.335475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b53aeee76341c5b0125f62f746ccc1', 'request_id': 'req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:09.396581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] The token cache is being invalidate because project 60b53aeee76341c5b0125f62f746ccc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:09.397097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:09.402034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:09.409405 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1329/2686] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:08 2022] DELETE /identity/v3/projects/60b53aeee76341c5b0125f62f746ccc1 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:09.410726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c56428-80f6-4e4b-a65f-298d7de1c1e9 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:09.426928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c56428-80f6-4e4b-a65f-298d7de1c1e9 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:09.693457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:09.694958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:09.695609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:09.696270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] PATH_INFO: `/v3/users/e94b890451c7433ea5efaa1219e6cf5d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:09.711851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94b890451c7433ea5efaa1219e6cf5d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:09.715786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:09.832644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94b890451c7433ea5efaa1219e6cf5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:09.833971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94b890451c7433ea5efaa1219e6cf5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:09.857391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94b890451c7433ea5efaa1219e6cf5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:09.880927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94b890451c7433ea5efaa1219e6cf5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:09.966464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-666f5b94-dc34-4e4f-a1ab-7aeda5739595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94b890451c7433ea5efaa1219e6cf5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:09.994455 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1358/2687] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:09 2022] DELETE /identity/v3/users/e94b890451c7433ea5efaa1219e6cf5d => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:11.360442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:11.362212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:11.389839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71c3c-1aa5-4e3b-980c-9ace9e47933d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:11.558554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:11.559237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:11.559543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:11.559837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] PATH_INFO: `/v3/projects/76e7aa8988ee407a820d8abb926e458a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:11.563368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e7aa8988ee407a820d8abb926e458a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:11.584063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:11.808793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e7aa8988ee407a820d8abb926e458a', 'request_id': 'req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:11.822184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e7aa8988ee407a820d8abb926e458a', 'request_id': 'req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:11.851847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e7aa8988ee407a820d8abb926e458a', 'request_id': 'req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:11.878716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] The token cache is being invalidate because project 76e7aa8988ee407a820d8abb926e458a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:11.879039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:11.885487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429e1f1d-54a3-47e4-8096-7ffd42dc5c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:11.890764 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1330/2688] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:11 2022] DELETE /identity/v3/projects/76e7aa8988ee407a820d8abb926e458a => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:11.892657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c946eb-caeb-4e6b-acac-97b9b589128a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:11.893446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c946eb-caeb-4e6b-acac-97b9b589128a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:11.893730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c946eb-caeb-4e6b-acac-97b9b589128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:11.956062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-48c946eb-caeb-4e6b-acac-97b9b589128a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:11.961360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-48c946eb-caeb-4e6b-acac-97b9b589128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:12.118952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:12.308873 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1359/2689] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:12.310684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5aea7d-114c-4a0e-9b96-c57276a1403b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:12.310976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5aea7d-114c-4a0e-9b96-c57276a1403b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:12.311303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5aea7d-114c-4a0e-9b96-c57276a1403b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:12.353913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3d5aea7d-114c-4a0e-9b96-c57276a1403b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:12.356930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3d5aea7d-114c-4a0e-9b96-c57276a1403b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:12.385553 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1331/2690] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:12.390137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c946eb-caeb-4e6b-acac-97b9b589128a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:12.407703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c946eb-caeb-4e6b-acac-97b9b589128a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:12.427242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357022da-06fe-4f05-8052-2b0bed677011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:12.427562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357022da-06fe-4f05-8052-2b0bed677011 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:12.427857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357022da-06fe-4f05-8052-2b0bed677011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:12.428120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357022da-06fe-4f05-8052-2b0bed677011 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:12.429080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357022da-06fe-4f05-8052-2b0bed677011 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:12.429080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357022da-06fe-4f05-8052-2b0bed677011 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:12.431530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357022da-06fe-4f05-8052-2b0bed677011 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:12.475460 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1360/2691] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:12.478205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5aea7d-114c-4a0e-9b96-c57276a1403b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:12.491070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5aea7d-114c-4a0e-9b96-c57276a1403b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:12.506877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b904c5-e28d-427c-a9d5-ce653ad1ec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:12.507527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b904c5-e28d-427c-a9d5-ce653ad1ec38 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:12.507869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b904c5-e28d-427c-a9d5-ce653ad1ec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:12.514122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b904c5-e28d-427c-a9d5-ce653ad1ec38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:12.514956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b904c5-e28d-427c-a9d5-ce653ad1ec38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:12.517396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b904c5-e28d-427c-a9d5-ce653ad1ec38 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:12.551265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:12.598376 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1332/2692] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:12 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:12.599588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357022da-06fe-4f05-8052-2b0bed677011 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:12.616488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357022da-06fe-4f05-8052-2b0bed677011 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:12.795813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658003f-43fe-41c2-848a-c200df72c0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:12.800060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658003f-43fe-41c2-848a-c200df72c0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:12.801083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658003f-43fe-41c2-848a-c200df72c0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:12.801992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658003f-43fe-41c2-848a-c200df72c0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:12.804436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658003f-43fe-41c2-848a-c200df72c0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:12.810880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658003f-43fe-41c2-848a-c200df72c0d6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:12.871179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b904c5-e28d-427c-a9d5-ce653ad1ec38 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:12.877249 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1361/2693] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:12 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:12.894449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b904c5-e28d-427c-a9d5-ce653ad1ec38 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:12.919269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39cd46-a71f-4de5-87fc-bd34e929296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:12.920140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39cd46-a71f-4de5-87fc-bd34e929296c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:12.920236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39cd46-a71f-4de5-87fc-bd34e929296c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:12.920655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39cd46-a71f-4de5-87fc-bd34e929296c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:12.928007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39cd46-a71f-4de5-87fc-bd34e929296c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:12.933697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39cd46-a71f-4de5-87fc-bd34e929296c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:12.990294 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1333/2694] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:12.991982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658003f-43fe-41c2-848a-c200df72c0d6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:13.008569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658003f-43fe-41c2-848a-c200df72c0d6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:13.030864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367aa7b-54bd-451f-aa9a-f6e808f60f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:13.033447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367aa7b-54bd-451f-aa9a-f6e808f60f97 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:13.033898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367aa7b-54bd-451f-aa9a-f6e808f60f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:13.035489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367aa7b-54bd-451f-aa9a-f6e808f60f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:13.037526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367aa7b-54bd-451f-aa9a-f6e808f60f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:13.042775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367aa7b-54bd-451f-aa9a-f6e808f60f97 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:13.085135 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1362/2695] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:13.085612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39cd46-a71f-4de5-87fc-bd34e929296c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:13.109122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39cd46-a71f-4de5-87fc-bd34e929296c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:13.132228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be914-0922-42dd-8916-2999ac255e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:13.136961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be914-0922-42dd-8916-2999ac255e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:13.140725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be914-0922-42dd-8916-2999ac255e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:13.141245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be914-0922-42dd-8916-2999ac255e94 admin admin] PATH_INFO: `/v3/projects/4e8bf42e1b264fc6bffccacc18a8fb3b/users/712858eb54154022953646b2f34c0fd2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:13.221234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98be914-0922-42dd-8916-2999ac255e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8bf42e1b264fc6bffccacc18a8fb3b, user_id=712858eb54154022953646b2f34c0fd2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:13.243302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98be914-0922-42dd-8916-2999ac255e94 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:13.301414 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1334/2696] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:13 2022] PUT /identity/v3/projects/4e8bf42e1b264fc6bffccacc18a8fb3b/users/712858eb54154022953646b2f34c0fd2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:13.315445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce952d8a-3926-449c-a819-915c4ebd1389 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:13.316759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce952d8a-3926-449c-a819-915c4ebd1389 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:13.317517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce952d8a-3926-449c-a819-915c4ebd1389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:13.375003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ce952d8a-3926-449c-a819-915c4ebd1389 None None] MFA Rules not processed for user `712858eb54154022953646b2f34c0fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:13.377377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ce952d8a-3926-449c-a819-915c4ebd1389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:13.579554 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1363/2697] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:13.580624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be914-0922-42dd-8916-2999ac255e94 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:13.774769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98be914-0922-42dd-8916-2999ac255e94 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:13.802471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eb7a-b4e0-45d8-b077-5ed77b9a6022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:13.803598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eb7a-b4e0-45d8-b077-5ed77b9a6022 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:13.808542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eb7a-b4e0-45d8-b077-5ed77b9a6022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:13.808877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eb7a-b4e0-45d8-b077-5ed77b9a6022 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:13.810160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278eb7a-b4e0-45d8-b077-5ed77b9a6022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:13.820342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278eb7a-b4e0-45d8-b077-5ed77b9a6022 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:13.864448 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1335/2698] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:13 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:18:13.870110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce952d8a-3926-449c-a819-915c4ebd1389 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:13.890051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce952d8a-3926-449c-a819-915c4ebd1389 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:13.949275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:14.081241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53697d1d-2347-4744-b0e9-5d0514ba5a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:14.082024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53697d1d-2347-4744-b0e9-5d0514ba5a83 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:14.082251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53697d1d-2347-4744-b0e9-5d0514ba5a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:14.082550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53697d1d-2347-4744-b0e9-5d0514ba5a83 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:14.083190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53697d1d-2347-4744-b0e9-5d0514ba5a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:14.096899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53697d1d-2347-4744-b0e9-5d0514ba5a83 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:14.151141 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1364/2699] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:13 2022] POST /identity/v3/users => generated 299 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:14.155216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eb7a-b4e0-45d8-b077-5ed77b9a6022 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:14.174327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eb7a-b4e0-45d8-b077-5ed77b9a6022 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:14.187548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d7093-cd86-4c8d-98ef-a9348cf36adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:14.188602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d7093-cd86-4c8d-98ef-a9348cf36adf admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:14.190226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d7093-cd86-4c8d-98ef-a9348cf36adf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:14.190823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d7093-cd86-4c8d-98ef-a9348cf36adf admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:14.193445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d7093-cd86-4c8d-98ef-a9348cf36adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:14.206597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d7093-cd86-4c8d-98ef-a9348cf36adf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:14.271366 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1336/2700] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:14.274945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53697d1d-2347-4744-b0e9-5d0514ba5a83 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:14.322558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53697d1d-2347-4744-b0e9-5d0514ba5a83 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:14.341556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751d13d-1ac1-41a5-aae4-b124905ed72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:14.343259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d13d-1ac1-41a5-aae4-b124905ed72d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:14.347475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d13d-1ac1-41a5-aae4-b124905ed72d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:14.348469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751d13d-1ac1-41a5-aae4-b124905ed72d admin admin] PATH_INFO: `/v3/projects/5f24713c715544769d53a3cec8df3261/users/517817c80ef5409584348d08dcd73afc/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:14.458858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751d13d-1ac1-41a5-aae4-b124905ed72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f24713c715544769d53a3cec8df3261, user_id=517817c80ef5409584348d08dcd73afc, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:14.461655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4751d13d-1ac1-41a5-aae4-b124905ed72d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:14.497236 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1365/2701] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:14 2022] PUT /identity/v3/projects/5f24713c715544769d53a3cec8df3261/users/517817c80ef5409584348d08dcd73afc/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:14.498625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d7093-cd86-4c8d-98ef-a9348cf36adf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:14.521089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d7093-cd86-4c8d-98ef-a9348cf36adf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:14.774519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c67f2-0659-475c-b347-96b06a509ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:14.775117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c67f2-0659-475c-b347-96b06a509ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:14.776731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c67f2-0659-475c-b347-96b06a509ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:14.779199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c67f2-0659-475c-b347-96b06a509ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:14.779904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c67f2-0659-475c-b347-96b06a509ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:14.784477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c67f2-0659-475c-b347-96b06a509ed7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:14.826437 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1337/2702] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:14.827974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751d13d-1ac1-41a5-aae4-b124905ed72d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:14.851406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751d13d-1ac1-41a5-aae4-b124905ed72d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:14.891814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6c44-2b84-4fce-a501-c87905009e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:14.892962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6c44-2b84-4fce-a501-c87905009e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:14.893437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6c44-2b84-4fce-a501-c87905009e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:14.893962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6c44-2b84-4fce-a501-c87905009e75 admin admin] PATH_INFO: `/v3/projects/5f24713c715544769d53a3cec8df3261/users/517817c80ef5409584348d08dcd73afc/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:14.905703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe6c44-2b84-4fce-a501-c87905009e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f24713c715544769d53a3cec8df3261, user_id=517817c80ef5409584348d08dcd73afc, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:14.912745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe6c44-2b84-4fce-a501-c87905009e75 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:14.960572 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1366/2703] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:14 2022] PUT /identity/v3/projects/5f24713c715544769d53a3cec8df3261/users/517817c80ef5409584348d08dcd73afc/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:14.973697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12226-9c83-46e2-ab25-4bfecc7f3e22 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:14.974092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12226-9c83-46e2-ab25-4bfecc7f3e22 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:14.974389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12226-9c83-46e2-ab25-4bfecc7f3e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:15.017910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7ab12226-9c83-46e2-ab25-4bfecc7f3e22 None None] MFA Rules not processed for user `517817c80ef5409584348d08dcd73afc`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:15.019910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ab12226-9c83-46e2-ab25-4bfecc7f3e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:15.042977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:15.153325 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1338/2704] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:15.255353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6c44-2b84-4fce-a501-c87905009e75 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:15.257248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ecbe6c44-2b84-4fce-a501-c87905009e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:15.564907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6c44-2b84-4fce-a501-c87905009e75 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:15.578132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055655d-2a5a-40ed-8fd0-8aaca6fb62bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:15.579452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055655d-2a5a-40ed-8fd0-8aaca6fb62bf service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:15.580297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055655d-2a5a-40ed-8fd0-8aaca6fb62bf service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:15.581081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d055655d-2a5a-40ed-8fd0-8aaca6fb62bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:15.621851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055655d-2a5a-40ed-8fd0-8aaca6fb62bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:15.623581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d055655d-2a5a-40ed-8fd0-8aaca6fb62bf service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:15.640885 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1367/2705] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:16.088495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a2f9a-0215-4d60-9dc0-36ece499eaea None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.089762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a2f9a-0215-4d60-9dc0-36ece499eaea None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.091648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a2f9a-0215-4d60-9dc0-36ece499eaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.137602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-525a2f9a-0215-4d60-9dc0-36ece499eaea None None] MFA Rules not processed for user `15d9145717cd4745871196a3d9d70c68`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:16.140055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-525a2f9a-0215-4d60-9dc0-36ece499eaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:16.250295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055655d-2a5a-40ed-8fd0-8aaca6fb62bf service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.356523 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1339/2706] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:16.379171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18490592-5161-4a0e-a7a7-d0aae042f845 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.379905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18490592-5161-4a0e-a7a7-d0aae042f845 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.381915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18490592-5161-4a0e-a7a7-d0aae042f845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.396271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d055655d-2a5a-40ed-8fd0-8aaca6fb62bf service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.404384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.405509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.405977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.406412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] PATH_INFO: `/v3/users/712858eb54154022953646b2f34c0fd2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.408362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=712858eb54154022953646b2f34c0fd2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:16.431295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-18490592-5161-4a0e-a7a7-d0aae042f845 None None] MFA Rules not processed for user `15d9145717cd4745871196a3d9d70c68`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:16.433649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-18490592-5161-4a0e-a7a7-d0aae042f845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:16.436404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:16.457595 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1340/2707] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:16.484392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:16.487913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18490592-5161-4a0e-a7a7-d0aae042f845 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.505636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-18490592-5161-4a0e-a7a7-d0aae042f845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:16.551716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18490592-5161-4a0e-a7a7-d0aae042f845 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:16.581015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712858eb54154022953646b2f34c0fd2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:16.584608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712858eb54154022953646b2f34c0fd2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:16.595454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db7acd-479d-43d9-b103-c462c9d1700a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:16.596098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7acd-479d-43d9-b103-c462c9d1700a service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.596374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7acd-479d-43d9-b103-c462c9d1700a service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.596641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db7acd-479d-43d9-b103-c462c9d1700a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.607418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712858eb54154022953646b2f34c0fd2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:16.627399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db7acd-479d-43d9-b103-c462c9d1700a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:16.628955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712858eb54154022953646b2f34c0fd2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:16.629219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db7acd-479d-43d9-b103-c462c9d1700a service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:16.662699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712858eb54154022953646b2f34c0fd2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:16.663776 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1341/2708] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:16.683724 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1368/2709] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:16 2022] DELETE /identity/v3/users/712858eb54154022953646b2f34c0fd2 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:16.688726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da11f4-68f3-4c5d-99cf-e482090a34fa None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:16.689018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da11f4-68f3-4c5d-99cf-e482090a34fa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:16.689282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da11f4-68f3-4c5d-99cf-e482090a34fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:16.744474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-46da11f4-68f3-4c5d-99cf-e482090a34fa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:16.745734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-46da11f4-68f3-4c5d-99cf-e482090a34fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:16.913150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:16.916447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:16.921272 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1342/2710] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:18:17.065233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b2171-bdd4-4e5d-bf67-702cde65f636 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:17.069967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbe8f2-3933-4d11-95b8-9121d3f0524b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:17.070767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbe8f2-3933-4d11-95b8-9121d3f0524b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:17.071098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbe8f2-3933-4d11-95b8-9121d3f0524b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:17.071435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbe8f2-3933-4d11-95b8-9121d3f0524b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:17.084131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbe8f2-3933-4d11-95b8-9121d3f0524b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:17.086347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbe8f2-3933-4d11-95b8-9121d3f0524b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:17.106307 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1369/2711] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:18:17.899005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da11f4-68f3-4c5d-99cf-e482090a34fa None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:17.903018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-46da11f4-68f3-4c5d-99cf-e482090a34fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:17.957990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da11f4-68f3-4c5d-99cf-e482090a34fa None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:17.995415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:17.996667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:17.996957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:17.997232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] PATH_INFO: `/v3/projects/4e8bf42e1b264fc6bffccacc18a8fb3b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:18.004542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8bf42e1b264fc6bffccacc18a8fb3b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:18.007278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:18.088219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:18.187594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8bf42e1b264fc6bffccacc18a8fb3b', 'request_id': 'req-8f74670d-f899-4293-9ff8-ef71bd7abefd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.221845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8bf42e1b264fc6bffccacc18a8fb3b', 'request_id': 'req-8f74670d-f899-4293-9ff8-ef71bd7abefd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.238045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8bf42e1b264fc6bffccacc18a8fb3b', 'request_id': 'req-8f74670d-f899-4293-9ff8-ef71bd7abefd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.273643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] The token cache is being invalidate because project 4e8bf42e1b264fc6bffccacc18a8fb3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:18.275833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.276752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.281926 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1343/2712] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:17 2022] DELETE /identity/v3/projects/4e8bf42e1b264fc6bffccacc18a8fb3b => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:18.284862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbe8f2-3933-4d11-95b8-9121d3f0524b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:18.308553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbe8f2-3933-4d11-95b8-9121d3f0524b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:18.550078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:18.550742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:18.551020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:18.551290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] PATH_INFO: `/v3/users/517817c80ef5409584348d08dcd73afc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:18.563103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] RBAC: Authorizing `identity:delete_user(user_id=517817c80ef5409584348d08dcd73afc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:18.572025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:18.651514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:18.700507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517817c80ef5409584348d08dcd73afc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.702490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517817c80ef5409584348d08dcd73afc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.731435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517817c80ef5409584348d08dcd73afc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.754424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517817c80ef5409584348d08dcd73afc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.815067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8027ca9a-90be-433f-8a87-1922aab1d51c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517817c80ef5409584348d08dcd73afc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:18.837071 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1370/2713] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:18 2022] DELETE /identity/v3/users/517817c80ef5409584348d08dcd73afc => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:20.041435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:20.043903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:20.074429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74670d-f899-4293-9ff8-ef71bd7abefd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:20.280514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:20.281185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:20.281465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:20.282508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] PATH_INFO: `/v3/projects/5f24713c715544769d53a3cec8df3261` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:20.285293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f24713c715544769d53a3cec8df3261)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:20.291953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:20.441934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f24713c715544769d53a3cec8df3261', 'request_id': 'req-787d81c4-5a17-45bd-9524-b41f7f9c20a6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:20.464151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f24713c715544769d53a3cec8df3261', 'request_id': 'req-787d81c4-5a17-45bd-9524-b41f7f9c20a6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:20.478154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f24713c715544769d53a3cec8df3261', 'request_id': 'req-787d81c4-5a17-45bd-9524-b41f7f9c20a6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:20.495515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] The token cache is being invalidate because project 5f24713c715544769d53a3cec8df3261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:20.495888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:20.496479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-787d81c4-5a17-45bd-9524-b41f7f9c20a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:20.502679 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1344/2714] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:20 2022] DELETE /identity/v3/projects/5f24713c715544769d53a3cec8df3261 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:20.504297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e493ca-4c26-421b-baa2-d09aa683e7ac None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:20.505320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e493ca-4c26-421b-baa2-d09aa683e7ac None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:20.505617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e493ca-4c26-421b-baa2-d09aa683e7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:20.548129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-16e493ca-4c26-421b-baa2-d09aa683e7ac None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:20.551556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-16e493ca-4c26-421b-baa2-d09aa683e7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:20.698183 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1371/2715] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:20.702397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb6c9-0135-4297-a96c-2e1d24086928 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:20.702775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb6c9-0135-4297-a96c-2e1d24086928 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:20.703128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb6c9-0135-4297-a96c-2e1d24086928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:20.770662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-84adb6c9-0135-4297-a96c-2e1d24086928 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:20.772764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-84adb6c9-0135-4297-a96c-2e1d24086928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:20.798556 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1345/2716] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:20.803701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e493ca-4c26-421b-baa2-d09aa683e7ac None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:20.850944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e493ca-4c26-421b-baa2-d09aa683e7ac None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:20.887535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17d974-a274-40c6-91c7-8fdebd9dc1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:20.889938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17d974-a274-40c6-91c7-8fdebd9dc1ad admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:20.893728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17d974-a274-40c6-91c7-8fdebd9dc1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:20.894087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17d974-a274-40c6-91c7-8fdebd9dc1ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:20.903513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17d974-a274-40c6-91c7-8fdebd9dc1ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:20.905743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17d974-a274-40c6-91c7-8fdebd9dc1ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:20.918183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17d974-a274-40c6-91c7-8fdebd9dc1ad admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:20.984832 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1372/2717] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:20.990204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adb6c9-0135-4297-a96c-2e1d24086928 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:21.045452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adb6c9-0135-4297-a96c-2e1d24086928 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:21.092830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818885b-3ac4-41f9-b966-4ce6dcd8c661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:21.093722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818885b-3ac4-41f9-b966-4ce6dcd8c661 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:21.094225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818885b-3ac4-41f9-b966-4ce6dcd8c661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:21.094675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818885b-3ac4-41f9-b966-4ce6dcd8c661 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:21.096511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818885b-3ac4-41f9-b966-4ce6dcd8c661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:21.101185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818885b-3ac4-41f9-b966-4ce6dcd8c661 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:21.230625 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1346/2718] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:20 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:21.235767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17d974-a274-40c6-91c7-8fdebd9dc1ad admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:21.255531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17d974-a274-40c6-91c7-8fdebd9dc1ad admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:21.433918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1577f-ca5a-4f9e-8922-a6b3a07dc3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:21.433918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1577f-ca5a-4f9e-8922-a6b3a07dc3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:21.433918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1577f-ca5a-4f9e-8922-a6b3a07dc3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:21.433918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1577f-ca5a-4f9e-8922-a6b3a07dc3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:21.434463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1577f-ca5a-4f9e-8922-a6b3a07dc3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:21.438218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1577f-ca5a-4f9e-8922-a6b3a07dc3c5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:21.515451 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1373/2719] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:21 2022] POST /identity/v3/users => generated 292 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:21.516724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818885b-3ac4-41f9-b966-4ce6dcd8c661 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:21.536469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818885b-3ac4-41f9-b966-4ce6dcd8c661 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:21.575255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de3e47-fd8e-4008-95f2-a6cc7026f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:21.575501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de3e47-fd8e-4008-95f2-a6cc7026f461 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:21.575760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de3e47-fd8e-4008-95f2-a6cc7026f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:21.576028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de3e47-fd8e-4008-95f2-a6cc7026f461 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:21.579761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de3e47-fd8e-4008-95f2-a6cc7026f461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:21.580722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de3e47-fd8e-4008-95f2-a6cc7026f461 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:21.582511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:21.634464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1577f-ca5a-4f9e-8922-a6b3a07dc3c5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:21.660147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1577f-ca5a-4f9e-8922-a6b3a07dc3c5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:21.660876 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1347/2720] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:21.710998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3740b0-04d6-4b8a-a5cc-38074bfc2a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:21.711855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3740b0-04d6-4b8a-a5cc-38074bfc2a91 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:21.712089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3740b0-04d6-4b8a-a5cc-38074bfc2a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:21.712342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3740b0-04d6-4b8a-a5cc-38074bfc2a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:21.713070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3740b0-04d6-4b8a-a5cc-38074bfc2a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:21.714797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3740b0-04d6-4b8a-a5cc-38074bfc2a91 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:21.791662 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1374/2721] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:18:21.793075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de3e47-fd8e-4008-95f2-a6cc7026f461 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:21.814893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de3e47-fd8e-4008-95f2-a6cc7026f461 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:21.844416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f65f1-8e7e-4569-ab1e-b64a78d5d911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:21.845196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f65f1-8e7e-4569-ab1e-b64a78d5d911 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:21.845472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f65f1-8e7e-4569-ab1e-b64a78d5d911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:21.845742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f65f1-8e7e-4569-ab1e-b64a78d5d911 admin admin] PATH_INFO: `/v3/projects/a2acae24b5c947cda3bf4c1e67c93c08/users/fc7b08bbe5324298b6429667ed449825/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:21.934678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f65f1-8e7e-4569-ab1e-b64a78d5d911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2acae24b5c947cda3bf4c1e67c93c08, user_id=fc7b08bbe5324298b6429667ed449825, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:21.938001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f65f1-8e7e-4569-ab1e-b64a78d5d911 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:21.990576 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1348/2722] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:21 2022] PUT /identity/v3/projects/a2acae24b5c947cda3bf4c1e67c93c08/users/fc7b08bbe5324298b6429667ed449825/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:18:21.993140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deef65-8671-49c1-9f15-4ac66b65e82f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:21.993618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deef65-8671-49c1-9f15-4ac66b65e82f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:21.994824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deef65-8671-49c1-9f15-4ac66b65e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:22.119505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-68deef65-8671-49c1-9f15-4ac66b65e82f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:22.120972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-68deef65-8671-49c1-9f15-4ac66b65e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:22.143355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:22.301786 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1375/2723] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:22.332533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f65f1-8e7e-4569-ab1e-b64a78d5d911 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:22.335777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d79f65f1-8e7e-4569-ab1e-b64a78d5d911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:22.622103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f65f1-8e7e-4569-ab1e-b64a78d5d911 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:22.661739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815614c-181d-4dc4-bf55-83cb63638a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:22.669077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815614c-181d-4dc4-bf55-83cb63638a0e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:22.673078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815614c-181d-4dc4-bf55-83cb63638a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:22.680012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815614c-181d-4dc4-bf55-83cb63638a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:22.757568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815614c-181d-4dc4-bf55-83cb63638a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:22.759905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815614c-181d-4dc4-bf55-83cb63638a0e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:22.816374 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1349/2724] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:25.974782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deef65-8671-49c1-9f15-4ac66b65e82f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:25.976693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-68deef65-8671-49c1-9f15-4ac66b65e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:26.127205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deef65-8671-49c1-9f15-4ac66b65e82f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:26.138795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0920b2-9ae8-4127-b249-d47f262803c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:26.139528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0920b2-9ae8-4127-b249-d47f262803c0 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:26.139817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0920b2-9ae8-4127-b249-d47f262803c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:26.140051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0920b2-9ae8-4127-b249-d47f262803c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:26.146591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4c0920b2-9ae8-4127-b249-d47f262803c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:26.293980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0920b2-9ae8-4127-b249-d47f262803c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:26.297257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0920b2-9ae8-4127-b249-d47f262803c0 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:26.327027 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1376/2725] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:32.800706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:35.833583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf535d9-a22f-4138-9b3c-07cbcd993e5a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:35.834232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf535d9-a22f-4138-9b3c-07cbcd993e5a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:35.836400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf535d9-a22f-4138-9b3c-07cbcd993e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:35.901685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0bf535d9-a22f-4138-9b3c-07cbcd993e5a None None] MFA Rules not processed for user `fc7b08bbe5324298b6429667ed449825`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:35.904400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0bf535d9-a22f-4138-9b3c-07cbcd993e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:36.057713 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1350/2726] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:36.062767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0920b2-9ae8-4127-b249-d47f262803c0 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.087870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0920b2-9ae8-4127-b249-d47f262803c0 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.095097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e1144-d091-42cf-ad42-e67fe0d29d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.095735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1144-d091-42cf-ad42-e67fe0d29d0e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.096008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1144-d091-42cf-ad42-e67fe0d29d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.096267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e1144-d091-42cf-ad42-e67fe0d29d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.097102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e1144-d091-42cf-ad42-e67fe0d29d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.111409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e1144-d091-42cf-ad42-e67fe0d29d0e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.160053 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1377/2727] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:36 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:36.164578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf535d9-a22f-4138-9b3c-07cbcd993e5a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.188839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf535d9-a22f-4138-9b3c-07cbcd993e5a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.388820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf7a4-35f0-451f-b3d7-14880bf5bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.389802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf7a4-35f0-451f-b3d7-14880bf5bba5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.390264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf7a4-35f0-451f-b3d7-14880bf5bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.390656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf7a4-35f0-451f-b3d7-14880bf5bba5 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.391629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf7a4-35f0-451f-b3d7-14880bf5bba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.393947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf7a4-35f0-451f-b3d7-14880bf5bba5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.433115 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1351/2728] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:36 2022] POST /identity/v3/users => generated 299 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:36.437050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e1144-d091-42cf-ad42-e67fe0d29d0e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.454100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e1144-d091-42cf-ad42-e67fe0d29d0e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.462747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfe2c3-3841-40ae-bc96-5bbdd57defee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.464187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfe2c3-3841-40ae-bc96-5bbdd57defee admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.464577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfe2c3-3841-40ae-bc96-5bbdd57defee admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.465201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfe2c3-3841-40ae-bc96-5bbdd57defee admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.466029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfe2c3-3841-40ae-bc96-5bbdd57defee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.468131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfe2c3-3841-40ae-bc96-5bbdd57defee admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.487676 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1378/2729] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:18:36.494425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf7a4-35f0-451f-b3d7-14880bf5bba5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.509528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf7a4-35f0-451f-b3d7-14880bf5bba5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.517018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b80d-7025-4f04-b05b-e8600bbb3e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.518579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b80d-7025-4f04-b05b-e8600bbb3e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.519682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b80d-7025-4f04-b05b-e8600bbb3e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.520413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1b80d-7025-4f04-b05b-e8600bbb3e10 admin admin] PATH_INFO: `/v3/projects/b97d0c0623c4460b9a4f6cbb3d6f6ae8/users/1f80b2226866477db509c28bc0717f8f/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.562317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1b80d-7025-4f04-b05b-e8600bbb3e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97d0c0623c4460b9a4f6cbb3d6f6ae8, user_id=1f80b2226866477db509c28bc0717f8f, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.567811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1b80d-7025-4f04-b05b-e8600bbb3e10 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.618671 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1352/2730] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:36 2022] PUT /identity/v3/projects/b97d0c0623c4460b9a4f6cbb3d6f6ae8/users/1f80b2226866477db509c28bc0717f8f/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:36.624369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfe2c3-3841-40ae-bc96-5bbdd57defee admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.641256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfe2c3-3841-40ae-bc96-5bbdd57defee admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.661606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:36.768482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7bdfd-6604-4a4a-a343-09b4d555a354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.769137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bdfd-6604-4a4a-a343-09b4d555a354 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.769545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bdfd-6604-4a4a-a343-09b4d555a354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.769820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7bdfd-6604-4a4a-a343-09b4d555a354 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.771144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7bdfd-6604-4a4a-a343-09b4d555a354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.780498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7bdfd-6604-4a4a-a343-09b4d555a354 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.805171 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1379/2731] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:36.806591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b80d-7025-4f04-b05b-e8600bbb3e10 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:36.822268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1b80d-7025-4f04-b05b-e8600bbb3e10 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:36.838047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c7ea1-1ec2-406f-b571-7b10048db1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:36.838962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c7ea1-1ec2-406f-b571-7b10048db1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:36.838962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c7ea1-1ec2-406f-b571-7b10048db1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:36.839229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c7ea1-1ec2-406f-b571-7b10048db1c4 admin admin] PATH_INFO: `/v3/projects/b97d0c0623c4460b9a4f6cbb3d6f6ae8/users/1f80b2226866477db509c28bc0717f8f/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:36.841443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c7ea1-1ec2-406f-b571-7b10048db1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97d0c0623c4460b9a4f6cbb3d6f6ae8, user_id=1f80b2226866477db509c28bc0717f8f, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:36.845253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c7ea1-1ec2-406f-b571-7b10048db1c4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:36.866543 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1353/2732] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:36 2022] PUT /identity/v3/projects/b97d0c0623c4460b9a4f6cbb3d6f6ae8/users/1f80b2226866477db509c28bc0717f8f/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:36.904086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7bdfd-6604-4a4a-a343-09b4d555a354 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:37.057014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7bdfd-6604-4a4a-a343-09b4d555a354 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:37.131601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0215f63-dfc8-48a9-ab56-82803b9bfde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:37.132592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0215f63-dfc8-48a9-ab56-82803b9bfde3 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:37.133277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0215f63-dfc8-48a9-ab56-82803b9bfde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:37.133771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0215f63-dfc8-48a9-ab56-82803b9bfde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:37.137795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d0215f63-dfc8-48a9-ab56-82803b9bfde3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:37.246387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0215f63-dfc8-48a9-ab56-82803b9bfde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:37.252461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0215f63-dfc8-48a9-ab56-82803b9bfde3 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:37.267441 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1380/2733] 10.222.0.43 () {60 vars in 1396 bytes} [Tue Aug 30 04:18:36 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:38.288194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c7ea1-1ec2-406f-b571-7b10048db1c4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:38.302519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c7ea1-1ec2-406f-b571-7b10048db1c4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:38.307692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73fe6b-2609-49da-88a6-47400a267efc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:38.308243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73fe6b-2609-49da-88a6-47400a267efc service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:38.308837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73fe6b-2609-49da-88a6-47400a267efc service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:38.309282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73fe6b-2609-49da-88a6-47400a267efc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:38.311918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fc73fe6b-2609-49da-88a6-47400a267efc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:38.368806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:38.419817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73fe6b-2609-49da-88a6-47400a267efc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:38.420846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73fe6b-2609-49da-88a6-47400a267efc service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:38.434179 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1354/2734] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:39.054787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe7db-cefd-4ce1-8bad-2a3e2ba0f2e7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:39.056971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe7db-cefd-4ce1-8bad-2a3e2ba0f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:39.057692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe7db-cefd-4ce1-8bad-2a3e2ba0f2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:39.088334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c01fe7db-cefd-4ce1-8bad-2a3e2ba0f2e7 None None] MFA Rules not processed for user `bb9f4c8f290947ac996f0415b8b74d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:39.090921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c01fe7db-cefd-4ce1-8bad-2a3e2ba0f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:39.110699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:39.189040 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1381/2735] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:39.449308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73fe6b-2609-49da-88a6-47400a267efc service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:39.449308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fc73fe6b-2609-49da-88a6-47400a267efc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:39.579628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73fe6b-2609-49da-88a6-47400a267efc service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:39.585129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:39.586346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:39.587498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:39.587953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] PATH_INFO: `/v3/users/326ddfe51e68488c8b2bdb3953f7ac95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:39.590166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=326ddfe51e68488c8b2bdb3953f7ac95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:39.593049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:39.684591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '326ddfe51e68488c8b2bdb3953f7ac95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:39.703928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '326ddfe51e68488c8b2bdb3953f7ac95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:39.740228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '326ddfe51e68488c8b2bdb3953f7ac95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:39.755658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '326ddfe51e68488c8b2bdb3953f7ac95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:39.756456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '326ddfe51e68488c8b2bdb3953f7ac95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:39.786139 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1355/2736] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:18:39 2022] DELETE /identity/v3/users/326ddfe51e68488c8b2bdb3953f7ac95 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:40.627134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fe7db-cefd-4ce1-8bad-2a3e2ba0f2e7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:40.651973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fe7db-cefd-4ce1-8bad-2a3e2ba0f2e7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:40.816392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:40.817297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:40.817840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:40.818429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] PATH_INFO: `/v3/projects/5143ccea80d342a197c74a2e71a5f80a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:40.820403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5143ccea80d342a197c74a2e71a5f80a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:40.823912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:40.967921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:40.969717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:41.044028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5143ccea80d342a197c74a2e71a5f80a', 'request_id': 'req-3b8b7efa-1187-4480-b608-5650a6ef5e7f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:41.068922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5143ccea80d342a197c74a2e71a5f80a', 'request_id': 'req-3b8b7efa-1187-4480-b608-5650a6ef5e7f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:41.097116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5143ccea80d342a197c74a2e71a5f80a', 'request_id': 'req-3b8b7efa-1187-4480-b608-5650a6ef5e7f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:41.129490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:41.169380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] The token cache is being invalidate because project 5143ccea80d342a197c74a2e71a5f80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:18:41.170062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:41.170962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b8b7efa-1187-4480-b608-5650a6ef5e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:18:41.176824 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1382/2737] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:18:40 2022] DELETE /identity/v3/projects/5143ccea80d342a197c74a2e71a5f80a => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:41.183287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca9ed4-6bc6-4739-8cfd-8301d42d984d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:41.183802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca9ed4-6bc6-4739-8cfd-8301d42d984d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:41.184253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca9ed4-6bc6-4739-8cfd-8301d42d984d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:41.236845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fac8a-c0d1-477b-91b4-56cf80646b51 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:41.246511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e9ca9ed4-6bc6-4739-8cfd-8301d42d984d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:41.247772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e9ca9ed4-6bc6-4739-8cfd-8301d42d984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:41.393397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:41.400981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ff00e-dbc8-42c5-94b2-4b749c90ce38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:41.405537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ff00e-dbc8-42c5-94b2-4b749c90ce38 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:41.405723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ff00e-dbc8-42c5-94b2-4b749c90ce38 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:41.406017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ff00e-dbc8-42c5-94b2-4b749c90ce38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:41.416775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-383ff00e-dbc8-42c5-94b2-4b749c90ce38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:41.418409 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1383/2738] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:41.428869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990ef7-8fd5-4997-b56f-20d4fdbc4041 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:41.429144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990ef7-8fd5-4997-b56f-20d4fdbc4041 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:41.429447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e990ef7-8fd5-4997-b56f-20d4fdbc4041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:41.453177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ff00e-dbc8-42c5-94b2-4b749c90ce38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:41.455625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ff00e-dbc8-42c5-94b2-4b749c90ce38 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:41.474902 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1356/2739] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:18:41.481559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6e990ef7-8fd5-4997-b56f-20d4fdbc4041 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:41.482909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6e990ef7-8fd5-4997-b56f-20d4fdbc4041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:41.500193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ff00e-dbc8-42c5-94b2-4b749c90ce38 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:41.506821 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1384/2740] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:41.513751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ff00e-dbc8-42c5-94b2-4b749c90ce38 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:41.520312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdf571-74a5-45b0-81c1-1896f86b15d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:41.520989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdf571-74a5-45b0-81c1-1896f86b15d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:41.521279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdf571-74a5-45b0-81c1-1896f86b15d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:41.521526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdf571-74a5-45b0-81c1-1896f86b15d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:41.522886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdf571-74a5-45b0-81c1-1896f86b15d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:18:41.523632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdf571-74a5-45b0-81c1-1896f86b15d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:41.525427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdf571-74a5-45b0-81c1-1896f86b15d1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:41.552824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e990ef7-8fd5-4997-b56f-20d4fdbc4041 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:41.559653 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1357/2741] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:18:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:18:41.566596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e990ef7-8fd5-4997-b56f-20d4fdbc4041 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:41.576555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d09e01-0ad5-4a82-b649-64c5be89bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:41.577196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09e01-0ad5-4a82-b649-64c5be89bac9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:41.578375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09e01-0ad5-4a82-b649-64c5be89bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:41.578375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09e01-0ad5-4a82-b649-64c5be89bac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:41.578628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d09e01-0ad5-4a82-b649-64c5be89bac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:41.581153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d09e01-0ad5-4a82-b649-64c5be89bac9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:41.648585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdf571-74a5-45b0-81c1-1896f86b15d1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:41.650066 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1385/2742] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:18:41 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:41.674745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdf571-74a5-45b0-81c1-1896f86b15d1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:41.793916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d812-b540-4ea9-bf92-0a56b3ac06f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:41.794804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d812-b540-4ea9-bf92-0a56b3ac06f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:41.795350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d812-b540-4ea9-bf92-0a56b3ac06f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:41.795675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d812-b540-4ea9-bf92-0a56b3ac06f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:41.796531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0d812-b540-4ea9-bf92-0a56b3ac06f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:41.800001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0d812-b540-4ea9-bf92-0a56b3ac06f9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:41.824597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d09e01-0ad5-4a82-b649-64c5be89bac9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:41.826481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f4d09e01-0ad5-4a82-b649-64c5be89bac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:41.838493 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1358/2743] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:18:41 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:18:41.842290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d812-b540-4ea9-bf92-0a56b3ac06f9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:41.891998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d812-b540-4ea9-bf92-0a56b3ac06f9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:41.908923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9f72-e2eb-48c8-b506-fbb5a2e6d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:41.911494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9f72-e2eb-48c8-b506-fbb5a2e6d32c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:41.911814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9f72-e2eb-48c8-b506-fbb5a2e6d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:41.912089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9f72-e2eb-48c8-b506-fbb5a2e6d32c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:41.912802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd9f72-e2eb-48c8-b506-fbb5a2e6d32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:41.914985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd9f72-e2eb-48c8-b506-fbb5a2e6d32c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:41.948939 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1359/2744] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:41.953042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9f72-e2eb-48c8-b506-fbb5a2e6d32c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:41.983892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9f72-e2eb-48c8-b506-fbb5a2e6d32c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:41.987046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d09e01-0ad5-4a82-b649-64c5be89bac9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:41.999418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae71c7-a11b-46b5-b802-0b0f99f835a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:41.999982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae71c7-a11b-46b5-b802-0b0f99f835a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:42.000280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae71c7-a11b-46b5-b802-0b0f99f835a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:42.000539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae71c7-a11b-46b5-b802-0b0f99f835a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:42.004008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc4d3-b636-4c49-ab94-001af815b847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:42.005467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-caae71c7-a11b-46b5-b802-0b0f99f835a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:42.007604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc4d3-b636-4c49-ab94-001af815b847 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:42.010548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc4d3-b636-4c49-ab94-001af815b847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:42.012496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbc4d3-b636-4c49-ab94-001af815b847 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:42.013728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbc4d3-b636-4c49-ab94-001af815b847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:42.022698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbc4d3-b636-4c49-ab94-001af815b847 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:42.078772 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1360/2745] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:18:42.083887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc4d3-b636-4c49-ab94-001af815b847 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:42.122755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbc4d3-b636-4c49-ab94-001af815b847 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:42.144783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539ec5-c686-4fdb-8ec4-939300e23a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:42.149048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539ec5-c686-4fdb-8ec4-939300e23a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:42.151782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539ec5-c686-4fdb-8ec4-939300e23a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:42.154228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539ec5-c686-4fdb-8ec4-939300e23a6b admin admin] PATH_INFO: `/v3/projects/3e2ecce8584241b8b8cd1657e1459ca5/users/fcabb8e05a9c499c97324a04fe4cc5df/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:42.208346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae71c7-a11b-46b5-b802-0b0f99f835a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:42.209839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae71c7-a11b-46b5-b802-0b0f99f835a9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:42.214908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be539ec5-c686-4fdb-8ec4-939300e23a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2ecce8584241b8b8cd1657e1459ca5, user_id=fcabb8e05a9c499c97324a04fe4cc5df, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:42.219341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be539ec5-c686-4fdb-8ec4-939300e23a6b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:42.237466 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1361/2746] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:18:42 2022] PUT /identity/v3/projects/3e2ecce8584241b8b8cd1657e1459ca5/users/fcabb8e05a9c499c97324a04fe4cc5df/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:18:42.242736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cefac7-fb64-45f5-be35-a9c8c02c99ea None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:42.243455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cefac7-fb64-45f5-be35-a9c8c02c99ea None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:42.244486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cefac7-fb64-45f5-be35-a9c8c02c99ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:42.266628 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1386/2747] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:18:42.284684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-75cefac7-fb64-45f5-be35-a9c8c02c99ea None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:42.286710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-75cefac7-fb64-45f5-be35-a9c8c02c99ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:42.293774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:42.417412 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1362/2748] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:42.427709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae71c7-a11b-46b5-b802-0b0f99f835a9 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:42.430240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-caae71c7-a11b-46b5-b802-0b0f99f835a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:42.449645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae71c7-a11b-46b5-b802-0b0f99f835a9 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:42.606925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb006b2-29d2-4b78-8269-b5b32ce99dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:42.607194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb006b2-29d2-4b78-8269-b5b32ce99dad service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:42.607321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb006b2-29d2-4b78-8269-b5b32ce99dad service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:42.607552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb006b2-29d2-4b78-8269-b5b32ce99dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:42.630286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb006b2-29d2-4b78-8269-b5b32ce99dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:42.631345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb006b2-29d2-4b78-8269-b5b32ce99dad service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:42.684641 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1387/2749] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:52.393933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=23 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:52.653108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:52.806763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74d04-da3a-454a-af60-54ed4b909aa8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:52.807093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74d04-da3a-454a-af60-54ed4b909aa8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:52.807280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74d04-da3a-454a-af60-54ed4b909aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:52.868998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5dc74d04-da3a-454a-af60-54ed4b909aa8 None None] MFA Rules not processed for user `1f80b2226866477db509c28bc0717f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:18:52.870123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5dc74d04-da3a-454a-af60-54ed4b909aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:53.160211 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1363/2750] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:18:53.179169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb006b2-29d2-4b78-8269-b5b32ce99dad service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:53.181693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-edb006b2-29d2-4b78-8269-b5b32ce99dad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:53.374014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc74d04-da3a-454a-af60-54ed4b909aa8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:18:53.408004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc74d04-da3a-454a-af60-54ed4b909aa8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:53.432834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf6f5c-e293-494f-acbb-ebff8a4080d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:53.439390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf6f5c-e293-494f-acbb-ebff8a4080d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:53.439971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf6f5c-e293-494f-acbb-ebff8a4080d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:53.440876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf6f5c-e293-494f-acbb-ebff8a4080d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:53.456350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb006b2-29d2-4b78-8269-b5b32ce99dad service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:18:53.471644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942a078-fa1d-4c8b-9a12-9c687d7ff145 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:18:53.472555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a078-fa1d-4c8b-9a12-9c687d7ff145 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:18:53.473021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a078-fa1d-4c8b-9a12-9c687d7ff145 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:18:53.473507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942a078-fa1d-4c8b-9a12-9c687d7ff145 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:18:53.475329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b6cf6f5c-e293-494f-acbb-ebff8a4080d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:18:53.503763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942a078-fa1d-4c8b-9a12-9c687d7ff145 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:53.503992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf6f5c-e293-494f-acbb-ebff8a4080d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:18:53.505392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf6f5c-e293-494f-acbb-ebff8a4080d6 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:53.505940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942a078-fa1d-4c8b-9a12-9c687d7ff145 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:18:53.532956 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1364/2751] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:53.536349 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1388/2752] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:18:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:00.828225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3074-a39c-44cd-b4e4-85a76688637c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:00.828751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3074-a39c-44cd-b4e4-85a76688637c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:00.828751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3074-a39c-44cd-b4e4-85a76688637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:00.868299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-97dc3074-a39c-44cd-b4e4-85a76688637c None None] MFA Rules not processed for user `15d9145717cd4745871196a3d9d70c68`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:00.869911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-97dc3074-a39c-44cd-b4e4-85a76688637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:01.002128 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1365/2753] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:01.316884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171b550-810e-4fba-905d-8884597316e3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:01.317503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171b550-810e-4fba-905d-8884597316e3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:01.317503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171b550-810e-4fba-905d-8884597316e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:01.377154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3171b550-810e-4fba-905d-8884597316e3 None None] MFA Rules not processed for user `fcabb8e05a9c499c97324a04fe4cc5df`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:01.384356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3171b550-810e-4fba-905d-8884597316e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:01.547029 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1389/2754] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:01.560942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc3074-a39c-44cd-b4e4-85a76688637c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:01.562617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-97dc3074-a39c-44cd-b4e4-85a76688637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:01.879905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc3074-a39c-44cd-b4e4-85a76688637c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:01.901963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b5c6d-7267-4209-9edb-151faf9d1dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:01.903428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b5c6d-7267-4209-9edb-151faf9d1dda service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:01.904147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b5c6d-7267-4209-9edb-151faf9d1dda service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:01.905215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b5c6d-7267-4209-9edb-151faf9d1dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:01.923368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b5c6d-7267-4209-9edb-151faf9d1dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:01.926557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b5c6d-7267-4209-9edb-151faf9d1dda service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:01.948861 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1366/2755] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:02.045397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171b550-810e-4fba-905d-8884597316e3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:02.077542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171b550-810e-4fba-905d-8884597316e3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:02.088604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc7aee-617f-4488-aacd-db644bc4a173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:02.089736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc7aee-617f-4488-aacd-db644bc4a173 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:02.090273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc7aee-617f-4488-aacd-db644bc4a173 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:02.090804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc7aee-617f-4488-aacd-db644bc4a173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:02.094180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-57cc7aee-617f-4488-aacd-db644bc4a173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:02.139092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc7aee-617f-4488-aacd-db644bc4a173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:02.141254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc7aee-617f-4488-aacd-db644bc4a173 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:02.159502 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1390/2756] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:06.580157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b5c6d-7267-4209-9edb-151faf9d1dda service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:06.581755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-394b5c6d-7267-4209-9edb-151faf9d1dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:06.609662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:06.663472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b5c6d-7267-4209-9edb-151faf9d1dda service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:06.707625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010dbd6-d197-41aa-adbb-895a3e9e407e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:06.708617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010dbd6-d197-41aa-adbb-895a3e9e407e service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:06.709068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010dbd6-d197-41aa-adbb-895a3e9e407e service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:06.709548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010dbd6-d197-41aa-adbb-895a3e9e407e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:06.720453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9010dbd6-d197-41aa-adbb-895a3e9e407e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:06.766972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010dbd6-d197-41aa-adbb-895a3e9e407e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:06.769285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010dbd6-d197-41aa-adbb-895a3e9e407e service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:06.791710 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1367/2757] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:07.423592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2b0d-932e-4079-a78d-2cc0c457056c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:07.431282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2b0d-932e-4079-a78d-2cc0c457056c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:07.436882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee2b0d-932e-4079-a78d-2cc0c457056c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:07.582678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-13ee2b0d-932e-4079-a78d-2cc0c457056c None None] MFA Rules not processed for user `e37ffb070d2443f7b8bcf1ed61041a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:07.590574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-13ee2b0d-932e-4079-a78d-2cc0c457056c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:08.148329 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1391/2758] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 727 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:08.610159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe30040-5707-4478-8d17-7383ae9e1d06 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:08.611055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe30040-5707-4478-8d17-7383ae9e1d06 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:08.615371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe30040-5707-4478-8d17-7383ae9e1d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:08.774579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9fe30040-5707-4478-8d17-7383ae9e1d06 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:08.776449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9fe30040-5707-4478-8d17-7383ae9e1d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:09.061110 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1368/2759] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:19:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:09.135727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee2b0d-932e-4079-a78d-2cc0c457056c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:09.137473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-13ee2b0d-932e-4079-a78d-2cc0c457056c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:09.237051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:09.457253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee2b0d-932e-4079-a78d-2cc0c457056c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:09.475090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e24e7-b567-47aa-be03-6bffdab45de8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:09.476726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e24e7-b567-47aa-be03-6bffdab45de8 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:09.482894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e24e7-b567-47aa-be03-6bffdab45de8 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:09.483487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e24e7-b567-47aa-be03-6bffdab45de8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:09.507156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e24e7-b567-47aa-be03-6bffdab45de8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:09.511684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e24e7-b567-47aa-be03-6bffdab45de8 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:09.534363 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1392/2760] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:19:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:19:12.052381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe30040-5707-4478-8d17-7383ae9e1d06 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:12.064120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe30040-5707-4478-8d17-7383ae9e1d06 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:12.082631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854394-4e55-4a48-a4ac-21e32678d33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:12.083562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854394-4e55-4a48-a4ac-21e32678d33f service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:12.083760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854394-4e55-4a48-a4ac-21e32678d33f service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:12.084200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854394-4e55-4a48-a4ac-21e32678d33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:12.108479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e5854394-4e55-4a48-a4ac-21e32678d33f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:12.143909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5854394-4e55-4a48-a4ac-21e32678d33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:12.146384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5854394-4e55-4a48-a4ac-21e32678d33f service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:12.197970 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1369/2761] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:19.527189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=21 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:22.188582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=36 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:23.669793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e24e7-b567-47aa-be03-6bffdab45de8 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:23.695760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e24e7-b567-47aa-be03-6bffdab45de8 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:23.714436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8766f6b-a1cd-4415-8916-316b8bf8c82e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:23.715484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8766f6b-a1cd-4415-8916-316b8bf8c82e service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:23.715930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8766f6b-a1cd-4415-8916-316b8bf8c82e service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:23.716383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8766f6b-a1cd-4415-8916-316b8bf8c82e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:23.718594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e8766f6b-a1cd-4415-8916-316b8bf8c82e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:23.767499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8766f6b-a1cd-4415-8916-316b8bf8c82e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:23.772810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8766f6b-a1cd-4415-8916-316b8bf8c82e service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:23.814952 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1393/2762] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:19:24.426527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854394-4e55-4a48-a4ac-21e32678d33f service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:24.449583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854394-4e55-4a48-a4ac-21e32678d33f service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:24.455925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b6bdb-4328-4b53-8cff-fdfa75c1db58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:24.457036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b6bdb-4328-4b53-8cff-fdfa75c1db58 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:24.457562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b6bdb-4328-4b53-8cff-fdfa75c1db58 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:24.458092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b6bdb-4328-4b53-8cff-fdfa75c1db58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:24.460399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-922b6bdb-4328-4b53-8cff-fdfa75c1db58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:24.485421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b6bdb-4328-4b53-8cff-fdfa75c1db58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:24.489458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b6bdb-4328-4b53-8cff-fdfa75c1db58 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:24.524062 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1370/2763] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:29.294067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8766f6b-a1cd-4415-8916-316b8bf8c82e service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:29.306803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8766f6b-a1cd-4415-8916-316b8bf8c82e service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:29.337432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aef295-0657-490c-8b45-126ff62d6aa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:29.338699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aef295-0657-490c-8b45-126ff62d6aa8 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:29.339378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aef295-0657-490c-8b45-126ff62d6aa8 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:29.340046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aef295-0657-490c-8b45-126ff62d6aa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:29.356127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-35aef295-0657-490c-8b45-126ff62d6aa8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:29.552491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aef295-0657-490c-8b45-126ff62d6aa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:29.554231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aef295-0657-490c-8b45-126ff62d6aa8 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:29.569163 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1394/2764] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:31.039717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b6bdb-4328-4b53-8cff-fdfa75c1db58 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:31.057780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b6bdb-4328-4b53-8cff-fdfa75c1db58 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:31.064714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaf583-787b-4a2b-8a0c-3a4c50aae484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:31.066266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf583-787b-4a2b-8a0c-3a4c50aae484 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:31.066783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf583-787b-4a2b-8a0c-3a4c50aae484 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:31.067367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf583-787b-4a2b-8a0c-3a4c50aae484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:31.081911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5ecaf583-787b-4a2b-8a0c-3a4c50aae484 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:31.179077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaf583-787b-4a2b-8a0c-3a4c50aae484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:31.182262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaf583-787b-4a2b-8a0c-3a4c50aae484 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:31.195169 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1371/2765] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:34.531665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d5628-42a8-4ec1-9f0b-9f971971f425 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:34.532188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d5628-42a8-4ec1-9f0b-9f971971f425 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:34.532414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d5628-42a8-4ec1-9f0b-9f971971f425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:34.558669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d37d5628-42a8-4ec1-9f0b-9f971971f425 None None] MFA Rules not processed for user `fc7b08bbe5324298b6429667ed449825`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:34.561104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d37d5628-42a8-4ec1-9f0b-9f971971f425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:34.572536 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1395/2766] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:35.706274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaf583-787b-4a2b-8a0c-3a4c50aae484 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:35.716693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaf583-787b-4a2b-8a0c-3a4c50aae484 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:35.731767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0d872-5afe-4d10-a504-4f9ff27e06ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:35.733392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0d872-5afe-4d10-a504-4f9ff27e06ec service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:35.733915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0d872-5afe-4d10-a504-4f9ff27e06ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:35.734704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0d872-5afe-4d10-a504-4f9ff27e06ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:35.737203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a9f0d872-5afe-4d10-a504-4f9ff27e06ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:35.751442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0d872-5afe-4d10-a504-4f9ff27e06ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:35.754487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0d872-5afe-4d10-a504-4f9ff27e06ec service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:35.768277 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1372/2767] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:36.032987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d5628-42a8-4ec1-9f0b-9f971971f425 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:36.050151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d5628-42a8-4ec1-9f0b-9f971971f425 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:36.057763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:36.059348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:36.059851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:36.060306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] PATH_INFO: `/v3/users/fcabb8e05a9c499c97324a04fe4cc5df` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:36.061730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcabb8e05a9c499c97324a04fe4cc5df)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:36.064103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:36.129413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcabb8e05a9c499c97324a04fe4cc5df'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:36.130217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcabb8e05a9c499c97324a04fe4cc5df'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:36.139536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcabb8e05a9c499c97324a04fe4cc5df'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:36.151852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcabb8e05a9c499c97324a04fe4cc5df'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:36.175703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4f4649a4-01a4-4189-a933-12d9b1321e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcabb8e05a9c499c97324a04fe4cc5df'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:36.185295 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1396/2768] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:19:36 2022] DELETE /identity/v3/users/fcabb8e05a9c499c97324a04fe4cc5df => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:36.411660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0d872-5afe-4d10-a504-4f9ff27e06ec service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:36.428436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0d872-5afe-4d10-a504-4f9ff27e06ec service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:36.552034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:36.552696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:36.552967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:36.553234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] PATH_INFO: `/v3/projects/3e2ecce8584241b8b8cd1657e1459ca5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:36.555421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2ecce8584241b8b8cd1657e1459ca5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:36.557509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:36.637154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2ecce8584241b8b8cd1657e1459ca5', 'request_id': 'req-8d52283d-a6cf-49f0-9481-18d878fccf2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:36.651988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2ecce8584241b8b8cd1657e1459ca5', 'request_id': 'req-8d52283d-a6cf-49f0-9481-18d878fccf2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:36.662036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2ecce8584241b8b8cd1657e1459ca5', 'request_id': 'req-8d52283d-a6cf-49f0-9481-18d878fccf2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:36.688384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] The token cache is being invalidate because project 3e2ecce8584241b8b8cd1657e1459ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:19:36.688821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:36.689633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d52283d-a6cf-49f0-9481-18d878fccf2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:36.696950 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1373/2769] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:19:36 2022] DELETE /identity/v3/projects/3e2ecce8584241b8b8cd1657e1459ca5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:36.698922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89db4b-310f-4494-939a-fc170733e8e8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:36.699574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89db4b-310f-4494-939a-fc170733e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:36.700816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89db4b-310f-4494-939a-fc170733e8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:36.729379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2c89db4b-310f-4494-939a-fc170733e8e8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:36.731919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c89db4b-310f-4494-939a-fc170733e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:36.793904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:36.814922 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1397/2770] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:36.823241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424593f-f1b4-4c8c-80f6-d8732f778680 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:36.823807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424593f-f1b4-4c8c-80f6-d8732f778680 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:36.823807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424593f-f1b4-4c8c-80f6-d8732f778680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:36.831734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:36.846807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b424593f-f1b4-4c8c-80f6-d8732f778680 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:36.848090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b424593f-f1b4-4c8c-80f6-d8732f778680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:36.856418 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1374/2771] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:36.860957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89db4b-310f-4494-939a-fc170733e8e8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:36.872963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89db4b-310f-4494-939a-fc170733e8e8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:36.878773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a4a90-b424-4399-8462-8ad5f3b62c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:36.879229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a4a90-b424-4399-8462-8ad5f3b62c1d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:36.879670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a4a90-b424-4399-8462-8ad5f3b62c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:36.879936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a4a90-b424-4399-8462-8ad5f3b62c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:36.880706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a4a90-b424-4399-8462-8ad5f3b62c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:19:36.881104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a4a90-b424-4399-8462-8ad5f3b62c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:36.882942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a4a90-b424-4399-8462-8ad5f3b62c1d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:36.896407 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1398/2772] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:19:36.901377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424593f-f1b4-4c8c-80f6-d8732f778680 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:36.911195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424593f-f1b4-4c8c-80f6-d8732f778680 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:36.933026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc0c5f-dc7e-4840-86b6-885369348693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:36.933820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc0c5f-dc7e-4840-86b6-885369348693 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:36.934167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc0c5f-dc7e-4840-86b6-885369348693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:36.934446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc0c5f-dc7e-4840-86b6-885369348693 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:36.935098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc0c5f-dc7e-4840-86b6-885369348693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:36.937066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc0c5f-dc7e-4840-86b6-885369348693 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:36.975932 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1375/2773] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:19:36 2022] POST /identity/v3/projects => generated 397 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:19:36.980087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a4a90-b424-4399-8462-8ad5f3b62c1d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:36.991562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a4a90-b424-4399-8462-8ad5f3b62c1d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:37.074259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937724fc-70a4-4ac8-9535-2ef51371be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:37.075740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937724fc-70a4-4ac8-9535-2ef51371be2d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:37.076119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937724fc-70a4-4ac8-9535-2ef51371be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:37.076645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937724fc-70a4-4ac8-9535-2ef51371be2d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:37.077476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937724fc-70a4-4ac8-9535-2ef51371be2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:37.079827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937724fc-70a4-4ac8-9535-2ef51371be2d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:37.111511 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1399/2774] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:19:36 2022] POST /identity/v3/users => generated 299 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:19:37.113322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc0c5f-dc7e-4840-86b6-885369348693 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:37.128280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc0c5f-dc7e-4840-86b6-885369348693 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:37.133516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26d5db-d286-4c66-bc85-b3933fde6e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:37.134533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26d5db-d286-4c66-bc85-b3933fde6e80 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:37.135106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26d5db-d286-4c66-bc85-b3933fde6e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:37.135375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26d5db-d286-4c66-bc85-b3933fde6e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:37.136038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26d5db-d286-4c66-bc85-b3933fde6e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:37.137758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26d5db-d286-4c66-bc85-b3933fde6e80 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:37.154534 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1376/2775] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:19:37.159898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937724fc-70a4-4ac8-9535-2ef51371be2d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:37.175544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937724fc-70a4-4ac8-9535-2ef51371be2d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:37.184208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2731e-8e38-4b99-9f8d-fcba64d9890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:37.184881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2731e-8e38-4b99-9f8d-fcba64d9890e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:37.185202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2731e-8e38-4b99-9f8d-fcba64d9890e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:37.185629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2731e-8e38-4b99-9f8d-fcba64d9890e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:37.186208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2731e-8e38-4b99-9f8d-fcba64d9890e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:37.187960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2731e-8e38-4b99-9f8d-fcba64d9890e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:37.205318 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1400/2776] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:19:37.210535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26d5db-d286-4c66-bc85-b3933fde6e80 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:37.235798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26d5db-d286-4c66-bc85-b3933fde6e80 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:37.244778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16ebdd-c1e1-436f-98de-b062e177bd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:37.246042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ebdd-c1e1-436f-98de-b062e177bd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:37.246603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ebdd-c1e1-436f-98de-b062e177bd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:37.247003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ebdd-c1e1-436f-98de-b062e177bd39 admin admin] PATH_INFO: `/v3/projects/8541f52fc3e44af9ad88747a01c89f5e/users/263835ce010c4bd996e421a7d2f9ea1a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:37.282741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16ebdd-c1e1-436f-98de-b062e177bd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8541f52fc3e44af9ad88747a01c89f5e, user_id=263835ce010c4bd996e421a7d2f9ea1a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:37.289857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16ebdd-c1e1-436f-98de-b062e177bd39 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:37.341302 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1377/2777] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:19:37 2022] PUT /identity/v3/projects/8541f52fc3e44af9ad88747a01c89f5e/users/263835ce010c4bd996e421a7d2f9ea1a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:37.358969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed09c36-210d-4a45-85ee-4f2d2487d1ca None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:37.362000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed09c36-210d-4a45-85ee-4f2d2487d1ca None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:37.362666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed09c36-210d-4a45-85ee-4f2d2487d1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:37.454800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7ed09c36-210d-4a45-85ee-4f2d2487d1ca None None] MFA Rules not processed for user `263835ce010c4bd996e421a7d2f9ea1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:37.457437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7ed09c36-210d-4a45-85ee-4f2d2487d1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:37.577583 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1401/2778] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:39.204280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16ebdd-c1e1-436f-98de-b062e177bd39 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:39.220950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3e16ebdd-c1e1-436f-98de-b062e177bd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:39.515249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16ebdd-c1e1-436f-98de-b062e177bd39 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:39.531567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e0b0d-780c-4f09-b56a-3f93e556efea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:39.535827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e0b0d-780c-4f09-b56a-3f93e556efea service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:39.536102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e0b0d-780c-4f09-b56a-3f93e556efea service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:39.537705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e0b0d-780c-4f09-b56a-3f93e556efea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:39.583424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e0b0d-780c-4f09-b56a-3f93e556efea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:39.586610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e0b0d-780c-4f09-b56a-3f93e556efea service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:39.659404 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1378/2779] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:40.265288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078e75-913a-4865-8515-643651b6f51b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:40.265908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078e75-913a-4865-8515-643651b6f51b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:40.265908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a078e75-913a-4865-8515-643651b6f51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:40.356254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2a078e75-913a-4865-8515-643651b6f51b None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:40.358177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2a078e75-913a-4865-8515-643651b6f51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:40.485157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:40.542032 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1402/2780] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:40.557428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e0b0d-780c-4f09-b56a-3f93e556efea service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:40.559449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-294e0b0d-780c-4f09-b56a-3f93e556efea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:40.833907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e0b0d-780c-4f09-b56a-3f93e556efea service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:40.842548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d7206-ec35-4a77-b8f5-626b8357a5f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:40.843755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d7206-ec35-4a77-b8f5-626b8357a5f8 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:40.844273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d7206-ec35-4a77-b8f5-626b8357a5f8 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:40.844813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d7206-ec35-4a77-b8f5-626b8357a5f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:40.868106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d7206-ec35-4a77-b8f5-626b8357a5f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:40.870376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d7206-ec35-4a77-b8f5-626b8357a5f8 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:40.891763 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1379/2781] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:19:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:19:42.450998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a078e75-913a-4865-8515-643651b6f51b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:42.624529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a078e75-913a-4865-8515-643651b6f51b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:42.638230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:42.639480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:42.640244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:42.641031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] PATH_INFO: `/v3/users/263835ce010c4bd996e421a7d2f9ea1a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:42.645146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=263835ce010c4bd996e421a7d2f9ea1a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:42.652286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:42.782036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '263835ce010c4bd996e421a7d2f9ea1a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:42.783670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '263835ce010c4bd996e421a7d2f9ea1a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:42.804582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '263835ce010c4bd996e421a7d2f9ea1a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:42.820783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '263835ce010c4bd996e421a7d2f9ea1a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:42.859536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '263835ce010c4bd996e421a7d2f9ea1a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:42.873745 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1403/2782] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:19:42 2022] DELETE /identity/v3/users/263835ce010c4bd996e421a7d2f9ea1a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:42.879635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90d69-6282-4359-b6bb-594940ecfa94 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:42.884104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90d69-6282-4359-b6bb-594940ecfa94 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:42.884104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90d69-6282-4359-b6bb-594940ecfa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:42.940637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-72d90d69-6282-4359-b6bb-594940ecfa94 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:42.942048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-72d90d69-6282-4359-b6bb-594940ecfa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:42.986909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:43.207458 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1380/2783] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:43.220664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:43.222261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:43.358810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae3717-d85a-46c1-a16e-018448cc5cce admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:43.377431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd677657-4c58-4a07-b6c0-2d678935103d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:43.378750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd677657-4c58-4a07-b6c0-2d678935103d service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:43.379603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd677657-4c58-4a07-b6c0-2d678935103d service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:43.379927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd677657-4c58-4a07-b6c0-2d678935103d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:43.395063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd677657-4c58-4a07-b6c0-2d678935103d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:43.397554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd677657-4c58-4a07-b6c0-2d678935103d service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:43.433044 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1404/2784] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:44.101353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d90d69-6282-4359-b6bb-594940ecfa94 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:44.103334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-72d90d69-6282-4359-b6bb-594940ecfa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:44.125016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d90d69-6282-4359-b6bb-594940ecfa94 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:44.143364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:44.144549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:44.145108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:44.145596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] PATH_INFO: `/v3/projects/8541f52fc3e44af9ad88747a01c89f5e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:44.147616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8541f52fc3e44af9ad88747a01c89f5e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:44.150464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:44.282978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8541f52fc3e44af9ad88747a01c89f5e', 'request_id': 'req-6efec100-6fc4-4ec0-8d43-9a10bf978dba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:44.304026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8541f52fc3e44af9ad88747a01c89f5e', 'request_id': 'req-6efec100-6fc4-4ec0-8d43-9a10bf978dba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:44.340270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8541f52fc3e44af9ad88747a01c89f5e', 'request_id': 'req-6efec100-6fc4-4ec0-8d43-9a10bf978dba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:44.372430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] The token cache is being invalidate because project 8541f52fc3e44af9ad88747a01c89f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:19:44.373043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:44.374052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6efec100-6fc4-4ec0-8d43-9a10bf978dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:44.376687 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1381/2785] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:19:44 2022] DELETE /identity/v3/projects/8541f52fc3e44af9ad88747a01c89f5e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:44.382643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be195e86-1756-414e-9ca1-810d0cdacadc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:44.383242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be195e86-1756-414e-9ca1-810d0cdacadc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:44.383497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be195e86-1756-414e-9ca1-810d0cdacadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:44.414675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-be195e86-1756-414e-9ca1-810d0cdacadc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:44.446702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-be195e86-1756-414e-9ca1-810d0cdacadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:44.471535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:44.623218 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1405/2786] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:44.632840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54efea1-f7cb-4972-b4d2-9bf4a6b66c7d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:44.633150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54efea1-f7cb-4972-b4d2-9bf4a6b66c7d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:44.633381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54efea1-f7cb-4972-b4d2-9bf4a6b66c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:44.688177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c54efea1-f7cb-4972-b4d2-9bf4a6b66c7d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:44.689476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c54efea1-f7cb-4972-b4d2-9bf4a6b66c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:44.719738 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1382/2787] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:44.724190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be195e86-1756-414e-9ca1-810d0cdacadc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:44.739885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be195e86-1756-414e-9ca1-810d0cdacadc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:44.751729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a49f12-47d4-4df6-9c05-a3274cef6dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:44.752435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49f12-47d4-4df6-9c05-a3274cef6dbb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:44.752743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49f12-47d4-4df6-9c05-a3274cef6dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:44.753011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a49f12-47d4-4df6-9c05-a3274cef6dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:44.755979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a49f12-47d4-4df6-9c05-a3274cef6dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:19:44.756285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a49f12-47d4-4df6-9c05-a3274cef6dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:44.762164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a49f12-47d4-4df6-9c05-a3274cef6dbb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:44.791111 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1406/2788] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:19:44.796426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54efea1-f7cb-4972-b4d2-9bf4a6b66c7d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:44.814287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54efea1-f7cb-4972-b4d2-9bf4a6b66c7d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:44.832094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd965859-182d-4c37-b950-bfb092d01928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:44.833413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd965859-182d-4c37-b950-bfb092d01928 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:44.834062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd965859-182d-4c37-b950-bfb092d01928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:44.835306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd965859-182d-4c37-b950-bfb092d01928 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:44.839481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd965859-182d-4c37-b950-bfb092d01928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:44.842251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd965859-182d-4c37-b950-bfb092d01928 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:44.925714 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1383/2789] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:19:44 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:19:44.934388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a49f12-47d4-4df6-9c05-a3274cef6dbb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:44.956189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a49f12-47d4-4df6-9c05-a3274cef6dbb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:45.134543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff37a5-a43f-4e2a-8f36-6474aaa0de51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:45.135173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff37a5-a43f-4e2a-8f36-6474aaa0de51 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:45.135496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff37a5-a43f-4e2a-8f36-6474aaa0de51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:45.135764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff37a5-a43f-4e2a-8f36-6474aaa0de51 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:45.136490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff37a5-a43f-4e2a-8f36-6474aaa0de51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:45.152880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff37a5-a43f-4e2a-8f36-6474aaa0de51 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:45.187463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd965859-182d-4c37-b950-bfb092d01928 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:45.188056 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1407/2790] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:19:44 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:19:45.203046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd965859-182d-4c37-b950-bfb092d01928 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:45.208805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f0204-b1fb-4c4f-9317-7974c4d37a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:45.209810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f0204-b1fb-4c4f-9317-7974c4d37a6b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:45.210330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f0204-b1fb-4c4f-9317-7974c4d37a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:45.211042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f0204-b1fb-4c4f-9317-7974c4d37a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:45.212393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f0204-b1fb-4c4f-9317-7974c4d37a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:45.214535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f0204-b1fb-4c4f-9317-7974c4d37a6b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:45.236710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff37a5-a43f-4e2a-8f36-6474aaa0de51 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:45.247264 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1384/2791] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:19:45.252217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff37a5-a43f-4e2a-8f36-6474aaa0de51 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:45.258663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f823146-0e76-42b0-9fad-2daf7f1e8dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:45.260343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f823146-0e76-42b0-9fad-2daf7f1e8dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:45.260957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f823146-0e76-42b0-9fad-2daf7f1e8dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:45.261457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f823146-0e76-42b0-9fad-2daf7f1e8dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:45.262630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f823146-0e76-42b0-9fad-2daf7f1e8dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:45.264675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f823146-0e76-42b0-9fad-2daf7f1e8dc4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:45.285388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f0204-b1fb-4c4f-9317-7974c4d37a6b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:45.297412 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1408/2792] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:19:45.302684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f0204-b1fb-4c4f-9317-7974c4d37a6b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:45.308412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d7ac7-bd77-46a6-9870-54c3a53b8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:45.309533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d7ac7-bd77-46a6-9870-54c3a53b8fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:45.310187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d7ac7-bd77-46a6-9870-54c3a53b8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:45.310690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d7ac7-bd77-46a6-9870-54c3a53b8fd2 admin admin] PATH_INFO: `/v3/projects/dd69cd339bcc4a6f944a6d635fcf366b/users/4a4f15def3dc44989da457f837eb4b6f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:45.346104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d7ac7-bd77-46a6-9870-54c3a53b8fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd69cd339bcc4a6f944a6d635fcf366b, user_id=4a4f15def3dc44989da457f837eb4b6f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:45.350920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d7ac7-bd77-46a6-9870-54c3a53b8fd2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:45.386483 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1385/2793] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:19:45 2022] PUT /identity/v3/projects/dd69cd339bcc4a6f944a6d635fcf366b/users/4a4f15def3dc44989da457f837eb4b6f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:45.388773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f704e-05d9-4fad-9e48-bf6d1055f3bf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:45.389963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f704e-05d9-4fad-9e48-bf6d1055f3bf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:45.390529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f704e-05d9-4fad-9e48-bf6d1055f3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:45.435870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d88f704e-05d9-4fad-9e48-bf6d1055f3bf None None] MFA Rules not processed for user `4a4f15def3dc44989da457f837eb4b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:45.438851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d88f704e-05d9-4fad-9e48-bf6d1055f3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:45.621914 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1409/2794] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:45.633290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd157da5-e8d5-40ae-b683-986ef6c92753 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:45.642791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd157da5-e8d5-40ae-b683-986ef6c92753 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:45.643064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd157da5-e8d5-40ae-b683-986ef6c92753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:45.688710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bd157da5-e8d5-40ae-b683-986ef6c92753 None None] MFA Rules not processed for user `4a4f15def3dc44989da457f837eb4b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:45.689967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bd157da5-e8d5-40ae-b683-986ef6c92753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:45.703655 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1386/2795] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:19:46.075064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f704e-05d9-4fad-9e48-bf6d1055f3bf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:46.076615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d88f704e-05d9-4fad-9e48-bf6d1055f3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:46.086613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:46.212781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f704e-05d9-4fad-9e48-bf6d1055f3bf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:46.218462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe186a-5680-47a3-973d-72e777a8e4df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:46.219088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe186a-5680-47a3-973d-72e777a8e4df service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:46.219361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe186a-5680-47a3-973d-72e777a8e4df service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:46.219750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe186a-5680-47a3-973d-72e777a8e4df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:46.229913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe186a-5680-47a3-973d-72e777a8e4df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:46.231620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe186a-5680-47a3-973d-72e777a8e4df service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:46.255104 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1410/2796] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:19:55.674536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:56.240286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=32 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:57.090917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd157da5-e8d5-40ae-b683-986ef6c92753 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:57.093822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bd157da5-e8d5-40ae-b683-986ef6c92753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:57.210087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd157da5-e8d5-40ae-b683-986ef6c92753 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:57.217212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:57.218365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:57.218933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:57.219429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] PATH_INFO: `/v3/users/15d9145717cd4745871196a3d9d70c68` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:57.220971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d9145717cd4745871196a3d9d70c68)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:57.226529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:57.315269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d9145717cd4745871196a3d9d70c68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:57.331806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d9145717cd4745871196a3d9d70c68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:57.351075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d9145717cd4745871196a3d9d70c68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:57.370832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d9145717cd4745871196a3d9d70c68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:57.371864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-46cb6248-47c7-4b86-8fb1-a54d11278a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d9145717cd4745871196a3d9d70c68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:57.383329 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1387/2797] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:19:57 2022] DELETE /identity/v3/users/15d9145717cd4745871196a3d9d70c68 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:58.531463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe186a-5680-47a3-973d-72e777a8e4df service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:58.550127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe186a-5680-47a3-973d-72e777a8e4df service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:58.718405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:58.719060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:58.719339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:58.719631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] PATH_INFO: `/v3/projects/fa0d67fd528740208334473b4625dac8` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:58.720812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0d67fd528740208334473b4625dac8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:58.723050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:58.824902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0d67fd528740208334473b4625dac8', 'request_id': 'req-c21b38a3-e63f-4c7e-943f-679995cfec2b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:58.836839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0d67fd528740208334473b4625dac8', 'request_id': 'req-c21b38a3-e63f-4c7e-943f-679995cfec2b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:58.851073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0d67fd528740208334473b4625dac8', 'request_id': 'req-c21b38a3-e63f-4c7e-943f-679995cfec2b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:58.873528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] The token cache is being invalidate because project fa0d67fd528740208334473b4625dac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:19:58.874046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:58.875044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c21b38a3-e63f-4c7e-943f-679995cfec2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:19:58.885918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89389446-fc5c-420b-91e7-036cd778b508 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:58.886505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89389446-fc5c-420b-91e7-036cd778b508 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:58.886702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89389446-fc5c-420b-91e7-036cd778b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:58.892317 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1411/2798] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:19:58 2022] DELETE /identity/v3/projects/fa0d67fd528740208334473b4625dac8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:58.916327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-89389446-fc5c-420b-91e7-036cd778b508 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:58.917932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-89389446-fc5c-420b-91e7-036cd778b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:59.023897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1297123-f18e-461b-bece-f87bfa1ba0d5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:59.024689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1297123-f18e-461b-bece-f87bfa1ba0d5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:59.026291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1297123-f18e-461b-bece-f87bfa1ba0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:59.033158 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1388/2799] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:59.058984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c1297123-f18e-461b-bece-f87bfa1ba0d5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:59.060342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c1297123-f18e-461b-bece-f87bfa1ba0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:59.078910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89389446-fc5c-420b-91e7-036cd778b508 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:59.084149 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1412/2800] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:59.092619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89389446-fc5c-420b-91e7-036cd778b508 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:59.109735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66213b51-1073-4d0b-acfa-67309a801f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:59.111181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66213b51-1073-4d0b-acfa-67309a801f3c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:59.111181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66213b51-1073-4d0b-acfa-67309a801f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:59.111447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66213b51-1073-4d0b-acfa-67309a801f3c admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:59.113766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66213b51-1073-4d0b-acfa-67309a801f3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:19:59.113766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66213b51-1073-4d0b-acfa-67309a801f3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:59.116401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66213b51-1073-4d0b-acfa-67309a801f3c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:59.139907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1297123-f18e-461b-bece-f87bfa1ba0d5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:59.147760 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1389/2801] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:19:59.154551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1297123-f18e-461b-bece-f87bfa1ba0d5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:59.161146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e9261-304f-4f41-b124-ffcc9a8ab91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:59.161770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9261-304f-4f41-b124-ffcc9a8ab91d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:59.162358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9261-304f-4f41-b124-ffcc9a8ab91d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:59.163200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9261-304f-4f41-b124-ffcc9a8ab91d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:59.164033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e9261-304f-4f41-b124-ffcc9a8ab91d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:59.166479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e9261-304f-4f41-b124-ffcc9a8ab91d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:59.222432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66213b51-1073-4d0b-acfa-67309a801f3c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:59.230175 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1413/2802] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:19:59 2022] POST /identity/v3/projects => generated 393 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:19:59.236969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66213b51-1073-4d0b-acfa-67309a801f3c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:59.242919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:59.346938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3330df-d561-4cc4-9657-ffa277fa34a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:59.348078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3330df-d561-4cc4-9657-ffa277fa34a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:59.348306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3330df-d561-4cc4-9657-ffa277fa34a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:59.348691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3330df-d561-4cc4-9657-ffa277fa34a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:59.349813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3330df-d561-4cc4-9657-ffa277fa34a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:59.353185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3330df-d561-4cc4-9657-ffa277fa34a9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:59.385954 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1390/2803] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:19:59 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:19:59.390387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e9261-304f-4f41-b124-ffcc9a8ab91d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:59.403403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e9261-304f-4f41-b124-ffcc9a8ab91d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:59.410700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadb0ff-72d8-4e4f-8801-e36ce888d427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:59.411842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadb0ff-72d8-4e4f-8801-e36ce888d427 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:59.412283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadb0ff-72d8-4e4f-8801-e36ce888d427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:59.412762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadb0ff-72d8-4e4f-8801-e36ce888d427 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:59.413776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadb0ff-72d8-4e4f-8801-e36ce888d427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:59.415852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faadb0ff-72d8-4e4f-8801-e36ce888d427 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:59.435825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3330df-d561-4cc4-9657-ffa277fa34a9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:59.445023 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1414/2804] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:19:59.450888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3330df-d561-4cc4-9657-ffa277fa34a9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:59.458004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692f8db-84ea-4141-a8b1-a721190a5ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:59.460281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f8db-84ea-4141-a8b1-a721190a5ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:59.460281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f8db-84ea-4141-a8b1-a721190a5ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:59.460281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692f8db-84ea-4141-a8b1-a721190a5ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:59.461171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692f8db-84ea-4141-a8b1-a721190a5ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:59.462861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692f8db-84ea-4141-a8b1-a721190a5ae6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:59.498121 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1391/2805] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:19:59.500839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadb0ff-72d8-4e4f-8801-e36ce888d427 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:59.531564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadb0ff-72d8-4e4f-8801-e36ce888d427 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:19:59.537765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea54ce8-c13c-432e-93e4-c0aea2e9abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:19:59.539230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea54ce8-c13c-432e-93e4-c0aea2e9abff admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:59.539695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea54ce8-c13c-432e-93e4-c0aea2e9abff admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:59.540157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea54ce8-c13c-432e-93e4-c0aea2e9abff admin admin] PATH_INFO: `/v3/projects/8645f7fc0db348e89fd338905e31c12a/users/e5a02f772ad1448ab3d1b67541ca6581/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:59.571338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea54ce8-c13c-432e-93e4-c0aea2e9abff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8645f7fc0db348e89fd338905e31c12a, user_id=e5a02f772ad1448ab3d1b67541ca6581, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:19:59.574251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea54ce8-c13c-432e-93e4-c0aea2e9abff admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:19:59.602619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1415/2806] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:19:59 2022] PUT /identity/v3/projects/8645f7fc0db348e89fd338905e31c12a/users/e5a02f772ad1448ab3d1b67541ca6581/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:19:59.605764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e717a-43ac-4b8f-8f64-87ad43b1bda3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:19:59.606074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e717a-43ac-4b8f-8f64-87ad43b1bda3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:19:59.606352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e717a-43ac-4b8f-8f64-87ad43b1bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:19:59.642298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-921e717a-43ac-4b8f-8f64-87ad43b1bda3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:19:59.644323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-921e717a-43ac-4b8f-8f64-87ad43b1bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:59.801434 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1392/2807] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:19:59.804605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea54ce8-c13c-432e-93e4-c0aea2e9abff admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:19:59.808650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2ea54ce8-c13c-432e-93e4-c0aea2e9abff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:19:59.903216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:00.028094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea54ce8-c13c-432e-93e4-c0aea2e9abff admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:00.045419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d225bf-c778-4f93-b5a3-8ebf1e142913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:00.047840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d225bf-c778-4f93-b5a3-8ebf1e142913 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:00.052661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d225bf-c778-4f93-b5a3-8ebf1e142913 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:00.053157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d225bf-c778-4f93-b5a3-8ebf1e142913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:00.090427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d225bf-c778-4f93-b5a3-8ebf1e142913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:00.092175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d225bf-c778-4f93-b5a3-8ebf1e142913 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:00.121756 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1416/2808] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:20:01.136719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e717a-43ac-4b8f-8f64-87ad43b1bda3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:01.138175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-921e717a-43ac-4b8f-8f64-87ad43b1bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:01.154596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e717a-43ac-4b8f-8f64-87ad43b1bda3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:01.164723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:01.165411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:01.165783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:01.166087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] PATH_INFO: `/v3/users/bb9f4c8f290947ac996f0415b8b74d5a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:01.167299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9f4c8f290947ac996f0415b8b74d5a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:01.169258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:01.255781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9f4c8f290947ac996f0415b8b74d5a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:01.273087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9f4c8f290947ac996f0415b8b74d5a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:01.296225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9f4c8f290947ac996f0415b8b74d5a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:01.312981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9f4c8f290947ac996f0415b8b74d5a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:01.313950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9f4c8f290947ac996f0415b8b74d5a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:01.316111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:01.342663 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1393/2809] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:01 2022] DELETE /identity/v3/users/bb9f4c8f290947ac996f0415b8b74d5a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:20:01.595163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d225bf-c778-4f93-b5a3-8ebf1e142913 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:01.615148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d225bf-c778-4f93-b5a3-8ebf1e142913 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:01.755542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:01.756473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:01.757090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:01.758451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] PATH_INFO: `/v3/projects/da590949542e44baa0808b5f4e73fa20` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:01.760512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da590949542e44baa0808b5f4e73fa20)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:01.763983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:01.842678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da590949542e44baa0808b5f4e73fa20', 'request_id': 'req-3be8dc14-63ff-472b-980c-5579d10bfbe1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:01.851095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da590949542e44baa0808b5f4e73fa20', 'request_id': 'req-3be8dc14-63ff-472b-980c-5579d10bfbe1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:01.860729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da590949542e44baa0808b5f4e73fa20', 'request_id': 'req-3be8dc14-63ff-472b-980c-5579d10bfbe1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:01.881924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] The token cache is being invalidate because project da590949542e44baa0808b5f4e73fa20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:01.882355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:01.883344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:01.885938 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1417/2810] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:01 2022] DELETE /identity/v3/projects/da590949542e44baa0808b5f4e73fa20 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:01.893102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:01.901719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:01.929732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a1b9b-b577-47de-ba41-b37998dd539a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:02.026484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:02.027207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:02.027555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:02.028000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] PATH_INFO: `/v3/users/7193519296024afdb72ef0802d2dfb50` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:02.029546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7193519296024afdb72ef0802d2dfb50)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:02.034372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:02.128671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7193519296024afdb72ef0802d2dfb50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:02.141435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7193519296024afdb72ef0802d2dfb50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:02.160932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7193519296024afdb72ef0802d2dfb50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:02.172806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7193519296024afdb72ef0802d2dfb50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:02.175117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1b6694cc-37a5-404a-8beb-d6bee16996a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7193519296024afdb72ef0802d2dfb50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:02.196321 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1394/2811] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:01 2022] DELETE /identity/v3/users/7193519296024afdb72ef0802d2dfb50 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:02.548419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:02.550234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:02.572712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8dc14-63ff-472b-980c-5579d10bfbe1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:02.653979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:02.654700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:02.654961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:02.655270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] PATH_INFO: `/v3/projects/a5648de0d3344676ae5573fd9472ec61` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:02.656429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5648de0d3344676ae5573fd9472ec61)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:02.658534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:02.660578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:02.738095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5648de0d3344676ae5573fd9472ec61', 'request_id': 'req-c0df5430-cbbb-4682-a98f-472e2f22e324'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:02.752826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5648de0d3344676ae5573fd9472ec61', 'request_id': 'req-c0df5430-cbbb-4682-a98f-472e2f22e324'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:02.771899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5648de0d3344676ae5573fd9472ec61', 'request_id': 'req-c0df5430-cbbb-4682-a98f-472e2f22e324'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:02.806284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] The token cache is being invalidate because project a5648de0d3344676ae5573fd9472ec61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:02.806805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:02.807714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0df5430-cbbb-4682-a98f-472e2f22e324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:02.810477 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1418/2812] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:02 2022] DELETE /identity/v3/projects/a5648de0d3344676ae5573fd9472ec61 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:02.819276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f24709-eb7a-40c7-967f-3d043eb9f2c5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:02.825827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f24709-eb7a-40c7-967f-3d043eb9f2c5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:02.827092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f24709-eb7a-40c7-967f-3d043eb9f2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:02.895846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d6f24709-eb7a-40c7-967f-3d043eb9f2c5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:02.900621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d6f24709-eb7a-40c7-967f-3d043eb9f2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:03.046752 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1395/2813] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:03.048033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eac457-2ef8-4a05-85fc-04bdd15de69e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:03.048307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eac457-2ef8-4a05-85fc-04bdd15de69e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:03.048659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eac457-2ef8-4a05-85fc-04bdd15de69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:03.073271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b5eac457-2ef8-4a05-85fc-04bdd15de69e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:03.074628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b5eac457-2ef8-4a05-85fc-04bdd15de69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:03.089711 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1419/2814] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:03.095009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f24709-eb7a-40c7-967f-3d043eb9f2c5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:03.111172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f24709-eb7a-40c7-967f-3d043eb9f2c5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:03.118024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3c461-2c91-44c5-b23d-37cb4374e4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:03.119222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3c461-2c91-44c5-b23d-37cb4374e4af admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:03.119751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3c461-2c91-44c5-b23d-37cb4374e4af admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:03.121829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3c461-2c91-44c5-b23d-37cb4374e4af admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:03.122854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3c461-2c91-44c5-b23d-37cb4374e4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:03.123359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3c461-2c91-44c5-b23d-37cb4374e4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:03.126272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3c461-2c91-44c5-b23d-37cb4374e4af admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:03.175411 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1396/2815] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:03.184749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eac457-2ef8-4a05-85fc-04bdd15de69e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:03.220156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eac457-2ef8-4a05-85fc-04bdd15de69e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:03.227872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf64f-97f6-47df-9f4d-997e7def8730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:03.228780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf64f-97f6-47df-9f4d-997e7def8730 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:03.229199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf64f-97f6-47df-9f4d-997e7def8730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:03.229644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cf64f-97f6-47df-9f4d-997e7def8730 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:03.230713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cf64f-97f6-47df-9f4d-997e7def8730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:03.233379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cf64f-97f6-47df-9f4d-997e7def8730 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:03.306216 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1420/2816] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:03 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:03.308380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3c461-2c91-44c5-b23d-37cb4374e4af admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:03.317701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:03.322781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3c461-2c91-44c5-b23d-37cb4374e4af admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:03.468793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90261b46-f41f-44dd-a438-d90388218cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:03.469440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90261b46-f41f-44dd-a438-d90388218cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:03.469950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90261b46-f41f-44dd-a438-d90388218cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:03.470394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90261b46-f41f-44dd-a438-d90388218cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:03.471204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90261b46-f41f-44dd-a438-d90388218cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:03.473371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90261b46-f41f-44dd-a438-d90388218cf1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:03.523402 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1397/2817] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:03 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:20:03.532107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf64f-97f6-47df-9f4d-997e7def8730 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:03.579583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cf64f-97f6-47df-9f4d-997e7def8730 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:03.619663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38101c5b-3f60-48af-8a9e-6dbff37e4ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:03.624956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38101c5b-3f60-48af-8a9e-6dbff37e4ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:03.625456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38101c5b-3f60-48af-8a9e-6dbff37e4ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:03.629486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38101c5b-3f60-48af-8a9e-6dbff37e4ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:03.631318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38101c5b-3f60-48af-8a9e-6dbff37e4ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:03.640419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38101c5b-3f60-48af-8a9e-6dbff37e4ed4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:03.692965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90261b46-f41f-44dd-a438-d90388218cf1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:03.697604 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1421/2818] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:03.723557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90261b46-f41f-44dd-a438-d90388218cf1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:03.741533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd58c28-d87c-4fcc-a4bb-df0b8bda8d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:03.742694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd58c28-d87c-4fcc-a4bb-df0b8bda8d2d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:03.743193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd58c28-d87c-4fcc-a4bb-df0b8bda8d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:03.743674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd58c28-d87c-4fcc-a4bb-df0b8bda8d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:03.744895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd58c28-d87c-4fcc-a4bb-df0b8bda8d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:03.748088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd58c28-d87c-4fcc-a4bb-df0b8bda8d2d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:03.792677 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1398/2819] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:20:03.798090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38101c5b-3f60-48af-8a9e-6dbff37e4ed4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:03.817268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38101c5b-3f60-48af-8a9e-6dbff37e4ed4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:03.830717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30836e25-6d55-4a3e-bb2a-0ecec4a83122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:03.831427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30836e25-6d55-4a3e-bb2a-0ecec4a83122 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:03.831927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30836e25-6d55-4a3e-bb2a-0ecec4a83122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:03.832208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30836e25-6d55-4a3e-bb2a-0ecec4a83122 admin admin] PATH_INFO: `/v3/projects/b3505f632bca4106b175b39c7a03670c/users/8a36d48c52a44da7a5d768baa004a066/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:03.878431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30836e25-6d55-4a3e-bb2a-0ecec4a83122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3505f632bca4106b175b39c7a03670c, user_id=8a36d48c52a44da7a5d768baa004a066, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:03.886712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30836e25-6d55-4a3e-bb2a-0ecec4a83122 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:03.932415 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1422/2820] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:03 2022] PUT /identity/v3/projects/b3505f632bca4106b175b39c7a03670c/users/8a36d48c52a44da7a5d768baa004a066/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:03.938498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c218f1-64ec-467e-8ae6-005148392e28 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:03.938985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c218f1-64ec-467e-8ae6-005148392e28 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:03.939452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c218f1-64ec-467e-8ae6-005148392e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:04.074874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-24c218f1-64ec-467e-8ae6-005148392e28 None None] MFA Rules not processed for user `8a36d48c52a44da7a5d768baa004a066`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:04.076900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24c218f1-64ec-467e-8ae6-005148392e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:04.324934 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1399/2821] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:05.290520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30836e25-6d55-4a3e-bb2a-0ecec4a83122 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:05.293498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-30836e25-6d55-4a3e-bb2a-0ecec4a83122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:05.551754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30836e25-6d55-4a3e-bb2a-0ecec4a83122 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:05.567394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03691c-ad6d-420a-8565-10d4892975e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:05.568983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03691c-ad6d-420a-8565-10d4892975e0 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:05.569257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03691c-ad6d-420a-8565-10d4892975e0 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:05.569525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03691c-ad6d-420a-8565-10d4892975e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:05.606483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03691c-ad6d-420a-8565-10d4892975e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:05.609163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03691c-ad6d-420a-8565-10d4892975e0 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:05.633950 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1423/2822] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:06.195518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc2726-1715-4635-b30a-0e593134aad6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:06.196197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc2726-1715-4635-b30a-0e593134aad6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:06.196577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc2726-1715-4635-b30a-0e593134aad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:06.273708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5fdc2726-1715-4635-b30a-0e593134aad6 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:06.279895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5fdc2726-1715-4635-b30a-0e593134aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:06.582056 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1400/2823] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:20:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:06.599301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03691c-ad6d-420a-8565-10d4892975e0 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:06.600796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1f03691c-ad6d-420a-8565-10d4892975e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:06.642031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:06.831197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03691c-ad6d-420a-8565-10d4892975e0 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:06.849633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c88b17-4aba-457c-a11e-d15c9e29bd2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:06.850320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c88b17-4aba-457c-a11e-d15c9e29bd2a service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:06.850674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c88b17-4aba-457c-a11e-d15c9e29bd2a service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:06.851097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c88b17-4aba-457c-a11e-d15c9e29bd2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:06.874903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c88b17-4aba-457c-a11e-d15c9e29bd2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:06.876653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c88b17-4aba-457c-a11e-d15c9e29bd2a service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:06.918325 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1424/2824] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:20:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:07.269723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe4842-4934-4af5-9ebd-e5b49f92ba8c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:07.270272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe4842-4934-4af5-9ebd-e5b49f92ba8c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:07.270691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe4842-4934-4af5-9ebd-e5b49f92ba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:07.327002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3cfe4842-4934-4af5-9ebd-e5b49f92ba8c None None] MFA Rules not processed for user `8a36d48c52a44da7a5d768baa004a066`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:07.329614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3cfe4842-4934-4af5-9ebd-e5b49f92ba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:07.351068 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1401/2825] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:08.724275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e6d00-c1d5-4665-98cf-9126b10a1ba2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:08.725853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e6d00-c1d5-4665-98cf-9126b10a1ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:08.726462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e6d00-c1d5-4665-98cf-9126b10a1ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:08.787138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-883e6d00-c1d5-4665-98cf-9126b10a1ba2 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:08.791584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-883e6d00-c1d5-4665-98cf-9126b10a1ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:08.811800 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1425/2826] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:20:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:08.829178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe4842-4934-4af5-9ebd-e5b49f92ba8c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:08.864353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe4842-4934-4af5-9ebd-e5b49f92ba8c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:08.877071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40f122-2f3b-4650-adfb-a689047e2ae6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:08.901832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40f122-2f3b-4650-adfb-a689047e2ae6 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:08.902406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40f122-2f3b-4650-adfb-a689047e2ae6 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:08.902809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40f122-2f3b-4650-adfb-a689047e2ae6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:08.933983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40f122-2f3b-4650-adfb-a689047e2ae6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:08.935632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40f122-2f3b-4650-adfb-a689047e2ae6 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:08.940131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:08.962399 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1402/2827] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:20:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:09.228946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e6d00-c1d5-4665-98cf-9126b10a1ba2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:09.367351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e6d00-c1d5-4665-98cf-9126b10a1ba2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:09.373781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:09.374941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:09.375576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:09.375997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] PATH_INFO: `/v3/users/8a36d48c52a44da7a5d768baa004a066` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:09.377862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a36d48c52a44da7a5d768baa004a066)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:09.380070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:09.572400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a36d48c52a44da7a5d768baa004a066'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:09.573597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a36d48c52a44da7a5d768baa004a066'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:09.617776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a36d48c52a44da7a5d768baa004a066'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:09.639925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a36d48c52a44da7a5d768baa004a066'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:09.683987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a36d48c52a44da7a5d768baa004a066'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:09.755656 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1426/2828] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:09 2022] DELETE /identity/v3/users/8a36d48c52a44da7a5d768baa004a066 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:09.763837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8f13-0343-40b7-a22b-c5e7eee54ee3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:09.764661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8f13-0343-40b7-a22b-c5e7eee54ee3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:09.765415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8f13-0343-40b7-a22b-c5e7eee54ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:09.835196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7cbe8f13-0343-40b7-a22b-c5e7eee54ee3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:09.839311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7cbe8f13-0343-40b7-a22b-c5e7eee54ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:09.995845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:09.999221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:10.027868 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1403/2829] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:10.063174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe8f13-0343-40b7-a22b-c5e7eee54ee3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:10.064870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7cbe8f13-0343-40b7-a22b-c5e7eee54ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:10.153283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:10.260131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe8f13-0343-40b7-a22b-c5e7eee54ee3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:10.276937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f134c5-71ca-4783-a058-5b0920b9d5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:10.277786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f134c5-71ca-4783-a058-5b0920b9d5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:10.278523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f134c5-71ca-4783-a058-5b0920b9d5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:10.280989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f134c5-71ca-4783-a058-5b0920b9d5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:10.322577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f134c5-71ca-4783-a058-5b0920b9d5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:10.324169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f134c5-71ca-4783-a058-5b0920b9d5c1 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:10.353402 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1404/2830] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:20:10.360741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f134c5-71ca-4783-a058-5b0920b9d5c1 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:10.365714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-02f134c5-71ca-4783-a058-5b0920b9d5c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:10.396361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f134c5-71ca-4783-a058-5b0920b9d5c1 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:10.410660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:10.411319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:10.414167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:10.415719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] PATH_INFO: `/v3/users/885331f5db0b4ad78e75b4653bb89b6f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:10.418506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] RBAC: Authorizing `identity:delete_user(user_id=885331f5db0b4ad78e75b4653bb89b6f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:10.420902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:10.424057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741ed46-89db-41e7-9fcb-2ce61038988f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:10.434050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b00b8f-b559-468c-afa9-9991be8b0a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:10.435007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b00b8f-b559-468c-afa9-9991be8b0a77 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:10.436149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b00b8f-b559-468c-afa9-9991be8b0a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:10.436423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b00b8f-b559-468c-afa9-9991be8b0a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:10.444370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-82b00b8f-b559-468c-afa9-9991be8b0a77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:10.596203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '885331f5db0b4ad78e75b4653bb89b6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:10.644957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '885331f5db0b4ad78e75b4653bb89b6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:10.676352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '885331f5db0b4ad78e75b4653bb89b6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:10.705708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '885331f5db0b4ad78e75b4653bb89b6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:10.706962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b443aeeb-ced9-4371-bb1c-e28b9b29706b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '885331f5db0b4ad78e75b4653bb89b6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:10.724737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b00b8f-b559-468c-afa9-9991be8b0a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:10.730612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b00b8f-b559-468c-afa9-9991be8b0a77 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:10.732260 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1405/2831] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:10 2022] DELETE /identity/v3/users/885331f5db0b4ad78e75b4653bb89b6f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:10.739620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce980-7225-47fb-a0d5-09e9f3791eaa None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:10.740448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce980-7225-47fb-a0d5-09e9f3791eaa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:10.740948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce980-7225-47fb-a0d5-09e9f3791eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:10.770484 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1427/2832] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 782 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:10.873938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6adce980-7225-47fb-a0d5-09e9f3791eaa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:10.876400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6adce980-7225-47fb-a0d5-09e9f3791eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:10.915560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:11.079586 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1406/2833] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:11.130569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b00b8f-b559-468c-afa9-9991be8b0a77 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:11.135119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-82b00b8f-b559-468c-afa9-9991be8b0a77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:11.178896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b00b8f-b559-468c-afa9-9991be8b0a77 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:11.413217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae208f1-043b-46d8-a7cf-182def143a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:11.419258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae208f1-043b-46d8-a7cf-182def143a30 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:11.419771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae208f1-043b-46d8-a7cf-182def143a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:11.424733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae208f1-043b-46d8-a7cf-182def143a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:11.505411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae208f1-043b-46d8-a7cf-182def143a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:11.513620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae208f1-043b-46d8-a7cf-182def143a30 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:11.596681 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1428/2834] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:12.190596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce980-7225-47fb-a0d5-09e9f3791eaa None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:12.193310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6adce980-7225-47fb-a0d5-09e9f3791eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:12.260815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce980-7225-47fb-a0d5-09e9f3791eaa None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:12.299341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:12.300431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:12.300919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:12.301406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] PATH_INFO: `/v3/projects/b3505f632bca4106b175b39c7a03670c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:12.307309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3505f632bca4106b175b39c7a03670c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:12.315157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:12.482307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae208f1-043b-46d8-a7cf-182def143a30 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:12.490509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9ae208f1-043b-46d8-a7cf-182def143a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:12.517233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3505f632bca4106b175b39c7a03670c', 'request_id': 'req-3b4ea311-64ca-4426-b4cc-8fe12336456c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:12.536084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3505f632bca4106b175b39c7a03670c', 'request_id': 'req-3b4ea311-64ca-4426-b4cc-8fe12336456c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:12.543620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae208f1-043b-46d8-a7cf-182def143a30 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:12.548368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3505f632bca4106b175b39c7a03670c', 'request_id': 'req-3b4ea311-64ca-4426-b4cc-8fe12336456c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:12.581258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] The token cache is being invalidate because project b3505f632bca4106b175b39c7a03670c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:12.583414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:12.585331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ea311-64ca-4426-b4cc-8fe12336456c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:12.588114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1407/2835] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:12 2022] DELETE /identity/v3/projects/b3505f632bca4106b175b39c7a03670c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:12.599481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817a52a-7f9c-43c2-8170-d1f2172f2ada None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:12.612804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817a52a-7f9c-43c2-8170-d1f2172f2ada None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:12.613331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817a52a-7f9c-43c2-8170-d1f2172f2ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:12.686686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2817a52a-7f9c-43c2-8170-d1f2172f2ada None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:12.687903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2817a52a-7f9c-43c2-8170-d1f2172f2ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:12.688601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:12.701163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:12.702415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:12.702861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:12.703320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] PATH_INFO: `/v3/projects/2ecdb839de1a4d56a708dff9007e0e8f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:12.705373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ecdb839de1a4d56a708dff9007e0e8f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:12.708853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:12.807744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ecdb839de1a4d56a708dff9007e0e8f', 'request_id': 'req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:12.816471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ecdb839de1a4d56a708dff9007e0e8f', 'request_id': 'req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:12.829483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ecdb839de1a4d56a708dff9007e0e8f', 'request_id': 'req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:12.847133 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1408/2836] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:12.849640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] The token cache is being invalidate because project 2ecdb839de1a4d56a708dff9007e0e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:12.850208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:12.850708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893fe0-b16d-4bf9-96c3-c2c1fc076187 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:12.851104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa3cfd38-7cf8-4806-b9b5-00f15954b89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:12.851803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893fe0-b16d-4bf9-96c3-c2c1fc076187 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:12.852572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893fe0-b16d-4bf9-96c3-c2c1fc076187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:12.853639 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1429/2837] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:12 2022] DELETE /identity/v3/projects/2ecdb839de1a4d56a708dff9007e0e8f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:12.856122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4cc9-d4f1-4ad7-bd17-2e10a8912678 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:12.856413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4cc9-d4f1-4ad7-bd17-2e10a8912678 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:12.856681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b4cc9-d4f1-4ad7-bd17-2e10a8912678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:12.882758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-655b4cc9-d4f1-4ad7-bd17-2e10a8912678 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:12.884412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-655b4cc9-d4f1-4ad7-bd17-2e10a8912678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:12.934238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fe893fe0-b16d-4bf9-96c3-c2c1fc076187 None None] MFA Rules not processed for user `e5a02f772ad1448ab3d1b67541ca6581`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:12.935519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fe893fe0-b16d-4bf9-96c3-c2c1fc076187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:12.996019 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1430/2838] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:12.997384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b4cc9-d4f1-4ad7-bd17-2e10a8912678 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:13.005103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-655b4cc9-d4f1-4ad7-bd17-2e10a8912678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:13.008006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:13.021335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b4cc9-d4f1-4ad7-bd17-2e10a8912678 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:13.029420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:13.029991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:13.030269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:13.030540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] PATH_INFO: `/v3/users/ecb468048d2a49818fbf91f00af8d58d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:13.032020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb468048d2a49818fbf91f00af8d58d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:13.035126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:13.162662 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1409/2839] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:13.174722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb468048d2a49818fbf91f00af8d58d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:13.186772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb468048d2a49818fbf91f00af8d58d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:13.190676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe893fe0-b16d-4bf9-96c3-c2c1fc076187 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:13.229979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb468048d2a49818fbf91f00af8d58d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:13.230316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe893fe0-b16d-4bf9-96c3-c2c1fc076187 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:13.237285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07836be5-3c1f-4d59-8a37-3eb9b6b82907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:13.238558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07836be5-3c1f-4d59-8a37-3eb9b6b82907 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:13.239020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07836be5-3c1f-4d59-8a37-3eb9b6b82907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:13.239620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07836be5-3c1f-4d59-8a37-3eb9b6b82907 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:13.241075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07836be5-3c1f-4d59-8a37-3eb9b6b82907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:13.241702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07836be5-3c1f-4d59-8a37-3eb9b6b82907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:13.244137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07836be5-3c1f-4d59-8a37-3eb9b6b82907 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:13.252953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb468048d2a49818fbf91f00af8d58d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:13.269935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1410/2840] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:13.271646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175a99-0104-4345-87c2-d7a827868a61 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:13.272139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175a99-0104-4345-87c2-d7a827868a61 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:13.272579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77175a99-0104-4345-87c2-d7a827868a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:13.284837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:13.296046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb468048d2a49818fbf91f00af8d58d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:13.312394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-77175a99-0104-4345-87c2-d7a827868a61 None None] MFA Rules not processed for user `e5a02f772ad1448ab3d1b67541ca6581`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:13.315614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-77175a99-0104-4345-87c2-d7a827868a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:13.324082 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1431/2841] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:12 2022] DELETE /identity/v3/users/ecb468048d2a49818fbf91f00af8d58d => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:13.325250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:13.327120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:13.475710 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1411/2842] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:13.484041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77175a99-0104-4345-87c2-d7a827868a61 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:13.487261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-77175a99-0104-4345-87c2-d7a827868a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:13.536286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3991b-d479-4719-b609-c3d0e20f525e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:13.551780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d91895-1550-4f77-b8a3-be9609eeeba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:13.552606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91895-1550-4f77-b8a3-be9609eeeba1 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:13.552886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91895-1550-4f77-b8a3-be9609eeeba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:13.553172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d91895-1550-4f77-b8a3-be9609eeeba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:13.553865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d91895-1550-4f77-b8a3-be9609eeeba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:13.558316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d91895-1550-4f77-b8a3-be9609eeeba1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:13.646642 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1432/2843] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:13 2022] POST /identity/v3/projects => generated 379 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:13.647981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d91895-1550-4f77-b8a3-be9609eeeba1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:13.798953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77175a99-0104-4345-87c2-d7a827868a61 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:13.890295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d91895-1550-4f77-b8a3-be9609eeeba1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:13.915915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c685d-b3a6-47f0-a028-f070cb9190bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:13.921684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c685d-b3a6-47f0-a028-f070cb9190bb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:13.922011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c685d-b3a6-47f0-a028-f070cb9190bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:13.922282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c685d-b3a6-47f0-a028-f070cb9190bb admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:13.922988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c685d-b3a6-47f0-a028-f070cb9190bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:13.929161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c685d-b3a6-47f0-a028-f070cb9190bb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:13.979581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:13.983320 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1433/2844] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:13 2022] POST /identity/v3/users => generated 290 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:13.984613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c685d-b3a6-47f0-a028-f070cb9190bb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:13.989444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-455c685d-b3a6-47f0-a028-f070cb9190bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:14.007787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa74e41-e560-41d1-9576-c1ea9fbb8f85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:14.008521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa74e41-e560-41d1-9576-c1ea9fbb8f85 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:14.008966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa74e41-e560-41d1-9576-c1ea9fbb8f85 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:14.009307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa74e41-e560-41d1-9576-c1ea9fbb8f85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:14.015959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7fa74e41-e560-41d1-9576-c1ea9fbb8f85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:14.020320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c685d-b3a6-47f0-a028-f070cb9190bb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:14.031563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:14.032213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:14.032490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:14.032758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] PATH_INFO: `/v3/projects/e7571f1fc6b347cab1e09e0051d402ad` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:14.036263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7571f1fc6b347cab1e09e0051d402ad)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:14.041388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:14.143382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7571f1fc6b347cab1e09e0051d402ad', 'request_id': 'req-614c4825-9c8e-4282-8ce2-7f853bc36fc2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:14.153806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa74e41-e560-41d1-9576-c1ea9fbb8f85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:14.155774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa74e41-e560-41d1-9576-c1ea9fbb8f85 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:14.164790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7571f1fc6b347cab1e09e0051d402ad', 'request_id': 'req-614c4825-9c8e-4282-8ce2-7f853bc36fc2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:14.176924 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1412/2845] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:20:14.177988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa74e41-e560-41d1-9576-c1ea9fbb8f85 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:14.183879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7571f1fc6b347cab1e09e0051d402ad', 'request_id': 'req-614c4825-9c8e-4282-8ce2-7f853bc36fc2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:14.187554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:14.220807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] The token cache is being invalidate because project e7571f1fc6b347cab1e09e0051d402ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:14.221180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:14.223864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa74e41-e560-41d1-9576-c1ea9fbb8f85 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:14.225022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-614c4825-9c8e-4282-8ce2-7f853bc36fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:14.233961 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1434/2846] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:13 2022] DELETE /identity/v3/projects/e7571f1fc6b347cab1e09e0051d402ad => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:14.238987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715909f3-98b1-4589-94e6-64d40bea85ae None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:14.238987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715909f3-98b1-4589-94e6-64d40bea85ae None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:14.239396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715909f3-98b1-4589-94e6-64d40bea85ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:14.302092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-715909f3-98b1-4589-94e6-64d40bea85ae None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:14.303467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-715909f3-98b1-4589-94e6-64d40bea85ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:14.413210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c9506-6796-44ca-9b01-c4e49287c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:14.413844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9506-6796-44ca-9b01-c4e49287c04d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:14.414479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9506-6796-44ca-9b01-c4e49287c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:14.414779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c9506-6796-44ca-9b01-c4e49287c04d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:14.415450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c9506-6796-44ca-9b01-c4e49287c04d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:14.417105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c9506-6796-44ca-9b01-c4e49287c04d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:14.455924 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1413/2847] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:14.464270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c9506-6796-44ca-9b01-c4e49287c04d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:14.472102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3a9c9506-6796-44ca-9b01-c4e49287c04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:14.500040 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1435/2848] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:14.508030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40230-0c6f-4c63-baf5-f119410f4a28 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:14.508357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40230-0c6f-4c63-baf5-f119410f4a28 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:14.508709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe40230-0c6f-4c63-baf5-f119410f4a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:14.528476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c9506-6796-44ca-9b01-c4e49287c04d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:14.534586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857d7be-6518-49d1-91e9-7feefa6c4867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:14.535278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857d7be-6518-49d1-91e9-7feefa6c4867 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:14.535559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857d7be-6518-49d1-91e9-7feefa6c4867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:14.535827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857d7be-6518-49d1-91e9-7feefa6c4867 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:14.536541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857d7be-6518-49d1-91e9-7feefa6c4867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:14.538568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857d7be-6518-49d1-91e9-7feefa6c4867 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:14.561089 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1414/2849] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:14.562634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857d7be-6518-49d1-91e9-7feefa6c4867 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:14.568529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-abe40230-0c6f-4c63-baf5-f119410f4a28 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:14.578174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857d7be-6518-49d1-91e9-7feefa6c4867 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:14.583352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-abe40230-0c6f-4c63-baf5-f119410f4a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:14.595435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54d451-ac4e-40ed-8ac6-92b708bce877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:14.596295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54d451-ac4e-40ed-8ac6-92b708bce877 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:14.596578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54d451-ac4e-40ed-8ac6-92b708bce877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:14.596934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54d451-ac4e-40ed-8ac6-92b708bce877 admin admin] PATH_INFO: `/v3/projects/b392188c8c93466cb564f6abab737839/users/0b7a042d5c364b9c972d503c3252bac4/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:14.638823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54d451-ac4e-40ed-8ac6-92b708bce877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b392188c8c93466cb564f6abab737839, user_id=0b7a042d5c364b9c972d503c3252bac4, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:14.641784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54d451-ac4e-40ed-8ac6-92b708bce877 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:14.646854 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1436/2850] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:14.656436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe40230-0c6f-4c63-baf5-f119410f4a28 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:14.683956 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1415/2851] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:14 2022] PUT /identity/v3/projects/b392188c8c93466cb564f6abab737839/users/0b7a042d5c364b9c972d503c3252bac4/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:14.693635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271203c-ac0d-4e16-8c59-3d862dd7206c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:14.694634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe40230-0c6f-4c63-baf5-f119410f4a28 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:14.696754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271203c-ac0d-4e16-8c59-3d862dd7206c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:14.697153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271203c-ac0d-4e16-8c59-3d862dd7206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:14.835640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6271203c-ac0d-4e16-8c59-3d862dd7206c None None] MFA Rules not processed for user `0b7a042d5c364b9c972d503c3252bac4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:14.840994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6271203c-ac0d-4e16-8c59-3d862dd7206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:15.029620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:15.040016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbfee1-e5f7-4e6a-b524-516b18640ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:15.041924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbfee1-e5f7-4e6a-b524-516b18640ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:15.043143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbfee1-e5f7-4e6a-b524-516b18640ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:15.044398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dbfee1-e5f7-4e6a-b524-516b18640ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:15.045858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbfee1-e5f7-4e6a-b524-516b18640ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:15.046993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbfee1-e5f7-4e6a-b524-516b18640ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:15.057045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dbfee1-e5f7-4e6a-b524-516b18640ef7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:15.100247 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1416/2852] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:15.105587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271203c-ac0d-4e16-8c59-3d862dd7206c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:15.109274 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1437/2853] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:15.111288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbfee1-e5f7-4e6a-b524-516b18640ef7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:15.112486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6271203c-ac0d-4e16-8c59-3d862dd7206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:15.153276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dbfee1-e5f7-4e6a-b524-516b18640ef7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:15.172315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f8eb2-be1f-4bc9-a42f-5cbb6d75eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:15.174287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f8eb2-be1f-4bc9-a42f-5cbb6d75eb35 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:15.176112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f8eb2-be1f-4bc9-a42f-5cbb6d75eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:15.176838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2f8eb2-be1f-4bc9-a42f-5cbb6d75eb35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:15.181550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f8eb2-be1f-4bc9-a42f-5cbb6d75eb35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:15.187920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2f8eb2-be1f-4bc9-a42f-5cbb6d75eb35 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:15.304298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271203c-ac0d-4e16-8c59-3d862dd7206c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:15.325475 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1438/2854] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:15 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:20:15.326631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766a45-5a3f-4d03-9474-3ca8e96b0597 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:15.329447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f8eb2-be1f-4bc9-a42f-5cbb6d75eb35 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:15.330600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766a45-5a3f-4d03-9474-3ca8e96b0597 service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:15.331379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766a45-5a3f-4d03-9474-3ca8e96b0597 service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:15.331979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81766a45-5a3f-4d03-9474-3ca8e96b0597 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:15.369830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81766a45-5a3f-4d03-9474-3ca8e96b0597 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:15.372943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81766a45-5a3f-4d03-9474-3ca8e96b0597 service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:15.419832 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1417/2855] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:15.447627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:15.455611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2f8eb2-be1f-4bc9-a42f-5cbb6d75eb35 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:15.468032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f35a4-25eb-4474-b758-70128f5beabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:15.470045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f35a4-25eb-4474-b758-70128f5beabb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:15.474019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f35a4-25eb-4474-b758-70128f5beabb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:15.474862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f35a4-25eb-4474-b758-70128f5beabb admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:15.475988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f35a4-25eb-4474-b758-70128f5beabb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:15.480855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f35a4-25eb-4474-b758-70128f5beabb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:15.540437 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1439/2856] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:15 2022] POST /identity/v3/users => generated 281 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:15.543984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766a45-5a3f-4d03-9474-3ca8e96b0597 service glance] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:15.590210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81766a45-5a3f-4d03-9474-3ca8e96b0597 service glance] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:15.625423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a09c-309f-4188-8894-5fcda3d754c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:15.626535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a09c-309f-4188-8894-5fcda3d754c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:15.627047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a09c-309f-4188-8894-5fcda3d754c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:15.627791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a09c-309f-4188-8894-5fcda3d754c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:15.628637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58a09c-309f-4188-8894-5fcda3d754c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:15.635952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58a09c-309f-4188-8894-5fcda3d754c0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:15.639887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494607d-d116-4b43-87f8-53180766c799 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:15.640492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494607d-d116-4b43-87f8-53180766c799 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:15.640659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494607d-d116-4b43-87f8-53180766c799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:15.691677 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1418/2857] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:15.702986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e494607d-d116-4b43-87f8-53180766c799 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:15.704378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e494607d-d116-4b43-87f8-53180766c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:15.707667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a09c-309f-4188-8894-5fcda3d754c0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:15.762672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a09c-309f-4188-8894-5fcda3d754c0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:15.797577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe256c0-0f64-4554-9b50-248df8fd01c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:15.798460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe256c0-0f64-4554-9b50-248df8fd01c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:15.798958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe256c0-0f64-4554-9b50-248df8fd01c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:15.799454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe256c0-0f64-4554-9b50-248df8fd01c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:15.800669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe256c0-0f64-4554-9b50-248df8fd01c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:15.803926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe256c0-0f64-4554-9b50-248df8fd01c7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:15.871088 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1440/2858] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:20:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:15.872822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0ae38-9071-4c14-841f-9d460f87ede4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:15.873043 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1419/2859] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:15.877525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0ae38-9071-4c14-841f-9d460f87ede4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:15.878094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0ae38-9071-4c14-841f-9d460f87ede4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:15.882458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe256c0-0f64-4554-9b50-248df8fd01c7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:15.923068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a9b0ae38-9071-4c14-841f-9d460f87ede4 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:15.924352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a9b0ae38-9071-4c14-841f-9d460f87ede4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:15.937052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe256c0-0f64-4554-9b50-248df8fd01c7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:15.943394 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1441/2860] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:20:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:15.943861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0ae38-9071-4c14-841f-9d460f87ede4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:15.951693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a9b0ae38-9071-4c14-841f-9d460f87ede4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:15.966649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854541a-25a6-41f4-809b-4ec0a5a0252d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:15.967837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854541a-25a6-41f4-809b-4ec0a5a0252d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:15.968334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854541a-25a6-41f4-809b-4ec0a5a0252d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:15.968905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854541a-25a6-41f4-809b-4ec0a5a0252d admin admin] PATH_INFO: `/v3/projects/ce1ffff3a6e64c8c83dc4ffc13737908/users/21ea4f8e999847dfb1e45abe44c28841/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:16.067632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854541a-25a6-41f4-809b-4ec0a5a0252d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1ffff3a6e64c8c83dc4ffc13737908, user_id=21ea4f8e999847dfb1e45abe44c28841, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:16.073026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854541a-25a6-41f4-809b-4ec0a5a0252d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:16.116541 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1420/2861] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:15 2022] PUT /identity/v3/projects/ce1ffff3a6e64c8c83dc4ffc13737908/users/21ea4f8e999847dfb1e45abe44c28841/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:16.118360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854541a-25a6-41f4-809b-4ec0a5a0252d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:16.128128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8854541a-25a6-41f4-809b-4ec0a5a0252d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:16.196723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0ae38-9071-4c14-841f-9d460f87ede4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:16.320241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854541a-25a6-41f4-809b-4ec0a5a0252d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:16.338733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaa369-1e46-4172-a82a-6de5277e8e8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:16.340388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaa369-1e46-4172-a82a-6de5277e8e8b service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:16.340949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaa369-1e46-4172-a82a-6de5277e8e8b service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:16.343189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaa369-1e46-4172-a82a-6de5277e8e8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:16.374384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf83965-d451-4bf2-9ae5-83eb63703960 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:16.377118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83965-d451-4bf2-9ae5-83eb63703960 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:16.378928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83965-d451-4bf2-9ae5-83eb63703960 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:16.381487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83965-d451-4bf2-9ae5-83eb63703960 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:16.521425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:16.586966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:16.694060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf83965-d451-4bf2-9ae5-83eb63703960 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:16.697100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf83965-d451-4bf2-9ae5-83eb63703960 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:16.704646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaa369-1e46-4172-a82a-6de5277e8e8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:16.706446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaa369-1e46-4172-a82a-6de5277e8e8b service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:16.739748 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1442/2862] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:20:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:16.741293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727f267-fb11-4630-801e-a8d8e04f6812 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:16.741581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727f267-fb11-4630-801e-a8d8e04f6812 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:16.741852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727f267-fb11-4630-801e-a8d8e04f6812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:16.882751 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1421/2863] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:20:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:16.883403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce5d78-b9ae-45ac-aba5-6b38257c516e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:16.883835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce5d78-b9ae-45ac-aba5-6b38257c516e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:16.902229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce5d78-b9ae-45ac-aba5-6b38257c516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:16.946964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8727f267-fb11-4630-801e-a8d8e04f6812 None None] MFA Rules not processed for user `21ea4f8e999847dfb1e45abe44c28841`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:16.948367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8727f267-fb11-4630-801e-a8d8e04f6812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:17.051562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a9ce5d78-b9ae-45ac-aba5-6b38257c516e None None] MFA Rules not processed for user `e5a02f772ad1448ab3d1b67541ca6581`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:17.058638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a9ce5d78-b9ae-45ac-aba5-6b38257c516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:17.229158 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1443/2864] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:17.232419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727f267-fb11-4630-801e-a8d8e04f6812 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:17.271567 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1422/2865] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:17.519865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727f267-fb11-4630-801e-a8d8e04f6812 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:17.551240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196905d0-e18c-4348-a0ba-af539496a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:17.551985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196905d0-e18c-4348-a0ba-af539496a631 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:17.553424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196905d0-e18c-4348-a0ba-af539496a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:17.555173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196905d0-e18c-4348-a0ba-af539496a631 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:17.557623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196905d0-e18c-4348-a0ba-af539496a631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:17.561923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196905d0-e18c-4348-a0ba-af539496a631 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:17.676052 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1444/2866] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:17 2022] POST /identity/v3/projects => generated 359 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:17.688471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce5d78-b9ae-45ac-aba5-6b38257c516e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:17.718718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce5d78-b9ae-45ac-aba5-6b38257c516e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:18.148062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb54b9-524d-4ef3-adf7-9bf629f558a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:18.151242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb54b9-524d-4ef3-adf7-9bf629f558a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:18.157751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb54b9-524d-4ef3-adf7-9bf629f558a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:18.158473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb54b9-524d-4ef3-adf7-9bf629f558a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:18.159840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb54b9-524d-4ef3-adf7-9bf629f558a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:18.170858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb54b9-524d-4ef3-adf7-9bf629f558a4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:18.253123 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1423/2867] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:17 2022] POST /identity/v3/users => generated 286 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:18.258124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196905d0-e18c-4348-a0ba-af539496a631 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:18.278125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196905d0-e18c-4348-a0ba-af539496a631 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:18.297260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143b8d0-22dd-49dd-adb0-27c189979e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:18.300844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b8d0-22dd-49dd-adb0-27c189979e6b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:18.303596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b8d0-22dd-49dd-adb0-27c189979e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:18.304045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143b8d0-22dd-49dd-adb0-27c189979e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:18.305114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143b8d0-22dd-49dd-adb0-27c189979e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:18.309445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143b8d0-22dd-49dd-adb0-27c189979e6b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:18.350656 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1445/2868] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:18.355117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb54b9-524d-4ef3-adf7-9bf629f558a4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:18.375525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb54b9-524d-4ef3-adf7-9bf629f558a4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:18.398789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c04a-eede-4857-9943-9357745f17b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:18.399765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c04a-eede-4857-9943-9357745f17b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:18.400190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c04a-eede-4857-9943-9357745f17b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:18.401234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793c04a-eede-4857-9943-9357745f17b1 admin admin] PATH_INFO: `/v3/projects/9b281fd71d84469a92b56eb83ed99ccd/users/a42dbf9a1f624e6fb3da4c5bab4eb1ed/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:18.449903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793c04a-eede-4857-9943-9357745f17b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b281fd71d84469a92b56eb83ed99ccd, user_id=a42dbf9a1f624e6fb3da4c5bab4eb1ed, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:18.455995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793c04a-eede-4857-9943-9357745f17b1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:18.490859 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1424/2869] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:18 2022] PUT /identity/v3/projects/9b281fd71d84469a92b56eb83ed99ccd/users/a42dbf9a1f624e6fb3da4c5bab4eb1ed/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:18.491888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143b8d0-22dd-49dd-adb0-27c189979e6b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:18.506575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143b8d0-22dd-49dd-adb0-27c189979e6b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:18.577105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:18.665743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f097f-a172-4dcb-877a-b5d1521fbf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:18.666638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f097f-a172-4dcb-877a-b5d1521fbf01 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:18.667068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f097f-a172-4dcb-877a-b5d1521fbf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:18.667506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f097f-a172-4dcb-877a-b5d1521fbf01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:18.668503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f097f-a172-4dcb-877a-b5d1521fbf01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:18.674136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f097f-a172-4dcb-877a-b5d1521fbf01 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:18.715905 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1446/2870] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:20:18.721636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c04a-eede-4857-9943-9357745f17b1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:18.745099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793c04a-eede-4857-9943-9357745f17b1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:18.785718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63fb3-509a-43d7-b72f-30c6f130099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:18.790972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63fb3-509a-43d7-b72f-30c6f130099a admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:18.791796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63fb3-509a-43d7-b72f-30c6f130099a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:18.792078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c63fb3-509a-43d7-b72f-30c6f130099a admin admin] PATH_INFO: `/v3/projects/9b281fd71d84469a92b56eb83ed99ccd/users/a42dbf9a1f624e6fb3da4c5bab4eb1ed/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:18.814651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c63fb3-509a-43d7-b72f-30c6f130099a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b281fd71d84469a92b56eb83ed99ccd, user_id=a42dbf9a1f624e6fb3da4c5bab4eb1ed, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:18.842456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c63fb3-509a-43d7-b72f-30c6f130099a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:18.938017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a6bc8-f7f0-417b-98e4-6681cd09776a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:18.938390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a6bc8-f7f0-417b-98e4-6681cd09776a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:18.938870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a6bc8-f7f0-417b-98e4-6681cd09776a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:18.942356 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1425/2871] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:18 2022] PUT /identity/v3/projects/9b281fd71d84469a92b56eb83ed99ccd/users/a42dbf9a1f624e6fb3da4c5bab4eb1ed/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:19.008271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7a9a6bc8-f7f0-417b-98e4-6681cd09776a None None] MFA Rules not processed for user `a42dbf9a1f624e6fb3da4c5bab4eb1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:19.012657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7a9a6bc8-f7f0-417b-98e4-6681cd09776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:19.184152 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1447/2872] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:19.914234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63fb3-509a-43d7-b72f-30c6f130099a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:19.917217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-37c63fb3-509a-43d7-b72f-30c6f130099a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:19.992082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:20.123575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c63fb3-509a-43d7-b72f-30c6f130099a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:20.153099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebf58d-631b-4fa6-ae81-39afb5682654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:20.156909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebf58d-631b-4fa6-ae81-39afb5682654 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:20.158510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebf58d-631b-4fa6-ae81-39afb5682654 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:20.161577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebf58d-631b-4fa6-ae81-39afb5682654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:20.215313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebf58d-631b-4fa6-ae81-39afb5682654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:20.223132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebf58d-631b-4fa6-ae81-39afb5682654 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:20.261739 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1426/2873] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:23.657968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a6bc8-f7f0-417b-98e4-6681cd09776a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:23.882658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a6bc8-f7f0-417b-98e4-6681cd09776a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:23.899598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:23.900912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:23.902220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:23.902653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] PATH_INFO: `/v3/users/21ea4f8e999847dfb1e45abe44c28841` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:23.906816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ea4f8e999847dfb1e45abe44c28841)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:23.909029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:24.043620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ea4f8e999847dfb1e45abe44c28841'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:24.045177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ea4f8e999847dfb1e45abe44c28841'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:24.079800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ea4f8e999847dfb1e45abe44c28841'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:24.088331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:24.104225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ea4f8e999847dfb1e45abe44c28841'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:24.134576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ea4f8e999847dfb1e45abe44c28841'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:24.150201 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1448/2874] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:23 2022] DELETE /identity/v3/users/21ea4f8e999847dfb1e45abe44c28841 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:24.153596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84c069-f3b3-421e-b1c4-22b43b32218f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:24.154973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84c069-f3b3-421e-b1c4-22b43b32218f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:24.155520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84c069-f3b3-421e-b1c4-22b43b32218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:24.250360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-db84c069-f3b3-421e-b1c4-22b43b32218f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:24.252175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-db84c069-f3b3-421e-b1c4-22b43b32218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:24.430246 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1427/2875] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:24.471661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:24.473370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:24.800781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1c737-5389-40c8-b4d6-60655fe32eea admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:24.818810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfadce7-ae68-48cd-a703-a222239feec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:24.819478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfadce7-ae68-48cd-a703-a222239feec8 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:24.819760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfadce7-ae68-48cd-a703-a222239feec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:24.820121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfadce7-ae68-48cd-a703-a222239feec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:24.866511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfadce7-ae68-48cd-a703-a222239feec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:24.875364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfadce7-ae68-48cd-a703-a222239feec8 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:24.917311 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1449/2876] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:25.238321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837511e-28f8-4875-ae24-278f2cf85ad5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:25.238812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837511e-28f8-4875-ae24-278f2cf85ad5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:25.242413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837511e-28f8-4875-ae24-278f2cf85ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:25.325630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5837511e-28f8-4875-ae24-278f2cf85ad5 None None] MFA Rules not processed for user `0b4617ac955e438c979ca0938ee117c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:25.331269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5837511e-28f8-4875-ae24-278f2cf85ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:25.477061 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1428/2877] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:26.675681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfadce7-ae68-48cd-a703-a222239feec8 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:26.678557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8dfadce7-ae68-48cd-a703-a222239feec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:26.741562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfadce7-ae68-48cd-a703-a222239feec8 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:26.753193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:26.753856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:26.754162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:26.754432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] PATH_INFO: `/v3/projects/ce1ffff3a6e64c8c83dc4ffc13737908` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:26.755813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1ffff3a6e64c8c83dc4ffc13737908)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:26.762564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:26.875070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1ffff3a6e64c8c83dc4ffc13737908', 'request_id': 'req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:26.899859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1ffff3a6e64c8c83dc4ffc13737908', 'request_id': 'req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:26.954057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1ffff3a6e64c8c83dc4ffc13737908', 'request_id': 'req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:27.019960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] The token cache is being invalidate because project ce1ffff3a6e64c8c83dc4ffc13737908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:27.024309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:27.031470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:27.046188 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1450/2878] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:26 2022] DELETE /identity/v3/projects/ce1ffff3a6e64c8c83dc4ffc13737908 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:27.050135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837511e-28f8-4875-ae24-278f2cf85ad5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:27.071385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837511e-28f8-4875-ae24-278f2cf85ad5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:27.258693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:27.259749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:27.260220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:27.260761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] PATH_INFO: `/v3/users/a42dbf9a1f624e6fb3da4c5bab4eb1ed` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:27.262378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42dbf9a1f624e6fb3da4c5bab4eb1ed)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:27.264928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:27.288378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:27.416788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42dbf9a1f624e6fb3da4c5bab4eb1ed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:27.448950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42dbf9a1f624e6fb3da4c5bab4eb1ed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:27.505192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42dbf9a1f624e6fb3da4c5bab4eb1ed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:27.536514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42dbf9a1f624e6fb3da4c5bab4eb1ed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:27.537774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c83ef1a8-bc79-4821-bc62-97615b784588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42dbf9a1f624e6fb3da4c5bab4eb1ed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:27.557546 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1429/2879] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:27 2022] DELETE /identity/v3/users/a42dbf9a1f624e6fb3da4c5bab4eb1ed => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:29.069813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:29.071804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:29.099220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfdd2b-7c09-4e3a-bc7d-830eef1b7fb0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:29.300154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:29.304683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:29.304946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:29.308960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] PATH_INFO: `/v3/projects/9b281fd71d84469a92b56eb83ed99ccd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:29.311526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b281fd71d84469a92b56eb83ed99ccd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:29.314465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:29.324061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:29.492600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b281fd71d84469a92b56eb83ed99ccd', 'request_id': 'req-55844bb4-e283-4658-ad3f-31f342ee7188'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:29.505094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b281fd71d84469a92b56eb83ed99ccd', 'request_id': 'req-55844bb4-e283-4658-ad3f-31f342ee7188'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:29.526000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b281fd71d84469a92b56eb83ed99ccd', 'request_id': 'req-55844bb4-e283-4658-ad3f-31f342ee7188'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:29.551881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] The token cache is being invalidate because project 9b281fd71d84469a92b56eb83ed99ccd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:29.552238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:29.554939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55844bb4-e283-4658-ad3f-31f342ee7188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:29.563757 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1451/2880] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:29 2022] DELETE /identity/v3/projects/9b281fd71d84469a92b56eb83ed99ccd => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:29.566731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6addba8-a12f-436d-8e27-ceb0d893d526 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:29.566731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6addba8-a12f-436d-8e27-ceb0d893d526 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:29.566731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6addba8-a12f-436d-8e27-ceb0d893d526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:29.599507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e6addba8-a12f-436d-8e27-ceb0d893d526 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:29.601177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e6addba8-a12f-436d-8e27-ceb0d893d526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:29.834676 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1430/2881] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:29.843534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08b17-c91a-475c-ab77-e8847d1c33f8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:29.843829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08b17-c91a-475c-ab77-e8847d1c33f8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:29.844102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f08b17-c91a-475c-ab77-e8847d1c33f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:29.908436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d2f08b17-c91a-475c-ab77-e8847d1c33f8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:29.917844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d2f08b17-c91a-475c-ab77-e8847d1c33f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:29.942380 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1452/2882] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:29.943815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6addba8-a12f-436d-8e27-ceb0d893d526 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:29.962944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6addba8-a12f-436d-8e27-ceb0d893d526 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:29.978632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ea883-33ab-4260-902f-e16e2452504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:29.980630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ea883-33ab-4260-902f-e16e2452504f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:29.982523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ea883-33ab-4260-902f-e16e2452504f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:29.983860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ea883-33ab-4260-902f-e16e2452504f admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:29.987161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ea883-33ab-4260-902f-e16e2452504f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:29.987515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ea883-33ab-4260-902f-e16e2452504f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:29.993086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ea883-33ab-4260-902f-e16e2452504f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:30.043863 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1431/2883] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:30.047193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f08b17-c91a-475c-ab77-e8847d1c33f8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:30.084495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f08b17-c91a-475c-ab77-e8847d1c33f8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:30.115864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc7222-b43c-4879-9dc4-8979a6d786e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:30.116510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc7222-b43c-4879-9dc4-8979a6d786e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:30.116956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc7222-b43c-4879-9dc4-8979a6d786e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:30.134019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc7222-b43c-4879-9dc4-8979a6d786e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:30.137056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc7222-b43c-4879-9dc4-8979a6d786e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:30.146825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc7222-b43c-4879-9dc4-8979a6d786e7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:30.270930 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1453/2884] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:30 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:30.273815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ea883-33ab-4260-902f-e16e2452504f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:30.297496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ea883-33ab-4260-902f-e16e2452504f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:30.574884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d752a26-52bc-451e-bad8-7cfa21e2ad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:30.579281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d752a26-52bc-451e-bad8-7cfa21e2ad2d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:30.579845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d752a26-52bc-451e-bad8-7cfa21e2ad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:30.581495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d752a26-52bc-451e-bad8-7cfa21e2ad2d admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:30.583488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d752a26-52bc-451e-bad8-7cfa21e2ad2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:30.592137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d752a26-52bc-451e-bad8-7cfa21e2ad2d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:30.691985 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1432/2885] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:30 2022] POST /identity/v3/users => generated 287 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:30.696685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc7222-b43c-4879-9dc4-8979a6d786e7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:30.711054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc7222-b43c-4879-9dc4-8979a6d786e7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:30.744816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea0ec9-d06d-4fc2-a8b7-1e6fa7c15f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:30.745925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea0ec9-d06d-4fc2-a8b7-1e6fa7c15f9c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:30.747195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea0ec9-d06d-4fc2-a8b7-1e6fa7c15f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:30.747614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ea0ec9-d06d-4fc2-a8b7-1e6fa7c15f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:30.748802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea0ec9-d06d-4fc2-a8b7-1e6fa7c15f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:30.752049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ea0ec9-d06d-4fc2-a8b7-1e6fa7c15f9c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:30.830955 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1454/2886] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:30.835910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d752a26-52bc-451e-bad8-7cfa21e2ad2d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:30.848511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d752a26-52bc-451e-bad8-7cfa21e2ad2d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:30.881292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da946817-d7be-4f0a-95a1-7545161eaad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:30.888481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da946817-d7be-4f0a-95a1-7545161eaad7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:30.889210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da946817-d7be-4f0a-95a1-7545161eaad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:30.890302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da946817-d7be-4f0a-95a1-7545161eaad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:30.892520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da946817-d7be-4f0a-95a1-7545161eaad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:30.896264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da946817-d7be-4f0a-95a1-7545161eaad7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:30.910471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:30.949751 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1433/2887] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:20:30.955567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea0ec9-d06d-4fc2-a8b7-1e6fa7c15f9c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:30.984192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ea0ec9-d06d-4fc2-a8b7-1e6fa7c15f9c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:31.005302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180198b-0c13-4c25-ae4a-d3d73f61e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:31.007238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180198b-0c13-4c25-ae4a-d3d73f61e276 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:31.011393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180198b-0c13-4c25-ae4a-d3d73f61e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:31.012769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180198b-0c13-4c25-ae4a-d3d73f61e276 admin admin] PATH_INFO: `/v3/projects/79651d2c0f89490f8a3942f0bbcce583/users/9c333fc89a2348eba7f8b5e9c6f651f2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:31.086218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180198b-0c13-4c25-ae4a-d3d73f61e276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79651d2c0f89490f8a3942f0bbcce583, user_id=9c333fc89a2348eba7f8b5e9c6f651f2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:31.090468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180198b-0c13-4c25-ae4a-d3d73f61e276 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:31.154501 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1455/2888] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:30 2022] PUT /identity/v3/projects/79651d2c0f89490f8a3942f0bbcce583/users/9c333fc89a2348eba7f8b5e9c6f651f2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:20:31.156258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f986-1b66-4f4b-b0e6-b65302645527 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:31.156785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f986-1b66-4f4b-b0e6-b65302645527 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:31.157203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f986-1b66-4f4b-b0e6-b65302645527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:31.243479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-aab9f986-1b66-4f4b-b0e6-b65302645527 None None] MFA Rules not processed for user `9c333fc89a2348eba7f8b5e9c6f651f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:31.248383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aab9f986-1b66-4f4b-b0e6-b65302645527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:31.386967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180198b-0c13-4c25-ae4a-d3d73f61e276 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:31.388371 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1434/2889] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:31.667421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180198b-0c13-4c25-ae4a-d3d73f61e276 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:31.695124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd13ff-8ac5-49e5-8e56-1758ed3dee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:31.696118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd13ff-8ac5-49e5-8e56-1758ed3dee33 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:31.701059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd13ff-8ac5-49e5-8e56-1758ed3dee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:31.701353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd13ff-8ac5-49e5-8e56-1758ed3dee33 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:31.702080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd13ff-8ac5-49e5-8e56-1758ed3dee33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:31.712589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd13ff-8ac5-49e5-8e56-1758ed3dee33 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:31.782341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9f986-1b66-4f4b-b0e6-b65302645527 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:31.797437 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1456/2890] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:31 2022] POST /identity/v3/projects => generated 375 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:31.806204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9f986-1b66-4f4b-b0e6-b65302645527 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:32.064698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac5e7f-65d2-4712-a041-5b8613262e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:32.066107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5e7f-65d2-4712-a041-5b8613262e70 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:32.070154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5e7f-65d2-4712-a041-5b8613262e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:32.074286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac5e7f-65d2-4712-a041-5b8613262e70 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:32.078686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac5e7f-65d2-4712-a041-5b8613262e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:32.090713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac5e7f-65d2-4712-a041-5b8613262e70 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:32.188245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd13ff-8ac5-49e5-8e56-1758ed3dee33 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:32.214149 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1435/2891] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:31 2022] POST /identity/v3/users => generated 294 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:32.224292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd13ff-8ac5-49e5-8e56-1758ed3dee33 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:32.271248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fba5e-ff8f-480e-860b-e63d1f8f5707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:32.272400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fba5e-ff8f-480e-860b-e63d1f8f5707 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:32.276989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fba5e-ff8f-480e-860b-e63d1f8f5707 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:32.277469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fba5e-ff8f-480e-860b-e63d1f8f5707 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:32.278664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fba5e-ff8f-480e-860b-e63d1f8f5707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:32.287946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fba5e-ff8f-480e-860b-e63d1f8f5707 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:32.343019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:32.376751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac5e7f-65d2-4712-a041-5b8613262e70 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:32.399556 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1457/2892] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:20:32.416528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac5e7f-65d2-4712-a041-5b8613262e70 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:32.444528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aafc0-d6bf-4c82-a60d-132f1ba03178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:32.446130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aafc0-d6bf-4c82-a60d-132f1ba03178 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:32.446588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aafc0-d6bf-4c82-a60d-132f1ba03178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:32.447079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aafc0-d6bf-4c82-a60d-132f1ba03178 admin admin] PATH_INFO: `/v3/projects/76493ddc50dd48baaa54e341997c7555/users/de497eaf77664f3bb0ed3c1e615157bd/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:32.520642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292aafc0-d6bf-4c82-a60d-132f1ba03178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76493ddc50dd48baaa54e341997c7555, user_id=de497eaf77664f3bb0ed3c1e615157bd, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:32.529012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292aafc0-d6bf-4c82-a60d-132f1ba03178 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:32.578080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fba5e-ff8f-480e-860b-e63d1f8f5707 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:32.588019 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1436/2893] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:32 2022] PUT /identity/v3/projects/76493ddc50dd48baaa54e341997c7555/users/de497eaf77664f3bb0ed3c1e615157bd/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:20:32.604934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fba5e-ff8f-480e-860b-e63d1f8f5707 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:32.766701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40578ab-4090-4a87-b81f-193f13f13ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:32.767657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40578ab-4090-4a87-b81f-193f13f13ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:32.768072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40578ab-4090-4a87-b81f-193f13f13ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:32.768721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40578ab-4090-4a87-b81f-193f13f13ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:32.770827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40578ab-4090-4a87-b81f-193f13f13ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:32.773616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40578ab-4090-4a87-b81f-193f13f13ff4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:32.801540 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1458/2894] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:32.807084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aafc0-d6bf-4c82-a60d-132f1ba03178 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:32.821620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aafc0-d6bf-4c82-a60d-132f1ba03178 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:32.835074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70317b6-ccbd-4fc0-bab8-c2b36073f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:32.836682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70317b6-ccbd-4fc0-bab8-c2b36073f783 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:32.837204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70317b6-ccbd-4fc0-bab8-c2b36073f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:32.837654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70317b6-ccbd-4fc0-bab8-c2b36073f783 admin admin] PATH_INFO: `/v3/projects/76493ddc50dd48baaa54e341997c7555/users/de497eaf77664f3bb0ed3c1e615157bd/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:32.840060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70317b6-ccbd-4fc0-bab8-c2b36073f783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76493ddc50dd48baaa54e341997c7555, user_id=de497eaf77664f3bb0ed3c1e615157bd, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:32.843842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70317b6-ccbd-4fc0-bab8-c2b36073f783 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:32.859813 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1437/2895] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:32 2022] PUT /identity/v3/projects/76493ddc50dd48baaa54e341997c7555/users/de497eaf77664f3bb0ed3c1e615157bd/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:32.878009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9295b-f652-4afa-ab59-c6c32ea43b91 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:32.878305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9295b-f652-4afa-ab59-c6c32ea43b91 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:32.878537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9295b-f652-4afa-ab59-c6c32ea43b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:32.940328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-16d9295b-f652-4afa-ab59-c6c32ea43b91 None None] MFA Rules not processed for user `de497eaf77664f3bb0ed3c1e615157bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:32.941594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-16d9295b-f652-4afa-ab59-c6c32ea43b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:33.155930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70317b6-ccbd-4fc0-bab8-c2b36073f783 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:33.160204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b70317b6-ccbd-4fc0-bab8-c2b36073f783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:33.182386 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1459/2896] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:33.184264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9295b-f652-4afa-ab59-c6c32ea43b91 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:33.206917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9295b-f652-4afa-ab59-c6c32ea43b91 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:33.233529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dc3c5-40b9-4c1c-8a88-d486131f74c5 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:33.235027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc3c5-40b9-4c1c-8a88-d486131f74c5 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:33.235278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc3c5-40b9-4c1c-8a88-d486131f74c5 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:33.235721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc3c5-40b9-4c1c-8a88-d486131f74c5 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:33.236600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dc3c5-40b9-4c1c-8a88-d486131f74c5 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:33.237083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dc3c5-40b9-4c1c-8a88-d486131f74c5 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:33.239008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dc3c5-40b9-4c1c-8a88-d486131f74c5 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:33.272716 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1460/2897] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:20:33.274143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:33.278774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dc3c5-40b9-4c1c-8a88-d486131f74c5 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:33.306898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dc3c5-40b9-4c1c-8a88-d486131f74c5 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:33.334751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83704fa-6853-49b9-b313-7ae30bbb8ccb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:33.336063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83704fa-6853-49b9-b313-7ae30bbb8ccb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:33.342398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83704fa-6853-49b9-b313-7ae30bbb8ccb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:33.344590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83704fa-6853-49b9-b313-7ae30bbb8ccb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:33.344763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70317b6-ccbd-4fc0-bab8-c2b36073f783 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:33.351469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83704fa-6853-49b9-b313-7ae30bbb8ccb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:33.352932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:33.353777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:33.354230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:33.354603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] PATH_INFO: `/v3/users/7b6db36eb9c94341be5d69f932256067` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:33.356441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6db36eb9c94341be5d69f932256067)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:33.360681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:33.366550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83704fa-6853-49b9-b313-7ae30bbb8ccb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:33.459977 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1461/2898] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:33 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:33.460631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83704fa-6853-49b9-b313-7ae30bbb8ccb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:33.541109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6db36eb9c94341be5d69f932256067'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:33.582368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6db36eb9c94341be5d69f932256067'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:33.647057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:33.656441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6db36eb9c94341be5d69f932256067'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:33.688807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83704fa-6853-49b9-b313-7ae30bbb8ccb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:33.696643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6db36eb9c94341be5d69f932256067'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:33.697945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6db36eb9c94341be5d69f932256067'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:33.717626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702c4d4-4dc6-48cd-a1b1-3d0b3bad04d0 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:33.718876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702c4d4-4dc6-48cd-a1b1-3d0b3bad04d0 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:33.719164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702c4d4-4dc6-48cd-a1b1-3d0b3bad04d0 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:33.719443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702c4d4-4dc6-48cd-a1b1-3d0b3bad04d0 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:33.720143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702c4d4-4dc6-48cd-a1b1-3d0b3bad04d0 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:33.720457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702c4d4-4dc6-48cd-a1b1-3d0b3bad04d0 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:33.723415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702c4d4-4dc6-48cd-a1b1-3d0b3bad04d0 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:33.729706 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1438/2899] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:33 2022] DELETE /identity/v3/users/7b6db36eb9c94341be5d69f932256067 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:33.763028 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1462/2900] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:34.222338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:34.224000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:34.387067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c3666-5867-4c1b-a9d6-d4cd7912ee67 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:34.402243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:34.404580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:34.406128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:34.406438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] PATH_INFO: `/v3/projects/3e87ae4cc51243798be7af2ba7278786` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:34.411698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e87ae4cc51243798be7af2ba7278786)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:34.415094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:34.490034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e87ae4cc51243798be7af2ba7278786', 'request_id': 'req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:34.499938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e87ae4cc51243798be7af2ba7278786', 'request_id': 'req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:34.503320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:34.509953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e87ae4cc51243798be7af2ba7278786', 'request_id': 'req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:34.529902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] The token cache is being invalidate because project 3e87ae4cc51243798be7af2ba7278786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:34.530638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:34.531575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee5be290-3e8f-4223-a5b1-44ef9b636c8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:34.533850 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1439/2901] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:34 2022] DELETE /identity/v3/projects/3e87ae4cc51243798be7af2ba7278786 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:34.541571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697c3c-1bc4-416b-b352-da0f4595b24c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:34.542850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697c3c-1bc4-416b-b352-da0f4595b24c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:34.543392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697c3c-1bc4-416b-b352-da0f4595b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:34.569351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-66697c3c-1bc4-416b-b352-da0f4595b24c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:34.571388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-66697c3c-1bc4-416b-b352-da0f4595b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:34.655558 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1463/2902] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:34.664685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bce9b-243f-4c3d-bd96-30f32b5d842a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:34.665171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bce9b-243f-4c3d-bd96-30f32b5d842a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:34.665515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bce9b-243f-4c3d-bd96-30f32b5d842a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:34.691704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-aa3bce9b-243f-4c3d-bd96-30f32b5d842a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:34.692968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aa3bce9b-243f-4c3d-bd96-30f32b5d842a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:34.705974 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1440/2903] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:34.707277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697c3c-1bc4-416b-b352-da0f4595b24c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:34.724020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697c3c-1bc4-416b-b352-da0f4595b24c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:34.730715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8160-c3a6-47bc-9edd-58d1e297033e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:34.731917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8160-c3a6-47bc-9edd-58d1e297033e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:34.732588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8160-c3a6-47bc-9edd-58d1e297033e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:34.732931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e8160-c3a6-47bc-9edd-58d1e297033e admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:34.733682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e8160-c3a6-47bc-9edd-58d1e297033e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:34.734094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e8160-c3a6-47bc-9edd-58d1e297033e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:34.736244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e8160-c3a6-47bc-9edd-58d1e297033e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:34.756295 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1464/2904] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:34.761318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bce9b-243f-4c3d-bd96-30f32b5d842a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:34.775962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bce9b-243f-4c3d-bd96-30f32b5d842a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:34.783679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715aa4e-d6b2-4577-b087-e85aac13a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:34.784442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715aa4e-d6b2-4577-b087-e85aac13a847 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:34.784807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715aa4e-d6b2-4577-b087-e85aac13a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:34.785160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715aa4e-d6b2-4577-b087-e85aac13a847 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:34.787627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715aa4e-d6b2-4577-b087-e85aac13a847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:34.791595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715aa4e-d6b2-4577-b087-e85aac13a847 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:34.847154 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1441/2905] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:34 2022] POST /identity/v3/projects => generated 391 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:34.852173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8160-c3a6-47bc-9edd-58d1e297033e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:34.866981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e8160-c3a6-47bc-9edd-58d1e297033e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:34.993248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dcb05-e604-48f9-a0b9-e58cb787ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:34.994111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dcb05-e604-48f9-a0b9-e58cb787ccf9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:34.994455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dcb05-e604-48f9-a0b9-e58cb787ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:34.994794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dcb05-e604-48f9-a0b9-e58cb787ccf9 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:34.995516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dcb05-e604-48f9-a0b9-e58cb787ccf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:34.997735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dcb05-e604-48f9-a0b9-e58cb787ccf9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:35.030173 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1465/2906] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:34 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:35.032210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715aa4e-d6b2-4577-b087-e85aac13a847 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:35.043485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715aa4e-d6b2-4577-b087-e85aac13a847 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:35.051554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fa6e3-6e0b-411f-b752-a92b5e8e5a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:35.052203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa6e3-6e0b-411f-b752-a92b5e8e5a39 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:35.052490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa6e3-6e0b-411f-b752-a92b5e8e5a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:35.052744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0fa6e3-6e0b-411f-b752-a92b5e8e5a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:35.053474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fa6e3-6e0b-411f-b752-a92b5e8e5a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:35.055277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0fa6e3-6e0b-411f-b752-a92b5e8e5a39 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:35.068469 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1442/2907] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:35.075482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dcb05-e604-48f9-a0b9-e58cb787ccf9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:35.090937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dcb05-e604-48f9-a0b9-e58cb787ccf9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:35.099496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b5f72-36e8-4233-ab5b-d4f34e8fa6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:35.100814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b5f72-36e8-4233-ab5b-d4f34e8fa6ee admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:35.100814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b5f72-36e8-4233-ab5b-d4f34e8fa6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:35.100814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b5f72-36e8-4233-ab5b-d4f34e8fa6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:35.102660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b5f72-36e8-4233-ab5b-d4f34e8fa6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:35.104452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b5f72-36e8-4233-ab5b-d4f34e8fa6ee admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:35.135527 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1466/2908] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:35.138407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fa6e3-6e0b-411f-b752-a92b5e8e5a39 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:35.174085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0fa6e3-6e0b-411f-b752-a92b5e8e5a39 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:35.182186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4750-e810-4e6d-99e1-2e4d58a9af03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:35.182981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4750-e810-4e6d-99e1-2e4d58a9af03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:35.183255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4750-e810-4e6d-99e1-2e4d58a9af03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:35.183525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc4750-e810-4e6d-99e1-2e4d58a9af03 admin admin] PATH_INFO: `/v3/projects/be38fe88df1a40899428d0279c3be0c8/users/a7e09dadd70845f98b0bfb3397d74f26/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:35.200360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc4750-e810-4e6d-99e1-2e4d58a9af03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be38fe88df1a40899428d0279c3be0c8, user_id=a7e09dadd70845f98b0bfb3397d74f26, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:35.203230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc4750-e810-4e6d-99e1-2e4d58a9af03 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:35.292642 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1443/2909] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:35 2022] PUT /identity/v3/projects/be38fe88df1a40899428d0279c3be0c8/users/a7e09dadd70845f98b0bfb3397d74f26/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:35.297681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140b6fb-6af9-427a-b887-d8d8a144b10c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:35.298029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140b6fb-6af9-427a-b887-d8d8a144b10c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:35.298281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140b6fb-6af9-427a-b887-d8d8a144b10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:35.325560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e140b6fb-6af9-427a-b887-d8d8a144b10c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:35.333211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e140b6fb-6af9-427a-b887-d8d8a144b10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:35.404395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:35.434353 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1467/2910] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:35.441737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4750-e810-4e6d-99e1-2e4d58a9af03 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:35.443986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-82bc4750-e810-4e6d-99e1-2e4d58a9af03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:35.543312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc4750-e810-4e6d-99e1-2e4d58a9af03 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:35.549764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b4324-c044-41a2-8dd1-b36e18dd2d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:35.550455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b4324-c044-41a2-8dd1-b36e18dd2d6e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:35.550729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b4324-c044-41a2-8dd1-b36e18dd2d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:35.551294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b4324-c044-41a2-8dd1-b36e18dd2d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:35.566803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b4324-c044-41a2-8dd1-b36e18dd2d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:35.568511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b4324-c044-41a2-8dd1-b36e18dd2d6e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:35.585328 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1444/2911] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:41.836692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140b6fb-6af9-427a-b887-d8d8a144b10c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:41.838182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e140b6fb-6af9-427a-b887-d8d8a144b10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:42.119950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140b6fb-6af9-427a-b887-d8d8a144b10c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:42.137195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dd831-cf72-4b7e-8ec8-3129b075c035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:42.140862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dd831-cf72-4b7e-8ec8-3129b075c035 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:42.141325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dd831-cf72-4b7e-8ec8-3129b075c035 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:42.141756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6dd831-cf72-4b7e-8ec8-3129b075c035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:42.147945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4a6dd831-cf72-4b7e-8ec8-3129b075c035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:42.302230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dd831-cf72-4b7e-8ec8-3129b075c035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:42.304669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6dd831-cf72-4b7e-8ec8-3129b075c035 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:42.331359 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1468/2912] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:42.340319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef378a-b272-48f1-88ef-966c64122d3a None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:42.340927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef378a-b272-48f1-88ef-966c64122d3a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:42.340927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef378a-b272-48f1-88ef-966c64122d3a None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:42.342641 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1445/2913] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:42.360716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dd831-cf72-4b7e-8ec8-3129b075c035 service nova] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:42.377330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dd831-cf72-4b7e-8ec8-3129b075c035 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:42.395271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6dd831-cf72-4b7e-8ec8-3129b075c035 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:42.402722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64cebd-8013-48ca-b86c-294e5738bf6b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:42.405649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64cebd-8013-48ca-b86c-294e5738bf6b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:42.406285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64cebd-8013-48ca-b86c-294e5738bf6b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:42.407026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64cebd-8013-48ca-b86c-294e5738bf6b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/f28de2d034d447379c07db675577c03f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:42.409774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64cebd-8013-48ca-b86c-294e5738bf6b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=f28de2d034d447379c07db675577c03f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:42.412987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64cebd-8013-48ca-b86c-294e5738bf6b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:42.437935 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1469/2914] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:42 2022] GET /identity/v3/projects/f28de2d034d447379c07db675577c03f => generated 371 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:42.555592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcc3a2-22e5-43b7-9bf3-79e7f20bba4d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:42.558016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcc3a2-22e5-43b7-9bf3-79e7f20bba4d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:42.558484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcc3a2-22e5-43b7-9bf3-79e7f20bba4d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:42.562913 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1446/2915] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:42.568728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64cebd-8013-48ca-b86c-294e5738bf6b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:42.570713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7a64cebd-8013-48ca-b86c-294e5738bf6b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:42.603998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64cebd-8013-48ca-b86c-294e5738bf6b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:42.630589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64cebd-8013-48ca-b86c-294e5738bf6b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:42.652307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86826a09-c19e-4458-a3d5-a4fcf2d190fa tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:42.653458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86826a09-c19e-4458-a3d5-a4fcf2d190fa tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:42.654109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86826a09-c19e-4458-a3d5-a4fcf2d190fa tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:42.654602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86826a09-c19e-4458-a3d5-a4fcf2d190fa tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/f28de2d034d447379c07db675577c03f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:42.655988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86826a09-c19e-4458-a3d5-a4fcf2d190fa tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=f28de2d034d447379c07db675577c03f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:42.658427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86826a09-c19e-4458-a3d5-a4fcf2d190fa tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:42.660758 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1470/2916] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:42 2022] GET /identity/v3/projects/f28de2d034d447379c07db675577c03f => generated 371 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:43.154500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafd963-7fab-44d4-9354-68ae34d466ce None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.155012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafd963-7fab-44d4-9354-68ae34d466ce None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.155450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cafd963-7fab-44d4-9354-68ae34d466ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.246597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9cafd963-7fab-44d4-9354-68ae34d466ce None None] MFA Rules not processed for user `a7e09dadd70845f98b0bfb3397d74f26`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:43.250805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9cafd963-7fab-44d4-9354-68ae34d466ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:43.375438 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1447/2917] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:43.390597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868fed1-249c-440c-989b-900afceb54b5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.391139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868fed1-249c-440c-989b-900afceb54b5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.391233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868fed1-249c-440c-989b-900afceb54b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.425144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2868fed1-249c-440c-989b-900afceb54b5 None None] MFA Rules not processed for user `a7e09dadd70845f98b0bfb3397d74f26`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:43.426988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2868fed1-249c-440c-989b-900afceb54b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:43.447827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1471/2918] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:43.539587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d2d08-d0f8-459b-802d-c81e95f867b7 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.539907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d2d08-d0f8-459b-802d-c81e95f867b7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.540147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d2d08-d0f8-459b-802d-c81e95f867b7 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.541606 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1448/2919] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:43.547886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868fed1-249c-440c-989b-900afceb54b5 None None] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:43.572765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868fed1-249c-440c-989b-900afceb54b5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:43.589729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2868fed1-249c-440c-989b-900afceb54b5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:43.602160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf759e5-ed72-45d9-8e70-22dab0f3e124 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:43.603961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf759e5-ed72-45d9-8e70-22dab0f3e124 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.604316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf759e5-ed72-45d9-8e70-22dab0f3e124 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.605527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf759e5-ed72-45d9-8e70-22dab0f3e124 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/f28de2d034d447379c07db675577c03f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.607196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf759e5-ed72-45d9-8e70-22dab0f3e124 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=f28de2d034d447379c07db675577c03f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:43.609614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf759e5-ed72-45d9-8e70-22dab0f3e124 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:43.611814 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1472/2920] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:43 2022] GET /identity/v3/projects/f28de2d034d447379c07db675577c03f => generated 371 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:43.642960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d2d08-d0f8-459b-802d-c81e95f867b7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:43.676694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d2d08-d0f8-459b-802d-c81e95f867b7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:43.678911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf759e5-ed72-45d9-8e70-22dab0f3e124 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:43.698062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:43.698383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.698580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.699041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/f28de2d034d447379c07db675577c03f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.703639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f28de2d034d447379c07db675577c03f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:43.706402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:43.715186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf759e5-ed72-45d9-8e70-22dab0f3e124 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:43.721702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cb581-4b16-493c-b620-e1d93437a2d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:43.722795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cb581-4b16-493c-b620-e1d93437a2d9 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.723077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cb581-4b16-493c-b620-e1d93437a2d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.723347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cb581-4b16-493c-b620-e1d93437a2d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.735640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cb581-4b16-493c-b620-e1d93437a2d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:43.737623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4cb581-4b16-493c-b620-e1d93437a2d9 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:43.740652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:43.767680 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1473/2921] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:20:43.812905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782edf5-7dda-45d8-b39c-9de2ccb2fd12 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:43.818362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782edf5-7dda-45d8-b39c-9de2ccb2fd12 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:43.818644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782edf5-7dda-45d8-b39c-9de2ccb2fd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:43.822070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f28de2d034d447379c07db675577c03f', 'request_id': 'req-55caaebf-616e-4ccc-b600-f51391554cc3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:43.841604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f28de2d034d447379c07db675577c03f', 'request_id': 'req-55caaebf-616e-4ccc-b600-f51391554cc3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:43.844450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c782edf5-7dda-45d8-b39c-9de2ccb2fd12 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:43.845642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c782edf5-7dda-45d8-b39c-9de2ccb2fd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:43.855057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f28de2d034d447379c07db675577c03f', 'request_id': 'req-55caaebf-616e-4ccc-b600-f51391554cc3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:43.882938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] The token cache is being invalidate because project f28de2d034d447379c07db675577c03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:43.883373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:43.884913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:43.887556 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1449/2922] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:43 2022] DELETE /identity/v3/projects/f28de2d034d447379c07db675577c03f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:43.931866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:43.952204 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1474/2923] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:20:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:43.974714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:43.976518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:44.083500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caaebf-616e-4ccc-b600-f51391554cc3 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:44.091039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:44.097525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:44.098033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:44.099696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:44.119593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:44.121341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:44.133420 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1450/2924] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:20:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:44.783909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385547-adde-4429-9291-bd816a0bf515 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:44.784578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385547-adde-4429-9291-bd816a0bf515 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:44.784700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385547-adde-4429-9291-bd816a0bf515 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:44.790230 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1475/2925] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:44.798317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:44.800469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:44.828238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265d2fa-93ea-466a-a35c-3d7bff6be104 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:44.828565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265d2fa-93ea-466a-a35c-3d7bff6be104 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:44.828790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265d2fa-93ea-466a-a35c-3d7bff6be104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:44.860208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d265d2fa-93ea-466a-a35c-3d7bff6be104 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:44.861520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d265d2fa-93ea-466a-a35c-3d7bff6be104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:44.870777 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1476/2926] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:20:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:44.885469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265d2fa-93ea-466a-a35c-3d7bff6be104 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:44.900914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265d2fa-93ea-466a-a35c-3d7bff6be104 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:44.917167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac925fbe-902f-49bc-b97c-a3a5ef8f6f87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:44.918270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac925fbe-902f-49bc-b97c-a3a5ef8f6f87 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:44.918270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac925fbe-902f-49bc-b97c-a3a5ef8f6f87 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:44.918499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac925fbe-902f-49bc-b97c-a3a5ef8f6f87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:44.938301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac925fbe-902f-49bc-b97c-a3a5ef8f6f87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:44.940070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac925fbe-902f-49bc-b97c-a3a5ef8f6f87 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:44.958473 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1477/2927] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:20:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:20:44.961598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:44.963915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:45.024322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:45.102860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184e6f8-179b-4935-91a0-3effc4b8f5b7 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:45.108603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717330d-86d9-44b0-a849-2961dd6fe195 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:45.109384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717330d-86d9-44b0-a849-2961dd6fe195 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:45.109760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717330d-86d9-44b0-a849-2961dd6fe195 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:45.110219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717330d-86d9-44b0-a849-2961dd6fe195 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/79651d2c0f89490f8a3942f0bbcce583` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:45.111415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717330d-86d9-44b0-a849-2961dd6fe195 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=79651d2c0f89490f8a3942f0bbcce583)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:45.113587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717330d-86d9-44b0-a849-2961dd6fe195 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:45.115604 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1451/2928] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:44 2022] GET /identity/v3/projects/79651d2c0f89490f8a3942f0bbcce583 => generated 373 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:45.138528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac925fbe-902f-49bc-b97c-a3a5ef8f6f87 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:45.139486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717330d-86d9-44b0-a849-2961dd6fe195 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:45.140908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ac925fbe-902f-49bc-b97c-a3a5ef8f6f87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:45.154862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717330d-86d9-44b0-a849-2961dd6fe195 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:45.162296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8a3b2-c95e-4c5a-b8f1-eaedf1dcfabf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:45.163094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8a3b2-c95e-4c5a-b8f1-eaedf1dcfabf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:45.164206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8a3b2-c95e-4c5a-b8f1-eaedf1dcfabf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:45.164206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8a3b2-c95e-4c5a-b8f1-eaedf1dcfabf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:45.165358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8a3b2-c95e-4c5a-b8f1-eaedf1dcfabf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:45.165722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8a3b2-c95e-4c5a-b8f1-eaedf1dcfabf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:45.167837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8a3b2-c95e-4c5a-b8f1-eaedf1dcfabf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:45.187237 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1452/2929] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:20:45.188528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8a3b2-c95e-4c5a-b8f1-eaedf1dcfabf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:45.202739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8a3b2-c95e-4c5a-b8f1-eaedf1dcfabf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:45.208024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2bb34-b7a3-4756-8535-2327170c8339 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:45.208646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2bb34-b7a3-4756-8535-2327170c8339 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:45.208923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2bb34-b7a3-4756-8535-2327170c8339 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:45.209191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2bb34-b7a3-4756-8535-2327170c8339 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:45.209839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2bb34-b7a3-4756-8535-2327170c8339 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:45.212728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2bb34-b7a3-4756-8535-2327170c8339 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:45.279074 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1453/2930] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:45 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:45.279928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2bb34-b7a3-4756-8535-2327170c8339 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:45.300050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac925fbe-902f-49bc-b97c-a3a5ef8f6f87 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:45.432226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2bb34-b7a3-4756-8535-2327170c8339 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:45.439873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd989d2-f627-456f-9f0d-248978135b68 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:45.441026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd989d2-f627-456f-9f0d-248978135b68 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:45.441899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd989d2-f627-456f-9f0d-248978135b68 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:45.442411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd989d2-f627-456f-9f0d-248978135b68 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:45.443616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd989d2-f627-456f-9f0d-248978135b68 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:45.444079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd989d2-f627-456f-9f0d-248978135b68 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:45.446550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd989d2-f627-456f-9f0d-248978135b68 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:45.464405 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1454/2931] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:45.499019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:45.499019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:45.499019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:45.499019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] PATH_INFO: `/v3/users/0b7a042d5c364b9c972d503c3252bac4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:45.499594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b7a042d5c364b9c972d503c3252bac4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:45.501622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:45.596190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b7a042d5c364b9c972d503c3252bac4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:45.598149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b7a042d5c364b9c972d503c3252bac4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:45.614839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b7a042d5c364b9c972d503c3252bac4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:45.632239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b7a042d5c364b9c972d503c3252bac4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:45.648898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:45.665099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6a0ca681-d483-4f88-8d58-19352e029dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b7a042d5c364b9c972d503c3252bac4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:45.691065 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1478/2932] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:45 2022] DELETE /identity/v3/users/0b7a042d5c364b9c972d503c3252bac4 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:45.695537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c48a27-29d1-4412-90a2-09fc0614426d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:45.695821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c48a27-29d1-4412-90a2-09fc0614426d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:45.696154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c48a27-29d1-4412-90a2-09fc0614426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:45.710155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ef02-5369-41ba-9dc7-ba1cebc9ff40 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:45.710661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ef02-5369-41ba-9dc7-ba1cebc9ff40 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:45.711121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725ef02-5369-41ba-9dc7-ba1cebc9ff40 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:45.713376 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1479/2933] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:45.719932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725ef02-5369-41ba-9dc7-ba1cebc9ff40 None None] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:45.723409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7725ef02-5369-41ba-9dc7-ba1cebc9ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:45.729150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-68c48a27-29d1-4412-90a2-09fc0614426d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:45.730494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-68c48a27-29d1-4412-90a2-09fc0614426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:45.834672 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1455/2934] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:45.847028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c48a27-29d1-4412-90a2-09fc0614426d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:45.848798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-68c48a27-29d1-4412-90a2-09fc0614426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:45.895787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:45.921455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725ef02-5369-41ba-9dc7-ba1cebc9ff40 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:45.923984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7725ef02-5369-41ba-9dc7-ba1cebc9ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:45.965793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c48a27-29d1-4412-90a2-09fc0614426d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:45.974569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efc587-5ce8-454d-8e6b-0b44fa22f3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:45.975431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efc587-5ce8-454d-8e6b-0b44fa22f3de service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:45.977068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efc587-5ce8-454d-8e6b-0b44fa22f3de service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:45.977461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efc587-5ce8-454d-8e6b-0b44fa22f3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:45.997841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efc587-5ce8-454d-8e6b-0b44fa22f3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:46.002260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efc587-5ce8-454d-8e6b-0b44fa22f3de service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:46.038952 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1456/2935] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:46.106548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725ef02-5369-41ba-9dc7-ba1cebc9ff40 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:46.115070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae50e-eb57-4047-9187-cf212ec88416 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:46.118048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae50e-eb57-4047-9187-cf212ec88416 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:46.118699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae50e-eb57-4047-9187-cf212ec88416 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:46.119076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ae50e-eb57-4047-9187-cf212ec88416 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/bc80ad2f1cad4290afa706b096817570` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:46.121562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ae50e-eb57-4047-9187-cf212ec88416 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc80ad2f1cad4290afa706b096817570)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:46.128978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ae50e-eb57-4047-9187-cf212ec88416 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:46.133827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1480/2936] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:45 2022] GET /identity/v3/projects/bc80ad2f1cad4290afa706b096817570 => generated 371 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:20:46.446684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3023da-d2cb-463f-b446-8d42bb4c5622 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:46.447411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3023da-d2cb-463f-b446-8d42bb4c5622 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:46.447936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3023da-d2cb-463f-b446-8d42bb4c5622 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:46.451052 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1457/2937] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:46.458012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae50e-eb57-4047-9187-cf212ec88416 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:46.464435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-838ae50e-eb57-4047-9187-cf212ec88416 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:46.538015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae50e-eb57-4047-9187-cf212ec88416 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:46.573893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ae50e-eb57-4047-9187-cf212ec88416 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:46.586267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0c21-0b31-4205-a6ab-f2a8f7083586 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:46.587263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0c21-0b31-4205-a6ab-f2a8f7083586 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:46.587723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0c21-0b31-4205-a6ab-f2a8f7083586 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:46.588294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0c21-0b31-4205-a6ab-f2a8f7083586 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/bc80ad2f1cad4290afa706b096817570` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:46.604514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0c21-0b31-4205-a6ab-f2a8f7083586 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc80ad2f1cad4290afa706b096817570)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:46.607021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0c21-0b31-4205-a6ab-f2a8f7083586 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:46.609306 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1481/2938] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:46 2022] GET /identity/v3/projects/bc80ad2f1cad4290afa706b096817570 => generated 371 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:46.728998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3023da-d2cb-463f-b446-8d42bb4c5622 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:46.769323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3023da-d2cb-463f-b446-8d42bb4c5622 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:46.788798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39fb60-b836-4d0f-9b6e-77564680c764 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:46.790446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39fb60-b836-4d0f-9b6e-77564680c764 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:46.791805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39fb60-b836-4d0f-9b6e-77564680c764 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:46.793511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39fb60-b836-4d0f-9b6e-77564680c764 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:46.799410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0c21-0b31-4205-a6ab-f2a8f7083586 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:46.802800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1c6d0c21-0b31-4205-a6ab-f2a8f7083586 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:46.815074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39fb60-b836-4d0f-9b6e-77564680c764 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:46.817681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39fb60-b836-4d0f-9b6e-77564680c764 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:46.823009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39fb60-b836-4d0f-9b6e-77564680c764 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:46.842709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0c21-0b31-4205-a6ab-f2a8f7083586 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:46.863299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:46.867592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:46.867954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:46.868445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] PATH_INFO: `/v3/projects/b392188c8c93466cb564f6abab737839` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:46.873718 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1458/2939] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:46.876790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39fb60-b836-4d0f-9b6e-77564680c764 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:46.888624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b392188c8c93466cb564f6abab737839)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:46.890875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:46.913373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39fb60-b836-4d0f-9b6e-77564680c764 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:46.926252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213c3a-4f6f-418b-9d5d-ec08099a1931 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:46.926972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213c3a-4f6f-418b-9d5d-ec08099a1931 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:46.927334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213c3a-4f6f-418b-9d5d-ec08099a1931 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:46.927716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213c3a-4f6f-418b-9d5d-ec08099a1931 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:46.928443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213c3a-4f6f-418b-9d5d-ec08099a1931 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:46.931689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213c3a-4f6f-418b-9d5d-ec08099a1931 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:46.983972 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1459/2940] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:46 2022] POST /identity/v3/users => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:46.987165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213c3a-4f6f-418b-9d5d-ec08099a1931 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:47.012241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213c3a-4f6f-418b-9d5d-ec08099a1931 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:47.036284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b392188c8c93466cb564f6abab737839', 'request_id': 'req-b67704a8-e4be-4bef-83de-86a9a766b589'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:47.051433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b392188c8c93466cb564f6abab737839', 'request_id': 'req-b67704a8-e4be-4bef-83de-86a9a766b589'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:47.063866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b392188c8c93466cb564f6abab737839', 'request_id': 'req-b67704a8-e4be-4bef-83de-86a9a766b589'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:47.076178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:47.087114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] The token cache is being invalidate because project b392188c8c93466cb564f6abab737839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:47.087547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:47.093399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b67704a8-e4be-4bef-83de-86a9a766b589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:47.100122 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1482/2941] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:46 2022] DELETE /identity/v3/projects/b392188c8c93466cb564f6abab737839 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:47.117409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b633e-df3e-4fa4-96ae-fcf3e806c55e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.119482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b633e-df3e-4fa4-96ae-fcf3e806c55e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.119865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b633e-df3e-4fa4-96ae-fcf3e806c55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.152972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e086b-e2af-4652-8996-3531391f55bf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:47.155045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e086b-e2af-4652-8996-3531391f55bf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.156047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e086b-e2af-4652-8996-3531391f55bf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.157173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e086b-e2af-4652-8996-3531391f55bf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.158715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e086b-e2af-4652-8996-3531391f55bf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:47.159973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e086b-e2af-4652-8996-3531391f55bf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:47.163745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e086b-e2af-4652-8996-3531391f55bf tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:47.191350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-539b633e-df3e-4fa4-96ae-fcf3e806c55e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:47.195667 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1460/2942] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:47.198993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-539b633e-df3e-4fa4-96ae-fcf3e806c55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:47.275335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277d4af-5d5a-401e-82ef-a3b3b8af5b4d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.280442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277d4af-5d5a-401e-82ef-a3b3b8af5b4d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.281029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277d4af-5d5a-401e-82ef-a3b3b8af5b4d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.283723 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1461/2943] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:47.291017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277d4af-5d5a-401e-82ef-a3b3b8af5b4d None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:47.295013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1277d4af-5d5a-401e-82ef-a3b3b8af5b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:47.380295 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1483/2944] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:47.458205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53dd1e-212d-4b21-9c2f-af10a6b27314 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.458756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53dd1e-212d-4b21-9c2f-af10a6b27314 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.459218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53dd1e-212d-4b21-9c2f-af10a6b27314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.485407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9e53dd1e-212d-4b21-9c2f-af10a6b27314 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:47.487099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9e53dd1e-212d-4b21-9c2f-af10a6b27314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:47.496640 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1484/2945] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:47.502072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53dd1e-212d-4b21-9c2f-af10a6b27314 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:47.502922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277d4af-5d5a-401e-82ef-a3b3b8af5b4d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:47.505253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1277d4af-5d5a-401e-82ef-a3b3b8af5b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:47.515419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53dd1e-212d-4b21-9c2f-af10a6b27314 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:47.531250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5dfe8-f874-4538-b2ae-3a15985386c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:47.532295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5dfe8-f874-4538-b2ae-3a15985386c2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.532768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5dfe8-f874-4538-b2ae-3a15985386c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.533195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5dfe8-f874-4538-b2ae-3a15985386c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.534106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5dfe8-f874-4538-b2ae-3a15985386c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:47.534776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5dfe8-f874-4538-b2ae-3a15985386c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:47.536681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5dfe8-f874-4538-b2ae-3a15985386c2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:47.541368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277d4af-5d5a-401e-82ef-a3b3b8af5b4d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:47.557186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b739a39-cca2-4a4a-9ddc-659b81d9ad45 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:47.558200 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1485/2946] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:47.558534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b739a39-cca2-4a4a-9ddc-659b81d9ad45 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.559476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b739a39-cca2-4a4a-9ddc-659b81d9ad45 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.559780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5dfe8-f874-4538-b2ae-3a15985386c2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:47.560403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b739a39-cca2-4a4a-9ddc-659b81d9ad45 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/bc80ad2f1cad4290afa706b096817570` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.562638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b739a39-cca2-4a4a-9ddc-659b81d9ad45 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc80ad2f1cad4290afa706b096817570)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:47.567480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b739a39-cca2-4a4a-9ddc-659b81d9ad45 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:47.571728 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1462/2947] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:47 2022] GET /identity/v3/projects/bc80ad2f1cad4290afa706b096817570 => generated 371 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:20:47.573556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5dfe8-f874-4538-b2ae-3a15985386c2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:47.578651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602327b-7016-4e74-ba7b-4bc2f56209d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:47.580110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602327b-7016-4e74-ba7b-4bc2f56209d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.580624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602327b-7016-4e74-ba7b-4bc2f56209d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.581290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602327b-7016-4e74-ba7b-4bc2f56209d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.582169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602327b-7016-4e74-ba7b-4bc2f56209d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:47.584715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602327b-7016-4e74-ba7b-4bc2f56209d4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:47.626630 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1486/2948] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:47 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:47.628579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b739a39-cca2-4a4a-9ddc-659b81d9ad45 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:47.658401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b739a39-cca2-4a4a-9ddc-659b81d9ad45 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:47.690717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:47.785437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ea82f-a733-41d0-86ba-9be538948133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:47.790651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea82f-a733-41d0-86ba-9be538948133 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.793384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea82f-a733-41d0-86ba-9be538948133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.794218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ea82f-a733-41d0-86ba-9be538948133 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.795064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ea82f-a733-41d0-86ba-9be538948133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:47.803250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ea82f-a733-41d0-86ba-9be538948133 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:47.879217 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1463/2949] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:47 2022] POST /identity/v3/users => generated 300 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:47.883960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602327b-7016-4e74-ba7b-4bc2f56209d4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:47.893408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b94c26-99ca-4684-b8f4-ee356064209d None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.894298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b94c26-99ca-4684-b8f4-ee356064209d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.894982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b94c26-99ca-4684-b8f4-ee356064209d None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.896633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602327b-7016-4e74-ba7b-4bc2f56209d4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:47.897510 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1464/2950] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:20:47.905132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b94c26-99ca-4684-b8f4-ee356064209d None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:47.929241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d95f5-b057-44eb-831d-62473c8b6063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:47.929915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d95f5-b057-44eb-831d-62473c8b6063 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:47.930166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d95f5-b057-44eb-831d-62473c8b6063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:47.930528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d95f5-b057-44eb-831d-62473c8b6063 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:47.931069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d95f5-b057-44eb-831d-62473c8b6063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:47.932722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d95f5-b057-44eb-831d-62473c8b6063 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:48.002600 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1487/2951] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:48.006280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d95f5-b057-44eb-831d-62473c8b6063 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:48.044395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d95f5-b057-44eb-831d-62473c8b6063 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:48.065573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3353708-e6ff-4588-a727-ca8288d067dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:48.066420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3353708-e6ff-4588-a727-ca8288d067dd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:48.069437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3353708-e6ff-4588-a727-ca8288d067dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:48.069750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3353708-e6ff-4588-a727-ca8288d067dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:48.073408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3353708-e6ff-4588-a727-ca8288d067dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:48.078176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3353708-e6ff-4588-a727-ca8288d067dd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:48.092729 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1488/2952] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:48.098832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3353708-e6ff-4588-a727-ca8288d067dd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:48.158552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3353708-e6ff-4588-a727-ca8288d067dd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:48.191590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a4b50-22f1-424b-a09a-f4ea8d6182b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:48.196550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a4b50-22f1-424b-a09a-f4ea8d6182b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:48.197650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a4b50-22f1-424b-a09a-f4ea8d6182b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:48.198613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a4b50-22f1-424b-a09a-f4ea8d6182b8 admin admin] PATH_INFO: `/v3/projects/f873bf31c6ad40e1acac1e16c03e55bf/users/933e2c1b4da4460eb830777c8e27342f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:48.244132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a4b50-22f1-424b-a09a-f4ea8d6182b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f873bf31c6ad40e1acac1e16c03e55bf, user_id=933e2c1b4da4460eb830777c8e27342f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:48.252141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a4b50-22f1-424b-a09a-f4ea8d6182b8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:48.294982 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1489/2953] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:48 2022] PUT /identity/v3/projects/f873bf31c6ad40e1acac1e16c03e55bf/users/933e2c1b4da4460eb830777c8e27342f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:48.299737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb0872-fa99-4035-aa1e-428d46fcdedf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:48.300516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb0872-fa99-4035-aa1e-428d46fcdedf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:48.301029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb0872-fa99-4035-aa1e-428d46fcdedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:48.343173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b94c26-99ca-4684-b8f4-ee356064209d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:48.373756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f5bb0872-fa99-4035-aa1e-428d46fcdedf None None] MFA Rules not processed for user `933e2c1b4da4460eb830777c8e27342f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:48.375944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f5bb0872-fa99-4035-aa1e-428d46fcdedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:48.516043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b94c26-99ca-4684-b8f4-ee356064209d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:48.564679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:48.587958 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1490/2954] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:48.611445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb0872-fa99-4035-aa1e-428d46fcdedf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:48.613125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f5bb0872-fa99-4035-aa1e-428d46fcdedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:48.691981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:48.716975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2611aa-7c91-44d7-b1d9-b9ea6c979f1b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:48.718183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2611aa-7c91-44d7-b1d9-b9ea6c979f1b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:48.718518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2611aa-7c91-44d7-b1d9-b9ea6c979f1b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:48.718855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2611aa-7c91-44d7-b1d9-b9ea6c979f1b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/bc80ad2f1cad4290afa706b096817570` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:48.721673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2611aa-7c91-44d7-b1d9-b9ea6c979f1b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc80ad2f1cad4290afa706b096817570)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:48.729866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2611aa-7c91-44d7-b1d9-b9ea6c979f1b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:48.736954 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1465/2955] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:47 2022] GET /identity/v3/projects/bc80ad2f1cad4290afa706b096817570 => generated 371 bytes in 833 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:20:48.783625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2611aa-7c91-44d7-b1d9-b9ea6c979f1b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:48.799308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2611aa-7c91-44d7-b1d9-b9ea6c979f1b tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:48.805796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb0872-fa99-4035-aa1e-428d46fcdedf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:48.823037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:48.825320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:48.826545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:48.826545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/users/13afdbdc741a4967afa5bf7291f185f5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:48.836031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb13378-e47a-4690-952f-bbbadb609c61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:48.837752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb13378-e47a-4690-952f-bbbadb609c61 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:48.839083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb13378-e47a-4690-952f-bbbadb609c61 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:48.839464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb13378-e47a-4690-952f-bbbadb609c61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:48.860555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb13378-e47a-4690-952f-bbbadb609c61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:48.864200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb13378-e47a-4690-952f-bbbadb609c61 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:48.876786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:delete_user(user_id=13afdbdc741a4967afa5bf7291f185f5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:48.878917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:48.901458 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1491/2956] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:48.984159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13afdbdc741a4967afa5bf7291f185f5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.002147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb13378-e47a-4690-952f-bbbadb609c61 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:49.017058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13afdbdc741a4967afa5bf7291f185f5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.086091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13afdbdc741a4967afa5bf7291f185f5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.120409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13afdbdc741a4967afa5bf7291f185f5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.121541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13afdbdc741a4967afa5bf7291f185f5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.156478 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1466/2957] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:48 2022] DELETE /identity/v3/users/13afdbdc741a4967afa5bf7291f185f5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:49.161493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:49.164721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb13378-e47a-4690-952f-bbbadb609c61 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:49.168060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:49.358256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:49.360166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:49.360641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:49.361168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] PATH_INFO: `/v3/users/933e2c1b4da4460eb830777c8e27342f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:49.366952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=933e2c1b4da4460eb830777c8e27342f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:49.375661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:49.428884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c0f26-e90c-46e2-b615-45270b285cbb tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:49.447473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:49.449685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:49.450076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:49.450914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/bc80ad2f1cad4290afa706b096817570` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:49.454573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bc80ad2f1cad4290afa706b096817570)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:49.483145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:49.538543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:49.626750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933e2c1b4da4460eb830777c8e27342f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.629167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933e2c1b4da4460eb830777c8e27342f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.650905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933e2c1b4da4460eb830777c8e27342f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.702080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933e2c1b4da4460eb830777c8e27342f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.769383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-be3fd5fa-a055-4752-91ba-ce9008368c9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933e2c1b4da4460eb830777c8e27342f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.795737 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1492/2958] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:49 2022] DELETE /identity/v3/users/933e2c1b4da4460eb830777c8e27342f => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:49.804565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf404df-26d6-4ca2-b519-689401ccaef2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:49.805134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf404df-26d6-4ca2-b519-689401ccaef2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:49.805625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf404df-26d6-4ca2-b519-689401ccaef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:49.824682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc80ad2f1cad4290afa706b096817570', 'request_id': 'req-c78467f8-f4fd-49a5-a5de-4d56b464d88e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.865128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-acf404df-26d6-4ca2-b519-689401ccaef2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:49.868700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-acf404df-26d6-4ca2-b519-689401ccaef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:49.885446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc80ad2f1cad4290afa706b096817570', 'request_id': 'req-c78467f8-f4fd-49a5-a5de-4d56b464d88e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.888064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:49.926303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc80ad2f1cad4290afa706b096817570', 'request_id': 'req-c78467f8-f4fd-49a5-a5de-4d56b464d88e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.955660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] The token cache is being invalidate because project bc80ad2f1cad4290afa706b096817570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:49.955946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.959974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c78467f8-f4fd-49a5-a5de-4d56b464d88e tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:49.969801 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1467/2959] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:49 2022] DELETE /identity/v3/projects/bc80ad2f1cad4290afa706b096817570 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:50.000609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8dd97-7aad-49d3-bb92-90a9e2da8e27 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:50.001310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8dd97-7aad-49d3-bb92-90a9e2da8e27 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:50.001310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8dd97-7aad-49d3-bb92-90a9e2da8e27 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:50.002938 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1468/2960] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:50.015930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8dd97-7aad-49d3-bb92-90a9e2da8e27 None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:50.017927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f3f8dd97-7aad-49d3-bb92-90a9e2da8e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:50.030830 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1493/2961] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:50.042242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf404df-26d6-4ca2-b519-689401ccaef2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:50.046536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-acf404df-26d6-4ca2-b519-689401ccaef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:50.221470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf404df-26d6-4ca2-b519-689401ccaef2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:50.227430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1fac8-dd05-4094-9f10-57e4cab8d7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:50.228592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1fac8-dd05-4094-9f10-57e4cab8d7ee service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:50.228872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1fac8-dd05-4094-9f10-57e4cab8d7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:50.229148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1fac8-dd05-4094-9f10-57e4cab8d7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:50.272240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1fac8-dd05-4094-9f10-57e4cab8d7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:50.280911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1fac8-dd05-4094-9f10-57e4cab8d7ee service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:50.287320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8dd97-7aad-49d3-bb92-90a9e2da8e27 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:50.291376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f3f8dd97-7aad-49d3-bb92-90a9e2da8e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:50.305846 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1494/2962] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:50.492134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8dd97-7aad-49d3-bb92-90a9e2da8e27 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:50.507268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e761ec-4859-4aad-a417-853a2d723447 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:50.508393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e761ec-4859-4aad-a417-853a2d723447 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:50.509116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e761ec-4859-4aad-a417-853a2d723447 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:50.509396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e761ec-4859-4aad-a417-853a2d723447 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/79651d2c0f89490f8a3942f0bbcce583` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:50.511819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e761ec-4859-4aad-a417-853a2d723447 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=79651d2c0f89490f8a3942f0bbcce583)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:50.517814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e761ec-4859-4aad-a417-853a2d723447 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:50.534173 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1469/2963] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:50 2022] GET /identity/v3/projects/79651d2c0f89490f8a3942f0bbcce583 => generated 373 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:20:50.643956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa4aaa-2d18-498d-9c9b-75a49dd40402 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:50.644071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa4aaa-2d18-498d-9c9b-75a49dd40402 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:50.644336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa4aaa-2d18-498d-9c9b-75a49dd40402 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:50.646268 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1495/2964] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:50.654347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e761ec-4859-4aad-a417-853a2d723447 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:50.657104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-46e761ec-4859-4aad-a417-853a2d723447 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:50.719351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e761ec-4859-4aad-a417-853a2d723447 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:50.739219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e761ec-4859-4aad-a417-853a2d723447 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:50.749199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c82d-7a7a-4a44-ad57-413156263c96 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:50.750120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c82d-7a7a-4a44-ad57-413156263c96 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:50.750438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c82d-7a7a-4a44-ad57-413156263c96 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:50.750892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c82d-7a7a-4a44-ad57-413156263c96 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/79651d2c0f89490f8a3942f0bbcce583` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:50.753632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5c82d-7a7a-4a44-ad57-413156263c96 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=79651d2c0f89490f8a3942f0bbcce583)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:50.758972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5c82d-7a7a-4a44-ad57-413156263c96 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:50.762917 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1470/2965] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:50 2022] GET /identity/v3/projects/79651d2c0f89490f8a3942f0bbcce583 => generated 373 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:51.434645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31172-10de-4f0e-b4ec-f9693b2bb7fc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:51.435547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31172-10de-4f0e-b4ec-f9693b2bb7fc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:51.436040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d31172-10de-4f0e-b4ec-f9693b2bb7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:51.483299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-32d31172-10de-4f0e-b4ec-f9693b2bb7fc None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:51.484573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-32d31172-10de-4f0e-b4ec-f9693b2bb7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:51.507713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28267c6c-c8ec-4a95-9c65-e3c6f543e87f None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:51.508282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28267c6c-c8ec-4a95-9c65-e3c6f543e87f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:51.508282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28267c6c-c8ec-4a95-9c65-e3c6f543e87f None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:51.509622 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1471/2966] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:20:51.525936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28267c6c-c8ec-4a95-9c65-e3c6f543e87f None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:20:51.543767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28267c6c-c8ec-4a95-9c65-e3c6f543e87f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:51.556344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28267c6c-c8ec-4a95-9c65-e3c6f543e87f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:51.566386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fd2bb-391c-4f26-a49d-c214b56bfd65 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de497eaf77664f3bb0ed3c1e615157bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76493ddc50dd48baaa54e341997c7555', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:51.567538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fd2bb-391c-4f26-a49d-c214b56bfd65 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:51.569227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fd2bb-391c-4f26-a49d-c214b56bfd65 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:51.569815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fd2bb-391c-4f26-a49d-c214b56bfd65 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] PATH_INFO: `/v3/projects/79651d2c0f89490f8a3942f0bbcce583` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:51.575744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fd2bb-391c-4f26-a49d-c214b56bfd65 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorizing `identity:get_project(project_id=79651d2c0f89490f8a3942f0bbcce583)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:51.579177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fd2bb-391c-4f26-a49d-c214b56bfd65 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:51.586910 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1472/2967] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:20:51 2022] GET /identity/v3/projects/79651d2c0f89490f8a3942f0bbcce583 => generated 373 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:51.615566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fd2bb-391c-4f26-a49d-c214b56bfd65 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:51.618026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-315fd2bb-391c-4f26-a49d-c214b56bfd65 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:51.620986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:51.651868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fd2bb-391c-4f26-a49d-c214b56bfd65 tempest-QuotasAdminTestJSON-1930517636 tempest-QuotasAdminTestJSON-1930517636-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:51.656646 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1496/2968] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:20:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:51.674208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d31172-10de-4f0e-b4ec-f9693b2bb7fc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:51.676892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-32d31172-10de-4f0e-b4ec-f9693b2bb7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:51.689398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:51.690559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:51.691098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:51.691606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] PATH_INFO: `/v3/projects/f873bf31c6ad40e1acac1e16c03e55bf` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:51.700050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f873bf31c6ad40e1acac1e16c03e55bf)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:51.702805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:51.828120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f873bf31c6ad40e1acac1e16c03e55bf', 'request_id': 'req-b81af88b-db99-4065-9b24-45e0efd6fc1a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:51.854504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f873bf31c6ad40e1acac1e16c03e55bf', 'request_id': 'req-b81af88b-db99-4065-9b24-45e0efd6fc1a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:51.857280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:51.872356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f873bf31c6ad40e1acac1e16c03e55bf', 'request_id': 'req-b81af88b-db99-4065-9b24-45e0efd6fc1a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:51.900907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] The token cache is being invalidate because project f873bf31c6ad40e1acac1e16c03e55bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:51.901175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:51.902646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b81af88b-db99-4065-9b24-45e0efd6fc1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:51.916723 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1473/2969] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:51 2022] DELETE /identity/v3/projects/f873bf31c6ad40e1acac1e16c03e55bf => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:20:51.918472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03a5b6-01c7-42f1-a4ae-21afdecbb380 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:51.918795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03a5b6-01c7-42f1-a4ae-21afdecbb380 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:51.919094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03a5b6-01c7-42f1-a4ae-21afdecbb380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:51.938817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d31172-10de-4f0e-b4ec-f9693b2bb7fc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:51.964376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fd03a5b6-01c7-42f1-a4ae-21afdecbb380 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:51.967740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fd03a5b6-01c7-42f1-a4ae-21afdecbb380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:52.065952 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1474/2970] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:52.068520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a511f67-9cbe-4650-a3be-6c6267b37c74 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:52.072061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a511f67-9cbe-4650-a3be-6c6267b37c74 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:52.073637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a511f67-9cbe-4650-a3be-6c6267b37c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:52.150194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d7c71-3d80-45dc-8a5b-cb2940d72ce1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:52.151901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d7c71-3d80-45dc-8a5b-cb2940d72ce1 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:52.154401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d7c71-3d80-45dc-8a5b-cb2940d72ce1 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:52.155014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d7c71-3d80-45dc-8a5b-cb2940d72ce1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:52.157977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-823d7c71-3d80-45dc-8a5b-cb2940d72ce1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:52.186712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4a511f67-9cbe-4650-a3be-6c6267b37c74 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:52.192990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4a511f67-9cbe-4650-a3be-6c6267b37c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:52.215820 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1475/2971] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:52.224183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a511f67-9cbe-4650-a3be-6c6267b37c74 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:52.260998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a511f67-9cbe-4650-a3be-6c6267b37c74 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:52.280432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16d636-0d8b-42cb-8e4b-9996d4193c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:52.282558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16d636-0d8b-42cb-8e4b-9996d4193c49 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:52.283041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16d636-0d8b-42cb-8e4b-9996d4193c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:52.284311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16d636-0d8b-42cb-8e4b-9996d4193c49 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:52.286113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16d636-0d8b-42cb-8e4b-9996d4193c49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:52.287015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16d636-0d8b-42cb-8e4b-9996d4193c49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:52.305540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16d636-0d8b-42cb-8e4b-9996d4193c49 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:52.312224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d7c71-3d80-45dc-8a5b-cb2940d72ce1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:52.314354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d7c71-3d80-45dc-8a5b-cb2940d72ce1 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:52.325259 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1497/2972] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:20:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:20:52.346464 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1476/2973] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:52.352310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d7c71-3d80-45dc-8a5b-cb2940d72ce1 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:52.371460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d7c71-3d80-45dc-8a5b-cb2940d72ce1 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:52.389613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16d636-0d8b-42cb-8e4b-9996d4193c49 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:52.392798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb09a34-a0b6-4e10-a707-cc2087fd1e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:52.393796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb09a34-a0b6-4e10-a707-cc2087fd1e7c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:52.395897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb09a34-a0b6-4e10-a707-cc2087fd1e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:52.396487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb09a34-a0b6-4e10-a707-cc2087fd1e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:52.397150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ae16d636-0d8b-42cb-8e4b-9996d4193c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:52.398395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb09a34-a0b6-4e10-a707-cc2087fd1e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:52.410686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb09a34-a0b6-4e10-a707-cc2087fd1e7c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:52.432068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16d636-0d8b-42cb-8e4b-9996d4193c49 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:52.456281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:52.457021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:52.459133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:52.459457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] PATH_INFO: `/v3/users/9c333fc89a2348eba7f8b5e9c6f651f2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:52.461038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c333fc89a2348eba7f8b5e9c6f651f2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:52.463432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:52.558729 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1498/2974] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:52 2022] POST /identity/v3/projects => generated 379 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:52.564352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb09a34-a0b6-4e10-a707-cc2087fd1e7c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:52.611803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c333fc89a2348eba7f8b5e9c6f651f2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:52.628242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c333fc89a2348eba7f8b5e9c6f651f2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:52.657319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:52.670285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c333fc89a2348eba7f8b5e9c6f651f2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:52.705799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c333fc89a2348eba7f8b5e9c6f651f2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:52.706597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b8febd79-8c53-4218-977b-c71a6b18f0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c333fc89a2348eba7f8b5e9c6f651f2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:52.724504 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1477/2975] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:52 2022] DELETE /identity/v3/users/9c333fc89a2348eba7f8b5e9c6f651f2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:52.731493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d4a16-67f0-4d20-9e23-ace5c81105d3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:52.732168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d4a16-67f0-4d20-9e23-ace5c81105d3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:52.732605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d4a16-67f0-4d20-9e23-ace5c81105d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:52.787735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-961d4a16-67f0-4d20-9e23-ace5c81105d3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:52.790611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb09a34-a0b6-4e10-a707-cc2087fd1e7c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:52.791742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-961d4a16-67f0-4d20-9e23-ace5c81105d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:52.884796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:52.965235 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1478/2976] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:20:52.992704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d4a16-67f0-4d20-9e23-ace5c81105d3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:52.995692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-961d4a16-67f0-4d20-9e23-ace5c81105d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:53.059255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1f35a-2a1f-4729-b2f3-ebafce10ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:53.059916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1f35a-2a1f-4729-b2f3-ebafce10ab3a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:53.060314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1f35a-2a1f-4729-b2f3-ebafce10ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:53.060892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1f35a-2a1f-4729-b2f3-ebafce10ab3a admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:53.061630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1f35a-2a1f-4729-b2f3-ebafce10ab3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:53.063913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1f35a-2a1f-4729-b2f3-ebafce10ab3a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:53.111232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d4a16-67f0-4d20-9e23-ace5c81105d3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:53.115739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab45d3-4a37-4ead-8407-5e99f58476e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:53.116448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab45d3-4a37-4ead-8407-5e99f58476e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:53.117206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab45d3-4a37-4ead-8407-5e99f58476e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:53.117474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab45d3-4a37-4ead-8407-5e99f58476e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:53.128307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab45d3-4a37-4ead-8407-5e99f58476e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:53.129694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab45d3-4a37-4ead-8407-5e99f58476e9 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:53.141448 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1479/2977] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:20:53.152675 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1499/2978] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:52 2022] POST /identity/v3/users => generated 290 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:53.157380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab45d3-4a37-4ead-8407-5e99f58476e9 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:53.160996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-00ab45d3-4a37-4ead-8407-5e99f58476e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:53.184457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab45d3-4a37-4ead-8407-5e99f58476e9 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:53.191027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302f98d-429c-42bc-8571-d843d86fcf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:53.191654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302f98d-429c-42bc-8571-d843d86fcf41 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:53.191924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302f98d-429c-42bc-8571-d843d86fcf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:53.192193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302f98d-429c-42bc-8571-d843d86fcf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:53.192845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302f98d-429c-42bc-8571-d843d86fcf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:53.194595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302f98d-429c-42bc-8571-d843d86fcf41 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:53.212639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1f35a-2a1f-4729-b2f3-ebafce10ab3a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:53.223300 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1480/2979] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:53.225198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1f35a-2a1f-4729-b2f3-ebafce10ab3a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:53.231952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35115aaf-c94c-4211-8b85-d1d9cd654123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:53.233133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115aaf-c94c-4211-8b85-d1d9cd654123 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:53.233321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115aaf-c94c-4211-8b85-d1d9cd654123 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:53.233664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35115aaf-c94c-4211-8b85-d1d9cd654123 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:53.234497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35115aaf-c94c-4211-8b85-d1d9cd654123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:53.237797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35115aaf-c94c-4211-8b85-d1d9cd654123 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:53.259757 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1500/2980] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:53.265186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302f98d-429c-42bc-8571-d843d86fcf41 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:53.290541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302f98d-429c-42bc-8571-d843d86fcf41 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:53.299658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180408f-fba2-46a5-8182-a374dabdbb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:53.300984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180408f-fba2-46a5-8182-a374dabdbb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:53.301380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180408f-fba2-46a5-8182-a374dabdbb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:53.301688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180408f-fba2-46a5-8182-a374dabdbb6b admin admin] PATH_INFO: `/v3/projects/cca7040daf57463e9ccabccb8b86dcdd/users/68242b2f7fc447278230f48eaee28396/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:53.331449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180408f-fba2-46a5-8182-a374dabdbb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca7040daf57463e9ccabccb8b86dcdd, user_id=68242b2f7fc447278230f48eaee28396, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:53.334269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180408f-fba2-46a5-8182-a374dabdbb6b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:53.385741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924cd6-3553-4676-bafb-0c089db02b9e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:53.386018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924cd6-3553-4676-bafb-0c089db02b9e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:53.386218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c924cd6-3553-4676-bafb-0c089db02b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:53.389451 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1481/2981] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:53 2022] PUT /identity/v3/projects/cca7040daf57463e9ccabccb8b86dcdd/users/68242b2f7fc447278230f48eaee28396/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:53.423698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9c924cd6-3553-4676-bafb-0c089db02b9e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:53.424965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9c924cd6-3553-4676-bafb-0c089db02b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:53.682035 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1501/2982] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:53.716990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180408f-fba2-46a5-8182-a374dabdbb6b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:53.863156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180408f-fba2-46a5-8182-a374dabdbb6b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:53.873100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c057ee-5cc8-4752-a438-fbf775f685ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:53.873852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c057ee-5cc8-4752-a438-fbf775f685ca service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:53.874161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c057ee-5cc8-4752-a438-fbf775f685ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:53.874676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c057ee-5cc8-4752-a438-fbf775f685ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:53.922927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c057ee-5cc8-4752-a438-fbf775f685ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:53.926394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c057ee-5cc8-4752-a438-fbf775f685ca service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:53.962813 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1482/2983] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:54.022646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c924cd6-3553-4676-bafb-0c089db02b9e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:54.034427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9c924cd6-3553-4676-bafb-0c089db02b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:54.231700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c924cd6-3553-4676-bafb-0c089db02b9e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:54.247939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:54.251101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:54.253121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:54.254314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] PATH_INFO: `/v3/projects/79651d2c0f89490f8a3942f0bbcce583` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:54.259337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79651d2c0f89490f8a3942f0bbcce583)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:54.269381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:54.439332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:54.474650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79651d2c0f89490f8a3942f0bbcce583', 'request_id': 'req-3f71e76a-eb6d-4036-861b-7be60e599062'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:54.503588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79651d2c0f89490f8a3942f0bbcce583', 'request_id': 'req-3f71e76a-eb6d-4036-861b-7be60e599062'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:54.526838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79651d2c0f89490f8a3942f0bbcce583', 'request_id': 'req-3f71e76a-eb6d-4036-861b-7be60e599062'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:54.565445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] The token cache is being invalidate because project 79651d2c0f89490f8a3942f0bbcce583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:54.565806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:54.568781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:54.583490 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1502/2984] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:54 2022] DELETE /identity/v3/projects/79651d2c0f89490f8a3942f0bbcce583 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:54.584679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c057ee-5cc8-4752-a438-fbf775f685ca service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:54.599889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c057ee-5cc8-4752-a438-fbf775f685ca service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:54.834671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:54.859287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:54.859991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:54.860788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:54.861064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] PATH_INFO: `/v3/users/de497eaf77664f3bb0ed3c1e615157bd` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:54.865068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de497eaf77664f3bb0ed3c1e615157bd)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:54.869376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:55.233497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de497eaf77664f3bb0ed3c1e615157bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:55.267686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de497eaf77664f3bb0ed3c1e615157bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:55.311911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de497eaf77664f3bb0ed3c1e615157bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:55.336629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de497eaf77664f3bb0ed3c1e615157bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:55.338044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-31605bea-414d-4106-9d30-136e2ad9bd33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de497eaf77664f3bb0ed3c1e615157bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:55.355594 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1483/2985] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:20:54 2022] DELETE /identity/v3/users/de497eaf77664f3bb0ed3c1e615157bd => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:20:57.253550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:57.255837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:57.298514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71e76a-eb6d-4036-861b-7be60e599062 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:57.502623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:57.503703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:57.504152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:57.504589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] PATH_INFO: `/v3/projects/76493ddc50dd48baaa54e341997c7555` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:57.522398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76493ddc50dd48baaa54e341997c7555)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:57.524525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:57.710130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76493ddc50dd48baaa54e341997c7555', 'request_id': 'req-7ffafc98-f238-44fd-b989-b38caa04980e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:57.745057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76493ddc50dd48baaa54e341997c7555', 'request_id': 'req-7ffafc98-f238-44fd-b989-b38caa04980e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:57.776711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76493ddc50dd48baaa54e341997c7555', 'request_id': 'req-7ffafc98-f238-44fd-b989-b38caa04980e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:57.840690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] The token cache is being invalidate because project 76493ddc50dd48baaa54e341997c7555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:20:57.841978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:57.843700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ffafc98-f238-44fd-b989-b38caa04980e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:20:57.848869 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1503/2986] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:57 2022] DELETE /identity/v3/projects/76493ddc50dd48baaa54e341997c7555 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:57.855444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e37cf-f0ab-45b9-8af4-dc106a4d730e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:57.857742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e37cf-f0ab-45b9-8af4-dc106a4d730e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:57.858345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e37cf-f0ab-45b9-8af4-dc106a4d730e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:57.948242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c61e37cf-f0ab-45b9-8af4-dc106a4d730e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:57.954039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c61e37cf-f0ab-45b9-8af4-dc106a4d730e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:58.183731 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1484/2987] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:58.192275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45438e-be68-4b34-931f-84552e6e49f7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:58.192990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45438e-be68-4b34-931f-84552e6e49f7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:58.193466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45438e-be68-4b34-931f-84552e6e49f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:58.257267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-eb45438e-be68-4b34-931f-84552e6e49f7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:58.262406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eb45438e-be68-4b34-931f-84552e6e49f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:58.288877 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1504/2988] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:58.290103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e37cf-f0ab-45b9-8af4-dc106a4d730e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:58.334587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e37cf-f0ab-45b9-8af4-dc106a4d730e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:58.342462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54839a0f-be1a-4550-a734-28ff466d39c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:58.343575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54839a0f-be1a-4550-a734-28ff466d39c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:58.346572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54839a0f-be1a-4550-a734-28ff466d39c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:58.346572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54839a0f-be1a-4550-a734-28ff466d39c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:58.347855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54839a0f-be1a-4550-a734-28ff466d39c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:20:58.348614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54839a0f-be1a-4550-a734-28ff466d39c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:58.353689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54839a0f-be1a-4550-a734-28ff466d39c1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:58.390580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45438e-be68-4b34-931f-84552e6e49f7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:58.396715 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1485/2989] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:20:58.403013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45438e-be68-4b34-931f-84552e6e49f7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:58.408438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3613b-1000-4f59-acdb-1f2705ec47db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:58.409554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3613b-1000-4f59-acdb-1f2705ec47db admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:58.409972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3613b-1000-4f59-acdb-1f2705ec47db admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:58.410504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3613b-1000-4f59-acdb-1f2705ec47db admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:58.411274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3613b-1000-4f59-acdb-1f2705ec47db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:58.413821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3613b-1000-4f59-acdb-1f2705ec47db admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:58.480405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54839a0f-be1a-4550-a734-28ff466d39c1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:58.487556 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1505/2990] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:58 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:58.493923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54839a0f-be1a-4550-a734-28ff466d39c1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:58.725319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:58.756207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8b9b2-9c0a-406a-9f4a-911ec31aa9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:58.757410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8b9b2-9c0a-406a-9f4a-911ec31aa9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:58.758707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8b9b2-9c0a-406a-9f4a-911ec31aa9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:58.758707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8b9b2-9c0a-406a-9f4a-911ec31aa9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:58.765027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8b9b2-9c0a-406a-9f4a-911ec31aa9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:58.783161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8b9b2-9c0a-406a-9f4a-911ec31aa9f1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:58.856360 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1486/2991] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:20:58 2022] POST /identity/v3/users => generated 289 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:20:58.860478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3613b-1000-4f59-acdb-1f2705ec47db admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:58.875436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3613b-1000-4f59-acdb-1f2705ec47db admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:58.901349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7774a-6b23-48a7-a670-b48c10b0290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:58.901918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7774a-6b23-48a7-a670-b48c10b0290d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:58.902298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7774a-6b23-48a7-a670-b48c10b0290d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:58.904267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7774a-6b23-48a7-a670-b48c10b0290d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:58.905321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7774a-6b23-48a7-a670-b48c10b0290d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:58.907513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7774a-6b23-48a7-a670-b48c10b0290d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:58.951153 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1506/2992] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:20:58.952039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8b9b2-9c0a-406a-9f4a-911ec31aa9f1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:59.001509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8b9b2-9c0a-406a-9f4a-911ec31aa9f1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:59.045391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c1a52-9dbe-4543-bd06-a445590eae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:59.048565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c1a52-9dbe-4543-bd06-a445590eae4b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:59.053081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c1a52-9dbe-4543-bd06-a445590eae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:59.053981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c1a52-9dbe-4543-bd06-a445590eae4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:59.062770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c1a52-9dbe-4543-bd06-a445590eae4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:59.065923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c1a52-9dbe-4543-bd06-a445590eae4b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:59.123910 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1487/2993] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:20:59.128190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7774a-6b23-48a7-a670-b48c10b0290d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:59.141958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7774a-6b23-48a7-a670-b48c10b0290d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:59.169955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8066bd-0ffd-4919-bbfd-73917ac4692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:59.171500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8066bd-0ffd-4919-bbfd-73917ac4692d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:59.172235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8066bd-0ffd-4919-bbfd-73917ac4692d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:59.174045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8066bd-0ffd-4919-bbfd-73917ac4692d admin admin] PATH_INFO: `/v3/projects/37439939450b4b95bbe7b296aff1db5c/users/2a5173c820ae4a5bb16d6c5fd4251373/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:59.244943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8066bd-0ffd-4919-bbfd-73917ac4692d admin admin] RBAC: Authorizing `identity:create_grant(project_id=37439939450b4b95bbe7b296aff1db5c, user_id=2a5173c820ae4a5bb16d6c5fd4251373, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:59.247803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8066bd-0ffd-4919-bbfd-73917ac4692d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:20:59.254469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:59.288380 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1507/2994] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:20:59 2022] PUT /identity/v3/projects/37439939450b4b95bbe7b296aff1db5c/users/2a5173c820ae4a5bb16d6c5fd4251373/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:20:59.301998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaafce-4e92-472a-9a56-e564ccf89a68 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:59.303111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaafce-4e92-472a-9a56-e564ccf89a68 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:59.303830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eaafce-4e92-472a-9a56-e564ccf89a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:59.421504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b9eaafce-4e92-472a-9a56-e564ccf89a68 None None] MFA Rules not processed for user `2a5173c820ae4a5bb16d6c5fd4251373`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:20:59.423485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b9eaafce-4e92-472a-9a56-e564ccf89a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:20:59.736571 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1488/2995] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:20:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:20:59.745543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8066bd-0ffd-4919-bbfd-73917ac4692d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:20:59.943180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8066bd-0ffd-4919-bbfd-73917ac4692d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:20:59.962873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129225e1-8ace-45e7-8886-a394e15d86ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:20:59.965167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129225e1-8ace-45e7-8886-a394e15d86ae admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:20:59.965781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129225e1-8ace-45e7-8886-a394e15d86ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:20:59.966362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129225e1-8ace-45e7-8886-a394e15d86ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:20:59.967327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129225e1-8ace-45e7-8886-a394e15d86ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:20:59.971000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129225e1-8ace-45e7-8886-a394e15d86ae admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:00.071778 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1508/2996] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:20:59 2022] POST /identity/v3/projects => generated 379 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:21:00.076871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaafce-4e92-472a-9a56-e564ccf89a68 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:00.125222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eaafce-4e92-472a-9a56-e564ccf89a68 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:00.433720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41af23-e0d3-4d7c-a10c-408061c22989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:00.434198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41af23-e0d3-4d7c-a10c-408061c22989 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:00.434475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41af23-e0d3-4d7c-a10c-408061c22989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:00.434745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41af23-e0d3-4d7c-a10c-408061c22989 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:00.435418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41af23-e0d3-4d7c-a10c-408061c22989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:00.437464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41af23-e0d3-4d7c-a10c-408061c22989 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:00.548107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129225e1-8ace-45e7-8886-a394e15d86ae admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:00.552204 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1489/2997] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:21:00 2022] POST /identity/v3/users => generated 296 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:21:00.570160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129225e1-8ace-45e7-8886-a394e15d86ae admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:00.585655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b69c3-21df-4d6d-867a-4115750ec701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:00.586741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b69c3-21df-4d6d-867a-4115750ec701 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:00.587208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b69c3-21df-4d6d-867a-4115750ec701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:00.587652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b69c3-21df-4d6d-867a-4115750ec701 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:00.588518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b69c3-21df-4d6d-867a-4115750ec701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:00.590533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b69c3-21df-4d6d-867a-4115750ec701 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:00.624694 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1509/2998] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:21:00.628682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41af23-e0d3-4d7c-a10c-408061c22989 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:00.661319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41af23-e0d3-4d7c-a10c-408061c22989 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:00.712135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20225a96-da51-4a2e-9309-21de7d8b5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:00.718483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20225a96-da51-4a2e-9309-21de7d8b5c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:00.719316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20225a96-da51-4a2e-9309-21de7d8b5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:00.723751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20225a96-da51-4a2e-9309-21de7d8b5c67 admin admin] PATH_INFO: `/v3/projects/5cfeb9c2b0604572bf0eb2e6d0de2209/users/a3a4ddf327254e2fba72baf719b29c03/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:00.791950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20225a96-da51-4a2e-9309-21de7d8b5c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfeb9c2b0604572bf0eb2e6d0de2209, user_id=a3a4ddf327254e2fba72baf719b29c03, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:00.794871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20225a96-da51-4a2e-9309-21de7d8b5c67 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:00.851623 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1490/2999] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:21:00 2022] PUT /identity/v3/projects/5cfeb9c2b0604572bf0eb2e6d0de2209/users/a3a4ddf327254e2fba72baf719b29c03/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:00.856959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b69c3-21df-4d6d-867a-4115750ec701 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:00.885346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b69c3-21df-4d6d-867a-4115750ec701 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:01.024855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b2564-09b1-4850-afb3-139086efe31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:01.025920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2564-09b1-4850-afb3-139086efe31b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:01.026169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2564-09b1-4850-afb3-139086efe31b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:01.026435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b2564-09b1-4850-afb3-139086efe31b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:01.035582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b2564-09b1-4850-afb3-139086efe31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:01.037458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b2564-09b1-4850-afb3-139086efe31b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:01.064941 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1510/3000] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:21:01.071114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20225a96-da51-4a2e-9309-21de7d8b5c67 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:01.087268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20225a96-da51-4a2e-9309-21de7d8b5c67 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:01.145117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a291-9f00-490e-b199-1c1b62b461fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:01.154715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a291-9f00-490e-b199-1c1b62b461fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:01.155794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a291-9f00-490e-b199-1c1b62b461fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:01.156521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60a291-9f00-490e-b199-1c1b62b461fd admin admin] PATH_INFO: `/v3/projects/5cfeb9c2b0604572bf0eb2e6d0de2209/users/a3a4ddf327254e2fba72baf719b29c03/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:01.159692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60a291-9f00-490e-b199-1c1b62b461fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfeb9c2b0604572bf0eb2e6d0de2209, user_id=a3a4ddf327254e2fba72baf719b29c03, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:01.174637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60a291-9f00-490e-b199-1c1b62b461fd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:01.259238 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1491/3001] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:21:01 2022] PUT /identity/v3/projects/5cfeb9c2b0604572bf0eb2e6d0de2209/users/a3a4ddf327254e2fba72baf719b29c03/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:21:01.261692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ada71-5026-4447-a112-d90749d5938e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:01.262219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ada71-5026-4447-a112-d90749d5938e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:01.262669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ada71-5026-4447-a112-d90749d5938e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:01.369558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d07ada71-5026-4447-a112-d90749d5938e None None] MFA Rules not processed for user `a3a4ddf327254e2fba72baf719b29c03`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:01.370889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d07ada71-5026-4447-a112-d90749d5938e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:01.527283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:01.602143 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1511/3002] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:02.121977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a291-9f00-490e-b199-1c1b62b461fd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:02.125185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6e60a291-9f00-490e-b199-1c1b62b461fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:02.233583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:02.424976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60a291-9f00-490e-b199-1c1b62b461fd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:02.452021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc52da5-3816-4c2d-a52e-1cbbe2e6bff7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:02.452976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc52da5-3816-4c2d-a52e-1cbbe2e6bff7 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:02.454602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc52da5-3816-4c2d-a52e-1cbbe2e6bff7 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:02.455959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc52da5-3816-4c2d-a52e-1cbbe2e6bff7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:02.490086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc52da5-3816-4c2d-a52e-1cbbe2e6bff7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:02.492256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc52da5-3816-4c2d-a52e-1cbbe2e6bff7 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:02.509779 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1492/3003] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:03.229667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ada71-5026-4447-a112-d90749d5938e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:03.397472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ada71-5026-4447-a112-d90749d5938e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:03.425747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:03.426533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:03.426814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:03.427121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] PATH_INFO: `/v3/users/2a5173c820ae4a5bb16d6c5fd4251373` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:03.431633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5173c820ae4a5bb16d6c5fd4251373)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:03.436891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:03.570207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5173c820ae4a5bb16d6c5fd4251373'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:03.571958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5173c820ae4a5bb16d6c5fd4251373'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:03.590786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5173c820ae4a5bb16d6c5fd4251373'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:03.616405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5173c820ae4a5bb16d6c5fd4251373'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:03.660688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5173c820ae4a5bb16d6c5fd4251373'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:03.693683 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1512/3004] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:21:03 2022] DELETE /identity/v3/users/2a5173c820ae4a5bb16d6c5fd4251373 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:03.697225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb18da-6738-4947-a05c-b0fed0288c26 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:03.697985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb18da-6738-4947-a05c-b0fed0288c26 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:03.697985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb18da-6738-4947-a05c-b0fed0288c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:03.770057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3cfb18da-6738-4947-a05c-b0fed0288c26 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:03.771377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3cfb18da-6738-4947-a05c-b0fed0288c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:03.984796 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1493/3005] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:04.147976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:04.149781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:04.373485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8907d66-0e8f-4aa1-a70a-9c8474bf0bdc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:04.393225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7038666-a5a0-47c0-8890-b6cb97cb8e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:04.394305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038666-a5a0-47c0-8890-b6cb97cb8e22 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:04.394835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038666-a5a0-47c0-8890-b6cb97cb8e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:04.396848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7038666-a5a0-47c0-8890-b6cb97cb8e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:04.437914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038666-a5a0-47c0-8890-b6cb97cb8e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:04.439909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7038666-a5a0-47c0-8890-b6cb97cb8e22 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:04.479565 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1513/3006] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:06.901373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb18da-6738-4947-a05c-b0fed0288c26 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:06.902912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3cfb18da-6738-4947-a05c-b0fed0288c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:06.946533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb18da-6738-4947-a05c-b0fed0288c26 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:06.974260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:06.974942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:06.975222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:06.975500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] PATH_INFO: `/v3/projects/37439939450b4b95bbe7b296aff1db5c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:06.977560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37439939450b4b95bbe7b296aff1db5c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:06.983175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:07.023072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa967b4-f3c4-4d3c-a36b-7e44b9880108 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:07.024026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa967b4-f3c4-4d3c-a36b-7e44b9880108 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:07.024310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa967b4-f3c4-4d3c-a36b-7e44b9880108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:07.114815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:07.137133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cfa967b4-f3c4-4d3c-a36b-7e44b9880108 None None] MFA Rules not processed for user `68242b2f7fc447278230f48eaee28396`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:07.144215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cfa967b4-f3c4-4d3c-a36b-7e44b9880108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:07.232809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37439939450b4b95bbe7b296aff1db5c', 'request_id': 'req-6927cc9a-d510-472e-8368-f770a071a625'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:07.274630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37439939450b4b95bbe7b296aff1db5c', 'request_id': 'req-6927cc9a-d510-472e-8368-f770a071a625'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:07.287300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37439939450b4b95bbe7b296aff1db5c', 'request_id': 'req-6927cc9a-d510-472e-8368-f770a071a625'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:07.328517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] The token cache is being invalidate because project 37439939450b4b95bbe7b296aff1db5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:21:07.328808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:07.334178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:07.336943 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1494/3007] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:06 2022] DELETE /identity/v3/projects/37439939450b4b95bbe7b296aff1db5c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:07.344257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:07.350378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:07.364254 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1514/3008] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:07.426683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:07.594751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927cc9a-d510-472e-8368-f770a071a625 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:07.613452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:07.616979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:07.617411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:07.618565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] PATH_INFO: `/v3/users/a3a4ddf327254e2fba72baf719b29c03` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:07.620977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a4ddf327254e2fba72baf719b29c03)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:07.628958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:07.699476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa967b4-f3c4-4d3c-a36b-7e44b9880108 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:07.701576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cfa967b4-f3c4-4d3c-a36b-7e44b9880108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:07.760410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a4ddf327254e2fba72baf719b29c03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:07.790077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a4ddf327254e2fba72baf719b29c03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:07.831158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a4ddf327254e2fba72baf719b29c03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:07.853469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a4ddf327254e2fba72baf719b29c03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:07.854164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a4ddf327254e2fba72baf719b29c03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:07.863050 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1495/3009] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:21:07 2022] DELETE /identity/v3/users/a3a4ddf327254e2fba72baf719b29c03 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:07.982614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa967b4-f3c4-4d3c-a36b-7e44b9880108 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:08.104355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbd36b-058e-4ce9-bf68-6bca966f9518 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:08.106736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbd36b-058e-4ce9-bf68-6bca966f9518 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:08.107499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbd36b-058e-4ce9-bf68-6bca966f9518 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:08.108236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbd36b-058e-4ce9-bf68-6bca966f9518 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:08.110825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c8dbd36b-058e-4ce9-bf68-6bca966f9518 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:08.204391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:08.275051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbd36b-058e-4ce9-bf68-6bca966f9518 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:08.277026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbd36b-058e-4ce9-bf68-6bca966f9518 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:08.339491 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1515/3010] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:21:09.003999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:09.004701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:09.272242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205758b8-f801-41ab-a8ad-939fffdac074 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:09.288166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:09.289324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:09.290840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:09.291412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] PATH_INFO: `/v3/projects/5cfeb9c2b0604572bf0eb2e6d0de2209` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:09.294140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cfeb9c2b0604572bf0eb2e6d0de2209)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:09.299827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:09.489122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:09.491334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cfeb9c2b0604572bf0eb2e6d0de2209', 'request_id': 'req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:09.510582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cfeb9c2b0604572bf0eb2e6d0de2209', 'request_id': 'req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:09.521792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cfeb9c2b0604572bf0eb2e6d0de2209', 'request_id': 'req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:09.546614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] The token cache is being invalidate because project 5cfeb9c2b0604572bf0eb2e6d0de2209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:21:09.547126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:09.547996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53ecd9d9-82a3-4cd3-b4a8-3f090fd8f2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:09.556974 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1496/3011] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:09 2022] DELETE /identity/v3/projects/5cfeb9c2b0604572bf0eb2e6d0de2209 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:09.559590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9db7c5-51e9-4471-a275-7295f8191ef4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:09.560435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9db7c5-51e9-4471-a275-7295f8191ef4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:09.560877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9db7c5-51e9-4471-a275-7295f8191ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:09.621718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0c9db7c5-51e9-4471-a275-7295f8191ef4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:09.623895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0c9db7c5-51e9-4471-a275-7295f8191ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:09.844571 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1516/3012] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:09.846362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2a71-c6f1-4708-964f-d46c62840035 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:09.847169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2a71-c6f1-4708-964f-d46c62840035 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:09.847848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2a71-c6f1-4708-964f-d46c62840035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:09.900141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e2eb2a71-c6f1-4708-964f-d46c62840035 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:09.905580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e2eb2a71-c6f1-4708-964f-d46c62840035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:09.945622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9db7c5-51e9-4471-a275-7295f8191ef4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:09.956172 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1497/3013] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:09.970511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9db7c5-51e9-4471-a275-7295f8191ef4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:09.995468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5c26-8e9e-4e31-a464-d20a2119d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:09.996516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5c26-8e9e-4e31-a464-d20a2119d629 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:09.996992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5c26-8e9e-4e31-a464-d20a2119d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:09.997453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5c26-8e9e-4e31-a464-d20a2119d629 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:09.998587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa5c26-8e9e-4e31-a464-d20a2119d629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:21:09.999104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa5c26-8e9e-4e31-a464-d20a2119d629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:10.013570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa5c26-8e9e-4e31-a464-d20a2119d629 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:10.046706 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1517/3014] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:21:10.050332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb2a71-c6f1-4708-964f-d46c62840035 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:10.063935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb2a71-c6f1-4708-964f-d46c62840035 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:10.076810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d5a74-28bf-47f2-a095-b46c1d3e2d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:10.077739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d5a74-28bf-47f2-a095-b46c1d3e2d7e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:10.078282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d5a74-28bf-47f2-a095-b46c1d3e2d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:10.078781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d5a74-28bf-47f2-a095-b46c1d3e2d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:10.080755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d5a74-28bf-47f2-a095-b46c1d3e2d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:10.087719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d5a74-28bf-47f2-a095-b46c1d3e2d7e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:10.209960 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1498/3015] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:21:10 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:21:10.215190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5c26-8e9e-4e31-a464-d20a2119d629 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:10.250536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5c26-8e9e-4e31-a464-d20a2119d629 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:10.459483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70755bdf-bfbd-4afc-b4d2-19bc3b35df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:10.460639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755bdf-bfbd-4afc-b4d2-19bc3b35df9b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:10.461228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755bdf-bfbd-4afc-b4d2-19bc3b35df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:10.461861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70755bdf-bfbd-4afc-b4d2-19bc3b35df9b admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:10.462821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70755bdf-bfbd-4afc-b4d2-19bc3b35df9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:10.466448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70755bdf-bfbd-4afc-b4d2-19bc3b35df9b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:10.502216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d5a74-28bf-47f2-a095-b46c1d3e2d7e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:10.511585 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1518/3016] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:21:10 2022] POST /identity/v3/users => generated 296 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:21:10.518946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d5a74-28bf-47f2-a095-b46c1d3e2d7e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:10.543555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daac2e-0995-43ac-a2f8-bb03fdb41fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:10.544309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daac2e-0995-43ac-a2f8-bb03fdb41fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:10.546623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daac2e-0995-43ac-a2f8-bb03fdb41fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:10.547009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daac2e-0995-43ac-a2f8-bb03fdb41fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:10.547972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44daac2e-0995-43ac-a2f8-bb03fdb41fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:10.555245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44daac2e-0995-43ac-a2f8-bb03fdb41fe1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:10.591371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70755bdf-bfbd-4afc-b4d2-19bc3b35df9b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:10.604176 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1499/3017] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:21:10.608778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70755bdf-bfbd-4afc-b4d2-19bc3b35df9b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:10.622024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778001f3-8a72-4bd6-b9bd-919cd1e21a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:10.632067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778001f3-8a72-4bd6-b9bd-919cd1e21a59 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:10.643846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778001f3-8a72-4bd6-b9bd-919cd1e21a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:10.644727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778001f3-8a72-4bd6-b9bd-919cd1e21a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:10.646134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778001f3-8a72-4bd6-b9bd-919cd1e21a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:10.650876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778001f3-8a72-4bd6-b9bd-919cd1e21a59 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:10.697513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daac2e-0995-43ac-a2f8-bb03fdb41fe1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:10.704884 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1519/3018] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:21:10.711762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daac2e-0995-43ac-a2f8-bb03fdb41fe1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:10.724517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388527c-f34a-4569-87f6-551b462bd46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:10.725662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388527c-f34a-4569-87f6-551b462bd46c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:10.726226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388527c-f34a-4569-87f6-551b462bd46c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:10.728381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388527c-f34a-4569-87f6-551b462bd46c admin admin] PATH_INFO: `/v3/projects/0714b08090fd4f1ca32bcc6d0e9a75ad/users/a16394d6528b433aab8239ba9376a93f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:10.773381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388527c-f34a-4569-87f6-551b462bd46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0714b08090fd4f1ca32bcc6d0e9a75ad, user_id=a16394d6528b433aab8239ba9376a93f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:10.777752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388527c-f34a-4569-87f6-551b462bd46c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:10.811051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8bb23-82c5-4975-9032-0b5477df01a5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:10.812479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8bb23-82c5-4975-9032-0b5477df01a5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:10.813815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8bb23-82c5-4975-9032-0b5477df01a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:10.819167 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1500/3019] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:21:10 2022] PUT /identity/v3/projects/0714b08090fd4f1ca32bcc6d0e9a75ad/users/a16394d6528b433aab8239ba9376a93f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:10.858560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-15c8bb23-82c5-4975-9032-0b5477df01a5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:10.860321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-15c8bb23-82c5-4975-9032-0b5477df01a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:11.008572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:11.107266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388527c-f34a-4569-87f6-551b462bd46c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:11.110982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9388527c-f34a-4569-87f6-551b462bd46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:11.122473 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1520/3020] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:11.512141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388527c-f34a-4569-87f6-551b462bd46c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:11.527534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1ad01-a9f3-409b-8319-f2cd1ef9f6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:11.528599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ad01-a9f3-409b-8319-f2cd1ef9f6ce service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:11.529180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ad01-a9f3-409b-8319-f2cd1ef9f6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:11.530524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ad01-a9f3-409b-8319-f2cd1ef9f6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:11.566211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1ad01-a9f3-409b-8319-f2cd1ef9f6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:11.575430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1ad01-a9f3-409b-8319-f2cd1ef9f6ce service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:11.640042 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1501/3021] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:14.412350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09082ab2-fd20-4910-8a49-c4d91ae5ac99 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:14.413787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09082ab2-fd20-4910-8a49-c4d91ae5ac99 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:14.414259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09082ab2-fd20-4910-8a49-c4d91ae5ac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:14.498235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-09082ab2-fd20-4910-8a49-c4d91ae5ac99 None None] MFA Rules not processed for user `68242b2f7fc447278230f48eaee28396`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:14.514994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-09082ab2-fd20-4910-8a49-c4d91ae5ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:14.809159 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1521/3022] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:21.613770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:24.325480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d02c1-b05f-429b-8491-fe38c057f623 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:24.325480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d02c1-b05f-429b-8491-fe38c057f623 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:24.325480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d02c1-b05f-429b-8491-fe38c057f623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:24.401913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-228d02c1-b05f-429b-8491-fe38c057f623 None None] MFA Rules not processed for user `a16394d6528b433aab8239ba9376a93f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:24.403208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-228d02c1-b05f-429b-8491-fe38c057f623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:24.691242 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1502/3023] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:24.780723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=32 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:25.205299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09082ab2-fd20-4910-8a49-c4d91ae5ac99 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:25.206940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-09082ab2-fd20-4910-8a49-c4d91ae5ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:25.574243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09082ab2-fd20-4910-8a49-c4d91ae5ac99 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:25.580626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe356f11-c8d2-4541-bd93-1e870845fa42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:25.581143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe356f11-c8d2-4541-bd93-1e870845fa42 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:25.581424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe356f11-c8d2-4541-bd93-1e870845fa42 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:25.581695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe356f11-c8d2-4541-bd93-1e870845fa42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:25.583581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fe356f11-c8d2-4541-bd93-1e870845fa42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:25.605556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe356f11-c8d2-4541-bd93-1e870845fa42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:25.607427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe356f11-c8d2-4541-bd93-1e870845fa42 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:25.633973 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1522/3024] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:26.714931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d02c1-b05f-429b-8491-fe38c057f623 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:26.720320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-228d02c1-b05f-429b-8491-fe38c057f623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:27.035731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d02c1-b05f-429b-8491-fe38c057f623 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:27.053768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f09b0f-5768-4418-96c1-a3b7584375f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:27.055234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f09b0f-5768-4418-96c1-a3b7584375f9 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:27.055946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f09b0f-5768-4418-96c1-a3b7584375f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:27.056693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f09b0f-5768-4418-96c1-a3b7584375f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:27.083006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f09b0f-5768-4418-96c1-a3b7584375f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:27.090094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f09b0f-5768-4418-96c1-a3b7584375f9 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:27.115301 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1503/3025] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:26 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:27.463431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe356f11-c8d2-4541-bd93-1e870845fa42 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:27.474709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe356f11-c8d2-4541-bd93-1e870845fa42 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:27.479093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f29846-e80c-4f00-a566-203da0c26c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:27.480094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f29846-e80c-4f00-a566-203da0c26c1b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:27.480575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f29846-e80c-4f00-a566-203da0c26c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:27.481053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f29846-e80c-4f00-a566-203da0c26c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:27.484013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-15f29846-e80c-4f00-a566-203da0c26c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:27.505786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f29846-e80c-4f00-a566-203da0c26c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:27.508089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f29846-e80c-4f00-a566-203da0c26c1b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:27.520956 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1523/3026] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:32.299292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327100a-c8f1-483d-8862-e3332ebb21c5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:32.300014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327100a-c8f1-483d-8862-e3332ebb21c5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:32.300425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327100a-c8f1-483d-8862-e3332ebb21c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:32.384901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a327100a-c8f1-483d-8862-e3332ebb21c5 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:32.386868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a327100a-c8f1-483d-8862-e3332ebb21c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:32.498258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:32.539011 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1504/3027] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:21:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:21:32.562350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f29846-e80c-4f00-a566-203da0c26c1b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:32.564094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-15f29846-e80c-4f00-a566-203da0c26c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:32.718316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f29846-e80c-4f00-a566-203da0c26c1b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:32.725273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4dd8a-98f5-4c14-8dd0-90c69f65ff85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:32.726411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4dd8a-98f5-4c14-8dd0-90c69f65ff85 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:32.726964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4dd8a-98f5-4c14-8dd0-90c69f65ff85 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:32.727374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4dd8a-98f5-4c14-8dd0-90c69f65ff85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:32.738275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4dd8a-98f5-4c14-8dd0-90c69f65ff85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:32.741299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4dd8a-98f5-4c14-8dd0-90c69f65ff85 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:32.748513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:32.755695 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1524/3028] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:21:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:21:38.007408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327100a-c8f1-483d-8862-e3332ebb21c5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:38.039421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327100a-c8f1-483d-8862-e3332ebb21c5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:38.060944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1c2d-85b3-4650-8fd8-ea8bcfdfbe08 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:38.062296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1c2d-85b3-4650-8fd8-ea8bcfdfbe08 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:38.065104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1c2d-85b3-4650-8fd8-ea8bcfdfbe08 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:38.065713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f1c2d-85b3-4650-8fd8-ea8bcfdfbe08 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:38.070436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-839f1c2d-85b3-4650-8fd8-ea8bcfdfbe08 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:38.121262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f1c2d-85b3-4650-8fd8-ea8bcfdfbe08 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:38.123327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f1c2d-85b3-4650-8fd8-ea8bcfdfbe08 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:38.160257 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1505/3029] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:38.174562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4dd8a-98f5-4c14-8dd0-90c69f65ff85 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:38.192121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4dd8a-98f5-4c14-8dd0-90c69f65ff85 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:38.204830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:38.205780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:38.206327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:38.206817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] PATH_INFO: `/v3/users/a16394d6528b433aab8239ba9376a93f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:38.208979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a16394d6528b433aab8239ba9376a93f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:38.212714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:38.316084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a16394d6528b433aab8239ba9376a93f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:38.317832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a16394d6528b433aab8239ba9376a93f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:38.339619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a16394d6528b433aab8239ba9376a93f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:38.386792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a16394d6528b433aab8239ba9376a93f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:38.439999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fe8e74e0-78c0-4677-b50a-30bec81460cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a16394d6528b433aab8239ba9376a93f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:38.470370 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1525/3030] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:21:38 2022] DELETE /identity/v3/users/a16394d6528b433aab8239ba9376a93f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:38.961775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1c2d-85b3-4650-8fd8-ea8bcfdfbe08 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:38.982062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f1c2d-85b3-4650-8fd8-ea8bcfdfbe08 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:39.165337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:39.168161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:39.170702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:39.171393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] PATH_INFO: `/v3/projects/0714b08090fd4f1ca32bcc6d0e9a75ad` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:39.175715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0714b08090fd4f1ca32bcc6d0e9a75ad)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:39.177904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:39.279240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0714b08090fd4f1ca32bcc6d0e9a75ad', 'request_id': 'req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:39.293746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0714b08090fd4f1ca32bcc6d0e9a75ad', 'request_id': 'req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:39.302139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0714b08090fd4f1ca32bcc6d0e9a75ad', 'request_id': 'req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:39.318774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] The token cache is being invalidate because project 0714b08090fd4f1ca32bcc6d0e9a75ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:21:39.320179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:39.321174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-68d5f9d0-d5a7-47c3-8f54-918ae2eaf33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:39.323770 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1506/3031] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:38 2022] DELETE /identity/v3/projects/0714b08090fd4f1ca32bcc6d0e9a75ad => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:39.334004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb325c-8be9-482b-8587-f143228bc7b2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:39.335992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb325c-8be9-482b-8587-f143228bc7b2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:39.336544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb325c-8be9-482b-8587-f143228bc7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:39.412032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-57eb325c-8be9-482b-8587-f143228bc7b2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:39.414415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-57eb325c-8be9-482b-8587-f143228bc7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:39.568305 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1526/3032] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:39.571355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0680b4-ee9d-4f0d-8162-daec9a3bf7ef None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:39.571794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0680b4-ee9d-4f0d-8162-daec9a3bf7ef None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:39.572178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0680b4-ee9d-4f0d-8162-daec9a3bf7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:39.619586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ec0680b4-ee9d-4f0d-8162-daec9a3bf7ef None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:39.620549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ec0680b4-ee9d-4f0d-8162-daec9a3bf7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:39.654512 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1507/3033] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:39.657240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb325c-8be9-482b-8587-f143228bc7b2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:39.671366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb325c-8be9-482b-8587-f143228bc7b2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:39.683709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb93e4e-f2c8-4846-bf8c-38064af7a8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:39.683709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb93e4e-f2c8-4846-bf8c-38064af7a8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:39.683709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb93e4e-f2c8-4846-bf8c-38064af7a8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:39.683709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb93e4e-f2c8-4846-bf8c-38064af7a8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:39.684206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb93e4e-f2c8-4846-bf8c-38064af7a8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:21:39.684206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb93e4e-f2c8-4846-bf8c-38064af7a8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:39.686287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb93e4e-f2c8-4846-bf8c-38064af7a8c7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:39.710275 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1527/3034] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:21:39.713237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0680b4-ee9d-4f0d-8162-daec9a3bf7ef None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:39.724085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0680b4-ee9d-4f0d-8162-daec9a3bf7ef None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:39.731045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60b3f0-d037-4550-ab60-ae6baaf57738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:39.731734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60b3f0-d037-4550-ab60-ae6baaf57738 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:39.732021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60b3f0-d037-4550-ab60-ae6baaf57738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:39.732240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60b3f0-d037-4550-ab60-ae6baaf57738 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:39.732856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60b3f0-d037-4550-ab60-ae6baaf57738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:39.734933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf60b3f0-d037-4550-ab60-ae6baaf57738 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:39.785037 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1508/3035] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:21:39 2022] POST /identity/v3/projects => generated 391 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:21:39.790028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb93e4e-f2c8-4846-bf8c-38064af7a8c7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:39.800594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb93e4e-f2c8-4846-bf8c-38064af7a8c7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:39.875041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:39.886854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b0edc-baa7-444a-94d9-caaaad5cd75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:39.887834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b0edc-baa7-444a-94d9-caaaad5cd75a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:39.888285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b0edc-baa7-444a-94d9-caaaad5cd75a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:39.888947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b0edc-baa7-444a-94d9-caaaad5cd75a admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:39.889818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b0edc-baa7-444a-94d9-caaaad5cd75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:39.892065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b0edc-baa7-444a-94d9-caaaad5cd75a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:39.942336 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1528/3036] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:21:39 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:21:39.947087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60b3f0-d037-4550-ab60-ae6baaf57738 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:39.964299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60b3f0-d037-4550-ab60-ae6baaf57738 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:39.988246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb740525-8440-469e-9207-09fb2ed9aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:39.988795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb740525-8440-469e-9207-09fb2ed9aa92 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:39.989071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb740525-8440-469e-9207-09fb2ed9aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:39.989335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb740525-8440-469e-9207-09fb2ed9aa92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:39.990030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb740525-8440-469e-9207-09fb2ed9aa92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:39.991809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb740525-8440-469e-9207-09fb2ed9aa92 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:40.014018 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1509/3037] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:21:40.017786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b0edc-baa7-444a-94d9-caaaad5cd75a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:40.037489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b0edc-baa7-444a-94d9-caaaad5cd75a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:40.044271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bf5e6-cbfc-4d70-a8cf-4cbdc78ec8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:40.044922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bf5e6-cbfc-4d70-a8cf-4cbdc78ec8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:40.045378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bf5e6-cbfc-4d70-a8cf-4cbdc78ec8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:40.045705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bf5e6-cbfc-4d70-a8cf-4cbdc78ec8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:40.046360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bf5e6-cbfc-4d70-a8cf-4cbdc78ec8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:40.048320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bf5e6-cbfc-4d70-a8cf-4cbdc78ec8e2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:40.066675 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1529/3038] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:21:40.068194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb740525-8440-469e-9207-09fb2ed9aa92 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:40.080088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb740525-8440-469e-9207-09fb2ed9aa92 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:40.085002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d268d4d-d92a-4057-ba0f-1eb1e24ed6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:40.086251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d268d4d-d92a-4057-ba0f-1eb1e24ed6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:40.086827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d268d4d-d92a-4057-ba0f-1eb1e24ed6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:40.087547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d268d4d-d92a-4057-ba0f-1eb1e24ed6e8 admin admin] PATH_INFO: `/v3/projects/45941ac90da3421ab97e31ccad7fb9a3/users/57f2bfa0d35c44d79241f38b77901e39/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:40.106858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d268d4d-d92a-4057-ba0f-1eb1e24ed6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45941ac90da3421ab97e31ccad7fb9a3, user_id=57f2bfa0d35c44d79241f38b77901e39, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:40.111791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d268d4d-d92a-4057-ba0f-1eb1e24ed6e8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:40.123037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:40.137330 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1510/3039] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:21:40 2022] PUT /identity/v3/projects/45941ac90da3421ab97e31ccad7fb9a3/users/57f2bfa0d35c44d79241f38b77901e39/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:40.160600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7075c5-9d2c-4575-ab7e-ca4171e60013 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:40.160600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7075c5-9d2c-4575-ab7e-ca4171e60013 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:40.160600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7075c5-9d2c-4575-ab7e-ca4171e60013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:40.249666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3a7075c5-9d2c-4575-ab7e-ca4171e60013 None None] MFA Rules not processed for user `57f2bfa0d35c44d79241f38b77901e39`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:40.254800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3a7075c5-9d2c-4575-ab7e-ca4171e60013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:40.391767 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1530/3040] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:40.410567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d268d4d-d92a-4057-ba0f-1eb1e24ed6e8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:40.418030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0d268d4d-d92a-4057-ba0f-1eb1e24ed6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:40.751935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d268d4d-d92a-4057-ba0f-1eb1e24ed6e8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:40.766772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0c99e-7272-4d8a-a069-1ecb18a170a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:40.768047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0c99e-7272-4d8a-a069-1ecb18a170a5 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:40.768650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0c99e-7272-4d8a-a069-1ecb18a170a5 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:40.769234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0c99e-7272-4d8a-a069-1ecb18a170a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:40.792294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0c99e-7272-4d8a-a069-1ecb18a170a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:40.795568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe0c99e-7272-4d8a-a069-1ecb18a170a5 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:40.820631 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1511/3041] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:41.543075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7075c5-9d2c-4575-ab7e-ca4171e60013 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:41.712685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7075c5-9d2c-4575-ab7e-ca4171e60013 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:41.724018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:41.725171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:41.725661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:41.726195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] PATH_INFO: `/v3/users/57f2bfa0d35c44d79241f38b77901e39` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:41.728080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f2bfa0d35c44d79241f38b77901e39)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:41.730374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:41.829038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f2bfa0d35c44d79241f38b77901e39'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:41.830886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f2bfa0d35c44d79241f38b77901e39'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:41.865975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f2bfa0d35c44d79241f38b77901e39'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:41.872814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:41.896185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f2bfa0d35c44d79241f38b77901e39'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:41.956412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f2bfa0d35c44d79241f38b77901e39'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:41.964724 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1531/3042] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:21:41 2022] DELETE /identity/v3/users/57f2bfa0d35c44d79241f38b77901e39 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:41.971997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c25049-25a0-4b84-950a-1315b403d024 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:41.972718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c25049-25a0-4b84-950a-1315b403d024 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:41.972950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c25049-25a0-4b84-950a-1315b403d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:42.002400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-30c25049-25a0-4b84-950a-1315b403d024 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:42.003663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-30c25049-25a0-4b84-950a-1315b403d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:42.174694 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1512/3043] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:42.193116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:42.194980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:42.314564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b4c1a-9988-4a88-b962-31bbbdcd4854 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:42.319450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89d1da-0709-4b12-845b-258b850aa430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:42.320251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89d1da-0709-4b12-845b-258b850aa430 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:42.320631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89d1da-0709-4b12-845b-258b850aa430 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:42.321019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89d1da-0709-4b12-845b-258b850aa430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:42.343340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89d1da-0709-4b12-845b-258b850aa430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:42.346341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89d1da-0709-4b12-845b-258b850aa430 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:42.365680 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1532/3044] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:42.836648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c25049-25a0-4b84-950a-1315b403d024 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:42.838788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-30c25049-25a0-4b84-950a-1315b403d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:42.855203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c25049-25a0-4b84-950a-1315b403d024 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:42.862620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:42.863420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:42.863795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:42.864163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] PATH_INFO: `/v3/projects/45941ac90da3421ab97e31ccad7fb9a3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:42.865638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] RBAC: Authorizing `identity:delete_project(project_id=45941ac90da3421ab97e31ccad7fb9a3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:42.869456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:43.002980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45941ac90da3421ab97e31ccad7fb9a3', 'request_id': 'req-37be74cd-0c81-4100-8351-da5ab796853c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:43.015589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45941ac90da3421ab97e31ccad7fb9a3', 'request_id': 'req-37be74cd-0c81-4100-8351-da5ab796853c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:43.041313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45941ac90da3421ab97e31ccad7fb9a3', 'request_id': 'req-37be74cd-0c81-4100-8351-da5ab796853c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:43.079717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] The token cache is being invalidate because project 45941ac90da3421ab97e31ccad7fb9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:21:43.082386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:43.089252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37be74cd-0c81-4100-8351-da5ab796853c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:43.094589 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1513/3045] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:42 2022] DELETE /identity/v3/projects/45941ac90da3421ab97e31ccad7fb9a3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:43.102670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d7df6-e836-4fd8-b3cf-488b6bb0d65a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:43.103171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d7df6-e836-4fd8-b3cf-488b6bb0d65a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:43.104150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d7df6-e836-4fd8-b3cf-488b6bb0d65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:43.160963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b53d7df6-e836-4fd8-b3cf-488b6bb0d65a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:43.163394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b53d7df6-e836-4fd8-b3cf-488b6bb0d65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:43.258046 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1533/3046] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:43.266217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5621-416d-4733-8239-bcb568669fd0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:43.266512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5621-416d-4733-8239-bcb568669fd0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:43.266785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f5621-416d-4733-8239-bcb568669fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:43.289665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:43.301734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-644f5621-416d-4733-8239-bcb568669fd0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:43.308579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-644f5621-416d-4733-8239-bcb568669fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:43.321333 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1514/3047] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:43.326867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d7df6-e836-4fd8-b3cf-488b6bb0d65a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:43.346271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d7df6-e836-4fd8-b3cf-488b6bb0d65a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:43.356536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991e9e-c369-4944-b5d8-6ea1ac1b786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:43.358098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991e9e-c369-4944-b5d8-6ea1ac1b786e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:43.358602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991e9e-c369-4944-b5d8-6ea1ac1b786e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:43.359993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26991e9e-c369-4944-b5d8-6ea1ac1b786e admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:43.361422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26991e9e-c369-4944-b5d8-6ea1ac1b786e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:21:43.362097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26991e9e-c369-4944-b5d8-6ea1ac1b786e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:43.364254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26991e9e-c369-4944-b5d8-6ea1ac1b786e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:43.407533 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1534/3048] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:21:43.412367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f5621-416d-4733-8239-bcb568669fd0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:43.427090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f5621-416d-4733-8239-bcb568669fd0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:43.435297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204da00c-6144-4616-8c64-863332069976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:43.437811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da00c-6144-4616-8c64-863332069976 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:43.438476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da00c-6144-4616-8c64-863332069976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:43.439294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da00c-6144-4616-8c64-863332069976 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:43.440162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204da00c-6144-4616-8c64-863332069976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:43.444045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204da00c-6144-4616-8c64-863332069976 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:43.446850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991e9e-c369-4944-b5d8-6ea1ac1b786e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:43.449427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-26991e9e-c369-4944-b5d8-6ea1ac1b786e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:43.511581 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1515/3049] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:21:43 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:21:43.512902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204da00c-6144-4616-8c64-863332069976 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:43.586055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26991e9e-c369-4944-b5d8-6ea1ac1b786e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:43.598468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:43.603037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204da00c-6144-4616-8c64-863332069976 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:43.611151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ddd61-1a21-4aa0-a7f6-e5309943c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:43.611151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ddd61-1a21-4aa0-a7f6-e5309943c25b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:43.611151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ddd61-1a21-4aa0-a7f6-e5309943c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:43.612023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ddd61-1a21-4aa0-a7f6-e5309943c25b admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:43.612860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ddd61-1a21-4aa0-a7f6-e5309943c25b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:43.615346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ddd61-1a21-4aa0-a7f6-e5309943c25b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:43.671722 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1516/3050] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:21:43 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:21:43.672836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ddd61-1a21-4aa0-a7f6-e5309943c25b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:43.695766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ddd61-1a21-4aa0-a7f6-e5309943c25b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:43.700219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6e5f7-7021-4c3f-8517-d86356edbccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:43.701132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e5f7-7021-4c3f-8517-d86356edbccb admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:43.702207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e5f7-7021-4c3f-8517-d86356edbccb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:43.702485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e5f7-7021-4c3f-8517-d86356edbccb admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:43.703171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6e5f7-7021-4c3f-8517-d86356edbccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:43.707158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6e5f7-7021-4c3f-8517-d86356edbccb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:43.728068 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1517/3051] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:21:43.729142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6e5f7-7021-4c3f-8517-d86356edbccb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:43.744080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6e5f7-7021-4c3f-8517-d86356edbccb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:43.750610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e14fd4-9a8e-4259-b33e-1a1401425f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:43.751291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14fd4-9a8e-4259-b33e-1a1401425f3c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:43.751649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14fd4-9a8e-4259-b33e-1a1401425f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:43.751903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14fd4-9a8e-4259-b33e-1a1401425f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:43.753561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e14fd4-9a8e-4259-b33e-1a1401425f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:43.753746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ccb1e-6875-4cb2-bbf2-a8a121edbaa4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:43.755005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ccb1e-6875-4cb2-bbf2-a8a121edbaa4 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:43.755471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e14fd4-9a8e-4259-b33e-1a1401425f3c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:43.755999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ccb1e-6875-4cb2-bbf2-a8a121edbaa4 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:43.756552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ccb1e-6875-4cb2-bbf2-a8a121edbaa4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:43.759971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c2ccb1e-6875-4cb2-bbf2-a8a121edbaa4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:43.776451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ccb1e-6875-4cb2-bbf2-a8a121edbaa4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:43.778951 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1518/3052] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:21:43.779094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ccb1e-6875-4cb2-bbf2-a8a121edbaa4 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:43.780845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e14fd4-9a8e-4259-b33e-1a1401425f3c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:43.793342 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1535/3053] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:21:43.796595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e14fd4-9a8e-4259-b33e-1a1401425f3c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:43.803278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36119a-f665-4ab2-938a-60ae6ed0fa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:43.810206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36119a-f665-4ab2-938a-60ae6ed0fa3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:43.810586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36119a-f665-4ab2-938a-60ae6ed0fa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:43.810867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36119a-f665-4ab2-938a-60ae6ed0fa3f admin admin] PATH_INFO: `/v3/projects/1513e7ac9999430ea3d4e63c3fa16235/users/3a2945d225044b12a8e332db3b97da1e/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:43.833445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36119a-f665-4ab2-938a-60ae6ed0fa3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1513e7ac9999430ea3d4e63c3fa16235, user_id=3a2945d225044b12a8e332db3b97da1e, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:43.838813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e36119a-f665-4ab2-938a-60ae6ed0fa3f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:43.863858 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1519/3054] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:21:43 2022] PUT /identity/v3/projects/1513e7ac9999430ea3d4e63c3fa16235/users/3a2945d225044b12a8e332db3b97da1e/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:43.959624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d3d35-c605-4c4e-b7ec-9be2c793ffee None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:43.961623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d3d35-c605-4c4e-b7ec-9be2c793ffee None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:43.962280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d3d35-c605-4c4e-b7ec-9be2c793ffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:44.089913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6d1d3d35-c605-4c4e-b7ec-9be2c793ffee None None] MFA Rules not processed for user `3a2945d225044b12a8e332db3b97da1e`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:44.092566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6d1d3d35-c605-4c4e-b7ec-9be2c793ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:44.212776 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1536/3055] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:44.686185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36119a-f665-4ab2-938a-60ae6ed0fa3f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:44.689829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4e36119a-f665-4ab2-938a-60ae6ed0fa3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:44.699882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d3d35-c605-4c4e-b7ec-9be2c793ffee None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:44.701754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6d1d3d35-c605-4c4e-b7ec-9be2c793ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:44.895694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36119a-f665-4ab2-938a-60ae6ed0fa3f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:44.910712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:44.911828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:44.912288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:44.912458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d3d35-c605-4c4e-b7ec-9be2c793ffee None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:44.912780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] PATH_INFO: `/v3/users/4a4f15def3dc44989da457f837eb4b6f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:44.914945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4f15def3dc44989da457f837eb4b6f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:44.919551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f0dc6-0268-4e16-9f68-4095fdc10f88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:44.919768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:44.920262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f0dc6-0268-4e16-9f68-4095fdc10f88 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:44.920478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f0dc6-0268-4e16-9f68-4095fdc10f88 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:44.920752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f0dc6-0268-4e16-9f68-4095fdc10f88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:44.923543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3d4f0dc6-0268-4e16-9f68-4095fdc10f88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:44.962863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:44.980239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:45.071723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f0dc6-0268-4e16-9f68-4095fdc10f88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:45.072043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4f15def3dc44989da457f837eb4b6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:45.076564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f0dc6-0268-4e16-9f68-4095fdc10f88 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:45.081332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4f15def3dc44989da457f837eb4b6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:45.099101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4f15def3dc44989da457f837eb4b6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:45.105769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1537/3056] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:45.118689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f0dc6-0268-4e16-9f68-4095fdc10f88 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:45.123886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3d4f0dc6-0268-4e16-9f68-4095fdc10f88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:45.134140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4f15def3dc44989da457f837eb4b6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:45.135312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7e34385-f2b5-4271-9c13-03ac9dc027f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4f15def3dc44989da457f837eb4b6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:45.145829 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1520/3057] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:21:44 2022] DELETE /identity/v3/users/4a4f15def3dc44989da457f837eb4b6f => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:45.157613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ef8b3-b66b-4486-ae6c-13066da326ee None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:45.158406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ef8b3-b66b-4486-ae6c-13066da326ee None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:45.160324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ef8b3-b66b-4486-ae6c-13066da326ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:45.185635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f0dc6-0268-4e16-9f68-4095fdc10f88 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:45.234713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-799ef8b3-b66b-4486-ae6c-13066da326ee None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:45.240158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-799ef8b3-b66b-4486-ae6c-13066da326ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:45.367027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce124f-01aa-4031-868b-e87d1838ba85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:45.367890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce124f-01aa-4031-868b-e87d1838ba85 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:45.368135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce124f-01aa-4031-868b-e87d1838ba85 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:45.368662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce124f-01aa-4031-868b-e87d1838ba85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:45.384017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-43ce124f-01aa-4031-868b-e87d1838ba85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:45.411185 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1521/3058] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:45.426009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ef8b3-b66b-4486-ae6c-13066da326ee None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:45.429611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-799ef8b3-b66b-4486-ae6c-13066da326ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:45.565106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ef8b3-b66b-4486-ae6c-13066da326ee None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:45.573454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a03e-af28-4bfe-86e1-ef1aa4b2f70e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:45.574315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a03e-af28-4bfe-86e1-ef1aa4b2f70e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:45.574686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a03e-af28-4bfe-86e1-ef1aa4b2f70e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:45.575330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46a03e-af28-4bfe-86e1-ef1aa4b2f70e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:45.612342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a03e-af28-4bfe-86e1-ef1aa4b2f70e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:45.614188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46a03e-af28-4bfe-86e1-ef1aa4b2f70e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:45.643647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce124f-01aa-4031-868b-e87d1838ba85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:45.650824 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1522/3059] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:45.652518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce124f-01aa-4031-868b-e87d1838ba85 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:45.700684 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1538/3060] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:46.949749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a03e-af28-4bfe-86e1-ef1aa4b2f70e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:46.951332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4f46a03e-af28-4bfe-86e1-ef1aa4b2f70e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:46.981269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46a03e-af28-4bfe-86e1-ef1aa4b2f70e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:47.028668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:47.030981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:47.032275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:47.032971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] PATH_INFO: `/v3/projects/dd69cd339bcc4a6f944a6d635fcf366b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:47.045710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd69cd339bcc4a6f944a6d635fcf366b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:47.072176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:47.190704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:47.207695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd69cd339bcc4a6f944a6d635fcf366b', 'request_id': 'req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:47.227190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd69cd339bcc4a6f944a6d635fcf366b', 'request_id': 'req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:47.250678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd69cd339bcc4a6f944a6d635fcf366b', 'request_id': 'req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:47.271942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] The token cache is being invalidate because project dd69cd339bcc4a6f944a6d635fcf366b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:21:47.272322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:47.277108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-872dfaa7-2616-4a0b-b9c5-6fa6eb746314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:21:47.282760 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1523/3061] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:46 2022] DELETE /identity/v3/projects/dd69cd339bcc4a6f944a6d635fcf366b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:21:47.289216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64698cd-7050-4e01-a764-1dd3c5ae3e45 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:47.289216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64698cd-7050-4e01-a764-1dd3c5ae3e45 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:47.289216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64698cd-7050-4e01-a764-1dd3c5ae3e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:47.378462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d64698cd-7050-4e01-a764-1dd3c5ae3e45 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:47.379832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d64698cd-7050-4e01-a764-1dd3c5ae3e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:47.503475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:47.525648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62180-c859-4933-a64f-b7a9213b4408 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:47.526421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62180-c859-4933-a64f-b7a9213b4408 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:47.526754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b62180-c859-4933-a64f-b7a9213b4408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:47.534077 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1539/3062] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:47.595620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-73b62180-c859-4933-a64f-b7a9213b4408 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:47.603489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-73b62180-c859-4933-a64f-b7a9213b4408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:47.627392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64698cd-7050-4e01-a764-1dd3c5ae3e45 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:47.628205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1524/3063] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:47.647828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64698cd-7050-4e01-a764-1dd3c5ae3e45 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:47.680032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783113e8-d6a3-46da-be4a-214975cdfb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:47.680032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783113e8-d6a3-46da-be4a-214975cdfb71 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:47.680032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783113e8-d6a3-46da-be4a-214975cdfb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:47.680032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783113e8-d6a3-46da-be4a-214975cdfb71 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:47.680740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783113e8-d6a3-46da-be4a-214975cdfb71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:21:47.680740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783113e8-d6a3-46da-be4a-214975cdfb71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:47.680740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783113e8-d6a3-46da-be4a-214975cdfb71 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:47.702703 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1540/3064] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:21:47.709996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b62180-c859-4933-a64f-b7a9213b4408 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:47.727058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b62180-c859-4933-a64f-b7a9213b4408 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:47.738385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928a830-84ea-4ac6-9dd7-a23c728667ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:47.739138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a830-84ea-4ac6-9dd7-a23c728667ff admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:47.739420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a830-84ea-4ac6-9dd7-a23c728667ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:47.739800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928a830-84ea-4ac6-9dd7-a23c728667ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:47.740546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928a830-84ea-4ac6-9dd7-a23c728667ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:47.742729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928a830-84ea-4ac6-9dd7-a23c728667ff admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:47.795978 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1525/3065] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:21:47 2022] POST /identity/v3/projects => generated 397 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:21:47.798171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783113e8-d6a3-46da-be4a-214975cdfb71 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:47.823554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783113e8-d6a3-46da-be4a-214975cdfb71 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:47.930203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64436271-d069-4596-b5ab-3a78064280b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:47.931394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64436271-d069-4596-b5ab-3a78064280b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:47.931743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64436271-d069-4596-b5ab-3a78064280b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:47.932007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64436271-d069-4596-b5ab-3a78064280b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:47.932838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64436271-d069-4596-b5ab-3a78064280b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:47.935900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64436271-d069-4596-b5ab-3a78064280b3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:47.965790 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1541/3066] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:21:47 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:21:47.967132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928a830-84ea-4ac6-9dd7-a23c728667ff admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:47.980188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928a830-84ea-4ac6-9dd7-a23c728667ff admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:47.987016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86478df-f3cb-4ee3-93d1-e18d5e26b9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:47.987950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86478df-f3cb-4ee3-93d1-e18d5e26b9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:47.988395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86478df-f3cb-4ee3-93d1-e18d5e26b9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:47.988872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86478df-f3cb-4ee3-93d1-e18d5e26b9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:47.989846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86478df-f3cb-4ee3-93d1-e18d5e26b9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:47.991985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86478df-f3cb-4ee3-93d1-e18d5e26b9d9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:48.005934 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1526/3067] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:21:48.009636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64436271-d069-4596-b5ab-3a78064280b3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:48.023401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64436271-d069-4596-b5ab-3a78064280b3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:48.029296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcaf2b-5043-4048-8337-97abb678d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:48.030264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcaf2b-5043-4048-8337-97abb678d9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:48.030638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcaf2b-5043-4048-8337-97abb678d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:48.031093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcaf2b-5043-4048-8337-97abb678d9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:48.031855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcaf2b-5043-4048-8337-97abb678d9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:48.035487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcaf2b-5043-4048-8337-97abb678d9c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:48.075656 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1542/3068] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:21:48.080173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86478df-f3cb-4ee3-93d1-e18d5e26b9d9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:48.093802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86478df-f3cb-4ee3-93d1-e18d5e26b9d9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:48.099201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc4180-0d3b-4418-a481-3a0ec1bc1200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:48.100461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc4180-0d3b-4418-a481-3a0ec1bc1200 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:48.100606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc4180-0d3b-4418-a481-3a0ec1bc1200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:48.101009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc4180-0d3b-4418-a481-3a0ec1bc1200 admin admin] PATH_INFO: `/v3/projects/f1fbf75f364f466698dd4eb2a1df773b/users/16b4da39b4ad4cee98c185bfa7e6f054/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:48.134895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc4180-0d3b-4418-a481-3a0ec1bc1200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1fbf75f364f466698dd4eb2a1df773b, user_id=16b4da39b4ad4cee98c185bfa7e6f054, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:48.138105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc4180-0d3b-4418-a481-3a0ec1bc1200 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:48.163906 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1527/3069] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:21:48 2022] PUT /identity/v3/projects/f1fbf75f364f466698dd4eb2a1df773b/users/16b4da39b4ad4cee98c185bfa7e6f054/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:21:48.171345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733691d-8210-4d03-867c-ee1c85decf3c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:48.172379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733691d-8210-4d03-867c-ee1c85decf3c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:48.172893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733691d-8210-4d03-867c-ee1c85decf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:48.207810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7733691d-8210-4d03-867c-ee1c85decf3c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:48.209385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7733691d-8210-4d03-867c-ee1c85decf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:48.299597 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1543/3070] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:48.311811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc4180-0d3b-4418-a481-3a0ec1bc1200 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:48.313787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3cfc4180-0d3b-4418-a481-3a0ec1bc1200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:48.339675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733691d-8210-4d03-867c-ee1c85decf3c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:48.341822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7733691d-8210-4d03-867c-ee1c85decf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:48.396575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc4180-0d3b-4418-a481-3a0ec1bc1200 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:48.403456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3b92d-f355-440f-bad0-ed32e13394dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:48.404120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3b92d-f355-440f-bad0-ed32e13394dc service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:48.404405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3b92d-f355-440f-bad0-ed32e13394dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:48.404676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3b92d-f355-440f-bad0-ed32e13394dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:48.417516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3b92d-f355-440f-bad0-ed32e13394dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:48.418567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3b92d-f355-440f-bad0-ed32e13394dc service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:48.431897 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1528/3071] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:21:48.441240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733691d-8210-4d03-867c-ee1c85decf3c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:48.452117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d78f9f-f237-4b88-9d16-60bf2cf200ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:48.453300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d78f9f-f237-4b88-9d16-60bf2cf200ed service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:48.453300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d78f9f-f237-4b88-9d16-60bf2cf200ed service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:48.453545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d78f9f-f237-4b88-9d16-60bf2cf200ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:48.456507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-58d78f9f-f237-4b88-9d16-60bf2cf200ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:48.472962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:48.480033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d78f9f-f237-4b88-9d16-60bf2cf200ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:48.482314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d78f9f-f237-4b88-9d16-60bf2cf200ed service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:48.497035 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1544/3072] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:21:48.970019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3b92d-f355-440f-bad0-ed32e13394dc service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:48.973296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-daa3b92d-f355-440f-bad0-ed32e13394dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:48.992263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3b92d-f355-440f-bad0-ed32e13394dc service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:48.998115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ecccc-e5c4-41a7-81a6-162fb52da23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:48.999302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ecccc-e5c4-41a7-81a6-162fb52da23e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:48.999609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ecccc-e5c4-41a7-81a6-162fb52da23e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:48.999885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ecccc-e5c4-41a7-81a6-162fb52da23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:49.003267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bc6ecccc-e5c4-41a7-81a6-162fb52da23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:49.096504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:49.126856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ecccc-e5c4-41a7-81a6-162fb52da23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:49.131543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ecccc-e5c4-41a7-81a6-162fb52da23e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:49.156549 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1529/3073] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:21:49.502214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d78f9f-f237-4b88-9d16-60bf2cf200ed service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:49.526012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d78f9f-f237-4b88-9d16-60bf2cf200ed service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:49.534412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db32b0-dbf9-4ee5-b9e0-7f1eb1b56571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:49.535523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db32b0-dbf9-4ee5-b9e0-7f1eb1b56571 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:49.536320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db32b0-dbf9-4ee5-b9e0-7f1eb1b56571 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:49.536655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db32b0-dbf9-4ee5-b9e0-7f1eb1b56571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:49.538860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-81db32b0-dbf9-4ee5-b9e0-7f1eb1b56571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:49.552542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db32b0-dbf9-4ee5-b9e0-7f1eb1b56571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:49.554487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db32b0-dbf9-4ee5-b9e0-7f1eb1b56571 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:49.565672 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1545/3074] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:21:56.981340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed52c3-f67c-4c88-a381-f8d267b90848 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:56.982002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed52c3-f67c-4c88-a381-f8d267b90848 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:56.982390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed52c3-f67c-4c88-a381-f8d267b90848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:57.040532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5aed52c3-f67c-4c88-a381-f8d267b90848 None None] MFA Rules not processed for user `16b4da39b4ad4cee98c185bfa7e6f054`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:57.041754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5aed52c3-f67c-4c88-a381-f8d267b90848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:57.181463 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1530/3075] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:57.184339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d2335-a499-49b6-b978-f35bf8cf80ec None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:57.184895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d2335-a499-49b6-b978-f35bf8cf80ec None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:57.185536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d2335-a499-49b6-b978-f35bf8cf80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:57.221662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b29d2335-a499-49b6-b978-f35bf8cf80ec None None] MFA Rules not processed for user `16b4da39b4ad4cee98c185bfa7e6f054`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:21:57.224530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b29d2335-a499-49b6-b978-f35bf8cf80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:57.246476 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1546/3076] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:21:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:21:57.584044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed52c3-f67c-4c88-a381-f8d267b90848 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:21:57.585807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5aed52c3-f67c-4c88-a381-f8d267b90848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:21:57.699914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed52c3-f67c-4c88-a381-f8d267b90848 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:21:57.713668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ccd61-7033-420a-9149-836e07ff91a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:21:57.717998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ccd61-7033-420a-9149-836e07ff91a7 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:21:57.718496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ccd61-7033-420a-9149-836e07ff91a7 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:21:57.719108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ccd61-7033-420a-9149-836e07ff91a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:21:57.736845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ccd61-7033-420a-9149-836e07ff91a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:21:57.738734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ccd61-7033-420a-9149-836e07ff91a7 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:21:57.750233 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1531/3077] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:21:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:03.658103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d2335-a499-49b6-b978-f35bf8cf80ec None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:03.661863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b29d2335-a499-49b6-b978-f35bf8cf80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:03.758423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d2335-a499-49b6-b978-f35bf8cf80ec None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:03.784258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:03.786207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:03.786833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:03.788633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] PATH_INFO: `/v3/users/a7e09dadd70845f98b0bfb3397d74f26` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:03.791156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e09dadd70845f98b0bfb3397d74f26)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:03.796563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:03.959908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e09dadd70845f98b0bfb3397d74f26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:03.962238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e09dadd70845f98b0bfb3397d74f26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:03.974948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e09dadd70845f98b0bfb3397d74f26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:04.014024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e09dadd70845f98b0bfb3397d74f26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:04.045890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56e7e7f4-1f37-4f2e-9e17-a1bf6cf86898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e09dadd70845f98b0bfb3397d74f26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:04.091005 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1547/3078] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:03 2022] DELETE /identity/v3/users/a7e09dadd70845f98b0bfb3397d74f26 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:04.440578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ccd61-7033-420a-9149-836e07ff91a7 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:04.496708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ccd61-7033-420a-9149-836e07ff91a7 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:04.676984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:04.687255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:04.688197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:04.688407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] PATH_INFO: `/v3/projects/be38fe88df1a40899428d0279c3be0c8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:04.689960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be38fe88df1a40899428d0279c3be0c8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:04.692238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:04.775766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:04.782807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be38fe88df1a40899428d0279c3be0c8', 'request_id': 'req-4c8f6806-0e8b-433f-978a-3088308ead8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:04.800542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be38fe88df1a40899428d0279c3be0c8', 'request_id': 'req-4c8f6806-0e8b-433f-978a-3088308ead8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:04.815151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be38fe88df1a40899428d0279c3be0c8', 'request_id': 'req-4c8f6806-0e8b-433f-978a-3088308ead8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:04.839073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] The token cache is being invalidate because project be38fe88df1a40899428d0279c3be0c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:04.839413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:04.840052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c8f6806-0e8b-433f-978a-3088308ead8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:04.842126 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1532/3079] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:04 2022] DELETE /identity/v3/projects/be38fe88df1a40899428d0279c3be0c8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:04.848850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596695b-a0f6-44db-8c49-42a33a4c4b42 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:04.850007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596695b-a0f6-44db-8c49-42a33a4c4b42 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:04.850642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596695b-a0f6-44db-8c49-42a33a4c4b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:04.930314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0596695b-a0f6-44db-8c49-42a33a4c4b42 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:04.946163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0596695b-a0f6-44db-8c49-42a33a4c4b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:05.132063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:05.178178 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1548/3080] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:05.191782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306788f9-3a0f-42ce-a6e1-7399b834e0d8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:05.192646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306788f9-3a0f-42ce-a6e1-7399b834e0d8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:05.193186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306788f9-3a0f-42ce-a6e1-7399b834e0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:05.222457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-306788f9-3a0f-42ce-a6e1-7399b834e0d8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:05.224476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-306788f9-3a0f-42ce-a6e1-7399b834e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:05.235782 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1533/3081] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:22:05.242428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596695b-a0f6-44db-8c49-42a33a4c4b42 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:05.262606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306788f9-3a0f-42ce-a6e1-7399b834e0d8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:05.264106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596695b-a0f6-44db-8c49-42a33a4c4b42 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:05.265841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-306788f9-3a0f-42ce-a6e1-7399b834e0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:05.271010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3286a8b-f180-4e50-8cdf-c030bd600c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:05.273138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3286a8b-f180-4e50-8cdf-c030bd600c1a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:05.273556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3286a8b-f180-4e50-8cdf-c030bd600c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:05.274334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3286a8b-f180-4e50-8cdf-c030bd600c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:05.275761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3286a8b-f180-4e50-8cdf-c030bd600c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:22:05.276929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3286a8b-f180-4e50-8cdf-c030bd600c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:05.283942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3286a8b-f180-4e50-8cdf-c030bd600c1a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:05.300753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306788f9-3a0f-42ce-a6e1-7399b834e0d8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:05.310013 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1549/3082] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:22:05.314379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3286a8b-f180-4e50-8cdf-c030bd600c1a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:05.320197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12267419-6396-459e-b512-107d828df092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:05.321310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267419-6396-459e-b512-107d828df092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:05.321776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267419-6396-459e-b512-107d828df092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:05.322267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267419-6396-459e-b512-107d828df092 admin admin] PATH_INFO: `/v3/users/3a2945d225044b12a8e332db3b97da1e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:05.325113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12267419-6396-459e-b512-107d828df092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2945d225044b12a8e332db3b97da1e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:05.329510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12267419-6396-459e-b512-107d828df092 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:05.332918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3286a8b-f180-4e50-8cdf-c030bd600c1a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:05.341383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7263a-7026-4c9c-be0d-6013c47e891f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:05.342611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7263a-7026-4c9c-be0d-6013c47e891f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:05.343130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7263a-7026-4c9c-be0d-6013c47e891f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:05.343768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7263a-7026-4c9c-be0d-6013c47e891f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:05.345022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7263a-7026-4c9c-be0d-6013c47e891f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:05.348533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7263a-7026-4c9c-be0d-6013c47e891f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:05.403455 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1550/3083] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:05 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:22:05.406370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7263a-7026-4c9c-be0d-6013c47e891f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:05.434478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12267419-6396-459e-b512-107d828df092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2945d225044b12a8e332db3b97da1e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:05.446664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12267419-6396-459e-b512-107d828df092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2945d225044b12a8e332db3b97da1e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:05.475025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12267419-6396-459e-b512-107d828df092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2945d225044b12a8e332db3b97da1e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:05.489738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12267419-6396-459e-b512-107d828df092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2945d225044b12a8e332db3b97da1e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:05.490616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12267419-6396-459e-b512-107d828df092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2945d225044b12a8e332db3b97da1e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:05.511400 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1534/3084] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:05 2022] DELETE /identity/v3/users/3a2945d225044b12a8e332db3b97da1e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:05.516418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc456ad-e3c4-4282-8587-053e869dc5d9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:05.517010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc456ad-e3c4-4282-8587-053e869dc5d9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:05.517534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc456ad-e3c4-4282-8587-053e869dc5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:05.520232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7263a-7026-4c9c-be0d-6013c47e891f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:05.541906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5bc456ad-e3c4-4282-8587-053e869dc5d9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:05.543892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5bc456ad-e3c4-4282-8587-053e869dc5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:05.598894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb728c33-6eff-4c1c-b2bb-89366e56a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:05.599540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb728c33-6eff-4c1c-b2bb-89366e56a231 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:05.599891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb728c33-6eff-4c1c-b2bb-89366e56a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:05.600348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb728c33-6eff-4c1c-b2bb-89366e56a231 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:05.620258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb728c33-6eff-4c1c-b2bb-89366e56a231 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:05.622981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb728c33-6eff-4c1c-b2bb-89366e56a231 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:05.656859 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1535/3085] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:05.678311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc456ad-e3c4-4282-8587-053e869dc5d9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:05.681633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5bc456ad-e3c4-4282-8587-053e869dc5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:05.708146 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1551/3086] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:05 2022] POST /identity/v3/users => generated 290 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:22:05.714355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb728c33-6eff-4c1c-b2bb-89366e56a231 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:05.716572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cb728c33-6eff-4c1c-b2bb-89366e56a231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:05.765618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb728c33-6eff-4c1c-b2bb-89366e56a231 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:05.782775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0b5cb-1fa7-4b67-9d4e-020c2b1d325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:05.784837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0b5cb-1fa7-4b67-9d4e-020c2b1d325f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:05.788999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0b5cb-1fa7-4b67-9d4e-020c2b1d325f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:05.791554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0b5cb-1fa7-4b67-9d4e-020c2b1d325f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:05.793781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0b5cb-1fa7-4b67-9d4e-020c2b1d325f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:05.798382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0b5cb-1fa7-4b67-9d4e-020c2b1d325f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:05.807368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:05.827403 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1552/3087] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:05.844405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0b5cb-1fa7-4b67-9d4e-020c2b1d325f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:05.878982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0b5cb-1fa7-4b67-9d4e-020c2b1d325f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:05.905120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455f79e-5092-4c5c-b53d-4cf15281fc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:05.917393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455f79e-5092-4c5c-b53d-4cf15281fc44 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:05.917913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455f79e-5092-4c5c-b53d-4cf15281fc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:05.921560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455f79e-5092-4c5c-b53d-4cf15281fc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:05.923310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455f79e-5092-4c5c-b53d-4cf15281fc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:05.932745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455f79e-5092-4c5c-b53d-4cf15281fc44 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:05.936437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc456ad-e3c4-4282-8587-053e869dc5d9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:05.949093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af242f-22ca-48d2-9e83-b0037a47b799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:05.949842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af242f-22ca-48d2-9e83-b0037a47b799 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:05.950150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af242f-22ca-48d2-9e83-b0037a47b799 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:05.950420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af242f-22ca-48d2-9e83-b0037a47b799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:05.964367 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1553/3088] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:05.966005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455f79e-5092-4c5c-b53d-4cf15281fc44 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:05.989255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455f79e-5092-4c5c-b53d-4cf15281fc44 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:05.996994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af242f-22ca-48d2-9e83-b0037a47b799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:05.999265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af242f-22ca-48d2-9e83-b0037a47b799 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:06.009163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869af06-f260-453a-a752-067ea81db6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:06.011648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869af06-f260-453a-a752-067ea81db6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:06.013417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869af06-f260-453a-a752-067ea81db6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:06.013811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869af06-f260-453a-a752-067ea81db6fd admin admin] PATH_INFO: `/v3/projects/b768d75b29ac4ad18cd34e44b1382004/users/2e944e3030a1404c9862d953fedfb94a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:06.033020 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1536/3089] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:06.091153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869af06-f260-453a-a752-067ea81db6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b768d75b29ac4ad18cd34e44b1382004, user_id=2e944e3030a1404c9862d953fedfb94a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:06.103401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869af06-f260-453a-a752-067ea81db6fd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:06.151059 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1554/3090] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:05 2022] PUT /identity/v3/projects/b768d75b29ac4ad18cd34e44b1382004/users/2e944e3030a1404c9862d953fedfb94a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:22:06.157419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adec2bc-9c4d-4f80-a2ca-b8186c0ca24e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:06.158298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adec2bc-9c4d-4f80-a2ca-b8186c0ca24e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:06.158930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adec2bc-9c4d-4f80-a2ca-b8186c0ca24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:06.206478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9adec2bc-9c4d-4f80-a2ca-b8186c0ca24e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:06.207829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9adec2bc-9c4d-4f80-a2ca-b8186c0ca24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:06.343126 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1537/3091] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:22:06.369407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869af06-f260-453a-a752-067ea81db6fd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:06.396650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:06.476949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869af06-f260-453a-a752-067ea81db6fd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:06.485494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab2fac-4f70-48eb-91ec-d0af70c4f32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:06.486320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab2fac-4f70-48eb-91ec-d0af70c4f32c service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:06.486594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab2fac-4f70-48eb-91ec-d0af70c4f32c service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:06.486862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab2fac-4f70-48eb-91ec-d0af70c4f32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:06.505482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab2fac-4f70-48eb-91ec-d0af70c4f32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:06.507260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab2fac-4f70-48eb-91ec-d0af70c4f32c service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:06.520325 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1555/3092] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:06.590653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa0576-5a09-4193-87ba-321f12b4ec69 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:06.591550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa0576-5a09-4193-87ba-321f12b4ec69 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:06.592304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa0576-5a09-4193-87ba-321f12b4ec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:06.632964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3faa0576-5a09-4193-87ba-321f12b4ec69 None None] MFA Rules not processed for user `68242b2f7fc447278230f48eaee28396`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:06.648467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3faa0576-5a09-4193-87ba-321f12b4ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:06.714045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab2fac-4f70-48eb-91ec-d0af70c4f32c service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:06.716148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dcab2fac-4f70-48eb-91ec-d0af70c4f32c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:06.730100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab2fac-4f70-48eb-91ec-d0af70c4f32c service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:06.736660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:06.737591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:06.738113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:06.738651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] PATH_INFO: `/v3/projects/1513e7ac9999430ea3d4e63c3fa16235` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:06.741749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1513e7ac9999430ea3d4e63c3fa16235)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:06.744310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:06.818861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1513e7ac9999430ea3d4e63c3fa16235', 'request_id': 'req-11bf695a-d2ab-4326-b150-9555be7fd292'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:06.843015 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1538/3093] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:22:06.843370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1513e7ac9999430ea3d4e63c3fa16235', 'request_id': 'req-11bf695a-d2ab-4326-b150-9555be7fd292'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:06.858804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1513e7ac9999430ea3d4e63c3fa16235', 'request_id': 'req-11bf695a-d2ab-4326-b150-9555be7fd292'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:06.918596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] The token cache is being invalidate because project 1513e7ac9999430ea3d4e63c3fa16235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:06.922332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:06.925638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11bf695a-d2ab-4326-b150-9555be7fd292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:06.928795 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1556/3094] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:06 2022] DELETE /identity/v3/projects/1513e7ac9999430ea3d4e63c3fa16235 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:06.937131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510c872-f96b-463f-a465-9d450a87f869 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:06.937131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510c872-f96b-463f-a465-9d450a87f869 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:06.937438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510c872-f96b-463f-a465-9d450a87f869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:06.966209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8510c872-f96b-463f-a465-9d450a87f869 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:06.968106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8510c872-f96b-463f-a465-9d450a87f869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:07.099980 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1539/3095] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:07.108131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68250b0-92bd-49fe-824a-aca507dfe3e0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:07.108568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68250b0-92bd-49fe-824a-aca507dfe3e0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:07.109013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68250b0-92bd-49fe-824a-aca507dfe3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:07.143116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c68250b0-92bd-49fe-824a-aca507dfe3e0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:07.144818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c68250b0-92bd-49fe-824a-aca507dfe3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:07.170777 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1557/3096] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:22:07.175364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510c872-f96b-463f-a465-9d450a87f869 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:07.210572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510c872-f96b-463f-a465-9d450a87f869 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:07.233814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270696c5-da31-467f-b8eb-6dae2d9aefba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:07.234468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270696c5-da31-467f-b8eb-6dae2d9aefba admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:07.234746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270696c5-da31-467f-b8eb-6dae2d9aefba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:07.235012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270696c5-da31-467f-b8eb-6dae2d9aefba admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:07.235706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270696c5-da31-467f-b8eb-6dae2d9aefba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:22:07.236006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270696c5-da31-467f-b8eb-6dae2d9aefba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:07.237700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270696c5-da31-467f-b8eb-6dae2d9aefba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:07.239888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:07.286495 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1540/3097] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:22:07.292186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68250b0-92bd-49fe-824a-aca507dfe3e0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:07.382370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68250b0-92bd-49fe-824a-aca507dfe3e0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:07.410214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c72d2-a1c0-4745-8336-7ab4ff12981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:07.413074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c72d2-a1c0-4745-8336-7ab4ff12981d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:07.415614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c72d2-a1c0-4745-8336-7ab4ff12981d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:07.419142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c72d2-a1c0-4745-8336-7ab4ff12981d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:07.420528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c72d2-a1c0-4745-8336-7ab4ff12981d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:07.430793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c72d2-a1c0-4745-8336-7ab4ff12981d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:07.620376 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1558/3098] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:07 2022] POST /identity/v3/projects => generated 397 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:07.622035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270696c5-da31-467f-b8eb-6dae2d9aefba admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:07.636468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270696c5-da31-467f-b8eb-6dae2d9aefba admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:07.834714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a53d7-ecd3-4a88-86f5-c85605c39b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:07.836102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a53d7-ecd3-4a88-86f5-c85605c39b3a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:07.837448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a53d7-ecd3-4a88-86f5-c85605c39b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:07.837930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a53d7-ecd3-4a88-86f5-c85605c39b3a admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:07.838784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a53d7-ecd3-4a88-86f5-c85605c39b3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:07.842005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a53d7-ecd3-4a88-86f5-c85605c39b3a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:07.907711 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1541/3099] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:07 2022] POST /identity/v3/users => generated 299 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:07.912292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c72d2-a1c0-4745-8336-7ab4ff12981d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:07.949431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c72d2-a1c0-4745-8336-7ab4ff12981d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:07.972925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c1409-0454-48f4-99e9-6c3fbcc83bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:07.975494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c1409-0454-48f4-99e9-6c3fbcc83bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:07.976464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c1409-0454-48f4-99e9-6c3fbcc83bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:07.976812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c1409-0454-48f4-99e9-6c3fbcc83bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:07.979661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c1409-0454-48f4-99e9-6c3fbcc83bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:07.983460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c1409-0454-48f4-99e9-6c3fbcc83bd8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:08.021231 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1559/3100] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:08.027613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a53d7-ecd3-4a88-86f5-c85605c39b3a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:08.055984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a53d7-ecd3-4a88-86f5-c85605c39b3a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:08.071458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec0c57-63c3-4963-ba3c-aa94ce0c73ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:08.071458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0c57-63c3-4963-ba3c-aa94ce0c73ef admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:08.074291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0c57-63c3-4963-ba3c-aa94ce0c73ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:08.074291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec0c57-63c3-4963-ba3c-aa94ce0c73ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:08.074291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0c57-63c3-4963-ba3c-aa94ce0c73ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:08.098347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec0c57-63c3-4963-ba3c-aa94ce0c73ef admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:08.124858 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1542/3101] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:08.131130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c1409-0454-48f4-99e9-6c3fbcc83bd8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:08.151823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c1409-0454-48f4-99e9-6c3fbcc83bd8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:08.159577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809a32-5c9b-4b9b-ad07-3dde77e7a64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:08.160824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809a32-5c9b-4b9b-ad07-3dde77e7a64f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:08.161502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809a32-5c9b-4b9b-ad07-3dde77e7a64f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:08.162067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b809a32-5c9b-4b9b-ad07-3dde77e7a64f admin admin] PATH_INFO: `/v3/projects/cc7096024f2a46d1bce2a8c8d7aa0804/users/1c1e8b4efdb64ba1ae5d28585fce505d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:08.212342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b809a32-5c9b-4b9b-ad07-3dde77e7a64f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc7096024f2a46d1bce2a8c8d7aa0804, user_id=1c1e8b4efdb64ba1ae5d28585fce505d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:08.216734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b809a32-5c9b-4b9b-ad07-3dde77e7a64f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:08.241847 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1560/3102] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:08 2022] PUT /identity/v3/projects/cc7096024f2a46d1bce2a8c8d7aa0804/users/1c1e8b4efdb64ba1ae5d28585fce505d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:08.260991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f236c2-c1aa-468f-9483-2cdff85a25a0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:08.261792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f236c2-c1aa-468f-9483-2cdff85a25a0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:08.261792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f236c2-c1aa-468f-9483-2cdff85a25a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:08.339354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-95f236c2-c1aa-468f-9483-2cdff85a25a0 None None] MFA Rules not processed for user `1c1e8b4efdb64ba1ae5d28585fce505d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:08.344056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-95f236c2-c1aa-468f-9483-2cdff85a25a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:08.626786 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1543/3103] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:09.465852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809a32-5c9b-4b9b-ad07-3dde77e7a64f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:09.468772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6b809a32-5c9b-4b9b-ad07-3dde77e7a64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:09.600685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:09.757922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b809a32-5c9b-4b9b-ad07-3dde77e7a64f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:09.769852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dac44-f8d0-4f03-8483-f68570cd266c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:09.771120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dac44-f8d0-4f03-8483-f68570cd266c service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:09.772111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dac44-f8d0-4f03-8483-f68570cd266c service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:09.772684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dac44-f8d0-4f03-8483-f68570cd266c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:09.796246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dac44-f8d0-4f03-8483-f68570cd266c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:09.797913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dac44-f8d0-4f03-8483-f68570cd266c service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:09.810376 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1561/3104] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:09 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:09.952856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3c80-ad36-4616-83ca-92a584663431 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:09.953373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3c80-ad36-4616-83ca-92a584663431 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:09.953680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c3c80-ad36-4616-83ca-92a584663431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:10.086178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ff3c3c80-ad36-4616-83ca-92a584663431 None None] MFA Rules not processed for user `1c1e8b4efdb64ba1ae5d28585fce505d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:10.091152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ff3c3c80-ad36-4616-83ca-92a584663431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:10.116658 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1544/3105] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:09 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:10.983314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dac44-f8d0-4f03-8483-f68570cd266c service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:11.156412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dac44-f8d0-4f03-8483-f68570cd266c service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:11.163536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:11.164650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:11.165232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:11.165795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] PATH_INFO: `/v3/users/1c1e8b4efdb64ba1ae5d28585fce505d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:11.167885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1e8b4efdb64ba1ae5d28585fce505d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:11.170525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:11.278495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1e8b4efdb64ba1ae5d28585fce505d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:11.279386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1e8b4efdb64ba1ae5d28585fce505d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:11.297825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1e8b4efdb64ba1ae5d28585fce505d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:11.344092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1e8b4efdb64ba1ae5d28585fce505d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:11.363135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1e8b4efdb64ba1ae5d28585fce505d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:11.372176 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1562/3106] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:10 2022] DELETE /identity/v3/users/1c1e8b4efdb64ba1ae5d28585fce505d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:11.377782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb5422-22ae-4dc2-8d12-136807e0cc38 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:11.377782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb5422-22ae-4dc2-8d12-136807e0cc38 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:11.378443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb5422-22ae-4dc2-8d12-136807e0cc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:11.415574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-59cb5422-22ae-4dc2-8d12-136807e0cc38 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:11.416986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-59cb5422-22ae-4dc2-8d12-136807e0cc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:11.524214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:11.553429 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1545/3107] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:11.573334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:11.575235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:11.762848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb5422-22ae-4dc2-8d12-136807e0cc38 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:11.765069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-59cb5422-22ae-4dc2-8d12-136807e0cc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:11.775981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:11.851411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5295f-3af0-4708-a70f-5769057438c7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:11.864646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cabbd1-eebe-4256-b2b0-ba314fcbf93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:11.865524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cabbd1-eebe-4256-b2b0-ba314fcbf93e service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:11.865951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cabbd1-eebe-4256-b2b0-ba314fcbf93e service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:11.866937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cabbd1-eebe-4256-b2b0-ba314fcbf93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:11.894901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cabbd1-eebe-4256-b2b0-ba314fcbf93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:11.906296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cabbd1-eebe-4256-b2b0-ba314fcbf93e service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:11.935941 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1563/3108] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:11.965443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb5422-22ae-4dc2-8d12-136807e0cc38 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:11.973724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ae07e-f785-4798-a955-495bed1d8c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:11.975514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ae07e-f785-4798-a955-495bed1d8c4a service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:11.975997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ae07e-f785-4798-a955-495bed1d8c4a service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:11.976480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ae07e-f785-4798-a955-495bed1d8c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:11.980972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-490ae07e-f785-4798-a955-495bed1d8c4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:12.133456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ae07e-f785-4798-a955-495bed1d8c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:12.137969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ae07e-f785-4798-a955-495bed1d8c4a service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:12.151900 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1546/3109] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:11 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:13.566123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cabbd1-eebe-4256-b2b0-ba314fcbf93e service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:13.568125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b1cabbd1-eebe-4256-b2b0-ba314fcbf93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:13.591565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cabbd1-eebe-4256-b2b0-ba314fcbf93e service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:13.609831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:13.610861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:13.611207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:13.611589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] PATH_INFO: `/v3/projects/cc7096024f2a46d1bce2a8c8d7aa0804` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:13.620144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc7096024f2a46d1bce2a8c8d7aa0804)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:13.622594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:13.754746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7096024f2a46d1bce2a8c8d7aa0804', 'request_id': 'req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:13.767186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7096024f2a46d1bce2a8c8d7aa0804', 'request_id': 'req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:13.791018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7096024f2a46d1bce2a8c8d7aa0804', 'request_id': 'req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:13.810367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] The token cache is being invalidate because project cc7096024f2a46d1bce2a8c8d7aa0804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:13.810821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:13.811797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d8f688d9-afd4-44a7-b9f2-91f5e711dcf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:13.813969 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1564/3110] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:13 2022] DELETE /identity/v3/projects/cc7096024f2a46d1bce2a8c8d7aa0804 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:13.820113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1116-508d-4b16-ad06-bb17941cd971 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:13.820716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1116-508d-4b16-ad06-bb17941cd971 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:13.820716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1116-508d-4b16-ad06-bb17941cd971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:13.866558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fbab1116-508d-4b16-ad06-bb17941cd971 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:13.871219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fbab1116-508d-4b16-ad06-bb17941cd971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:14.055017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5faaeb-111b-4815-a673-5a8e562f7269 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:14.055833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5faaeb-111b-4815-a673-5a8e562f7269 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:14.055833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5faaeb-111b-4815-a673-5a8e562f7269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:14.064023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1547/3111] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:14.098681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2b5faaeb-111b-4815-a673-5a8e562f7269 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:14.102919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b5faaeb-111b-4815-a673-5a8e562f7269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:14.123724 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1565/3112] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:14.130270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1116-508d-4b16-ad06-bb17941cd971 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:14.155067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1116-508d-4b16-ad06-bb17941cd971 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:14.169046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accadc61-5fa1-4ec1-86dd-19e5ddba2eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:14.169864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accadc61-5fa1-4ec1-86dd-19e5ddba2eba admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:14.170369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accadc61-5fa1-4ec1-86dd-19e5ddba2eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:14.170557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accadc61-5fa1-4ec1-86dd-19e5ddba2eba admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:14.171288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accadc61-5fa1-4ec1-86dd-19e5ddba2eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:22:14.171665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accadc61-5fa1-4ec1-86dd-19e5ddba2eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:14.173378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accadc61-5fa1-4ec1-86dd-19e5ddba2eba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:14.189587 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1548/3113] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:22:14.194694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5faaeb-111b-4815-a673-5a8e562f7269 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:14.209059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5faaeb-111b-4815-a673-5a8e562f7269 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:14.216616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b623b-1a16-424d-a1d0-1df6be5d834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:14.218587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b623b-1a16-424d-a1d0-1df6be5d834c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:14.219213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b623b-1a16-424d-a1d0-1df6be5d834c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:14.219695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b623b-1a16-424d-a1d0-1df6be5d834c admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:14.221289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b623b-1a16-424d-a1d0-1df6be5d834c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:14.224499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b623b-1a16-424d-a1d0-1df6be5d834c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:14.271776 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1566/3114] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:14 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:22:14.279458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accadc61-5fa1-4ec1-86dd-19e5ddba2eba admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:14.292788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accadc61-5fa1-4ec1-86dd-19e5ddba2eba admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:14.327362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:14.416041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c0def-8168-4cd2-a17c-11b5e9abf744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:14.417448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0def-8168-4cd2-a17c-11b5e9abf744 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:14.417851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0def-8168-4cd2-a17c-11b5e9abf744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:14.418260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0def-8168-4cd2-a17c-11b5e9abf744 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:14.419468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c0def-8168-4cd2-a17c-11b5e9abf744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:14.423169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c0def-8168-4cd2-a17c-11b5e9abf744 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:14.471702 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1549/3115] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:14 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:14.475831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b623b-1a16-424d-a1d0-1df6be5d834c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:14.493948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b623b-1a16-424d-a1d0-1df6be5d834c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:14.500945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623816bf-08c8-4d0f-98a2-2b09faced9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:14.502079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623816bf-08c8-4d0f-98a2-2b09faced9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:14.502649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623816bf-08c8-4d0f-98a2-2b09faced9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:14.503190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623816bf-08c8-4d0f-98a2-2b09faced9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:14.504216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623816bf-08c8-4d0f-98a2-2b09faced9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:14.506871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623816bf-08c8-4d0f-98a2-2b09faced9e3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:14.525728 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1567/3116] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:14.530611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c0def-8168-4cd2-a17c-11b5e9abf744 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:14.547418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c0def-8168-4cd2-a17c-11b5e9abf744 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:14.553528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794cb6d-3306-45de-8068-9399d4f6df0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:14.554977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cb6d-3306-45de-8068-9399d4f6df0e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:14.555736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cb6d-3306-45de-8068-9399d4f6df0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:14.556211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794cb6d-3306-45de-8068-9399d4f6df0e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:14.557889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794cb6d-3306-45de-8068-9399d4f6df0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:14.560303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794cb6d-3306-45de-8068-9399d4f6df0e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:14.575468 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1550/3117] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:14.579771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623816bf-08c8-4d0f-98a2-2b09faced9e3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:14.600871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623816bf-08c8-4d0f-98a2-2b09faced9e3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:14.611579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36846b39-619c-42ff-bc33-c6e40a555db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:14.613729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846b39-619c-42ff-bc33-c6e40a555db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:14.614729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846b39-619c-42ff-bc33-c6e40a555db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:14.614939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36846b39-619c-42ff-bc33-c6e40a555db9 admin admin] PATH_INFO: `/v3/projects/d3d737e34eb8482086ffd7cece0a1803/users/2d8dfc007dc44ab1b63b594796172cad/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:14.650713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36846b39-619c-42ff-bc33-c6e40a555db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d737e34eb8482086ffd7cece0a1803, user_id=2d8dfc007dc44ab1b63b594796172cad, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:14.654399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36846b39-619c-42ff-bc33-c6e40a555db9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:14.681123 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1568/3118] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:14 2022] PUT /identity/v3/projects/d3d737e34eb8482086ffd7cece0a1803/users/2d8dfc007dc44ab1b63b594796172cad/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:14.697795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff84324-f587-4583-9b47-6f56854f714b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:14.697795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff84324-f587-4583-9b47-6f56854f714b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:14.697795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff84324-f587-4583-9b47-6f56854f714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:14.729094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cff84324-f587-4583-9b47-6f56854f714b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:14.730995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cff84324-f587-4583-9b47-6f56854f714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:14.911598 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1551/3119] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:14.939667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36846b39-619c-42ff-bc33-c6e40a555db9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:14.946863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-36846b39-619c-42ff-bc33-c6e40a555db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:15.074011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36846b39-619c-42ff-bc33-c6e40a555db9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:15.089828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a2b32-9912-4936-b419-9a3840fac5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:15.091219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a2b32-9912-4936-b419-9a3840fac5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:15.091870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a2b32-9912-4936-b419-9a3840fac5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:15.092411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a2b32-9912-4936-b419-9a3840fac5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:15.108238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a2b32-9912-4936-b419-9a3840fac5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:15.114574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a2b32-9912-4936-b419-9a3840fac5d4 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:15.150141 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1569/3120] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:22:18.739543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b281e-125e-4cff-9fd0-a9b798aab467 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:18.740493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b281e-125e-4cff-9fd0-a9b798aab467 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:18.741748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b281e-125e-4cff-9fd0-a9b798aab467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:18.809321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d97b281e-125e-4cff-9fd0-a9b798aab467 None None] MFA Rules not processed for user `2e944e3030a1404c9862d953fedfb94a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:18.811135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d97b281e-125e-4cff-9fd0-a9b798aab467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:18.990796 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1552/3121] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:19.880635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a2b32-9912-4936-b419-9a3840fac5d4 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:19.885687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-242a2b32-9912-4936-b419-9a3840fac5d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:19.894715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:20.121358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a2b32-9912-4936-b419-9a3840fac5d4 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:20.129677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4af62-c52a-4af9-8262-be7764166506 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:20.130934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4af62-c52a-4af9-8262-be7764166506 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:20.131519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4af62-c52a-4af9-8262-be7764166506 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:20.132240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4af62-c52a-4af9-8262-be7764166506 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:20.142023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4af62-c52a-4af9-8262-be7764166506 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:20.144666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4af62-c52a-4af9-8262-be7764166506 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:20.167897 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1570/3122] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:25.560638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e4e3b-60f6-4d58-bb5e-3bda47534d23 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:25.561244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e4e3b-60f6-4d58-bb5e-3bda47534d23 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:25.561244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e4e3b-60f6-4d58-bb5e-3bda47534d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:25.598728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-598e4e3b-60f6-4d58-bb5e-3bda47534d23 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:25.605164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-598e4e3b-60f6-4d58-bb5e-3bda47534d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:25.674932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:25.728427 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1553/3123] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:22:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:25.758880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4af62-c52a-4af9-8262-be7764166506 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:25.761167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c5b4af62-c52a-4af9-8262-be7764166506 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:25.856678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4af62-c52a-4af9-8262-be7764166506 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:25.863658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa38eb5-f6f1-45fd-9731-9be1bffd1e3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:25.864732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa38eb5-f6f1-45fd-9731-9be1bffd1e3a service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:25.865283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa38eb5-f6f1-45fd-9731-9be1bffd1e3a service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:25.865903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa38eb5-f6f1-45fd-9731-9be1bffd1e3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:25.877491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa38eb5-f6f1-45fd-9731-9be1bffd1e3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:25.882254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa38eb5-f6f1-45fd-9731-9be1bffd1e3a service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:25.930772 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1571/3124] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:22:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:22:27.560244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cad4c-7634-4967-9ea2-0d4372327a37 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:27.562733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cad4c-7634-4967-9ea2-0d4372327a37 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:27.563218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cad4c-7634-4967-9ea2-0d4372327a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:27.601971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ca8cad4c-7634-4967-9ea2-0d4372327a37 None None] MFA Rules not processed for user `2e944e3030a1404c9862d953fedfb94a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:27.603548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ca8cad4c-7634-4967-9ea2-0d4372327a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:27.619496 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1554/3125] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:28.911196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985d8d-31ad-4c40-9812-387cdaf23353 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:28.911627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985d8d-31ad-4c40-9812-387cdaf23353 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:28.911734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50985d8d-31ad-4c40-9812-387cdaf23353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:28.956347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-50985d8d-31ad-4c40-9812-387cdaf23353 None None] MFA Rules not processed for user `2d8dfc007dc44ab1b63b594796172cad`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:28.957479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-50985d8d-31ad-4c40-9812-387cdaf23353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:29.052870 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1572/3126] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:29.057388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cad4c-7634-4967-9ea2-0d4372327a37 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:29.070672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cad4c-7634-4967-9ea2-0d4372327a37 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:29.075667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed4fa9-80f0-4408-b77b-f8f4e50b9cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:29.076303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed4fa9-80f0-4408-b77b-f8f4e50b9cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:29.076577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed4fa9-80f0-4408-b77b-f8f4e50b9cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:29.076845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed4fa9-80f0-4408-b77b-f8f4e50b9cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:29.077493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed4fa9-80f0-4408-b77b-f8f4e50b9cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:29.081282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed4fa9-80f0-4408-b77b-f8f4e50b9cb3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:29.130771 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1555/3127] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:29 2022] POST /identity/v3/projects => generated 377 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:29.138701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50985d8d-31ad-4c40-9812-387cdaf23353 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:29.170461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50985d8d-31ad-4c40-9812-387cdaf23353 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:29.186178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:29.338944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa153285-ce9e-4d06-bcde-a20c8ea81e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:29.340708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa153285-ce9e-4d06-bcde-a20c8ea81e63 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:29.341281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa153285-ce9e-4d06-bcde-a20c8ea81e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:29.341827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa153285-ce9e-4d06-bcde-a20c8ea81e63 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:29.342909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa153285-ce9e-4d06-bcde-a20c8ea81e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:29.346128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa153285-ce9e-4d06-bcde-a20c8ea81e63 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:29.386175 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1573/3128] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:29 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:22:29.387728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed4fa9-80f0-4408-b77b-f8f4e50b9cb3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:29.398909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed4fa9-80f0-4408-b77b-f8f4e50b9cb3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:29.404712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ebef3-5007-461c-8d85-d36aade6a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:29.405743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ebef3-5007-461c-8d85-d36aade6a52e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:29.406285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ebef3-5007-461c-8d85-d36aade6a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:29.407337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ebef3-5007-461c-8d85-d36aade6a52e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:29.408279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ebef3-5007-461c-8d85-d36aade6a52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:29.410895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ebef3-5007-461c-8d85-d36aade6a52e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:29.431680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa153285-ce9e-4d06-bcde-a20c8ea81e63 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:29.432155 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1556/3129] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:29.449807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa153285-ce9e-4d06-bcde-a20c8ea81e63 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:29.459687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546d5ba-a528-400b-812f-9ede4f8f3335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:29.460787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546d5ba-a528-400b-812f-9ede4f8f3335 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:29.461514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546d5ba-a528-400b-812f-9ede4f8f3335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:29.462272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546d5ba-a528-400b-812f-9ede4f8f3335 admin admin] PATH_INFO: `/v3/projects/96aed8ffe54a470dbd5838f03d3b5b55/users/635e6fcdf27c4f79aec507ade4821330/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:29.519824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546d5ba-a528-400b-812f-9ede4f8f3335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96aed8ffe54a470dbd5838f03d3b5b55, user_id=635e6fcdf27c4f79aec507ade4821330, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:29.530144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546d5ba-a528-400b-812f-9ede4f8f3335 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:29.580350 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1574/3130] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:29 2022] PUT /identity/v3/projects/96aed8ffe54a470dbd5838f03d3b5b55/users/635e6fcdf27c4f79aec507ade4821330/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:22:29.581770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ebef3-5007-461c-8d85-d36aade6a52e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:29.598478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ebef3-5007-461c-8d85-d36aade6a52e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:29.765498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdab6d8-0e1d-40b2-8fed-77250097231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:29.768468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab6d8-0e1d-40b2-8fed-77250097231e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:29.768757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab6d8-0e1d-40b2-8fed-77250097231e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:29.770129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab6d8-0e1d-40b2-8fed-77250097231e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:29.770994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdab6d8-0e1d-40b2-8fed-77250097231e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:29.775873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdab6d8-0e1d-40b2-8fed-77250097231e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:29.795860 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1557/3131] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:29.797460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546d5ba-a528-400b-812f-9ede4f8f3335 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:29.810881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546d5ba-a528-400b-812f-9ede4f8f3335 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:29.816216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419d0ef-d533-42bc-b886-ce14294e5d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:29.817269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419d0ef-d533-42bc-b886-ce14294e5d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:29.817593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419d0ef-d533-42bc-b886-ce14294e5d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:29.818563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419d0ef-d533-42bc-b886-ce14294e5d60 admin admin] PATH_INFO: `/v3/projects/96aed8ffe54a470dbd5838f03d3b5b55/users/635e6fcdf27c4f79aec507ade4821330/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:29.820902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419d0ef-d533-42bc-b886-ce14294e5d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96aed8ffe54a470dbd5838f03d3b5b55, user_id=635e6fcdf27c4f79aec507ade4821330, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:29.824443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419d0ef-d533-42bc-b886-ce14294e5d60 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:29.840838 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1575/3132] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:29 2022] PUT /identity/v3/projects/96aed8ffe54a470dbd5838f03d3b5b55/users/635e6fcdf27c4f79aec507ade4821330/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:30.761362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdab6d8-0e1d-40b2-8fed-77250097231e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:30.764172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fdab6d8-0e1d-40b2-8fed-77250097231e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:31.008052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdab6d8-0e1d-40b2-8fed-77250097231e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:31.131269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:31.239204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca744b27-3738-4444-b5df-62eadf75174d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:31.244014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca744b27-3738-4444-b5df-62eadf75174d service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:31.244382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca744b27-3738-4444-b5df-62eadf75174d service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:31.247231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca744b27-3738-4444-b5df-62eadf75174d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:31.254863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ca744b27-3738-4444-b5df-62eadf75174d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:31.490838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca744b27-3738-4444-b5df-62eadf75174d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:31.493342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca744b27-3738-4444-b5df-62eadf75174d service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:31.530281 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1558/3133] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:30 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:39.835126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=41,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:41.524772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=45 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:42.395520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c9c7-f8da-4729-915f-e89805e20c05 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:42.396005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c9c7-f8da-4729-915f-e89805e20c05 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:42.396106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47c9c7-f8da-4729-915f-e89805e20c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:42.450257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7e47c9c7-f8da-4729-915f-e89805e20c05 None None] MFA Rules not processed for user `e5a02f772ad1448ab3d1b67541ca6581`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:42.457234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e47c9c7-f8da-4729-915f-e89805e20c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:42.708599 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1576/3134] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:44.747373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd90db-34d8-4086-91cb-b0c7320d85bd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:44.747953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd90db-34d8-4086-91cb-b0c7320d85bd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:44.747953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd90db-34d8-4086-91cb-b0c7320d85bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:44.777622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cfcd90db-34d8-4086-91cb-b0c7320d85bd None None] MFA Rules not processed for user `e37ffb070d2443f7b8bcf1ed61041a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:44.778946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cfcd90db-34d8-4086-91cb-b0c7320d85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:44.890817 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1559/3135] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:48.098665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947c051-307a-4b52-b74f-5ec39e8ea057 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.099695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947c051-307a-4b52-b74f-5ec39e8ea057 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.100409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947c051-307a-4b52-b74f-5ec39e8ea057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.199215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0947c051-307a-4b52-b74f-5ec39e8ea057 None None] MFA Rules not processed for user `635e6fcdf27c4f79aec507ade4821330`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:48.200852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0947c051-307a-4b52-b74f-5ec39e8ea057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:48.382144 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1577/3136] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:48.397844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd90db-34d8-4086-91cb-b0c7320d85bd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:48.399865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cfcd90db-34d8-4086-91cb-b0c7320d85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:48.567160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd90db-34d8-4086-91cb-b0c7320d85bd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:48.578507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067fda6-cfe3-42db-84e0-e4f9d1681d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:48.579205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067fda6-cfe3-42db-84e0-e4f9d1681d99 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:48.579482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067fda6-cfe3-42db-84e0-e4f9d1681d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:48.579749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067fda6-cfe3-42db-84e0-e4f9d1681d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:48.746978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067fda6-cfe3-42db-84e0-e4f9d1681d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:48.748758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067fda6-cfe3-42db-84e0-e4f9d1681d99 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:48.776560 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1560/3137] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:53.424730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947c051-307a-4b52-b74f-5ec39e8ea057 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:53.435572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0947c051-307a-4b52-b74f-5ec39e8ea057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:53.863381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947c051-307a-4b52-b74f-5ec39e8ea057 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:53.877165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:53.881365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:53.881748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:53.886365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] PATH_INFO: `/v3/users/fc7b08bbe5324298b6429667ed449825` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:53.890530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7b08bbe5324298b6429667ed449825)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:53.894006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:54.010779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:54.076756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7b08bbe5324298b6429667ed449825'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:54.078344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7b08bbe5324298b6429667ed449825'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:54.115662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7b08bbe5324298b6429667ed449825'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:54.134136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7b08bbe5324298b6429667ed449825'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:54.184548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7b08bbe5324298b6429667ed449825'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:54.227585 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1578/3138] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:53 2022] DELETE /identity/v3/users/fc7b08bbe5324298b6429667ed449825 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:55.264983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067fda6-cfe3-42db-84e0-e4f9d1681d99 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:55.291519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067fda6-cfe3-42db-84e0-e4f9d1681d99 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:55.523486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:55.526656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:55.527453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:55.527960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] PATH_INFO: `/v3/projects/a2acae24b5c947cda3bf4c1e67c93c08` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:55.531623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2acae24b5c947cda3bf4c1e67c93c08)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:55.536575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:55.544287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:55.707582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2acae24b5c947cda3bf4c1e67c93c08', 'request_id': 'req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:55.735878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2acae24b5c947cda3bf4c1e67c93c08', 'request_id': 'req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:55.758014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2acae24b5c947cda3bf4c1e67c93c08', 'request_id': 'req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:55.801371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] The token cache is being invalidate because project a2acae24b5c947cda3bf4c1e67c93c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:55.802335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:55.804537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:55.809842 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1561/3139] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:55 2022] DELETE /identity/v3/projects/a2acae24b5c947cda3bf4c1e67c93c08 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:55.813991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:55.817140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:55.852153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79abe4b-0c58-4f7d-806c-d65f59f7b0c1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:56.088000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:56.089137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:56.089758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:56.090255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] PATH_INFO: `/v3/users/1f80b2226866477db509c28bc0717f8f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:56.092232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f80b2226866477db509c28bc0717f8f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:56.096568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:56.222358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f80b2226866477db509c28bc0717f8f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:56.223072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f80b2226866477db509c28bc0717f8f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:56.233471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f80b2226866477db509c28bc0717f8f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:56.250150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f80b2226866477db509c28bc0717f8f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:56.283531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2a20d8d-120a-47ff-b60b-a35794f2a4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f80b2226866477db509c28bc0717f8f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:56.300168 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1579/3140] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:22:55 2022] DELETE /identity/v3/users/1f80b2226866477db509c28bc0717f8f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:57.118844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:57.123873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:57.175069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33f31f-f5e9-43d1-81dc-1a27accd5d8d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:57.331730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:57.334278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:57.334876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:57.338452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] PATH_INFO: `/v3/projects/b97d0c0623c4460b9a4f6cbb3d6f6ae8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:57.342511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97d0c0623c4460b9a4f6cbb3d6f6ae8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:57.350005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:57.486797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97d0c0623c4460b9a4f6cbb3d6f6ae8', 'request_id': 'req-5f28cb77-485c-4233-b20c-315a7f4528fb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.498093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97d0c0623c4460b9a4f6cbb3d6f6ae8', 'request_id': 'req-5f28cb77-485c-4233-b20c-315a7f4528fb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.509726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97d0c0623c4460b9a4f6cbb3d6f6ae8', 'request_id': 'req-5f28cb77-485c-4233-b20c-315a7f4528fb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.525916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] The token cache is being invalidate because project b97d0c0623c4460b9a4f6cbb3d6f6ae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:22:57.526439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.527274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f28cb77-485c-4233-b20c-315a7f4528fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:22:57.529665 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1562/3141] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:57 2022] DELETE /identity/v3/projects/b97d0c0623c4460b9a4f6cbb3d6f6ae8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:57.534689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0daac-c3f9-49f0-b0b8-3a6272ecffbd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:57.535754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0daac-c3f9-49f0-b0b8-3a6272ecffbd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:57.536207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0daac-c3f9-49f0-b0b8-3a6272ecffbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:57.575174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a0f0daac-c3f9-49f0-b0b8-3a6272ecffbd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:57.578208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a0f0daac-c3f9-49f0-b0b8-3a6272ecffbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:57.661082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:57.779139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba340008-338e-4e57-9f20-f0dc0b015bd3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:57.779386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba340008-338e-4e57-9f20-f0dc0b015bd3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:57.779588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba340008-338e-4e57-9f20-f0dc0b015bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:57.780034 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1580/3142] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:57.804635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ba340008-338e-4e57-9f20-f0dc0b015bd3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:57.805926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ba340008-338e-4e57-9f20-f0dc0b015bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:57.815703 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1563/3143] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:22:57.819914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0daac-c3f9-49f0-b0b8-3a6272ecffbd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:57.837463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0daac-c3f9-49f0-b0b8-3a6272ecffbd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:57.851711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553c3ee-bdba-4daf-8ce0-8c34b2e69f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:57.852348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553c3ee-bdba-4daf-8ce0-8c34b2e69f12 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:57.852623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553c3ee-bdba-4daf-8ce0-8c34b2e69f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:57.852890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4553c3ee-bdba-4daf-8ce0-8c34b2e69f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:57.854897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553c3ee-bdba-4daf-8ce0-8c34b2e69f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:22:57.855239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553c3ee-bdba-4daf-8ce0-8c34b2e69f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:57.863397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4553c3ee-bdba-4daf-8ce0-8c34b2e69f12 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:57.930206 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1581/3144] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:22:57.936893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba340008-338e-4e57-9f20-f0dc0b015bd3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:57.949682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba340008-338e-4e57-9f20-f0dc0b015bd3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:57.967834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3155b9-3d9c-48f6-9054-666e9ffb6200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:57.969077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3155b9-3d9c-48f6-9054-666e9ffb6200 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:57.969352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3155b9-3d9c-48f6-9054-666e9ffb6200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:57.969649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3155b9-3d9c-48f6-9054-666e9ffb6200 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:57.973795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3155b9-3d9c-48f6-9054-666e9ffb6200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:57.976417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3155b9-3d9c-48f6-9054-666e9ffb6200 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.006591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:58.033092 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1564/3145] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:22:57 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:22:58.038292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553c3ee-bdba-4daf-8ce0-8c34b2e69f12 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.070243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4553c3ee-bdba-4daf-8ce0-8c34b2e69f12 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.200479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad4d6-d46a-4ef6-91f3-dff9b67b74a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.201151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad4d6-d46a-4ef6-91f3-dff9b67b74a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.201697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad4d6-d46a-4ef6-91f3-dff9b67b74a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.201697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad4d6-d46a-4ef6-91f3-dff9b67b74a4 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.202384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ad4d6-d46a-4ef6-91f3-dff9b67b74a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.205157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ad4d6-d46a-4ef6-91f3-dff9b67b74a4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.276217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3155b9-3d9c-48f6-9054-666e9ffb6200 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.278528 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1582/3146] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:22:58 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:22:58.310424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3155b9-3d9c-48f6-9054-666e9ffb6200 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.326477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7dfd6-d2a2-400c-855e-08297d5d2bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.327131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7dfd6-d2a2-400c-855e-08297d5d2bac admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.327452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7dfd6-d2a2-400c-855e-08297d5d2bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.327831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7dfd6-d2a2-400c-855e-08297d5d2bac admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.328539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7dfd6-d2a2-400c-855e-08297d5d2bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.338491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7dfd6-d2a2-400c-855e-08297d5d2bac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.371054 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1565/3147] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:22:58.376657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad4d6-d46a-4ef6-91f3-dff9b67b74a4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.391619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad4d6-d46a-4ef6-91f3-dff9b67b74a4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.408553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3d004-c23f-4bcb-8e1f-11184cea73c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.409218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3d004-c23f-4bcb-8e1f-11184cea73c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.409529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3d004-c23f-4bcb-8e1f-11184cea73c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.409790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3d004-c23f-4bcb-8e1f-11184cea73c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.410485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3d004-c23f-4bcb-8e1f-11184cea73c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.412354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3d004-c23f-4bcb-8e1f-11184cea73c8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.441940 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1583/3148] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:22:58.446956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7dfd6-d2a2-400c-855e-08297d5d2bac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.458000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7dfd6-d2a2-400c-855e-08297d5d2bac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.472419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751c464-9aae-427e-bab4-c21e847f5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.473117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751c464-9aae-427e-bab4-c21e847f5cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.473396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751c464-9aae-427e-bab4-c21e847f5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.473669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751c464-9aae-427e-bab4-c21e847f5cfe admin admin] PATH_INFO: `/v3/projects/51ff21f4b54d457ea7b538370b433058/users/345ef77f0aba4db68bea7b29421becd4/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.497025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751c464-9aae-427e-bab4-c21e847f5cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ff21f4b54d457ea7b538370b433058, user_id=345ef77f0aba4db68bea7b29421becd4, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:58.499780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751c464-9aae-427e-bab4-c21e847f5cfe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:58.524913 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1566/3149] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:22:58 2022] PUT /identity/v3/projects/51ff21f4b54d457ea7b538370b433058/users/345ef77f0aba4db68bea7b29421becd4/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:22:58.526926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a33d2b-bab6-4e83-b656-9eeed7e85afb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.527632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a33d2b-bab6-4e83-b656-9eeed7e85afb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.527913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a33d2b-bab6-4e83-b656-9eeed7e85afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:58.558447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-30a33d2b-bab6-4e83-b656-9eeed7e85afb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:58.560580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-30a33d2b-bab6-4e83-b656-9eeed7e85afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:58.689253 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1584/3150] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:22:58.710261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751c464-9aae-427e-bab4-c21e847f5cfe admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:22:58.712049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6751c464-9aae-427e-bab4-c21e847f5cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:22:58.970871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751c464-9aae-427e-bab4-c21e847f5cfe admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:22:58.987412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3907ee-df5b-459c-bcd6-eef599938f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:22:58.987412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3907ee-df5b-459c-bcd6-eef599938f03 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:58.987412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3907ee-df5b-459c-bcd6-eef599938f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:58.987412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3907ee-df5b-459c-bcd6-eef599938f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:59.079881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3907ee-df5b-459c-bcd6-eef599938f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:22:59.087863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3907ee-df5b-459c-bcd6-eef599938f03 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:22:59.152249 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1567/3151] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:22:59.868793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e86380-87f8-4ebc-b1ae-70f3dbf0f242 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:22:59.869376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e86380-87f8-4ebc-b1ae-70f3dbf0f242 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:22:59.869485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e86380-87f8-4ebc-b1ae-70f3dbf0f242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:22:59.949992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-84e86380-87f8-4ebc-b1ae-70f3dbf0f242 None None] MFA Rules not processed for user `16b4da39b4ad4cee98c185bfa7e6f054`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:22:59.951382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-84e86380-87f8-4ebc-b1ae-70f3dbf0f242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:00.064999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:00.153301 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1585/3152] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:22:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:09.128147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:09.635944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bb637-0a20-4926-b252-944455046ef1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:09.636757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bb637-0a20-4926-b252-944455046ef1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:09.637048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bb637-0a20-4926-b252-944455046ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:09.672786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9c9bb637-0a20-4926-b252-944455046ef1 None None] MFA Rules not processed for user `345ef77f0aba4db68bea7b29421becd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:09.674683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c9bb637-0a20-4926-b252-944455046ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:09.784407 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1568/3153] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:09.863817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dbdf8-0bcc-4bff-9161-18e740b69cee None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:09.864345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dbdf8-0bcc-4bff-9161-18e740b69cee None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:09.865395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dbdf8-0bcc-4bff-9161-18e740b69cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:09.900786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-363dbdf8-0bcc-4bff-9161-18e740b69cee None None] MFA Rules not processed for user `345ef77f0aba4db68bea7b29421becd4`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:09.902127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-363dbdf8-0bcc-4bff-9161-18e740b69cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:09.913922 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1586/3154] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:10.351411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bb637-0a20-4926-b252-944455046ef1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:10.353608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c9bb637-0a20-4926-b252-944455046ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:10.476095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bb637-0a20-4926-b252-944455046ef1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:10.485994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c2108-9b08-4a39-9972-2bc5ddf5c4da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:10.486670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c2108-9b08-4a39-9972-2bc5ddf5c4da service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:10.487272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c2108-9b08-4a39-9972-2bc5ddf5c4da service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:10.487565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c2108-9b08-4a39-9972-2bc5ddf5c4da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:10.508520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c2108-9b08-4a39-9972-2bc5ddf5c4da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:10.511241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c2108-9b08-4a39-9972-2bc5ddf5c4da service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:10.542213 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1569/3155] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:19.889950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=12 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:20.518010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=66 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:29.465192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dbdf8-0bcc-4bff-9161-18e740b69cee None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.467282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-363dbdf8-0bcc-4bff-9161-18e740b69cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:29.495570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c2108-9b08-4a39-9972-2bc5ddf5c4da service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.499338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dbdf8-0bcc-4bff-9161-18e740b69cee None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.507297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.507773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c2108-9b08-4a39-9972-2bc5ddf5c4da service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:29.508406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.509497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.510081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] PATH_INFO: `/v3/users/68242b2f7fc447278230f48eaee28396` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.511775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=68242b2f7fc447278230f48eaee28396)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.514372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.517114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b58465-d1c3-45ec-bccb-f08163a0fb37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:29.518122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58465-d1c3-45ec-bccb-f08163a0fb37 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:29.518400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58465-d1c3-45ec-bccb-f08163a0fb37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:29.518951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58465-d1c3-45ec-bccb-f08163a0fb37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:29.524394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-30b58465-d1c3-45ec-bccb-f08163a0fb37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:29.547748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b58465-d1c3-45ec-bccb-f08163a0fb37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:29.549917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b58465-d1c3-45ec-bccb-f08163a0fb37 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:29.564324 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1570/3156] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:23:29.603160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68242b2f7fc447278230f48eaee28396'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:29.603893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68242b2f7fc447278230f48eaee28396'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:29.612161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68242b2f7fc447278230f48eaee28396'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:29.621807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68242b2f7fc447278230f48eaee28396'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:29.642805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ae07d083-70ea-4989-8ee6-581db7ec8c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68242b2f7fc447278230f48eaee28396'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:29.650827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1587/3157] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:29 2022] DELETE /identity/v3/users/68242b2f7fc447278230f48eaee28396 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:29.872555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b58465-d1c3-45ec-bccb-f08163a0fb37 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:29.886542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b58465-d1c3-45ec-bccb-f08163a0fb37 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:30.001315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:30.002313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.002941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.003391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] PATH_INFO: `/v3/projects/cca7040daf57463e9ccabccb8b86dcdd` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.006108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca7040daf57463e9ccabccb8b86dcdd)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:30.008845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:30.079501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca7040daf57463e9ccabccb8b86dcdd', 'request_id': 'req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:30.093228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca7040daf57463e9ccabccb8b86dcdd', 'request_id': 'req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:30.102247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca7040daf57463e9ccabccb8b86dcdd', 'request_id': 'req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:30.124441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] The token cache is being invalidate because project cca7040daf57463e9ccabccb8b86dcdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:30.124953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:30.126081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8d7c2ea-fc2e-4e90-a25b-40542b152be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:30.133961 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1571/3158] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:29 2022] DELETE /identity/v3/projects/cca7040daf57463e9ccabccb8b86dcdd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:30.136363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1741-fd59-4d74-99fc-351a26a0315f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.137006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1741-fd59-4d74-99fc-351a26a0315f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.137621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc1741-fd59-4d74-99fc-351a26a0315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.164947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-50fc1741-fd59-4d74-99fc-351a26a0315f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:30.166213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-50fc1741-fd59-4d74-99fc-351a26a0315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:30.284510 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1588/3159] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:30.302782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413908c-fdf8-478c-a2cc-e9fed0466263 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.303386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413908c-fdf8-478c-a2cc-e9fed0466263 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.303736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413908c-fdf8-478c-a2cc-e9fed0466263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.358834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7413908c-fdf8-478c-a2cc-e9fed0466263 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:30.360340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7413908c-fdf8-478c-a2cc-e9fed0466263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:30.371197 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1572/3160] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:30.376413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc1741-fd59-4d74-99fc-351a26a0315f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:30.392134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc1741-fd59-4d74-99fc-351a26a0315f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:30.397703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b065030-06d0-4307-a75e-e0e3409ba627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:30.399195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b065030-06d0-4307-a75e-e0e3409ba627 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.399874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b065030-06d0-4307-a75e-e0e3409ba627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.400391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b065030-06d0-4307-a75e-e0e3409ba627 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.401201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b065030-06d0-4307-a75e-e0e3409ba627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:30.401631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b065030-06d0-4307-a75e-e0e3409ba627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:30.404640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b065030-06d0-4307-a75e-e0e3409ba627 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:30.433934 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1589/3161] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:30.434057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413908c-fdf8-478c-a2cc-e9fed0466263 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:30.443787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413908c-fdf8-478c-a2cc-e9fed0466263 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:30.449030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342016b-1394-4b88-a546-7767b0fb13d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:30.449732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342016b-1394-4b88-a546-7767b0fb13d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.450105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342016b-1394-4b88-a546-7767b0fb13d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.450444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2342016b-1394-4b88-a546-7767b0fb13d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.451168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342016b-1394-4b88-a546-7767b0fb13d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:30.453238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2342016b-1394-4b88-a546-7767b0fb13d5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:30.504344 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1573/3162] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:30 2022] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:30.506256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b065030-06d0-4307-a75e-e0e3409ba627 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:30.516908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b065030-06d0-4307-a75e-e0e3409ba627 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:30.618168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f9fd1-2c7b-47ca-ad0d-5d2eb74275f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:30.619675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f9fd1-2c7b-47ca-ad0d-5d2eb74275f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.620055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f9fd1-2c7b-47ca-ad0d-5d2eb74275f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.620417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f9fd1-2c7b-47ca-ad0d-5d2eb74275f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.621271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f9fd1-2c7b-47ca-ad0d-5d2eb74275f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:30.623641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f9fd1-2c7b-47ca-ad0d-5d2eb74275f8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:30.633734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:30.689363 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1590/3163] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:30 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:30.690045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342016b-1394-4b88-a546-7767b0fb13d5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:30.703284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2342016b-1394-4b88-a546-7767b0fb13d5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:30.709790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074c7d-b87c-4448-a490-8b83f7eafbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:30.710469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074c7d-b87c-4448-a490-8b83f7eafbbb admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.710799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074c7d-b87c-4448-a490-8b83f7eafbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.711076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074c7d-b87c-4448-a490-8b83f7eafbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.711793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76074c7d-b87c-4448-a490-8b83f7eafbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:30.713755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76074c7d-b87c-4448-a490-8b83f7eafbbb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:30.727545 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1574/3164] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:30.732483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f9fd1-2c7b-47ca-ad0d-5d2eb74275f8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:30.747775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f9fd1-2c7b-47ca-ad0d-5d2eb74275f8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:30.753353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ff714-a5ef-4d3f-a514-34ed262fd3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:30.754097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ff714-a5ef-4d3f-a514-34ed262fd3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.754422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ff714-a5ef-4d3f-a514-34ed262fd3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.754700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ff714-a5ef-4d3f-a514-34ed262fd3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.755465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ff714-a5ef-4d3f-a514-34ed262fd3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:30.757080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ff714-a5ef-4d3f-a514-34ed262fd3b7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:30.774159 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1591/3165] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:30.775911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074c7d-b87c-4448-a490-8b83f7eafbbb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:30.799976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074c7d-b87c-4448-a490-8b83f7eafbbb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:30.811816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3d995-69bd-473d-acf7-49305cd3cdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:30.812857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d995-69bd-473d-acf7-49305cd3cdc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.813143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d995-69bd-473d-acf7-49305cd3cdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.813435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d995-69bd-473d-acf7-49305cd3cdc9 admin admin] PATH_INFO: `/v3/projects/78e54ec6dad74d4b85876689aeaab833/users/02f472dc41b84e428eeb0b43299a37fe/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.843914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3d995-69bd-473d-acf7-49305cd3cdc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e54ec6dad74d4b85876689aeaab833, user_id=02f472dc41b84e428eeb0b43299a37fe, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:30.847222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3d995-69bd-473d-acf7-49305cd3cdc9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:30.869403 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1575/3166] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:30 2022] PUT /identity/v3/projects/78e54ec6dad74d4b85876689aeaab833/users/02f472dc41b84e428eeb0b43299a37fe/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:30.873625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cce7e-d5d5-485f-ab5c-f0b1fb71eded None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:30.874946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cce7e-d5d5-485f-ab5c-f0b1fb71eded None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:30.875333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cce7e-d5d5-485f-ab5c-f0b1fb71eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:30.912391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-dc7cce7e-d5d5-485f-ab5c-f0b1fb71eded None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:30.914068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dc7cce7e-d5d5-485f-ab5c-f0b1fb71eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:31.010033 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1592/3167] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:31.019878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3d995-69bd-473d-acf7-49305cd3cdc9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:31.022370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-60d3d995-69bd-473d-acf7-49305cd3cdc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:31.030435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:31.110814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3d995-69bd-473d-acf7-49305cd3cdc9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:31.115912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29542a64-4ead-41ad-b44e-d98bd62c5e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:31.116877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29542a64-4ead-41ad-b44e-d98bd62c5e3d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:31.117477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29542a64-4ead-41ad-b44e-d98bd62c5e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:31.117982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29542a64-4ead-41ad-b44e-d98bd62c5e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:31.130928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29542a64-4ead-41ad-b44e-d98bd62c5e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:31.132699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29542a64-4ead-41ad-b44e-d98bd62c5e3d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:31.169435 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1576/3168] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:38.622462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cce7e-d5d5-485f-ab5c-f0b1fb71eded None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:38.623966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dc7cce7e-d5d5-485f-ab5c-f0b1fb71eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:38.644460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cce7e-d5d5-485f-ab5c-f0b1fb71eded None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:38.654496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623d22-e663-46cd-b66f-64b405a65ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:38.655935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623d22-e663-46cd-b66f-64b405a65ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:38.656500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623d22-e663-46cd-b66f-64b405a65ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:38.656961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623d22-e663-46cd-b66f-64b405a65ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:38.659516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-af623d22-e663-46cd-b66f-64b405a65ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:38.761628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af623d22-e663-46cd-b66f-64b405a65ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:38.764423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af623d22-e663-46cd-b66f-64b405a65ed1 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:38.779503 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1593/3169] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:41.067643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2ace0-0486-41ec-aa48-a39125fec9fc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:41.068267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2ace0-0486-41ec-aa48-a39125fec9fc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:41.068588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2ace0-0486-41ec-aa48-a39125fec9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:41.160840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b2c2ace0-0486-41ec-aa48-a39125fec9fc None None] MFA Rules not processed for user `02f472dc41b84e428eeb0b43299a37fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:41.163504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b2c2ace0-0486-41ec-aa48-a39125fec9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:41.315190 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1577/3170] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:41.335103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623d22-e663-46cd-b66f-64b405a65ed1 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:41.337076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-af623d22-e663-46cd-b66f-64b405a65ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:41.358386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623d22-e663-46cd-b66f-64b405a65ed1 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:41.371874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87380bbd-5961-4f52-890e-e511a735484b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:41.372813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87380bbd-5961-4f52-890e-e511a735484b service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:41.373241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87380bbd-5961-4f52-890e-e511a735484b service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:41.373648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87380bbd-5961-4f52-890e-e511a735484b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:41.385973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87380bbd-5961-4f52-890e-e511a735484b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:41.387833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87380bbd-5961-4f52-890e-e511a735484b service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:41.399925 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1594/3171] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:42.309461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2ace0-0486-41ec-aa48-a39125fec9fc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:42.326113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2ace0-0486-41ec-aa48-a39125fec9fc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:42.339889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e905-7023-4fea-b89a-7560a67a0ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:42.341003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e905-7023-4fea-b89a-7560a67a0ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:42.341757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e905-7023-4fea-b89a-7560a67a0ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:42.344235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e905-7023-4fea-b89a-7560a67a0ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:42.347566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3be9e905-7023-4fea-b89a-7560a67a0ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:42.385094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9e905-7023-4fea-b89a-7560a67a0ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:42.387018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9e905-7023-4fea-b89a-7560a67a0ae2 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:42.404744 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1578/3172] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:47.218321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c403-8750-4cd4-9bcf-3db1032a52b2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:47.219269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c403-8750-4cd4-9bcf-3db1032a52b2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:47.219783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c403-8750-4cd4-9bcf-3db1032a52b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:47.250341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c4e7c403-8750-4cd4-9bcf-3db1032a52b2 None None] MFA Rules not processed for user `02f472dc41b84e428eeb0b43299a37fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:47.252052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c4e7c403-8750-4cd4-9bcf-3db1032a52b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:47.264356 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1595/3173] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:49.581657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f70dc8-a27e-4cfd-a7a0-18c117d0e8c8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:49.581657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f70dc8-a27e-4cfd-a7a0-18c117d0e8c8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:49.581657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f70dc8-a27e-4cfd-a7a0-18c117d0e8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:49.637195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d3f70dc8-a27e-4cfd-a7a0-18c117d0e8c8 None None] MFA Rules not processed for user `2d8dfc007dc44ab1b63b594796172cad`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:49.640941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d3f70dc8-a27e-4cfd-a7a0-18c117d0e8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:49.711791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7c403-8750-4cd4-9bcf-3db1032a52b2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:49.713467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c4e7c403-8750-4cd4-9bcf-3db1032a52b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:49.755831 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1579/3174] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:49.766752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d550af-b007-4a29-ae4c-2d6706af4bce None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:49.768144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d550af-b007-4a29-ae4c-2d6706af4bce None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:49.768520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d550af-b007-4a29-ae4c-2d6706af4bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:49.801388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:49.805620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-69d550af-b007-4a29-ae4c-2d6706af4bce None None] MFA Rules not processed for user `2d8dfc007dc44ab1b63b594796172cad`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:49.824074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-69d550af-b007-4a29-ae4c-2d6706af4bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:49.837098 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1580/3175] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:23:49.855231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7c403-8750-4cd4-9bcf-3db1032a52b2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:49.887197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765a5b-af4c-4e46-88f0-df0ab4b5ea23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:49.888180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765a5b-af4c-4e46-88f0-df0ab4b5ea23 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:49.888636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765a5b-af4c-4e46-88f0-df0ab4b5ea23 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:49.889621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70765a5b-af4c-4e46-88f0-df0ab4b5ea23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:49.891925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-70765a5b-af4c-4e46-88f0-df0ab4b5ea23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:49.916830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70765a5b-af4c-4e46-88f0-df0ab4b5ea23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:49.918834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70765a5b-af4c-4e46-88f0-df0ab4b5ea23 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:49.934307 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1596/3176] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:50.742513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d550af-b007-4a29-ae4c-2d6706af4bce None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:50.745521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-69d550af-b007-4a29-ae4c-2d6706af4bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:50.778220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d550af-b007-4a29-ae4c-2d6706af4bce None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:50.796986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e13d1b-569e-46be-8593-f05ca0c198f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:50.797621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e13d1b-569e-46be-8593-f05ca0c198f0 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:50.798034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e13d1b-569e-46be-8593-f05ca0c198f0 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:50.798178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e13d1b-569e-46be-8593-f05ca0c198f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:50.803170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-17e13d1b-569e-46be-8593-f05ca0c198f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:50.831470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e13d1b-569e-46be-8593-f05ca0c198f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:50.834041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e13d1b-569e-46be-8593-f05ca0c198f0 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:50.884078 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1581/3177] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:51.093513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765a5b-af4c-4e46-88f0-df0ab4b5ea23 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:51.099599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-70765a5b-af4c-4e46-88f0-df0ab4b5ea23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:51.134092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70765a5b-af4c-4e46-88f0-df0ab4b5ea23 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:51.148942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:51.149683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:51.151796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:51.152247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] PATH_INFO: `/v3/users/0b4617ac955e438c979ca0938ee117c1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:51.155565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4617ac955e438c979ca0938ee117c1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:51.158044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:51.318829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4617ac955e438c979ca0938ee117c1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:51.319611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4617ac955e438c979ca0938ee117c1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:51.340527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4617ac955e438c979ca0938ee117c1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:51.354850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4617ac955e438c979ca0938ee117c1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:51.419271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4617ac955e438c979ca0938ee117c1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:51.439660 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1597/3178] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:51 2022] DELETE /identity/v3/users/0b4617ac955e438c979ca0938ee117c1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:52.463597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e13d1b-569e-46be-8593-f05ca0c198f0 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:52.497365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e13d1b-569e-46be-8593-f05ca0c198f0 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:52.508082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:52.630844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:52.631699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:52.632112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:52.632524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] PATH_INFO: `/v3/projects/fb902a62020246c8ade79bd43ff6755f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:52.633971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb902a62020246c8ade79bd43ff6755f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:52.645112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:52.755031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb902a62020246c8ade79bd43ff6755f', 'request_id': 'req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:52.764560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb902a62020246c8ade79bd43ff6755f', 'request_id': 'req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:52.775363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb902a62020246c8ade79bd43ff6755f', 'request_id': 'req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:52.791123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] The token cache is being invalidate because project fb902a62020246c8ade79bd43ff6755f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:52.791557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:52.792645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:52.795878 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1582/3179] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:52 2022] DELETE /identity/v3/projects/fb902a62020246c8ade79bd43ff6755f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:52.800682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:52.803215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:52.829485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4c5be-6f93-4b04-860b-a2c6837e066a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:52.962806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:52.963479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:52.964858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:52.965145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] PATH_INFO: `/v3/users/b636296d33514d3b9dc8c03398b7410b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:52.966641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b636296d33514d3b9dc8c03398b7410b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:52.969008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:53.106414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b636296d33514d3b9dc8c03398b7410b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:53.111014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b636296d33514d3b9dc8c03398b7410b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:53.112684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:53.137478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b636296d33514d3b9dc8c03398b7410b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:53.159614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b636296d33514d3b9dc8c03398b7410b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:53.195870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-45feeeef-3fe0-4276-867a-abe057ac4c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b636296d33514d3b9dc8c03398b7410b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:53.213569 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1598/3180] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:52 2022] DELETE /identity/v3/users/b636296d33514d3b9dc8c03398b7410b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:53.827568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:53.829048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:53.856454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2136e-7a86-4cc6-8bb1-709869a83d2d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:53.968730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:53.970724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:53.971226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:53.971645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] PATH_INFO: `/v3/projects/0965b23050524d06b3fe3d3349f51b80` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:53.974667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0965b23050524d06b3fe3d3349f51b80)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:53.976973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:54.057891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:54.068053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0965b23050524d06b3fe3d3349f51b80', 'request_id': 'req-7e61deaa-b326-4f33-9151-324a28d35a55'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:54.084174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0965b23050524d06b3fe3d3349f51b80', 'request_id': 'req-7e61deaa-b326-4f33-9151-324a28d35a55'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:54.093559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0965b23050524d06b3fe3d3349f51b80', 'request_id': 'req-7e61deaa-b326-4f33-9151-324a28d35a55'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:54.107707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] The token cache is being invalidate because project 0965b23050524d06b3fe3d3349f51b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:54.108008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:54.108682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e61deaa-b326-4f33-9151-324a28d35a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:54.112087 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1583/3181] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:53 2022] DELETE /identity/v3/projects/0965b23050524d06b3fe3d3349f51b80 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:54.117488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8b56-703f-4ccc-9a11-ce34f2ebc304 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:54.117986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8b56-703f-4ccc-9a11-ce34f2ebc304 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:54.118075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8b56-703f-4ccc-9a11-ce34f2ebc304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:54.165385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d7ff8b56-703f-4ccc-9a11-ce34f2ebc304 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:54.168640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d7ff8b56-703f-4ccc-9a11-ce34f2ebc304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:54.335317 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1599/3182] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:54.343362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62b53-c750-473a-a500-68a5a277a9a7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:54.343903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62b53-c750-473a-a500-68a5a277a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:54.344425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f62b53-c750-473a-a500-68a5a277a9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:54.389550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e8f62b53-c750-473a-a500-68a5a277a9a7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:54.390761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e8f62b53-c750-473a-a500-68a5a277a9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:54.405746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff8b56-703f-4ccc-9a11-ce34f2ebc304 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:54.412959 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1584/3183] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:54.417436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff8b56-703f-4ccc-9a11-ce34f2ebc304 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:54.436422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2902-6e80-4f8e-b942-8f57b8b74977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:54.437091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2902-6e80-4f8e-b942-8f57b8b74977 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:54.437371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2902-6e80-4f8e-b942-8f57b8b74977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:54.437791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc2902-6e80-4f8e-b942-8f57b8b74977 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:54.438697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc2902-6e80-4f8e-b942-8f57b8b74977 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:54.439000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc2902-6e80-4f8e-b942-8f57b8b74977 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:54.440635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc2902-6e80-4f8e-b942-8f57b8b74977 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:54.469992 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1600/3184] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:54.475069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f62b53-c750-473a-a500-68a5a277a9a7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:54.489161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f62b53-c750-473a-a500-68a5a277a9a7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:54.495652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3ef1f-c97e-41bf-bac1-17fe5e20f052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:54.497867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3ef1f-c97e-41bf-bac1-17fe5e20f052 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:54.497867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3ef1f-c97e-41bf-bac1-17fe5e20f052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:54.497867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3ef1f-c97e-41bf-bac1-17fe5e20f052 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:54.498861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3ef1f-c97e-41bf-bac1-17fe5e20f052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:54.502065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3ef1f-c97e-41bf-bac1-17fe5e20f052 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:54.560753 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1585/3185] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:54 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:54.565191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2902-6e80-4f8e-b942-8f57b8b74977 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:54.581189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc2902-6e80-4f8e-b942-8f57b8b74977 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:54.717520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc9fdd-7acb-486a-9415-ce0555ffea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:54.718487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc9fdd-7acb-486a-9415-ce0555ffea3c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:54.721054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc9fdd-7acb-486a-9415-ce0555ffea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:54.721701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc9fdd-7acb-486a-9415-ce0555ffea3c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:54.723407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc9fdd-7acb-486a-9415-ce0555ffea3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:54.744486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc9fdd-7acb-486a-9415-ce0555ffea3c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:54.779334 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1601/3186] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:54 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:54.783304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3ef1f-c97e-41bf-bac1-17fe5e20f052 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:54.796815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3ef1f-c97e-41bf-bac1-17fe5e20f052 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:54.803767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe1d5-db71-4ba0-af5c-52cb0e5b9bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:54.804566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe1d5-db71-4ba0-af5c-52cb0e5b9bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:54.804852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe1d5-db71-4ba0-af5c-52cb0e5b9bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:54.805141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe1d5-db71-4ba0-af5c-52cb0e5b9bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:54.806246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efe1d5-db71-4ba0-af5c-52cb0e5b9bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:54.808148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efe1d5-db71-4ba0-af5c-52cb0e5b9bd6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:54.831338 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1586/3187] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:54.836082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc9fdd-7acb-486a-9415-ce0555ffea3c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:54.851397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc9fdd-7acb-486a-9415-ce0555ffea3c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:54.864382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2da3d1-5d8d-49b7-97a7-4f2da6b7747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:54.865210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2da3d1-5d8d-49b7-97a7-4f2da6b7747a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:54.867552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2da3d1-5d8d-49b7-97a7-4f2da6b7747a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:54.867836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2da3d1-5d8d-49b7-97a7-4f2da6b7747a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:54.869795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2da3d1-5d8d-49b7-97a7-4f2da6b7747a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:54.871771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2da3d1-5d8d-49b7-97a7-4f2da6b7747a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:54.891250 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1602/3188] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:23:54.896118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe1d5-db71-4ba0-af5c-52cb0e5b9bd6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:54.912197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe1d5-db71-4ba0-af5c-52cb0e5b9bd6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:54.933022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaf5b1-235a-40e2-a3ea-a4a08f7c9e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:54.933748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaf5b1-235a-40e2-a3ea-a4a08f7c9e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:54.934062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaf5b1-235a-40e2-a3ea-a4a08f7c9e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:54.934341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaf5b1-235a-40e2-a3ea-a4a08f7c9e05 admin admin] PATH_INFO: `/v3/projects/579eaf95502143658fee5c78549af85c/users/377df607378542a5a1ba70c96e9f8b05/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:55.030456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaf5b1-235a-40e2-a3ea-a4a08f7c9e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=579eaf95502143658fee5c78549af85c, user_id=377df607378542a5a1ba70c96e9f8b05, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:55.033362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaf5b1-235a-40e2-a3ea-a4a08f7c9e05 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:55.083796 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1587/3189] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:54 2022] PUT /identity/v3/projects/579eaf95502143658fee5c78549af85c/users/377df607378542a5a1ba70c96e9f8b05/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:55.094118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231e092-1150-4ce9-9a79-24658c6f501f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:55.094749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231e092-1150-4ce9-9a79-24658c6f501f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:55.095209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231e092-1150-4ce9-9a79-24658c6f501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:55.146478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7231e092-1150-4ce9-9a79-24658c6f501f None None] MFA Rules not processed for user `377df607378542a5a1ba70c96e9f8b05`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:55.150318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7231e092-1150-4ce9-9a79-24658c6f501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:55.204374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:55.342104 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1603/3190] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:55.346527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaf5b1-235a-40e2-a3ea-a4a08f7c9e05 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:55.447936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231e092-1150-4ce9-9a79-24658c6f501f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:55.450898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7231e092-1150-4ce9-9a79-24658c6f501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:55.499285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaf5b1-235a-40e2-a3ea-a4a08f7c9e05 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:55.517323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659e1c6-74da-4ceb-b70e-d3e8820eeb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:55.534412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659e1c6-74da-4ceb-b70e-d3e8820eeb95 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:55.534706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659e1c6-74da-4ceb-b70e-d3e8820eeb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:55.534993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659e1c6-74da-4ceb-b70e-d3e8820eeb95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:55.535876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659e1c6-74da-4ceb-b70e-d3e8820eeb95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:55.537965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659e1c6-74da-4ceb-b70e-d3e8820eeb95 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:55.587137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231e092-1150-4ce9-9a79-24658c6f501f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:55.592723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349f23e-905c-4231-9e7e-d5335b0d1a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:55.594138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f23e-905c-4231-9e7e-d5335b0d1a45 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:55.594955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f23e-905c-4231-9e7e-d5335b0d1a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:55.595069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349f23e-905c-4231-9e7e-d5335b0d1a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:55.597570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5349f23e-905c-4231-9e7e-d5335b0d1a45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:55.615873 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1588/3191] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:55 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:55.619758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659e1c6-74da-4ceb-b70e-d3e8820eeb95 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:55.645620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349f23e-905c-4231-9e7e-d5335b0d1a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:55.651699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349f23e-905c-4231-9e7e-d5335b0d1a45 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:55.672332 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1604/3192] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:23:55.699968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:55.748549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659e1c6-74da-4ceb-b70e-d3e8820eeb95 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:55.758591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aadc0-f326-4c7a-9393-4b59af532295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:55.760432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aadc0-f326-4c7a-9393-4b59af532295 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:55.761848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aadc0-f326-4c7a-9393-4b59af532295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:55.762342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7aadc0-f326-4c7a-9393-4b59af532295 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:55.763368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7aadc0-f326-4c7a-9393-4b59af532295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:55.767731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7aadc0-f326-4c7a-9393-4b59af532295 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:55.810238 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1589/3193] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:55 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:55.811161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349f23e-905c-4231-9e7e-d5335b0d1a45 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:55.829678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349f23e-905c-4231-9e7e-d5335b0d1a45 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:55.836313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ae727-c802-4cd4-ac96-bc80cb4b5b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:55.837285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ae727-c802-4cd4-ac96-bc80cb4b5b0c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:55.837657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ae727-c802-4cd4-ac96-bc80cb4b5b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:55.838142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ae727-c802-4cd4-ac96-bc80cb4b5b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:55.839094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ae727-c802-4cd4-ac96-bc80cb4b5b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:55.840943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ae727-c802-4cd4-ac96-bc80cb4b5b0c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:55.860218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aadc0-f326-4c7a-9393-4b59af532295 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:55.867712 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1605/3194] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:55.872881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7aadc0-f326-4c7a-9393-4b59af532295 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:55.880926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e77c7-0794-4975-abf2-eed4935afe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:55.884698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e77c7-0794-4975-abf2-eed4935afe72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:55.885130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e77c7-0794-4975-abf2-eed4935afe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:55.885514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e77c7-0794-4975-abf2-eed4935afe72 admin admin] PATH_INFO: `/v3/projects/e2e2697cf8d24aaaa510bb0d76a723c3/users/c7b4992fd86d4299b802c9d08b127977/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:55.927224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e77c7-0794-4975-abf2-eed4935afe72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e2697cf8d24aaaa510bb0d76a723c3, user_id=c7b4992fd86d4299b802c9d08b127977, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:55.935864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e77c7-0794-4975-abf2-eed4935afe72 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:55.968400 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1590/3195] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:55 2022] PUT /identity/v3/projects/e2e2697cf8d24aaaa510bb0d76a723c3/users/c7b4992fd86d4299b802c9d08b127977/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:55.972899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ae727-c802-4cd4-ac96-bc80cb4b5b0c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:55.991951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ae727-c802-4cd4-ac96-bc80cb4b5b0c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:56.127431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1e96-bd9b-40cf-b8f4-08dda6a021b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:56.128382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1e96-bd9b-40cf-b8f4-08dda6a021b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:56.128960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1e96-bd9b-40cf-b8f4-08dda6a021b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:56.130442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1e96-bd9b-40cf-b8f4-08dda6a021b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:56.131383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a1e96-bd9b-40cf-b8f4-08dda6a021b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:56.133641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a1e96-bd9b-40cf-b8f4-08dda6a021b2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:56.151528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e77c7-0794-4975-abf2-eed4935afe72 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:56.159191 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1606/3196] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:56.163948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e77c7-0794-4975-abf2-eed4935afe72 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:56.173811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b1119-1db3-415c-b331-cfd9d472949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:56.174788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b1119-1db3-415c-b331-cfd9d472949b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:56.175239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b1119-1db3-415c-b331-cfd9d472949b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:56.175681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b1119-1db3-415c-b331-cfd9d472949b admin admin] PATH_INFO: `/v3/projects/e2e2697cf8d24aaaa510bb0d76a723c3/users/c7b4992fd86d4299b802c9d08b127977/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:56.178867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b1119-1db3-415c-b331-cfd9d472949b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e2697cf8d24aaaa510bb0d76a723c3, user_id=c7b4992fd86d4299b802c9d08b127977, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:56.181980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b1119-1db3-415c-b331-cfd9d472949b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:56.234705 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1591/3197] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:56 2022] PUT /identity/v3/projects/e2e2697cf8d24aaaa510bb0d76a723c3/users/c7b4992fd86d4299b802c9d08b127977/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:56.333734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43038-c894-4d68-8792-433bb00f6c8a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:56.336928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474226c-e16a-4755-9414-545a173eefc7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:56.337211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474226c-e16a-4755-9414-545a173eefc7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:56.337477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474226c-e16a-4755-9414-545a173eefc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:56.338405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43038-c894-4d68-8792-433bb00f6c8a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:56.338770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e43038-c894-4d68-8792-433bb00f6c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:56.395849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1474226c-e16a-4755-9414-545a173eefc7 None None] MFA Rules not processed for user `16b4da39b4ad4cee98c185bfa7e6f054`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:56.403012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1474226c-e16a-4755-9414-545a173eefc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:56.428021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-55e43038-c894-4d68-8792-433bb00f6c8a None None] MFA Rules not processed for user `c7b4992fd86d4299b802c9d08b127977`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:56.429269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-55e43038-c894-4d68-8792-433bb00f6c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:56.527662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:56.547451 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1592/3198] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:56.608906 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1607/3199] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:56.616450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474226c-e16a-4755-9414-545a173eefc7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:56.636063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474226c-e16a-4755-9414-545a173eefc7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:56.643417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c599ac-f8f8-44ca-98d9-d1dc6d30f578 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:56.644140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c599ac-f8f8-44ca-98d9-d1dc6d30f578 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:56.644230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c599ac-f8f8-44ca-98d9-d1dc6d30f578 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:56.644780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c599ac-f8f8-44ca-98d9-d1dc6d30f578 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:56.645660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c599ac-f8f8-44ca-98d9-d1dc6d30f578 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:56.646064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c599ac-f8f8-44ca-98d9-d1dc6d30f578 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:56.648648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c599ac-f8f8-44ca-98d9-d1dc6d30f578 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:56.666816 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1593/3200] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:56.671405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43038-c894-4d68-8792-433bb00f6c8a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:56.688688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e43038-c894-4d68-8792-433bb00f6c8a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:56.694644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170f3a1-e87f-423a-975e-7689734d0eea tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:56.695493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170f3a1-e87f-423a-975e-7689734d0eea tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:56.695839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170f3a1-e87f-423a-975e-7689734d0eea tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:56.696175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170f3a1-e87f-423a-975e-7689734d0eea tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:56.696889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170f3a1-e87f-423a-975e-7689734d0eea tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:56.699126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170f3a1-e87f-423a-975e-7689734d0eea tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:56.741638 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1608/3201] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:56 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:56.746226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c599ac-f8f8-44ca-98d9-d1dc6d30f578 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:56.758287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c599ac-f8f8-44ca-98d9-d1dc6d30f578 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:56.838332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d4089-1abe-45b7-9d33-82ddf1d30e44 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:56.838964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4089-1abe-45b7-9d33-82ddf1d30e44 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:56.839614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4089-1abe-45b7-9d33-82ddf1d30e44 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:56.839723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4089-1abe-45b7-9d33-82ddf1d30e44 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:56.840321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d4089-1abe-45b7-9d33-82ddf1d30e44 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:56.840634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d4089-1abe-45b7-9d33-82ddf1d30e44 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:56.842517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d4089-1abe-45b7-9d33-82ddf1d30e44 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:56.857729 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1594/3202] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:57.764177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170f3a1-e87f-423a-975e-7689734d0eea tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:57.766272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1170f3a1-e87f-423a-975e-7689734d0eea tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:57.868992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170f3a1-e87f-423a-975e-7689734d0eea tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:57.877578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:57.878524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:57.879111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:57.879839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] PATH_INFO: `/v3/users/345ef77f0aba4db68bea7b29421becd4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:57.882126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=345ef77f0aba4db68bea7b29421becd4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:57.885967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:57.982813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345ef77f0aba4db68bea7b29421becd4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:57.983926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345ef77f0aba4db68bea7b29421becd4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:57.999082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345ef77f0aba4db68bea7b29421becd4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:58.015183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345ef77f0aba4db68bea7b29421becd4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:58.034147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-df3a0f27-46c7-46ad-a4a8-8f6f935eeb6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345ef77f0aba4db68bea7b29421becd4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:58.046035 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1609/3203] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:23:57 2022] DELETE /identity/v3/users/345ef77f0aba4db68bea7b29421becd4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:58.313091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d4089-1abe-45b7-9d33-82ddf1d30e44 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:58.316054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-742d4089-1abe-45b7-9d33-82ddf1d30e44 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:58.338089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d4089-1abe-45b7-9d33-82ddf1d30e44 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:58.380951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:58.423776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:58.424434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:58.424704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:58.424966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] PATH_INFO: `/v3/projects/51ff21f4b54d457ea7b538370b433058` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:58.426252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ff21f4b54d457ea7b538370b433058)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:58.428268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:58.500665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ff21f4b54d457ea7b538370b433058', 'request_id': 'req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:58.511729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ff21f4b54d457ea7b538370b433058', 'request_id': 'req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:58.519731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ff21f4b54d457ea7b538370b433058', 'request_id': 'req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:58.536093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] The token cache is being invalidate because project 51ff21f4b54d457ea7b538370b433058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:23:58.536412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:58.537371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cc48c6a7-b0d8-4fd9-b9f7-74f5a25c3482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:23:58.539738 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1595/3204] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:58 2022] DELETE /identity/v3/projects/51ff21f4b54d457ea7b538370b433058 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:23:58.544988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1d3a-ddd8-471c-9917-de2e268ea1e3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:58.545265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1d3a-ddd8-471c-9917-de2e268ea1e3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:58.545530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c1d3a-ddd8-471c-9917-de2e268ea1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:58.567622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-242c1d3a-ddd8-471c-9917-de2e268ea1e3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:58.568887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-242c1d3a-ddd8-471c-9917-de2e268ea1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:58.600678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:58.656966 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1610/3205] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:58.659402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38610c1-5385-46c9-a031-ffd78a9b9902 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:58.659984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38610c1-5385-46c9-a031-ffd78a9b9902 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:58.660432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38610c1-5385-46c9-a031-ffd78a9b9902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:58.685382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d38610c1-5385-46c9-a031-ffd78a9b9902 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:58.686642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d38610c1-5385-46c9-a031-ffd78a9b9902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:58.695730 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1596/3206] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:58.700322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c1d3a-ddd8-471c-9917-de2e268ea1e3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:58.710609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c1d3a-ddd8-471c-9917-de2e268ea1e3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:58.715503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae06e92-8fd9-44ba-9ef4-c29b7a1c3ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:58.716159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae06e92-8fd9-44ba-9ef4-c29b7a1c3ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:58.716408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae06e92-8fd9-44ba-9ef4-c29b7a1c3ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:58.716694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae06e92-8fd9-44ba-9ef4-c29b7a1c3ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:58.717361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae06e92-8fd9-44ba-9ef4-c29b7a1c3ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:23:58.717661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae06e92-8fd9-44ba-9ef4-c29b7a1c3ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:58.719315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae06e92-8fd9-44ba-9ef4-c29b7a1c3ab7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:58.738948 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1611/3207] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:58.746125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38610c1-5385-46c9-a031-ffd78a9b9902 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:58.754790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38610c1-5385-46c9-a031-ffd78a9b9902 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:58.763926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a465b12-cc1c-4cf1-83f6-131c453616f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:58.764564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a465b12-cc1c-4cf1-83f6-131c453616f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:58.764847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a465b12-cc1c-4cf1-83f6-131c453616f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:58.765094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a465b12-cc1c-4cf1-83f6-131c453616f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:58.769567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a465b12-cc1c-4cf1-83f6-131c453616f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:58.769567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a465b12-cc1c-4cf1-83f6-131c453616f2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:58.809930 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1597/3208] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:23:58 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:23:58.813102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae06e92-8fd9-44ba-9ef4-c29b7a1c3ab7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:58.837353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae06e92-8fd9-44ba-9ef4-c29b7a1c3ab7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:58.914468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a465b12-cc1c-4cf1-83f6-131c453616f2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:58.918369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0a465b12-cc1c-4cf1-83f6-131c453616f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:58.993596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f50e9-29fd-48e6-b8f7-17d264e7bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:58.994311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f50e9-29fd-48e6-b8f7-17d264e7bebb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:58.994588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f50e9-29fd-48e6-b8f7-17d264e7bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:58.994858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f50e9-29fd-48e6-b8f7-17d264e7bebb admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:58.998175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f50e9-29fd-48e6-b8f7-17d264e7bebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:59.004178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f50e9-29fd-48e6-b8f7-17d264e7bebb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:59.071744 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1612/3209] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:23:58 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:23:59.074837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f50e9-29fd-48e6-b8f7-17d264e7bebb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:59.094567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f50e9-29fd-48e6-b8f7-17d264e7bebb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:59.114268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe176-2688-4600-960b-4089fa1adf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:59.114467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a465b12-cc1c-4cf1-83f6-131c453616f2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:59.115710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe176-2688-4600-960b-4089fa1adf3b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:59.116204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe176-2688-4600-960b-4089fa1adf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:59.116705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbe176-2688-4600-960b-4089fa1adf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:59.117738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbe176-2688-4600-960b-4089fa1adf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:59.122253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0db7e8-a51e-416d-b022-6879494cacc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:59.122900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0db7e8-a51e-416d-b022-6879494cacc4 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:59.123064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbe176-2688-4600-960b-4089fa1adf3b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:59.123195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0db7e8-a51e-416d-b022-6879494cacc4 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:59.123445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0db7e8-a51e-416d-b022-6879494cacc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:59.125571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4c0db7e8-a51e-416d-b022-6879494cacc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:59.159436 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1613/3210] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:59.165901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe176-2688-4600-960b-4089fa1adf3b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:59.168210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:59.188974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbe176-2688-4600-960b-4089fa1adf3b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:59.198663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f49c0d-1550-4dca-b305-9365ba0fad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:59.199846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49c0d-1550-4dca-b305-9365ba0fad31 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:59.200891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49c0d-1550-4dca-b305-9365ba0fad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:59.201376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f49c0d-1550-4dca-b305-9365ba0fad31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:59.202286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f49c0d-1550-4dca-b305-9365ba0fad31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:59.204427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f49c0d-1550-4dca-b305-9365ba0fad31 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:59.221207 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1614/3211] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:23:59.228010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f49c0d-1550-4dca-b305-9365ba0fad31 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:59.242812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f49c0d-1550-4dca-b305-9365ba0fad31 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:59.249125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd5309-5f38-47a3-acbb-1070c113e675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:59.250017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd5309-5f38-47a3-acbb-1070c113e675 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:59.250275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd5309-5f38-47a3-acbb-1070c113e675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:59.250544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd5309-5f38-47a3-acbb-1070c113e675 admin admin] PATH_INFO: `/v3/projects/a94444750c734cf5a920c0f611602978/users/ca572f20589e4b70bb7aaa60c6c55581/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:59.274694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0db7e8-a51e-416d-b022-6879494cacc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:59.277355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0db7e8-a51e-416d-b022-6879494cacc4 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:59.277850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd5309-5f38-47a3-acbb-1070c113e675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94444750c734cf5a920c0f611602978, user_id=ca572f20589e4b70bb7aaa60c6c55581, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:59.281582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd5309-5f38-47a3-acbb-1070c113e675 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:59.297733 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1598/3212] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:23:59.307669 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1615/3213] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:23:59 2022] PUT /identity/v3/projects/a94444750c734cf5a920c0f611602978/users/ca572f20589e4b70bb7aaa60c6c55581/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:23:59.320638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec64fd-d083-417a-aeff-754e5e21dc5b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:59.321140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec64fd-d083-417a-aeff-754e5e21dc5b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:59.321285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec64fd-d083-417a-aeff-754e5e21dc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:59.339750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77fa18-e732-4890-ac5c-8732dabefaba None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:59.340201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77fa18-e732-4890-ac5c-8732dabefaba None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:59.340690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77fa18-e732-4890-ac5c-8732dabefaba None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:59.343001 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1616/3214] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:23:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:23:59.350965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77fa18-e732-4890-ac5c-8732dabefaba None None] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:23:59.359080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d4ec64fd-d083-417a-aeff-754e5e21dc5b None None] MFA Rules not processed for user `ca572f20589e4b70bb7aaa60c6c55581`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:23:59.360647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d4ec64fd-d083-417a-aeff-754e5e21dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:23:59.462913 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1599/3215] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:23:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:23:59.477153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:59.497819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77fa18-e732-4890-ac5c-8732dabefaba None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:59.599490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77fa18-e732-4890-ac5c-8732dabefaba None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:23:59.606222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b7d8b-3f46-462d-8612-7f88dde7a703 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:23:59.607242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7d8b-3f46-462d-8612-7f88dde7a703 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:23:59.607641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7d8b-3f46-462d-8612-7f88dde7a703 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:23:59.608073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b7d8b-3f46-462d-8612-7f88dde7a703 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/projects/b275eda330af4d50877f00b3d96458a7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:23:59.609969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b7d8b-3f46-462d-8612-7f88dde7a703 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:get_project(project_id=b275eda330af4d50877f00b3d96458a7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:23:59.613362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b7d8b-3f46-462d-8612-7f88dde7a703 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:23:59.615700 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1617/3216] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:23:59 2022] GET /identity/v3/projects/b275eda330af4d50877f00b3d96458a7 => generated 371 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:23:59.935755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec64fd-d083-417a-aeff-754e5e21dc5b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:23:59.937458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d4ec64fd-d083-417a-aeff-754e5e21dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:00.015938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec64fd-d083-417a-aeff-754e5e21dc5b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.021606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054812d-49d3-42fa-b700-82a14cb5fb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.022260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054812d-49d3-42fa-b700-82a14cb5fb54 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.022536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054812d-49d3-42fa-b700-82a14cb5fb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.023172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054812d-49d3-42fa-b700-82a14cb5fb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.024991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1054812d-49d3-42fa-b700-82a14cb5fb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:00.042286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054812d-49d3-42fa-b700-82a14cb5fb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:00.043761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054812d-49d3-42fa-b700-82a14cb5fb54 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:00.057633 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1600/3217] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:23:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:00.071534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b7d8b-3f46-462d-8612-7f88dde7a703 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:00.074352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cf9b7d8b-3f46-462d-8612-7f88dde7a703 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:00.098240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b7d8b-3f46-462d-8612-7f88dde7a703 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.106437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64953b-790e-43de-b92b-f9b98ea3d68d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.107594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64953b-790e-43de-b92b-f9b98ea3d68d service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.107880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64953b-790e-43de-b92b-f9b98ea3d68d service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.108152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64953b-790e-43de-b92b-f9b98ea3d68d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.118098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64953b-790e-43de-b92b-f9b98ea3d68d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:00.119739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64953b-790e-43de-b92b-f9b98ea3d68d service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:00.140653 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1618/3218] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:00.201315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054812d-49d3-42fa-b700-82a14cb5fb54 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:00.207849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f337b-5ba5-44be-8a2e-277b209315d5 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.207849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f337b-5ba5-44be-8a2e-277b209315d5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.208187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f337b-5ba5-44be-8a2e-277b209315d5 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.209934 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1619/3219] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:24:00.216062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f337b-5ba5-44be-8a2e-277b209315d5 None None] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:00.239812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f337b-5ba5-44be-8a2e-277b209315d5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:00.255961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f337b-5ba5-44be-8a2e-277b209315d5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.276430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9615c-f90e-4f1e-83d6-0614d7bf09d9 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.276866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9615c-f90e-4f1e-83d6-0614d7bf09d9 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.277139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9615c-f90e-4f1e-83d6-0614d7bf09d9 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.277401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9615c-f90e-4f1e-83d6-0614d7bf09d9 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/projects/b275eda330af4d50877f00b3d96458a7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.278652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9615c-f90e-4f1e-83d6-0614d7bf09d9 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:get_project(project_id=b275eda330af4d50877f00b3d96458a7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:00.280743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b9615c-f90e-4f1e-83d6-0614d7bf09d9 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:00.282689 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1620/3220] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:00 2022] GET /identity/v3/projects/b275eda330af4d50877f00b3d96458a7 => generated 371 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:00.300237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:00.307924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054812d-49d3-42fa-b700-82a14cb5fb54 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.314327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.316220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.316501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.316800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] PATH_INFO: `/v3/users/ca572f20589e4b70bb7aaa60c6c55581` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.318170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca572f20589e4b70bb7aaa60c6c55581)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:00.320235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:00.335993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9615c-f90e-4f1e-83d6-0614d7bf09d9 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:00.350997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9615c-f90e-4f1e-83d6-0614d7bf09d9 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.389862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58e8c7-8d1d-4bfe-8133-00f93be683aa tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.390780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58e8c7-8d1d-4bfe-8133-00f93be683aa tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.392676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58e8c7-8d1d-4bfe-8133-00f93be683aa tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.393142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58e8c7-8d1d-4bfe-8133-00f93be683aa tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.394027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58e8c7-8d1d-4bfe-8133-00f93be683aa tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:24:00.396129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58e8c7-8d1d-4bfe-8133-00f93be683aa tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:00.398995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58e8c7-8d1d-4bfe-8133-00f93be683aa tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:00.423998 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1621/3221] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:00.428342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58e8c7-8d1d-4bfe-8133-00f93be683aa tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:00.434103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca572f20589e4b70bb7aaa60c6c55581'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:00.444448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58e8c7-8d1d-4bfe-8133-00f93be683aa tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.450501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca572f20589e4b70bb7aaa60c6c55581'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:00.461516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99f7fb-7789-4270-9293-9b6e79310715 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.462455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99f7fb-7789-4270-9293-9b6e79310715 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.462801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99f7fb-7789-4270-9293-9b6e79310715 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.463136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99f7fb-7789-4270-9293-9b6e79310715 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.463868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99f7fb-7789-4270-9293-9b6e79310715 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:00.465916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99f7fb-7789-4270-9293-9b6e79310715 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:00.472751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca572f20589e4b70bb7aaa60c6c55581'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:00.486524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca572f20589e4b70bb7aaa60c6c55581'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:00.487924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5ecc42ba-0ec1-4d3e-9789-54351b0a6903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca572f20589e4b70bb7aaa60c6c55581'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:00.501036 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1601/3222] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:24:00 2022] DELETE /identity/v3/users/ca572f20589e4b70bb7aaa60c6c55581 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:00.508556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83db09-3e84-4ffa-9ca2-dbf30d1f446f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.510379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83db09-3e84-4ffa-9ca2-dbf30d1f446f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.511007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83db09-3e84-4ffa-9ca2-dbf30d1f446f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.517787 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1622/3223] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:24:00 2022] POST /identity/v3/users => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:00.519031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99f7fb-7789-4270-9293-9b6e79310715 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:00.522256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e99f7fb-7789-4270-9293-9b6e79310715 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:00.542700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99f7fb-7789-4270-9293-9b6e79310715 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.575379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ca83db09-3e84-4ffa-9ca2-dbf30d1f446f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:00.591887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ca83db09-3e84-4ffa-9ca2-dbf30d1f446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:00.632167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557e30a-33f0-4879-a5a3-5dec4d4f443a tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.632919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557e30a-33f0-4879-a5a3-5dec4d4f443a tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.633211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557e30a-33f0-4879-a5a3-5dec4d4f443a tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.633707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557e30a-33f0-4879-a5a3-5dec4d4f443a tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.638171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557e30a-33f0-4879-a5a3-5dec4d4f443a tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:24:00.638171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557e30a-33f0-4879-a5a3-5dec4d4f443a tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:00.638171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557e30a-33f0-4879-a5a3-5dec4d4f443a tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:00.655807 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1623/3224] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:00.693607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf266a03-0b47-4aa2-b71c-f2c37e84b3ae None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.694125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf266a03-0b47-4aa2-b71c-f2c37e84b3ae None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.695078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf266a03-0b47-4aa2-b71c-f2c37e84b3ae None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.696717 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1624/3225] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:24:00.713845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf266a03-0b47-4aa2-b71c-f2c37e84b3ae None None] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:00.716084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bf266a03-0b47-4aa2-b71c-f2c37e84b3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:00.760991 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1602/3226] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:00.773103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83db09-3e84-4ffa-9ca2-dbf30d1f446f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:00.774633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ca83db09-3e84-4ffa-9ca2-dbf30d1f446f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:00.820431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:00.897088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83db09-3e84-4ffa-9ca2-dbf30d1f446f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.903643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f34b0-ec6a-45e9-9cd4-f9de776a1040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.904362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f34b0-ec6a-45e9-9cd4-f9de776a1040 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.904650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f34b0-ec6a-45e9-9cd4-f9de776a1040 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.904921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f34b0-ec6a-45e9-9cd4-f9de776a1040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.917850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf266a03-0b47-4aa2-b71c-f2c37e84b3ae None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:00.919624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f34b0-ec6a-45e9-9cd4-f9de776a1040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:00.921352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f34b0-ec6a-45e9-9cd4-f9de776a1040 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:00.932318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf266a03-0b47-4aa2-b71c-f2c37e84b3ae None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:00.934837 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1603/3227] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:00.941760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85049a4a-fc68-45a3-bf60-7954a1896763 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:00.942613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049a4a-fc68-45a3-bf60-7954a1896763 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:00.942994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049a4a-fc68-45a3-bf60-7954a1896763 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:00.943239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85049a4a-fc68-45a3-bf60-7954a1896763 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/projects/b275eda330af4d50877f00b3d96458a7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:00.945383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85049a4a-fc68-45a3-bf60-7954a1896763 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:get_project(project_id=b275eda330af4d50877f00b3d96458a7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:00.948857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85049a4a-fc68-45a3-bf60-7954a1896763 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:00.952246 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1625/3228] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:00 2022] GET /identity/v3/projects/b275eda330af4d50877f00b3d96458a7 => generated 371 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:24:01.373864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10aebe-db68-47b7-8632-bc83bf3c757e None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.375165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10aebe-db68-47b7-8632-bc83bf3c757e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.375445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10aebe-db68-47b7-8632-bc83bf3c757e None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.377158 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1604/3229] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:24:01.391653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85049a4a-fc68-45a3-bf60-7954a1896763 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:01.394365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-85049a4a-fc68-45a3-bf60-7954a1896763 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:01.416653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10aebe-db68-47b7-8632-bc83bf3c757e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:01.418785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f10aebe-db68-47b7-8632-bc83bf3c757e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:01.431946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85049a4a-fc68-45a3-bf60-7954a1896763 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:01.464257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f10aebe-db68-47b7-8632-bc83bf3c757e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:01.467746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85049a4a-fc68-45a3-bf60-7954a1896763 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:01.481029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d2e5-2054-41d5-9cc0-b210728a2cd0 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:01.481977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d2e5-2054-41d5-9cc0-b210728a2cd0 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.482254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d2e5-2054-41d5-9cc0-b210728a2cd0 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.482526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf0d2e5-2054-41d5-9cc0-b210728a2cd0 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/projects/b275eda330af4d50877f00b3d96458a7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.483716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d2e5-2054-41d5-9cc0-b210728a2cd0 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:get_project(project_id=b275eda330af4d50877f00b3d96458a7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:01.485799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf0d2e5-2054-41d5-9cc0-b210728a2cd0 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:01.487244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:01.487577 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1626/3230] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:01 2022] GET /identity/v3/projects/b275eda330af4d50877f00b3d96458a7 => generated 371 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:01.489158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.490867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.491769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] PATH_INFO: `/v3/projects/a94444750c734cf5a920c0f611602978` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.495703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94444750c734cf5a920c0f611602978)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:01.501194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:01.535709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:01.554973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d2e5-2054-41d5-9cc0-b210728a2cd0 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:01.572373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf0d2e5-2054-41d5-9cc0-b210728a2cd0 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:01.580750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:01.581418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.581705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.582001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/users/043c5c3919864f2aa1c43b69deeda187` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.617116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:delete_user(user_id=043c5c3919864f2aa1c43b69deeda187)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:01.619431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:01.625938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94444750c734cf5a920c0f611602978', 'request_id': 'req-374234a1-9536-4e1c-8362-29a6b316b05a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:01.654590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94444750c734cf5a920c0f611602978', 'request_id': 'req-374234a1-9536-4e1c-8362-29a6b316b05a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:01.668950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94444750c734cf5a920c0f611602978', 'request_id': 'req-374234a1-9536-4e1c-8362-29a6b316b05a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:01.682258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] The token cache is being invalidate because project a94444750c734cf5a920c0f611602978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:24:01.683065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:01.684018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-374234a1-9536-4e1c-8362-29a6b316b05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:01.686631 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1605/3231] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:01 2022] DELETE /identity/v3/projects/a94444750c734cf5a920c0f611602978 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:24:01.692082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8e793-f31b-412e-9d0c-21166ac0bc37 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.692745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8e793-f31b-412e-9d0c-21166ac0bc37 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.693229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8e793-f31b-412e-9d0c-21166ac0bc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.720358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043c5c3919864f2aa1c43b69deeda187'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:01.720633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-adc8e793-f31b-412e-9d0c-21166ac0bc37 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:01.721302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043c5c3919864f2aa1c43b69deeda187'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:01.721860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-adc8e793-f31b-412e-9d0c-21166ac0bc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:01.737194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043c5c3919864f2aa1c43b69deeda187'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:01.749612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043c5c3919864f2aa1c43b69deeda187'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:01.773168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043c5c3919864f2aa1c43b69deeda187'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:01.790610 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1627/3232] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:24:01 2022] DELETE /identity/v3/users/043c5c3919864f2aa1c43b69deeda187 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:24:01.792010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:01.793814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:01.838651 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1606/3233] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:01.848876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65071c2d-3e35-40ff-83a2-e298c1ffd84f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.849240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65071c2d-3e35-40ff-83a2-e298c1ffd84f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.849605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65071c2d-3e35-40ff-83a2-e298c1ffd84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.884679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-65071c2d-3e35-40ff-83a2-e298c1ffd84f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:01.888688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-65071c2d-3e35-40ff-83a2-e298c1ffd84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:01.924394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bff542-5b9a-4de5-8715-096a3963b96c tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:01.938252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7b4992fd86d4299b802c9d08b127977', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:01.939065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:01.939349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:01.939621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] PATH_INFO: `/v3/projects/b275eda330af4d50877f00b3d96458a7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:01.940864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b275eda330af4d50877f00b3d96458a7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:01.945140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:01.996707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:02.036250 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1607/3234] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:02.042540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65071c2d-3e35-40ff-83a2-e298c1ffd84f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:02.060749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b275eda330af4d50877f00b3d96458a7', 'request_id': 'req-da555266-89be-4ba9-9765-288419f06c03'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:02.067492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65071c2d-3e35-40ff-83a2-e298c1ffd84f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:02.069339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b275eda330af4d50877f00b3d96458a7', 'request_id': 'req-da555266-89be-4ba9-9765-288419f06c03'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:02.086838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b275eda330af4d50877f00b3d96458a7', 'request_id': 'req-da555266-89be-4ba9-9765-288419f06c03'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:02.109948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] The token cache is being invalidate because project b275eda330af4d50877f00b3d96458a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:24:02.110267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:02.111418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:02.117370 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1628/3235] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:01 2022] DELETE /identity/v3/projects/b275eda330af4d50877f00b3d96458a7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:02.118949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:02.120432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:02.137081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:02.164349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57fc8e-af18-4b33-9176-a785a49f93dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:02.164993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57fc8e-af18-4b33-9176-a785a49f93dc admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:02.165401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57fc8e-af18-4b33-9176-a785a49f93dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:02.165551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57fc8e-af18-4b33-9176-a785a49f93dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:02.166339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57fc8e-af18-4b33-9176-a785a49f93dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:24:02.166649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57fc8e-af18-4b33-9176-a785a49f93dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:02.168401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57fc8e-af18-4b33-9176-a785a49f93dc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:02.188005 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1608/3236] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:02.193175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57fc8e-af18-4b33-9176-a785a49f93dc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:02.197667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6d57fc8e-af18-4b33-9176-a785a49f93dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:02.208939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da555266-89be-4ba9-9765-288419f06c03 tempest-QuotasAdminTestV257-2117401451 tempest-QuotasAdminTestV257-2117401451-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:02.215391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:02.215914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57fc8e-af18-4b33-9176-a785a49f93dc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:02.216037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:02.216326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:02.216599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] PATH_INFO: `/v3/users/377df607378542a5a1ba70c96e9f8b05` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:02.218284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=377df607378542a5a1ba70c96e9f8b05)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:02.220154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:02.223860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358468-4484-430f-8cd4-24005d9dbc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:02.224582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358468-4484-430f-8cd4-24005d9dbc2c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:02.224990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358468-4484-430f-8cd4-24005d9dbc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:02.225136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2358468-4484-430f-8cd4-24005d9dbc2c admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:02.225757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2358468-4484-430f-8cd4-24005d9dbc2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:02.228063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2358468-4484-430f-8cd4-24005d9dbc2c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:02.266451 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1609/3237] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:24:02 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:24:02.268267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358468-4484-430f-8cd4-24005d9dbc2c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:02.295848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377df607378542a5a1ba70c96e9f8b05'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:02.297415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377df607378542a5a1ba70c96e9f8b05'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:02.308250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377df607378542a5a1ba70c96e9f8b05'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:02.321431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377df607378542a5a1ba70c96e9f8b05'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:02.350738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8fc58ee7-a01e-4d62-b4c9-198f2154c3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377df607378542a5a1ba70c96e9f8b05'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:02.367941 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1629/3238] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:24:02 2022] DELETE /identity/v3/users/377df607378542a5a1ba70c96e9f8b05 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:02.374159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94872a6c-9320-4968-9773-3dcf19d75880 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:02.374550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94872a6c-9320-4968-9773-3dcf19d75880 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:02.374894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94872a6c-9320-4968-9773-3dcf19d75880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:02.378114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2358468-4484-430f-8cd4-24005d9dbc2c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:02.421371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-94872a6c-9320-4968-9773-3dcf19d75880 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:02.424741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-94872a6c-9320-4968-9773-3dcf19d75880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:02.466839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:02.483103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a78d8f-5ee6-41c8-8900-4faff4b79c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:02.484018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a78d8f-5ee6-41c8-8900-4faff4b79c8f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:02.486999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a78d8f-5ee6-41c8-8900-4faff4b79c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:02.488069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a78d8f-5ee6-41c8-8900-4faff4b79c8f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:02.489069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a78d8f-5ee6-41c8-8900-4faff4b79c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:02.491528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a78d8f-5ee6-41c8-8900-4faff4b79c8f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:02.511420 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1630/3239] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:02.525219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94872a6c-9320-4968-9773-3dcf19d75880 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:02.528289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-94872a6c-9320-4968-9773-3dcf19d75880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:02.532321 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1610/3240] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:24:02 2022] POST /identity/v3/users => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:02.536977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a78d8f-5ee6-41c8-8900-4faff4b79c8f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:02.539562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-66a78d8f-5ee6-41c8-8900-4faff4b79c8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:02.553756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a78d8f-5ee6-41c8-8900-4faff4b79c8f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:02.560870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618836da-29f5-44f4-b1ae-cbe9cc94371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:02.561666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618836da-29f5-44f4-b1ae-cbe9cc94371f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:02.561813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618836da-29f5-44f4-b1ae-cbe9cc94371f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:02.562530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618836da-29f5-44f4-b1ae-cbe9cc94371f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:02.563210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618836da-29f5-44f4-b1ae-cbe9cc94371f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:02.565285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618836da-29f5-44f4-b1ae-cbe9cc94371f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:02.578991 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1611/3241] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:02.584230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618836da-29f5-44f4-b1ae-cbe9cc94371f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:02.595607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618836da-29f5-44f4-b1ae-cbe9cc94371f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:02.602613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61efd9f-51fb-4617-963d-706956fc2848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:02.603519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61efd9f-51fb-4617-963d-706956fc2848 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:02.603688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61efd9f-51fb-4617-963d-706956fc2848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:02.603886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61efd9f-51fb-4617-963d-706956fc2848 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:02.604534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61efd9f-51fb-4617-963d-706956fc2848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:02.606842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61efd9f-51fb-4617-963d-706956fc2848 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:02.612048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94872a6c-9320-4968-9773-3dcf19d75880 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:02.619298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bca88-e00f-4ab5-8a44-c26506335f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:02.620343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bca88-e00f-4ab5-8a44-c26506335f14 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:02.620856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bca88-e00f-4ab5-8a44-c26506335f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:02.621323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bca88-e00f-4ab5-8a44-c26506335f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:02.622946 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1612/3242] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:24:02.624158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61efd9f-51fb-4617-963d-706956fc2848 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:02.635039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bca88-e00f-4ab5-8a44-c26506335f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:02.638218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bca88-e00f-4ab5-8a44-c26506335f14 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:02.642622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61efd9f-51fb-4617-963d-706956fc2848 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:02.652329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4661ee5-de61-44c0-b1c0-824868add847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:02.653563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4661ee5-de61-44c0-b1c0-824868add847 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:02.654218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4661ee5-de61-44c0-b1c0-824868add847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:02.654803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4661ee5-de61-44c0-b1c0-824868add847 admin admin] PATH_INFO: `/v3/projects/98516c7536e2422aba7979f694dfa523/users/756aa8043ed94658844cd8c46e8723d2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:02.655188 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1631/3243] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:02.681605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4661ee5-de61-44c0-b1c0-824868add847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98516c7536e2422aba7979f694dfa523, user_id=756aa8043ed94658844cd8c46e8723d2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:02.686115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4661ee5-de61-44c0-b1c0-824868add847 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:02.709433 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1613/3244] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:02 2022] PUT /identity/v3/projects/98516c7536e2422aba7979f694dfa523/users/756aa8043ed94658844cd8c46e8723d2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:02.720560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395dcdc-0cc3-4a84-ad61-6c73f869cf56 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:02.721031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395dcdc-0cc3-4a84-ad61-6c73f869cf56 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:02.721251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395dcdc-0cc3-4a84-ad61-6c73f869cf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:02.757854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5395dcdc-0cc3-4a84-ad61-6c73f869cf56 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:02.759262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5395dcdc-0cc3-4a84-ad61-6c73f869cf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:02.919362 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1632/3245] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:02.978280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4661ee5-de61-44c0-b1c0-824868add847 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:02.981050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b4661ee5-de61-44c0-b1c0-824868add847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:02.996814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:03.143037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4661ee5-de61-44c0-b1c0-824868add847 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:03.149155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709309a-bff3-43d8-951f-248565f714cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:03.149588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709309a-bff3-43d8-951f-248565f714cc service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:03.150003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709309a-bff3-43d8-951f-248565f714cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:03.150280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709309a-bff3-43d8-951f-248565f714cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:03.157110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395dcdc-0cc3-4a84-ad61-6c73f869cf56 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:03.162466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709309a-bff3-43d8-951f-248565f714cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:03.164071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709309a-bff3-43d8-951f-248565f714cc service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:03.176143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395dcdc-0cc3-4a84-ad61-6c73f869cf56 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:03.178788 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1614/3246] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:03.189965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a57abb-f05c-4f02-b455-03daff720914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:03.190724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57abb-f05c-4f02-b455-03daff720914 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:03.191004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57abb-f05c-4f02-b455-03daff720914 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:03.192068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a57abb-f05c-4f02-b455-03daff720914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:03.195436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-79a57abb-f05c-4f02-b455-03daff720914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:03.258876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709309a-bff3-43d8-951f-248565f714cc service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:03.261160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c709309a-bff3-43d8-951f-248565f714cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:03.296670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709309a-bff3-43d8-951f-248565f714cc service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:03.304168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:03.305030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:03.305562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:03.306015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] PATH_INFO: `/v3/projects/579eaf95502143658fee5c78549af85c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:03.308096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=579eaf95502143658fee5c78549af85c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:03.310465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:03.337976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a57abb-f05c-4f02-b455-03daff720914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:03.340321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a57abb-f05c-4f02-b455-03daff720914 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:03.349279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:03.359648 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1633/3247] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:03.401416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '579eaf95502143658fee5c78549af85c', 'request_id': 'req-ef7c979b-5c04-4b8a-9680-8218c3617cec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.415217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '579eaf95502143658fee5c78549af85c', 'request_id': 'req-ef7c979b-5c04-4b8a-9680-8218c3617cec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.425218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '579eaf95502143658fee5c78549af85c', 'request_id': 'req-ef7c979b-5c04-4b8a-9680-8218c3617cec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.439624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] The token cache is being invalidate because project 579eaf95502143658fee5c78549af85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:24:03.439991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.440631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.442905 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1615/3248] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:03 2022] DELETE /identity/v3/projects/579eaf95502143658fee5c78549af85c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:03.448969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a57abb-f05c-4f02-b455-03daff720914 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:03.477464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a57abb-f05c-4f02-b455-03daff720914 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:03.655576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:03.656823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:03.657302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:03.657771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] PATH_INFO: `/v3/users/c7b4992fd86d4299b802c9d08b127977` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:03.659236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b4992fd86d4299b802c9d08b127977)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:03.662057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:03.796261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b4992fd86d4299b802c9d08b127977'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.803461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b4992fd86d4299b802c9d08b127977'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.818193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b4992fd86d4299b802c9d08b127977'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.838493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b4992fd86d4299b802c9d08b127977'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.865446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-04e02316-e3a7-4579-bd81-c6757cafb5d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b4992fd86d4299b802c9d08b127977'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:03.874449 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1634/3249] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:24:03 2022] DELETE /identity/v3/users/c7b4992fd86d4299b802c9d08b127977 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:04.473458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:04.475053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:04.496307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c979b-5c04-4b8a-9680-8218c3617cec admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:04.570247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:04.571653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:04.571932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:04.572197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] PATH_INFO: `/v3/projects/e2e2697cf8d24aaaa510bb0d76a723c3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:04.573430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e2697cf8d24aaaa510bb0d76a723c3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:04.575736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:04.628496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:04.650846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'request_id': 'req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:04.660213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'request_id': 'req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:04.668272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e2697cf8d24aaaa510bb0d76a723c3', 'request_id': 'req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:04.681057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] The token cache is being invalidate because project e2e2697cf8d24aaaa510bb0d76a723c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:24:04.681432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:04.682192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1aeb8da8-14a1-42cc-b508-1aa6d4d8685d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:04.683974 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1616/3250] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:04 2022] DELETE /identity/v3/projects/e2e2697cf8d24aaaa510bb0d76a723c3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:24:04.690072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01bd8a-c957-495c-8622-c71e029c9a0a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:04.690619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01bd8a-c957-495c-8622-c71e029c9a0a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:04.690619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01bd8a-c957-495c-8622-c71e029c9a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:04.711875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9e01bd8a-c957-495c-8622-c71e029c9a0a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:04.713373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9e01bd8a-c957-495c-8622-c71e029c9a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:04.806993 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1635/3251] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:04.814993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45937e61-b376-4202-85eb-8eec5fc38ae0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:04.815275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45937e61-b376-4202-85eb-8eec5fc38ae0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:04.815538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45937e61-b376-4202-85eb-8eec5fc38ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:04.841585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-45937e61-b376-4202-85eb-8eec5fc38ae0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:04.843340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-45937e61-b376-4202-85eb-8eec5fc38ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:04.856045 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1617/3252] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:04.860406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01bd8a-c957-495c-8622-c71e029c9a0a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:04.873427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01bd8a-c957-495c-8622-c71e029c9a0a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:04.879152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9d01c-4189-4a55-98c8-aaf81fd8e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:04.880299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9d01c-4189-4a55-98c8-aaf81fd8e67b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:04.880779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9d01c-4189-4a55-98c8-aaf81fd8e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:04.881269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9d01c-4189-4a55-98c8-aaf81fd8e67b admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:04.882197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9d01c-4189-4a55-98c8-aaf81fd8e67b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:24:04.882722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9d01c-4189-4a55-98c8-aaf81fd8e67b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:04.884859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9d01c-4189-4a55-98c8-aaf81fd8e67b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:04.906828 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1636/3253] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:04.912162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45937e61-b376-4202-85eb-8eec5fc38ae0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:04.924188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45937e61-b376-4202-85eb-8eec5fc38ae0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:04.931848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35bd5b-c1bc-4611-8140-537fcc3969fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:04.932983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35bd5b-c1bc-4611-8140-537fcc3969fe admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:04.933457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35bd5b-c1bc-4611-8140-537fcc3969fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:04.933963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35bd5b-c1bc-4611-8140-537fcc3969fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:04.934801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35bd5b-c1bc-4611-8140-537fcc3969fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:04.937341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b35bd5b-c1bc-4611-8140-537fcc3969fe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:05.006023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1618/3254] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:24:04 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:05.009107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9d01c-4189-4a55-98c8-aaf81fd8e67b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:05.028353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9d01c-4189-4a55-98c8-aaf81fd8e67b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:05.033806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:05.152877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450140b-41fb-4234-8fa7-3e36c5c472c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:05.153898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450140b-41fb-4234-8fa7-3e36c5c472c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:05.154396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450140b-41fb-4234-8fa7-3e36c5c472c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:05.154862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450140b-41fb-4234-8fa7-3e36c5c472c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:05.155696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450140b-41fb-4234-8fa7-3e36c5c472c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:05.158597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450140b-41fb-4234-8fa7-3e36c5c472c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:05.227356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35bd5b-c1bc-4611-8140-537fcc3969fe admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:05.237200 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1637/3255] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:24:05 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:05.245290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35bd5b-c1bc-4611-8140-537fcc3969fe admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:05.262353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbd428-0fc3-45c2-be2e-8e5f1f39693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:05.263474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd428-0fc3-45c2-be2e-8e5f1f39693f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:05.263950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd428-0fc3-45c2-be2e-8e5f1f39693f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:05.264412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbd428-0fc3-45c2-be2e-8e5f1f39693f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:05.266695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbd428-0fc3-45c2-be2e-8e5f1f39693f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:05.269528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbd428-0fc3-45c2-be2e-8e5f1f39693f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:05.293261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450140b-41fb-4234-8fa7-3e36c5c472c9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:05.308464 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1619/3256] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:05.311040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450140b-41fb-4234-8fa7-3e36c5c472c9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:05.318217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d623378a-d5eb-4422-b3be-505c1751feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:05.319521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623378a-d5eb-4422-b3be-505c1751feb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:05.319521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623378a-d5eb-4422-b3be-505c1751feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:05.319774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d623378a-d5eb-4422-b3be-505c1751feb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:05.320596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623378a-d5eb-4422-b3be-505c1751feb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:05.323309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d623378a-d5eb-4422-b3be-505c1751feb8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:05.346104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbd428-0fc3-45c2-be2e-8e5f1f39693f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:05.355804 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1638/3257] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:05.362991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbd428-0fc3-45c2-be2e-8e5f1f39693f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:05.369631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbda25-cb5c-4ff6-87d8-141b8c095095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:05.369631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbda25-cb5c-4ff6-87d8-141b8c095095 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:05.369926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbda25-cb5c-4ff6-87d8-141b8c095095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:05.370141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbda25-cb5c-4ff6-87d8-141b8c095095 admin admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c/users/9de0e2001c4b414c9b9afd78bba19e9c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:05.398188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbda25-cb5c-4ff6-87d8-141b8c095095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fab9264a92cf47f7bde5829178a7cf7c, user_id=9de0e2001c4b414c9b9afd78bba19e9c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:05.401122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbda25-cb5c-4ff6-87d8-141b8c095095 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:05.439037 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1620/3258] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:05 2022] PUT /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c/users/9de0e2001c4b414c9b9afd78bba19e9c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:05.446132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2830bc4-fe65-4355-b2db-7ffabcddb1a7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:05.447770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2830bc4-fe65-4355-b2db-7ffabcddb1a7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:05.448318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2830bc4-fe65-4355-b2db-7ffabcddb1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:05.497243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e2830bc4-fe65-4355-b2db-7ffabcddb1a7 None None] MFA Rules not processed for user `9de0e2001c4b414c9b9afd78bba19e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:05.499778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e2830bc4-fe65-4355-b2db-7ffabcddb1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:05.640647 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1639/3259] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:05.647433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbda25-cb5c-4ff6-87d8-141b8c095095 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:05.757933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbda25-cb5c-4ff6-87d8-141b8c095095 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:05.766777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037480ae-4895-4d32-b8f1-774f5aff4ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:05.767799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037480ae-4895-4d32-b8f1-774f5aff4ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:05.768438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037480ae-4895-4d32-b8f1-774f5aff4ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:05.768947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037480ae-4895-4d32-b8f1-774f5aff4ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:05.769978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037480ae-4895-4d32-b8f1-774f5aff4ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:05.773075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037480ae-4895-4d32-b8f1-774f5aff4ad6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:05.823214 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1621/3260] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:24:05 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:05.827497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2830bc4-fe65-4355-b2db-7ffabcddb1a7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:05.849157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2830bc4-fe65-4355-b2db-7ffabcddb1a7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:05.997692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfe2d-af25-46dc-9d79-7a5228d78f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:05.998462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfe2d-af25-46dc-9d79-7a5228d78f3e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:05.998662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfe2d-af25-46dc-9d79-7a5228d78f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:05.998930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfe2d-af25-46dc-9d79-7a5228d78f3e admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:05.999601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cfe2d-af25-46dc-9d79-7a5228d78f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:06.001767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cfe2d-af25-46dc-9d79-7a5228d78f3e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:06.048590 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1640/3261] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:24:05 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:24:06.052828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037480ae-4895-4d32-b8f1-774f5aff4ad6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:06.072521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037480ae-4895-4d32-b8f1-774f5aff4ad6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:06.091549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f8423-f08e-4f1b-9b41-5e26e723e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:06.092737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8423-f08e-4f1b-9b41-5e26e723e3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:06.092737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8423-f08e-4f1b-9b41-5e26e723e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:06.092938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f8423-f08e-4f1b-9b41-5e26e723e3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:06.093735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f8423-f08e-4f1b-9b41-5e26e723e3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:06.097851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253f8423-f08e-4f1b-9b41-5e26e723e3f9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:06.119093 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1622/3262] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:06.124184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfe2d-af25-46dc-9d79-7a5228d78f3e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:06.134848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:06.145520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfe2d-af25-46dc-9d79-7a5228d78f3e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:06.160511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129c5b2-7a5d-45e0-8934-9032bbfd1191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:06.161421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129c5b2-7a5d-45e0-8934-9032bbfd1191 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:06.161839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129c5b2-7a5d-45e0-8934-9032bbfd1191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:06.164134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129c5b2-7a5d-45e0-8934-9032bbfd1191 admin admin] PATH_INFO: `/v3/projects/d2220819b9bb46609c0473352a7e06d4/users/ee166e45336f45099b9d355bb3ef992e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:06.206677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129c5b2-7a5d-45e0-8934-9032bbfd1191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2220819b9bb46609c0473352a7e06d4, user_id=ee166e45336f45099b9d355bb3ef992e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:06.213271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129c5b2-7a5d-45e0-8934-9032bbfd1191 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:06.248693 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1641/3263] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:06 2022] PUT /identity/v3/projects/d2220819b9bb46609c0473352a7e06d4/users/ee166e45336f45099b9d355bb3ef992e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:06.250390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f8423-f08e-4f1b-9b41-5e26e723e3f9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:06.277568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f8423-f08e-4f1b-9b41-5e26e723e3f9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:06.365716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:06.415641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b20e7-7e5d-4e83-9336-403fd41fdc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:06.416371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b20e7-7e5d-4e83-9336-403fd41fdc02 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:06.416714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b20e7-7e5d-4e83-9336-403fd41fdc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:06.417050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b20e7-7e5d-4e83-9336-403fd41fdc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:06.417793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b20e7-7e5d-4e83-9336-403fd41fdc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:06.419702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b20e7-7e5d-4e83-9336-403fd41fdc02 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:06.431851 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1623/3264] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:24:06.435829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129c5b2-7a5d-45e0-8934-9032bbfd1191 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:06.449338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129c5b2-7a5d-45e0-8934-9032bbfd1191 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:06.454839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbc001-17f5-4762-8ca2-df06909a8e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:06.456551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc001-17f5-4762-8ca2-df06909a8e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:06.456862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc001-17f5-4762-8ca2-df06909a8e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:06.457127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbc001-17f5-4762-8ca2-df06909a8e1b admin admin] PATH_INFO: `/v3/projects/d2220819b9bb46609c0473352a7e06d4/users/ee166e45336f45099b9d355bb3ef992e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:06.459406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbc001-17f5-4762-8ca2-df06909a8e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2220819b9bb46609c0473352a7e06d4, user_id=ee166e45336f45099b9d355bb3ef992e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:06.464328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbc001-17f5-4762-8ca2-df06909a8e1b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:06.489838 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1642/3265] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:06 2022] PUT /identity/v3/projects/d2220819b9bb46609c0473352a7e06d4/users/ee166e45336f45099b9d355bb3ef992e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:06.491472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def505b3-284d-45b5-ae9f-3589863db30d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:06.492029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def505b3-284d-45b5-ae9f-3589863db30d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:06.492407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def505b3-284d-45b5-ae9f-3589863db30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:06.534726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-def505b3-284d-45b5-ae9f-3589863db30d None None] MFA Rules not processed for user `ee166e45336f45099b9d355bb3ef992e`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:06.537105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-def505b3-284d-45b5-ae9f-3589863db30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:06.668197 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1624/3266] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:24:07.582066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbc001-17f5-4762-8ca2-df06909a8e1b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:07.584904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2cbbc001-17f5-4762-8ca2-df06909a8e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:07.762781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbc001-17f5-4762-8ca2-df06909a8e1b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:07.773043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d31f1-e758-4583-862c-24ca90e13547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:07.773603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d31f1-e758-4583-862c-24ca90e13547 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:07.774292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d31f1-e758-4583-862c-24ca90e13547 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:07.776461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d31f1-e758-4583-862c-24ca90e13547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:07.791009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d31f1-e758-4583-862c-24ca90e13547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:07.792620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d31f1-e758-4583-862c-24ca90e13547 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:07.818690 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1643/3267] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:07.821418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e697493-9aa3-4652-bbaa-1a5b9353c342 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:07.821933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e697493-9aa3-4652-bbaa-1a5b9353c342 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:07.822078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e697493-9aa3-4652-bbaa-1a5b9353c342 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:07.823451 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1625/3268] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:24:07.831094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d31f1-e758-4583-862c-24ca90e13547 service nova] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:07.862615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d31f1-e758-4583-862c-24ca90e13547 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:07.881672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d31f1-e758-4583-862c-24ca90e13547 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:07.901739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8737b-8ae2-40eb-bbcd-bc151784f744 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee166e45336f45099b9d355bb3ef992e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2220819b9bb46609c0473352a7e06d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:07.902995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8737b-8ae2-40eb-bbcd-bc151784f744 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:07.904014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8737b-8ae2-40eb-bbcd-bc151784f744 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:07.904580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8737b-8ae2-40eb-bbcd-bc151784f744 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:07.915816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8737b-8ae2-40eb-bbcd-bc151784f744 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorizing `identity:get_project(project_id=fab9264a92cf47f7bde5829178a7cf7c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:07.918831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8737b-8ae2-40eb-bbcd-bc151784f744 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:07.934089 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1644/3269] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:07 2022] GET /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c => generated 383 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:24:08.842616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd3a2b-7059-4b62-9925-208491722a54 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:08.843385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd3a2b-7059-4b62-9925-208491722a54 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:08.843916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd3a2b-7059-4b62-9925-208491722a54 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:08.846723 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1626/3270] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:24:08.856795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8737b-8ae2-40eb-bbcd-bc151784f744 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:08.876000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8737b-8ae2-40eb-bbcd-bc151784f744 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:08.892569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8737b-8ae2-40eb-bbcd-bc151784f744 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:08.907097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768a6e6-deb8-4541-96d0-15595c7c8a84 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee166e45336f45099b9d355bb3ef992e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2220819b9bb46609c0473352a7e06d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:08.908120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768a6e6-deb8-4541-96d0-15595c7c8a84 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:08.908965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768a6e6-deb8-4541-96d0-15595c7c8a84 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:08.911328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768a6e6-deb8-4541-96d0-15595c7c8a84 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:08.914704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768a6e6-deb8-4541-96d0-15595c7c8a84 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorizing `identity:get_project(project_id=fab9264a92cf47f7bde5829178a7cf7c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:08.922081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768a6e6-deb8-4541-96d0-15595c7c8a84 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:08.927501 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1645/3271] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:08 2022] GET /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c => generated 383 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:09.170719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0ca0-0070-4125-ae72-9ff9842a0e3b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.171381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0ca0-0070-4125-ae72-9ff9842a0e3b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.171903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb0ca0-0070-4125-ae72-9ff9842a0e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.223655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6deb0ca0-0070-4125-ae72-9ff9842a0e3b None None] MFA Rules not processed for user `9de0e2001c4b414c9b9afd78bba19e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:09.224669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6deb0ca0-0070-4125-ae72-9ff9842a0e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:09.419727 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1627/3272] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:09.751183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768a6e6-deb8-4541-96d0-15595c7c8a84 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:09.773839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768a6e6-deb8-4541-96d0-15595c7c8a84 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:09.797083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cbf30-cfb3-406c-9e9e-11f4c812e178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:09.797978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cbf30-cfb3-406c-9e9e-11f4c812e178 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:09.798363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cbf30-cfb3-406c-9e9e-11f4c812e178 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:09.799138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cbf30-cfb3-406c-9e9e-11f4c812e178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:09.826510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cbf30-cfb3-406c-9e9e-11f4c812e178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:09.829509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cbf30-cfb3-406c-9e9e-11f4c812e178 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:09.861798 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1646/3273] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:12.116938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549d25c-961d-476c-ac90-e58e5434e261 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:12.117947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549d25c-961d-476c-ac90-e58e5434e261 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:12.118321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549d25c-961d-476c-ac90-e58e5434e261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:12.178506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e549d25c-961d-476c-ac90-e58e5434e261 None None] MFA Rules not processed for user `756aa8043ed94658844cd8c46e8723d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:12.179817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e549d25c-961d-476c-ac90-e58e5434e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:12.302493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:12.336192 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1628/3274] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:12 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:12.878802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a03d7-9cdb-487d-b825-bee08feabcba None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:12.879911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a03d7-9cdb-487d-b825-bee08feabcba None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:12.880384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a03d7-9cdb-487d-b825-bee08feabcba None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:12.882831 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1647/3275] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:24:12.889131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549d25c-961d-476c-ac90-e58e5434e261 None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:12.890949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e549d25c-961d-476c-ac90-e58e5434e261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:12.910453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549d25c-961d-476c-ac90-e58e5434e261 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:12.924674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549d25c-961d-476c-ac90-e58e5434e261 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:12.930671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7f326-81cc-4b3a-b180-7f614e2ae4d2 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee166e45336f45099b9d355bb3ef992e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2220819b9bb46609c0473352a7e06d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:12.931330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7f326-81cc-4b3a-b180-7f614e2ae4d2 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:12.932154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7f326-81cc-4b3a-b180-7f614e2ae4d2 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:12.932154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7f326-81cc-4b3a-b180-7f614e2ae4d2 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:12.933449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7f326-81cc-4b3a-b180-7f614e2ae4d2 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorizing `identity:get_project(project_id=fab9264a92cf47f7bde5829178a7cf7c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:12.935456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7f326-81cc-4b3a-b180-7f614e2ae4d2 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:12.937373 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1629/3276] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:12 2022] GET /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c => generated 383 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:13.043342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a03d7-9cdb-487d-b825-bee08feabcba None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:13.062971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a03d7-9cdb-487d-b825-bee08feabcba None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:13.069022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174f5ca-4651-40f2-9480-bc8bf318f224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:13.069984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174f5ca-4651-40f2-9480-bc8bf318f224 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:13.070416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174f5ca-4651-40f2-9480-bc8bf318f224 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:13.071090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174f5ca-4651-40f2-9480-bc8bf318f224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:13.080777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174f5ca-4651-40f2-9480-bc8bf318f224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:13.082858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174f5ca-4651-40f2-9480-bc8bf318f224 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:13.106477 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1648/3277] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:13 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:13.807741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3f7de-d5d5-468c-8500-3228d5c6bfc9 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:13.808328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3f7de-d5d5-468c-8500-3228d5c6bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:13.808423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3f7de-d5d5-468c-8500-3228d5c6bfc9 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:13.809835 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1630/3278] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:24:13.816034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174f5ca-4651-40f2-9480-bc8bf318f224 service nova] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:13.839095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174f5ca-4651-40f2-9480-bc8bf318f224 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:13.857737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174f5ca-4651-40f2-9480-bc8bf318f224 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:13.866894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df0f5f-3393-479f-998c-befdd63f069a tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee166e45336f45099b9d355bb3ef992e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2220819b9bb46609c0473352a7e06d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:13.869103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df0f5f-3393-479f-998c-befdd63f069a tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:13.869748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df0f5f-3393-479f-998c-befdd63f069a tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:13.870325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df0f5f-3393-479f-998c-befdd63f069a tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:13.872340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df0f5f-3393-479f-998c-befdd63f069a tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorizing `identity:get_project(project_id=fab9264a92cf47f7bde5829178a7cf7c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:13.875322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df0f5f-3393-479f-998c-befdd63f069a tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:13.877685 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1649/3279] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:13 2022] GET /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c => generated 383 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:14.463149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464948a9-d960-4df8-91c1-fa7e3a54ee13 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:14.463424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464948a9-d960-4df8-91c1-fa7e3a54ee13 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:14.463918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464948a9-d960-4df8-91c1-fa7e3a54ee13 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:14.465722 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1631/3280] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:24:14.474468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df0f5f-3393-479f-998c-befdd63f069a tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:14.496613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df0f5f-3393-479f-998c-befdd63f069a tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:14.522204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df0f5f-3393-479f-998c-befdd63f069a tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:14.530649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b33ea7-6288-4192-be1a-5ae18c45499c tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee166e45336f45099b9d355bb3ef992e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2220819b9bb46609c0473352a7e06d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:14.531806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b33ea7-6288-4192-be1a-5ae18c45499c tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:14.532271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b33ea7-6288-4192-be1a-5ae18c45499c tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:14.532992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b33ea7-6288-4192-be1a-5ae18c45499c tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:14.536074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b33ea7-6288-4192-be1a-5ae18c45499c tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorizing `identity:get_project(project_id=fab9264a92cf47f7bde5829178a7cf7c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:14.540606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b33ea7-6288-4192-be1a-5ae18c45499c tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:14.544542 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1650/3281] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:14 2022] GET /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c => generated 383 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:24:14.680675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839938c-6507-4600-a7a1-135122d403e3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:14.681339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839938c-6507-4600-a7a1-135122d403e3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:14.681855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839938c-6507-4600-a7a1-135122d403e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:14.724907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d839938c-6507-4600-a7a1-135122d403e3 None None] MFA Rules not processed for user `9de0e2001c4b414c9b9afd78bba19e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:14.727132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d839938c-6507-4600-a7a1-135122d403e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:14.743155 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1632/3282] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:18.575614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd557a4-57d7-44eb-b3b0-d92ab0a0579b None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:18.576150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd557a4-57d7-44eb-b3b0-d92ab0a0579b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:18.576150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd557a4-57d7-44eb-b3b0-d92ab0a0579b None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:18.577936 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1651/3283] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:24:18.584111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839938c-6507-4600-a7a1-135122d403e3 None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:18.609980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839938c-6507-4600-a7a1-135122d403e3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:18.637426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839938c-6507-4600-a7a1-135122d403e3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:18.659524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e93fe5-e4bc-4045-88b5-39b897bdb600 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee166e45336f45099b9d355bb3ef992e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2220819b9bb46609c0473352a7e06d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:18.661860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e93fe5-e4bc-4045-88b5-39b897bdb600 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:18.662424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e93fe5-e4bc-4045-88b5-39b897bdb600 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:18.662976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e93fe5-e4bc-4045-88b5-39b897bdb600 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:18.664754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e93fe5-e4bc-4045-88b5-39b897bdb600 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorizing `identity:get_project(project_id=fab9264a92cf47f7bde5829178a7cf7c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:18.667757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e93fe5-e4bc-4045-88b5-39b897bdb600 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:18.670449 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1633/3284] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:18 2022] GET /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c => generated 383 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:19.697636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9135af-2f9f-4fdb-b241-bec9769e0b4f None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:19.698653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9135af-2f9f-4fdb-b241-bec9769e0b4f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:19.699122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9135af-2f9f-4fdb-b241-bec9769e0b4f None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:19.701040 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1652/3285] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:24:19.705992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e93fe5-e4bc-4045-88b5-39b897bdb600 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:19.721312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e93fe5-e4bc-4045-88b5-39b897bdb600 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:19.735667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e93fe5-e4bc-4045-88b5-39b897bdb600 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:19.743004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f5a7a-8a5b-40e6-a6e3-75738f0c6a0b tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee166e45336f45099b9d355bb3ef992e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2220819b9bb46609c0473352a7e06d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:19.743841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f5a7a-8a5b-40e6-a6e3-75738f0c6a0b tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:19.744217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f5a7a-8a5b-40e6-a6e3-75738f0c6a0b tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:19.744848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f5a7a-8a5b-40e6-a6e3-75738f0c6a0b tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:19.746734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f5a7a-8a5b-40e6-a6e3-75738f0c6a0b tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorizing `identity:get_project(project_id=fab9264a92cf47f7bde5829178a7cf7c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:19.749990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f5a7a-8a5b-40e6-a6e3-75738f0c6a0b tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:19.752143 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1634/3286] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:19 2022] GET /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c => generated 383 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:21.042236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6e83-aff6-423c-8803-82e323dd9a53 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:21.042816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6e83-aff6-423c-8803-82e323dd9a53 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:21.042816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be6e83-aff6-423c-8803-82e323dd9a53 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:21.044743 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1653/3287] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:24:21.069938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f5a7a-8a5b-40e6-a6e3-75738f0c6a0b tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:21.094296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f5a7a-8a5b-40e6-a6e3-75738f0c6a0b tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:21.108615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f5a7a-8a5b-40e6-a6e3-75738f0c6a0b tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:21.115810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f1421-36bc-4220-973b-d1837929d3f8 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee166e45336f45099b9d355bb3ef992e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2220819b9bb46609c0473352a7e06d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:21.117705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1421-36bc-4220-973b-d1837929d3f8 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:21.118347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1421-36bc-4220-973b-d1837929d3f8 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:21.118893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f1421-36bc-4220-973b-d1837929d3f8 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:21.120690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f1421-36bc-4220-973b-d1837929d3f8 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorizing `identity:get_project(project_id=fab9264a92cf47f7bde5829178a7cf7c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:21.123562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f1421-36bc-4220-973b-d1837929d3f8 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:21.138262 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1635/3288] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:21 2022] GET /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c => generated 383 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:21.284042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134756-2ab4-4baa-8fbd-523a5d9a3b5f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:21.284650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134756-2ab4-4baa-8fbd-523a5d9a3b5f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:21.285198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134756-2ab4-4baa-8fbd-523a5d9a3b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:21.323921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-17134756-2ab4-4baa-8fbd-523a5d9a3b5f None None] MFA Rules not processed for user `9de0e2001c4b414c9b9afd78bba19e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:21.325503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-17134756-2ab4-4baa-8fbd-523a5d9a3b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:21.354961 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1654/3289] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:22.983878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8494-50cb-4417-ab55-a846fec67b04 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:22.984573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8494-50cb-4417-ab55-a846fec67b04 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:22.984573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f8494-50cb-4417-ab55-a846fec67b04 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:22.985814 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1636/3290] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:24:22.992512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134756-2ab4-4baa-8fbd-523a5d9a3b5f None None] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:24:23.014551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134756-2ab4-4baa-8fbd-523a5d9a3b5f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:23.027000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134756-2ab4-4baa-8fbd-523a5d9a3b5f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:23.032724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6694a2d-67e8-486c-bd00-b7348f579940 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee166e45336f45099b9d355bb3ef992e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2220819b9bb46609c0473352a7e06d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:23.033360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694a2d-67e8-486c-bd00-b7348f579940 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:23.033637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694a2d-67e8-486c-bd00-b7348f579940 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:23.033917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6694a2d-67e8-486c-bd00-b7348f579940 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:23.035548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6694a2d-67e8-486c-bd00-b7348f579940 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorizing `identity:get_project(project_id=fab9264a92cf47f7bde5829178a7cf7c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:23.037680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6694a2d-67e8-486c-bd00-b7348f579940 tempest-QuotasAdminNegativeTest-549262348 tempest-QuotasAdminNegativeTest-549262348-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:23.039777 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1655/3291] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:24:22 2022] GET /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c => generated 383 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:23.203603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8494-50cb-4417-ab55-a846fec67b04 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:23.299960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f8494-50cb-4417-ab55-a846fec67b04 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:23.307093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:23.308073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:23.308507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:23.308908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] PATH_INFO: `/v3/users/9de0e2001c4b414c9b9afd78bba19e9c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:23.310708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de0e2001c4b414c9b9afd78bba19e9c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:23.312731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:23.382894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de0e2001c4b414c9b9afd78bba19e9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:23.394322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de0e2001c4b414c9b9afd78bba19e9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:23.410491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de0e2001c4b414c9b9afd78bba19e9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:23.420356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de0e2001c4b414c9b9afd78bba19e9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:23.421139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de0e2001c4b414c9b9afd78bba19e9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:23.431621 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1637/3292] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:24:23 2022] DELETE /identity/v3/users/9de0e2001c4b414c9b9afd78bba19e9c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:24:23.436917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784bf1-805e-41ea-a52e-28752cd0c2ee None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:23.437108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784bf1-805e-41ea-a52e-28752cd0c2ee None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:23.437370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784bf1-805e-41ea-a52e-28752cd0c2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:23.460825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7e784bf1-805e-41ea-a52e-28752cd0c2ee None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:23.462783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e784bf1-805e-41ea-a52e-28752cd0c2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:23.518464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:23.557441 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1656/3293] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:23.574180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:23.575693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:23.617383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:23.709955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fa5d4-2d0f-4b93-af1e-e7780e4747d7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:23.715914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155676f-1db7-4b95-8b14-c9b4c409266d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:23.716705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155676f-1db7-4b95-8b14-c9b4c409266d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:23.717169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155676f-1db7-4b95-8b14-c9b4c409266d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:23.717324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155676f-1db7-4b95-8b14-c9b4c409266d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:23.732126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155676f-1db7-4b95-8b14-c9b4c409266d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:23.733943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3155676f-1db7-4b95-8b14-c9b4c409266d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:23.747521 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1638/3294] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:24.092558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784bf1-805e-41ea-a52e-28752cd0c2ee None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:24.093671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e784bf1-805e-41ea-a52e-28752cd0c2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:24.112479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784bf1-805e-41ea-a52e-28752cd0c2ee None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:24.119435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:24.120631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:24.121055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:24.121472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] PATH_INFO: `/v3/projects/fab9264a92cf47f7bde5829178a7cf7c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:24.123498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fab9264a92cf47f7bde5829178a7cf7c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:24.125731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:24.202129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fab9264a92cf47f7bde5829178a7cf7c', 'request_id': 'req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:24.215582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fab9264a92cf47f7bde5829178a7cf7c', 'request_id': 'req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:24.235873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fab9264a92cf47f7bde5829178a7cf7c', 'request_id': 'req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:24.250185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] The token cache is being invalidate because project fab9264a92cf47f7bde5829178a7cf7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:24:24.250783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:24.251715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:24.259039 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1657/3295] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:24 2022] DELETE /identity/v3/projects/fab9264a92cf47f7bde5829178a7cf7c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:24.260249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155676f-1db7-4b95-8b14-c9b4c409266d service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:24.273265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155676f-1db7-4b95-8b14-c9b4c409266d service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:24.358569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:24.361201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:24.386535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:24.387189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:24.387462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:24.387728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] PATH_INFO: `/v3/users/ee166e45336f45099b9d355bb3ef992e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:24.389943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee166e45336f45099b9d355bb3ef992e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:24.392141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:24.460834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee166e45336f45099b9d355bb3ef992e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:24.471103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee166e45336f45099b9d355bb3ef992e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:24.489269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee166e45336f45099b9d355bb3ef992e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:24.492304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ae52a-0db3-47d5-b5e0-2eade7dc3621 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:24.500025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee166e45336f45099b9d355bb3ef992e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:24.500251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd146df-aeae-4642-bd37-5b79bca0c0a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:24.501076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd146df-aeae-4642-bd37-5b79bca0c0a1 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:24.501426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd146df-aeae-4642-bd37-5b79bca0c0a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:24.501649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee166e45336f45099b9d355bb3ef992e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:24.501809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd146df-aeae-4642-bd37-5b79bca0c0a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:24.504598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3dd146df-aeae-4642-bd37-5b79bca0c0a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:24.511130 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1639/3296] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:24:24 2022] DELETE /identity/v3/users/ee166e45336f45099b9d355bb3ef992e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:24.520679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd146df-aeae-4642-bd37-5b79bca0c0a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:24.523281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd146df-aeae-4642-bd37-5b79bca0c0a1 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:24.550056 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1658/3297] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:24.889459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:24.893743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:24.969129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:24.988809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a151c-bd69-4534-a135-bfb30ea1d59f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:24.994838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:24.996978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:24.997344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:24.997680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] PATH_INFO: `/v3/projects/d2220819b9bb46609c0473352a7e06d4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:25.000061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2220819b9bb46609c0473352a7e06d4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:25.001417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:25.072770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2220819b9bb46609c0473352a7e06d4', 'request_id': 'req-c2839dab-2511-41a9-a261-2d5d147d5d32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:25.085301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2220819b9bb46609c0473352a7e06d4', 'request_id': 'req-c2839dab-2511-41a9-a261-2d5d147d5d32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:25.093307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2220819b9bb46609c0473352a7e06d4', 'request_id': 'req-c2839dab-2511-41a9-a261-2d5d147d5d32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:25.106632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] The token cache is being invalidate because project d2220819b9bb46609c0473352a7e06d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:24:25.107000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:25.108816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c2839dab-2511-41a9-a261-2d5d147d5d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:25.116110 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1640/3298] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:24 2022] DELETE /identity/v3/projects/d2220819b9bb46609c0473352a7e06d4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:25.118282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39126d-8043-4fcd-8dcf-051eae543877 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:25.118727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39126d-8043-4fcd-8dcf-051eae543877 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:25.118848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39126d-8043-4fcd-8dcf-051eae543877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:25.164357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0b39126d-8043-4fcd-8dcf-051eae543877 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:25.166832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0b39126d-8043-4fcd-8dcf-051eae543877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:25.236396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:25.269188 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1659/3299] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:24:25.278447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16568a-5313-4c6a-a884-605af96b59b2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:25.279174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16568a-5313-4c6a-a884-605af96b59b2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:25.279174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16568a-5313-4c6a-a884-605af96b59b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:25.303546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7b16568a-5313-4c6a-a884-605af96b59b2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:25.304796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7b16568a-5313-4c6a-a884-605af96b59b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:25.313211 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1641/3300] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:25.318179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39126d-8043-4fcd-8dcf-051eae543877 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:25.330296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39126d-8043-4fcd-8dcf-051eae543877 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:25.336337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1bf9f-dcbc-4bc5-b107-c1c6f4e99a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:25.337145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1bf9f-dcbc-4bc5-b107-c1c6f4e99a91 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:25.337427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1bf9f-dcbc-4bc5-b107-c1c6f4e99a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:25.337696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1bf9f-dcbc-4bc5-b107-c1c6f4e99a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:25.338397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1bf9f-dcbc-4bc5-b107-c1c6f4e99a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:24:25.338695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1bf9f-dcbc-4bc5-b107-c1c6f4e99a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:25.340348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1bf9f-dcbc-4bc5-b107-c1c6f4e99a91 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:25.354528 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1660/3301] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:25.359036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16568a-5313-4c6a-a884-605af96b59b2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:25.370217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16568a-5313-4c6a-a884-605af96b59b2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:25.377192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efea30-f11d-45ab-97b4-882fdfa45130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:25.377192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efea30-f11d-45ab-97b4-882fdfa45130 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:25.377597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efea30-f11d-45ab-97b4-882fdfa45130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:25.378093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efea30-f11d-45ab-97b4-882fdfa45130 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:25.378855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efea30-f11d-45ab-97b4-882fdfa45130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:25.381292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2efea30-f11d-45ab-97b4-882fdfa45130 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:25.418175 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1642/3302] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:24:25 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:25.423515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1bf9f-dcbc-4bc5-b107-c1c6f4e99a91 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:25.435624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1bf9f-dcbc-4bc5-b107-c1c6f4e99a91 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:25.526995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea19353-8eb8-4db1-a9e0-639b821c2547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:25.527578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea19353-8eb8-4db1-a9e0-639b821c2547 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:25.527856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea19353-8eb8-4db1-a9e0-639b821c2547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:25.528119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea19353-8eb8-4db1-a9e0-639b821c2547 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:25.528766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea19353-8eb8-4db1-a9e0-639b821c2547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:25.530970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea19353-8eb8-4db1-a9e0-639b821c2547 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:25.565433 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1661/3303] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:24:25 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:25.568309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efea30-f11d-45ab-97b4-882fdfa45130 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:25.592614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efea30-f11d-45ab-97b4-882fdfa45130 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:25.608553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed3d84-befe-4e2d-bf85-d48526f1ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:25.609116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed3d84-befe-4e2d-bf85-d48526f1ebfa admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:25.609396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed3d84-befe-4e2d-bf85-d48526f1ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:25.609666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed3d84-befe-4e2d-bf85-d48526f1ebfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:25.610380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed3d84-befe-4e2d-bf85-d48526f1ebfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:25.612065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed3d84-befe-4e2d-bf85-d48526f1ebfa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:25.626535 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1643/3304] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:25.631373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea19353-8eb8-4db1-a9e0-639b821c2547 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:25.648866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea19353-8eb8-4db1-a9e0-639b821c2547 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:25.662761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfac29-0f45-4d99-9e45-b80b5591cad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:25.663821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfac29-0f45-4d99-9e45-b80b5591cad4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:25.663821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfac29-0f45-4d99-9e45-b80b5591cad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:25.664275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfac29-0f45-4d99-9e45-b80b5591cad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:25.665060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfac29-0f45-4d99-9e45-b80b5591cad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:25.668220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfac29-0f45-4d99-9e45-b80b5591cad4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:25.696713 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1662/3305] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:25.700205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed3d84-befe-4e2d-bf85-d48526f1ebfa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:25.729097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed3d84-befe-4e2d-bf85-d48526f1ebfa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:25.738033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac1b85-888d-483d-9946-be971b0d1a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:25.739887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac1b85-888d-483d-9946-be971b0d1a40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:25.740253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac1b85-888d-483d-9946-be971b0d1a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:25.740980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac1b85-888d-483d-9946-be971b0d1a40 admin admin] PATH_INFO: `/v3/projects/4064fb2403ed4acd8d7cbe41691935d5/users/b2e132bba27b449b99cfdeff2feef522/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:25.765368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac1b85-888d-483d-9946-be971b0d1a40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4064fb2403ed4acd8d7cbe41691935d5, user_id=b2e132bba27b449b99cfdeff2feef522, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:25.768975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac1b85-888d-483d-9946-be971b0d1a40 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:25.797707 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1644/3306] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:25 2022] PUT /identity/v3/projects/4064fb2403ed4acd8d7cbe41691935d5/users/b2e132bba27b449b99cfdeff2feef522/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:25.811335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1ecbf-14d2-4e13-b834-1e80d48e55f9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:25.811817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1ecbf-14d2-4e13-b834-1e80d48e55f9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:25.812747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1ecbf-14d2-4e13-b834-1e80d48e55f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:25.850323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a4f1ecbf-14d2-4e13-b834-1e80d48e55f9 None None] MFA Rules not processed for user `b2e132bba27b449b99cfdeff2feef522`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:25.851608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a4f1ecbf-14d2-4e13-b834-1e80d48e55f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:25.973043 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1663/3307] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:25.975249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac1b85-888d-483d-9946-be971b0d1a40 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:26.071241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac1b85-888d-483d-9946-be971b0d1a40 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:26.080261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa8261-5954-473f-983c-b1e8fea4d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:26.080991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa8261-5954-473f-983c-b1e8fea4d680 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:26.081374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa8261-5954-473f-983c-b1e8fea4d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:26.084048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa8261-5954-473f-983c-b1e8fea4d680 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:26.084897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa8261-5954-473f-983c-b1e8fea4d680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:26.087191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa8261-5954-473f-983c-b1e8fea4d680 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:26.135230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:26.156496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1ecbf-14d2-4e13-b834-1e80d48e55f9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:26.161266 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1645/3308] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:24:25 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:26.174355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1ecbf-14d2-4e13-b834-1e80d48e55f9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:26.235737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:26.266137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb3179-7d67-4425-bd4a-7c8153b91e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:26.266860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb3179-7d67-4425-bd4a-7c8153b91e06 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:26.267043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb3179-7d67-4425-bd4a-7c8153b91e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:26.267317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb3179-7d67-4425-bd4a-7c8153b91e06 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:26.268106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb3179-7d67-4425-bd4a-7c8153b91e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:26.270704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb3179-7d67-4425-bd4a-7c8153b91e06 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:26.303923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa8261-5954-473f-983c-b1e8fea4d680 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:26.310938 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1664/3309] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:24:26 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:26.322868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa8261-5954-473f-983c-b1e8fea4d680 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:26.329831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e87bf-a75d-413f-981c-120c14323897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:26.330760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e87bf-a75d-413f-981c-120c14323897 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:26.331195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e87bf-a75d-413f-981c-120c14323897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:26.331460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e87bf-a75d-413f-981c-120c14323897 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:26.332500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e87bf-a75d-413f-981c-120c14323897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:26.334398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e87bf-a75d-413f-981c-120c14323897 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:26.352639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb3179-7d67-4425-bd4a-7c8153b91e06 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:26.359334 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1646/3310] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:26.365005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb3179-7d67-4425-bd4a-7c8153b91e06 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:26.371227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a87e-a0fc-4d47-bdf3-fbfaf998d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:26.372335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a87e-a0fc-4d47-bdf3-fbfaf998d2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:26.372942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a87e-a0fc-4d47-bdf3-fbfaf998d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:26.373509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7a87e-a0fc-4d47-bdf3-fbfaf998d2ea admin admin] PATH_INFO: `/v3/projects/ee0bf3cbfab14e38bede9e9ffb302684/users/e1deb6c9cc964f7a81cdcaa950b30574/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:26.406477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7a87e-a0fc-4d47-bdf3-fbfaf998d2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0bf3cbfab14e38bede9e9ffb302684, user_id=e1deb6c9cc964f7a81cdcaa950b30574, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:26.409634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7a87e-a0fc-4d47-bdf3-fbfaf998d2ea admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:26.434242 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1665/3311] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:26 2022] PUT /identity/v3/projects/ee0bf3cbfab14e38bede9e9ffb302684/users/e1deb6c9cc964f7a81cdcaa950b30574/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:26.436420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e87bf-a75d-413f-981c-120c14323897 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:26.479844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e87bf-a75d-413f-981c-120c14323897 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:26.613159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08001112-fbc0-4bea-8342-e37a86f154ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:26.613460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001112-fbc0-4bea-8342-e37a86f154ec admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:26.613547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001112-fbc0-4bea-8342-e37a86f154ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:26.615625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08001112-fbc0-4bea-8342-e37a86f154ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:26.616985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08001112-fbc0-4bea-8342-e37a86f154ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:26.620574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08001112-fbc0-4bea-8342-e37a86f154ec admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:26.643102 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1647/3312] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:26.643749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a87e-a0fc-4d47-bdf3-fbfaf998d2ea admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:26.657103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7a87e-a0fc-4d47-bdf3-fbfaf998d2ea admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:26.662789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc3f5d-b75a-4107-9222-d00b0cb55b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:26.672890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc3f5d-b75a-4107-9222-d00b0cb55b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:26.672890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc3f5d-b75a-4107-9222-d00b0cb55b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:26.672890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc3f5d-b75a-4107-9222-d00b0cb55b96 admin admin] PATH_INFO: `/v3/projects/ee0bf3cbfab14e38bede9e9ffb302684/users/e1deb6c9cc964f7a81cdcaa950b30574/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:26.687483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc3f5d-b75a-4107-9222-d00b0cb55b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0bf3cbfab14e38bede9e9ffb302684, user_id=e1deb6c9cc964f7a81cdcaa950b30574, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:26.690484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc3f5d-b75a-4107-9222-d00b0cb55b96 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:26.711569 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1666/3313] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:26 2022] PUT /identity/v3/projects/ee0bf3cbfab14e38bede9e9ffb302684/users/e1deb6c9cc964f7a81cdcaa950b30574/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:26.723127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83293c03-8649-4fdb-b6ff-0cab5bd2971c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:26.724266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83293c03-8649-4fdb-b6ff-0cab5bd2971c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:26.724266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83293c03-8649-4fdb-b6ff-0cab5bd2971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:26.761040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-83293c03-8649-4fdb-b6ff-0cab5bd2971c None None] MFA Rules not processed for user `e1deb6c9cc964f7a81cdcaa950b30574`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:26.762182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-83293c03-8649-4fdb-b6ff-0cab5bd2971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:26.907742 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1648/3314] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:26.921662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c8af5-2576-4891-872a-0e4232bbe1b6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:26.921992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c8af5-2576-4891-872a-0e4232bbe1b6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:26.923012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c8af5-2576-4891-872a-0e4232bbe1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:26.953422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2b6c8af5-2576-4891-872a-0e4232bbe1b6 None None] MFA Rules not processed for user `b2e132bba27b449b99cfdeff2feef522`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:26.955010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b6c8af5-2576-4891-872a-0e4232bbe1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:27.077846 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1667/3315] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:27.359771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83293c03-8649-4fdb-b6ff-0cab5bd2971c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:27.359771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-83293c03-8649-4fdb-b6ff-0cab5bd2971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:27.491792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83293c03-8649-4fdb-b6ff-0cab5bd2971c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:27.502634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb7394-7cb4-4781-bd89-3778b4f5a29b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:27.504047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb7394-7cb4-4781-bd89-3778b4f5a29b service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:27.504658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb7394-7cb4-4781-bd89-3778b4f5a29b service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:27.505277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb7394-7cb4-4781-bd89-3778b4f5a29b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:27.514228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:27.524004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb7394-7cb4-4781-bd89-3778b4f5a29b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:27.527318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb7394-7cb4-4781-bd89-3778b4f5a29b service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:27.558218 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1649/3316] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:30.200013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8c48-5fd3-474f-9ed1-9a81ea96366b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:30.200950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8c48-5fd3-474f-9ed1-9a81ea96366b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:30.200950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea8c48-5fd3-474f-9ed1-9a81ea96366b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:30.302092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ebea8c48-5fd3-474f-9ed1-9a81ea96366b None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:30.303878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ebea8c48-5fd3-474f-9ed1-9a81ea96366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:30.319139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb7394-7cb4-4781-bd89-3778b4f5a29b service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:30.322105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d5bb7394-7cb4-4781-bd89-3778b4f5a29b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:30.350942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb7394-7cb4-4781-bd89-3778b4f5a29b service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:30.383003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650acef-816d-4e00-8b4f-9c5fffa2c7f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:30.383530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650acef-816d-4e00-8b4f-9c5fffa2c7f9 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:30.383808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650acef-816d-4e00-8b4f-9c5fffa2c7f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:30.384076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650acef-816d-4e00-8b4f-9c5fffa2c7f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:30.389182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2650acef-816d-4e00-8b4f-9c5fffa2c7f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:30.415801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650acef-816d-4e00-8b4f-9c5fffa2c7f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:30.417711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650acef-816d-4e00-8b4f-9c5fffa2c7f9 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:30.427689 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1668/3317] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:24:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:30.455431 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1650/3318] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:24:30.524978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea8c48-5fd3-474f-9ed1-9a81ea96366b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:30.526696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ebea8c48-5fd3-474f-9ed1-9a81ea96366b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:30.552735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:30.734381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea8c48-5fd3-474f-9ed1-9a81ea96366b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:30.751037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06bb8-6eb3-4e2e-b400-59072d400a10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:30.752436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06bb8-6eb3-4e2e-b400-59072d400a10 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:30.752895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06bb8-6eb3-4e2e-b400-59072d400a10 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:30.753367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06bb8-6eb3-4e2e-b400-59072d400a10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:30.767720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06bb8-6eb3-4e2e-b400-59072d400a10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:30.770321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06bb8-6eb3-4e2e-b400-59072d400a10 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:30.791002 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1669/3319] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:32.869191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650acef-816d-4e00-8b4f-9c5fffa2c7f9 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:32.871666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2650acef-816d-4e00-8b4f-9c5fffa2c7f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:33.016704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650acef-816d-4e00-8b4f-9c5fffa2c7f9 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:33.023712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f563e-c9ea-4d8d-a87d-33bd7ffc2cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:33.024797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f563e-c9ea-4d8d-a87d-33bd7ffc2cfc service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:33.025184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f563e-c9ea-4d8d-a87d-33bd7ffc2cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:33.025557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f563e-c9ea-4d8d-a87d-33bd7ffc2cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:33.028356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-578f563e-c9ea-4d8d-a87d-33bd7ffc2cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:33.044323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f563e-c9ea-4d8d-a87d-33bd7ffc2cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:33.046138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f563e-c9ea-4d8d-a87d-33bd7ffc2cfc service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:33.069540 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1651/3320] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:40.778597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=37 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:42.366879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06bb8-6eb3-4e2e-b400-59072d400a10 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:42.368695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ff06bb8-6eb3-4e2e-b400-59072d400a10 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:42.529066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06bb8-6eb3-4e2e-b400-59072d400a10 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:42.536658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:42.537355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:42.537774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:42.538002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] PATH_INFO: `/v3/users/756aa8043ed94658844cd8c46e8723d2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:42.540045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=756aa8043ed94658844cd8c46e8723d2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:42.542334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:42.632620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756aa8043ed94658844cd8c46e8723d2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:42.634010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756aa8043ed94658844cd8c46e8723d2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:42.648348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756aa8043ed94658844cd8c46e8723d2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:42.674134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756aa8043ed94658844cd8c46e8723d2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:42.705095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2a29062e-1926-4adb-9121-4d74ad84f17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756aa8043ed94658844cd8c46e8723d2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:42.713603 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1670/3321] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:24:42 2022] DELETE /identity/v3/users/756aa8043ed94658844cd8c46e8723d2 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:43.045780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f563e-c9ea-4d8d-a87d-33bd7ffc2cfc service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:43.065263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f563e-c9ea-4d8d-a87d-33bd7ffc2cfc service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:43.135213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:43.136162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:43.136426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:43.136898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] PATH_INFO: `/v3/projects/98516c7536e2422aba7979f694dfa523` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:43.138341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98516c7536e2422aba7979f694dfa523)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:43.140506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:43.242263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98516c7536e2422aba7979f694dfa523', 'request_id': 'req-555ff28d-5ce6-47bf-b563-9a778bd941f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:43.255520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98516c7536e2422aba7979f694dfa523', 'request_id': 'req-555ff28d-5ce6-47bf-b563-9a778bd941f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:43.265338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98516c7536e2422aba7979f694dfa523', 'request_id': 'req-555ff28d-5ce6-47bf-b563-9a778bd941f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:43.279447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] The token cache is being invalidate because project 98516c7536e2422aba7979f694dfa523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:24:43.280062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:43.280955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-555ff28d-5ce6-47bf-b563-9a778bd941f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:43.283001 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1652/3322] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:43 2022] DELETE /identity/v3/projects/98516c7536e2422aba7979f694dfa523 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:43.287952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc5cc9-9aff-4af5-ba33-252029fc49da None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:43.288619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc5cc9-9aff-4af5-ba33-252029fc49da None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:43.289662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc5cc9-9aff-4af5-ba33-252029fc49da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:43.315365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-57bc5cc9-9aff-4af5-ba33-252029fc49da None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:43.317967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-57bc5cc9-9aff-4af5-ba33-252029fc49da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:43.422588 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1671/3323] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:24:43.432513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc684a-97eb-47f5-ae68-75fd730f5764 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:43.432901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc684a-97eb-47f5-ae68-75fd730f5764 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:43.433322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc684a-97eb-47f5-ae68-75fd730f5764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:43.458185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7ecc684a-97eb-47f5-ae68-75fd730f5764 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:43.459555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ecc684a-97eb-47f5-ae68-75fd730f5764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:43.477362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc5cc9-9aff-4af5-ba33-252029fc49da None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:43.492561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc5cc9-9aff-4af5-ba33-252029fc49da None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:43.495160 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1653/3324] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:43.503261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da7d52-264c-4f6b-86c6-b5fb88b10b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:43.504132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da7d52-264c-4f6b-86c6-b5fb88b10b2f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:43.504722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da7d52-264c-4f6b-86c6-b5fb88b10b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:43.505144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da7d52-264c-4f6b-86c6-b5fb88b10b2f admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:43.505941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da7d52-264c-4f6b-86c6-b5fb88b10b2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:24:43.506347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da7d52-264c-4f6b-86c6-b5fb88b10b2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:43.508078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da7d52-264c-4f6b-86c6-b5fb88b10b2f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:43.525838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc684a-97eb-47f5-ae68-75fd730f5764 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:43.533430 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1672/3325] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:43.542769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc684a-97eb-47f5-ae68-75fd730f5764 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:43.549857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e37b16-d1ec-449c-bad2-bf28fc4f1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:43.551280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37b16-d1ec-449c-bad2-bf28fc4f1b3b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:43.551880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37b16-d1ec-449c-bad2-bf28fc4f1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:43.552680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e37b16-d1ec-449c-bad2-bf28fc4f1b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:43.554602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e37b16-d1ec-449c-bad2-bf28fc4f1b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:43.556615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e37b16-d1ec-449c-bad2-bf28fc4f1b3b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:43.565599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:43.641038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da7d52-264c-4f6b-86c6-b5fb88b10b2f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:43.653830 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1654/3326] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:24:43 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:24:43.657059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da7d52-264c-4f6b-86c6-b5fb88b10b2f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:43.662397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:43.773041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470056a-a5ef-4baf-a7d3-581ec1c15092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:43.773832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470056a-a5ef-4baf-a7d3-581ec1c15092 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:43.776751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470056a-a5ef-4baf-a7d3-581ec1c15092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:43.777286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470056a-a5ef-4baf-a7d3-581ec1c15092 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:43.778084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470056a-a5ef-4baf-a7d3-581ec1c15092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:43.785363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470056a-a5ef-4baf-a7d3-581ec1c15092 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:43.839418 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1673/3327] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:24:43 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:24:43.843637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e37b16-d1ec-449c-bad2-bf28fc4f1b3b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:43.864827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e37b16-d1ec-449c-bad2-bf28fc4f1b3b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:43.895467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b967736-e648-40e1-b6d3-afa172039f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:43.897094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b967736-e648-40e1-b6d3-afa172039f74 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:43.899161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b967736-e648-40e1-b6d3-afa172039f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:43.900252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b967736-e648-40e1-b6d3-afa172039f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:43.902920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b967736-e648-40e1-b6d3-afa172039f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:43.906901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b967736-e648-40e1-b6d3-afa172039f74 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:43.947933 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1655/3328] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:43.952723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470056a-a5ef-4baf-a7d3-581ec1c15092 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:43.971141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470056a-a5ef-4baf-a7d3-581ec1c15092 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:43.987450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a81a8-a62c-400f-983b-d9dbb154731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:43.988170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a81a8-a62c-400f-983b-d9dbb154731c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:43.988606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a81a8-a62c-400f-983b-d9dbb154731c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:43.988873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a81a8-a62c-400f-983b-d9dbb154731c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:43.989599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a81a8-a62c-400f-983b-d9dbb154731c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:43.991264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a81a8-a62c-400f-983b-d9dbb154731c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:44.028274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b967736-e648-40e1-b6d3-afa172039f74 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:44.029195 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1674/3329] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:44.045345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b967736-e648-40e1-b6d3-afa172039f74 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:44.055880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff392be-28f1-4ee4-8730-2ba9e078442d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:44.056580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff392be-28f1-4ee4-8730-2ba9e078442d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:44.056860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff392be-28f1-4ee4-8730-2ba9e078442d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:44.057132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff392be-28f1-4ee4-8730-2ba9e078442d admin admin] PATH_INFO: `/v3/projects/270c2560a18d4d329ef45c1305706d05/users/fc376020ea1f4826b3c873b8945cb8a3/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:44.134157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff392be-28f1-4ee4-8730-2ba9e078442d admin admin] RBAC: Authorizing `identity:create_grant(project_id=270c2560a18d4d329ef45c1305706d05, user_id=fc376020ea1f4826b3c873b8945cb8a3, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:44.143936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff392be-28f1-4ee4-8730-2ba9e078442d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:44.173666 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1656/3330] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:44 2022] PUT /identity/v3/projects/270c2560a18d4d329ef45c1305706d05/users/fc376020ea1f4826b3c873b8945cb8a3/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:24:44.179511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d0ef-83fd-44c2-84d8-d93f9f9be4a0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:44.179791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d0ef-83fd-44c2-84d8-d93f9f9be4a0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:44.180062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5d0ef-83fd-44c2-84d8-d93f9f9be4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:44.227104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4ff5d0ef-83fd-44c2-84d8-d93f9f9be4a0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:44.228525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ff5d0ef-83fd-44c2-84d8-d93f9f9be4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:44.423745 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1675/3331] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:44.464101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff392be-28f1-4ee4-8730-2ba9e078442d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:44.466940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ff392be-28f1-4ee4-8730-2ba9e078442d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:44.605158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff392be-28f1-4ee4-8730-2ba9e078442d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:44.608962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985c005-5172-4f59-a363-b1de0ecf645e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:44.609611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985c005-5172-4f59-a363-b1de0ecf645e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:44.609918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985c005-5172-4f59-a363-b1de0ecf645e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:44.610328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985c005-5172-4f59-a363-b1de0ecf645e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:44.624477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985c005-5172-4f59-a363-b1de0ecf645e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:44.627391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985c005-5172-4f59-a363-b1de0ecf645e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:44.682030 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1657/3332] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:24:44.690615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53995d64-94ea-439c-a73b-09c9cc24325e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:44.691178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53995d64-94ea-439c-a73b-09c9cc24325e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:44.691613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53995d64-94ea-439c-a73b-09c9cc24325e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:44.714607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-53995d64-94ea-439c-a73b-09c9cc24325e None None] MFA Rules not processed for user `e5a02f772ad1448ab3d1b67541ca6581`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:44.716415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-53995d64-94ea-439c-a73b-09c9cc24325e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:44.800655 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1676/3333] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:45.141170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985c005-5172-4f59-a363-b1de0ecf645e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:45.142705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9985c005-5172-4f59-a363-b1de0ecf645e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:45.171090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985c005-5172-4f59-a363-b1de0ecf645e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:45.183969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:45.190045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:45.190568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:45.191217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] PATH_INFO: `/v3/users/16b4da39b4ad4cee98c185bfa7e6f054` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:45.193048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b4da39b4ad4cee98c185bfa7e6f054)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:45.195182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:45.312575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b4da39b4ad4cee98c185bfa7e6f054'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:45.334787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b4da39b4ad4cee98c185bfa7e6f054'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:45.367126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b4da39b4ad4cee98c185bfa7e6f054'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:45.380291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b4da39b4ad4cee98c185bfa7e6f054'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:45.381512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-acf4132a-275f-45dd-9f4f-594daf744f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b4da39b4ad4cee98c185bfa7e6f054'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:45.393400 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1658/3334] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:24:45 2022] DELETE /identity/v3/users/16b4da39b4ad4cee98c185bfa7e6f054 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:45.706756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53995d64-94ea-439c-a73b-09c9cc24325e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:45.720662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53995d64-94ea-439c-a73b-09c9cc24325e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:45.797769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:45.847310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:45.848783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:45.849457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:45.850310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] PATH_INFO: `/v3/projects/f1fbf75f364f466698dd4eb2a1df773b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:45.852649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1fbf75f364f466698dd4eb2a1df773b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:45.855141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:45.935906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1fbf75f364f466698dd4eb2a1df773b', 'request_id': 'req-c2b9bb67-f239-41f6-836a-a21397964923'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:45.946091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1fbf75f364f466698dd4eb2a1df773b', 'request_id': 'req-c2b9bb67-f239-41f6-836a-a21397964923'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:45.959645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1fbf75f364f466698dd4eb2a1df773b', 'request_id': 'req-c2b9bb67-f239-41f6-836a-a21397964923'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:45.979155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] The token cache is being invalidate because project f1fbf75f364f466698dd4eb2a1df773b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:24:45.979744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:45.980616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2b9bb67-f239-41f6-836a-a21397964923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:24:45.988608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500090a-12b7-442e-9414-8191e0910969 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:45.989066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500090a-12b7-442e-9414-8191e0910969 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:45.989411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500090a-12b7-442e-9414-8191e0910969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:45.991209 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1677/3335] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:45 2022] DELETE /identity/v3/projects/f1fbf75f364f466698dd4eb2a1df773b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:46.014941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c500090a-12b7-442e-9414-8191e0910969 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:46.018082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c500090a-12b7-442e-9414-8191e0910969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:46.043573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:46.101639 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1659/3336] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:46.109543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1104f-b3b7-4487-8d87-685d8d084157 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:46.110304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1104f-b3b7-4487-8d87-685d8d084157 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:46.110803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1104f-b3b7-4487-8d87-685d8d084157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:46.138107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-00f1104f-b3b7-4487-8d87-685d8d084157 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:46.139746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-00f1104f-b3b7-4487-8d87-685d8d084157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:46.149817 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1678/3337] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:24:46.154493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500090a-12b7-442e-9414-8191e0910969 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:46.169747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500090a-12b7-442e-9414-8191e0910969 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:46.180378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b0bc9-e48d-4b58-a522-1728dc0c68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:46.181548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b0bc9-e48d-4b58-a522-1728dc0c68d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:46.182019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b0bc9-e48d-4b58-a522-1728dc0c68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:46.182456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b0bc9-e48d-4b58-a522-1728dc0c68d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:46.183292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b0bc9-e48d-4b58-a522-1728dc0c68d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:24:46.183945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b0bc9-e48d-4b58-a522-1728dc0c68d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:46.185842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b0bc9-e48d-4b58-a522-1728dc0c68d7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:46.200265 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1660/3338] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:24:46.204435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1104f-b3b7-4487-8d87-685d8d084157 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:46.220280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1104f-b3b7-4487-8d87-685d8d084157 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:46.227079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b40f4-4999-48e7-9120-75d1c6411f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:46.228065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b40f4-4999-48e7-9120-75d1c6411f8f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:46.228714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b40f4-4999-48e7-9120-75d1c6411f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:46.229213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b40f4-4999-48e7-9120-75d1c6411f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:46.230115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b40f4-4999-48e7-9120-75d1c6411f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:46.232467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b40f4-4999-48e7-9120-75d1c6411f8f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:46.271174 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1679/3339] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:24:46 2022] POST /identity/v3/projects => generated 397 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:24:46.275486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b0bc9-e48d-4b58-a522-1728dc0c68d7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:46.289161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b0bc9-e48d-4b58-a522-1728dc0c68d7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:46.366689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ee5ce-1f47-4a00-84b0-9545c15739aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:46.367324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ee5ce-1f47-4a00-84b0-9545c15739aa admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:46.367746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ee5ce-1f47-4a00-84b0-9545c15739aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:46.368020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ee5ce-1f47-4a00-84b0-9545c15739aa admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:46.368798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ee5ce-1f47-4a00-84b0-9545c15739aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:46.371027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ee5ce-1f47-4a00-84b0-9545c15739aa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:46.401930 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1661/3340] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:24:46 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:24:46.407145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b40f4-4999-48e7-9120-75d1c6411f8f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:46.423481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b40f4-4999-48e7-9120-75d1c6411f8f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:46.450087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5df742-8028-4d70-af6b-44d749e8ae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:46.450964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5df742-8028-4d70-af6b-44d749e8ae4f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:46.451391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5df742-8028-4d70-af6b-44d749e8ae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:46.451816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5df742-8028-4d70-af6b-44d749e8ae4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:46.453818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5df742-8028-4d70-af6b-44d749e8ae4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:46.458511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5df742-8028-4d70-af6b-44d749e8ae4f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:46.485248 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1680/3341] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:24:46.486450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ee5ce-1f47-4a00-84b0-9545c15739aa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:46.505573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ee5ce-1f47-4a00-84b0-9545c15739aa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:46.533801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93563857-5d35-4c24-b76c-dd71b000ad5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:46.538485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93563857-5d35-4c24-b76c-dd71b000ad5d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:46.539541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93563857-5d35-4c24-b76c-dd71b000ad5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:46.539541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93563857-5d35-4c24-b76c-dd71b000ad5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:46.540064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93563857-5d35-4c24-b76c-dd71b000ad5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:46.543887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93563857-5d35-4c24-b76c-dd71b000ad5d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:46.564503 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1662/3342] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:24:46.566200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5df742-8028-4d70-af6b-44d749e8ae4f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:46.580449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5df742-8028-4d70-af6b-44d749e8ae4f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:46.590324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388f6bf-0e0d-4211-8c53-33a9e92f7207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:46.592320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388f6bf-0e0d-4211-8c53-33a9e92f7207 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:46.592813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388f6bf-0e0d-4211-8c53-33a9e92f7207 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:46.593493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388f6bf-0e0d-4211-8c53-33a9e92f7207 admin admin] PATH_INFO: `/v3/projects/0a2bacb22e024578b81b1ae1f70fab32/users/7ffd11b7f28d47478c4088a9d2a73a4a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:46.642536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388f6bf-0e0d-4211-8c53-33a9e92f7207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a2bacb22e024578b81b1ae1f70fab32, user_id=7ffd11b7f28d47478c4088a9d2a73a4a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:46.646481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d388f6bf-0e0d-4211-8c53-33a9e92f7207 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:46.696692 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1681/3343] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:24:46 2022] PUT /identity/v3/projects/0a2bacb22e024578b81b1ae1f70fab32/users/7ffd11b7f28d47478c4088a9d2a73a4a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:24:46.713349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3573f6-31a8-48e3-9647-d1907a873293 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:46.713947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3573f6-31a8-48e3-9647-d1907a873293 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:46.714241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3573f6-31a8-48e3-9647-d1907a873293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:46.739357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7c3573f6-31a8-48e3-9647-d1907a873293 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:46.740797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7c3573f6-31a8-48e3-9647-d1907a873293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:46.842013 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1663/3344] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:46.860287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388f6bf-0e0d-4211-8c53-33a9e92f7207 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:46.863518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d388f6bf-0e0d-4211-8c53-33a9e92f7207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:46.956736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388f6bf-0e0d-4211-8c53-33a9e92f7207 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:46.964847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ac50-d7e9-4a11-8206-edaf3e4e0c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:46.965580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ac50-d7e9-4a11-8206-edaf3e4e0c75 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:46.966369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ac50-d7e9-4a11-8206-edaf3e4e0c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:46.966369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7ac50-d7e9-4a11-8206-edaf3e4e0c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:46.979690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ac50-d7e9-4a11-8206-edaf3e4e0c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:46.981174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7ac50-d7e9-4a11-8206-edaf3e4e0c75 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:46.986513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:46.993352 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1682/3345] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:24:56.820730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:57.909310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cee2b-0791-421e-b5cc-26afb13dda71 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:57.910143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cee2b-0791-421e-b5cc-26afb13dda71 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:57.910143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cee2b-0791-421e-b5cc-26afb13dda71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:57.991825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-801cee2b-0791-421e-b5cc-26afb13dda71 None None] MFA Rules not processed for user `fc376020ea1f4826b3c873b8945cb8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:24:57.993236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-801cee2b-0791-421e-b5cc-26afb13dda71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:24:58.230408 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1664/3346] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:24:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:24:58.274722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ac50-d7e9-4a11-8206-edaf3e4e0c75 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:24:58.290856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7ac50-d7e9-4a11-8206-edaf3e4e0c75 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:24:58.298922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a301144-23aa-45b0-98f6-4e0c2465c0a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:24:58.302336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a301144-23aa-45b0-98f6-4e0c2465c0a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:24:58.302823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a301144-23aa-45b0-98f6-4e0c2465c0a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:24:58.303505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a301144-23aa-45b0-98f6-4e0c2465c0a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:24:58.330034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a301144-23aa-45b0-98f6-4e0c2465c0a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:24:58.336585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a301144-23aa-45b0-98f6-4e0c2465c0a9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:24:58.364219 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1683/3347] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:24:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:00.737258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6a43-e08e-488f-8e0e-61fc4f2789d0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:00.738340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6a43-e08e-488f-8e0e-61fc4f2789d0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:00.738956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6a43-e08e-488f-8e0e-61fc4f2789d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:00.780951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf3e10-700d-4325-b32c-eae8cd77781e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:00.781532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf3e10-700d-4325-b32c-eae8cd77781e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:00.781532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf3e10-700d-4325-b32c-eae8cd77781e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:00.798603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-39bb6a43-e08e-488f-8e0e-61fc4f2789d0 None None] MFA Rules not processed for user `7ffd11b7f28d47478c4088a9d2a73a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:00.800101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-39bb6a43-e08e-488f-8e0e-61fc4f2789d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:00.821257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-06bf3e10-700d-4325-b32c-eae8cd77781e None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:00.822579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-06bf3e10-700d-4325-b32c-eae8cd77781e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:00.954658 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1684/3348] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:25:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:00.955878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf3e10-700d-4325-b32c-eae8cd77781e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:00.967116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-06bf3e10-700d-4325-b32c-eae8cd77781e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:00.987276 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1665/3349] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:00 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:01.007106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb6a43-e08e-488f-8e0e-61fc4f2789d0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:01.008730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-39bb6a43-e08e-488f-8e0e-61fc4f2789d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:01.121612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf3e10-700d-4325-b32c-eae8cd77781e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:01.132505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef44627-350d-45b1-ab9f-12760157845b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:01.133409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44627-350d-45b1-ab9f-12760157845b service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:01.133861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44627-350d-45b1-ab9f-12760157845b service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:01.134323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef44627-350d-45b1-ab9f-12760157845b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:01.156301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef44627-350d-45b1-ab9f-12760157845b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:01.158623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef44627-350d-45b1-ab9f-12760157845b service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:01.190784 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1685/3350] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:25:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:01.194484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb6a43-e08e-488f-8e0e-61fc4f2789d0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:01.226114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079a334-74e0-416d-85e5-86ea64e64fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:01.228827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079a334-74e0-416d-85e5-86ea64e64fb0 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:01.230794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079a334-74e0-416d-85e5-86ea64e64fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:01.231110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079a334-74e0-416d-85e5-86ea64e64fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:01.261999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079a334-74e0-416d-85e5-86ea64e64fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:01.271254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079a334-74e0-416d-85e5-86ea64e64fb0 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:01.305983 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1666/3351] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:07.320990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eb0f6-baae-4c24-a0d7-10b0edc9e797 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:07.321687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eb0f6-baae-4c24-a0d7-10b0edc9e797 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:07.321687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eb0f6-baae-4c24-a0d7-10b0edc9e797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:07.420175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-538eb0f6-baae-4c24-a0d7-10b0edc9e797 None None] MFA Rules not processed for user `fc376020ea1f4826b3c873b8945cb8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:07.445535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-538eb0f6-baae-4c24-a0d7-10b0edc9e797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:07.477432 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1686/3352] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:09.554312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079a334-74e0-416d-85e5-86ea64e64fb0 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:09.555803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b079a334-74e0-416d-85e5-86ea64e64fb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:09.567753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:09.584514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079a334-74e0-416d-85e5-86ea64e64fb0 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:09.605212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f04b-6e5f-4fcf-8e13-0053da43d2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:09.606292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f04b-6e5f-4fcf-8e13-0053da43d2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:09.606775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f04b-6e5f-4fcf-8e13-0053da43d2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:09.607246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768f04b-6e5f-4fcf-8e13-0053da43d2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:09.622237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a768f04b-6e5f-4fcf-8e13-0053da43d2c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:09.668939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f04b-6e5f-4fcf-8e13-0053da43d2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:09.671418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768f04b-6e5f-4fcf-8e13-0053da43d2c8 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:09.710286 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1667/3353] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:14.814628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eb0f6-baae-4c24-a0d7-10b0edc9e797 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:14.816611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-538eb0f6-baae-4c24-a0d7-10b0edc9e797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:14.844293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eb0f6-baae-4c24-a0d7-10b0edc9e797 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:14.874261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:14.876762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:14.877048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:14.877327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] PATH_INFO: `/v3/users/02f472dc41b84e428eeb0b43299a37fe` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:14.885414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f472dc41b84e428eeb0b43299a37fe)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:14.898435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:15.050072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f472dc41b84e428eeb0b43299a37fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:15.062736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f472dc41b84e428eeb0b43299a37fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:15.084972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f04b-6e5f-4fcf-8e13-0053da43d2c8 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:15.093760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f472dc41b84e428eeb0b43299a37fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:15.110966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f472dc41b84e428eeb0b43299a37fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:15.130321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768f04b-6e5f-4fcf-8e13-0053da43d2c8 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:15.135672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:15.160499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f472dc41b84e428eeb0b43299a37fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:15.163786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82793a-b135-40f4-afe2-1b601eea6147 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:15.164567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82793a-b135-40f4-afe2-1b601eea6147 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:15.165081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82793a-b135-40f4-afe2-1b601eea6147 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:15.165474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82793a-b135-40f4-afe2-1b601eea6147 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:15.175092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0b82793a-b135-40f4-afe2-1b601eea6147 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:15.180735 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1687/3354] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:25:14 2022] DELETE /identity/v3/users/02f472dc41b84e428eeb0b43299a37fe => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:15.339938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82793a-b135-40f4-afe2-1b601eea6147 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:15.342057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82793a-b135-40f4-afe2-1b601eea6147 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:15.375714 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1668/3355] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:15.936621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:15.938383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:16.176453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1aa9f-4670-437f-b2f3-dc0d081e0506 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:16.212951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:16.219942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:16.230432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:16.231117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] PATH_INFO: `/v3/projects/78e54ec6dad74d4b85876689aeaab833` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:16.233448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e54ec6dad74d4b85876689aeaab833)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:16.237178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:16.437798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e54ec6dad74d4b85876689aeaab833', 'request_id': 'req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:16.462915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e54ec6dad74d4b85876689aeaab833', 'request_id': 'req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:16.506633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e54ec6dad74d4b85876689aeaab833', 'request_id': 'req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:16.539122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] The token cache is being invalidate because project 78e54ec6dad74d4b85876689aeaab833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:25:16.539425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:16.540110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2f02fe8e-b4e9-4cdd-805a-d326286dde7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:16.541662 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1688/3356] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:15 2022] DELETE /identity/v3/projects/78e54ec6dad74d4b85876689aeaab833 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:16.548904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d1ea-4e95-4e83-bebf-be5e0974e86b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:16.550166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d1ea-4e95-4e83-bebf-be5e0974e86b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:16.550166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d1ea-4e95-4e83-bebf-be5e0974e86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:16.610514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a381d1ea-4e95-4e83-bebf-be5e0974e86b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:16.613658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a381d1ea-4e95-4e83-bebf-be5e0974e86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:16.807356 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1669/3357] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:16.819360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7124-b265-48ab-b9c8-742ed7202853 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:16.819661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7124-b265-48ab-b9c8-742ed7202853 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:16.819914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca7124-b265-48ab-b9c8-742ed7202853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:16.848664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-40ca7124-b265-48ab-b9c8-742ed7202853 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:16.849996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-40ca7124-b265-48ab-b9c8-742ed7202853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:16.864170 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1689/3358] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:16.870367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381d1ea-4e95-4e83-bebf-be5e0974e86b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:16.886811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381d1ea-4e95-4e83-bebf-be5e0974e86b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:16.899049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb03fe-70e6-4547-b2a8-30f5bd8a4710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:16.899748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb03fe-70e6-4547-b2a8-30f5bd8a4710 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:16.900023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb03fe-70e6-4547-b2a8-30f5bd8a4710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:16.902450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb03fe-70e6-4547-b2a8-30f5bd8a4710 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:16.903152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb03fe-70e6-4547-b2a8-30f5bd8a4710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:25:16.904048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb03fe-70e6-4547-b2a8-30f5bd8a4710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:16.907019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb03fe-70e6-4547-b2a8-30f5bd8a4710 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:16.947079 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1670/3359] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:25:16.952697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca7124-b265-48ab-b9c8-742ed7202853 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:16.964453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca7124-b265-48ab-b9c8-742ed7202853 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:16.983245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bbf8a-33e2-400c-a4f3-bad350988ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:16.985430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bbf8a-33e2-400c-a4f3-bad350988ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:16.987217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bbf8a-33e2-400c-a4f3-bad350988ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:16.987682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bbf8a-33e2-400c-a4f3-bad350988ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:16.989859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bbf8a-33e2-400c-a4f3-bad350988ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:16.994762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bbf8a-33e2-400c-a4f3-bad350988ab1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:17.064811 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1690/3360] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:25:16 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:25:17.066586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb03fe-70e6-4547-b2a8-30f5bd8a4710 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:17.090221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb03fe-70e6-4547-b2a8-30f5bd8a4710 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:17.222248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bda53-ca31-4c6a-a5e5-69300f55bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:17.223081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bda53-ca31-4c6a-a5e5-69300f55bdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:17.223355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bda53-ca31-4c6a-a5e5-69300f55bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:17.223804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bda53-ca31-4c6a-a5e5-69300f55bdc3 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:17.224456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bda53-ca31-4c6a-a5e5-69300f55bdc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:17.226552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bda53-ca31-4c6a-a5e5-69300f55bdc3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:17.273475 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1671/3361] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:25:17 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:25:17.277390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bbf8a-33e2-400c-a4f3-bad350988ab1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:17.295786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bbf8a-33e2-400c-a4f3-bad350988ab1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:17.308731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f174c95-0bb7-44df-8040-17120c2dbea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:17.309380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f174c95-0bb7-44df-8040-17120c2dbea1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:17.309654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f174c95-0bb7-44df-8040-17120c2dbea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:17.309994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f174c95-0bb7-44df-8040-17120c2dbea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:17.310617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f174c95-0bb7-44df-8040-17120c2dbea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:17.312383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f174c95-0bb7-44df-8040-17120c2dbea1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:17.341744 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1691/3362] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:25:17.346983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bda53-ca31-4c6a-a5e5-69300f55bdc3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:17.354134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:17.365930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bda53-ca31-4c6a-a5e5-69300f55bdc3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:17.380094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca988e-bae7-40a3-966f-1d792cafb10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:17.380783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca988e-bae7-40a3-966f-1d792cafb10d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:17.381061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca988e-bae7-40a3-966f-1d792cafb10d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:17.381328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca988e-bae7-40a3-966f-1d792cafb10d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:17.382071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca988e-bae7-40a3-966f-1d792cafb10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:17.384379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca988e-bae7-40a3-966f-1d792cafb10d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:17.411685 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1672/3363] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:25:17.415725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f174c95-0bb7-44df-8040-17120c2dbea1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:17.430341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f174c95-0bb7-44df-8040-17120c2dbea1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:17.444179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a3d58-24dc-4fc2-b401-cadbe3f45208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:17.445393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a3d58-24dc-4fc2-b401-cadbe3f45208 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:17.445673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a3d58-24dc-4fc2-b401-cadbe3f45208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:17.445962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a3d58-24dc-4fc2-b401-cadbe3f45208 admin admin] PATH_INFO: `/v3/projects/aaa5c47a7b2e47aca3c7e78314b5151a/users/31b870521ea34e31a5c1bdce0829162d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:17.486403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a3d58-24dc-4fc2-b401-cadbe3f45208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa5c47a7b2e47aca3c7e78314b5151a, user_id=31b870521ea34e31a5c1bdce0829162d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:17.493005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a3d58-24dc-4fc2-b401-cadbe3f45208 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:17.522765 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1692/3364] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:25:17 2022] PUT /identity/v3/projects/aaa5c47a7b2e47aca3c7e78314b5151a/users/31b870521ea34e31a5c1bdce0829162d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:25:17.527898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5902b-aa64-4dcd-bb3d-7b935e4a671e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:17.528175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5902b-aa64-4dcd-bb3d-7b935e4a671e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:17.528447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5902b-aa64-4dcd-bb3d-7b935e4a671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:17.564022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-22d5902b-aa64-4dcd-bb3d-7b935e4a671e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:17.565393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-22d5902b-aa64-4dcd-bb3d-7b935e4a671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:17.722667 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1673/3365] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:17.810984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a3d58-24dc-4fc2-b401-cadbe3f45208 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:17.813691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-108a3d58-24dc-4fc2-b401-cadbe3f45208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:17.844714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:18.004582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a3d58-24dc-4fc2-b401-cadbe3f45208 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:18.008855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231534-5498-4474-ae07-35d526bd764d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:18.009625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231534-5498-4474-ae07-35d526bd764d service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:18.009934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231534-5498-4474-ae07-35d526bd764d service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:18.010210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231534-5498-4474-ae07-35d526bd764d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:18.021970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16231534-5498-4474-ae07-35d526bd764d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:18.023451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16231534-5498-4474-ae07-35d526bd764d service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:18.036274 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1693/3366] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:21.171274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5902b-aa64-4dcd-bb3d-7b935e4a671e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:21.173955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-22d5902b-aa64-4dcd-bb3d-7b935e4a671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:21.211941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5902b-aa64-4dcd-bb3d-7b935e4a671e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:21.226308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:21.241937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:21.248281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:21.248649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] PATH_INFO: `/v3/users/7ffd11b7f28d47478c4088a9d2a73a4a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:21.253850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ffd11b7f28d47478c4088a9d2a73a4a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:21.263304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:21.390726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ffd11b7f28d47478c4088a9d2a73a4a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:21.408366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ffd11b7f28d47478c4088a9d2a73a4a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:21.447625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ffd11b7f28d47478c4088a9d2a73a4a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:21.468712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ffd11b7f28d47478c4088a9d2a73a4a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:21.469388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b107fb34-e13e-49fd-ab3a-a7db52486ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ffd11b7f28d47478c4088a9d2a73a4a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:21.479279 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1674/3367] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:25:21 2022] DELETE /identity/v3/users/7ffd11b7f28d47478c4088a9d2a73a4a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:22.017480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231534-5498-4474-ae07-35d526bd764d service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:22.035123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231534-5498-4474-ae07-35d526bd764d service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:22.297557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:22.304568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:22.304568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:22.304867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] PATH_INFO: `/v3/projects/0a2bacb22e024578b81b1ae1f70fab32` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:22.313191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a2bacb22e024578b81b1ae1f70fab32)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:22.319534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:22.454867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a2bacb22e024578b81b1ae1f70fab32', 'request_id': 'req-eb385e46-9db8-4888-9c24-6d587320baa9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:22.468818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a2bacb22e024578b81b1ae1f70fab32', 'request_id': 'req-eb385e46-9db8-4888-9c24-6d587320baa9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:22.489134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a2bacb22e024578b81b1ae1f70fab32', 'request_id': 'req-eb385e46-9db8-4888-9c24-6d587320baa9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:22.517347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] The token cache is being invalidate because project 0a2bacb22e024578b81b1ae1f70fab32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:25:22.517794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:22.527685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb385e46-9db8-4888-9c24-6d587320baa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:22.530247 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1694/3368] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:22 2022] DELETE /identity/v3/projects/0a2bacb22e024578b81b1ae1f70fab32 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:22.538309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef47765-364e-48c5-9ac9-d82fba52d9bf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:22.539468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef47765-364e-48c5-9ac9-d82fba52d9bf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:22.539935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef47765-364e-48c5-9ac9-d82fba52d9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:22.587628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-aef47765-364e-48c5-9ac9-d82fba52d9bf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:22.590300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aef47765-364e-48c5-9ac9-d82fba52d9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:22.784270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33b774-54e0-4763-bd4d-4f9a79cb9627 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:22.784545 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1675/3369] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:22.785001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33b774-54e0-4763-bd4d-4f9a79cb9627 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:22.785485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33b774-54e0-4763-bd4d-4f9a79cb9627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:22.850486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8d33b774-54e0-4763-bd4d-4f9a79cb9627 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:22.854844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8d33b774-54e0-4763-bd4d-4f9a79cb9627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:22.901932 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1695/3370] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:22.904265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef47765-364e-48c5-9ac9-d82fba52d9bf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:22.922675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:22.936040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef47765-364e-48c5-9ac9-d82fba52d9bf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:22.966775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a88b3-e589-4fce-bf0a-a4d14e9086e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:22.967630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a88b3-e589-4fce-bf0a-a4d14e9086e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:22.967821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a88b3-e589-4fce-bf0a-a4d14e9086e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:22.968058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a88b3-e589-4fce-bf0a-a4d14e9086e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:22.968731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a88b3-e589-4fce-bf0a-a4d14e9086e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:25:22.974084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a88b3-e589-4fce-bf0a-a4d14e9086e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:22.975800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a88b3-e589-4fce-bf0a-a4d14e9086e7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:23.051406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33b774-54e0-4763-bd4d-4f9a79cb9627 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:23.053063 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1676/3371] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:25:23.061481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33b774-54e0-4763-bd4d-4f9a79cb9627 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:23.075203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b5891-55d7-4208-8450-643f8561f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:23.076892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b5891-55d7-4208-8450-643f8561f24d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:23.077911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b5891-55d7-4208-8450-643f8561f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:23.079476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b5891-55d7-4208-8450-643f8561f24d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:23.081838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b5891-55d7-4208-8450-643f8561f24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:23.084052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b5891-55d7-4208-8450-643f8561f24d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:23.169921 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1696/3372] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:25:23 2022] POST /identity/v3/projects => generated 359 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:25:23.171122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a88b3-e589-4fce-bf0a-a4d14e9086e7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:23.192664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a88b3-e589-4fce-bf0a-a4d14e9086e7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:23.484793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82559b-7c1d-4971-996c-a268ddefa143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:23.485448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82559b-7c1d-4971-996c-a268ddefa143 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:23.485723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82559b-7c1d-4971-996c-a268ddefa143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:23.486085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82559b-7c1d-4971-996c-a268ddefa143 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:23.486738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82559b-7c1d-4971-996c-a268ddefa143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:23.488829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf82559b-7c1d-4971-996c-a268ddefa143 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:23.542374 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1677/3373] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:25:23 2022] POST /identity/v3/users => generated 280 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:25:23.546620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b5891-55d7-4208-8450-643f8561f24d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:23.574698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b5891-55d7-4208-8450-643f8561f24d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:23.592700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd35cc-4e6e-4e43-a2e3-e02568e0a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:23.597112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd35cc-4e6e-4e43-a2e3-e02568e0a2cb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:23.598427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd35cc-4e6e-4e43-a2e3-e02568e0a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:23.599664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd35cc-4e6e-4e43-a2e3-e02568e0a2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:23.624062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd35cc-4e6e-4e43-a2e3-e02568e0a2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:23.626261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd35cc-4e6e-4e43-a2e3-e02568e0a2cb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:23.678835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82559b-7c1d-4971-996c-a268ddefa143 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:23.679750 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1697/3374] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:25:23.698039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82559b-7c1d-4971-996c-a268ddefa143 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:23.738791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32f8c3-49a9-46cf-8ca4-47446fcddf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:23.739754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32f8c3-49a9-46cf-8ca4-47446fcddf7f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:23.740182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32f8c3-49a9-46cf-8ca4-47446fcddf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:23.740598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32f8c3-49a9-46cf-8ca4-47446fcddf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:23.741430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32f8c3-49a9-46cf-8ca4-47446fcddf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:23.749433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32f8c3-49a9-46cf-8ca4-47446fcddf7f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:23.803146 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1678/3375] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:25:23.804621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd35cc-4e6e-4e43-a2e3-e02568e0a2cb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:23.825233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd35cc-4e6e-4e43-a2e3-e02568e0a2cb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:23.855822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d369-4818-4d70-97c5-3eef2f22d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:23.857565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d369-4818-4d70-97c5-3eef2f22d28b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:23.858105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d369-4818-4d70-97c5-3eef2f22d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:23.858846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3d369-4818-4d70-97c5-3eef2f22d28b admin admin] PATH_INFO: `/v3/projects/b4f7e7cea4974bc2ab8d7006d61e060e/users/d969d351b3cd441880005a6409b605a1/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:23.865729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:23.902335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3d369-4818-4d70-97c5-3eef2f22d28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f7e7cea4974bc2ab8d7006d61e060e, user_id=d969d351b3cd441880005a6409b605a1, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:23.906195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3d369-4818-4d70-97c5-3eef2f22d28b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:23.973935 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1698/3376] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:25:23 2022] PUT /identity/v3/projects/b4f7e7cea4974bc2ab8d7006d61e060e/users/d969d351b3cd441880005a6409b605a1/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:23.984616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc89ad-3f62-4315-b2ed-a01aed54ff82 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:23.984713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc89ad-3f62-4315-b2ed-a01aed54ff82 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:23.984997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc89ad-3f62-4315-b2ed-a01aed54ff82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:24.046999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d9fc89ad-3f62-4315-b2ed-a01aed54ff82 None None] MFA Rules not processed for user `d969d351b3cd441880005a6409b605a1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:24.048280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d9fc89ad-3f62-4315-b2ed-a01aed54ff82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:24.220424 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1679/3377] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:24.986339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d369-4818-4d70-97c5-3eef2f22d28b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:24.988966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-89e3d369-4818-4d70-97c5-3eef2f22d28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:25.115545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3d369-4818-4d70-97c5-3eef2f22d28b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:25.126795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d769602-52ee-4f18-81a1-098fe0b0016d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:25.127977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d769602-52ee-4f18-81a1-098fe0b0016d service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:25.128460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d769602-52ee-4f18-81a1-098fe0b0016d service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:25.128910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d769602-52ee-4f18-81a1-098fe0b0016d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:25.143591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d769602-52ee-4f18-81a1-098fe0b0016d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:25.148048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d769602-52ee-4f18-81a1-098fe0b0016d service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:25.167021 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1699/3378] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:24 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:25.281229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc89ad-3f62-4315-b2ed-a01aed54ff82 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:25.487805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc89ad-3f62-4315-b2ed-a01aed54ff82 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:25.503727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:25.504399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:25.504675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:25.504946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] PATH_INFO: `/v3/users/d969d351b3cd441880005a6409b605a1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:25.506653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d969d351b3cd441880005a6409b605a1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:25.508754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:25.511437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:25.644822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd969d351b3cd441880005a6409b605a1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:25.691402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd969d351b3cd441880005a6409b605a1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:25.726672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd969d351b3cd441880005a6409b605a1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:25.743575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd969d351b3cd441880005a6409b605a1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:25.744229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd969d351b3cd441880005a6409b605a1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:25.755630 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1680/3379] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:25:25 2022] DELETE /identity/v3/users/d969d351b3cd441880005a6409b605a1 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:25.760064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b4c7-7250-4886-995b-a31f1e7fbf47 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:25.760838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b4c7-7250-4886-995b-a31f1e7fbf47 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:25.761117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13b4c7-7250-4886-995b-a31f1e7fbf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:25.802039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6e13b4c7-7250-4886-995b-a31f1e7fbf47 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:25.806320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6e13b4c7-7250-4886-995b-a31f1e7fbf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:26.035680 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1700/3380] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:26.116329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:26.118254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:26.314791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fead8-d493-48a2-b4cf-382c1b220c2c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:26.335487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6705-aa8d-4305-86fa-5d5c19031ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:26.338180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6705-aa8d-4305-86fa-5d5c19031ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:26.338805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6705-aa8d-4305-86fa-5d5c19031ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:26.339289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6705-aa8d-4305-86fa-5d5c19031ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:26.357738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c6705-aa8d-4305-86fa-5d5c19031ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:26.365182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c6705-aa8d-4305-86fa-5d5c19031ae0 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:26.380325 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1681/3381] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:27.061455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13b4c7-7250-4886-995b-a31f1e7fbf47 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:27.063728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6e13b4c7-7250-4886-995b-a31f1e7fbf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:27.261843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13b4c7-7250-4886-995b-a31f1e7fbf47 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:27.272855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51b193-1ab2-4e1b-b650-8c42ac9085a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:27.273509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b193-1ab2-4e1b-b650-8c42ac9085a8 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:27.273789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b193-1ab2-4e1b-b650-8c42ac9085a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:27.274085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51b193-1ab2-4e1b-b650-8c42ac9085a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:27.280160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9e51b193-1ab2-4e1b-b650-8c42ac9085a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:27.330887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:27.386249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6705-aa8d-4305-86fa-5d5c19031ae0 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:27.387985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ae6c6705-aa8d-4305-86fa-5d5c19031ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:27.436830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6705-aa8d-4305-86fa-5d5c19031ae0 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:27.440155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b193-1ab2-4e1b-b650-8c42ac9085a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:27.442077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51b193-1ab2-4e1b-b650-8c42ac9085a8 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:27.458674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:27.461815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:27.463708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:27.464189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] PATH_INFO: `/v3/projects/b4f7e7cea4974bc2ab8d7006d61e060e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:27.470515 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1701/3382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:27 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:27.497938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f7e7cea4974bc2ab8d7006d61e060e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:27.500457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:27.663177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f7e7cea4974bc2ab8d7006d61e060e', 'request_id': 'req-5b695f6e-8f05-4311-90fd-c27ba5a063d0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:27.678470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f7e7cea4974bc2ab8d7006d61e060e', 'request_id': 'req-5b695f6e-8f05-4311-90fd-c27ba5a063d0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:27.691446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f7e7cea4974bc2ab8d7006d61e060e', 'request_id': 'req-5b695f6e-8f05-4311-90fd-c27ba5a063d0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:27.711643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] The token cache is being invalidate because project b4f7e7cea4974bc2ab8d7006d61e060e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:25:27.711937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:27.712749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b695f6e-8f05-4311-90fd-c27ba5a063d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:27.720160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00314fe6-1a5f-475d-80ed-95e1b0607c9f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:27.720557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00314fe6-1a5f-475d-80ed-95e1b0607c9f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:27.721090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00314fe6-1a5f-475d-80ed-95e1b0607c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:27.728608 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1682/3383] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:27 2022] DELETE /identity/v3/projects/b4f7e7cea4974bc2ab8d7006d61e060e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:27.759697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-00314fe6-1a5f-475d-80ed-95e1b0607c9f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:27.761361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-00314fe6-1a5f-475d-80ed-95e1b0607c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:27.954089 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1702/3384] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:27.957439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69d42-4882-4ddc-9d1d-b4be0f5d1012 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:27.959204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69d42-4882-4ddc-9d1d-b4be0f5d1012 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:27.959669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a69d42-4882-4ddc-9d1d-b4be0f5d1012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:27.975368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:28.001644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-22a69d42-4882-4ddc-9d1d-b4be0f5d1012 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:28.003097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-22a69d42-4882-4ddc-9d1d-b4be0f5d1012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:28.046332 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1683/3385] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:28.047393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00314fe6-1a5f-475d-80ed-95e1b0607c9f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:28.060729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00314fe6-1a5f-475d-80ed-95e1b0607c9f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:28.074344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f05cc3-22db-4845-9726-d0dc4a449b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:28.075297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f05cc3-22db-4845-9726-d0dc4a449b03 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:28.075736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f05cc3-22db-4845-9726-d0dc4a449b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:28.076175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f05cc3-22db-4845-9726-d0dc4a449b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:28.077211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f05cc3-22db-4845-9726-d0dc4a449b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:25:28.077691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f05cc3-22db-4845-9726-d0dc4a449b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:28.080628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f05cc3-22db-4845-9726-d0dc4a449b03 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:28.122657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69d42-4882-4ddc-9d1d-b4be0f5d1012 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:28.131220 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1703/3386] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:25:28.138634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a69d42-4882-4ddc-9d1d-b4be0f5d1012 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:28.152466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed00e1-a8e5-4b0b-8e9a-f04bbe87ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:28.153185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed00e1-a8e5-4b0b-8e9a-f04bbe87ce22 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:28.153703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed00e1-a8e5-4b0b-8e9a-f04bbe87ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:28.153939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed00e1-a8e5-4b0b-8e9a-f04bbe87ce22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:28.155939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed00e1-a8e5-4b0b-8e9a-f04bbe87ce22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:28.158683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed00e1-a8e5-4b0b-8e9a-f04bbe87ce22 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:28.204678 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1684/3387] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:25:28 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:25:28.208946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f05cc3-22db-4845-9726-d0dc4a449b03 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:28.225638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f05cc3-22db-4845-9726-d0dc4a449b03 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:28.371829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7c59b-c9b7-47cc-82ca-68a68b5df9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:28.372920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7c59b-c9b7-47cc-82ca-68a68b5df9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:28.373101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7c59b-c9b7-47cc-82ca-68a68b5df9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:28.373344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7c59b-c9b7-47cc-82ca-68a68b5df9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:28.374037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7c59b-c9b7-47cc-82ca-68a68b5df9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:28.376012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7c59b-c9b7-47cc-82ca-68a68b5df9a9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:28.425008 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1704/3388] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:25:28 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:25:28.427676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed00e1-a8e5-4b0b-8e9a-f04bbe87ce22 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:28.459101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed00e1-a8e5-4b0b-8e9a-f04bbe87ce22 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:28.466374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1c2c9-3d6d-4011-91ce-044039dd061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:28.468847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1c2c9-3d6d-4011-91ce-044039dd061b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:28.471757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1c2c9-3d6d-4011-91ce-044039dd061b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:28.472273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1c2c9-3d6d-4011-91ce-044039dd061b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:28.473223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1c2c9-3d6d-4011-91ce-044039dd061b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:28.480988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1c2c9-3d6d-4011-91ce-044039dd061b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:28.524265 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1685/3389] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:25:28.530017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7c59b-c9b7-47cc-82ca-68a68b5df9a9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:28.544753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7c59b-c9b7-47cc-82ca-68a68b5df9a9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:28.550146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237f63f-f48c-4cf5-82a4-9f51ca3bb50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:28.551063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237f63f-f48c-4cf5-82a4-9f51ca3bb50e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:28.551349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237f63f-f48c-4cf5-82a4-9f51ca3bb50e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:28.551623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237f63f-f48c-4cf5-82a4-9f51ca3bb50e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:28.552287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237f63f-f48c-4cf5-82a4-9f51ca3bb50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:28.553976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237f63f-f48c-4cf5-82a4-9f51ca3bb50e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:28.574689 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1705/3390] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:25:28.578963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1c2c9-3d6d-4011-91ce-044039dd061b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:28.603849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1c2c9-3d6d-4011-91ce-044039dd061b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:28.614357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29672de-5346-4fcd-86d9-5bc86d23e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:28.615059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29672de-5346-4fcd-86d9-5bc86d23e282 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:28.615334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29672de-5346-4fcd-86d9-5bc86d23e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:28.615610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29672de-5346-4fcd-86d9-5bc86d23e282 admin admin] PATH_INFO: `/v3/projects/4e408ce7d4134b9795d94877df77cf80/users/358a4edea635469d9a9f64e941b6ed53/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:28.670719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29672de-5346-4fcd-86d9-5bc86d23e282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e408ce7d4134b9795d94877df77cf80, user_id=358a4edea635469d9a9f64e941b6ed53, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:28.673474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29672de-5346-4fcd-86d9-5bc86d23e282 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:28.704703 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1686/3391] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:25:28 2022] PUT /identity/v3/projects/4e408ce7d4134b9795d94877df77cf80/users/358a4edea635469d9a9f64e941b6ed53/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:28.716121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb8ed-f1f4-4770-937e-f039a1e99bf2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:28.716417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb8ed-f1f4-4770-937e-f039a1e99bf2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:28.716692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb8ed-f1f4-4770-937e-f039a1e99bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:28.738673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2fcdb8ed-f1f4-4770-937e-f039a1e99bf2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:28.741974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2fcdb8ed-f1f4-4770-937e-f039a1e99bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:28.779881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:28.838436 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1706/3392] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:28.842003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29672de-5346-4fcd-86d9-5bc86d23e282 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:28.847571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e29672de-5346-4fcd-86d9-5bc86d23e282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:29.015292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29672de-5346-4fcd-86d9-5bc86d23e282 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:29.027338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fe960-60ca-41c3-a827-9059bd8092a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:29.028010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe960-60ca-41c3-a827-9059bd8092a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:29.028288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe960-60ca-41c3-a827-9059bd8092a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:29.028558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fe960-60ca-41c3-a827-9059bd8092a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:29.071439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fe960-60ca-41c3-a827-9059bd8092a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:29.072943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fe960-60ca-41c3-a827-9059bd8092a4 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:29.105280 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1687/3393] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:34.763391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5b8c0-57df-4244-967c-c483c4b19f2b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:34.763391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5b8c0-57df-4244-967c-c483c4b19f2b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:34.763391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5b8c0-57df-4244-967c-c483c4b19f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:34.845052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e4e5b8c0-57df-4244-967c-c483c4b19f2b None None] MFA Rules not processed for user `31b870521ea34e31a5c1bdce0829162d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:34.847169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e4e5b8c0-57df-4244-967c-c483c4b19f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:34.985418 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1707/3394] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:34.997796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fbc19-9926-494f-a013-8abc8699bd76 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:34.998647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fbc19-9926-494f-a013-8abc8699bd76 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:34.999095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fbc19-9926-494f-a013-8abc8699bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:35.069918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e97fbc19-9926-494f-a013-8abc8699bd76 None None] MFA Rules not processed for user `31b870521ea34e31a5c1bdce0829162d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:35.072805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e97fbc19-9926-494f-a013-8abc8699bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:35.090109 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1688/3395] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:35.879648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5b8c0-57df-4244-967c-c483c4b19f2b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:35.881355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e4e5b8c0-57df-4244-967c-c483c4b19f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:36.022469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5b8c0-57df-4244-967c-c483c4b19f2b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:36.030339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb0e78-8b96-47a6-b7bd-b29f392e8676 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:36.031512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb0e78-8b96-47a6-b7bd-b29f392e8676 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:36.031991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb0e78-8b96-47a6-b7bd-b29f392e8676 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:36.032590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb0e78-8b96-47a6-b7bd-b29f392e8676 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:36.043196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb0e78-8b96-47a6-b7bd-b29f392e8676 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:36.045414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb0e78-8b96-47a6-b7bd-b29f392e8676 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:36.059574 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1708/3396] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:37.233572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fbc19-9926-494f-a013-8abc8699bd76 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:37.235121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e97fbc19-9926-494f-a013-8abc8699bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:37.262706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fbc19-9926-494f-a013-8abc8699bd76 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:37.274110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765c43d-cb0b-4198-8870-1e2b4f199413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:37.275212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765c43d-cb0b-4198-8870-1e2b4f199413 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:37.275739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765c43d-cb0b-4198-8870-1e2b4f199413 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:37.277226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765c43d-cb0b-4198-8870-1e2b4f199413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:37.279413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2765c43d-cb0b-4198-8870-1e2b4f199413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:37.294258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765c43d-cb0b-4198-8870-1e2b4f199413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:37.296270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765c43d-cb0b-4198-8870-1e2b4f199413 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:37.312494 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1689/3397] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:39.723157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb0e78-8b96-47a6-b7bd-b29f392e8676 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:39.752529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb0e78-8b96-47a6-b7bd-b29f392e8676 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:39.758580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b07ce-117d-45a7-833d-5d1e9dcd0b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:39.761612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b07ce-117d-45a7-833d-5d1e9dcd0b40 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:39.762157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b07ce-117d-45a7-833d-5d1e9dcd0b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:39.762582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b07ce-117d-45a7-833d-5d1e9dcd0b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:39.765611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-635b07ce-117d-45a7-833d-5d1e9dcd0b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:39.791837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b07ce-117d-45a7-833d-5d1e9dcd0b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:39.793339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b07ce-117d-45a7-833d-5d1e9dcd0b40 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:39.816601 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1709/3398] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:45.586568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575092cf-1fd1-4ce4-bd1d-a6607b9b60a1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:45.587071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575092cf-1fd1-4ce4-bd1d-a6607b9b60a1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:45.587650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575092cf-1fd1-4ce4-bd1d-a6607b9b60a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:45.656782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-575092cf-1fd1-4ce4-bd1d-a6607b9b60a1 None None] MFA Rules not processed for user `358a4edea635469d9a9f64e941b6ed53`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:45.670419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-575092cf-1fd1-4ce4-bd1d-a6607b9b60a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:45.817797 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1690/3399] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:45.829780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8697-747f-417e-b52b-25c13e85cccf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:45.831385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8697-747f-417e-b52b-25c13e85cccf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:45.831734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c8697-747f-417e-b52b-25c13e85cccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:45.860300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a39c8697-747f-417e-b52b-25c13e85cccf None None] MFA Rules not processed for user `358a4edea635469d9a9f64e941b6ed53`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:45.867596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a39c8697-747f-417e-b52b-25c13e85cccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:45.887506 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1710/3400] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:47.602792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575092cf-1fd1-4ce4-bd1d-a6607b9b60a1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:47.619078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575092cf-1fd1-4ce4-bd1d-a6607b9b60a1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:47.625551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94053ab3-2759-45d6-a8a7-346c496348b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:47.626706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94053ab3-2759-45d6-a8a7-346c496348b8 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:47.627485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94053ab3-2759-45d6-a8a7-346c496348b8 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:47.627939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94053ab3-2759-45d6-a8a7-346c496348b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:47.640179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94053ab3-2759-45d6-a8a7-346c496348b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:47.642240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94053ab3-2759-45d6-a8a7-346c496348b8 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:47.650949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:47.657667 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1691/3401] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:48.036278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b42e-aafa-4122-b5d5-2ffe9204c329 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:48.036822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b42e-aafa-4122-b5d5-2ffe9204c329 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:48.036822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b42e-aafa-4122-b5d5-2ffe9204c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:48.097008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2427b42e-aafa-4122-b5d5-2ffe9204c329 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:48.103453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2427b42e-aafa-4122-b5d5-2ffe9204c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:48.160637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:48.251322 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1711/3402] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:25:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:25:48.264978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94053ab3-2759-45d6-a8a7-346c496348b8 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:48.266501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-94053ab3-2759-45d6-a8a7-346c496348b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:48.407852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94053ab3-2759-45d6-a8a7-346c496348b8 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:48.416394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31830-5fa8-4fc4-ada1-56fe4ee853c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:48.417493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31830-5fa8-4fc4-ada1-56fe4ee853c8 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:48.417867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31830-5fa8-4fc4-ada1-56fe4ee853c8 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:48.418249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31830-5fa8-4fc4-ada1-56fe4ee853c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:48.430111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b31830-5fa8-4fc4-ada1-56fe4ee853c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:48.432676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b31830-5fa8-4fc4-ada1-56fe4ee853c8 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:48.455923 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1692/3403] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:25:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:55.495140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427b42e-aafa-4122-b5d5-2ffe9204c329 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:55.516005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427b42e-aafa-4122-b5d5-2ffe9204c329 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:55.529574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b68e8f-d077-4799-aacb-e3e59e9d21eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:55.530700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b68e8f-d077-4799-aacb-e3e59e9d21eb service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:55.531342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b68e8f-d077-4799-aacb-e3e59e9d21eb service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:55.531859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b68e8f-d077-4799-aacb-e3e59e9d21eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:55.537526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-98b68e8f-d077-4799-aacb-e3e59e9d21eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:55.553915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b68e8f-d077-4799-aacb-e3e59e9d21eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:55.555805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b68e8f-d077-4799-aacb-e3e59e9d21eb service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:55.571411 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1712/3404] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:25:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:25:56.997616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31830-5fa8-4fc4-ada1-56fe4ee853c8 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:56.999237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-28b31830-5fa8-4fc4-ada1-56fe4ee853c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:57.033238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31830-5fa8-4fc4-ada1-56fe4ee853c8 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:57.068400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:57.069072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:57.069368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:57.069640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] PATH_INFO: `/v3/users/e37ffb070d2443f7b8bcf1ed61041a6d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:57.083069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37ffb070d2443f7b8bcf1ed61041a6d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:57.085102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:57.285986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37ffb070d2443f7b8bcf1ed61041a6d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:57.312460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37ffb070d2443f7b8bcf1ed61041a6d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:57.344703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37ffb070d2443f7b8bcf1ed61041a6d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:57.363972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37ffb070d2443f7b8bcf1ed61041a6d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:57.364793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37ffb070d2443f7b8bcf1ed61041a6d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:57.382291 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1693/3405] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:25:56 2022] DELETE /identity/v3/users/e37ffb070d2443f7b8bcf1ed61041a6d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:58.257384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b68e8f-d077-4799-aacb-e3e59e9d21eb service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:58.271438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b68e8f-d077-4799-aacb-e3e59e9d21eb service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:58.415116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:58.416424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:58.416847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:58.417303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] PATH_INFO: `/v3/projects/c61056a3bd6e462e96a5c27a887d710f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:58.418790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c61056a3bd6e462e96a5c27a887d710f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:58.423037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:58.512080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c61056a3bd6e462e96a5c27a887d710f', 'request_id': 'req-f20bb684-d489-4b10-8a72-dc2d467e5b7a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:58.523090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c61056a3bd6e462e96a5c27a887d710f', 'request_id': 'req-f20bb684-d489-4b10-8a72-dc2d467e5b7a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:58.538001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c61056a3bd6e462e96a5c27a887d710f', 'request_id': 'req-f20bb684-d489-4b10-8a72-dc2d467e5b7a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:58.556295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] The token cache is being invalidate because project c61056a3bd6e462e96a5c27a887d710f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:25:58.556606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:58.557360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:58.559639 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1713/3406] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:58 2022] DELETE /identity/v3/projects/c61056a3bd6e462e96a5c27a887d710f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:58.564577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:58.566778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:58.596797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049df65-16d1-4041-aa9f-aa947a88e134 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:58.759959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:58.760894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:58.761218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:58.761486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] PATH_INFO: `/v3/users/bba9704be908476fb5c2a81bae27f234` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:58.762763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba9704be908476fb5c2a81bae27f234)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:58.765097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:58.772131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:58.903770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba9704be908476fb5c2a81bae27f234'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:58.929204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba9704be908476fb5c2a81bae27f234'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:58.974963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba9704be908476fb5c2a81bae27f234'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:58.996843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba9704be908476fb5c2a81bae27f234'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:58.998175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb35781c-a6f9-4013-b407-88586b30694f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba9704be908476fb5c2a81bae27f234'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:59.011056 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1694/3407] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:25:58 2022] DELETE /identity/v3/users/bba9704be908476fb5c2a81bae27f234 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:59.436968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:25:59.440655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:25:59.467951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bb684-d489-4b10-8a72-dc2d467e5b7a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:25:59.616740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:59.650411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:25:59.651352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:59.651786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:59.652233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] PATH_INFO: `/v3/projects/487fccb69f7842969e601bdfa5f6288d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:59.654571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=487fccb69f7842969e601bdfa5f6288d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:25:59.656696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:25:59.771313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487fccb69f7842969e601bdfa5f6288d', 'request_id': 'req-05634c57-8e51-417f-ac40-2023db8c6dfa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:59.802916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487fccb69f7842969e601bdfa5f6288d', 'request_id': 'req-05634c57-8e51-417f-ac40-2023db8c6dfa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:59.825140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487fccb69f7842969e601bdfa5f6288d', 'request_id': 'req-05634c57-8e51-417f-ac40-2023db8c6dfa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:59.854250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] The token cache is being invalidate because project 487fccb69f7842969e601bdfa5f6288d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:25:59.855094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:59.858244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-05634c57-8e51-417f-ac40-2023db8c6dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:25:59.863749 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1714/3408] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:59 2022] DELETE /identity/v3/projects/487fccb69f7842969e601bdfa5f6288d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:25:59.869016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d05732-9bed-4d0c-b751-8740cac70f10 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:25:59.869534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d05732-9bed-4d0c-b751-8740cac70f10 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:25:59.869666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d05732-9bed-4d0c-b751-8740cac70f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:25:59.945185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c5d05732-9bed-4d0c-b751-8740cac70f10 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:25:59.946415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c5d05732-9bed-4d0c-b751-8740cac70f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:00.220417 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1695/3409] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:00.229244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2419603-3e85-49d0-8a8c-3809ad342c89 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:00.229793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2419603-3e85-49d0-8a8c-3809ad342c89 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:00.230357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2419603-3e85-49d0-8a8c-3809ad342c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:00.262054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e2419603-3e85-49d0-8a8c-3809ad342c89 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:00.263912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e2419603-3e85-49d0-8a8c-3809ad342c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:00.275987 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1715/3410] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:26:00.279939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d05732-9bed-4d0c-b751-8740cac70f10 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:00.296304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d05732-9bed-4d0c-b751-8740cac70f10 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:00.304661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bec79-4fac-4ab9-a8e6-a3a9ee999265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:00.306254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bec79-4fac-4ab9-a8e6-a3a9ee999265 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:00.307029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bec79-4fac-4ab9-a8e6-a3a9ee999265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:00.307579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bec79-4fac-4ab9-a8e6-a3a9ee999265 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:00.308740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bec79-4fac-4ab9-a8e6-a3a9ee999265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:26:00.309596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bec79-4fac-4ab9-a8e6-a3a9ee999265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:00.311876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bec79-4fac-4ab9-a8e6-a3a9ee999265 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:00.356526 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1696/3411] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:26:00.375348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2419603-3e85-49d0-8a8c-3809ad342c89 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:00.387478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2419603-3e85-49d0-8a8c-3809ad342c89 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:00.400465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f09608-5185-4dac-a062-3644439a90a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:00.401671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f09608-5185-4dac-a062-3644439a90a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:00.402249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f09608-5185-4dac-a062-3644439a90a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:00.403110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f09608-5185-4dac-a062-3644439a90a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:00.404540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f09608-5185-4dac-a062-3644439a90a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:00.408285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f09608-5185-4dac-a062-3644439a90a9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:00.472101 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1716/3412] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:00 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:00.477823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bec79-4fac-4ab9-a8e6-a3a9ee999265 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:00.495140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bec79-4fac-4ab9-a8e6-a3a9ee999265 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:00.616466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6435b2-72c8-469f-8363-ca24e29d5421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:00.617705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6435b2-72c8-469f-8363-ca24e29d5421 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:00.618324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6435b2-72c8-469f-8363-ca24e29d5421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:00.618807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6435b2-72c8-469f-8363-ca24e29d5421 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:00.620281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6435b2-72c8-469f-8363-ca24e29d5421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:00.622584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6435b2-72c8-469f-8363-ca24e29d5421 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:00.665208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:00.681072 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1697/3413] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:00 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:00.683197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f09608-5185-4dac-a062-3644439a90a9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:00.696457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f09608-5185-4dac-a062-3644439a90a9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:00.702465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008e20-8f23-4cbf-a210-c068aed1f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:00.703240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008e20-8f23-4cbf-a210-c068aed1f2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:00.703631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008e20-8f23-4cbf-a210-c068aed1f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:00.704027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d008e20-8f23-4cbf-a210-c068aed1f2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:00.708366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d008e20-8f23-4cbf-a210-c068aed1f2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:00.711279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d008e20-8f23-4cbf-a210-c068aed1f2b5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:00.729243 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1717/3414] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:00.730805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6435b2-72c8-469f-8363-ca24e29d5421 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:00.747759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6435b2-72c8-469f-8363-ca24e29d5421 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:00.757142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ace56b-9634-4ec8-bd8b-4fc1a33eec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:00.759896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace56b-9634-4ec8-bd8b-4fc1a33eec40 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:00.760941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace56b-9634-4ec8-bd8b-4fc1a33eec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:00.761744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ace56b-9634-4ec8-bd8b-4fc1a33eec40 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:00.762947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ace56b-9634-4ec8-bd8b-4fc1a33eec40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:00.765789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ace56b-9634-4ec8-bd8b-4fc1a33eec40 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:00.786478 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1698/3415] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:00.790671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008e20-8f23-4cbf-a210-c068aed1f2b5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:00.806849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d008e20-8f23-4cbf-a210-c068aed1f2b5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:00.818152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24904150-97ca-4ead-822f-1a9f729ac795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:00.821235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24904150-97ca-4ead-822f-1a9f729ac795 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:00.822828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24904150-97ca-4ead-822f-1a9f729ac795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:00.823550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24904150-97ca-4ead-822f-1a9f729ac795 admin admin] PATH_INFO: `/v3/projects/8502e5f236ae42509da19923f035a2d7/users/e68398e5fc8c472a95ecef61d8e4071f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:00.846943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24904150-97ca-4ead-822f-1a9f729ac795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8502e5f236ae42509da19923f035a2d7, user_id=e68398e5fc8c472a95ecef61d8e4071f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:00.850989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24904150-97ca-4ead-822f-1a9f729ac795 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:00.874677 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1718/3416] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:00 2022] PUT /identity/v3/projects/8502e5f236ae42509da19923f035a2d7/users/e68398e5fc8c472a95ecef61d8e4071f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:00.886083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336ebc5-14f4-4dbb-8fd9-76e82360d9ed None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:00.887154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336ebc5-14f4-4dbb-8fd9-76e82360d9ed None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:00.887639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336ebc5-14f4-4dbb-8fd9-76e82360d9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:00.929683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f336ebc5-14f4-4dbb-8fd9-76e82360d9ed None None] MFA Rules not processed for user `e68398e5fc8c472a95ecef61d8e4071f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:00.932411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f336ebc5-14f4-4dbb-8fd9-76e82360d9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:01.057430 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1699/3417] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:01.060180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24904150-97ca-4ead-822f-1a9f729ac795 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:01.271514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24904150-97ca-4ead-822f-1a9f729ac795 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:01.287905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316af8be-98d4-4ea1-af6d-eeadad3fc382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:01.290130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316af8be-98d4-4ea1-af6d-eeadad3fc382 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:01.290570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316af8be-98d4-4ea1-af6d-eeadad3fc382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:01.290992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316af8be-98d4-4ea1-af6d-eeadad3fc382 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:01.291802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316af8be-98d4-4ea1-af6d-eeadad3fc382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:01.297483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316af8be-98d4-4ea1-af6d-eeadad3fc382 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:01.352339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:01.369076 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1719/3418] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:01 2022] POST /identity/v3/projects => generated 395 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:01.369442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336ebc5-14f4-4dbb-8fd9-76e82360d9ed None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:01.397485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336ebc5-14f4-4dbb-8fd9-76e82360d9ed None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:01.700274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2bac4-fda4-4098-939d-f874c5882acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:01.702513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2bac4-fda4-4098-939d-f874c5882acd admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:01.705251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2bac4-fda4-4098-939d-f874c5882acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:01.705734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2bac4-fda4-4098-939d-f874c5882acd admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:01.706565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2bac4-fda4-4098-939d-f874c5882acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:01.712806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2bac4-fda4-4098-939d-f874c5882acd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:01.806208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316af8be-98d4-4ea1-af6d-eeadad3fc382 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:01.808511 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1700/3419] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:01 2022] POST /identity/v3/users => generated 304 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:01.827240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316af8be-98d4-4ea1-af6d-eeadad3fc382 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:01.849909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61ee0-383e-423f-a9e6-c3afccd7bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:01.850679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61ee0-383e-423f-a9e6-c3afccd7bc2d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:01.852015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61ee0-383e-423f-a9e6-c3afccd7bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:01.852369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e61ee0-383e-423f-a9e6-c3afccd7bc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:01.854115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e61ee0-383e-423f-a9e6-c3afccd7bc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:01.862072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e61ee0-383e-423f-a9e6-c3afccd7bc2d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:01.900207 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1720/3420] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:26:01.900913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2bac4-fda4-4098-939d-f874c5882acd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:01.911309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61ee0-383e-423f-a9e6-c3afccd7bc2d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:01.914643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2bac4-fda4-4098-939d-f874c5882acd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:01.916898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b8e61ee0-383e-423f-a9e6-c3afccd7bc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:01.930928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c34e-82ee-455d-b089-7740b527624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:01.931752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c34e-82ee-455d-b089-7740b527624e admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:01.932141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c34e-82ee-455d-b089-7740b527624e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:01.932493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2c34e-82ee-455d-b089-7740b527624e admin admin] PATH_INFO: `/v3/projects/66fd45d030f24a14a964b9c49961cb31/users/5f0efd4e27e547c382be453c8cdc82e0/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:01.957292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e61ee0-383e-423f-a9e6-c3afccd7bc2d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:01.969743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:01.970877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:01.971285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:01.971870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] PATH_INFO: `/v3/users/b2e132bba27b449b99cfdeff2feef522` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:01.974882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e132bba27b449b99cfdeff2feef522)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:01.977803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2c34e-82ee-455d-b089-7740b527624e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fd45d030f24a14a964b9c49961cb31, user_id=5f0efd4e27e547c382be453c8cdc82e0, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:01.980564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:01.984169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2c34e-82ee-455d-b089-7740b527624e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:02.018296 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1701/3421] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:01 2022] PUT /identity/v3/projects/66fd45d030f24a14a964b9c49961cb31/users/5f0efd4e27e547c382be453c8cdc82e0/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:02.023956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c34e-82ee-455d-b089-7740b527624e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:02.108819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e132bba27b449b99cfdeff2feef522'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:02.114381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e132bba27b449b99cfdeff2feef522'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:02.130014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e132bba27b449b99cfdeff2feef522'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:02.141422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:02.156517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e132bba27b449b99cfdeff2feef522'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:02.184885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2c34e-82ee-455d-b089-7740b527624e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:02.198151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d34d00f2-c40c-4ea3-823d-0cb54d312007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e132bba27b449b99cfdeff2feef522'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:02.207506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef09ca-6770-417a-aa73-901ae25cf483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:02.208248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef09ca-6770-417a-aa73-901ae25cf483 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:02.209044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef09ca-6770-417a-aa73-901ae25cf483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:02.209411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef09ca-6770-417a-aa73-901ae25cf483 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:02.210185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef09ca-6770-417a-aa73-901ae25cf483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:02.213576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef09ca-6770-417a-aa73-901ae25cf483 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:02.214968 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1721/3422] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:01 2022] DELETE /identity/v3/users/b2e132bba27b449b99cfdeff2feef522 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:26:02.219259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75560ac-b0c4-47a8-a92a-c11323a326db None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:02.220090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75560ac-b0c4-47a8-a92a-c11323a326db None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:02.220672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75560ac-b0c4-47a8-a92a-c11323a326db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:02.241165 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1702/3423] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:02.245426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef09ca-6770-417a-aa73-901ae25cf483 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:02.249848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fef09ca-6770-417a-aa73-901ae25cf483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:02.282500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef09ca-6770-417a-aa73-901ae25cf483 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:02.285032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d75560ac-b0c4-47a8-a92a-c11323a326db None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:02.286593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d75560ac-b0c4-47a8-a92a-c11323a326db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:02.432477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95a2f3-ba97-4840-ba3a-7fb277785d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:02.433426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95a2f3-ba97-4840-ba3a-7fb277785d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:02.433723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95a2f3-ba97-4840-ba3a-7fb277785d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:02.434085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95a2f3-ba97-4840-ba3a-7fb277785d5b admin admin] PATH_INFO: `/v3/projects/66fd45d030f24a14a964b9c49961cb31/users/5f0efd4e27e547c382be453c8cdc82e0/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:02.437679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95a2f3-ba97-4840-ba3a-7fb277785d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66fd45d030f24a14a964b9c49961cb31, user_id=5f0efd4e27e547c382be453c8cdc82e0, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:02.442647 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1722/3424] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:26:02.443949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95a2f3-ba97-4840-ba3a-7fb277785d5b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:02.454011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75560ac-b0c4-47a8-a92a-c11323a326db None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:02.456278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d75560ac-b0c4-47a8-a92a-c11323a326db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:02.478074 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1703/3425] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:02 2022] PUT /identity/v3/projects/66fd45d030f24a14a964b9c49961cb31/users/5f0efd4e27e547c382be453c8cdc82e0/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:02.479965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644d75-0977-4e77-a484-a04c2b34c03f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:02.480165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644d75-0977-4e77-a484-a04c2b34c03f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:02.480408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70644d75-0977-4e77-a484-a04c2b34c03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:02.549783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-70644d75-0977-4e77-a484-a04c2b34c03f None None] MFA Rules not processed for user `5f0efd4e27e547c382be453c8cdc82e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:02.551052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-70644d75-0977-4e77-a484-a04c2b34c03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:02.616462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75560ac-b0c4-47a8-a92a-c11323a326db None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:02.664360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:02.804571 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1704/3426] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:02 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:02.815816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270304d-cbd6-4d85-8f64-946397f74764 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:02.816120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270304d-cbd6-4d85-8f64-946397f74764 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:02.816367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270304d-cbd6-4d85-8f64-946397f74764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:02.829724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe60e2-5951-4437-9258-11f5057d283c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:02.835313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe60e2-5951-4437-9258-11f5057d283c service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:02.836881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe60e2-5951-4437-9258-11f5057d283c service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:02.837400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe60e2-5951-4437-9258-11f5057d283c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:02.854980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5270304d-cbd6-4d85-8f64-946397f74764 None None] MFA Rules not processed for user `e68398e5fc8c472a95ecef61d8e4071f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:02.856218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5270304d-cbd6-4d85-8f64-946397f74764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:03.029657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe60e2-5951-4437-9258-11f5057d283c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:03.031408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe60e2-5951-4437-9258-11f5057d283c service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:03.038446 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1705/3427] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:03.048065 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1723/3428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:26:03.585860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270304d-cbd6-4d85-8f64-946397f74764 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:03.588307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5270304d-cbd6-4d85-8f64-946397f74764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:03.593480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:03.732663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe60e2-5951-4437-9258-11f5057d283c service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:03.734458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cdfe60e2-5951-4437-9258-11f5057d283c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:03.754204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270304d-cbd6-4d85-8f64-946397f74764 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:03.763018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fccb80-f5cf-44c0-a459-74a36d43dc4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:03.763241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fccb80-f5cf-44c0-a459-74a36d43dc4b service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:03.763584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fccb80-f5cf-44c0-a459-74a36d43dc4b service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:03.763858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fccb80-f5cf-44c0-a459-74a36d43dc4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:03.766207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-95fccb80-f5cf-44c0-a459-74a36d43dc4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:03.781900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe60e2-5951-4437-9258-11f5057d283c service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:03.791923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fccb80-f5cf-44c0-a459-74a36d43dc4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:03.794328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fccb80-f5cf-44c0-a459-74a36d43dc4b service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:03.808470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:03.811199 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1706/3429] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:03.818755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:03.819816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:03.820099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] PATH_INFO: `/v3/projects/4064fb2403ed4acd8d7cbe41691935d5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:03.825598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4064fb2403ed4acd8d7cbe41691935d5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:03.831810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:03.978602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4064fb2403ed4acd8d7cbe41691935d5', 'request_id': 'req-61868058-25bd-4f39-a655-f19affa92db8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:03.988157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4064fb2403ed4acd8d7cbe41691935d5', 'request_id': 'req-61868058-25bd-4f39-a655-f19affa92db8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:04.003560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4064fb2403ed4acd8d7cbe41691935d5', 'request_id': 'req-61868058-25bd-4f39-a655-f19affa92db8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:04.025908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] The token cache is being invalidate because project 4064fb2403ed4acd8d7cbe41691935d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:04.026617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:04.027457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:04.034738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fccb80-f5cf-44c0-a459-74a36d43dc4b service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:04.058099 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1724/3430] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:03 2022] DELETE /identity/v3/projects/4064fb2403ed4acd8d7cbe41691935d5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:04.069527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fccb80-f5cf-44c0-a459-74a36d43dc4b service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:04.185241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:04.186656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:04.187235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:04.187654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] PATH_INFO: `/v3/users/e1deb6c9cc964f7a81cdcaa950b30574` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:04.189513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1deb6c9cc964f7a81cdcaa950b30574)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:04.191978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:04.270676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1deb6c9cc964f7a81cdcaa950b30574'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:04.287126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1deb6c9cc964f7a81cdcaa950b30574'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:04.308578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1deb6c9cc964f7a81cdcaa950b30574'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:04.323297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1deb6c9cc964f7a81cdcaa950b30574'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:04.324986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ce044c41-ceeb-4303-876f-b1dcf66ee113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1deb6c9cc964f7a81cdcaa950b30574'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:04.337241 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1707/3431] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:04 2022] DELETE /identity/v3/users/e1deb6c9cc964f7a81cdcaa950b30574 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:04.862186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:04.863671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:04.889981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61868058-25bd-4f39-a655-f19affa92db8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:05.058634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:05.093263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:05.098785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:05.099107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:05.099390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] PATH_INFO: `/v3/projects/ee0bf3cbfab14e38bede9e9ffb302684` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:05.102445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee0bf3cbfab14e38bede9e9ffb302684)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:05.108325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:05.235314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0bf3cbfab14e38bede9e9ffb302684', 'request_id': 'req-eda655e3-49e2-4d64-b000-e60ab1a90e3a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:05.258858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0bf3cbfab14e38bede9e9ffb302684', 'request_id': 'req-eda655e3-49e2-4d64-b000-e60ab1a90e3a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:05.283029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0bf3cbfab14e38bede9e9ffb302684', 'request_id': 'req-eda655e3-49e2-4d64-b000-e60ab1a90e3a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:05.303557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] The token cache is being invalidate because project ee0bf3cbfab14e38bede9e9ffb302684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:05.303826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:05.304758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eda655e3-49e2-4d64-b000-e60ab1a90e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:05.308827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1725/3432] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:04 2022] DELETE /identity/v3/projects/ee0bf3cbfab14e38bede9e9ffb302684 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:26:05.313087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fafe9-b8de-4c97-9e85-d5d648aa6592 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:05.314797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fafe9-b8de-4c97-9e85-d5d648aa6592 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:05.315594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fafe9-b8de-4c97-9e85-d5d648aa6592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:05.349160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:05.376407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7e7fafe9-b8de-4c97-9e85-d5d648aa6592 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:05.381129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7e7fafe9-b8de-4c97-9e85-d5d648aa6592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:05.538766 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1708/3433] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:26:05.546087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6dae7-82f2-4047-b139-6217db97f017 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:05.546304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6dae7-82f2-4047-b139-6217db97f017 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:05.546541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6dae7-82f2-4047-b139-6217db97f017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:05.579427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-98d6dae7-82f2-4047-b139-6217db97f017 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:05.585382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-98d6dae7-82f2-4047-b139-6217db97f017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:05.597063 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1726/3434] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:26:05.601179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fafe9-b8de-4c97-9e85-d5d648aa6592 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:05.652120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fafe9-b8de-4c97-9e85-d5d648aa6592 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:05.665855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fba0df-23f9-4f29-9880-99b75a05d3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:05.688703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fba0df-23f9-4f29-9880-99b75a05d3ce admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:05.688703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fba0df-23f9-4f29-9880-99b75a05d3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:05.688703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fba0df-23f9-4f29-9880-99b75a05d3ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:05.688703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fba0df-23f9-4f29-9880-99b75a05d3ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:26:05.688703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fba0df-23f9-4f29-9880-99b75a05d3ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:05.699014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fba0df-23f9-4f29-9880-99b75a05d3ce admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:05.734273 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1709/3435] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:26:05.737840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6dae7-82f2-4047-b139-6217db97f017 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:05.757512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6dae7-82f2-4047-b139-6217db97f017 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:05.776119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e912a-3fa2-4da1-90a0-2ad02b3c604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:05.777191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e912a-3fa2-4da1-90a0-2ad02b3c604e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:05.777472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e912a-3fa2-4da1-90a0-2ad02b3c604e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:05.777734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e912a-3fa2-4da1-90a0-2ad02b3c604e admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:05.778769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e912a-3fa2-4da1-90a0-2ad02b3c604e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:05.780795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e912a-3fa2-4da1-90a0-2ad02b3c604e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:05.874296 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1727/3436] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:05 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:05.887059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fba0df-23f9-4f29-9880-99b75a05d3ce admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:05.906274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fba0df-23f9-4f29-9880-99b75a05d3ce admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:05.975772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d1ac8-d543-46e8-bf36-eac0d620f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:05.976418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1ac8-d543-46e8-bf36-eac0d620f003 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:05.976691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1ac8-d543-46e8-bf36-eac0d620f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:05.977419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d1ac8-d543-46e8-bf36-eac0d620f003 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:05.982536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d1ac8-d543-46e8-bf36-eac0d620f003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:05.986470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d1ac8-d543-46e8-bf36-eac0d620f003 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:06.030977 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1710/3437] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:05 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:06.033516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e912a-3fa2-4da1-90a0-2ad02b3c604e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:06.058029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e912a-3fa2-4da1-90a0-2ad02b3c604e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:06.075725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310b6a-f256-4be1-8ce6-e142999bdfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:06.077796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310b6a-f256-4be1-8ce6-e142999bdfcc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:06.080340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310b6a-f256-4be1-8ce6-e142999bdfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:06.082835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61310b6a-f256-4be1-8ce6-e142999bdfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:06.085423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61310b6a-f256-4be1-8ce6-e142999bdfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:06.090000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61310b6a-f256-4be1-8ce6-e142999bdfcc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:06.140747 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1728/3438] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:06.144237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d1ac8-d543-46e8-bf36-eac0d620f003 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:06.163542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d1ac8-d543-46e8-bf36-eac0d620f003 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:06.173919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c66e5-2893-4fd2-97d6-1adba4a315cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:06.174768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c66e5-2893-4fd2-97d6-1adba4a315cb admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:06.175014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c66e5-2893-4fd2-97d6-1adba4a315cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:06.175282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c66e5-2893-4fd2-97d6-1adba4a315cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:06.176063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c66e5-2893-4fd2-97d6-1adba4a315cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:06.177883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c66e5-2893-4fd2-97d6-1adba4a315cb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:06.232102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310b6a-f256-4be1-8ce6-e142999bdfcc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:06.247353 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1711/3439] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:06.257026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61310b6a-f256-4be1-8ce6-e142999bdfcc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:06.271829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bd327-83ab-40c2-a0be-d33095690d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:06.272868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bd327-83ab-40c2-a0be-d33095690d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:06.273575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bd327-83ab-40c2-a0be-d33095690d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:06.274161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bd327-83ab-40c2-a0be-d33095690d43 admin admin] PATH_INFO: `/v3/projects/337dac45115541ff972750be568eb864/users/d7a12c873b724eb586098874f925791f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:06.309817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bd327-83ab-40c2-a0be-d33095690d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=337dac45115541ff972750be568eb864, user_id=d7a12c873b724eb586098874f925791f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:06.313674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bd327-83ab-40c2-a0be-d33095690d43 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:06.349793 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1729/3440] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:06 2022] PUT /identity/v3/projects/337dac45115541ff972750be568eb864/users/d7a12c873b724eb586098874f925791f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:26:06.361376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f810-ab36-4deb-a42c-59f6a42acbcc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:06.361982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f810-ab36-4deb-a42c-59f6a42acbcc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:06.361982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f810-ab36-4deb-a42c-59f6a42acbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:06.448330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5ae7f810-ab36-4deb-a42c-59f6a42acbcc None None] MFA Rules not processed for user `d7a12c873b724eb586098874f925791f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:06.449454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5ae7f810-ab36-4deb-a42c-59f6a42acbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:06.693403 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1712/3441] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:06.697543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bd327-83ab-40c2-a0be-d33095690d43 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:06.852721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bd327-83ab-40c2-a0be-d33095690d43 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:06.859710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd3683-deca-49ca-bc75-0df78dbe59f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:06.860696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd3683-deca-49ca-bc75-0df78dbe59f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:06.861272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd3683-deca-49ca-bc75-0df78dbe59f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:06.861864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd3683-deca-49ca-bc75-0df78dbe59f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:06.862734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd3683-deca-49ca-bc75-0df78dbe59f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:06.865189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd3683-deca-49ca-bc75-0df78dbe59f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:06.908282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:06.938889 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1730/3442] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:06 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:06.943651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7f810-ab36-4deb-a42c-59f6a42acbcc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:06.950288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:06.963683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7f810-ab36-4deb-a42c-59f6a42acbcc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:07.079762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb7243-d937-4bb5-878b-7bca2b2db994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:07.082029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb7243-d937-4bb5-878b-7bca2b2db994 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:07.083480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb7243-d937-4bb5-878b-7bca2b2db994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:07.084072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb7243-d937-4bb5-878b-7bca2b2db994 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:07.085744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb7243-d937-4bb5-878b-7bca2b2db994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:07.090189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb7243-d937-4bb5-878b-7bca2b2db994 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:07.148733 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1713/3443] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:06 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:07.149127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd3683-deca-49ca-bc75-0df78dbe59f2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:07.177588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd3683-deca-49ca-bc75-0df78dbe59f2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:07.201976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47416e0e-086f-426d-b346-3e7908f82502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:07.202853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416e0e-086f-426d-b346-3e7908f82502 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:07.203284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416e0e-086f-426d-b346-3e7908f82502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:07.203736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47416e0e-086f-426d-b346-3e7908f82502 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:07.204672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47416e0e-086f-426d-b346-3e7908f82502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:07.206634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47416e0e-086f-426d-b346-3e7908f82502 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:07.230142 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1731/3444] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:26:07.234474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb7243-d937-4bb5-878b-7bca2b2db994 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:07.256444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb7243-d937-4bb5-878b-7bca2b2db994 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:07.262338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790168d6-cb18-4948-8c42-79d17e8f60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:07.263213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790168d6-cb18-4948-8c42-79d17e8f60a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:07.263635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790168d6-cb18-4948-8c42-79d17e8f60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:07.264056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790168d6-cb18-4948-8c42-79d17e8f60a1 admin admin] PATH_INFO: `/v3/projects/2180f0060b55415a9b433cec7a266461/users/db80c9bf82bf4a08b451656bd046392c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:07.298456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790168d6-cb18-4948-8c42-79d17e8f60a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2180f0060b55415a9b433cec7a266461, user_id=db80c9bf82bf4a08b451656bd046392c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:07.301333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790168d6-cb18-4948-8c42-79d17e8f60a1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:07.326842 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1714/3445] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:07 2022] PUT /identity/v3/projects/2180f0060b55415a9b433cec7a266461/users/db80c9bf82bf4a08b451656bd046392c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:07.332683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47416e0e-086f-426d-b346-3e7908f82502 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:07.350491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47416e0e-086f-426d-b346-3e7908f82502 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:07.513301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a99db-ad6f-4610-8cba-84cc72a27aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:07.514925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a99db-ad6f-4610-8cba-84cc72a27aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:07.517794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a99db-ad6f-4610-8cba-84cc72a27aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:07.518518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a99db-ad6f-4610-8cba-84cc72a27aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:07.522582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a99db-ad6f-4610-8cba-84cc72a27aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:07.526388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a99db-ad6f-4610-8cba-84cc72a27aa7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:07.560254 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1732/3446] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:26:07.564909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790168d6-cb18-4948-8c42-79d17e8f60a1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:07.590922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790168d6-cb18-4948-8c42-79d17e8f60a1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:07.605315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51be441-a686-4cdb-b5e0-15c4a3264b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:07.606082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be441-a686-4cdb-b5e0-15c4a3264b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:07.606497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be441-a686-4cdb-b5e0-15c4a3264b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:07.618016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51be441-a686-4cdb-b5e0-15c4a3264b79 admin admin] PATH_INFO: `/v3/projects/2180f0060b55415a9b433cec7a266461/users/db80c9bf82bf4a08b451656bd046392c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:07.622019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51be441-a686-4cdb-b5e0-15c4a3264b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2180f0060b55415a9b433cec7a266461, user_id=db80c9bf82bf4a08b451656bd046392c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:07.628096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51be441-a686-4cdb-b5e0-15c4a3264b79 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:07.666912 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1715/3447] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:07 2022] PUT /identity/v3/projects/2180f0060b55415a9b433cec7a266461/users/db80c9bf82bf4a08b451656bd046392c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:07.686892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55e03b-85af-4d9e-a75f-17f3254d28a6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:07.687140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55e03b-85af-4d9e-a75f-17f3254d28a6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:07.687418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55e03b-85af-4d9e-a75f-17f3254d28a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:07.753906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-aa55e03b-85af-4d9e-a75f-17f3254d28a6 None None] MFA Rules not processed for user `db80c9bf82bf4a08b451656bd046392c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:07.755176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aa55e03b-85af-4d9e-a75f-17f3254d28a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:07.877703 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1733/3448] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:07.879844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ab874-2eb3-48d6-a0a4-8571d37f0521 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:07.879844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ab874-2eb3-48d6-a0a4-8571d37f0521 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:07.880076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ab874-2eb3-48d6-a0a4-8571d37f0521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:07.957523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4e3ab874-2eb3-48d6-a0a4-8571d37f0521 None None] MFA Rules not processed for user `d7a12c873b724eb586098874f925791f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:07.958845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4e3ab874-2eb3-48d6-a0a4-8571d37f0521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:08.145458 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1716/3449] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:08.153283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55e03b-85af-4d9e-a75f-17f3254d28a6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:08.155373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aa55e03b-85af-4d9e-a75f-17f3254d28a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:08.269197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55e03b-85af-4d9e-a75f-17f3254d28a6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:08.284433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c879ce-1a3e-4ce7-b8ff-78c8fe6d4516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:08.285153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c879ce-1a3e-4ce7-b8ff-78c8fe6d4516 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:08.285428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c879ce-1a3e-4ce7-b8ff-78c8fe6d4516 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:08.285699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c879ce-1a3e-4ce7-b8ff-78c8fe6d4516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:08.294570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:08.299361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c879ce-1a3e-4ce7-b8ff-78c8fe6d4516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:08.301243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c879ce-1a3e-4ce7-b8ff-78c8fe6d4516 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:08.312854 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1734/3450] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:13.633791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e2ba-58b2-453a-9e7e-e889d82e4435 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:13.634968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e2ba-58b2-453a-9e7e-e889d82e4435 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:13.635741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e2ba-58b2-453a-9e7e-e889d82e4435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:13.687127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b764e2ba-58b2-453a-9e7e-e889d82e4435 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:13.691668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b764e2ba-58b2-453a-9e7e-e889d82e4435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:13.837284 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1717/3451] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:26:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:13.852586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c879ce-1a3e-4ce7-b8ff-78c8fe6d4516 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:13.855973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-46c879ce-1a3e-4ce7-b8ff-78c8fe6d4516 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:13.976856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c879ce-1a3e-4ce7-b8ff-78c8fe6d4516 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:13.982694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3b608-6632-431f-a907-a009c08774b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:13.983401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3b608-6632-431f-a907-a009c08774b2 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:13.983762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3b608-6632-431f-a907-a009c08774b2 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:13.984141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3b608-6632-431f-a907-a009c08774b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:13.994138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3b608-6632-431f-a907-a009c08774b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:13.995979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3b608-6632-431f-a907-a009c08774b2 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:14.010109 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1735/3452] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:26:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:15.771108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b882e6-f2b6-44da-801b-27947829050d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:15.771711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b882e6-f2b6-44da-801b-27947829050d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:15.771983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b882e6-f2b6-44da-801b-27947829050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:15.786334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:15.825678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d8b882e6-f2b6-44da-801b-27947829050d None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:15.828177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d8b882e6-f2b6-44da-801b-27947829050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:15.853161 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1718/3453] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:26:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:15.867052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3b608-6632-431f-a907-a009c08774b2 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:15.883597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3b608-6632-431f-a907-a009c08774b2 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:15.890721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f485d-5598-466e-be80-e0f2d692ae39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:15.891402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f485d-5598-466e-be80-e0f2d692ae39 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:15.891945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f485d-5598-466e-be80-e0f2d692ae39 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:15.892237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f485d-5598-466e-be80-e0f2d692ae39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:15.902481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f485d-5598-466e-be80-e0f2d692ae39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:15.904336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f485d-5598-466e-be80-e0f2d692ae39 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:15.918591 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1736/3454] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:26:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:16.383093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab842a-fdc6-4ada-80d7-ae53f64bf113 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:16.383785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab842a-fdc6-4ada-80d7-ae53f64bf113 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:16.384230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ab842a-fdc6-4ada-80d7-ae53f64bf113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:16.411853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-44ab842a-fdc6-4ada-80d7-ae53f64bf113 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:16.413304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-44ab842a-fdc6-4ada-80d7-ae53f64bf113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:16.426080 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1719/3455] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:26:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:26:16.438828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f485d-5598-466e-be80-e0f2d692ae39 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:16.453245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f485d-5598-466e-be80-e0f2d692ae39 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:16.459279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bad8b8-8dd1-4fe6-aa61-baa4f900c2b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:16.460067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bad8b8-8dd1-4fe6-aa61-baa4f900c2b3 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:16.460399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bad8b8-8dd1-4fe6-aa61-baa4f900c2b3 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:16.460641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bad8b8-8dd1-4fe6-aa61-baa4f900c2b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:16.472741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bad8b8-8dd1-4fe6-aa61-baa4f900c2b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:16.474860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bad8b8-8dd1-4fe6-aa61-baa4f900c2b3 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:16.487166 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1737/3456] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:26:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:22.224573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab842a-fdc6-4ada-80d7-ae53f64bf113 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:22.226577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-44ab842a-fdc6-4ada-80d7-ae53f64bf113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:22.377998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ab842a-fdc6-4ada-80d7-ae53f64bf113 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:22.389148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0cd59-48e9-4f1a-a054-5be52ef3f91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:22.389782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0cd59-48e9-4f1a-a054-5be52ef3f91e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:22.390260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0cd59-48e9-4f1a-a054-5be52ef3f91e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:22.392032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0cd59-48e9-4f1a-a054-5be52ef3f91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:22.397312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-22b0cd59-48e9-4f1a-a054-5be52ef3f91e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:22.591692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0cd59-48e9-4f1a-a054-5be52ef3f91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:22.596758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0cd59-48e9-4f1a-a054-5be52ef3f91e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:22.618273 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1720/3457] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:23.366692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bad8b8-8dd1-4fe6-aa61-baa4f900c2b3 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:23.368301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-28bad8b8-8dd1-4fe6-aa61-baa4f900c2b3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:23.386305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bad8b8-8dd1-4fe6-aa61-baa4f900c2b3 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:23.392107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:23.393575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:23.394461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:23.395101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] PATH_INFO: `/v3/users/31b870521ea34e31a5c1bdce0829162d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:23.396377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b870521ea34e31a5c1bdce0829162d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:23.398455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:23.451846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b870521ea34e31a5c1bdce0829162d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:23.452477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b870521ea34e31a5c1bdce0829162d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:23.460659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b870521ea34e31a5c1bdce0829162d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:23.470240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b870521ea34e31a5c1bdce0829162d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:23.482657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d66e6461-93e9-421b-be3e-6685b17d2ab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b870521ea34e31a5c1bdce0829162d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:23.489219 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1738/3458] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:23 2022] DELETE /identity/v3/users/31b870521ea34e31a5c1bdce0829162d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:23.675629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0cd59-48e9-4f1a-a054-5be52ef3f91e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:23.695036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0cd59-48e9-4f1a-a054-5be52ef3f91e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:23.767024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:23.767674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:23.767967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:23.768216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] PATH_INFO: `/v3/projects/aaa5c47a7b2e47aca3c7e78314b5151a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:23.770457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa5c47a7b2e47aca3c7e78314b5151a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:23.772401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:23.868975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:23.875503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa5c47a7b2e47aca3c7e78314b5151a', 'request_id': 'req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:23.893150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa5c47a7b2e47aca3c7e78314b5151a', 'request_id': 'req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:23.931053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa5c47a7b2e47aca3c7e78314b5151a', 'request_id': 'req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:23.947302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] The token cache is being invalidate because project aaa5c47a7b2e47aca3c7e78314b5151a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:23.947597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:23.948300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd0b7ab0-c6b8-4161-a886-b73952fb5a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:23.956661 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1721/3459] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:23 2022] DELETE /identity/v3/projects/aaa5c47a7b2e47aca3c7e78314b5151a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:23.957717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbd498-ad4b-4628-a682-542f1135c4ac None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:23.958032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbd498-ad4b-4628-a682-542f1135c4ac None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:23.958308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbd498-ad4b-4628-a682-542f1135c4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:23.994619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c4dbd498-ad4b-4628-a682-542f1135c4ac None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:24.000038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c4dbd498-ad4b-4628-a682-542f1135c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:24.061170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:24.121133 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1739/3460] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:24.133324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55384-67bc-4854-833f-bc7634b09020 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:24.133603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55384-67bc-4854-833f-bc7634b09020 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:24.133895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55384-67bc-4854-833f-bc7634b09020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:24.157463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-65e55384-67bc-4854-833f-bc7634b09020 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:24.159496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-65e55384-67bc-4854-833f-bc7634b09020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:24.169010 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1722/3461] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:24.174820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbd498-ad4b-4628-a682-542f1135c4ac None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:24.187103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbd498-ad4b-4628-a682-542f1135c4ac None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:24.193474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce5aa5-f033-4c65-bfc9-6ebb5b0bb10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:24.194046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5aa5-f033-4c65-bfc9-6ebb5b0bb10e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:24.194646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5aa5-f033-4c65-bfc9-6ebb5b0bb10e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:24.194770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce5aa5-f033-4c65-bfc9-6ebb5b0bb10e admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:24.196614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce5aa5-f033-4c65-bfc9-6ebb5b0bb10e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:26:24.197148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce5aa5-f033-4c65-bfc9-6ebb5b0bb10e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:24.199588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce5aa5-f033-4c65-bfc9-6ebb5b0bb10e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:24.241385 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1740/3462] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:26:24.242970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e55384-67bc-4854-833f-bc7634b09020 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:24.258371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e55384-67bc-4854-833f-bc7634b09020 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:24.278284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8d3a2-4265-470b-87cb-aab1ddd03e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:24.278919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8d3a2-4265-470b-87cb-aab1ddd03e48 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:24.279189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8d3a2-4265-470b-87cb-aab1ddd03e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:24.280928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8d3a2-4265-470b-87cb-aab1ddd03e48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:24.280928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8d3a2-4265-470b-87cb-aab1ddd03e48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:24.287990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8d3a2-4265-470b-87cb-aab1ddd03e48 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:24.323364 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1723/3463] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:24 2022] POST /identity/v3/projects => generated 397 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:24.327283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce5aa5-f033-4c65-bfc9-6ebb5b0bb10e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:24.346617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce5aa5-f033-4c65-bfc9-6ebb5b0bb10e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:24.460410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451d81b-e604-48a6-aafe-d6a848d71ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:24.461939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451d81b-e604-48a6-aafe-d6a848d71ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:24.462411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451d81b-e604-48a6-aafe-d6a848d71ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:24.462842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451d81b-e604-48a6-aafe-d6a848d71ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:24.463644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451d81b-e604-48a6-aafe-d6a848d71ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:24.465773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451d81b-e604-48a6-aafe-d6a848d71ca2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:24.508028 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1741/3464] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:24 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:26:24.512929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8d3a2-4265-470b-87cb-aab1ddd03e48 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:24.532775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8d3a2-4265-470b-87cb-aab1ddd03e48 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:24.548554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74f6c3-60be-4ae6-ad49-8800e1a0e398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:24.549189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74f6c3-60be-4ae6-ad49-8800e1a0e398 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:24.549463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74f6c3-60be-4ae6-ad49-8800e1a0e398 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:24.549733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74f6c3-60be-4ae6-ad49-8800e1a0e398 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:24.550719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74f6c3-60be-4ae6-ad49-8800e1a0e398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:24.552167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74f6c3-60be-4ae6-ad49-8800e1a0e398 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:24.566179 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1724/3465] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:24.568077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451d81b-e604-48a6-aafe-d6a848d71ca2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:24.582725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451d81b-e604-48a6-aafe-d6a848d71ca2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:24.588947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b1f1f-ad79-40ee-a3bc-ada06c47c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:24.589731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1f1f-ad79-40ee-a3bc-ada06c47c652 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:24.590122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1f1f-ad79-40ee-a3bc-ada06c47c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:24.590457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b1f1f-ad79-40ee-a3bc-ada06c47c652 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:24.591377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b1f1f-ad79-40ee-a3bc-ada06c47c652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:24.593203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b1f1f-ad79-40ee-a3bc-ada06c47c652 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:24.611022 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1742/3466] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:24.615368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74f6c3-60be-4ae6-ad49-8800e1a0e398 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:24.645052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74f6c3-60be-4ae6-ad49-8800e1a0e398 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:24.650366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6defd13-2c35-4c98-afce-4729a8cfe904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:24.651084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6defd13-2c35-4c98-afce-4729a8cfe904 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:24.651362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6defd13-2c35-4c98-afce-4729a8cfe904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:24.651638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6defd13-2c35-4c98-afce-4729a8cfe904 admin admin] PATH_INFO: `/v3/projects/3ce2bb4dbf3545d0ad98bbaab2139357/users/77f2f19d1968440096cf91275a7a09e5/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:24.677290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6defd13-2c35-4c98-afce-4729a8cfe904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce2bb4dbf3545d0ad98bbaab2139357, user_id=77f2f19d1968440096cf91275a7a09e5, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:24.680728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6defd13-2c35-4c98-afce-4729a8cfe904 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:24.703280 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1725/3467] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:24 2022] PUT /identity/v3/projects/3ce2bb4dbf3545d0ad98bbaab2139357/users/77f2f19d1968440096cf91275a7a09e5/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:24.712608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e195f0-85b0-4e57-abb4-4dee3c8cf120 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:24.713062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e195f0-85b0-4e57-abb4-4dee3c8cf120 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:24.713482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e195f0-85b0-4e57-abb4-4dee3c8cf120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:24.745663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-89e195f0-85b0-4e57-abb4-4dee3c8cf120 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:24.747621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-89e195f0-85b0-4e57-abb4-4dee3c8cf120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:24.845034 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1743/3468] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:24.855247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6defd13-2c35-4c98-afce-4729a8cfe904 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:24.858055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a6defd13-2c35-4c98-afce-4729a8cfe904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:25.098511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6defd13-2c35-4c98-afce-4729a8cfe904 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:25.103770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e8688-eaa9-4d7e-b712-22c2b0792d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:25.105123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e8688-eaa9-4d7e-b712-22c2b0792d13 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:25.105532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e8688-eaa9-4d7e-b712-22c2b0792d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:25.106094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e8688-eaa9-4d7e-b712-22c2b0792d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:25.119176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e8688-eaa9-4d7e-b712-22c2b0792d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:25.121371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e8688-eaa9-4d7e-b712-22c2b0792d13 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:25.134627 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1726/3469] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:27.475473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86970ea-2df8-4289-ab3b-d30bfe3c4288 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:27.476198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86970ea-2df8-4289-ab3b-d30bfe3c4288 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:27.480233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86970ea-2df8-4289-ab3b-d30bfe3c4288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:27.527868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a86970ea-2df8-4289-ab3b-d30bfe3c4288 None None] MFA Rules not processed for user `358a4edea635469d9a9f64e941b6ed53`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:27.529513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a86970ea-2df8-4289-ab3b-d30bfe3c4288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:27.589256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:27.622408 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1744/3470] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:31.628364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e8688-eaa9-4d7e-b712-22c2b0792d13 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:31.633551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a54e8688-eaa9-4d7e-b712-22c2b0792d13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:31.743879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e8688-eaa9-4d7e-b712-22c2b0792d13 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:31.752112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816397f7-54c8-4205-b2cb-00cd821209b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:31.753304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816397f7-54c8-4205-b2cb-00cd821209b3 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:31.753966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816397f7-54c8-4205-b2cb-00cd821209b3 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:31.754648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816397f7-54c8-4205-b2cb-00cd821209b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:31.760964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-816397f7-54c8-4205-b2cb-00cd821209b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:31.774144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:31.973274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816397f7-54c8-4205-b2cb-00cd821209b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:31.975407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816397f7-54c8-4205-b2cb-00cd821209b3 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:32.018205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1727/3471] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:32.308968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61351ff0-e2b9-44fd-8488-8829eab7a194 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:32.310410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61351ff0-e2b9-44fd-8488-8829eab7a194 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:32.311531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61351ff0-e2b9-44fd-8488-8829eab7a194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:32.402737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-61351ff0-e2b9-44fd-8488-8829eab7a194 None None] MFA Rules not processed for user `2e944e3030a1404c9862d953fedfb94a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:32.409450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-61351ff0-e2b9-44fd-8488-8829eab7a194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:32.547819 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1745/3472] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:32.708415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816397f7-54c8-4205-b2cb-00cd821209b3 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:32.712266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-816397f7-54c8-4205-b2cb-00cd821209b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:32.763572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816397f7-54c8-4205-b2cb-00cd821209b3 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:32.790147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:32.793300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:32.794168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:32.794447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] PATH_INFO: `/v3/users/e5a02f772ad1448ab3d1b67541ca6581` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:32.797718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a02f772ad1448ab3d1b67541ca6581)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:32.802957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:32.961661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a02f772ad1448ab3d1b67541ca6581'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:32.977349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a02f772ad1448ab3d1b67541ca6581'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:33.033977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a02f772ad1448ab3d1b67541ca6581'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:33.051371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a02f772ad1448ab3d1b67541ca6581'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:33.052096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a02f772ad1448ab3d1b67541ca6581'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:33.067303 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1728/3473] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:32 2022] DELETE /identity/v3/users/e5a02f772ad1448ab3d1b67541ca6581 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:33.181309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec599a-0532-4b73-9e30-da560f1051e6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:33.181777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec599a-0532-4b73-9e30-da560f1051e6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:33.182099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec599a-0532-4b73-9e30-da560f1051e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:33.213918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-51ec599a-0532-4b73-9e30-da560f1051e6 None None] MFA Rules not processed for user `d7a12c873b724eb586098874f925791f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:33.215564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51ec599a-0532-4b73-9e30-da560f1051e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:33.428168 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1746/3474] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:33.914565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:33.915716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:34.044388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441064c-dd50-4431-adbe-7e9cd7236d47 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:34.060440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:34.061103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:34.061985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:34.061985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] PATH_INFO: `/v3/projects/8645f7fc0db348e89fd338905e31c12a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:34.064694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8645f7fc0db348e89fd338905e31c12a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:34.065230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:34.111510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:34.163701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8645f7fc0db348e89fd338905e31c12a', 'request_id': 'req-331c6156-e4d7-4463-a177-758738ac4132'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:34.204885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8645f7fc0db348e89fd338905e31c12a', 'request_id': 'req-331c6156-e4d7-4463-a177-758738ac4132'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:34.214214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8645f7fc0db348e89fd338905e31c12a', 'request_id': 'req-331c6156-e4d7-4463-a177-758738ac4132'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:34.254969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] The token cache is being invalidate because project 8645f7fc0db348e89fd338905e31c12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:34.255701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:34.256863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-331c6156-e4d7-4463-a177-758738ac4132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:34.259222 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1729/3475] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:33 2022] DELETE /identity/v3/projects/8645f7fc0db348e89fd338905e31c12a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:34.264731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644ae97-5931-4228-aa85-1b62e00ff0a8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:34.265028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644ae97-5931-4228-aa85-1b62e00ff0a8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:34.265304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644ae97-5931-4228-aa85-1b62e00ff0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:34.294959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f644ae97-5931-4228-aa85-1b62e00ff0a8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:34.297302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f644ae97-5931-4228-aa85-1b62e00ff0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:34.487950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0bf8-b745-43b9-a982-194b6b4ca392 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:34.488238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0bf8-b745-43b9-a982-194b6b4ca392 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:34.488514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0bf8-b745-43b9-a982-194b6b4ca392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:34.499807 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1747/3476] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:34.522013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a82e0bf8-b745-43b9-a982-194b6b4ca392 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:34.524119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a82e0bf8-b745-43b9-a982-194b6b4ca392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:34.535410 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1730/3477] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:34.540855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644ae97-5931-4228-aa85-1b62e00ff0a8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:34.556005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644ae97-5931-4228-aa85-1b62e00ff0a8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:34.567477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad8dda-d48f-4f19-916f-f693cc1637dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:34.569382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8dda-d48f-4f19-916f-f693cc1637dc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:34.570103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8dda-d48f-4f19-916f-f693cc1637dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:34.570534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad8dda-d48f-4f19-916f-f693cc1637dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:34.571365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad8dda-d48f-4f19-916f-f693cc1637dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:26:34.571821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad8dda-d48f-4f19-916f-f693cc1637dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:34.573768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad8dda-d48f-4f19-916f-f693cc1637dc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:34.597100 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1748/3478] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:26:34.599120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0bf8-b745-43b9-a982-194b6b4ca392 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:34.612940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0bf8-b745-43b9-a982-194b6b4ca392 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:34.628132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b358c-5420-41a8-85b7-88b00763eb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:34.628771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b358c-5420-41a8-85b7-88b00763eb71 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:34.629088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b358c-5420-41a8-85b7-88b00763eb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:34.629499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b358c-5420-41a8-85b7-88b00763eb71 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:34.630292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b358c-5420-41a8-85b7-88b00763eb71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:34.635753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b358c-5420-41a8-85b7-88b00763eb71 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:34.702048 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1731/3479] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:34 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:34.709432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad8dda-d48f-4f19-916f-f693cc1637dc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:34.724679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad8dda-d48f-4f19-916f-f693cc1637dc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:34.807614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:34.908496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa690a8-b75a-4adb-a0d8-e997b4c87424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:34.909138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa690a8-b75a-4adb-a0d8-e997b4c87424 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:34.909418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa690a8-b75a-4adb-a0d8-e997b4c87424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:34.909688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa690a8-b75a-4adb-a0d8-e997b4c87424 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:34.910579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa690a8-b75a-4adb-a0d8-e997b4c87424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:34.912330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa690a8-b75a-4adb-a0d8-e997b4c87424 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:34.986844 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1749/3480] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:34 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:34.987038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b358c-5420-41a8-85b7-88b00763eb71 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:35.003332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b358c-5420-41a8-85b7-88b00763eb71 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:35.016449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4d71c-4c26-4a8b-a671-3f7b94542d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:35.017405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4d71c-4c26-4a8b-a671-3f7b94542d3a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:35.020054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4d71c-4c26-4a8b-a671-3f7b94542d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:35.020536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4d71c-4c26-4a8b-a671-3f7b94542d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:35.023362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4d71c-4c26-4a8b-a671-3f7b94542d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:35.028401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4d71c-4c26-4a8b-a671-3f7b94542d3a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:35.055230 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1732/3481] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:35.059574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa690a8-b75a-4adb-a0d8-e997b4c87424 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:35.072929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa690a8-b75a-4adb-a0d8-e997b4c87424 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:35.078192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba45da4-8a67-482e-a1b8-3e9ad6290922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:35.078913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45da4-8a67-482e-a1b8-3e9ad6290922 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:35.079192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45da4-8a67-482e-a1b8-3e9ad6290922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:35.079993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba45da4-8a67-482e-a1b8-3e9ad6290922 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:35.080604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba45da4-8a67-482e-a1b8-3e9ad6290922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:35.082292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba45da4-8a67-482e-a1b8-3e9ad6290922 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:35.100603 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1750/3482] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:35.102101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4d71c-4c26-4a8b-a671-3f7b94542d3a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:35.116170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4d71c-4c26-4a8b-a671-3f7b94542d3a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:35.139612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e89623-331b-4a0c-98f2-cd1506e0a672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:35.141094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e89623-331b-4a0c-98f2-cd1506e0a672 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:35.143426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e89623-331b-4a0c-98f2-cd1506e0a672 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:35.144953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e89623-331b-4a0c-98f2-cd1506e0a672 admin admin] PATH_INFO: `/v3/projects/ff53cc1e4ac74cdeb36165f3a11a99cb/users/df89d9f07dce4db2867c5abc3385a409/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:35.186800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e89623-331b-4a0c-98f2-cd1506e0a672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff53cc1e4ac74cdeb36165f3a11a99cb, user_id=df89d9f07dce4db2867c5abc3385a409, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:35.195569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e89623-331b-4a0c-98f2-cd1506e0a672 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:35.265595 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1733/3483] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:35 2022] PUT /identity/v3/projects/ff53cc1e4ac74cdeb36165f3a11a99cb/users/df89d9f07dce4db2867c5abc3385a409/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:35.281563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50824d3-2aa2-4267-9fdd-4c4c11562fc6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:35.282632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50824d3-2aa2-4267-9fdd-4c4c11562fc6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:35.283283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50824d3-2aa2-4267-9fdd-4c4c11562fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:35.320429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a50824d3-2aa2-4267-9fdd-4c4c11562fc6 None None] MFA Rules not processed for user `df89d9f07dce4db2867c5abc3385a409`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:35.323439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a50824d3-2aa2-4267-9fdd-4c4c11562fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:35.442965 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1751/3484] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:35.450873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c095b-2bf9-418d-9eb8-9a539266da95 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:35.451160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c095b-2bf9-418d-9eb8-9a539266da95 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:35.451434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c095b-2bf9-418d-9eb8-9a539266da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:35.504799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bb2c095b-2bf9-418d-9eb8-9a539266da95 None None] MFA Rules not processed for user `df89d9f07dce4db2867c5abc3385a409`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:35.508393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bb2c095b-2bf9-418d-9eb8-9a539266da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:35.525897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50824d3-2aa2-4267-9fdd-4c4c11562fc6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:35.527881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a50824d3-2aa2-4267-9fdd-4c4c11562fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:35.566346 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1734/3485] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:35.746230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50824d3-2aa2-4267-9fdd-4c4c11562fc6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:35.760604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:35.761450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:35.761905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:35.762323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] PATH_INFO: `/v3/users/e68398e5fc8c472a95ecef61d8e4071f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:35.764509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68398e5fc8c472a95ecef61d8e4071f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:35.766779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:35.845717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:35.872259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68398e5fc8c472a95ecef61d8e4071f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:35.875912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68398e5fc8c472a95ecef61d8e4071f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:35.895106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68398e5fc8c472a95ecef61d8e4071f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:35.909790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68398e5fc8c472a95ecef61d8e4071f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:35.926347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c095b-2bf9-418d-9eb8-9a539266da95 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:35.928775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bb2c095b-2bf9-418d-9eb8-9a539266da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:35.952749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c56f4b65-e873-4db6-98d1-e917b8e4d163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68398e5fc8c472a95ecef61d8e4071f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:36.017081 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1752/3486] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:35 2022] DELETE /identity/v3/users/e68398e5fc8c472a95ecef61d8e4071f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:26:36.018812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176252-0ea5-4994-860e-64ec611dc751 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:36.019932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176252-0ea5-4994-860e-64ec611dc751 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:36.019932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176252-0ea5-4994-860e-64ec611dc751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:36.072482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-52176252-0ea5-4994-860e-64ec611dc751 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:36.077639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-52176252-0ea5-4994-860e-64ec611dc751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:36.263623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c095b-2bf9-418d-9eb8-9a539266da95 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:36.341257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:36.379765 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1753/3487] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:36.448445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52176252-0ea5-4994-860e-64ec611dc751 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:36.451202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-52176252-0ea5-4994-860e-64ec611dc751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:36.498889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ac22d-2e3e-4f3b-9b82-653e8e1095ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:36.505569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ac22d-2e3e-4f3b-9b82-653e8e1095ff service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:36.509959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ac22d-2e3e-4f3b-9b82-653e8e1095ff service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:36.510674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ac22d-2e3e-4f3b-9b82-653e8e1095ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:36.521660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6b5ac22d-2e3e-4f3b-9b82-653e8e1095ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:36.693153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52176252-0ea5-4994-860e-64ec611dc751 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:36.701369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec12f77-6e45-412d-a772-947a8fed3c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:36.702273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec12f77-6e45-412d-a772-947a8fed3c9c service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:36.704551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec12f77-6e45-412d-a772-947a8fed3c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:36.706543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec12f77-6e45-412d-a772-947a8fed3c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:36.706698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ac22d-2e3e-4f3b-9b82-653e8e1095ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:36.708330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ac22d-2e3e-4f3b-9b82-653e8e1095ff service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:36.720430 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1735/3488] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 796 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:26:36.732452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec12f77-6e45-412d-a772-947a8fed3c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:36.735140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec12f77-6e45-412d-a772-947a8fed3c9c service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:36.796256 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1754/3489] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:38.430660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ca6ce-8a5c-4ae3-81e3-288cb6b241dd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:38.431289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ca6ce-8a5c-4ae3-81e3-288cb6b241dd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:38.431386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ca6ce-8a5c-4ae3-81e3-288cb6b241dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:38.490586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0e3ca6ce-8a5c-4ae3-81e3-288cb6b241dd None None] MFA Rules not processed for user `fc376020ea1f4826b3c873b8945cb8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:38.497379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0e3ca6ce-8a5c-4ae3-81e3-288cb6b241dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:38.658589 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1736/3490] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:39.249500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec12f77-6e45-412d-a772-947a8fed3c9c service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:39.252618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7ec12f77-6e45-412d-a772-947a8fed3c9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:39.276905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec12f77-6e45-412d-a772-947a8fed3c9c service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:39.290762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:39.291890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:39.292488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:39.292984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] PATH_INFO: `/v3/projects/8502e5f236ae42509da19923f035a2d7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:39.294834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8502e5f236ae42509da19923f035a2d7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:39.299618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:39.427567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:39.436220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8502e5f236ae42509da19923f035a2d7', 'request_id': 'req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:39.454580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8502e5f236ae42509da19923f035a2d7', 'request_id': 'req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:39.474454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8502e5f236ae42509da19923f035a2d7', 'request_id': 'req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:39.494636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] The token cache is being invalidate because project 8502e5f236ae42509da19923f035a2d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:39.495060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:39.496940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a8cdb4ba-72c1-4b89-97fd-f4ddd6e7b421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:39.499180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1755/3491] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:39 2022] DELETE /identity/v3/projects/8502e5f236ae42509da19923f035a2d7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:39.504586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ca6ce-8a5c-4ae3-81e3-288cb6b241dd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:39.525968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ca6ce-8a5c-4ae3-81e3-288cb6b241dd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:39.662539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:39.663240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:39.663722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:39.664160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] PATH_INFO: `/v3/users/5f0efd4e27e547c382be453c8cdc82e0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:39.665669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0efd4e27e547c382be453c8cdc82e0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:39.667824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:39.713346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:39.772693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0efd4e27e547c382be453c8cdc82e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:39.789672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0efd4e27e547c382be453c8cdc82e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:39.821765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0efd4e27e547c382be453c8cdc82e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:39.839553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0efd4e27e547c382be453c8cdc82e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:39.840548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8575369-5467-4cb3-abd3-58ef3bbac369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0efd4e27e547c382be453c8cdc82e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:39.855239 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1737/3492] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:26:39 2022] DELETE /identity/v3/users/5f0efd4e27e547c382be453c8cdc82e0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:41.371583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc35264-3b0a-41a8-99e8-c166c8f5bdda None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:41.372032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc35264-3b0a-41a8-99e8-c166c8f5bdda None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:41.372125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc35264-3b0a-41a8-99e8-c166c8f5bdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:41.460043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bbc35264-3b0a-41a8-99e8-c166c8f5bdda None None] MFA Rules not processed for user `77f2f19d1968440096cf91275a7a09e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:41.461678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bbc35264-3b0a-41a8-99e8-c166c8f5bdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:41.648725 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1756/3493] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:41.650294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74548b1-95e1-456a-9a45-cede03c150a6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:41.650753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74548b1-95e1-456a-9a45-cede03c150a6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:41.650875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74548b1-95e1-456a-9a45-cede03c150a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:41.699607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d74548b1-95e1-456a-9a45-cede03c150a6 None None] MFA Rules not processed for user `77f2f19d1968440096cf91275a7a09e5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:41.703690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d74548b1-95e1-456a-9a45-cede03c150a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:41.733726 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1738/3494] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:42.082739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc35264-3b0a-41a8-99e8-c166c8f5bdda None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:42.084554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bbc35264-3b0a-41a8-99e8-c166c8f5bdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:42.255211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc35264-3b0a-41a8-99e8-c166c8f5bdda None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:42.261913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:42.262584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:42.263709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:42.263709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] PATH_INFO: `/v3/projects/66fd45d030f24a14a964b9c49961cb31` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:42.264326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66fd45d030f24a14a964b9c49961cb31)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:42.267682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:42.370860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66fd45d030f24a14a964b9c49961cb31', 'request_id': 'req-db80413f-5081-4a5f-971b-27798e47e486'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:42.380165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66fd45d030f24a14a964b9c49961cb31', 'request_id': 'req-db80413f-5081-4a5f-971b-27798e47e486'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:42.394760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66fd45d030f24a14a964b9c49961cb31', 'request_id': 'req-db80413f-5081-4a5f-971b-27798e47e486'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:42.403484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:42.419012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] The token cache is being invalidate because project 66fd45d030f24a14a964b9c49961cb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:26:42.420087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:42.421072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db80413f-5081-4a5f-971b-27798e47e486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:26:42.424140 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1757/3495] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:42 2022] DELETE /identity/v3/projects/66fd45d030f24a14a964b9c49961cb31 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:42.429169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3122d1-562c-453f-96da-be1b38b4b550 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:42.429833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3122d1-562c-453f-96da-be1b38b4b550 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:42.430133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3122d1-562c-453f-96da-be1b38b4b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:42.465947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3f3122d1-562c-453f-96da-be1b38b4b550 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:42.467506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3f3122d1-562c-453f-96da-be1b38b4b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:42.585227 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1739/3496] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:42.586159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4560-5036-4e9b-965f-ae4bef2a9252 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:42.586721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4560-5036-4e9b-965f-ae4bef2a9252 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:42.587228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a4560-5036-4e9b-965f-ae4bef2a9252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:42.673981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f20a4560-5036-4e9b-965f-ae4bef2a9252 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:42.676233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f20a4560-5036-4e9b-965f-ae4bef2a9252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:42.705159 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1758/3497] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:26:42.711246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3122d1-562c-453f-96da-be1b38b4b550 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:42.726070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3122d1-562c-453f-96da-be1b38b4b550 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:42.744515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852622-c9b4-4188-8f5a-bf510b80878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:42.747292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852622-c9b4-4188-8f5a-bf510b80878c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:42.749021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852622-c9b4-4188-8f5a-bf510b80878c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:42.749581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19852622-c9b4-4188-8f5a-bf510b80878c admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:42.771999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19852622-c9b4-4188-8f5a-bf510b80878c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:26:42.772417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19852622-c9b4-4188-8f5a-bf510b80878c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:42.778789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19852622-c9b4-4188-8f5a-bf510b80878c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:42.840174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4560-5036-4e9b-965f-ae4bef2a9252 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:42.840966 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1740/3498] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:26:42.856814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a4560-5036-4e9b-965f-ae4bef2a9252 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:42.870563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf252b-bbc4-462c-b139-f1c7e99345fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:42.871982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf252b-bbc4-462c-b139-f1c7e99345fa admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:42.872412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf252b-bbc4-462c-b139-f1c7e99345fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:42.872855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf252b-bbc4-462c-b139-f1c7e99345fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:42.873861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf252b-bbc4-462c-b139-f1c7e99345fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:42.878531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf252b-bbc4-462c-b139-f1c7e99345fa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:42.943717 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1759/3499] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:42 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:26:42.953267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852622-c9b4-4188-8f5a-bf510b80878c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:42.968699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19852622-c9b4-4188-8f5a-bf510b80878c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:43.109385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac693a-9971-489a-a1f2-915a30551f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:43.110318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac693a-9971-489a-a1f2-915a30551f8f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:43.111889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac693a-9971-489a-a1f2-915a30551f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:43.113380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac693a-9971-489a-a1f2-915a30551f8f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:43.116056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac693a-9971-489a-a1f2-915a30551f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:43.120621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac693a-9971-489a-a1f2-915a30551f8f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:43.178315 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1741/3500] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:42 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:43.182639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf252b-bbc4-462c-b139-f1c7e99345fa admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:43.196568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf252b-bbc4-462c-b139-f1c7e99345fa admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:43.207652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12329a0-9c5d-4dd9-893f-fe3c92ceaf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:43.208402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12329a0-9c5d-4dd9-893f-fe3c92ceaf06 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:43.214904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12329a0-9c5d-4dd9-893f-fe3c92ceaf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:43.215326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12329a0-9c5d-4dd9-893f-fe3c92ceaf06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:43.216550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12329a0-9c5d-4dd9-893f-fe3c92ceaf06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:43.218440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12329a0-9c5d-4dd9-893f-fe3c92ceaf06 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:43.259772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac693a-9971-489a-a1f2-915a30551f8f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:43.267731 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1760/3501] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:43.279205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:43.289322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac693a-9971-489a-a1f2-915a30551f8f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:43.299553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb20e7-ddf1-4879-a467-b1f054d1e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:43.300624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb20e7-ddf1-4879-a467-b1f054d1e91b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:43.301027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb20e7-ddf1-4879-a467-b1f054d1e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:43.301446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb20e7-ddf1-4879-a467-b1f054d1e91b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:43.302246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb20e7-ddf1-4879-a467-b1f054d1e91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:43.304237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb20e7-ddf1-4879-a467-b1f054d1e91b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:43.320245 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1742/3502] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:26:43.323184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12329a0-9c5d-4dd9-893f-fe3c92ceaf06 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:43.349844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12329a0-9c5d-4dd9-893f-fe3c92ceaf06 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:43.354676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24da139-1c56-4e49-bfaf-2d40303ece46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:43.355362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24da139-1c56-4e49-bfaf-2d40303ece46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:43.355646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24da139-1c56-4e49-bfaf-2d40303ece46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:43.355918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24da139-1c56-4e49-bfaf-2d40303ece46 admin admin] PATH_INFO: `/v3/projects/482483b6bedc4c0abdba4b58927f4b2c/users/2ad64e15a95f4057bffb4e2af194ad08/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:43.392380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24da139-1c56-4e49-bfaf-2d40303ece46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=482483b6bedc4c0abdba4b58927f4b2c, user_id=2ad64e15a95f4057bffb4e2af194ad08, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:43.395521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24da139-1c56-4e49-bfaf-2d40303ece46 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:43.435077 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1761/3503] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:43 2022] PUT /identity/v3/projects/482483b6bedc4c0abdba4b58927f4b2c/users/2ad64e15a95f4057bffb4e2af194ad08/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:43.437464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f49cb8-f704-4ec0-beef-fe6f3f57e393 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:43.438282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f49cb8-f704-4ec0-beef-fe6f3f57e393 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:43.439030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f49cb8-f704-4ec0-beef-fe6f3f57e393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:43.513580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-04f49cb8-f704-4ec0-beef-fe6f3f57e393 None None] MFA Rules not processed for user `2ad64e15a95f4057bffb4e2af194ad08`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:43.515557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-04f49cb8-f704-4ec0-beef-fe6f3f57e393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:43.576752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24da139-1c56-4e49-bfaf-2d40303ece46 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:43.578668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e24da139-1c56-4e49-bfaf-2d40303ece46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:43.745764 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1743/3504] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:26:43.751926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f49cb8-f704-4ec0-beef-fe6f3f57e393 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:43.789193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24da139-1c56-4e49-bfaf-2d40303ece46 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:43.797219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b4196-c39e-4dfb-aa53-dc374ef24e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:43.799022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b4196-c39e-4dfb-aa53-dc374ef24e41 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:43.799607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b4196-c39e-4dfb-aa53-dc374ef24e41 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:43.800077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b4196-c39e-4dfb-aa53-dc374ef24e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:43.802739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b7b4196-c39e-4dfb-aa53-dc374ef24e41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:43.952982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f49cb8-f704-4ec0-beef-fe6f3f57e393 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:43.968210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ec23a-3464-4324-9359-8c74c42f2aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:43.972024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ec23a-3464-4324-9359-8c74c42f2aec admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:43.972387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ec23a-3464-4324-9359-8c74c42f2aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:43.972595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ec23a-3464-4324-9359-8c74c42f2aec admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:43.974543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ec23a-3464-4324-9359-8c74c42f2aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:43.980045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ec23a-3464-4324-9359-8c74c42f2aec admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:44.015887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b4196-c39e-4dfb-aa53-dc374ef24e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:44.026829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b4196-c39e-4dfb-aa53-dc374ef24e41 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:44.052304 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1744/3505] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:26:43 2022] POST /identity/v3/projects => generated 377 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:26:44.056746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ec23a-3464-4324-9359-8c74c42f2aec admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:44.069334 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1762/3506] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:26:44.230306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ec23a-3464-4324-9359-8c74c42f2aec admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:44.245396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b4196-c39e-4dfb-aa53-dc374ef24e41 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:44.247158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4d18e-5ad9-43e8-b524-1a9ea1f8f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:44.247390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b7b4196-c39e-4dfb-aa53-dc374ef24e41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:44.248319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4d18e-5ad9-43e8-b524-1a9ea1f8f145 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:44.248722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4d18e-5ad9-43e8-b524-1a9ea1f8f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:44.249111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4d18e-5ad9-43e8-b524-1a9ea1f8f145 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:44.250121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4d18e-5ad9-43e8-b524-1a9ea1f8f145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:44.252669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4d18e-5ad9-43e8-b524-1a9ea1f8f145 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:44.288044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:44.299813 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1745/3507] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:26:44 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:26:44.301819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4d18e-5ad9-43e8-b524-1a9ea1f8f145 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:44.327610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4d18e-5ad9-43e8-b524-1a9ea1f8f145 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:44.339675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b08290-8021-458d-97cb-93d277b25fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:44.340959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b08290-8021-458d-97cb-93d277b25fbf admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:44.342514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b08290-8021-458d-97cb-93d277b25fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:44.342834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:44.343674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b08290-8021-458d-97cb-93d277b25fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:44.347130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b08290-8021-458d-97cb-93d277b25fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:44.351513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b08290-8021-458d-97cb-93d277b25fbf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:44.367524 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1746/3508] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:44.372637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b08290-8021-458d-97cb-93d277b25fbf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:44.398815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b08290-8021-458d-97cb-93d277b25fbf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:44.414317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c902a5-50cc-4d07-9a7e-be0ef149640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:44.417014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c902a5-50cc-4d07-9a7e-be0ef149640c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:44.417918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c902a5-50cc-4d07-9a7e-be0ef149640c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:44.418897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c902a5-50cc-4d07-9a7e-be0ef149640c admin admin] PATH_INFO: `/v3/projects/ede934ea479a4bc1a32704edc05cedcc/users/4f4dadb5742c4e9a9ea638eb8998e883/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:44.450743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b4196-c39e-4dfb-aa53-dc374ef24e41 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:44.458537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c902a5-50cc-4d07-9a7e-be0ef149640c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede934ea479a4bc1a32704edc05cedcc, user_id=4f4dadb5742c4e9a9ea638eb8998e883, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:44.465233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c902a5-50cc-4d07-9a7e-be0ef149640c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:44.513588 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1747/3509] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:44 2022] PUT /identity/v3/projects/ede934ea479a4bc1a32704edc05cedcc/users/4f4dadb5742c4e9a9ea638eb8998e883/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:44.514717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c902a5-50cc-4d07-9a7e-be0ef149640c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:44.631746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c902a5-50cc-4d07-9a7e-be0ef149640c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:44.634794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e06bc5-fa0c-4231-8271-4d1660bd72c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:44.635451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06bc5-fa0c-4231-8271-4d1660bd72c1 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:44.635723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06bc5-fa0c-4231-8271-4d1660bd72c1 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:44.635988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06bc5-fa0c-4231-8271-4d1660bd72c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:44.638297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13c999-51bc-4af2-9bc3-2089cd47a8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:44.639143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13c999-51bc-4af2-9bc3-2089cd47a8df admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:44.639520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13c999-51bc-4af2-9bc3-2089cd47a8df admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:44.640066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13c999-51bc-4af2-9bc3-2089cd47a8df admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:44.640886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13c999-51bc-4af2-9bc3-2089cd47a8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:44.643266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a13c999-51bc-4af2-9bc3-2089cd47a8df admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:44.644626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-17e06bc5-fa0c-4231-8271-4d1660bd72c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:44.657464 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1748/3510] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:26:44.663025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13c999-51bc-4af2-9bc3-2089cd47a8df admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:44.669044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e06bc5-fa0c-4231-8271-4d1660bd72c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:44.670709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e06bc5-fa0c-4231-8271-4d1660bd72c1 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:44.681373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13c999-51bc-4af2-9bc3-2089cd47a8df admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:44.694998 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1763/3511] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:44.713166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c99db-5f63-431b-b8f7-ceb602cf1c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:44.714052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c99db-5f63-431b-b8f7-ceb602cf1c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:44.715482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c99db-5f63-431b-b8f7-ceb602cf1c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:44.715482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c99db-5f63-431b-b8f7-ceb602cf1c29 admin admin] PATH_INFO: `/v3/projects/ede934ea479a4bc1a32704edc05cedcc/users/4f4dadb5742c4e9a9ea638eb8998e883/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:44.736522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c99db-5f63-431b-b8f7-ceb602cf1c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede934ea479a4bc1a32704edc05cedcc, user_id=4f4dadb5742c4e9a9ea638eb8998e883, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:44.753620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c99db-5f63-431b-b8f7-ceb602cf1c29 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:44.786942 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1749/3512] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:26:44 2022] PUT /identity/v3/projects/ede934ea479a4bc1a32704edc05cedcc/users/4f4dadb5742c4e9a9ea638eb8998e883/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:26:44.798740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd150-9ea7-466a-82aa-a36f6f82a7f7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:44.799006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd150-9ea7-466a-82aa-a36f6f82a7f7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:44.799658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdd150-9ea7-466a-82aa-a36f6f82a7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:44.867474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-84fdd150-9ea7-466a-82aa-a36f6f82a7f7 None None] MFA Rules not processed for user `4f4dadb5742c4e9a9ea638eb8998e883`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:44.869008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-84fdd150-9ea7-466a-82aa-a36f6f82a7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:45.064470 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1764/3513] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:45.065499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf850ed-2f07-461d-86a6-743e8eb896fd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.065799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf850ed-2f07-461d-86a6-743e8eb896fd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.066105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf850ed-2f07-461d-86a6-743e8eb896fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.120839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-abf850ed-2f07-461d-86a6-743e8eb896fd None None] MFA Rules not processed for user `2ad64e15a95f4057bffb4e2af194ad08`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:45.126630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-abf850ed-2f07-461d-86a6-743e8eb896fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:45.313174 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1750/3514] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:45.450851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605e902-70fc-4322-bc18-c5a06eb56e73 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.457616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605e902-70fc-4322-bc18-c5a06eb56e73 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.458191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605e902-70fc-4322-bc18-c5a06eb56e73 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.460384 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1765/3515] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:26:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:26:45.468536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8a4c0-fa30-4dca-bebb-1648ef51b2ac None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.468928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8a4c0-fa30-4dca-bebb-1648ef51b2ac None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.471800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8a4c0-fa30-4dca-bebb-1648ef51b2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.558073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cbb8a4c0-fa30-4dca-bebb-1648ef51b2ac None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:45.560416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cbb8a4c0-fa30-4dca-bebb-1648ef51b2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:45.628810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:45.704735 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1751/3516] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:26:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:45.751150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605e902-70fc-4322-bc18-c5a06eb56e73 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:45.753228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2605e902-70fc-4322-bc18-c5a06eb56e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:45.783490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605e902-70fc-4322-bc18-c5a06eb56e73 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:45.804328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26091e3-08c4-402b-b568-2d3950aa7a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:45.805583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26091e3-08c4-402b-b568-2d3950aa7a91 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:45.806995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26091e3-08c4-402b-b568-2d3950aa7a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:45.808371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26091e3-08c4-402b-b568-2d3950aa7a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:45.830589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26091e3-08c4-402b-b568-2d3950aa7a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:45.834504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26091e3-08c4-402b-b568-2d3950aa7a91 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:45.863536 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1766/3517] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:46.447651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8a4c0-fa30-4dca-bebb-1648ef51b2ac None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:46.583064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8a4c0-fa30-4dca-bebb-1648ef51b2ac None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:46.602858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aebfad-81ce-4b58-9874-a6aadf984011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:46.605083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aebfad-81ce-4b58-9874-a6aadf984011 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:46.605389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aebfad-81ce-4b58-9874-a6aadf984011 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:46.605752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aebfad-81ce-4b58-9874-a6aadf984011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:46.632252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aebfad-81ce-4b58-9874-a6aadf984011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:46.635295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aebfad-81ce-4b58-9874-a6aadf984011 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:46.678748 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1752/3518] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:47.755815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c58e-7e6f-4aba-8d4d-43cb426edebf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:47.756340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c58e-7e6f-4aba-8d4d-43cb426edebf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:47.756521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c58e-7e6f-4aba-8d4d-43cb426edebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:47.817431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0ac7c58e-7e6f-4aba-8d4d-43cb426edebf None None] MFA Rules not processed for user `2ad64e15a95f4057bffb4e2af194ad08`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:26:47.818718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0ac7c58e-7e6f-4aba-8d4d-43cb426edebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:47.863321 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1767/3519] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:26:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:26:48.935262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aebfad-81ce-4b58-9874-a6aadf984011 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:26:48.937523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c9aebfad-81ce-4b58-9874-a6aadf984011 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:49.078302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aebfad-81ce-4b58-9874-a6aadf984011 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:26:49.085813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ab365-9a34-4037-a154-e47e818d156f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:26:49.086493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab365-9a34-4037-a154-e47e818d156f service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:26:49.087066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab365-9a34-4037-a154-e47e818d156f service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:26:49.087412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab365-9a34-4037-a154-e47e818d156f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:26:49.089474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a86ab365-9a34-4037-a154-e47e818d156f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:26:49.115033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ab365-9a34-4037-a154-e47e818d156f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:26:49.117728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ab365-9a34-4037-a154-e47e818d156f service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:26:49.132354 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1753/3520] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:26:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:26:57.806651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:59.125238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=72 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:05.168944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb77b6-fdea-4f63-991a-5bebec886997 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:05.169509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb77b6-fdea-4f63-991a-5bebec886997 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:05.169509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb77b6-fdea-4f63-991a-5bebec886997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:05.197218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-33cb77b6-fdea-4f63-991a-5bebec886997 None None] MFA Rules not processed for user `d7a12c873b724eb586098874f925791f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:05.199018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-33cb77b6-fdea-4f63-991a-5bebec886997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:05.261170 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1768/3521] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:13.389665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0816fd6-c5ae-4df4-a569-7ae1c38ec3ae None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:13.390327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0816fd6-c5ae-4df4-a569-7ae1c38ec3ae None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:13.390327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0816fd6-c5ae-4df4-a569-7ae1c38ec3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:13.412206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f0816fd6-c5ae-4df4-a569-7ae1c38ec3ae None None] MFA Rules not processed for user `2ad64e15a95f4057bffb4e2af194ad08`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:13.413772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f0816fd6-c5ae-4df4-a569-7ae1c38ec3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:13.425801 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1754/3522] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:15.253944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=25 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:19.923117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb77b6-fdea-4f63-991a-5bebec886997 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:19.955908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb77b6-fdea-4f63-991a-5bebec886997 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:19.982583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c80f23-51d5-4e64-9f71-918aa4ada1e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:19.985548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80f23-51d5-4e64-9f71-918aa4ada1e3 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:19.989562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80f23-51d5-4e64-9f71-918aa4ada1e3 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:19.992266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c80f23-51d5-4e64-9f71-918aa4ada1e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:19.997792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e6c80f23-51d5-4e64-9f71-918aa4ada1e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:20.142365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c80f23-51d5-4e64-9f71-918aa4ada1e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:20.144365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c80f23-51d5-4e64-9f71-918aa4ada1e3 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:20.156767 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1769/3523] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:23.406383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:24.704337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0816fd6-c5ae-4df4-a569-7ae1c38ec3ae None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:24.728736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0816fd6-c5ae-4df4-a569-7ae1c38ec3ae None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:24.746213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8058e-594d-49ac-8ff7-4a7ea0912f51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:24.747473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8058e-594d-49ac-8ff7-4a7ea0912f51 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:24.748221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8058e-594d-49ac-8ff7-4a7ea0912f51 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:24.748855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8058e-594d-49ac-8ff7-4a7ea0912f51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:24.753705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24e8058e-594d-49ac-8ff7-4a7ea0912f51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:24.781476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8058e-594d-49ac-8ff7-4a7ea0912f51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:24.785306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8058e-594d-49ac-8ff7-4a7ea0912f51 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:24.807014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c80f23-51d5-4e64-9f71-918aa4ada1e3 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:24.809442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e6c80f23-51d5-4e64-9f71-918aa4ada1e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:24.832069 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1755/3524] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:24.941218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c80f23-51d5-4e64-9f71-918aa4ada1e3 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:24.947227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:24.948171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:24.949184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:24.949618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] PATH_INFO: `/v3/users/77f2f19d1968440096cf91275a7a09e5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:24.982427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f2f19d1968440096cf91275a7a09e5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:24.991025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:25.127376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f2f19d1968440096cf91275a7a09e5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:25.128540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f2f19d1968440096cf91275a7a09e5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:25.138406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f2f19d1968440096cf91275a7a09e5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:25.156283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f2f19d1968440096cf91275a7a09e5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:25.176766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15211385-4a62-47ac-8724-83daab47375c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f2f19d1968440096cf91275a7a09e5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:25.188121 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1770/3525] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:27:24 2022] DELETE /identity/v3/users/77f2f19d1968440096cf91275a7a09e5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:25.479859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8058e-594d-49ac-8ff7-4a7ea0912f51 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:25.513637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8058e-594d-49ac-8ff7-4a7ea0912f51 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:25.676733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:25.685139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:25.685139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:25.685139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] PATH_INFO: `/v3/projects/3ce2bb4dbf3545d0ad98bbaab2139357` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:25.685139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce2bb4dbf3545d0ad98bbaab2139357)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:25.701074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:25.839559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce2bb4dbf3545d0ad98bbaab2139357', 'request_id': 'req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:25.860707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce2bb4dbf3545d0ad98bbaab2139357', 'request_id': 'req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:25.871203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce2bb4dbf3545d0ad98bbaab2139357', 'request_id': 'req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:25.883575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] The token cache is being invalidate because project 3ce2bb4dbf3545d0ad98bbaab2139357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:27:25.884064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:25.885538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3eb3525a-c624-4eb0-bb50-1bdf07ed3d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:25.887725 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1756/3526] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:27:25 2022] DELETE /identity/v3/projects/3ce2bb4dbf3545d0ad98bbaab2139357 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:25.895469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1e814-2971-4f97-b30c-c75cd1ce8b84 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:25.896956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1e814-2971-4f97-b30c-c75cd1ce8b84 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:25.897459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1e814-2971-4f97-b30c-c75cd1ce8b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:25.951024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-caa1e814-2971-4f97-b30c-c75cd1ce8b84 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:25.952734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-caa1e814-2971-4f97-b30c-c75cd1ce8b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:25.986647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:26.070053 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1771/3527] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:26.076184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edda75-8a0c-40a2-aba1-02c45bd953f6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:26.076880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edda75-8a0c-40a2-aba1-02c45bd953f6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:26.077348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edda75-8a0c-40a2-aba1-02c45bd953f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:26.111205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-67edda75-8a0c-40a2-aba1-02c45bd953f6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:26.112447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-67edda75-8a0c-40a2-aba1-02c45bd953f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:26.121508 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1757/3528] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:26.127119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1e814-2971-4f97-b30c-c75cd1ce8b84 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:26.158924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1e814-2971-4f97-b30c-c75cd1ce8b84 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:26.165150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15510c18-9556-421d-8840-6f3369d69abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:26.166203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15510c18-9556-421d-8840-6f3369d69abd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:26.166647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15510c18-9556-421d-8840-6f3369d69abd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:26.167078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15510c18-9556-421d-8840-6f3369d69abd admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:26.169923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15510c18-9556-421d-8840-6f3369d69abd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:27:26.169923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15510c18-9556-421d-8840-6f3369d69abd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:26.171088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15510c18-9556-421d-8840-6f3369d69abd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:26.190587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edda75-8a0c-40a2-aba1-02c45bd953f6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:26.194433 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1772/3529] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:27:26.209836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67edda75-8a0c-40a2-aba1-02c45bd953f6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:26.217791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741eed7-d706-4ed2-bb67-ce4af1d38c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:26.218429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741eed7-d706-4ed2-bb67-ce4af1d38c2d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:26.218772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741eed7-d706-4ed2-bb67-ce4af1d38c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:26.219042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741eed7-d706-4ed2-bb67-ce4af1d38c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:26.219732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741eed7-d706-4ed2-bb67-ce4af1d38c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:26.221923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741eed7-d706-4ed2-bb67-ce4af1d38c2d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:26.256694 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1758/3530] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:27:26 2022] POST /identity/v3/projects => generated 395 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:27:26.261210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15510c18-9556-421d-8840-6f3369d69abd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:26.274462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15510c18-9556-421d-8840-6f3369d69abd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:26.367240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689597c-42ef-41ee-b6a0-1dc9797e24c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:26.367895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689597c-42ef-41ee-b6a0-1dc9797e24c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:26.368176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689597c-42ef-41ee-b6a0-1dc9797e24c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:26.368462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689597c-42ef-41ee-b6a0-1dc9797e24c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:26.369103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689597c-42ef-41ee-b6a0-1dc9797e24c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:26.371285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689597c-42ef-41ee-b6a0-1dc9797e24c3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:26.399005 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1773/3531] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:27:26 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:27:26.403235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741eed7-d706-4ed2-bb67-ce4af1d38c2d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:26.416417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741eed7-d706-4ed2-bb67-ce4af1d38c2d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:26.422221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7007a-85e4-4bb4-bee1-e3965ba4a426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:26.423123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7007a-85e4-4bb4-bee1-e3965ba4a426 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:26.428293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7007a-85e4-4bb4-bee1-e3965ba4a426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:26.428293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7007a-85e4-4bb4-bee1-e3965ba4a426 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:26.428293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7007a-85e4-4bb4-bee1-e3965ba4a426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:26.428293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7007a-85e4-4bb4-bee1-e3965ba4a426 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:26.439320 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1759/3532] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:27:26.445725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689597c-42ef-41ee-b6a0-1dc9797e24c3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:26.458540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689597c-42ef-41ee-b6a0-1dc9797e24c3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:26.464899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd60246-d302-41b6-97a5-d14e902a9c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:26.465631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60246-d302-41b6-97a5-d14e902a9c61 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:26.465953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60246-d302-41b6-97a5-d14e902a9c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:26.466234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd60246-d302-41b6-97a5-d14e902a9c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:26.467087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd60246-d302-41b6-97a5-d14e902a9c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:26.468879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd60246-d302-41b6-97a5-d14e902a9c61 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:26.487115 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1774/3533] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:27:26.491653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7007a-85e4-4bb4-bee1-e3965ba4a426 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:26.505026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7007a-85e4-4bb4-bee1-e3965ba4a426 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:26.513937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4f8f3-5566-4fb9-80ae-5546ead3baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:26.515841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f8f3-5566-4fb9-80ae-5546ead3baf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:26.516551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f8f3-5566-4fb9-80ae-5546ead3baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:26.516971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4f8f3-5566-4fb9-80ae-5546ead3baf6 admin admin] PATH_INFO: `/v3/projects/8829ad469628438b8f472ddbc176b2ee/users/42ddc65f782a4b20bba4980b53e62dcb/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:26.539372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4f8f3-5566-4fb9-80ae-5546ead3baf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8829ad469628438b8f472ddbc176b2ee, user_id=42ddc65f782a4b20bba4980b53e62dcb, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:26.542456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4f8f3-5566-4fb9-80ae-5546ead3baf6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:26.570171 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1760/3534] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:27:26 2022] PUT /identity/v3/projects/8829ad469628438b8f472ddbc176b2ee/users/42ddc65f782a4b20bba4980b53e62dcb/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:26.572467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6f50-b8cf-4c17-af22-fc93c0ec5357 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:26.572778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6f50-b8cf-4c17-af22-fc93c0ec5357 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:26.573109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d6f50-b8cf-4c17-af22-fc93c0ec5357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:26.603915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8d4d6f50-b8cf-4c17-af22-fc93c0ec5357 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:26.605501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8d4d6f50-b8cf-4c17-af22-fc93c0ec5357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:26.733767 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1775/3535] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:26.748994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4f8f3-5566-4fb9-80ae-5546ead3baf6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:26.751948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-beb4f8f3-5566-4fb9-80ae-5546ead3baf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:26.773587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:26.864716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4f8f3-5566-4fb9-80ae-5546ead3baf6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:26.868588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85722dba-3d33-47b6-9166-9f7e57dbc970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:26.869225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85722dba-3d33-47b6-9166-9f7e57dbc970 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:26.869685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85722dba-3d33-47b6-9166-9f7e57dbc970 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:26.870004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85722dba-3d33-47b6-9166-9f7e57dbc970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:26.882789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85722dba-3d33-47b6-9166-9f7e57dbc970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:26.884675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85722dba-3d33-47b6-9166-9f7e57dbc970 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:26.901486 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1761/3536] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:30.623706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14e533-ebf4-43f8-ba88-7cafef193635 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:30.624301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14e533-ebf4-43f8-ba88-7cafef193635 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:30.624397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14e533-ebf4-43f8-ba88-7cafef193635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:30.652693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-da14e533-ebf4-43f8-ba88-7cafef193635 None None] MFA Rules not processed for user `358a4edea635469d9a9f64e941b6ed53`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:30.655146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-da14e533-ebf4-43f8-ba88-7cafef193635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:30.681029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:30.756227 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1776/3537] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:30.928997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745edad0-fec4-4f2e-bece-53dcc9f0d387 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:30.929562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745edad0-fec4-4f2e-bece-53dcc9f0d387 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:30.929562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745edad0-fec4-4f2e-bece-53dcc9f0d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:31.007479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-745edad0-fec4-4f2e-bece-53dcc9f0d387 None None] MFA Rules not processed for user `d7a12c873b724eb586098874f925791f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:31.013373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-745edad0-fec4-4f2e-bece-53dcc9f0d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:31.148375 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1762/3538] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:32.826974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba99a-d1a4-48ff-b43f-e6f1d7879bcc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:32.827531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba99a-d1a4-48ff-b43f-e6f1d7879bcc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:32.827531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aba99a-d1a4-48ff-b43f-e6f1d7879bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:32.902933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-95aba99a-d1a4-48ff-b43f-e6f1d7879bcc None None] MFA Rules not processed for user `42ddc65f782a4b20bba4980b53e62dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:32.904230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-95aba99a-d1a4-48ff-b43f-e6f1d7879bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:33.073898 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1777/3539] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:33.086683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fdde6-4a04-4634-9212-c0c5e9f0215e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:33.087715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fdde6-4a04-4634-9212-c0c5e9f0215e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:33.088917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fdde6-4a04-4634-9212-c0c5e9f0215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:33.163562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cb7fdde6-4a04-4634-9212-c0c5e9f0215e None None] MFA Rules not processed for user `42ddc65f782a4b20bba4980b53e62dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:33.173912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cb7fdde6-4a04-4634-9212-c0c5e9f0215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:33.194785 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1763/3540] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:33.664902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aba99a-d1a4-48ff-b43f-e6f1d7879bcc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:33.667867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-95aba99a-d1a4-48ff-b43f-e6f1d7879bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:33.846523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aba99a-d1a4-48ff-b43f-e6f1d7879bcc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:33.860029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041be965-b979-4351-85bc-8d0940af6e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:33.860977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041be965-b979-4351-85bc-8d0940af6e6b service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:33.862299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041be965-b979-4351-85bc-8d0940af6e6b service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:33.864314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041be965-b979-4351-85bc-8d0940af6e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:33.904739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041be965-b979-4351-85bc-8d0940af6e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:33.907885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041be965-b979-4351-85bc-8d0940af6e6b service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:33.939476 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1778/3541] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:33 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:36.832092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fdde6-4a04-4634-9212-c0c5e9f0215e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:36.835306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cb7fdde6-4a04-4634-9212-c0c5e9f0215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:36.878897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fdde6-4a04-4634-9212-c0c5e9f0215e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:36.901301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:36.902777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:36.903069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:36.904268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] PATH_INFO: `/v3/users/fc376020ea1f4826b3c873b8945cb8a3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:36.908819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc376020ea1f4826b3c873b8945cb8a3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:36.911547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:36.945612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19368b-ee15-4731-8c1d-d91b604ff9cb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:36.946248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19368b-ee15-4731-8c1d-d91b604ff9cb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:36.946248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19368b-ee15-4731-8c1d-d91b604ff9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:37.016997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc376020ea1f4826b3c873b8945cb8a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:37.028908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-dc19368b-ee15-4731-8c1d-d91b604ff9cb None None] MFA Rules not processed for user `2e944e3030a1404c9862d953fedfb94a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:37.031467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc376020ea1f4826b3c873b8945cb8a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:37.034285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dc19368b-ee15-4731-8c1d-d91b604ff9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:37.061082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc376020ea1f4826b3c873b8945cb8a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:37.078004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc376020ea1f4826b3c873b8945cb8a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:37.079160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc376020ea1f4826b3c873b8945cb8a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:37.091845 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1764/3542] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:27:36 2022] DELETE /identity/v3/users/fc376020ea1f4826b3c873b8945cb8a3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:37.120697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:37.150308 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1779/3543] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:38.634371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:38.637237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:38.702203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:38.805125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b775ab8-2dec-4f67-ae04-ccda9375b357 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:38.811290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:38.812485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:38.812914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:38.814291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] PATH_INFO: `/v3/projects/270c2560a18d4d329ef45c1305706d05` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:38.815765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270c2560a18d4d329ef45c1305706d05)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:38.818744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:38.966777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270c2560a18d4d329ef45c1305706d05', 'request_id': 'req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:38.983150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270c2560a18d4d329ef45c1305706d05', 'request_id': 'req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:38.992622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270c2560a18d4d329ef45c1305706d05', 'request_id': 'req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:39.006027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] The token cache is being invalidate because project 270c2560a18d4d329ef45c1305706d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:27:39.006326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:39.007065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ebbccdf6-aaff-44dd-9500-7e6efcbac8c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:39.009896 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1765/3544] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:27:38 2022] DELETE /identity/v3/projects/270c2560a18d4d329ef45c1305706d05 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:39.014636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e159667-3e5b-4279-8bf5-6216f8adc4d6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:39.015566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e159667-3e5b-4279-8bf5-6216f8adc4d6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:39.015983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e159667-3e5b-4279-8bf5-6216f8adc4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:39.041663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2e159667-3e5b-4279-8bf5-6216f8adc4d6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:39.043426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2e159667-3e5b-4279-8bf5-6216f8adc4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:39.145184 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1780/3545] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:39.153608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd65bb-e098-4ca2-b1c4-125ca614446a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:39.153928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd65bb-e098-4ca2-b1c4-125ca614446a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:39.154186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd65bb-e098-4ca2-b1c4-125ca614446a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:39.188513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-47cd65bb-e098-4ca2-b1c4-125ca614446a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:39.190446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-47cd65bb-e098-4ca2-b1c4-125ca614446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:39.211051 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1766/3546] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:39.215547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e159667-3e5b-4279-8bf5-6216f8adc4d6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:39.228780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e159667-3e5b-4279-8bf5-6216f8adc4d6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:39.241994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe432f-5bca-4402-8e87-0f261353d659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:39.242662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe432f-5bca-4402-8e87-0f261353d659 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:39.242941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe432f-5bca-4402-8e87-0f261353d659 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:39.243212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe432f-5bca-4402-8e87-0f261353d659 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:39.243895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe432f-5bca-4402-8e87-0f261353d659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:27:39.244198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe432f-5bca-4402-8e87-0f261353d659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:39.245952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe432f-5bca-4402-8e87-0f261353d659 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:39.274897 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1781/3547] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:27:39.278606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd65bb-e098-4ca2-b1c4-125ca614446a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:39.289804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd65bb-e098-4ca2-b1c4-125ca614446a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:39.298113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed18881-3f48-47de-b9b8-f89b64fc7af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:39.299789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed18881-3f48-47de-b9b8-f89b64fc7af2 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:39.299789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed18881-3f48-47de-b9b8-f89b64fc7af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:39.299789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed18881-3f48-47de-b9b8-f89b64fc7af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:39.304010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed18881-3f48-47de-b9b8-f89b64fc7af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:39.307049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed18881-3f48-47de-b9b8-f89b64fc7af2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:39.384099 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1767/3548] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:27:39 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:27:39.384499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe432f-5bca-4402-8e87-0f261353d659 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:39.400882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe432f-5bca-4402-8e87-0f261353d659 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:39.540618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71835d22-79f0-47e8-b1d7-14cf6f426ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:39.541230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71835d22-79f0-47e8-b1d7-14cf6f426ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:39.541509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71835d22-79f0-47e8-b1d7-14cf6f426ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:39.541777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71835d22-79f0-47e8-b1d7-14cf6f426ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:39.545721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71835d22-79f0-47e8-b1d7-14cf6f426ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:39.567065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71835d22-79f0-47e8-b1d7-14cf6f426ba2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:39.621425 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1782/3549] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:27:39 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:27:39.628470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed18881-3f48-47de-b9b8-f89b64fc7af2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:39.642153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed18881-3f48-47de-b9b8-f89b64fc7af2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:39.650191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8776af6-a1bc-4b0c-b1da-5578d8f1d9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:39.650818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776af6-a1bc-4b0c-b1da-5578d8f1d9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:39.651241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776af6-a1bc-4b0c-b1da-5578d8f1d9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:39.651519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8776af6-a1bc-4b0c-b1da-5578d8f1d9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:39.652170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8776af6-a1bc-4b0c-b1da-5578d8f1d9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:39.654151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8776af6-a1bc-4b0c-b1da-5578d8f1d9e0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:39.669975 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1768/3550] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:27:39.671703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71835d22-79f0-47e8-b1d7-14cf6f426ba2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:39.686407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71835d22-79f0-47e8-b1d7-14cf6f426ba2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:39.691622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e250f-f1a9-4c2b-b242-4ab58f80f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:39.692323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e250f-f1a9-4c2b-b242-4ab58f80f0eb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:39.692610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e250f-f1a9-4c2b-b242-4ab58f80f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:39.692878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e250f-f1a9-4c2b-b242-4ab58f80f0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:39.693529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e250f-f1a9-4c2b-b242-4ab58f80f0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:39.695179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e250f-f1a9-4c2b-b242-4ab58f80f0eb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:39.710114 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1783/3551] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:27:39.711535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8776af6-a1bc-4b0c-b1da-5578d8f1d9e0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:39.722506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8776af6-a1bc-4b0c-b1da-5578d8f1d9e0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:39.727455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308e0b4-8bda-4595-85b2-6ba0897119a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:39.728179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e0b4-8bda-4595-85b2-6ba0897119a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:39.728540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e0b4-8bda-4595-85b2-6ba0897119a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:39.728872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308e0b4-8bda-4595-85b2-6ba0897119a1 admin admin] PATH_INFO: `/v3/projects/ece50677177d47d285da56e43e3e2837/users/82cee6782fad4147a19b38ed71949732/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:39.745502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308e0b4-8bda-4595-85b2-6ba0897119a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece50677177d47d285da56e43e3e2837, user_id=82cee6782fad4147a19b38ed71949732, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:39.748275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308e0b4-8bda-4595-85b2-6ba0897119a1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:39.777688 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1769/3552] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:27:39 2022] PUT /identity/v3/projects/ece50677177d47d285da56e43e3e2837/users/82cee6782fad4147a19b38ed71949732/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:39.783128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e4d4-da0d-47c5-b41c-617397f2acd2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:39.783442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e4d4-da0d-47c5-b41c-617397f2acd2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:39.783713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818e4d4-da0d-47c5-b41c-617397f2acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:39.807132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9818e4d4-da0d-47c5-b41c-617397f2acd2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:39.808308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9818e4d4-da0d-47c5-b41c-617397f2acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:39.863474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:39.876834 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1784/3553] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:27:39.888574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308e0b4-8bda-4595-85b2-6ba0897119a1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:39.890958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3308e0b4-8bda-4595-85b2-6ba0897119a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:39.953669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308e0b4-8bda-4595-85b2-6ba0897119a1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:39.957725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fb360-cc61-407b-bcc9-bdf9508e4344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:39.958468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fb360-cc61-407b-bcc9-bdf9508e4344 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:39.958872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fb360-cc61-407b-bcc9-bdf9508e4344 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:39.959148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fb360-cc61-407b-bcc9-bdf9508e4344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:39.966541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:39.969352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fb360-cc61-407b-bcc9-bdf9508e4344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:39.970877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fb360-cc61-407b-bcc9-bdf9508e4344 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:39.981632 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1770/3554] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:40.231060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e4d4-da0d-47c5-b41c-617397f2acd2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:40.233746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9818e4d4-da0d-47c5-b41c-617397f2acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:40.254706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818e4d4-da0d-47c5-b41c-617397f2acd2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:40.264791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:40.266530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:40.268891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:40.269360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] PATH_INFO: `/v3/users/df89d9f07dce4db2867c5abc3385a409` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:40.272277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df89d9f07dce4db2867c5abc3385a409)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:40.283726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:40.310995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fb360-cc61-407b-bcc9-bdf9508e4344 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:40.311584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-411fb360-cc61-407b-bcc9-bdf9508e4344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:40.388086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df89d9f07dce4db2867c5abc3385a409'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:40.390295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df89d9f07dce4db2867c5abc3385a409'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:40.412992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df89d9f07dce4db2867c5abc3385a409'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:40.432506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df89d9f07dce4db2867c5abc3385a409'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:40.457343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2e7f0234-7513-4774-8b7f-1a3b16813b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df89d9f07dce4db2867c5abc3385a409'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:40.468799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fb360-cc61-407b-bcc9-bdf9508e4344 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:40.471164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1785/3555] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:27:40 2022] DELETE /identity/v3/users/df89d9f07dce4db2867c5abc3385a409 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:40.476948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a81c58-2b65-4255-8bd0-073855b1ad92 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:40.477315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a81c58-2b65-4255-8bd0-073855b1ad92 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:40.477591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a81c58-2b65-4255-8bd0-073855b1ad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:40.520247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-22a81c58-2b65-4255-8bd0-073855b1ad92 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:40.522257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-22a81c58-2b65-4255-8bd0-073855b1ad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:40.659240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f087f-5be7-4f73-b3ba-03465ab7d457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:40.660032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f087f-5be7-4f73-b3ba-03465ab7d457 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:40.660403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f087f-5be7-4f73-b3ba-03465ab7d457 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:40.660763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f087f-5be7-4f73-b3ba-03465ab7d457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:40.667541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ec2f087f-5be7-4f73-b3ba-03465ab7d457 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:40.682168 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1786/3556] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:40.700332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a81c58-2b65-4255-8bd0-073855b1ad92 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:40.702157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-22a81c58-2b65-4255-8bd0-073855b1ad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:40.800817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f087f-5be7-4f73-b3ba-03465ab7d457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:40.803816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f087f-5be7-4f73-b3ba-03465ab7d457 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:40.826101 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1771/3557] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:40.852749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a81c58-2b65-4255-8bd0-073855b1ad92 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:40.861359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176204e7-16df-4a83-97f0-27b1506aced6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:40.862225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176204e7-16df-4a83-97f0-27b1506aced6 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:40.862594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176204e7-16df-4a83-97f0-27b1506aced6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:40.863584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176204e7-16df-4a83-97f0-27b1506aced6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:40.888828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176204e7-16df-4a83-97f0-27b1506aced6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:40.890424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176204e7-16df-4a83-97f0-27b1506aced6 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:40.935661 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1787/3558] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:27:43.261897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f087f-5be7-4f73-b3ba-03465ab7d457 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:43.264817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ec2f087f-5be7-4f73-b3ba-03465ab7d457 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:43.295543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f087f-5be7-4f73-b3ba-03465ab7d457 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:43.314285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:43.315211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:43.315673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:43.316094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] PATH_INFO: `/v3/projects/ff53cc1e4ac74cdeb36165f3a11a99cb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:43.317722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff53cc1e4ac74cdeb36165f3a11a99cb)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:43.319971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:43.408283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:43.471638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff53cc1e4ac74cdeb36165f3a11a99cb', 'request_id': 'req-b2d516ce-2c7c-4924-bd57-d0107832479c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:43.489718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff53cc1e4ac74cdeb36165f3a11a99cb', 'request_id': 'req-b2d516ce-2c7c-4924-bd57-d0107832479c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:43.502547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff53cc1e4ac74cdeb36165f3a11a99cb', 'request_id': 'req-b2d516ce-2c7c-4924-bd57-d0107832479c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:43.532727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] The token cache is being invalidate because project ff53cc1e4ac74cdeb36165f3a11a99cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:27:43.533430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:43.534505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2d516ce-2c7c-4924-bd57-d0107832479c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:27:43.536581 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1772/3559] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:27:43 2022] DELETE /identity/v3/projects/ff53cc1e4ac74cdeb36165f3a11a99cb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:27:43.542305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33709db5-004c-4e13-8ad1-43041840442f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:43.543725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33709db5-004c-4e13-8ad1-43041840442f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:43.544185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33709db5-004c-4e13-8ad1-43041840442f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:43.580411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-33709db5-004c-4e13-8ad1-43041840442f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:43.581180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-33709db5-004c-4e13-8ad1-43041840442f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:43.591641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:43.746402 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1788/3560] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:43.760943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0425a-3f29-4dd0-a677-a3d573a9cc7b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:43.761662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0425a-3f29-4dd0-a677-a3d573a9cc7b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:43.762162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0425a-3f29-4dd0-a677-a3d573a9cc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:43.801775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8ed0425a-3f29-4dd0-a677-a3d573a9cc7b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:43.805660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8ed0425a-3f29-4dd0-a677-a3d573a9cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:43.817807 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1773/3561] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:43.821955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33709db5-004c-4e13-8ad1-43041840442f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:43.838189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33709db5-004c-4e13-8ad1-43041840442f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:43.850568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81755c-d0f4-40d6-9374-b82015491286 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:43.851801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81755c-d0f4-40d6-9374-b82015491286 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:43.852238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81755c-d0f4-40d6-9374-b82015491286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:43.858969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8c6a4-accb-4778-9a3e-61f0a3022e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:43.859757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8c6a4-accb-4778-9a3e-61f0a3022e3c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:43.860054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8c6a4-accb-4778-9a3e-61f0a3022e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:43.860386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8c6a4-accb-4778-9a3e-61f0a3022e3c admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:43.861063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8c6a4-accb-4778-9a3e-61f0a3022e3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:27:43.861387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8c6a4-accb-4778-9a3e-61f0a3022e3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:43.863133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8c6a4-accb-4778-9a3e-61f0a3022e3c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:43.897218 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1789/3562] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:27:43.902397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8c6a4-accb-4778-9a3e-61f0a3022e3c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:43.907835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6f81755c-d0f4-40d6-9374-b82015491286 None None] MFA Rules not processed for user `358a4edea635469d9a9f64e941b6ed53`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:43.909099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f81755c-d0f4-40d6-9374-b82015491286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:43.924184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8c6a4-accb-4778-9a3e-61f0a3022e3c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:43.937015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4ea63-b679-4a5e-8256-63e531b08cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:43.938250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4ea63-b679-4a5e-8256-63e531b08cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:43.940969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4ea63-b679-4a5e-8256-63e531b08cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:43.941437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4ea63-b679-4a5e-8256-63e531b08cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:43.942294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4ea63-b679-4a5e-8256-63e531b08cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:43.944468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4ea63-b679-4a5e-8256-63e531b08cc6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:43.998251 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1790/3563] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:27:43 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:27:44.002555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4ea63-b679-4a5e-8256-63e531b08cc6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:44.086885 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1774/3564] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:44.174395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4ea63-b679-4a5e-8256-63e531b08cc6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:44.186591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1455c-5bfe-4b7e-a40f-7d04585cbe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:44.188138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1455c-5bfe-4b7e-a40f-7d04585cbe18 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:44.188405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1455c-5bfe-4b7e-a40f-7d04585cbe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:44.188677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1455c-5bfe-4b7e-a40f-7d04585cbe18 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:44.189328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1455c-5bfe-4b7e-a40f-7d04585cbe18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:44.191312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1455c-5bfe-4b7e-a40f-7d04585cbe18 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:44.261246 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1791/3565] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:27:44 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:27:44.265905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81755c-d0f4-40d6-9374-b82015491286 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:44.300267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81755c-d0f4-40d6-9374-b82015491286 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:44.326125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef29fb-249c-4cb8-b3f4-dba48beec93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:44.328434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef29fb-249c-4cb8-b3f4-dba48beec93e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:44.328836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef29fb-249c-4cb8-b3f4-dba48beec93e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:44.329902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef29fb-249c-4cb8-b3f4-dba48beec93e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:44.332775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef29fb-249c-4cb8-b3f4-dba48beec93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:44.336033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef29fb-249c-4cb8-b3f4-dba48beec93e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:44.356649 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1775/3566] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:27:44.360748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1455c-5bfe-4b7e-a40f-7d04585cbe18 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:44.373025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1455c-5bfe-4b7e-a40f-7d04585cbe18 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:44.378270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365a086-0350-42e3-8752-3eae611d2aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:44.378895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a086-0350-42e3-8752-3eae611d2aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:44.379168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a086-0350-42e3-8752-3eae611d2aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:44.379432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365a086-0350-42e3-8752-3eae611d2aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:44.380102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365a086-0350-42e3-8752-3eae611d2aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:44.382656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365a086-0350-42e3-8752-3eae611d2aa9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:44.396128 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1792/3567] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:27:44.399978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef29fb-249c-4cb8-b3f4-dba48beec93e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:44.418778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef29fb-249c-4cb8-b3f4-dba48beec93e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:44.431877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628e42-d6e2-4799-9e85-1ae683bf0605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:44.432859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628e42-d6e2-4799-9e85-1ae683bf0605 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:44.433513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628e42-d6e2-4799-9e85-1ae683bf0605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:44.434035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f628e42-d6e2-4799-9e85-1ae683bf0605 admin admin] PATH_INFO: `/v3/projects/b3f861d097e740d7b9715eea23a4737f/users/9a950251fb8644ec807a403a7e5cc53b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:44.454878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f628e42-d6e2-4799-9e85-1ae683bf0605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f861d097e740d7b9715eea23a4737f, user_id=9a950251fb8644ec807a403a7e5cc53b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:44.462352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f628e42-d6e2-4799-9e85-1ae683bf0605 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:44.480693 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1776/3568] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:27:44 2022] PUT /identity/v3/projects/b3f861d097e740d7b9715eea23a4737f/users/9a950251fb8644ec807a403a7e5cc53b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:27:44.486083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d8422-90dc-4480-8442-e4b9eb1b53df None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:44.486543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d8422-90dc-4480-8442-e4b9eb1b53df None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:44.486883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d8422-90dc-4480-8442-e4b9eb1b53df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:44.512605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-760d8422-90dc-4480-8442-e4b9eb1b53df None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:44.514143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-760d8422-90dc-4480-8442-e4b9eb1b53df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:44.582182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:44.619034 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1793/3569] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:44.647406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628e42-d6e2-4799-9e85-1ae683bf0605 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:44.649206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0f628e42-d6e2-4799-9e85-1ae683bf0605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:44.798773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f628e42-d6e2-4799-9e85-1ae683bf0605 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:44.803892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f0853-ef79-41ae-9894-27ef6fef832d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:44.804522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f0853-ef79-41ae-9894-27ef6fef832d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:44.804801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f0853-ef79-41ae-9894-27ef6fef832d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:44.805068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f0853-ef79-41ae-9894-27ef6fef832d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:44.817082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f0853-ef79-41ae-9894-27ef6fef832d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:44.818290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f0853-ef79-41ae-9894-27ef6fef832d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:44.845613 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1777/3570] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:49.227815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29487-69de-4dd1-b9fa-59d943b4e37f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:49.228551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29487-69de-4dd1-b9fa-59d943b4e37f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:49.228551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29487-69de-4dd1-b9fa-59d943b4e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:49.261476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fcd29487-69de-4dd1-b9fa-59d943b4e37f None None] MFA Rules not processed for user `82cee6782fad4147a19b38ed71949732`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:49.262719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fcd29487-69de-4dd1-b9fa-59d943b4e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:49.347641 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1794/3571] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:49.357420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ea626-dae1-429e-8527-eb9fa7be2bc8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:49.357916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ea626-dae1-429e-8527-eb9fa7be2bc8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:49.358044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ea626-dae1-429e-8527-eb9fa7be2bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:49.407211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9f2ea626-dae1-429e-8527-eb9fa7be2bc8 None None] MFA Rules not processed for user `82cee6782fad4147a19b38ed71949732`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:49.409677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9f2ea626-dae1-429e-8527-eb9fa7be2bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:49.428651 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1778/3572] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:49.618289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29487-69de-4dd1-b9fa-59d943b4e37f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:49.620866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fcd29487-69de-4dd1-b9fa-59d943b4e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:49.773524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29487-69de-4dd1-b9fa-59d943b4e37f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:49.780517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622cba1-0040-47fa-9cf7-0f358c26ec76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:49.782077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622cba1-0040-47fa-9cf7-0f358c26ec76 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:49.782211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622cba1-0040-47fa-9cf7-0f358c26ec76 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:49.782442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622cba1-0040-47fa-9cf7-0f358c26ec76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:49.796241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622cba1-0040-47fa-9cf7-0f358c26ec76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:49.800882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622cba1-0040-47fa-9cf7-0f358c26ec76 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:49.813655 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1795/3573] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:27:52.563340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a607-cea9-41cd-b719-7e1a314b5b27 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:52.563771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a607-cea9-41cd-b719-7e1a314b5b27 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:52.563771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a607-cea9-41cd-b719-7e1a314b5b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:52.594288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9210a607-cea9-41cd-b719-7e1a314b5b27 None None] MFA Rules not processed for user `d7a12c873b724eb586098874f925791f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:52.595771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9210a607-cea9-41cd-b719-7e1a314b5b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:52.610697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:52.768922 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1779/3574] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:27:58.433208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ce7c-beb5-4d73-ad77-ae0870db7a22 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:58.434279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ce7c-beb5-4d73-ad77-ae0870db7a22 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:58.434576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531ce7c-beb5-4d73-ad77-ae0870db7a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:58.479251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c531ce7c-beb5-4d73-ad77-ae0870db7a22 None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:58.479251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c531ce7c-beb5-4d73-ad77-ae0870db7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:58.574838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:58.590441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03e31d-2779-450d-9349-74cf2a913d81 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:58.590989 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1796/3575] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:27:58.591426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03e31d-2779-450d-9349-74cf2a913d81 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:58.591704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03e31d-2779-450d-9349-74cf2a913d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:58.636860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7d03e31d-2779-450d-9349-74cf2a913d81 None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:27:58.643548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7d03e31d-2779-450d-9349-74cf2a913d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:27:58.675066 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1780/3576] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:27:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:27:59.116300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ce7c-beb5-4d73-ad77-ae0870db7a22 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:27:59.137741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531ce7c-beb5-4d73-ad77-ae0870db7a22 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:27:59.156364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadc5d2-d89c-4f38-89a4-d7816356dd7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:27:59.162177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadc5d2-d89c-4f38-89a4-d7816356dd7b service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:27:59.167327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadc5d2-d89c-4f38-89a4-d7816356dd7b service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:27:59.171757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadc5d2-d89c-4f38-89a4-d7816356dd7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:27:59.186234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadc5d2-d89c-4f38-89a4-d7816356dd7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:27:59.188528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadc5d2-d89c-4f38-89a4-d7816356dd7b service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:27:59.225164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1797/3577] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:27:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:28:08.619480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=24 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:09.195990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:16.401945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d2077-1149-41ac-b358-4beb1e206da7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:16.402546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d2077-1149-41ac-b358-4beb1e206da7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:16.402546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d2077-1149-41ac-b358-4beb1e206da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:16.425002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-133d2077-1149-41ac-b358-4beb1e206da7 None None] MFA Rules not processed for user `d7a12c873b724eb586098874f925791f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:28:16.426397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-133d2077-1149-41ac-b358-4beb1e206da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:16.435651 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1781/3578] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:28:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:28:18.398640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a9e01-7221-415e-9d0e-f1deaa26ea7c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:18.399253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a9e01-7221-415e-9d0e-f1deaa26ea7c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:18.399682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a9e01-7221-415e-9d0e-f1deaa26ea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:18.421491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-da4a9e01-7221-415e-9d0e-f1deaa26ea7c None None] MFA Rules not processed for user `358a4edea635469d9a9f64e941b6ed53`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:28:18.423206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-da4a9e01-7221-415e-9d0e-f1deaa26ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:18.513130 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1798/3579] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:28:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:28:20.425511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cbbbe-92c8-4552-822e-285738e5df80 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:20.426092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cbbbe-92c8-4552-822e-285738e5df80 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:20.426092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cbbbe-92c8-4552-822e-285738e5df80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:20.485844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-200cbbbe-92c8-4552-822e-285738e5df80 None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:28:20.490261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-200cbbbe-92c8-4552-822e-285738e5df80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:20.524378 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1782/3580] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:28:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:28:28.504922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=25 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:30.474856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:32.676378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a9e01-7221-415e-9d0e-f1deaa26ea7c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:32.677807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-da4a9e01-7221-415e-9d0e-f1deaa26ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:32.697332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a9e01-7221-415e-9d0e-f1deaa26ea7c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:32.702925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:32.704411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:32.704895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:32.705234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] PATH_INFO: `/v3/users/82cee6782fad4147a19b38ed71949732` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:32.707182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cee6782fad4147a19b38ed71949732)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:32.709313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:32.787891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cee6782fad4147a19b38ed71949732'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:32.788910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cee6782fad4147a19b38ed71949732'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:32.817379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cee6782fad4147a19b38ed71949732'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:32.831579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cee6782fad4147a19b38ed71949732'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:32.858286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce8e2524-3c11-4019-9823-8803f3b4dd43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cee6782fad4147a19b38ed71949732'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:32.866607 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1799/3581] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:28:32 2022] DELETE /identity/v3/users/82cee6782fad4147a19b38ed71949732 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:28:33.089122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cbbbe-92c8-4552-822e-285738e5df80 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:33.102196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cbbbe-92c8-4552-822e-285738e5df80 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:33.169928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:33.172328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:33.172515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:33.172797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] PATH_INFO: `/v3/projects/ece50677177d47d285da56e43e3e2837` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:33.174291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece50677177d47d285da56e43e3e2837)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:33.177908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:33.272416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece50677177d47d285da56e43e3e2837', 'request_id': 'req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:33.295837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece50677177d47d285da56e43e3e2837', 'request_id': 'req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:33.304574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece50677177d47d285da56e43e3e2837', 'request_id': 'req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:33.318819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] The token cache is being invalidate because project ece50677177d47d285da56e43e3e2837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:28:33.319058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:33.320289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d14875c-7fdc-467b-ae4d-feb88ed70ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:28:33.325387 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1783/3582] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:28:33 2022] DELETE /identity/v3/projects/ece50677177d47d285da56e43e3e2837 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:28:33.327163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2e77a-16d3-4749-9ca7-4f53172e2516 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:33.327447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2e77a-16d3-4749-9ca7-4f53172e2516 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:33.327793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2e77a-16d3-4749-9ca7-4f53172e2516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:33.349301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bec2e77a-16d3-4749-9ca7-4f53172e2516 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:28:33.350992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bec2e77a-16d3-4749-9ca7-4f53172e2516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:33.419421 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1800/3583] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:28:33.429134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d289b-e236-4d6f-9a69-7cab9717673a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:33.429418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d289b-e236-4d6f-9a69-7cab9717673a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:33.429737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d289b-e236-4d6f-9a69-7cab9717673a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:33.455899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-406d289b-e236-4d6f-9a69-7cab9717673a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:28:33.457361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-406d289b-e236-4d6f-9a69-7cab9717673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:33.470113 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1784/3584] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:28:33.471524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2e77a-16d3-4749-9ca7-4f53172e2516 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:33.482400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2e77a-16d3-4749-9ca7-4f53172e2516 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:33.487764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3f56-d1f0-4092-ad27-06ccb7f79a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:33.488415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3f56-d1f0-4092-ad27-06ccb7f79a32 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:33.488693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3f56-d1f0-4092-ad27-06ccb7f79a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:33.488962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3f56-d1f0-4092-ad27-06ccb7f79a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:33.489640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3f56-d1f0-4092-ad27-06ccb7f79a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:28:33.489982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3f56-d1f0-4092-ad27-06ccb7f79a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:33.491676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3f56-d1f0-4092-ad27-06ccb7f79a32 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:33.505778 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1801/3585] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:28:33.510438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d289b-e236-4d6f-9a69-7cab9717673a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:33.521368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d289b-e236-4d6f-9a69-7cab9717673a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:33.527351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a59a7b-7c1a-4442-8171-f318d9663940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:33.528112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a59a7b-7c1a-4442-8171-f318d9663940 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:33.528381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a59a7b-7c1a-4442-8171-f318d9663940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:33.528713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a59a7b-7c1a-4442-8171-f318d9663940 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:33.529630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a59a7b-7c1a-4442-8171-f318d9663940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:33.532534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a59a7b-7c1a-4442-8171-f318d9663940 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:33.561908 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1785/3586] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:28:33 2022] POST /identity/v3/projects => generated 397 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:28:33.566684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3f56-d1f0-4092-ad27-06ccb7f79a32 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:33.578128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3f56-d1f0-4092-ad27-06ccb7f79a32 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:33.652470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528dc3c-29bb-49ec-8c3a-55fe88ef02d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:33.653072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528dc3c-29bb-49ec-8c3a-55fe88ef02d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:33.653351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528dc3c-29bb-49ec-8c3a-55fe88ef02d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:33.653621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528dc3c-29bb-49ec-8c3a-55fe88ef02d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:33.654442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528dc3c-29bb-49ec-8c3a-55fe88ef02d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:33.656603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528dc3c-29bb-49ec-8c3a-55fe88ef02d0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:33.665083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:33.687143 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1802/3587] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:28:33 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:28:33.692248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a59a7b-7c1a-4442-8171-f318d9663940 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:33.703415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a59a7b-7c1a-4442-8171-f318d9663940 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:33.709835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540782a2-95e1-40b5-a63c-1d8ffb36a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:33.710744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540782a2-95e1-40b5-a63c-1d8ffb36a201 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:33.711163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540782a2-95e1-40b5-a63c-1d8ffb36a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:33.711571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540782a2-95e1-40b5-a63c-1d8ffb36a201 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:33.712564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540782a2-95e1-40b5-a63c-1d8ffb36a201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:33.714588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540782a2-95e1-40b5-a63c-1d8ffb36a201 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:33.725738 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1786/3588] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:28:33.730146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528dc3c-29bb-49ec-8c3a-55fe88ef02d0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:33.745237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528dc3c-29bb-49ec-8c3a-55fe88ef02d0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:33.751972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b65e3-1cf7-49b8-a7a9-4452f4e770f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:33.752589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b65e3-1cf7-49b8-a7a9-4452f4e770f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:33.752865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b65e3-1cf7-49b8-a7a9-4452f4e770f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:33.753133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b65e3-1cf7-49b8-a7a9-4452f4e770f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:33.753777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b65e3-1cf7-49b8-a7a9-4452f4e770f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:33.755882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b65e3-1cf7-49b8-a7a9-4452f4e770f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:33.768851 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1803/3589] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:28:33.773700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540782a2-95e1-40b5-a63c-1d8ffb36a201 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:33.785776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540782a2-95e1-40b5-a63c-1d8ffb36a201 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:33.792397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1f5c3-d6ce-456f-8269-ce37d4657b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:33.792397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f5c3-d6ce-456f-8269-ce37d4657b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:33.792698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f5c3-d6ce-456f-8269-ce37d4657b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:33.792968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1f5c3-d6ce-456f-8269-ce37d4657b21 admin admin] PATH_INFO: `/v3/projects/65ca3e1ed56b4da5aefd0ead35f8f04e/users/488faff83ce040d09275cd674bc9a7dc/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:33.812940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1f5c3-d6ce-456f-8269-ce37d4657b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ca3e1ed56b4da5aefd0ead35f8f04e, user_id=488faff83ce040d09275cd674bc9a7dc, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:33.820123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1f5c3-d6ce-456f-8269-ce37d4657b21 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:33.839046 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1787/3590] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:28:33 2022] PUT /identity/v3/projects/65ca3e1ed56b4da5aefd0ead35f8f04e/users/488faff83ce040d09275cd674bc9a7dc/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:28:33.844781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f6b60-8fcb-434c-894c-376c794b9d04 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:33.845091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f6b60-8fcb-434c-894c-376c794b9d04 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:33.845454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f6b60-8fcb-434c-894c-376c794b9d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:33.870365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9a9f6b60-8fcb-434c-894c-376c794b9d04 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:28:33.871524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9a9f6b60-8fcb-434c-894c-376c794b9d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:33.946297 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1804/3591] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:28:33.956410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1f5c3-d6ce-456f-8269-ce37d4657b21 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:33.958457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7cb1f5c3-d6ce-456f-8269-ce37d4657b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:33.999581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:34.039230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1f5c3-d6ce-456f-8269-ce37d4657b21 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:34.046401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2244e-803e-4164-b496-976e53fed6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:34.047234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2244e-803e-4164-b496-976e53fed6cf service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:34.047428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2244e-803e-4164-b496-976e53fed6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:34.048099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2244e-803e-4164-b496-976e53fed6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:34.066842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2244e-803e-4164-b496-976e53fed6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:34.069098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2244e-803e-4164-b496-976e53fed6cf service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:34.091505 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1788/3592] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:28:38.253039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f6b60-8fcb-434c-894c-376c794b9d04 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:38.255697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9a9f6b60-8fcb-434c-894c-376c794b9d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:38.279775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f6b60-8fcb-434c-894c-376c794b9d04 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:38.300419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c34d4b-003f-4ef2-b3ce-33d876824480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:38.301544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c34d4b-003f-4ef2-b3ce-33d876824480 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:38.301836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c34d4b-003f-4ef2-b3ce-33d876824480 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:38.303526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c34d4b-003f-4ef2-b3ce-33d876824480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:38.306369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b2c34d4b-003f-4ef2-b3ce-33d876824480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:38.419795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c34d4b-003f-4ef2-b3ce-33d876824480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:38.422370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c34d4b-003f-4ef2-b3ce-33d876824480 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:38.436579 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1805/3593] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:28:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:28:40.335055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d5b6-57bb-4886-aff8-466f109f2ad1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:40.335772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d5b6-57bb-4886-aff8-466f109f2ad1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:40.335772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20d5b6-57bb-4886-aff8-466f109f2ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:40.373423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1f20d5b6-57bb-4886-aff8-466f109f2ad1 None None] MFA Rules not processed for user `488faff83ce040d09275cd674bc9a7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:28:40.374925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1f20d5b6-57bb-4886-aff8-466f109f2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:40.480798 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1789/3594] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:28:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:28:40.492139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c05fd-8468-4510-8990-fb9dc189acd1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:40.492694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c05fd-8468-4510-8990-fb9dc189acd1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:40.493180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c05fd-8468-4510-8990-fb9dc189acd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:40.519010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c90c05fd-8468-4510-8990-fb9dc189acd1 None None] MFA Rules not processed for user `488faff83ce040d09275cd674bc9a7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:28:40.521278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c90c05fd-8468-4510-8990-fb9dc189acd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:40.529797 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1806/3595] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:28:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:28:40.543635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20d5b6-57bb-4886-aff8-466f109f2ad1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:40.546197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1f20d5b6-57bb-4886-aff8-466f109f2ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:40.593495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20d5b6-57bb-4886-aff8-466f109f2ad1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:40.601502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc59486-cf66-4a24-bdf9-d7c794d12554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:40.603873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59486-cf66-4a24-bdf9-d7c794d12554 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:40.604187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59486-cf66-4a24-bdf9-d7c794d12554 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:40.604460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc59486-cf66-4a24-bdf9-d7c794d12554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:40.614782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc59486-cf66-4a24-bdf9-d7c794d12554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:40.616676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc59486-cf66-4a24-bdf9-d7c794d12554 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:40.628645 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1790/3596] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:28:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:28:42.130849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c05fd-8468-4510-8990-fb9dc189acd1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:42.144623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c05fd-8468-4510-8990-fb9dc189acd1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:42.149488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec14b2-2ff4-4e1d-ac10-6d9fdedcd273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:42.150413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec14b2-2ff4-4e1d-ac10-6d9fdedcd273 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:42.150752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec14b2-2ff4-4e1d-ac10-6d9fdedcd273 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:42.151772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec14b2-2ff4-4e1d-ac10-6d9fdedcd273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:42.154080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-39ec14b2-2ff4-4e1d-ac10-6d9fdedcd273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:42.173546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec14b2-2ff4-4e1d-ac10-6d9fdedcd273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:42.175148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec14b2-2ff4-4e1d-ac10-6d9fdedcd273 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:42.192950 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1807/3597] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:28:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:28:49.284919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc59486-cf66-4a24-bdf9-d7c794d12554 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:49.284919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-adc59486-cf66-4a24-bdf9-d7c794d12554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:49.299031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc59486-cf66-4a24-bdf9-d7c794d12554 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:49.305009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee585d-3341-424e-b28d-841a0a4a5b1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:49.305633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee585d-3341-424e-b28d-841a0a4a5b1f service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:49.305931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee585d-3341-424e-b28d-841a0a4a5b1f service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:49.306220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee585d-3341-424e-b28d-841a0a4a5b1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:49.308067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4cee585d-3341-424e-b28d-841a0a4a5b1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:49.375793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee585d-3341-424e-b28d-841a0a4a5b1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:49.377461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee585d-3341-424e-b28d-841a0a4a5b1f service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:49.387884 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1791/3598] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:28:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:28:51.482517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7820-e16b-442a-9da3-7685fbc12d0d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:51.483369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7820-e16b-442a-9da3-7685fbc12d0d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:51.483369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e7820-e16b-442a-9da3-7685fbc12d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:51.534760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-855e7820-e16b-442a-9da3-7685fbc12d0d None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:28:51.539961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-855e7820-e16b-442a-9da3-7685fbc12d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:51.619227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:51.662193 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1808/3599] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:28:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:28:55.433940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee585d-3341-424e-b28d-841a0a4a5b1f service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:28:55.452060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee585d-3341-424e-b28d-841a0a4a5b1f service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:28:55.464519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465e0e4-afff-408a-9b46-b4c394574dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:28:55.465431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e0e4-afff-408a-9b46-b4c394574dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:55.466002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e0e4-afff-408a-9b46-b4c394574dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:55.468980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465e0e4-afff-408a-9b46-b4c394574dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:55.472564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1465e0e4-afff-408a-9b46-b4c394574dd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:55.491199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465e0e4-afff-408a-9b46-b4c394574dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:28:55.493509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465e0e4-afff-408a-9b46-b4c394574dd3 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:28:55.511478 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1792/3600] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:28:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:28:57.313946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dfb44-f6ea-4543-b6bf-218b0603f862 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:28:57.318069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dfb44-f6ea-4543-b6bf-218b0603f862 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:28:57.318747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dfb44-f6ea-4543-b6bf-218b0603f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:28:57.353232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-665dfb44-f6ea-4543-b6bf-218b0603f862 None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:28:57.355338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-665dfb44-f6ea-4543-b6bf-218b0603f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:28:57.374742 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1809/3601] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:28:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:05.152450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6635027-06f4-4462-8d3f-4be83d2e3ff2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:05.155298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6635027-06f4-4462-8d3f-4be83d2e3ff2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:05.156466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6635027-06f4-4462-8d3f-4be83d2e3ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:05.185133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:05.233484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e6635027-06f4-4462-8d3f-4be83d2e3ff2 None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:05.235891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e6635027-06f4-4462-8d3f-4be83d2e3ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:05.251790 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1793/3602] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:07.343435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:09.133747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc0a5-2fb6-4998-aab5-6c23303b8cbc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:09.134856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc0a5-2fb6-4998-aab5-6c23303b8cbc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:09.135661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbc0a5-2fb6-4998-aab5-6c23303b8cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:09.185166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-57dbc0a5-2fb6-4998-aab5-6c23303b8cbc None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:09.191692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-57dbc0a5-2fb6-4998-aab5-6c23303b8cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:09.206545 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1810/3603] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:10.564293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6ae6-b40e-49a4-a97f-edc0fad020a4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:10.565192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6ae6-b40e-49a4-a97f-edc0fad020a4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:10.565192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c6ae6-b40e-49a4-a97f-edc0fad020a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:10.609809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3a0c6ae6-b40e-49a4-a97f-edc0fad020a4 None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:10.612725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3a0c6ae6-b40e-49a4-a97f-edc0fad020a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:10.626248 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1794/3604] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:12.584147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d91cf-58e9-4d6a-8477-fc01908dfb82 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:12.584809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d91cf-58e9-4d6a-8477-fc01908dfb82 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:12.584809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d91cf-58e9-4d6a-8477-fc01908dfb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:12.617283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ca6d91cf-58e9-4d6a-8477-fc01908dfb82 None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:12.620510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ca6d91cf-58e9-4d6a-8477-fc01908dfb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:12.639626 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1811/3605] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:13.892960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f122e84-17dd-4af8-981a-dcd701c46561 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:13.893803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f122e84-17dd-4af8-981a-dcd701c46561 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:13.893803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f122e84-17dd-4af8-981a-dcd701c46561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:13.933910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0f122e84-17dd-4af8-981a-dcd701c46561 None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:13.933910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0f122e84-17dd-4af8-981a-dcd701c46561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:13.945197 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1795/3606] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:16.378849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28c27-cc17-4629-8f4f-a7e07cae2067 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:16.379747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28c27-cc17-4629-8f4f-a7e07cae2067 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:16.380219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28c27-cc17-4629-8f4f-a7e07cae2067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:16.408494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-90a28c27-cc17-4629-8f4f-a7e07cae2067 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:16.410523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-90a28c27-cc17-4629-8f4f-a7e07cae2067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:16.509448 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1812/3607] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:29:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:16.650350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f122e84-17dd-4af8-981a-dcd701c46561 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:16.655131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0f122e84-17dd-4af8-981a-dcd701c46561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:16.906042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f122e84-17dd-4af8-981a-dcd701c46561 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:16.956158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584934a-b07b-4769-b0a4-26809b981f6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:16.961609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584934a-b07b-4769-b0a4-26809b981f6a service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:16.962157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584934a-b07b-4769-b0a4-26809b981f6a service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:16.962623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584934a-b07b-4769-b0a4-26809b981f6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:16.980548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584934a-b07b-4769-b0a4-26809b981f6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:16.983429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584934a-b07b-4769-b0a4-26809b981f6a service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:16.999453 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1796/3608] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:29:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:17.122431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a112a-f7a7-4ea7-9e0b-730f86f4741e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:17.126609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a112a-f7a7-4ea7-9e0b-730f86f4741e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:17.127524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a112a-f7a7-4ea7-9e0b-730f86f4741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:17.203330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b64a112a-f7a7-4ea7-9e0b-730f86f4741e None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:17.206311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b64a112a-f7a7-4ea7-9e0b-730f86f4741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:17.240180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1813/3609] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:19.076560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115dbe-5f5a-4aa0-9afa-1034de2a772e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:19.078452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115dbe-5f5a-4aa0-9afa-1034de2a772e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:19.079366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58115dbe-5f5a-4aa0-9afa-1034de2a772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:19.160970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-58115dbe-5f5a-4aa0-9afa-1034de2a772e None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:19.163617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-58115dbe-5f5a-4aa0-9afa-1034de2a772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:19.182871 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1797/3610] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:25.619469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a112a-f7a7-4ea7-9e0b-730f86f4741e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:25.691619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a112a-f7a7-4ea7-9e0b-730f86f4741e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:25.720573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8194094-7eae-4d97-8053-0e3d938ab468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:25.722225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8194094-7eae-4d97-8053-0e3d938ab468 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:25.723021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8194094-7eae-4d97-8053-0e3d938ab468 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:25.723703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8194094-7eae-4d97-8053-0e3d938ab468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:25.732695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e8194094-7eae-4d97-8053-0e3d938ab468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:25.785629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8194094-7eae-4d97-8053-0e3d938ab468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:25.792951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8194094-7eae-4d97-8053-0e3d938ab468 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:25.891993 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1814/3611] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:27.412593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d236ed-1e4d-48c5-9296-02ae4b8927ff None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:27.413491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d236ed-1e4d-48c5-9296-02ae4b8927ff None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:27.413491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d236ed-1e4d-48c5-9296-02ae4b8927ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:27.532372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a3d236ed-1e4d-48c5-9296-02ae4b8927ff None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:27.540022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a3d236ed-1e4d-48c5-9296-02ae4b8927ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:27.572792 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1798/3612] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:29.402904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8194094-7eae-4d97-8053-0e3d938ab468 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:29.408565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e8194094-7eae-4d97-8053-0e3d938ab468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:29.429011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8194094-7eae-4d97-8053-0e3d938ab468 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:29.437372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:29.438712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:29.439370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:29.440521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] PATH_INFO: `/v3/users/42ddc65f782a4b20bba4980b53e62dcb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:29.442376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ddc65f782a4b20bba4980b53e62dcb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:29.445008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:29.590943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ddc65f782a4b20bba4980b53e62dcb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:29.593050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ddc65f782a4b20bba4980b53e62dcb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:29.610759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ddc65f782a4b20bba4980b53e62dcb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:29.627041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ddc65f782a4b20bba4980b53e62dcb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:29.665538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c442d824-8003-4cb1-9fd9-ffb934c5730c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ddc65f782a4b20bba4980b53e62dcb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:29.694048 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1815/3613] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:29 2022] DELETE /identity/v3/users/42ddc65f782a4b20bba4980b53e62dcb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:30.920338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d236ed-1e4d-48c5-9296-02ae4b8927ff None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:30.957740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d236ed-1e4d-48c5-9296-02ae4b8927ff None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:31.192685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:31.193621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:31.194117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:31.194556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] PATH_INFO: `/v3/projects/8829ad469628438b8f472ddbc176b2ee` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:31.196914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8829ad469628438b8f472ddbc176b2ee)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:31.200529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:31.458779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8829ad469628438b8f472ddbc176b2ee', 'request_id': 'req-20bbf376-77a1-4780-9a2f-cfdfccf2f142'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:31.494361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8829ad469628438b8f472ddbc176b2ee', 'request_id': 'req-20bbf376-77a1-4780-9a2f-cfdfccf2f142'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:31.544361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8829ad469628438b8f472ddbc176b2ee', 'request_id': 'req-20bbf376-77a1-4780-9a2f-cfdfccf2f142'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:31.559855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:31.638824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] The token cache is being invalidate because project 8829ad469628438b8f472ddbc176b2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:31.640468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:31.644190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-20bbf376-77a1-4780-9a2f-cfdfccf2f142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:31.668774 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1799/3614] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:30 2022] DELETE /identity/v3/projects/8829ad469628438b8f472ddbc176b2ee => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:31.678936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1744a08-0211-479b-8584-811324e02d4f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:31.679983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1744a08-0211-479b-8584-811324e02d4f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:31.680401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1744a08-0211-479b-8584-811324e02d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:31.742624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a1744a08-0211-479b-8584-811324e02d4f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:31.747411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a1744a08-0211-479b-8584-811324e02d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:31.906304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:31.999875 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1816/3615] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:32.008240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11631e61-066c-44c4-9743-6c1783ac71fe None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:32.010790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11631e61-066c-44c4-9743-6c1783ac71fe None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:32.011533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11631e61-066c-44c4-9743-6c1783ac71fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:32.147545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-11631e61-066c-44c4-9743-6c1783ac71fe None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:32.174108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-11631e61-066c-44c4-9743-6c1783ac71fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:32.257825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1744a08-0211-479b-8584-811324e02d4f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:32.278695 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1800/3616] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:32.305082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1744a08-0211-479b-8584-811324e02d4f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:32.322683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f95eb-df4e-47e3-aa10-30f65e31e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:32.323518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f95eb-df4e-47e3-aa10-30f65e31e302 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:32.323893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f95eb-df4e-47e3-aa10-30f65e31e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:32.326538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f95eb-df4e-47e3-aa10-30f65e31e302 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:32.328898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f95eb-df4e-47e3-aa10-30f65e31e302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:32.329469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f95eb-df4e-47e3-aa10-30f65e31e302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:32.337224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f95eb-df4e-47e3-aa10-30f65e31e302 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:32.381943 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1817/3617] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:32.386702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11631e61-066c-44c4-9743-6c1783ac71fe None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:32.402183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11631e61-066c-44c4-9743-6c1783ac71fe None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:32.449379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba9852-ea01-4b94-a0fd-20e1d877bf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:32.451486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9852-ea01-4b94-a0fd-20e1d877bf91 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:32.452862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9852-ea01-4b94-a0fd-20e1d877bf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:32.457156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9852-ea01-4b94-a0fd-20e1d877bf91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:32.458256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba9852-ea01-4b94-a0fd-20e1d877bf91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:32.463738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba9852-ea01-4b94-a0fd-20e1d877bf91 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:32.609854 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1801/3618] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:32 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:32.611618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f95eb-df4e-47e3-aa10-30f65e31e302 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:32.641598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f95eb-df4e-47e3-aa10-30f65e31e302 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:32.806935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6734ae-a7b2-47dc-a712-4a8dcc8f03ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:32.808039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6734ae-a7b2-47dc-a712-4a8dcc8f03ae admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:32.808039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6734ae-a7b2-47dc-a712-4a8dcc8f03ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:32.808453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6734ae-a7b2-47dc-a712-4a8dcc8f03ae admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:32.813769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6734ae-a7b2-47dc-a712-4a8dcc8f03ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:32.816399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6734ae-a7b2-47dc-a712-4a8dcc8f03ae admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:32.867933 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1818/3619] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:32 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:32.872308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba9852-ea01-4b94-a0fd-20e1d877bf91 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:32.887898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba9852-ea01-4b94-a0fd-20e1d877bf91 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:32.902679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664c16-2a24-47e6-bf24-3fc94dd6dc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:32.904336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664c16-2a24-47e6-bf24-3fc94dd6dc7f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:32.905165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664c16-2a24-47e6-bf24-3fc94dd6dc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:32.905675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664c16-2a24-47e6-bf24-3fc94dd6dc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:32.906788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a664c16-2a24-47e6-bf24-3fc94dd6dc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:32.911904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a664c16-2a24-47e6-bf24-3fc94dd6dc7f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:32.947949 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1802/3620] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:32.950008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6734ae-a7b2-47dc-a712-4a8dcc8f03ae admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:32.966016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6734ae-a7b2-47dc-a712-4a8dcc8f03ae admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:32.978222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a649e4-a38f-45df-a050-a2e246c5561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:32.981507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a649e4-a38f-45df-a050-a2e246c5561f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:32.982265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a649e4-a38f-45df-a050-a2e246c5561f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:32.983590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a649e4-a38f-45df-a050-a2e246c5561f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:32.985787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a649e4-a38f-45df-a050-a2e246c5561f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:32.989765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a649e4-a38f-45df-a050-a2e246c5561f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:33.022547 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1819/3621] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:29:33.028459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664c16-2a24-47e6-bf24-3fc94dd6dc7f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:33.047453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664c16-2a24-47e6-bf24-3fc94dd6dc7f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:33.070666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b534aed-c8b0-479f-92a6-15bd0fa81e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:33.071805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b534aed-c8b0-479f-92a6-15bd0fa81e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:33.073296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b534aed-c8b0-479f-92a6-15bd0fa81e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:33.074693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b534aed-c8b0-479f-92a6-15bd0fa81e0e admin admin] PATH_INFO: `/v3/projects/41558b82b973471db940b53786e6a09e/users/b93362f0b03f41b99b42bae2fcac0468/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:33.137292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b534aed-c8b0-479f-92a6-15bd0fa81e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=41558b82b973471db940b53786e6a09e, user_id=b93362f0b03f41b99b42bae2fcac0468, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:33.143271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b534aed-c8b0-479f-92a6-15bd0fa81e0e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:33.204594 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1803/3622] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:33 2022] PUT /identity/v3/projects/41558b82b973471db940b53786e6a09e/users/b93362f0b03f41b99b42bae2fcac0468/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:33.228472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b3096-34b7-41fa-a271-a12aa19fb445 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:33.229048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b3096-34b7-41fa-a271-a12aa19fb445 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:33.229422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b3096-34b7-41fa-a271-a12aa19fb445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:33.307046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-286b3096-34b7-41fa-a271-a12aa19fb445 None None] MFA Rules not processed for user `b93362f0b03f41b99b42bae2fcac0468`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:33.309749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-286b3096-34b7-41fa-a271-a12aa19fb445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:33.514582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b534aed-c8b0-479f-92a6-15bd0fa81e0e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:33.518106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1b534aed-c8b0-479f-92a6-15bd0fa81e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:33.607024 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1820/3623] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:33.629270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b3096-34b7-41fa-a271-a12aa19fb445 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:33.631248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-286b3096-34b7-41fa-a271-a12aa19fb445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:33.747051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:33.763515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b534aed-c8b0-479f-92a6-15bd0fa81e0e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:33.797673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:33.799265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:33.799782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:33.800199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] PATH_INFO: `/v3/users/d7a12c873b724eb586098874f925791f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:33.807328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b3096-34b7-41fa-a271-a12aa19fb445 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:33.813618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a12c873b724eb586098874f925791f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:33.820317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:33.824844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11911c-a4c4-4124-908d-746d3c9fb637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:33.828900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11911c-a4c4-4124-908d-746d3c9fb637 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:33.829637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11911c-a4c4-4124-908d-746d3c9fb637 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:33.829838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11911c-a4c4-4124-908d-746d3c9fb637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:33.877463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11911c-a4c4-4124-908d-746d3c9fb637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:33.880420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11911c-a4c4-4124-908d-746d3c9fb637 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:33.925649 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1821/3624] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:29:33.990048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ce115-a21a-4d6a-989c-dfd39bc6a4fa None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:33.990507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ce115-a21a-4d6a-989c-dfd39bc6a4fa None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:33.990911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ce115-a21a-4d6a-989c-dfd39bc6a4fa None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:33.992730 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1822/3625] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 04:29:34.031423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ce115-a21a-4d6a-989c-dfd39bc6a4fa None None] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:29:34.076429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a12c873b724eb586098874f925791f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:34.118798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ce115-a21a-4d6a-989c-dfd39bc6a4fa None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:34.155724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ce115-a21a-4d6a-989c-dfd39bc6a4fa None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:34.166314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245184c6-d714-4844-8344-d8eefd9b1ac3 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b93362f0b03f41b99b42bae2fcac0468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41558b82b973471db940b53786e6a09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:34.169527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245184c6-d714-4844-8344-d8eefd9b1ac3 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:34.170705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245184c6-d714-4844-8344-d8eefd9b1ac3 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:34.171923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245184c6-d714-4844-8344-d8eefd9b1ac3 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] PATH_INFO: `/v3/projects/41558b82b973471db940b53786e6a09e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:34.173038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a12c873b724eb586098874f925791f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:34.175248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245184c6-d714-4844-8344-d8eefd9b1ac3 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: Authorizing `identity:get_project(project_id=41558b82b973471db940b53786e6a09e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:34.181136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245184c6-d714-4844-8344-d8eefd9b1ac3 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:34.186524 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1823/3626] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:29:34 2022] GET /identity/v3/projects/41558b82b973471db940b53786e6a09e => generated 365 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:34.263461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a12c873b724eb586098874f925791f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:34.274965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245184c6-d714-4844-8344-d8eefd9b1ac3 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:34.278586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-245184c6-d714-4844-8344-d8eefd9b1ac3 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:34.311749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a12c873b724eb586098874f925791f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:34.316053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3beca829-7651-413c-bae5-2db790503d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a12c873b724eb586098874f925791f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:34.365114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1804/3627] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:33 2022] DELETE /identity/v3/users/d7a12c873b724eb586098874f925791f => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:34.375494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245184c6-d714-4844-8344-d8eefd9b1ac3 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:34.376871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fed367-c6d1-44e8-8c8b-498a40a23ba7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:34.377678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fed367-c6d1-44e8-8c8b-498a40a23ba7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:34.381081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fed367-c6d1-44e8-8c8b-498a40a23ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:34.444232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:34.496244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e1fed367-c6d1-44e8-8c8b-498a40a23ba7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:34.501857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e1fed367-c6d1-44e8-8c8b-498a40a23ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:34.669504 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1805/3628] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:34.702475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fed367-c6d1-44e8-8c8b-498a40a23ba7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:34.704732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e1fed367-c6d1-44e8-8c8b-498a40a23ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:34.742276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:34.743638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:34.745087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:34.745770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] PATH_INFO: `/v3/users/2ad64e15a95f4057bffb4e2af194ad08` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:34.749827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad64e15a95f4057bffb4e2af194ad08)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:34.755677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:34.945656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fed367-c6d1-44e8-8c8b-498a40a23ba7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:34.966510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abf216-d9f5-44b7-9817-39f1cdc1a6db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:34.968060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abf216-d9f5-44b7-9817-39f1cdc1a6db service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:34.968584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abf216-d9f5-44b7-9817-39f1cdc1a6db service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:34.969017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abf216-d9f5-44b7-9817-39f1cdc1a6db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:35.002875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad64e15a95f4057bffb4e2af194ad08'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:35.003610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad64e15a95f4057bffb4e2af194ad08'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:35.004678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abf216-d9f5-44b7-9817-39f1cdc1a6db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:35.006271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abf216-d9f5-44b7-9817-39f1cdc1a6db service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:35.018308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad64e15a95f4057bffb4e2af194ad08'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:35.031786 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1806/3629] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:35.033321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad64e15a95f4057bffb4e2af194ad08'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:35.035234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cd59f-dcce-4dd1-adcc-e52e831105fc None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:35.035555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cd59f-dcce-4dd1-adcc-e52e831105fc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:35.037197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cd59f-dcce-4dd1-adcc-e52e831105fc None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:35.040061 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1807/3630] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:29:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:29:35.051698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cd59f-dcce-4dd1-adcc-e52e831105fc None None] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:29:35.058293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7bf25820-81ba-4657-bf53-9839f4b692cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad64e15a95f4057bffb4e2af194ad08'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:35.060560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-329cd59f-dcce-4dd1-adcc-e52e831105fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:35.068466 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1824/3631] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:34 2022] DELETE /identity/v3/users/2ad64e15a95f4057bffb4e2af194ad08 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:35.074632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f361ac-b96a-48ab-a26a-dac05fdba133 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:35.074960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f361ac-b96a-48ab-a26a-dac05fdba133 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:35.075305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f361ac-b96a-48ab-a26a-dac05fdba133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:35.164598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-13f361ac-b96a-48ab-a26a-dac05fdba133 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:35.168483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-13f361ac-b96a-48ab-a26a-dac05fdba133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:35.253774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:35.403633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cd59f-dcce-4dd1-adcc-e52e831105fc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:35.408528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-329cd59f-dcce-4dd1-adcc-e52e831105fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:35.432452 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1825/3632] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:35.433537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f361ac-b96a-48ab-a26a-dac05fdba133 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:35.440462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-13f361ac-b96a-48ab-a26a-dac05fdba133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:35.462286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f361ac-b96a-48ab-a26a-dac05fdba133 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:35.471543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:35.472755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:35.475720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:35.476312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] PATH_INFO: `/v3/users/488faff83ce040d09275cd674bc9a7dc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:35.478010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=488faff83ce040d09275cd674bc9a7dc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:35.482793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:35.576829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:35.636408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cd59f-dcce-4dd1-adcc-e52e831105fc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:35.641973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488faff83ce040d09275cd674bc9a7dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:35.645223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488faff83ce040d09275cd674bc9a7dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:35.648557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc4a7-ef83-4f00-9548-1795ec2bba8f tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b93362f0b03f41b99b42bae2fcac0468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41558b82b973471db940b53786e6a09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:35.652302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc4a7-ef83-4f00-9548-1795ec2bba8f tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:35.656755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc4a7-ef83-4f00-9548-1795ec2bba8f tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:35.656755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddc4a7-ef83-4f00-9548-1795ec2bba8f tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] PATH_INFO: `/v3/projects/41558b82b973471db940b53786e6a09e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:35.658656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc4a7-ef83-4f00-9548-1795ec2bba8f tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: Authorizing `identity:get_project(project_id=41558b82b973471db940b53786e6a09e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:35.667668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddc4a7-ef83-4f00-9548-1795ec2bba8f tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:35.673127 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1808/3633] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:29:35 2022] GET /identity/v3/projects/41558b82b973471db940b53786e6a09e => generated 365 bytes in 622 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:29:35.674553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488faff83ce040d09275cd674bc9a7dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:35.678284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc4a7-ef83-4f00-9548-1795ec2bba8f tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:35.688476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3dddc4a7-ef83-4f00-9548-1795ec2bba8f tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:35.703607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488faff83ce040d09275cd674bc9a7dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:35.747051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488faff83ce040d09275cd674bc9a7dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:35.769341 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1826/3634] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:35 2022] DELETE /identity/v3/users/488faff83ce040d09275cd674bc9a7dc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:35.847730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:35.849493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:35.960220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddc4a7-ef83-4f00-9548-1795ec2bba8f tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:36.105144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28483487-e8a8-4450-b6f9-9d728f816232 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:36.120804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:36.122250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:36.124866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:36.125303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] PATH_INFO: `/v3/projects/337dac45115541ff972750be568eb864` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:36.128666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=337dac45115541ff972750be568eb864)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:36.133349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:36.206074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa311-ada4-44c0-8c1e-3d63d19f602b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:36.208280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa311-ada4-44c0-8c1e-3d63d19f602b service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:36.208697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa311-ada4-44c0-8c1e-3d63d19f602b service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:36.213707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14faa311-ada4-44c0-8c1e-3d63d19f602b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:36.215777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-14faa311-ada4-44c0-8c1e-3d63d19f602b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:36.257017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faa311-ada4-44c0-8c1e-3d63d19f602b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:36.276436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14faa311-ada4-44c0-8c1e-3d63d19f602b service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:36.324679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337dac45115541ff972750be568eb864', 'request_id': 'req-e29fde35-a5ab-475a-a39a-30177c9df758'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.338424 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1809/3635] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:36.338682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:36.351199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337dac45115541ff972750be568eb864', 'request_id': 'req-e29fde35-a5ab-475a-a39a-30177c9df758'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.375853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa311-ada4-44c0-8c1e-3d63d19f602b service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:36.378327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337dac45115541ff972750be568eb864', 'request_id': 'req-e29fde35-a5ab-475a-a39a-30177c9df758'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.379456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-14faa311-ada4-44c0-8c1e-3d63d19f602b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:36.412834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14faa311-ada4-44c0-8c1e-3d63d19f602b service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:36.415247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] The token cache is being invalidate because project 337dac45115541ff972750be568eb864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:36.419175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.429952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e29fde35-a5ab-475a-a39a-30177c9df758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.429952 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1827/3636] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:35 2022] DELETE /identity/v3/projects/337dac45115541ff972750be568eb864 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:36.429952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81a92-4332-4845-83be-61538a70efc7 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:36.429952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81a92-4332-4845-83be-61538a70efc7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:36.429952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a81a92-4332-4845-83be-61538a70efc7 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:36.439921 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1828/3637] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:29:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:29:36.439921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a81a92-4332-4845-83be-61538a70efc7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:36.446218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-67a81a92-4332-4845-83be-61538a70efc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:36.616561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:36.616561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:36.616561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:36.616561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] PATH_INFO: `/v3/projects/65ca3e1ed56b4da5aefd0ead35f8f04e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:36.621425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ca3e1ed56b4da5aefd0ead35f8f04e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:36.628004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:36.661037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a81a92-4332-4845-83be-61538a70efc7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:36.666343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:36.667095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:36.667377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:36.667655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] PATH_INFO: `/v3/users/db80c9bf82bf4a08b451656bd046392c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:36.671977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db80c9bf82bf4a08b451656bd046392c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:36.675324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:36.794879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ca3e1ed56b4da5aefd0ead35f8f04e', 'request_id': 'req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.799868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db80c9bf82bf4a08b451656bd046392c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.801622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:36.803055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db80c9bf82bf4a08b451656bd046392c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.816512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db80c9bf82bf4a08b451656bd046392c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.822972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ca3e1ed56b4da5aefd0ead35f8f04e', 'request_id': 'req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.838297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db80c9bf82bf4a08b451656bd046392c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.848948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ca3e1ed56b4da5aefd0ead35f8f04e', 'request_id': 'req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.870090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db80c9bf82bf4a08b451656bd046392c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.884261 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1829/3638] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:36 2022] DELETE /identity/v3/users/db80c9bf82bf4a08b451656bd046392c => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:36.884261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:29:36.886383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:36.918002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] The token cache is being invalidate because project 65ca3e1ed56b4da5aefd0ead35f8f04e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:36.918531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.922670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dea48b92-ad43-4dcd-985f-ef1c6c44da4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:36.930768 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1810/3639] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:36 2022] DELETE /identity/v3/projects/65ca3e1ed56b4da5aefd0ead35f8f04e => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:36.935985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5459fee-e668-46e9-b091-be32aadd637f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:36.936432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5459fee-e668-46e9-b091-be32aadd637f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:36.936857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5459fee-e668-46e9-b091-be32aadd637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:36.994735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d5459fee-e668-46e9-b091-be32aadd637f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:36.996960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d5459fee-e668-46e9-b091-be32aadd637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:37.073728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:37.130117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:37.132225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:37.218089 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1811/3640] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:37.219598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5459fee-e668-46e9-b091-be32aadd637f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:37.235776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d5459fee-e668-46e9-b091-be32aadd637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:37.279552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a8582-cf70-4eff-94b6-33a53cd3d417 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:37.285215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10153-2ce2-46b4-a323-186c0749ee2e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b93362f0b03f41b99b42bae2fcac0468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41558b82b973471db940b53786e6a09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:37.286144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10153-2ce2-46b4-a323-186c0749ee2e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:37.286532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10153-2ce2-46b4-a323-186c0749ee2e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:37.286912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10153-2ce2-46b4-a323-186c0749ee2e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] PATH_INFO: `/v3/projects/41558b82b973471db940b53786e6a09e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:37.288393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b10153-2ce2-46b4-a323-186c0749ee2e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: Authorizing `identity:get_project(project_id=41558b82b973471db940b53786e6a09e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:37.290803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b10153-2ce2-46b4-a323-186c0749ee2e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:37.293438 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1830/3641] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:29:36 2022] GET /identity/v3/projects/41558b82b973471db940b53786e6a09e => generated 365 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:37.295327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ae893-c8e8-4c4f-8601-70b86e38c01e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:37.295602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5459fee-e668-46e9-b091-be32aadd637f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:37.295853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ae893-c8e8-4c4f-8601-70b86e38c01e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:37.296368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ae893-c8e8-4c4f-8601-70b86e38c01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:37.341131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2d7ae893-c8e8-4c4f-8601-70b86e38c01e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:37.343155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:37.344315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:37.344697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:37.345129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] PATH_INFO: `/v3/projects/482483b6bedc4c0abdba4b58927f4b2c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:37.345466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2d7ae893-c8e8-4c4f-8601-70b86e38c01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:37.358003 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1831/3642] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:37.359593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] RBAC: Authorizing `identity:delete_project(project_id=482483b6bedc4c0abdba4b58927f4b2c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:37.361177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ae893-c8e8-4c4f-8601-70b86e38c01e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:37.377363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:37.402497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ae893-c8e8-4c4f-8601-70b86e38c01e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:37.421558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015609d2-e590-4873-b162-b9e1f989cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:37.422702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015609d2-e590-4873-b162-b9e1f989cdfd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:37.423261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015609d2-e590-4873-b162-b9e1f989cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:37.423787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015609d2-e590-4873-b162-b9e1f989cdfd admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:37.424725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015609d2-e590-4873-b162-b9e1f989cdfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:37.425792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015609d2-e590-4873-b162-b9e1f989cdfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:37.428347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015609d2-e590-4873-b162-b9e1f989cdfd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:37.477521 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1832/3643] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:37.481765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c3bc-3765-486a-8f10-41c6ceaba59d None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:37.482726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c3bc-3765-486a-8f10-41c6ceaba59d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:37.483282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45c3bc-3765-486a-8f10-41c6ceaba59d None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:37.491118 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1833/3644] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:29:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:29:37.492934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c3bc-3765-486a-8f10-41c6ceaba59d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:37.495729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ea45c3bc-3765-486a-8f10-41c6ceaba59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:37.541888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45c3bc-3765-486a-8f10-41c6ceaba59d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:37.548539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:37.551125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:37.552866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:37.553418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] PATH_INFO: `/v3/projects/2180f0060b55415a9b433cec7a266461` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:37.556854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2180f0060b55415a9b433cec7a266461)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:37.559377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:37.618837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482483b6bedc4c0abdba4b58927f4b2c', 'request_id': 'req-63420317-6b7e-4a09-a037-3b41168e002c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:37.658167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482483b6bedc4c0abdba4b58927f4b2c', 'request_id': 'req-63420317-6b7e-4a09-a037-3b41168e002c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:37.677170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482483b6bedc4c0abdba4b58927f4b2c', 'request_id': 'req-63420317-6b7e-4a09-a037-3b41168e002c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:37.690100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2180f0060b55415a9b433cec7a266461', 'request_id': 'req-a9b2378c-d660-4385-927e-482e4b7bcd57'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:37.716754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] The token cache is being invalidate because project 482483b6bedc4c0abdba4b58927f4b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:37.717887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:37.719384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2180f0060b55415a9b433cec7a266461', 'request_id': 'req-a9b2378c-d660-4385-927e-482e4b7bcd57'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:37.722031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:37.727046 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1812/3645] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:37 2022] DELETE /identity/v3/projects/482483b6bedc4c0abdba4b58927f4b2c => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:37.728512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:37.730791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:37.785256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2180f0060b55415a9b433cec7a266461', 'request_id': 'req-a9b2378c-d660-4385-927e-482e4b7bcd57'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:37.814922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] The token cache is being invalidate because project 2180f0060b55415a9b433cec7a266461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:37.815630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:37.817530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:37.819728 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1834/3646] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:37 2022] DELETE /identity/v3/projects/2180f0060b55415a9b433cec7a266461 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:37.820746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:29:37.823753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:37.944464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63420317-6b7e-4a09-a037-3b41168e002c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:37.952266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:38.034459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:38.058587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:38.060628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:38.079727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce6496-645c-4234-bbef-904cd4e7ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:38.080475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6496-645c-4234-bbef-904cd4e7ca6f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.080820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6496-645c-4234-bbef-904cd4e7ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.081295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6496-645c-4234-bbef-904cd4e7ca6f admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.082093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce6496-645c-4234-bbef-904cd4e7ca6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:38.086284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce6496-645c-4234-bbef-904cd4e7ca6f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:38.132036 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1813/3647] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:37 2022] POST /identity/v3/projects => generated 377 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:38.132036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce6496-645c-4234-bbef-904cd4e7ca6f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:38.132036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dbce6496-645c-4234-bbef-904cd4e7ca6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:38.147601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2378c-d660-4385-927e-482e4b7bcd57 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:38.234365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab6d2c-45d0-44b4-a652-f73e33a29ac9 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b93362f0b03f41b99b42bae2fcac0468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41558b82b973471db940b53786e6a09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:38.235528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6d2c-45d0-44b4-a652-f73e33a29ac9 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.236026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6d2c-45d0-44b4-a652-f73e33a29ac9 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.237069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab6d2c-45d0-44b4-a652-f73e33a29ac9 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] PATH_INFO: `/v3/projects/41558b82b973471db940b53786e6a09e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.238292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab6d2c-45d0-44b4-a652-f73e33a29ac9 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: Authorizing `identity:get_project(project_id=41558b82b973471db940b53786e6a09e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:38.241255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab6d2c-45d0-44b4-a652-f73e33a29ac9 tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:38.251202 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1835/3648] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:29:37 2022] GET /identity/v3/projects/41558b82b973471db940b53786e6a09e => generated 365 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:38.253298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdbace-7d63-4ab5-8a01-c10b11c293c4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.254169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdbace-7d63-4ab5-8a01-c10b11c293c4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.254861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bdbace-7d63-4ab5-8a01-c10b11c293c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.282052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-63bdbace-7d63-4ab5-8a01-c10b11c293c4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:38.283691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-63bdbace-7d63-4ab5-8a01-c10b11c293c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:38.360258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce6496-645c-4234-bbef-904cd4e7ca6f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:38.371150 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1836/3649] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:38.372036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdbace-7d63-4ab5-8a01-c10b11c293c4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:38.374104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-63bdbace-7d63-4ab5-8a01-c10b11c293c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:38.387771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bdbace-7d63-4ab5-8a01-c10b11c293c4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:38.395742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac934241-172f-464d-853c-b931d26047b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:38.396915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934241-172f-464d-853c-b931d26047b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.399018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934241-172f-464d-853c-b931d26047b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.399909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac934241-172f-464d-853c-b931d26047b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.400856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac934241-172f-464d-853c-b931d26047b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:38.403351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac934241-172f-464d-853c-b931d26047b5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:38.407228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:38.408368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.408868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.409363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] PATH_INFO: `/v3/users/4f4dadb5742c4e9a9ea638eb8998e883` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.415417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f4dadb5742c4e9a9ea638eb8998e883)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:38.419060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:38.456812 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1837/3650] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:38 2022] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:38.458873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d47dcc-7976-4cdf-93b0-b7330c0939d7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.459202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d47dcc-7976-4cdf-93b0-b7330c0939d7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.459445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d47dcc-7976-4cdf-93b0-b7330c0939d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.498567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b1d47dcc-7976-4cdf-93b0-b7330c0939d7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:38.507721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b1d47dcc-7976-4cdf-93b0-b7330c0939d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:38.532585 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1838/3651] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:38.538178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d47dcc-7976-4cdf-93b0-b7330c0939d7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:38.568133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d47dcc-7976-4cdf-93b0-b7330c0939d7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:38.577982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff6855-aacb-4a64-bc22-4f372f0121ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:38.579332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff6855-aacb-4a64-bc22-4f372f0121ce admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.579531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f4dadb5742c4e9a9ea638eb8998e883'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:38.580015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff6855-aacb-4a64-bc22-4f372f0121ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.581359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff6855-aacb-4a64-bc22-4f372f0121ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.582589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff6855-aacb-4a64-bc22-4f372f0121ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:38.584708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff6855-aacb-4a64-bc22-4f372f0121ce admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:38.604257 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1839/3652] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:38.605379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff6855-aacb-4a64-bc22-4f372f0121ce admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:38.620428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f4dadb5742c4e9a9ea638eb8998e883'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:38.631552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff6855-aacb-4a64-bc22-4f372f0121ce admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:38.650818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aac6b9-1352-4d04-aeef-ad6d4b554553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:38.651477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac6b9-1352-4d04-aeef-ad6d4b554553 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.651756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac6b9-1352-4d04-aeef-ad6d4b554553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.652026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac6b9-1352-4d04-aeef-ad6d4b554553 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.652718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aac6b9-1352-4d04-aeef-ad6d4b554553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:38.653017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aac6b9-1352-4d04-aeef-ad6d4b554553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:38.653205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f4dadb5742c4e9a9ea638eb8998e883'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:38.656165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aac6b9-1352-4d04-aeef-ad6d4b554553 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:38.667613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f4dadb5742c4e9a9ea638eb8998e883'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:38.671276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f4dadb5742c4e9a9ea638eb8998e883'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:38.684921 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1840/3653] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:38.687647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9271-c677-4d2a-93b8-a6609f8c7a58 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.688066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9271-c677-4d2a-93b8-a6609f8c7a58 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.688806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec9271-c677-4d2a-93b8-a6609f8c7a58 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.692690 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1841/3654] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:29:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:29:38.695490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec9271-c677-4d2a-93b8-a6609f8c7a58 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:38.697374 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1814/3655] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:38 2022] DELETE /identity/v3/users/4f4dadb5742c4e9a9ea638eb8998e883 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:38.699363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:38.704079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:38.716065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-45ec9271-c677-4d2a-93b8-a6609f8c7a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:38.763655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:38.767604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:38.878571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec9271-c677-4d2a-93b8-a6609f8c7a58 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:38.884973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:38.885842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.886260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.886631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.888292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:38.891238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:38.909553 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1842/3656] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:38.910777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] Authenticating service token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 04:29:38.912995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:38.948162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25991c-bba4-4d7b-9765-a93fa9e9b379 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:38.964039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec2e9b-c651-4a85-bb86-262f8923dfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:38.965772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2e9b-c651-4a85-bb86-262f8923dfea admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:38.966940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2e9b-c651-4a85-bb86-262f8923dfea admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:38.968005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2e9b-c651-4a85-bb86-262f8923dfea admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:38.969834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec2e9b-c651-4a85-bb86-262f8923dfea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:38.974883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec2e9b-c651-4a85-bb86-262f8923dfea admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:39.067293 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1815/3657] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:38 2022] POST /identity/v3/projects => generated 393 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:39.070555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec2e9b-c651-4a85-bb86-262f8923dfea admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:39.077460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:39.083995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:39.294634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec2e9b-c651-4a85-bb86-262f8923dfea admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:39.336739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a710920-7239-4af3-977d-0718ec929c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:39.337281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a710920-7239-4af3-977d-0718ec929c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:39.337599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a710920-7239-4af3-977d-0718ec929c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:39.340042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a710920-7239-4af3-977d-0718ec929c97 admin admin] PATH_INFO: `/v3/projects/a1bfc45bbd204d6a90ae211e5ab8886d/users/46f7a2f32b0540fd8bbb2f0ff3073427/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:39.444560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a710920-7239-4af3-977d-0718ec929c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bfc45bbd204d6a90ae211e5ab8886d, user_id=46f7a2f32b0540fd8bbb2f0ff3073427, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:39.450595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17371918-d806-460f-89ec-d449e2948774 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:39.503067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a710920-7239-4af3-977d-0718ec929c97 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:39.527326 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1816/3658] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:39 2022] PUT /identity/v3/projects/a1bfc45bbd204d6a90ae211e5ab8886d/users/46f7a2f32b0540fd8bbb2f0ff3073427/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:39.528223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a710920-7239-4af3-977d-0718ec929c97 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:39.610971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:39.636107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e427d0-245d-402b-8ce2-9a0b7c382f6e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b93362f0b03f41b99b42bae2fcac0468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41558b82b973471db940b53786e6a09e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:39.636783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e427d0-245d-402b-8ce2-9a0b7c382f6e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:39.637062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e427d0-245d-402b-8ce2-9a0b7c382f6e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:39.637335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e427d0-245d-402b-8ce2-9a0b7c382f6e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] PATH_INFO: `/v3/projects/41558b82b973471db940b53786e6a09e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:39.638457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e427d0-245d-402b-8ce2-9a0b7c382f6e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: Authorizing `identity:get_project(project_id=41558b82b973471db940b53786e6a09e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:39.640734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e427d0-245d-402b-8ce2-9a0b7c382f6e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:39.668577 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1843/3659] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 04:29:38 2022] GET /identity/v3/projects/41558b82b973471db940b53786e6a09e => generated 365 bytes in 753 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:39.669744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e427d0-245d-402b-8ce2-9a0b7c382f6e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:39.672345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-38e427d0-245d-402b-8ce2-9a0b7c382f6e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:39.680485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a710920-7239-4af3-977d-0718ec929c97 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:39.688465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6694a3-71de-483e-9c7d-1ca58c413165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:39.689399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6694a3-71de-483e-9c7d-1ca58c413165 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:39.689837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6694a3-71de-483e-9c7d-1ca58c413165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:39.690372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6694a3-71de-483e-9c7d-1ca58c413165 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:39.691244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6694a3-71de-483e-9c7d-1ca58c413165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:39.693811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6694a3-71de-483e-9c7d-1ca58c413165 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:39.715036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e427d0-245d-402b-8ce2-9a0b7c382f6e tempest-QuotasTestJSON-2021962940 tempest-QuotasTestJSON-2021962940-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:39.733170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:39.733523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:39.734020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:39.734307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] PATH_INFO: `/v3/projects/ede934ea479a4bc1a32704edc05cedcc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:39.736125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede934ea479a4bc1a32704edc05cedcc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:39.738423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:39.751303 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1817/3660] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:39 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:39.754887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece54b22-b58a-499e-bc6d-6dc3b956bdf1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:39.755639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece54b22-b58a-499e-bc6d-6dc3b956bdf1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:39.758363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece54b22-b58a-499e-bc6d-6dc3b956bdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:39.816232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ece54b22-b58a-499e-bc6d-6dc3b956bdf1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:39.817540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ece54b22-b58a-499e-bc6d-6dc3b956bdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:39.828186 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1818/3661] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:39.829139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece54b22-b58a-499e-bc6d-6dc3b956bdf1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:39.837460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:39.846180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece54b22-b58a-499e-bc6d-6dc3b956bdf1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:39.880544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be981464-f98a-42bc-a8bc-b793dc89c43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:39.881593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be981464-f98a-42bc-a8bc-b793dc89c43d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:39.883597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be981464-f98a-42bc-a8bc-b793dc89c43d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:39.884614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be981464-f98a-42bc-a8bc-b793dc89c43d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:39.885400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be981464-f98a-42bc-a8bc-b793dc89c43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:39.891008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be981464-f98a-42bc-a8bc-b793dc89c43d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:39.906151 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1819/3662] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:39.911698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be981464-f98a-42bc-a8bc-b793dc89c43d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:39.914320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-be981464-f98a-42bc-a8bc-b793dc89c43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:39.922104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede934ea479a4bc1a32704edc05cedcc', 'request_id': 'req-7d764125-2988-4091-bdb2-5b3d5c97adbc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:39.936974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be981464-f98a-42bc-a8bc-b793dc89c43d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:39.951758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede934ea479a4bc1a32704edc05cedcc', 'request_id': 'req-7d764125-2988-4091-bdb2-5b3d5c97adbc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:39.982277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede934ea479a4bc1a32704edc05cedcc', 'request_id': 'req-7d764125-2988-4091-bdb2-5b3d5c97adbc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:40.048350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] The token cache is being invalidate because project ede934ea479a4bc1a32704edc05cedcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:40.050266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:40.051675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:40.062116 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1844/3663] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:39 2022] DELETE /identity/v3/projects/ede934ea479a4bc1a32704edc05cedcc => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:40.070154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:40.070154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:40.075280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:40.076528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:40.077178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:40.077636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] PATH_INFO: `/v3/users/b93362f0b03f41b99b42bae2fcac0468` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:40.079163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93362f0b03f41b99b42bae2fcac0468)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:40.081430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:40.221960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93362f0b03f41b99b42bae2fcac0468'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:40.247033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93362f0b03f41b99b42bae2fcac0468'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:40.259546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d764125-2988-4091-bdb2-5b3d5c97adbc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:40.279007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fd227-88f6-44d2-892c-74548208cf55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:40.280111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd227-88f6-44d2-892c-74548208cf55 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:40.280561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd227-88f6-44d2-892c-74548208cf55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:40.280991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd227-88f6-44d2-892c-74548208cf55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:40.284556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-117fd227-88f6-44d2-892c-74548208cf55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:40.289813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93362f0b03f41b99b42bae2fcac0468'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:40.314298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93362f0b03f41b99b42bae2fcac0468'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:40.315092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fd227-88f6-44d2-892c-74548208cf55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:40.316345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93362f0b03f41b99b42bae2fcac0468'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:40.316631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fd227-88f6-44d2-892c-74548208cf55 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:40.332175 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1820/3664] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:39 2022] DELETE /identity/v3/users/b93362f0b03f41b99b42bae2fcac0468 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:40.333744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:40.337017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:40.351518 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1845/3665] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:40.354869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00553-6ee3-4e44-aa27-3a1f77bafd9a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:40.355142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00553-6ee3-4e44-aa27-3a1f77bafd9a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:40.360770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b00553-6ee3-4e44-aa27-3a1f77bafd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:40.416748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b6b00553-6ee3-4e44-aa27-3a1f77bafd9a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:40.422194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b6b00553-6ee3-4e44-aa27-3a1f77bafd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:40.597344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30416403-d049-4834-9774-0b9f49c5fa51 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:40.621359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878b819-925e-43c7-85f5-7e625333cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:40.622501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b819-925e-43c7-85f5-7e625333cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:40.623023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b819-925e-43c7-85f5-7e625333cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:40.623875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878b819-925e-43c7-85f5-7e625333cd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:40.625094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878b819-925e-43c7-85f5-7e625333cd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:40.628468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878b819-925e-43c7-85f5-7e625333cd2d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:40.640769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1846/3666] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:40.651560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786f503-b460-4703-9b4a-821b4360bbf0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:40.652435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786f503-b460-4703-9b4a-821b4360bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:40.656875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786f503-b460-4703-9b4a-821b4360bbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:40.677287 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1821/3667] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:40.679908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b290d3-e2a5-4ebb-9611-358716063bb1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:40.680578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b290d3-e2a5-4ebb-9611-358716063bb1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:40.681519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b290d3-e2a5-4ebb-9611-358716063bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:40.769550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5786f503-b460-4703-9b4a-821b4360bbf0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:40.777980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c2b290d3-e2a5-4ebb-9611-358716063bb1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:40.780276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5786f503-b460-4703-9b4a-821b4360bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:40.786532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c2b290d3-e2a5-4ebb-9611-358716063bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:40.817302 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1847/3668] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:40.817778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786f503-b460-4703-9b4a-821b4360bbf0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:40.831371 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1822/3669] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:40.831371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b290d3-e2a5-4ebb-9611-358716063bb1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:40.836643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c2b290d3-e2a5-4ebb-9611-358716063bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:40.848421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:40.855598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786f503-b460-4703-9b4a-821b4360bbf0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:40.886969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a004-baaa-4abd-9b7e-b6497f27bc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:40.892661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a004-baaa-4abd-9b7e-b6497f27bc91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:40.895605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a004-baaa-4abd-9b7e-b6497f27bc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:40.896298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a004-baaa-4abd-9b7e-b6497f27bc91 admin admin] PATH_INFO: `/v3/projects/65028e1021d845d5ac6996b5dd1f5b65/users/041099b1a6884bd6bea2a401ca0475b1/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:40.949068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:40.972478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a004-baaa-4abd-9b7e-b6497f27bc91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65028e1021d845d5ac6996b5dd1f5b65, user_id=041099b1a6884bd6bea2a401ca0475b1, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:40.988037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a004-baaa-4abd-9b7e-b6497f27bc91 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:41.070428 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1848/3670] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:40 2022] PUT /identity/v3/projects/65028e1021d845d5ac6996b5dd1f5b65/users/041099b1a6884bd6bea2a401ca0475b1/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:41.074607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a004-baaa-4abd-9b7e-b6497f27bc91 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:41.086656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b290d3-e2a5-4ebb-9611-358716063bb1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:41.277202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a004-baaa-4abd-9b7e-b6497f27bc91 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:41.292642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9065355-cf99-4a6a-8205-445037f755b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:41.294279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065355-cf99-4a6a-8205-445037f755b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:41.295186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065355-cf99-4a6a-8205-445037f755b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:41.296056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065355-cf99-4a6a-8205-445037f755b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:41.297920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9065355-cf99-4a6a-8205-445037f755b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:41.298552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9065355-cf99-4a6a-8205-445037f755b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:41.301718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9065355-cf99-4a6a-8205-445037f755b5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:41.308334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fba2f-b8fe-49fc-b2e0-2ad049d2c3db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:41.309479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fba2f-b8fe-49fc-b2e0-2ad049d2c3db service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:41.320368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fba2f-b8fe-49fc-b2e0-2ad049d2c3db service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:41.320368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fba2f-b8fe-49fc-b2e0-2ad049d2c3db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:41.341305 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1849/3671] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:41.344283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9065355-cf99-4a6a-8205-445037f755b5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:41.348484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b9065355-cf99-4a6a-8205-445037f755b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:41.363107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fba2f-b8fe-49fc-b2e0-2ad049d2c3db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:41.365984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fba2f-b8fe-49fc-b2e0-2ad049d2c3db service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:41.409966 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1823/3672] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:41.410254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d141-a3f5-4b32-8178-632c1b7ab4ea None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:41.412148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d141-a3f5-4b32-8178-632c1b7ab4ea None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:41.412148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d141-a3f5-4b32-8178-632c1b7ab4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:41.418647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9065355-cf99-4a6a-8205-445037f755b5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:41.441658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44f6d9-9b31-4ada-aa62-dfe9ea77cf75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:41.443279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f6d9-9b31-4ada-aa62-dfe9ea77cf75 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:41.444059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f6d9-9b31-4ada-aa62-dfe9ea77cf75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:41.445222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44f6d9-9b31-4ada-aa62-dfe9ea77cf75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:41.454984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0c44f6d9-9b31-4ada-aa62-dfe9ea77cf75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:41.496577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44f6d9-9b31-4ada-aa62-dfe9ea77cf75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:41.500668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44f6d9-9b31-4ada-aa62-dfe9ea77cf75 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:41.527964 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1850/3673] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:41.530487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44f6d9-9b31-4ada-aa62-dfe9ea77cf75 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:41.566833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5665d141-a3f5-4b32-8178-632c1b7ab4ea None None] MFA Rules not processed for user `041099b1a6884bd6bea2a401ca0475b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:41.569123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5665d141-a3f5-4b32-8178-632c1b7ab4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:41.582561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44f6d9-9b31-4ada-aa62-dfe9ea77cf75 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:41.595687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21cc3-f7a6-41cd-ac10-6578fd65f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:41.598344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21cc3-f7a6-41cd-ac10-6578fd65f66f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:41.598344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21cc3-f7a6-41cd-ac10-6578fd65f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:41.599133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21cc3-f7a6-41cd-ac10-6578fd65f66f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:41.602114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21cc3-f7a6-41cd-ac10-6578fd65f66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:41.607206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21cc3-f7a6-41cd-ac10-6578fd65f66f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:41.758805 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1851/3674] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:41 2022] POST /identity/v3/projects => generated 393 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:41.765830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21cc3-f7a6-41cd-ac10-6578fd65f66f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.017010 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1824/3675] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:42.019097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665d141-a3f5-4b32-8178-632c1b7ab4ea None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.080247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665d141-a3f5-4b32-8178-632c1b7ab4ea None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.174100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21cc3-f7a6-41cd-ac10-6578fd65f66f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.185896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3b3ab-fdcf-49a2-9312-034feaa6d690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.189727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3b3ab-fdcf-49a2-9312-034feaa6d690 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.191290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3b3ab-fdcf-49a2-9312-034feaa6d690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.191983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3b3ab-fdcf-49a2-9312-034feaa6d690 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.193739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3b3ab-fdcf-49a2-9312-034feaa6d690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:42.199618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3b3ab-fdcf-49a2-9312-034feaa6d690 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:42.269656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:42.288029 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1852/3676] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:41 2022] POST /identity/v3/users => generated 297 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:42.296131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3b3ab-fdcf-49a2-9312-034feaa6d690 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.298324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9c54d-c1bd-4c3d-ba6c-4f9a24252beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.299814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9c54d-c1bd-4c3d-ba6c-4f9a24252beb admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.300514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9c54d-c1bd-4c3d-ba6c-4f9a24252beb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.301990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9c54d-c1bd-4c3d-ba6c-4f9a24252beb admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.302738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9c54d-c1bd-4c3d-ba6c-4f9a24252beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:42.306896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9c54d-c1bd-4c3d-ba6c-4f9a24252beb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:42.353203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3b3ab-fdcf-49a2-9312-034feaa6d690 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.370825 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1825/3677] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:42 2022] POST /identity/v3/projects => generated 393 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:42.373335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9c54d-c1bd-4c3d-ba6c-4f9a24252beb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.391422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127220bb-aae4-4775-8f20-b19002757858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.398990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127220bb-aae4-4775-8f20-b19002757858 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.399521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127220bb-aae4-4775-8f20-b19002757858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.399968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127220bb-aae4-4775-8f20-b19002757858 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.407136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127220bb-aae4-4775-8f20-b19002757858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:42.422383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127220bb-aae4-4775-8f20-b19002757858 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:42.479642 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1853/3678] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:42.483318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127220bb-aae4-4775-8f20-b19002757858 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.527790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127220bb-aae4-4775-8f20-b19002757858 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.601307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9c54d-c1bd-4c3d-ba6c-4f9a24252beb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.623132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:42.626422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fbf85-2b80-418f-8fd1-edb64cd9d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.631430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fbf85-2b80-418f-8fd1-edb64cd9d11b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.632412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fbf85-2b80-418f-8fd1-edb64cd9d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.632874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fbf85-2b80-418f-8fd1-edb64cd9d11b admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.651213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fbf85-2b80-418f-8fd1-edb64cd9d11b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:42.665390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17fbf85-2b80-418f-8fd1-edb64cd9d11b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:42.799918 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1826/3679] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:42 2022] POST /identity/v3/users => generated 303 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:42.815691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fbf85-2b80-418f-8fd1-edb64cd9d11b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.834550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fbf85-2b80-418f-8fd1-edb64cd9d11b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.846519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8567-98d4-4f3d-9558-89769e5cb49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.847610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8567-98d4-4f3d-9558-89769e5cb49a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.847998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8567-98d4-4f3d-9558-89769e5cb49a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.848377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d8567-98d4-4f3d-9558-89769e5cb49a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.850019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d8567-98d4-4f3d-9558-89769e5cb49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:42.852991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d8567-98d4-4f3d-9558-89769e5cb49a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:42.858814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cec46-a446-4e6f-ab99-56b1c8c5d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.865547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cec46-a446-4e6f-ab99-56b1c8c5d4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.866114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cec46-a446-4e6f-ab99-56b1c8c5d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.866607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902cec46-a446-4e6f-ab99-56b1c8c5d4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.868682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cec46-a446-4e6f-ab99-56b1c8c5d4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:42.877950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902cec46-a446-4e6f-ab99-56b1c8c5d4f8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:42.892239 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1827/3680] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:42.893650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8567-98d4-4f3d-9558-89769e5cb49a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.913286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d8567-98d4-4f3d-9558-89769e5cb49a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.922745 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1854/3681] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:42.930528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cec46-a446-4e6f-ab99-56b1c8c5d4f8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:42.933003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e75849-60b2-42b4-85d1-42eddaaea6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.937007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e75849-60b2-42b4-85d1-42eddaaea6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.938449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e75849-60b2-42b4-85d1-42eddaaea6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.938959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e75849-60b2-42b4-85d1-42eddaaea6e2 admin admin] PATH_INFO: `/v3/projects/cef7ed6b641f4d7b98c0a981297e94c2/users/e9c96b5b3ed947be9194a717628288d5/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.964997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902cec46-a446-4e6f-ab99-56b1c8c5d4f8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:42.981831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f47e59-3de8-4661-8019-3e9d83f828b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:42.985514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47e59-3de8-4661-8019-3e9d83f828b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:42.985820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47e59-3de8-4661-8019-3e9d83f828b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:42.986129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f47e59-3de8-4661-8019-3e9d83f828b1 admin admin] PATH_INFO: `/v3/projects/eee30ed0c91547f4829aaa198169adda/users/7a1ce4034c134ee3b5aaed733fa51358/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:42.989993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e75849-60b2-42b4-85d1-42eddaaea6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef7ed6b641f4d7b98c0a981297e94c2, user_id=e9c96b5b3ed947be9194a717628288d5, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:42.993237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e75849-60b2-42b4-85d1-42eddaaea6e2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:43.028984 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1828/3682] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:42 2022] PUT /identity/v3/projects/cef7ed6b641f4d7b98c0a981297e94c2/users/e9c96b5b3ed947be9194a717628288d5/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:43.037137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e75849-60b2-42b4-85d1-42eddaaea6e2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:43.037484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f47e59-3de8-4661-8019-3e9d83f828b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee30ed0c91547f4829aaa198169adda, user_id=7a1ce4034c134ee3b5aaed733fa51358, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:43.047216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f47e59-3de8-4661-8019-3e9d83f828b1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:43.078373 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1855/3683] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:42 2022] PUT /identity/v3/projects/eee30ed0c91547f4829aaa198169adda/users/7a1ce4034c134ee3b5aaed733fa51358/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:43.102473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd880f5-c2e3-43fd-ac46-e649623a9f25 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:43.103029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd880f5-c2e3-43fd-ac46-e649623a9f25 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:43.103372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd880f5-c2e3-43fd-ac46-e649623a9f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:43.192823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e75849-60b2-42b4-85d1-42eddaaea6e2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:43.198732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1bd880f5-c2e3-43fd-ac46-e649623a9f25 None None] MFA Rules not processed for user `7a1ce4034c134ee3b5aaed733fa51358`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:43.211192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1bd880f5-c2e3-43fd-ac46-e649623a9f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:43.285837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:43.351093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96cf2-08d0-422f-add7-9ae006432790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:43.352880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96cf2-08d0-422f-add7-9ae006432790 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:43.353218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96cf2-08d0-422f-add7-9ae006432790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:43.353566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96cf2-08d0-422f-add7-9ae006432790 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:43.354869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb96cf2-08d0-422f-add7-9ae006432790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:43.358697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb96cf2-08d0-422f-add7-9ae006432790 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:43.390690 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1829/3684] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:43.392227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96cf2-08d0-422f-add7-9ae006432790 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:43.418456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96cf2-08d0-422f-add7-9ae006432790 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:43.439089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04847-d4c0-42fc-a184-4c7d720cf6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:43.440524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04847-d4c0-42fc-a184-4c7d720cf6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:43.440810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04847-d4c0-42fc-a184-4c7d720cf6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:43.441103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04847-d4c0-42fc-a184-4c7d720cf6d8 admin admin] PATH_INFO: `/v3/projects/cef7ed6b641f4d7b98c0a981297e94c2/users/e9c96b5b3ed947be9194a717628288d5/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:43.445932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f04847-d4c0-42fc-a184-4c7d720cf6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef7ed6b641f4d7b98c0a981297e94c2, user_id=e9c96b5b3ed947be9194a717628288d5, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:43.452765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f04847-d4c0-42fc-a184-4c7d720cf6d8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:43.454641 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1856/3685] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:43.460052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd880f5-c2e3-43fd-ac46-e649623a9f25 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:43.485706 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1830/3686] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:43 2022] PUT /identity/v3/projects/cef7ed6b641f4d7b98c0a981297e94c2/users/e9c96b5b3ed947be9194a717628288d5/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:43.489465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78f4e-791d-47b2-a573-5fbb7b5d127a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:43.489750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78f4e-791d-47b2-a573-5fbb7b5d127a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:43.490145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d78f4e-791d-47b2-a573-5fbb7b5d127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:43.528902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd880f5-c2e3-43fd-ac46-e649623a9f25 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:43.550457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b8d78f4e-791d-47b2-a573-5fbb7b5d127a None None] MFA Rules not processed for user `e9c96b5b3ed947be9194a717628288d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:43.552483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8d78f4e-791d-47b2-a573-5fbb7b5d127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:43.709345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f5690-1a54-4ea0-88c9-d053a981860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:43.712053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f5690-1a54-4ea0-88c9-d053a981860a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:43.712053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f5690-1a54-4ea0-88c9-d053a981860a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:43.712053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f5690-1a54-4ea0-88c9-d053a981860a admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:43.712053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f5690-1a54-4ea0-88c9-d053a981860a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:43.713730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f5690-1a54-4ea0-88c9-d053a981860a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:43.776780 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1831/3687] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:43.776780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78f4e-791d-47b2-a573-5fbb7b5d127a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:43.778925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8d78f4e-791d-47b2-a573-5fbb7b5d127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:43.796630 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1857/3688] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:43 2022] POST /identity/v3/projects => generated 393 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:29:43.803103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f5690-1a54-4ea0-88c9-d053a981860a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:43.853904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:43.859956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d78f4e-791d-47b2-a573-5fbb7b5d127a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:43.935265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f5690-1a54-4ea0-88c9-d053a981860a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:43.941596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70603a17-b273-4ab3-9350-5a82c5a98461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:43.942363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70603a17-b273-4ab3-9350-5a82c5a98461 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:43.942638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70603a17-b273-4ab3-9350-5a82c5a98461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:43.942903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70603a17-b273-4ab3-9350-5a82c5a98461 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:43.943559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70603a17-b273-4ab3-9350-5a82c5a98461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:43.945917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70603a17-b273-4ab3-9350-5a82c5a98461 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:43.976020 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1858/3689] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:43 2022] POST /identity/v3/users => generated 303 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:43.977150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70603a17-b273-4ab3-9350-5a82c5a98461 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:43.979115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-70603a17-b273-4ab3-9350-5a82c5a98461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:44.116474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:44.120533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:44.121074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:44.125922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] PATH_INFO: `/v3/projects/41558b82b973471db940b53786e6a09e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:44.137922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41558b82b973471db940b53786e6a09e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:44.155295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:44.213915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70603a17-b273-4ab3-9350-5a82c5a98461 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:44.237613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac865df-7ca5-4b15-b9f4-8e5f50f54389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:44.238946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac865df-7ca5-4b15-b9f4-8e5f50f54389 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:44.240797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac865df-7ca5-4b15-b9f4-8e5f50f54389 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:44.241381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac865df-7ca5-4b15-b9f4-8e5f50f54389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:44.380489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:44.385345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41558b82b973471db940b53786e6a09e', 'request_id': 'req-c9729eff-210c-45ae-a82d-7405484fb138'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:44.420749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41558b82b973471db940b53786e6a09e', 'request_id': 'req-c9729eff-210c-45ae-a82d-7405484fb138'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:44.439269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41558b82b973471db940b53786e6a09e', 'request_id': 'req-c9729eff-210c-45ae-a82d-7405484fb138'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:44.452658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac865df-7ca5-4b15-b9f4-8e5f50f54389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:44.466595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac865df-7ca5-4b15-b9f4-8e5f50f54389 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:44.507556 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1859/3690] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:43 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:44.508557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac865df-7ca5-4b15-b9f4-8e5f50f54389 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:44.512060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] The token cache is being invalidate because project 41558b82b973471db940b53786e6a09e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:44.515866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:44.519080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9729eff-210c-45ae-a82d-7405484fb138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:44.531771 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1832/3691] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:43 2022] DELETE /identity/v3/projects/41558b82b973471db940b53786e6a09e => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:44.539763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbcd3a-c94a-4e49-9f95-1b1b4d91cfc9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:44.540235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac865df-7ca5-4b15-b9f4-8e5f50f54389 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:44.541633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbcd3a-c94a-4e49-9f95-1b1b4d91cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:44.545832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbcd3a-c94a-4e49-9f95-1b1b4d91cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:44.634352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:44.663554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8fcbcd3a-c94a-4e49-9f95-1b1b4d91cfc9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:44.664863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8fcbcd3a-c94a-4e49-9f95-1b1b4d91cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:44.732025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc2b4-71b7-462c-8dcb-bca4d56d9a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:44.734674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc2b4-71b7-462c-8dcb-bca4d56d9a5d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:44.735274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc2b4-71b7-462c-8dcb-bca4d56d9a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:44.735702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc2b4-71b7-462c-8dcb-bca4d56d9a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:44.738623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fc2b4-71b7-462c-8dcb-bca4d56d9a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:44.743900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fc2b4-71b7-462c-8dcb-bca4d56d9a5d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:44.780109 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1860/3692] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:44.781956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc2b4-71b7-462c-8dcb-bca4d56d9a5d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:44.787010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-679fc2b4-71b7-462c-8dcb-bca4d56d9a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:44.812071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc2b4-71b7-462c-8dcb-bca4d56d9a5d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:44.842419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6aeffa-c768-4267-a91c-77675bd33b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:44.843524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aeffa-c768-4267-a91c-77675bd33b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:44.843976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aeffa-c768-4267-a91c-77675bd33b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:44.844414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aeffa-c768-4267-a91c-77675bd33b51 admin admin] PATH_INFO: `/v3/projects/5625f9ef743d4550928e6b3455371a09/users/695255d030884d8b9adcacc806e474e3/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:44.881476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6aeffa-c768-4267-a91c-77675bd33b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5625f9ef743d4550928e6b3455371a09, user_id=695255d030884d8b9adcacc806e474e3, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:44.886469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6aeffa-c768-4267-a91c-77675bd33b51 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:44.929749 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1861/3693] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:44 2022] PUT /identity/v3/projects/5625f9ef743d4550928e6b3455371a09/users/695255d030884d8b9adcacc806e474e3/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:44.931746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6aeffa-c768-4267-a91c-77675bd33b51 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:44.997846 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1833/3694] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:45.003079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c9b83-f747-441d-8921-36c7305e737a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.003688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c9b83-f747-441d-8921-36c7305e737a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.004374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c9b83-f747-441d-8921-36c7305e737a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.063726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a61c9b83-f747-441d-8921-36c7305e737a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:45.072840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a61c9b83-f747-441d-8921-36c7305e737a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:45.172702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6aeffa-c768-4267-a91c-77675bd33b51 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:45.195456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44738240-d254-4792-ad3e-ffce6907009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:45.196543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44738240-d254-4792-ad3e-ffce6907009e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.197087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44738240-d254-4792-ad3e-ffce6907009e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.197565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44738240-d254-4792-ad3e-ffce6907009e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.198809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44738240-d254-4792-ad3e-ffce6907009e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:45.202199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44738240-d254-4792-ad3e-ffce6907009e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:45.253052 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1862/3695] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:45.257865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44738240-d254-4792-ad3e-ffce6907009e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:45.301086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44738240-d254-4792-ad3e-ffce6907009e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:45.322744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdfa8c-48d8-4932-9d4d-2f5cc33676be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:45.323989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdfa8c-48d8-4932-9d4d-2f5cc33676be admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.332914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdfa8c-48d8-4932-9d4d-2f5cc33676be admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.333567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdfa8c-48d8-4932-9d4d-2f5cc33676be admin admin] PATH_INFO: `/v3/projects/5625f9ef743d4550928e6b3455371a09/users/695255d030884d8b9adcacc806e474e3/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.342534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdfa8c-48d8-4932-9d4d-2f5cc33676be admin admin] RBAC: Authorizing `identity:create_grant(project_id=5625f9ef743d4550928e6b3455371a09, user_id=695255d030884d8b9adcacc806e474e3, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:45.358103 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1834/3696] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:45.358907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fdfa8c-48d8-4932-9d4d-2f5cc33676be admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:45.364244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c9b83-f747-441d-8921-36c7305e737a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:45.400518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c9b83-f747-441d-8921-36c7305e737a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:45.431281 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1863/3697] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:45 2022] PUT /identity/v3/projects/5625f9ef743d4550928e6b3455371a09/users/695255d030884d8b9adcacc806e474e3/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:45.443873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bea3ee-6628-4e78-a252-7ddd7c3a146f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.444371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bea3ee-6628-4e78-a252-7ddd7c3a146f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.444873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bea3ee-6628-4e78-a252-7ddd7c3a146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.558323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d4bea3ee-6628-4e78-a252-7ddd7c3a146f None None] MFA Rules not processed for user `695255d030884d8b9adcacc806e474e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:45.560693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d4bea3ee-6628-4e78-a252-7ddd7c3a146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:45.627505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ba536-b886-443e-87e5-751dae61c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:45.629143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ba536-b886-443e-87e5-751dae61c00c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.630702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ba536-b886-443e-87e5-751dae61c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.631209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ba536-b886-443e-87e5-751dae61c00c admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.633129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ba536-b886-443e-87e5-751dae61c00c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:45.635702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ba536-b886-443e-87e5-751dae61c00c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:45.643413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ba536-b886-443e-87e5-751dae61c00c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:45.708222 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1835/3698] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:29:45.716395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ba536-b886-443e-87e5-751dae61c00c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:45.771088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ba536-b886-443e-87e5-751dae61c00c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:45.790355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893d0a-a64c-4bd2-8fdd-4f2dad1d5d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:45.790964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893d0a-a64c-4bd2-8fdd-4f2dad1d5d96 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:45.792386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893d0a-a64c-4bd2-8fdd-4f2dad1d5d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:45.793971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893d0a-a64c-4bd2-8fdd-4f2dad1d5d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:45.796088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6893d0a-a64c-4bd2-8fdd-4f2dad1d5d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:45.801159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6893d0a-a64c-4bd2-8fdd-4f2dad1d5d96 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:45.833302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:45.850484 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1864/3699] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:45.883933 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1836/3700] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:45 2022] POST /identity/v3/projects => generated 359 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:45.885574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bea3ee-6628-4e78-a252-7ddd7c3a146f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:45.916024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bea3ee-6628-4e78-a252-7ddd7c3a146f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:45.926691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893d0a-a64c-4bd2-8fdd-4f2dad1d5d96 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:45.929229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f6893d0a-a64c-4bd2-8fdd-4f2dad1d5d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:45.958896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:46.096763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa3a1-9b98-498a-a2de-39367399ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:46.098412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa3a1-9b98-498a-a2de-39367399ba7c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.100897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa3a1-9b98-498a-a2de-39367399ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.101349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa3a1-9b98-498a-a2de-39367399ba7c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.103021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa3a1-9b98-498a-a2de-39367399ba7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:46.106095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa3a1-9b98-498a-a2de-39367399ba7c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:46.130991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893d0a-a64c-4bd2-8fdd-4f2dad1d5d96 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:46.159006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384be0c-48ec-44d9-a832-40c494a5fe0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:46.160585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384be0c-48ec-44d9-a832-40c494a5fe0b service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.161254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384be0c-48ec-44d9-a832-40c494a5fe0b service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.162641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384be0c-48ec-44d9-a832-40c494a5fe0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.168762 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1865/3701] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:45 2022] POST /identity/v3/users => generated 280 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:46.168762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f09c9-467b-4603-800d-f0acfdbeb132 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.168762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f09c9-467b-4603-800d-f0acfdbeb132 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.168762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f09c9-467b-4603-800d-f0acfdbeb132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.202840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3e9f09c9-467b-4603-800d-f0acfdbeb132 None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:46.207603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3e9f09c9-467b-4603-800d-f0acfdbeb132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:46.365974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384be0c-48ec-44d9-a832-40c494a5fe0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:46.367855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384be0c-48ec-44d9-a832-40c494a5fe0b service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:46.395817 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1866/3702] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:46.398216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f09c9-467b-4603-800d-f0acfdbeb132 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:46.407224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3e9f09c9-467b-4603-800d-f0acfdbeb132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:46.422107 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1837/3703] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:45 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:46.422979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384be0c-48ec-44d9-a832-40c494a5fe0b service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:46.461072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384be0c-48ec-44d9-a832-40c494a5fe0b service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:46.466939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f09c9-467b-4603-800d-f0acfdbeb132 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:46.476136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd444388-e4ae-4e6a-ab5e-07e728896874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:46.476136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd444388-e4ae-4e6a-ab5e-07e728896874 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.476136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd444388-e4ae-4e6a-ab5e-07e728896874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.476136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd444388-e4ae-4e6a-ab5e-07e728896874 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.476508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd444388-e4ae-4e6a-ab5e-07e728896874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:46.482431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd444388-e4ae-4e6a-ab5e-07e728896874 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:46.495561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4f16-c5b1-49e0-9268-4cab90cd89f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:46.496971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4f16-c5b1-49e0-9268-4cab90cd89f4 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.498440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4f16-c5b1-49e0-9268-4cab90cd89f4 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.499135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb4f16-c5b1-49e0-9268-4cab90cd89f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.514907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d0cb4f16-c5b1-49e0-9268-4cab90cd89f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:46.522782 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1838/3704] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:46.524218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd444388-e4ae-4e6a-ab5e-07e728896874 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:46.557654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd444388-e4ae-4e6a-ab5e-07e728896874 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:46.585199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511efad-6524-4aa6-aa94-2d0060e9e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:46.586169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511efad-6524-4aa6-aa94-2d0060e9e328 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.595001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511efad-6524-4aa6-aa94-2d0060e9e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.595567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511efad-6524-4aa6-aa94-2d0060e9e328 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.596511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511efad-6524-4aa6-aa94-2d0060e9e328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:46.598687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511efad-6524-4aa6-aa94-2d0060e9e328 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:46.632605 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1839/3705] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:46.649181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511efad-6524-4aa6-aa94-2d0060e9e328 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:46.714914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511efad-6524-4aa6-aa94-2d0060e9e328 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:46.726891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1979a-71a2-4872-a6ea-7fe032242d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:46.728388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1979a-71a2-4872-a6ea-7fe032242d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.728388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1979a-71a2-4872-a6ea-7fe032242d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.728388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1979a-71a2-4872-a6ea-7fe032242d4d admin admin] PATH_INFO: `/v3/projects/da9fd07d6d0440ebabcd7c245e28c4fc/users/725c6389b67a4ead93d42a62a4b46f03/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.805733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1979a-71a2-4872-a6ea-7fe032242d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9fd07d6d0440ebabcd7c245e28c4fc, user_id=725c6389b67a4ead93d42a62a4b46f03, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:46.822739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1979a-71a2-4872-a6ea-7fe032242d4d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:46.860334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb4f16-c5b1-49e0-9268-4cab90cd89f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:46.867964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb4f16-c5b1-49e0-9268-4cab90cd89f4 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:46.873841 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1840/3706] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:46 2022] PUT /identity/v3/projects/da9fd07d6d0440ebabcd7c245e28c4fc/users/725c6389b67a4ead93d42a62a4b46f03/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:46.886256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a6e4-1316-41fc-bdc8-1d7c387bba58 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:46.887043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a6e4-1316-41fc-bdc8-1d7c387bba58 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:46.887931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a6e4-1316-41fc-bdc8-1d7c387bba58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:46.945862 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1867/3707] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:47.011365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4f16-c5b1-49e0-9268-4cab90cd89f4 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:47.024517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d0cb4f16-c5b1-49e0-9268-4cab90cd89f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:47.078630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1757a6e4-1316-41fc-bdc8-1d7c387bba58 None None] MFA Rules not processed for user `725c6389b67a4ead93d42a62a4b46f03`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:47.095520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1757a6e4-1316-41fc-bdc8-1d7c387bba58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:47.166734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb4f16-c5b1-49e0-9268-4cab90cd89f4 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:47.169770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:47.332568 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1841/3708] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:29:47.470185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:47.502544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757a6e4-1316-41fc-bdc8-1d7c387bba58 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:47.508040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:47.509102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:47.509628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:47.510106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] PATH_INFO: `/v3/users/041099b1a6884bd6bea2a401ca0475b1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:47.513438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041099b1a6884bd6bea2a401ca0475b1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:47.523273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:47.706315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041099b1a6884bd6bea2a401ca0475b1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:47.707050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041099b1a6884bd6bea2a401ca0475b1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:47.708186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757a6e4-1316-41fc-bdc8-1d7c387bba58 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:47.730998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041099b1a6884bd6bea2a401ca0475b1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:47.739031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5591f-856f-4805-a394-8ff11a42ebcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:47.740257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5591f-856f-4805-a394-8ff11a42ebcd service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:47.740818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5591f-856f-4805-a394-8ff11a42ebcd service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:47.742155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5591f-856f-4805-a394-8ff11a42ebcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:47.746209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041099b1a6884bd6bea2a401ca0475b1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:47.759665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-30f5591f-856f-4805-a394-8ff11a42ebcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:47.791110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6ebfb81-73f8-4c3f-b737-8b5dc35bc9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041099b1a6884bd6bea2a401ca0475b1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:47.806087 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1868/3709] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:46 2022] DELETE /identity/v3/users/041099b1a6884bd6bea2a401ca0475b1 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:47.808299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72741a-43cd-4261-92e3-81bd2ed1e3a2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:47.808299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72741a-43cd-4261-92e3-81bd2ed1e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:47.808299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72741a-43cd-4261-92e3-81bd2ed1e3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:47.892619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0a72741a-43cd-4261-92e3-81bd2ed1e3a2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:47.893974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0a72741a-43cd-4261-92e3-81bd2ed1e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:48.071983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5591f-856f-4805-a394-8ff11a42ebcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:48.095724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5591f-856f-4805-a394-8ff11a42ebcd service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:48.127586 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1869/3710] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:48.138737 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1842/3711] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:29:48.163271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72741a-43cd-4261-92e3-81bd2ed1e3a2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:48.164837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0a72741a-43cd-4261-92e3-81bd2ed1e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:48.196583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72741a-43cd-4261-92e3-81bd2ed1e3a2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:48.219523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5591f-856f-4805-a394-8ff11a42ebcd service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:48.220141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:48.223984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:48.224279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:48.224567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] PATH_INFO: `/v3/users/7a1ce4034c134ee3b5aaed733fa51358` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:48.228608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1ce4034c134ee3b5aaed733fa51358)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:48.230735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:48.262093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5591f-856f-4805-a394-8ff11a42ebcd service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:48.273021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:48.274404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:48.275185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:48.276037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] PATH_INFO: `/v3/users/725c6389b67a4ead93d42a62a4b46f03` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:48.280680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725c6389b67a4ead93d42a62a4b46f03)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:48.299428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:48.391944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1ce4034c134ee3b5aaed733fa51358'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.393131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1ce4034c134ee3b5aaed733fa51358'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.417480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1ce4034c134ee3b5aaed733fa51358'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.448314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1ce4034c134ee3b5aaed733fa51358'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.452888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:48.474133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725c6389b67a4ead93d42a62a4b46f03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.490753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1ce4034c134ee3b5aaed733fa51358'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.496193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725c6389b67a4ead93d42a62a4b46f03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.498303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:48.515873 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1870/3712] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:48 2022] DELETE /identity/v3/users/7a1ce4034c134ee3b5aaed733fa51358 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:48.520065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:48.532102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:48.569538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725c6389b67a4ead93d42a62a4b46f03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.605668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725c6389b67a4ead93d42a62a4b46f03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.606459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd9b62bc-daf6-45cc-a9b2-99da0abf9369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725c6389b67a4ead93d42a62a4b46f03'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:48.620314 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1843/3713] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:48 2022] DELETE /identity/v3/users/725c6389b67a4ead93d42a62a4b46f03 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:48.621547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed06d-3ad0-4853-9220-7b9a8fb86a34 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:48.621744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed06d-3ad0-4853-9220-7b9a8fb86a34 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:48.622025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ed06d-3ad0-4853-9220-7b9a8fb86a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:48.696418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-405ed06d-3ad0-4853-9220-7b9a8fb86a34 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:48.697719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-405ed06d-3ad0-4853-9220-7b9a8fb86a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:48.746051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e77aa-36cf-4457-8c16-cd5373bc6594 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:48.883865 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1844/3714] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:48.885789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b25e-ad82-4327-aa0b-ad4936c3f05a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:48.886089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b25e-ad82-4327-aa0b-ad4936c3f05a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:48.886374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487b25e-ad82-4327-aa0b-ad4936c3f05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:48.907782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178b61-32c6-4296-874c-4585e4618297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:48.909605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178b61-32c6-4296-874c-4585e4618297 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:48.911916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178b61-32c6-4296-874c-4585e4618297 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:48.912907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178b61-32c6-4296-874c-4585e4618297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:48.918221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-68178b61-32c6-4296-874c-4585e4618297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:48.935151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b487b25e-ad82-4327-aa0b-ad4936c3f05a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:48.936446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b487b25e-ad82-4327-aa0b-ad4936c3f05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:48.952412 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1845/3715] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:48.953760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbae46b-7d89-409b-a571-76930f15a164 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:48.954243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbae46b-7d89-409b-a571-76930f15a164 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:48.954456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbae46b-7d89-409b-a571-76930f15a164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:48.972086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68178b61-32c6-4296-874c-4585e4618297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:49.009478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68178b61-32c6-4296-874c-4585e4618297 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:49.033982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2fbae46b-7d89-409b-a571-76930f15a164 None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:49.035763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2fbae46b-7d89-409b-a571-76930f15a164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:49.070422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1871/3716] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:49.073065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178b61-32c6-4296-874c-4585e4618297 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:49.075688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-68178b61-32c6-4296-874c-4585e4618297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:49.105146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178b61-32c6-4296-874c-4585e4618297 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:49.113213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb7385-9c64-419a-85b5-3ef6c1d4f149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:49.114975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb7385-9c64-419a-85b5-3ef6c1d4f149 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:49.115730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb7385-9c64-419a-85b5-3ef6c1d4f149 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:49.117411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb7385-9c64-419a-85b5-3ef6c1d4f149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:49.143305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb7385-9c64-419a-85b5-3ef6c1d4f149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:49.146764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb7385-9c64-419a-85b5-3ef6c1d4f149 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:49.174354 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1872/3717] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:49.178134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb7385-9c64-419a-85b5-3ef6c1d4f149 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:49.206161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb7385-9c64-419a-85b5-3ef6c1d4f149 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:49.215154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2328-ca49-4c54-9fec-c57d0cec7cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:49.217189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2328-ca49-4c54-9fec-c57d0cec7cdd service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:49.217770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2328-ca49-4c54-9fec-c57d0cec7cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:49.218484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c2328-ca49-4c54-9fec-c57d0cec7cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:49.242041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c2328-ca49-4c54-9fec-c57d0cec7cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:49.244981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c2328-ca49-4c54-9fec-c57d0cec7cdd service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:49.271612 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1873/3718] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:49.280696 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1846/3719] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:50.672374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2328-ca49-4c54-9fec-c57d0cec7cdd service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:50.676002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5d1c2328-ca49-4c54-9fec-c57d0cec7cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:50.744196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c2328-ca49-4c54-9fec-c57d0cec7cdd service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:50.758972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:50.762209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:50.763455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:50.767314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] PATH_INFO: `/v3/projects/da9fd07d6d0440ebabcd7c245e28c4fc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:50.772821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9fd07d6d0440ebabcd7c245e28c4fc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:50.777996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:50.985703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbae46b-7d89-409b-a571-76930f15a164 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:50.987408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9fd07d6d0440ebabcd7c245e28c4fc', 'request_id': 'req-52dd1c89-cbfd-4964-8660-5e4473679b1c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:50.988981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2fbae46b-7d89-409b-a571-76930f15a164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:51.022501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9fd07d6d0440ebabcd7c245e28c4fc', 'request_id': 'req-52dd1c89-cbfd-4964-8660-5e4473679b1c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.052796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbae46b-7d89-409b-a571-76930f15a164 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:51.056899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9fd07d6d0440ebabcd7c245e28c4fc', 'request_id': 'req-52dd1c89-cbfd-4964-8660-5e4473679b1c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.084712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:51.102950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] The token cache is being invalidate because project da9fd07d6d0440ebabcd7c245e28c4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:51.103466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.107570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52dd1c89-cbfd-4964-8660-5e4473679b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.114780 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1874/3720] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:50 2022] DELETE /identity/v3/projects/da9fd07d6d0440ebabcd7c245e28c4fc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:51.123004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f00ce-bdce-4678-af69-102407751379 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:51.123663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f00ce-bdce-4678-af69-102407751379 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:51.124031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f00ce-bdce-4678-af69-102407751379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:51.184394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e14f00ce-bdce-4678-af69-102407751379 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:51.185939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e14f00ce-bdce-4678-af69-102407751379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:51.205579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:51.206660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:51.207901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:51.208455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] PATH_INFO: `/v3/projects/65028e1021d845d5ac6996b5dd1f5b65` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:51.210972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=65028e1021d845d5ac6996b5dd1f5b65)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:51.214240 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1875/3721] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:51.215423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:51.226642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce53b8f-abcd-4b68-ad51-d7a70a3ec304 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:51.227043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce53b8f-abcd-4b68-ad51-d7a70a3ec304 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:51.227278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce53b8f-abcd-4b68-ad51-d7a70a3ec304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:51.241732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:51.278193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4ce53b8f-abcd-4b68-ad51-d7a70a3ec304 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:51.280970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ce53b8f-abcd-4b68-ad51-d7a70a3ec304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:51.317911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65028e1021d845d5ac6996b5dd1f5b65', 'request_id': 'req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.336731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65028e1021d845d5ac6996b5dd1f5b65', 'request_id': 'req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.373792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65028e1021d845d5ac6996b5dd1f5b65', 'request_id': 'req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.422632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] The token cache is being invalidate because project 65028e1021d845d5ac6996b5dd1f5b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:51.423537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.427077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.438637 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1847/3722] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:50 2022] DELETE /identity/v3/projects/65028e1021d845d5ac6996b5dd1f5b65 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:51.442987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:51.446700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:51.482936 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1876/3723] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:51.484868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce53b8f-abcd-4b68-ad51-d7a70a3ec304 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:51.515762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce53b8f-abcd-4b68-ad51-d7a70a3ec304 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:51.524817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bdfec-d7d2-4f37-bd6d-a9f7c29871f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:51.528581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bdfec-d7d2-4f37-bd6d-a9f7c29871f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:51.529143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bdfec-d7d2-4f37-bd6d-a9f7c29871f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:51.530192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bdfec-d7d2-4f37-bd6d-a9f7c29871f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:51.533740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bdfec-d7d2-4f37-bd6d-a9f7c29871f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:51.534861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bdfec-d7d2-4f37-bd6d-a9f7c29871f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:51.540623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bdfec-d7d2-4f37-bd6d-a9f7c29871f0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:51.579585 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1877/3724] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:51.584846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bdfec-d7d2-4f37-bd6d-a9f7c29871f0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:51.614885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bdfec-d7d2-4f37-bd6d-a9f7c29871f0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:51.658913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b8e3-b4fd-42a8-9b1e-03031dab5222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:51.659821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b8e3-b4fd-42a8-9b1e-03031dab5222 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:51.660249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b8e3-b4fd-42a8-9b1e-03031dab5222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:51.661303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55b8e3-b4fd-42a8-9b1e-03031dab5222 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:51.664113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55b8e3-b4fd-42a8-9b1e-03031dab5222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:51.670420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55b8e3-b4fd-42a8-9b1e-03031dab5222 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:51.701382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee42b32-1271-41cc-9fd4-8f1785e7bd9e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:51.715785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:51.717711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:51.718950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:51.719590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] PATH_INFO: `/v3/users/e9c96b5b3ed947be9194a717628288d5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:51.723007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c96b5b3ed947be9194a717628288d5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:51.728417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:51.771992 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1878/3725] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:51 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:51.773007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b8e3-b4fd-42a8-9b1e-03031dab5222 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:51.791525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2f55b8e3-b4fd-42a8-9b1e-03031dab5222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:51.930075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c96b5b3ed947be9194a717628288d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:51.951158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c96b5b3ed947be9194a717628288d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.010758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c96b5b3ed947be9194a717628288d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.042064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c96b5b3ed947be9194a717628288d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.043146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c96b5b3ed947be9194a717628288d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.054416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55b8e3-b4fd-42a8-9b1e-03031dab5222 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:52.061703 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1848/3726] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:51 2022] DELETE /identity/v3/users/e9c96b5b3ed947be9194a717628288d5 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:52.067869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:52.070730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:52.080892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:52.082392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:52.083366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:52.084022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] PATH_INFO: `/v3/projects/eee30ed0c91547f4829aaa198169adda` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:52.086817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee30ed0c91547f4829aaa198169adda)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:52.110237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:52.181391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:52.273946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee30ed0c91547f4829aaa198169adda', 'request_id': 'req-bad170a2-3b79-420e-b62c-a67291cf86e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.293040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee30ed0c91547f4829aaa198169adda', 'request_id': 'req-bad170a2-3b79-420e-b62c-a67291cf86e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.309705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:52.328636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee30ed0c91547f4829aaa198169adda', 'request_id': 'req-bad170a2-3b79-420e-b62c-a67291cf86e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.351470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] The token cache is being invalidate because project eee30ed0c91547f4829aaa198169adda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:52.351757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.353244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.357710 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1879/3727] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:51 2022] DELETE /identity/v3/projects/eee30ed0c91547f4829aaa198169adda => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:52.362303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a6854-7916-426d-af83-93d47a63843f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:52.365669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:52.367235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:52.534942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad170a2-3b79-420e-b62c-a67291cf86e0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:52.546805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7abf0-ff04-4dc5-8547-9f0e7501429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:52.548324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7abf0-ff04-4dc5-8547-9f0e7501429a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:52.548902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7abf0-ff04-4dc5-8547-9f0e7501429a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:52.549473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7abf0-ff04-4dc5-8547-9f0e7501429a admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:52.551443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7abf0-ff04-4dc5-8547-9f0e7501429a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:52.556865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7abf0-ff04-4dc5-8547-9f0e7501429a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:52.563096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:52.563883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:52.564357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:52.564589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] PATH_INFO: `/v3/users/695255d030884d8b9adcacc806e474e3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:52.566087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=695255d030884d8b9adcacc806e474e3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:52.570771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:52.633586 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1849/3728] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:52 2022] POST /identity/v3/users => generated 293 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:52.641664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7abf0-ff04-4dc5-8547-9f0e7501429a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:52.641664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-70d7abf0-ff04-4dc5-8547-9f0e7501429a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:52.676878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7abf0-ff04-4dc5-8547-9f0e7501429a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:52.700327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36b8bb-af99-4728-9e14-efdee6fbbf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:52.704895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36b8bb-af99-4728-9e14-efdee6fbbf50 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:52.707082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36b8bb-af99-4728-9e14-efdee6fbbf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:52.707947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc36b8bb-af99-4728-9e14-efdee6fbbf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:52.709297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36b8bb-af99-4728-9e14-efdee6fbbf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:52.714805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc36b8bb-af99-4728-9e14-efdee6fbbf50 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:52.744647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695255d030884d8b9adcacc806e474e3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.745419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695255d030884d8b9adcacc806e474e3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.757296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695255d030884d8b9adcacc806e474e3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.763859 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1850/3729] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:52.765673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36b8bb-af99-4728-9e14-efdee6fbbf50 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:52.768224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695255d030884d8b9adcacc806e474e3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.784007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc36b8bb-af99-4728-9e14-efdee6fbbf50 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:52.788371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695255d030884d8b9adcacc806e474e3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:52.792296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee716c48-9960-4ff7-8914-2b8ca6a58770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:52.793821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee716c48-9960-4ff7-8914-2b8ca6a58770 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:52.794342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee716c48-9960-4ff7-8914-2b8ca6a58770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:52.794980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee716c48-9960-4ff7-8914-2b8ca6a58770 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:52.795446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee716c48-9960-4ff7-8914-2b8ca6a58770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:52.798453 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1880/3730] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:52 2022] DELETE /identity/v3/users/695255d030884d8b9adcacc806e474e3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:52.798675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee716c48-9960-4ff7-8914-2b8ca6a58770 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:52.817604 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1851/3731] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:52.822687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:52.824455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:52.926708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b7fc0-1913-404b-ad19-3c5219178987 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:52.947371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7447-a3ad-42b3-b120-2c0fa4a82426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:52.948022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7447-a3ad-42b3-b120-2c0fa4a82426 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:52.948862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7447-a3ad-42b3-b120-2c0fa4a82426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:52.948862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f7447-a3ad-42b3-b120-2c0fa4a82426 admin admin] PATH_INFO: `/v3/projects/f20bac72b3e549849fe2f19e9494127a/users/36bbf0c01d0148aeab626e6d1bb1f0ee/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:52.979178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:53.014657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f7447-a3ad-42b3-b120-2c0fa4a82426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f20bac72b3e549849fe2f19e9494127a, user_id=36bbf0c01d0148aeab626e6d1bb1f0ee, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:53.021808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f7447-a3ad-42b3-b120-2c0fa4a82426 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:53.071520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a98c9-8cc3-48f5-9229-26a1e367190c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:53.074387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a98c9-8cc3-48f5-9229-26a1e367190c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:53.074387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a98c9-8cc3-48f5-9229-26a1e367190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:53.080635 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1881/3732] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:52 2022] PUT /identity/v3/projects/f20bac72b3e549849fe2f19e9494127a/users/36bbf0c01d0148aeab626e6d1bb1f0ee/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:53.107975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-652a98c9-8cc3-48f5-9229-26a1e367190c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:53.109365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-652a98c9-8cc3-48f5-9229-26a1e367190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:53.259549 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1852/3733] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:53.305456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7447-a3ad-42b3-b120-2c0fa4a82426 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:53.309163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-553f7447-a3ad-42b3-b120-2c0fa4a82426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:53.475342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f7447-a3ad-42b3-b120-2c0fa4a82426 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:53.503029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace293a-e181-411c-a4cf-6b47304519b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:53.506664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace293a-e181-411c-a4cf-6b47304519b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:53.507057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace293a-e181-411c-a4cf-6b47304519b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:53.507345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace293a-e181-411c-a4cf-6b47304519b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:53.538392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace293a-e181-411c-a4cf-6b47304519b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:53.542407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace293a-e181-411c-a4cf-6b47304519b3 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:53.576082 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1882/3734] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:53.704008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a98c9-8cc3-48f5-9229-26a1e367190c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:53.709138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-652a98c9-8cc3-48f5-9229-26a1e367190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:53.761204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a98c9-8cc3-48f5-9229-26a1e367190c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:53.782021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:53.783360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:53.783832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:53.784914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] PATH_INFO: `/v3/projects/cef7ed6b641f4d7b98c0a981297e94c2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:53.791390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef7ed6b641f4d7b98c0a981297e94c2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:53.800659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:53.915538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace293a-e181-411c-a4cf-6b47304519b3 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:53.916998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1ace293a-e181-411c-a4cf-6b47304519b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:53.975473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:54.023003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef7ed6b641f4d7b98c0a981297e94c2', 'request_id': 'req-fea02452-855e-4282-ad62-e29ef69ad56c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:54.040437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef7ed6b641f4d7b98c0a981297e94c2', 'request_id': 'req-fea02452-855e-4282-ad62-e29ef69ad56c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:54.061535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef7ed6b641f4d7b98c0a981297e94c2', 'request_id': 'req-fea02452-855e-4282-ad62-e29ef69ad56c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:54.098234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace293a-e181-411c-a4cf-6b47304519b3 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:54.112535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] The token cache is being invalidate because project cef7ed6b641f4d7b98c0a981297e94c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:54.114293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:54.116052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fea02452-855e-4282-ad62-e29ef69ad56c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:54.120863 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1853/3735] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:53 2022] DELETE /identity/v3/projects/cef7ed6b641f4d7b98c0a981297e94c2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:54.129230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b68ef-a451-463f-aba2-cb876ca423e8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:54.130665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b68ef-a451-463f-aba2-cb876ca423e8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:54.144692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b68ef-a451-463f-aba2-cb876ca423e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:54.237115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-285b68ef-a451-463f-aba2-cb876ca423e8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:54.241128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-285b68ef-a451-463f-aba2-cb876ca423e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:54.293168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cdde0-f6b1-4b4a-b25c-9c0fce51df4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:54.295850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cdde0-f6b1-4b4a-b25c-9c0fce51df4b service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:54.296659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cdde0-f6b1-4b4a-b25c-9c0fce51df4b service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:54.301091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cdde0-f6b1-4b4a-b25c-9c0fce51df4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:54.308700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-546cdde0-f6b1-4b4a-b25c-9c0fce51df4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:54.351092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cdde0-f6b1-4b4a-b25c-9c0fce51df4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:54.352891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546cdde0-f6b1-4b4a-b25c-9c0fce51df4b service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:54.402979 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1883/3736] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:54.529171 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1854/3737] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:54.533059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f4f5-cf30-41f1-8760-c4c04217ddd6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:54.533552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f4f5-cf30-41f1-8760-c4c04217ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:54.535869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5f4f5-cf30-41f1-8760-c4c04217ddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:54.658319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-03c5f4f5-cf30-41f1-8760-c4c04217ddd6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:54.660897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-03c5f4f5-cf30-41f1-8760-c4c04217ddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:54.703803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b68ef-a451-463f-aba2-cb876ca423e8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:54.705784 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1884/3738] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:54.727820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b68ef-a451-463f-aba2-cb876ca423e8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:54.757929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dc78d-30f8-401f-a04e-4d15b48b35b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:54.758662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dc78d-30f8-401f-a04e-4d15b48b35b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:54.758943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dc78d-30f8-401f-a04e-4d15b48b35b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:54.759216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dc78d-30f8-401f-a04e-4d15b48b35b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:54.759928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dc78d-30f8-401f-a04e-4d15b48b35b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:54.760232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dc78d-30f8-401f-a04e-4d15b48b35b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:54.762512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dc78d-30f8-401f-a04e-4d15b48b35b1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:54.850158 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1855/3739] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:54.855082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5f4f5-cf30-41f1-8760-c4c04217ddd6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:54.878757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5f4f5-cf30-41f1-8760-c4c04217ddd6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:54.895679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f078e-020d-4b66-9986-caa0d3fb9b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:54.900431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f078e-020d-4b66-9986-caa0d3fb9b69 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:54.900837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f078e-020d-4b66-9986-caa0d3fb9b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:54.901124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f078e-020d-4b66-9986-caa0d3fb9b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:54.901909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f078e-020d-4b66-9986-caa0d3fb9b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:54.909454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f078e-020d-4b66-9986-caa0d3fb9b69 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:54.994996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:55.030069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dc78d-30f8-401f-a04e-4d15b48b35b1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:55.037703 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1885/3740] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:54 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:29:55.048452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dc78d-30f8-401f-a04e-4d15b48b35b1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:55.305503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6d44-4c58-4845-a651-eb0d3ae00e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:55.307371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6d44-4c58-4845-a651-eb0d3ae00e24 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.308295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6d44-4c58-4845-a651-eb0d3ae00e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.308768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baa6d44-4c58-4845-a651-eb0d3ae00e24 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.310082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa6d44-4c58-4845-a651-eb0d3ae00e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:55.312623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baa6d44-4c58-4845-a651-eb0d3ae00e24 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:55.364492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f078e-020d-4b66-9986-caa0d3fb9b69 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:55.376755 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1856/3741] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:55 2022] POST /identity/v3/users => generated 286 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:55.385860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f078e-020d-4b66-9986-caa0d3fb9b69 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:55.409538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7bce5-c64c-4745-bb72-4557c78c470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:55.410256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7bce5-c64c-4745-bb72-4557c78c470a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.410539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7bce5-c64c-4745-bb72-4557c78c470a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.410814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7bce5-c64c-4745-bb72-4557c78c470a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.411499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7bce5-c64c-4745-bb72-4557c78c470a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:55.413204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7bce5-c64c-4745-bb72-4557c78c470a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:55.433067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6d44-4c58-4845-a651-eb0d3ae00e24 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:55.442132 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1886/3742] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:55.450135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baa6d44-4c58-4845-a651-eb0d3ae00e24 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:55.460477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28af1c-8437-4e12-8444-39c8f4620705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:55.460477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28af1c-8437-4e12-8444-39c8f4620705 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.460477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28af1c-8437-4e12-8444-39c8f4620705 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.460477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a28af1c-8437-4e12-8444-39c8f4620705 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.461166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28af1c-8437-4e12-8444-39c8f4620705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:55.462760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7bce5-c64c-4745-bb72-4557c78c470a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:55.465012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6ba7bce5-c64c-4745-bb72-4557c78c470a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:55.474535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a28af1c-8437-4e12-8444-39c8f4620705 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:55.501054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7bce5-c64c-4745-bb72-4557c78c470a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:55.520815 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1857/3743] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:55.522635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28af1c-8437-4e12-8444-39c8f4620705 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:55.523710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:55.523710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.524513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.525328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] PATH_INFO: `/v3/projects/5625f9ef743d4550928e6b3455371a09` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.531281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5625f9ef743d4550928e6b3455371a09)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:55.537209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:55.570318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a28af1c-8437-4e12-8444-39c8f4620705 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:55.589023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58048458-360a-4399-b26e-5b109099a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:55.590498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58048458-360a-4399-b26e-5b109099a1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.590982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58048458-360a-4399-b26e-5b109099a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.594927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58048458-360a-4399-b26e-5b109099a1fb admin admin] PATH_INFO: `/v3/projects/b4f3320bdd824252b52d1339b8ba5a20/users/38965eb885c34c2b80359b2667d6e8d7/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.651474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58048458-360a-4399-b26e-5b109099a1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4f3320bdd824252b52d1339b8ba5a20, user_id=38965eb885c34c2b80359b2667d6e8d7, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:55.659176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58048458-360a-4399-b26e-5b109099a1fb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:55.671874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5625f9ef743d4550928e6b3455371a09', 'request_id': 'req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:55.687319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5625f9ef743d4550928e6b3455371a09', 'request_id': 'req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:55.705315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5625f9ef743d4550928e6b3455371a09', 'request_id': 'req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:55.726023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1858/3744] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:55 2022] PUT /identity/v3/projects/b4f3320bdd824252b52d1339b8ba5a20/users/38965eb885c34c2b80359b2667d6e8d7/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:55.730217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58048458-360a-4399-b26e-5b109099a1fb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:55.733543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-58048458-360a-4399-b26e-5b109099a1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:55.750297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:55.781226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] The token cache is being invalidate because project 5625f9ef743d4550928e6b3455371a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:29:55.781759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:55.782888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e4a5c68-7acb-45fa-bc6d-1233661d98aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:55.788529 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1887/3745] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:29:55 2022] DELETE /identity/v3/projects/5625f9ef743d4550928e6b3455371a09 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:55.791149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6130fb-585b-4648-b5e0-3b374c5ce75d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:55.791589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6130fb-585b-4648-b5e0-3b374c5ce75d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:55.792045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6130fb-585b-4648-b5e0-3b374c5ce75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:55.915327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fc6130fb-585b-4648-b5e0-3b374c5ce75d None None] MFA Rules not processed for user `38965eb885c34c2b80359b2667d6e8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:55.917388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fc6130fb-585b-4648-b5e0-3b374c5ce75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:56.123798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58048458-360a-4399-b26e-5b109099a1fb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:56.151947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04c81-f27f-4360-9978-4701f8091c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:56.155784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04c81-f27f-4360-9978-4701f8091c09 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:56.156414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04c81-f27f-4360-9978-4701f8091c09 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:56.159195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04c81-f27f-4360-9978-4701f8091c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:56.164000 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1888/3746] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:56.169722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bbb04c81-f27f-4360-9978-4701f8091c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:56.174690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4fc24-512a-47ff-a9bd-51be3064f57f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:56.177335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4fc24-512a-47ff-a9bd-51be3064f57f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:56.178407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4fc24-512a-47ff-a9bd-51be3064f57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:56.275317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-36c4fc24-512a-47ff-a9bd-51be3064f57f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:56.282971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-36c4fc24-512a-47ff-a9bd-51be3064f57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:56.288187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04c81-f27f-4360-9978-4701f8091c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:56.316580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04c81-f27f-4360-9978-4701f8091c09 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:56.374593 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1859/3747] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:56.446420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:56.470936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04c81-f27f-4360-9978-4701f8091c09 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:56.474636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bbb04c81-f27f-4360-9978-4701f8091c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:56.481427 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1889/3748] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:56.496457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a63e4-ae87-4f60-af4f-228b49f7f1b9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:56.496942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a63e4-ae87-4f60-af4f-228b49f7f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:56.497930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a63e4-ae87-4f60-af4f-228b49f7f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:56.502494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04c81-f27f-4360-9978-4701f8091c09 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:56.513794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad28ad9-450a-46cd-a465-3a6425706b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:56.516636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad28ad9-450a-46cd-a465-3a6425706b18 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:56.517273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad28ad9-450a-46cd-a465-3a6425706b18 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:56.518130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad28ad9-450a-46cd-a465-3a6425706b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:56.538026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad28ad9-450a-46cd-a465-3a6425706b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:56.540053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad28ad9-450a-46cd-a465-3a6425706b18 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:56.561035 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1860/3749] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:56.564502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-de3a63e4-ae87-4f60-af4f-228b49f7f1b9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:56.566001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-de3a63e4-ae87-4f60-af4f-228b49f7f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:56.610376 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1890/3750] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:56.617134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad28ad9-450a-46cd-a465-3a6425706b18 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:56.646654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad28ad9-450a-46cd-a465-3a6425706b18 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:56.655537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37f904-5886-4971-9679-fb42908ac436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:56.656841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37f904-5886-4971-9679-fb42908ac436 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:56.657458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37f904-5886-4971-9679-fb42908ac436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:56.658109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37f904-5886-4971-9679-fb42908ac436 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:56.659522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37f904-5886-4971-9679-fb42908ac436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:29:56.660205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37f904-5886-4971-9679-fb42908ac436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:56.673640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37f904-5886-4971-9679-fb42908ac436 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:56.759496 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1861/3751] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:29:56.768412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a63e4-ae87-4f60-af4f-228b49f7f1b9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:56.786060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a63e4-ae87-4f60-af4f-228b49f7f1b9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:56.799240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c61c4-3968-485f-9061-4ed5e3325d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:56.799779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c61c4-3968-485f-9061-4ed5e3325d23 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:56.800080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c61c4-3968-485f-9061-4ed5e3325d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:56.800386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c61c4-3968-485f-9061-4ed5e3325d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:56.801148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c61c4-3968-485f-9061-4ed5e3325d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:56.803221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c61c4-3968-485f-9061-4ed5e3325d23 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:56.870465 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1891/3752] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:29:56 2022] POST /identity/v3/projects => generated 413 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:56.878341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37f904-5886-4971-9679-fb42908ac436 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:56.921922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37f904-5886-4971-9679-fb42908ac436 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:57.128540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076501c-f4cd-44de-b231-05a0b47de1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:57.130754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076501c-f4cd-44de-b231-05a0b47de1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.133344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076501c-f4cd-44de-b231-05a0b47de1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.134451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076501c-f4cd-44de-b231-05a0b47de1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.137037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076501c-f4cd-44de-b231-05a0b47de1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:57.144316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076501c-f4cd-44de-b231-05a0b47de1d1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:57.215592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c61c4-3968-485f-9061-4ed5e3325d23 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:57.216666 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1862/3753] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:29:56 2022] POST /identity/v3/users => generated 307 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:29:57.231335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c61c4-3968-485f-9061-4ed5e3325d23 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:57.243480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f76f3-7f3e-44cb-9188-509cf4150df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:57.244638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f76f3-7f3e-44cb-9188-509cf4150df3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.250630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f76f3-7f3e-44cb-9188-509cf4150df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.251330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f76f3-7f3e-44cb-9188-509cf4150df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.252581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f76f3-7f3e-44cb-9188-509cf4150df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:57.255004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f76f3-7f3e-44cb-9188-509cf4150df3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:57.285516 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1892/3754] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:57.290899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076501c-f4cd-44de-b231-05a0b47de1d1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:57.311704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076501c-f4cd-44de-b231-05a0b47de1d1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:57.331558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebca6ec-098f-4c4b-81d1-b0bd60db906f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:57.335868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebca6ec-098f-4c4b-81d1-b0bd60db906f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.340687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebca6ec-098f-4c4b-81d1-b0bd60db906f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.342453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebca6ec-098f-4c4b-81d1-b0bd60db906f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.352715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebca6ec-098f-4c4b-81d1-b0bd60db906f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:57.364003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebca6ec-098f-4c4b-81d1-b0bd60db906f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:57.429935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1863/3755] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:29:57.436521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f76f3-7f3e-44cb-9188-509cf4150df3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:57.470423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f76f3-7f3e-44cb-9188-509cf4150df3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:57.535053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57491d87-57de-43b1-9742-dab3c38f6010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:57.539603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57491d87-57de-43b1-9742-dab3c38f6010 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.541327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57491d87-57de-43b1-9742-dab3c38f6010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.542701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57491d87-57de-43b1-9742-dab3c38f6010 admin admin] PATH_INFO: `/v3/projects/f421e020e5bb441692dd0fa885a3b7ae/users/cabd5ca94ba1400ab58cef69212365c8/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.613130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57491d87-57de-43b1-9742-dab3c38f6010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f421e020e5bb441692dd0fa885a3b7ae, user_id=cabd5ca94ba1400ab58cef69212365c8, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:57.615961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57491d87-57de-43b1-9742-dab3c38f6010 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:57.651342 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1893/3756] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:29:57 2022] PUT /identity/v3/projects/f421e020e5bb441692dd0fa885a3b7ae/users/cabd5ca94ba1400ab58cef69212365c8/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:29:57.659879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84edff5-1e26-4ba0-97b1-51e297dd92c7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:57.660359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84edff5-1e26-4ba0-97b1-51e297dd92c7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:57.661589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84edff5-1e26-4ba0-97b1-51e297dd92c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:57.792917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f84edff5-1e26-4ba0-97b1-51e297dd92c7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:57.803863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f84edff5-1e26-4ba0-97b1-51e297dd92c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:57.968231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57491d87-57de-43b1-9742-dab3c38f6010 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:57.970320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-57491d87-57de-43b1-9742-dab3c38f6010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:58.015707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:58.097270 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1864/3757] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:58.147016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84edff5-1e26-4ba0-97b1-51e297dd92c7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:58.150176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f84edff5-1e26-4ba0-97b1-51e297dd92c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:58.191367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57491d87-57de-43b1-9742-dab3c38f6010 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.234273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.235315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.235315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.235640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] PATH_INFO: `/v3/users/38965eb885c34c2b80359b2667d6e8d7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.242402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38965eb885c34c2b80359b2667d6e8d7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:58.244763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:58.345400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38965eb885c34c2b80359b2667d6e8d7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:58.347992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38965eb885c34c2b80359b2667d6e8d7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:58.379343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38965eb885c34c2b80359b2667d6e8d7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:58.402860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38965eb885c34c2b80359b2667d6e8d7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:58.436421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b1c5f66c-7c88-4d03-92b7-713520de95f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38965eb885c34c2b80359b2667d6e8d7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:29:58.450192 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1894/3758] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:29:57 2022] DELETE /identity/v3/users/38965eb885c34c2b80359b2667d6e8d7 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:29:58.458088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26397fc-c3e3-46af-a91f-cb2eabd56186 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.458407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26397fc-c3e3-46af-a91f-cb2eabd56186 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.458650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26397fc-c3e3-46af-a91f-cb2eabd56186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.514847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84edff5-1e26-4ba0-97b1-51e297dd92c7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.549046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b26397fc-c3e3-46af-a91f-cb2eabd56186 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:58.551568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b26397fc-c3e3-46af-a91f-cb2eabd56186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:58.574766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:58.723858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b0650-842c-4d26-b65e-2abb81af2725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.726862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b0650-842c-4d26-b65e-2abb81af2725 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.729625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b0650-842c-4d26-b65e-2abb81af2725 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.729625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b0650-842c-4d26-b65e-2abb81af2725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.739168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8b5b0650-842c-4d26-b65e-2abb81af2725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:58.833573 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1895/3759] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:58.857794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26397fc-c3e3-46af-a91f-cb2eabd56186 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:58.860216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b26397fc-c3e3-46af-a91f-cb2eabd56186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:58.920527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26397fc-c3e3-46af-a91f-cb2eabd56186 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:58.921617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b0650-842c-4d26-b65e-2abb81af2725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:58.924773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b0650-842c-4d26-b65e-2abb81af2725 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:58.939520 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1865/3760] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:58.940265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b5efd-9334-4382-aa03-0dce08954fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:58.941355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b5efd-9334-4382-aa03-0dce08954fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:58.941834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b5efd-9334-4382-aa03-0dce08954fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:58.942337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b5efd-9334-4382-aa03-0dce08954fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:58.963583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b5efd-9334-4382-aa03-0dce08954fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:58.966743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b5efd-9334-4382-aa03-0dce08954fe6 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:29:58.988868 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1896/3761] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:29:59.475950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4caf05-8d71-4a66-9d51-133e61854046 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:59.476234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4caf05-8d71-4a66-9d51-133e61854046 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:59.476489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4caf05-8d71-4a66-9d51-133e61854046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:59.543311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fc4caf05-8d71-4a66-9d51-133e61854046 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:29:59.549601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fc4caf05-8d71-4a66-9d51-133e61854046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:59.665548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:59.713013 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1866/3762] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:29:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:29:59.725620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b5efd-9334-4382-aa03-0dce08954fe6 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:29:59.728182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4e2b5efd-9334-4382-aa03-0dce08954fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:29:59.949967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b5efd-9334-4382-aa03-0dce08954fe6 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:29:59.965121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31415f34-db57-4fad-9167-ad657004de24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:29:59.965689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31415f34-db57-4fad-9167-ad657004de24 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:29:59.966221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31415f34-db57-4fad-9167-ad657004de24 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:29:59.966624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31415f34-db57-4fad-9167-ad657004de24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:29:59.987639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31415f34-db57-4fad-9167-ad657004de24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:29:59.989469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31415f34-db57-4fad-9167-ad657004de24 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:00.011056 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1897/3763] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:00.203207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4caf05-8d71-4a66-9d51-133e61854046 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:00.206279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fc4caf05-8d71-4a66-9d51-133e61854046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:00.267802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4caf05-8d71-4a66-9d51-133e61854046 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:00.283619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:00.288592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.289199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.289674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] PATH_INFO: `/v3/projects/b4f3320bdd824252b52d1339b8ba5a20` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.297431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4f3320bdd824252b52d1339b8ba5a20)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:00.317738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:00.520428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f3320bdd824252b52d1339b8ba5a20', 'request_id': 'req-9a78237f-fba0-4470-8c4a-04a918bd2e7c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:00.552521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f3320bdd824252b52d1339b8ba5a20', 'request_id': 'req-9a78237f-fba0-4470-8c4a-04a918bd2e7c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:00.572757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f3320bdd824252b52d1339b8ba5a20', 'request_id': 'req-9a78237f-fba0-4470-8c4a-04a918bd2e7c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:00.611622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] The token cache is being invalidate because project b4f3320bdd824252b52d1339b8ba5a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:00.618546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:00.620732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a78237f-fba0-4470-8c4a-04a918bd2e7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:00.635168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e002aa1-b670-4a4b-8755-5b404d07e78c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.635490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e002aa1-b670-4a4b-8755-5b404d07e78c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.635756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e002aa1-b670-4a4b-8755-5b404d07e78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.659368 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1867/3764] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:00 2022] DELETE /identity/v3/projects/b4f3320bdd824252b52d1339b8ba5a20 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:00.696010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4e002aa1-b670-4a4b-8755-5b404d07e78c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:00.697334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4e002aa1-b670-4a4b-8755-5b404d07e78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:00.858677 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1898/3765] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:00.862406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b64a-3636-4c62-87c6-c84891b2e97c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.863333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b64a-3636-4c62-87c6-c84891b2e97c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.864065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530b64a-3636-4c62-87c6-c84891b2e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.899627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9530b64a-3636-4c62-87c6-c84891b2e97c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:00.901889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9530b64a-3636-4c62-87c6-c84891b2e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:00.924580 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1868/3766] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:00.925716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e002aa1-b670-4a4b-8755-5b404d07e78c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:00.939084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e002aa1-b670-4a4b-8755-5b404d07e78c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:00.974223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb0984-5dc4-4568-a567-a34f32e25e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:00.976035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb0984-5dc4-4568-a567-a34f32e25e33 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:00.977063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb0984-5dc4-4568-a567-a34f32e25e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:00.977689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb0984-5dc4-4568-a567-a34f32e25e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:00.980560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb0984-5dc4-4568-a567-a34f32e25e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:00.983593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb0984-5dc4-4568-a567-a34f32e25e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:00.987620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb0984-5dc4-4568-a567-a34f32e25e33 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.019177 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1899/3767] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:30:01.029244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530b64a-3636-4c62-87c6-c84891b2e97c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:01.078291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9530b64a-3636-4c62-87c6-c84891b2e97c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:01.100853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5b49-b134-4ae4-8fe6-02e6b3613723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:01.108543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5b49-b134-4ae4-8fe6-02e6b3613723 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.109044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5b49-b134-4ae4-8fe6-02e6b3613723 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.109533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e5b49-b134-4ae4-8fe6-02e6b3613723 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.112382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e5b49-b134-4ae4-8fe6-02e6b3613723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:01.116230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e5b49-b134-4ae4-8fe6-02e6b3613723 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.224347 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1869/3768] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:01 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:01.232085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb0984-5dc4-4568-a567-a34f32e25e33 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:01.252570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb0984-5dc4-4568-a567-a34f32e25e33 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:01.281769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:01.409683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb2c5e-120b-4b9c-8693-88321f44733b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:01.411872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb2c5e-120b-4b9c-8693-88321f44733b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.412459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb2c5e-120b-4b9c-8693-88321f44733b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.412908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb2c5e-120b-4b9c-8693-88321f44733b admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.414268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb2c5e-120b-4b9c-8693-88321f44733b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:01.418698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb2c5e-120b-4b9c-8693-88321f44733b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.495493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5b49-b134-4ae4-8fe6-02e6b3613723 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:01.513297 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1900/3769] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:01 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:01.534356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e5b49-b134-4ae4-8fe6-02e6b3613723 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:01.544071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b5765-ef31-41e0-bb09-479cb37fc62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:01.545508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b5765-ef31-41e0-bb09-479cb37fc62f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.546234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b5765-ef31-41e0-bb09-479cb37fc62f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.546938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b5765-ef31-41e0-bb09-479cb37fc62f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.548367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b5765-ef31-41e0-bb09-479cb37fc62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:01.551758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b5765-ef31-41e0-bb09-479cb37fc62f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.575795 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1870/3770] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:01.583381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb2c5e-120b-4b9c-8693-88321f44733b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:01.607285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb2c5e-120b-4b9c-8693-88321f44733b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:01.631195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505e23c-1f8f-407d-91e8-abe7db4e0ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:01.632235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e23c-1f8f-407d-91e8-abe7db4e0ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.633081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e23c-1f8f-407d-91e8-abe7db4e0ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.633541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e23c-1f8f-407d-91e8-abe7db4e0ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.658380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505e23c-1f8f-407d-91e8-abe7db4e0ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:01.658380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505e23c-1f8f-407d-91e8-abe7db4e0ef5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.741117 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1901/3771] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:01.748850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b5765-ef31-41e0-bb09-479cb37fc62f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:01.786822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b5765-ef31-41e0-bb09-479cb37fc62f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:01.814627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c1f2b-d87c-4276-93a0-054b59a98e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:01.814968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac3135-f116-4d23-8b96-305bac223496 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.815261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac3135-f116-4d23-8b96-305bac223496 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.815534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac3135-f116-4d23-8b96-305bac223496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.816082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c1f2b-d87c-4276-93a0-054b59a98e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.816614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c1f2b-d87c-4276-93a0-054b59a98e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.817061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c1f2b-d87c-4276-93a0-054b59a98e4c admin admin] PATH_INFO: `/v3/projects/1b5cb5820bb9414bb5174473073d33a6/users/72bc94a22eae41b09ba69cd3a595e1e9/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.858246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c1f2b-d87c-4276-93a0-054b59a98e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5cb5820bb9414bb5174473073d33a6, user_id=72bc94a22eae41b09ba69cd3a595e1e9, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:01.861182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c1f2b-d87c-4276-93a0-054b59a98e4c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:01.870235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-40ac3135-f116-4d23-8b96-305bac223496 None None] MFA Rules not processed for user `46f7a2f32b0540fd8bbb2f0ff3073427`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:01.880620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-40ac3135-f116-4d23-8b96-305bac223496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:01.903334 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1871/3772] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:01 2022] PUT /identity/v3/projects/1b5cb5820bb9414bb5174473073d33a6/users/72bc94a22eae41b09ba69cd3a595e1e9/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:01.910296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fde72-b980-4fef-acae-a4cae9c044cf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:01.910583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fde72-b980-4fef-acae-a4cae9c044cf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:01.910852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fde72-b980-4fef-acae-a4cae9c044cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:01.944588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e46fde72-b980-4fef-acae-a4cae9c044cf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:01.945955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e46fde72-b980-4fef-acae-a4cae9c044cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:02.144277 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1902/3773] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:02.145954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2d346-db3c-4e3e-8327-4623ef31cc4e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:02.146327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2d346-db3c-4e3e-8327-4623ef31cc4e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:02.146573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2d346-db3c-4e3e-8327-4623ef31cc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:02.219283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8aa2d346-db3c-4e3e-8327-4623ef31cc4e None None] MFA Rules not processed for user `46f7a2f32b0540fd8bbb2f0ff3073427`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:02.242833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8aa2d346-db3c-4e3e-8327-4623ef31cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:02.277187 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1872/3774] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:02.289366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fde72-b980-4fef-acae-a4cae9c044cf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:02.297115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e46fde72-b980-4fef-acae-a4cae9c044cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:02.396210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:02.568681 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1903/3775] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:02.599818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fde72-b980-4fef-acae-a4cae9c044cf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:02.604946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e1463-bb3f-47d0-9e48-b33388f157ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:02.607730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e1463-bb3f-47d0-9e48-b33388f157ca service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:02.608654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e1463-bb3f-47d0-9e48-b33388f157ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:02.609445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e1463-bb3f-47d0-9e48-b33388f157ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:02.635182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e1463-bb3f-47d0-9e48-b33388f157ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:02.641046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e1463-bb3f-47d0-9e48-b33388f157ca service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:02.682361 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1873/3776] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:04.945577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2d346-db3c-4e3e-8327-4623ef31cc4e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:04.948290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8aa2d346-db3c-4e3e-8327-4623ef31cc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:05.133437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:05.375815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2d346-db3c-4e3e-8327-4623ef31cc4e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:05.407016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8e67c-ee88-4471-8aae-142912139930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:05.411797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8e67c-ee88-4471-8aae-142912139930 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:05.412515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8e67c-ee88-4471-8aae-142912139930 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:05.413178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8e67c-ee88-4471-8aae-142912139930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:05.455237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8e67c-ee88-4471-8aae-142912139930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:05.458772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8e67c-ee88-4471-8aae-142912139930 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:05.558164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1904/3777] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:06.322064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e1463-bb3f-47d0-9e48-b33388f157ca service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:06.324986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dc7e1463-bb3f-47d0-9e48-b33388f157ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:06.668201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e1463-bb3f-47d0-9e48-b33388f157ca service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:06.693904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e99f9-7267-4f25-ad98-7c48fca9cf2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:06.699271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e99f9-7267-4f25-ad98-7c48fca9cf2a service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:06.699743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e99f9-7267-4f25-ad98-7c48fca9cf2a service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:06.700888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e99f9-7267-4f25-ad98-7c48fca9cf2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:06.713114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bc5e99f9-7267-4f25-ad98-7c48fca9cf2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:06.748400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e99f9-7267-4f25-ad98-7c48fca9cf2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:06.750173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e99f9-7267-4f25-ad98-7c48fca9cf2a service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:06.767850 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1874/3778] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:07.370726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113ca7-f7d2-47be-bbab-184489af355d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:07.372045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113ca7-f7d2-47be-bbab-184489af355d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:07.372601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113ca7-f7d2-47be-bbab-184489af355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:07.420471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-54113ca7-f7d2-47be-bbab-184489af355d None None] MFA Rules not processed for user `358a4edea635469d9a9f64e941b6ed53`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:07.426218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-54113ca7-f7d2-47be-bbab-184489af355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:07.605268 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1905/3779] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:10.284319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e99f9-7267-4f25-ad98-7c48fca9cf2a service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:10.286565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bc5e99f9-7267-4f25-ad98-7c48fca9cf2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:10.308000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e99f9-7267-4f25-ad98-7c48fca9cf2a service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:10.328898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63654154-4b54-49c6-b5d5-aed6d075207d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:10.330028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63654154-4b54-49c6-b5d5-aed6d075207d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:10.330776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63654154-4b54-49c6-b5d5-aed6d075207d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:10.332363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63654154-4b54-49c6-b5d5-aed6d075207d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:10.338944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-63654154-4b54-49c6-b5d5-aed6d075207d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:10.381405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63654154-4b54-49c6-b5d5-aed6d075207d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:10.383348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63654154-4b54-49c6-b5d5-aed6d075207d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:10.426723 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1875/3780] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:11.680607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54113ca7-f7d2-47be-bbab-184489af355d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:11.682181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-54113ca7-f7d2-47be-bbab-184489af355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:11.713046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54113ca7-f7d2-47be-bbab-184489af355d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:11.729089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c520c1-2d68-4c4b-87d3-8ca35a58b774 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:11.729748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c520c1-2d68-4c4b-87d3-8ca35a58b774 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:11.730072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c520c1-2d68-4c4b-87d3-8ca35a58b774 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:11.730325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c520c1-2d68-4c4b-87d3-8ca35a58b774 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:11.740761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-41c520c1-2d68-4c4b-87d3-8ca35a58b774 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:11.770008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c520c1-2d68-4c4b-87d3-8ca35a58b774 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:11.772041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c520c1-2d68-4c4b-87d3-8ca35a58b774 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:11.797237 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1906/3781] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:14.951617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50fed-40fb-44a5-8d6a-f1efb4d43f6a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:14.952876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50fed-40fb-44a5-8d6a-f1efb4d43f6a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:14.953197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50fed-40fb-44a5-8d6a-f1efb4d43f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:15.002592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7cc50fed-40fb-44a5-8d6a-f1efb4d43f6a None None] MFA Rules not processed for user `72bc94a22eae41b09ba69cd3a595e1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:15.004763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7cc50fed-40fb-44a5-8d6a-f1efb4d43f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:15.220855 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1876/3782] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:15.406388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c520c1-2d68-4c4b-87d3-8ca35a58b774 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:15.409274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-41c520c1-2d68-4c4b-87d3-8ca35a58b774 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:15.453996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c520c1-2d68-4c4b-87d3-8ca35a58b774 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:15.473547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c834-8480-467e-9d9a-4994e110d61a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:15.474713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c834-8480-467e-9d9a-4994e110d61a service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:15.475256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c834-8480-467e-9d9a-4994e110d61a service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:15.475677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80c834-8480-467e-9d9a-4994e110d61a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:15.501455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80c834-8480-467e-9d9a-4994e110d61a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:15.503886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80c834-8480-467e-9d9a-4994e110d61a service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:15.539479 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1907/3783] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:30:20.693545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5a8d-d3ba-4b9d-bf25-433df9940f98 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:20.694559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5a8d-d3ba-4b9d-bf25-433df9940f98 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:20.694994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb5a8d-d3ba-4b9d-bf25-433df9940f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:20.722668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-64fb5a8d-d3ba-4b9d-bf25-433df9940f98 None None] MFA Rules not processed for user `72bc94a22eae41b09ba69cd3a595e1e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:20.724245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-64fb5a8d-d3ba-4b9d-bf25-433df9940f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:20.752908 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1877/3784] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:23.366436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c834-8480-467e-9d9a-4994e110d61a service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:23.399273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80c834-8480-467e-9d9a-4994e110d61a service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:23.412264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072599-8111-473a-9a32-7ddb44f7fe9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:23.413975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072599-8111-473a-9a32-7ddb44f7fe9d service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:23.414263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072599-8111-473a-9a32-7ddb44f7fe9d service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:23.416484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce072599-8111-473a-9a32-7ddb44f7fe9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:23.431199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ce072599-8111-473a-9a32-7ddb44f7fe9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:23.477082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce072599-8111-473a-9a32-7ddb44f7fe9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:23.485735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce072599-8111-473a-9a32-7ddb44f7fe9d service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:23.525015 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1908/3785] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:29.720343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6ca88-ab45-43d9-8cc6-89623098c7ec None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:29.720955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6ca88-ab45-43d9-8cc6-89623098c7ec None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:29.722859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6ca88-ab45-43d9-8cc6-89623098c7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:29.802112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:29.813182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-49e6ca88-ab45-43d9-8cc6-89623098c7ec None None] MFA Rules not processed for user `36bbf0c01d0148aeab626e6d1bb1f0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:29.823546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-49e6ca88-ab45-43d9-8cc6-89623098c7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:30.023019 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1878/3786] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:31.622630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072599-8111-473a-9a32-7ddb44f7fe9d service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:31.647019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce072599-8111-473a-9a32-7ddb44f7fe9d service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:31.657310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd0df7-f5dd-412b-87c8-9224d7e9b9f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:31.658198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd0df7-f5dd-412b-87c8-9224d7e9b9f7 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:31.658942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd0df7-f5dd-412b-87c8-9224d7e9b9f7 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:31.659970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd0df7-f5dd-412b-87c8-9224d7e9b9f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:31.672332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd0df7-f5dd-412b-87c8-9224d7e9b9f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:31.674495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd0df7-f5dd-412b-87c8-9224d7e9b9f7 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:31.702090 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1909/3787] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:36.179796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5c7e-b278-4e13-bbd2-8ec8142eb737 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.182464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5c7e-b278-4e13-bbd2-8ec8142eb737 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.183952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f5c7e-b278-4e13-bbd2-8ec8142eb737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:36.244883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-162f5c7e-b278-4e13-bbd2-8ec8142eb737 None None] MFA Rules not processed for user `cabd5ca94ba1400ab58cef69212365c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:36.248808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-162f5c7e-b278-4e13-bbd2-8ec8142eb737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:36.344982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b335299-c6a3-4e57-a525-30a00cc4de11 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.353069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b335299-c6a3-4e57-a525-30a00cc4de11 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.353474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b335299-c6a3-4e57-a525-30a00cc4de11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:36.376798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=70 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:36.428363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2b335299-c6a3-4e57-a525-30a00cc4de11 None None] MFA Rules not processed for user `36bbf0c01d0148aeab626e6d1bb1f0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:36.433762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b335299-c6a3-4e57-a525-30a00cc4de11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:36.471250 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1910/3788] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:36.485961 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1879/3789] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:36 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:36.494685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e11cc-73cf-44a5-9dbf-ebeefb7de8d0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:36.495622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e11cc-73cf-44a5-9dbf-ebeefb7de8d0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:36.497552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e11cc-73cf-44a5-9dbf-ebeefb7de8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:36.631672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-336e11cc-73cf-44a5-9dbf-ebeefb7de8d0 None None] MFA Rules not processed for user `cabd5ca94ba1400ab58cef69212365c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:36.633314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-336e11cc-73cf-44a5-9dbf-ebeefb7de8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:36.659958 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1911/3790] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:36 2022] POST /identity/v3/auth/tokens => generated 3290 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:37.618580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f5c7e-b278-4e13-bbd2-8ec8142eb737 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:37.656781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f5c7e-b278-4e13-bbd2-8ec8142eb737 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:37.674677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed1231-206c-4095-9cba-74fb90501f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:37.677436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1231-206c-4095-9cba-74fb90501f59 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:37.689213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1231-206c-4095-9cba-74fb90501f59 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:37.689934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed1231-206c-4095-9cba-74fb90501f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:37.716573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed1231-206c-4095-9cba-74fb90501f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:37.720862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed1231-206c-4095-9cba-74fb90501f59 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:37.750442 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1880/3791] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:37 2022] GET /identity/v3/auth/tokens => generated 3290 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:39.572824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e11cc-73cf-44a5-9dbf-ebeefb7de8d0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:39.591148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e11cc-73cf-44a5-9dbf-ebeefb7de8d0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:39.607920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a076846-ccac-401f-a8a3-1ac115f288b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:39.609319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a076846-ccac-401f-a8a3-1ac115f288b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:39.610030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a076846-ccac-401f-a8a3-1ac115f288b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:39.610472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a076846-ccac-401f-a8a3-1ac115f288b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:39.612898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7a076846-ccac-401f-a8a3-1ac115f288b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:39.642501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a076846-ccac-401f-a8a3-1ac115f288b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:39.644302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a076846-ccac-401f-a8a3-1ac115f288b5 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:39.674325 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1912/3792] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:46.728266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e498-87da-48f9-a8cc-8069ec351c0b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:46.729309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e498-87da-48f9-a8cc-8069ec351c0b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:46.729642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104e498-87da-48f9-a8cc-8069ec351c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:46.764664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d104e498-87da-48f9-a8cc-8069ec351c0b None None] MFA Rules not processed for user `9a950251fb8644ec807a403a7e5cc53b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:46.766290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d104e498-87da-48f9-a8cc-8069ec351c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:46.929148 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1881/3793] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:48.701313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a076846-ccac-401f-a8a3-1ac115f288b5 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:48.724363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a076846-ccac-401f-a8a3-1ac115f288b5 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:48.733237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954105a4-dd71-434d-a0ed-ba6abc7137d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:48.734193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954105a4-dd71-434d-a0ed-ba6abc7137d1 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:48.734628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954105a4-dd71-434d-a0ed-ba6abc7137d1 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:48.735055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954105a4-dd71-434d-a0ed-ba6abc7137d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:48.737906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-954105a4-dd71-434d-a0ed-ba6abc7137d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:48.758349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954105a4-dd71-434d-a0ed-ba6abc7137d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:48.760809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954105a4-dd71-434d-a0ed-ba6abc7137d1 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:48.776968 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1913/3794] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:51.781901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e498-87da-48f9-a8cc-8069ec351c0b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:51.783938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d104e498-87da-48f9-a8cc-8069ec351c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:51.807888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104e498-87da-48f9-a8cc-8069ec351c0b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:51.815030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:51.816166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:51.816695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:51.817199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] PATH_INFO: `/v3/users/2d8dfc007dc44ab1b63b594796172cad` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:51.820131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8dfc007dc44ab1b63b594796172cad)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:51.822409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:51.852715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:51.903848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8dfc007dc44ab1b63b594796172cad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:51.916001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8dfc007dc44ab1b63b594796172cad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:51.933462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8dfc007dc44ab1b63b594796172cad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:51.950560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8dfc007dc44ab1b63b594796172cad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:51.952831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8dfc007dc44ab1b63b594796172cad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:51.978004 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1882/3795] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:51 2022] DELETE /identity/v3/users/2d8dfc007dc44ab1b63b594796172cad => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:52.267249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954105a4-dd71-434d-a0ed-ba6abc7137d1 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:52.301702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954105a4-dd71-434d-a0ed-ba6abc7137d1 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:52.438326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:52.441964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:52.442310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:52.442590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] PATH_INFO: `/v3/projects/d3d737e34eb8482086ffd7cece0a1803` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:52.444884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d737e34eb8482086ffd7cece0a1803)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:52.448551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:52.569675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d737e34eb8482086ffd7cece0a1803', 'request_id': 'req-9b6d77d5-b644-431a-b1b7-5225bedc6c08'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:52.601777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d737e34eb8482086ffd7cece0a1803', 'request_id': 'req-9b6d77d5-b644-431a-b1b7-5225bedc6c08'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:52.634069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d737e34eb8482086ffd7cece0a1803', 'request_id': 'req-9b6d77d5-b644-431a-b1b7-5225bedc6c08'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:52.676605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] The token cache is being invalidate because project d3d737e34eb8482086ffd7cece0a1803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:52.677318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:52.678529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:52.681972 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1914/3796] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:52 2022] DELETE /identity/v3/projects/d3d737e34eb8482086ffd7cece0a1803 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:52.687651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:52.689540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:52.723464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f2580-e57b-429f-9f92-f54428871adc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:52.832696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:52.834297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:52.834771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:52.835380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] PATH_INFO: `/v3/users/635e6fcdf27c4f79aec507ade4821330` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:52.837533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=635e6fcdf27c4f79aec507ade4821330)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:52.842068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:52.912500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '635e6fcdf27c4f79aec507ade4821330'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:52.921748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '635e6fcdf27c4f79aec507ade4821330'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:52.954815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '635e6fcdf27c4f79aec507ade4821330'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:52.962273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '635e6fcdf27c4f79aec507ade4821330'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:52.962273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-690ad354-bac9-4a17-8308-02f57bfc35bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '635e6fcdf27c4f79aec507ade4821330'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:52.975245 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1883/3797] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:52 2022] DELETE /identity/v3/users/635e6fcdf27c4f79aec507ade4821330 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:54.070951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:54.073095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:54.160767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d77d5-b644-431a-b1b7-5225bedc6c08 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:54.284745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:54.312530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:54.314020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:54.314795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:54.315967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] PATH_INFO: `/v3/projects/96aed8ffe54a470dbd5838f03d3b5b55` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:54.318064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96aed8ffe54a470dbd5838f03d3b5b55)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:54.322323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:54.397324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96aed8ffe54a470dbd5838f03d3b5b55', 'request_id': 'req-02786326-5f5a-4372-b983-be64358d7079'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:54.407413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96aed8ffe54a470dbd5838f03d3b5b55', 'request_id': 'req-02786326-5f5a-4372-b983-be64358d7079'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:54.420975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96aed8ffe54a470dbd5838f03d3b5b55', 'request_id': 'req-02786326-5f5a-4372-b983-be64358d7079'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:54.439768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] The token cache is being invalidate because project 96aed8ffe54a470dbd5838f03d3b5b55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:54.441088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:54.441948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02786326-5f5a-4372-b983-be64358d7079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:54.444768 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1915/3798] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:54 2022] DELETE /identity/v3/projects/96aed8ffe54a470dbd5838f03d3b5b55 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:54.451461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3aeb5-1061-4a69-a8df-841ad6e0fce8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:54.452492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3aeb5-1061-4a69-a8df-841ad6e0fce8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:54.452492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3aeb5-1061-4a69-a8df-841ad6e0fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:54.493135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6ee3aeb5-1061-4a69-a8df-841ad6e0fce8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:54.495870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6ee3aeb5-1061-4a69-a8df-841ad6e0fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:54.521077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:54.624970 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1884/3799] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:54.638566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed538de-19f2-4bea-8dc4-175e5aac0385 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:54.639138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed538de-19f2-4bea-8dc4-175e5aac0385 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:54.639694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed538de-19f2-4bea-8dc4-175e5aac0385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:54.671390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bed538de-19f2-4bea-8dc4-175e5aac0385 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:54.673296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bed538de-19f2-4bea-8dc4-175e5aac0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:54.693377 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1916/3800] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:54.700604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3aeb5-1061-4a69-a8df-841ad6e0fce8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:54.724496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3aeb5-1061-4a69-a8df-841ad6e0fce8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:54.735582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81254abe-7981-457b-94f5-187cd814817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:54.737277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81254abe-7981-457b-94f5-187cd814817d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:54.738360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81254abe-7981-457b-94f5-187cd814817d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:54.739189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81254abe-7981-457b-94f5-187cd814817d admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:54.740902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81254abe-7981-457b-94f5-187cd814817d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:54.742106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81254abe-7981-457b-94f5-187cd814817d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:54.745742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81254abe-7981-457b-94f5-187cd814817d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:54.773947 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1885/3801] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:30:54.781221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed538de-19f2-4bea-8dc4-175e5aac0385 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:54.803737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed538de-19f2-4bea-8dc4-175e5aac0385 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:54.812675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d53262-dedc-402a-b26f-2197ea484172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:54.813924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d53262-dedc-402a-b26f-2197ea484172 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:54.814338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d53262-dedc-402a-b26f-2197ea484172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:54.814757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d53262-dedc-402a-b26f-2197ea484172 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:54.816238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d53262-dedc-402a-b26f-2197ea484172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:54.820441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d53262-dedc-402a-b26f-2197ea484172 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:54.877278 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1917/3802] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:54 2022] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:54.884472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81254abe-7981-457b-94f5-187cd814817d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:54.905362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81254abe-7981-457b-94f5-187cd814817d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:55.043445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d1f2a-4f65-4eff-b683-3a74ae11d8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:55.044751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d1f2a-4f65-4eff-b683-3a74ae11d8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:55.045357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d1f2a-4f65-4eff-b683-3a74ae11d8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:55.046003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d1f2a-4f65-4eff-b683-3a74ae11d8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:55.047419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d1f2a-4f65-4eff-b683-3a74ae11d8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:55.051836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d1f2a-4f65-4eff-b683-3a74ae11d8b3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:55.102132 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1886/3803] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:54 2022] POST /identity/v3/users => generated 299 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:30:55.104111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d53262-dedc-402a-b26f-2197ea484172 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:55.123349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d53262-dedc-402a-b26f-2197ea484172 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:55.134008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7ae2-bae4-43bf-928a-3ae3fcd15424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:55.135170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7ae2-bae4-43bf-928a-3ae3fcd15424 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:55.136371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7ae2-bae4-43bf-928a-3ae3fcd15424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:55.137493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a7ae2-bae4-43bf-928a-3ae3fcd15424 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:55.138507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a7ae2-bae4-43bf-928a-3ae3fcd15424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:55.142596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a7ae2-bae4-43bf-928a-3ae3fcd15424 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:55.156890 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1918/3804] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:55.162548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d1f2a-4f65-4eff-b683-3a74ae11d8b3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:55.182924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d1f2a-4f65-4eff-b683-3a74ae11d8b3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:55.191511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ba1c8-fbd8-488e-a4fe-e9c52526a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:55.192553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ba1c8-fbd8-488e-a4fe-e9c52526a606 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:55.193016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ba1c8-fbd8-488e-a4fe-e9c52526a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:55.193465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ba1c8-fbd8-488e-a4fe-e9c52526a606 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:55.194676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ba1c8-fbd8-488e-a4fe-e9c52526a606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:55.197789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ba1c8-fbd8-488e-a4fe-e9c52526a606 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:55.228774 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1887/3805] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:55.242288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7ae2-bae4-43bf-928a-3ae3fcd15424 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:55.265150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a7ae2-bae4-43bf-928a-3ae3fcd15424 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:55.279838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa39dd4-0da4-443e-aacb-b72aad55e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:55.280329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39dd4-0da4-443e-aacb-b72aad55e99f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:55.280816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39dd4-0da4-443e-aacb-b72aad55e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:55.281672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa39dd4-0da4-443e-aacb-b72aad55e99f admin admin] PATH_INFO: `/v3/projects/18fe98d072ac4dd8a312c30f4267ef23/users/afb66e4243204192acf54cf0a02fe777/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:55.322456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa39dd4-0da4-443e-aacb-b72aad55e99f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18fe98d072ac4dd8a312c30f4267ef23, user_id=afb66e4243204192acf54cf0a02fe777, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:55.328269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa39dd4-0da4-443e-aacb-b72aad55e99f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:55.354128 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1919/3806] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:55 2022] PUT /identity/v3/projects/18fe98d072ac4dd8a312c30f4267ef23/users/afb66e4243204192acf54cf0a02fe777/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:55.366449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c6bcf-dfe7-4d4d-bc95-854c894fab2b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:55.366931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c6bcf-dfe7-4d4d-bc95-854c894fab2b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:55.367399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c6bcf-dfe7-4d4d-bc95-854c894fab2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:55.473483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5b4c6bcf-dfe7-4d4d-bc95-854c894fab2b None None] MFA Rules not processed for user `afb66e4243204192acf54cf0a02fe777`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:55.475918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5b4c6bcf-dfe7-4d4d-bc95-854c894fab2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:55.636969 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1888/3807] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:55.657388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355eeff-9d61-4248-bd78-557c446dd32f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:55.657756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355eeff-9d61-4248-bd78-557c446dd32f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:55.658109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355eeff-9d61-4248-bd78-557c446dd32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:55.696299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d355eeff-9d61-4248-bd78-557c446dd32f None None] MFA Rules not processed for user `afb66e4243204192acf54cf0a02fe777`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:55.699919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d355eeff-9d61-4248-bd78-557c446dd32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:55.713807 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1920/3808] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:55.727266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c6bcf-dfe7-4d4d-bc95-854c894fab2b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:55.732180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5b4c6bcf-dfe7-4d4d-bc95-854c894fab2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:55.756662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:55.853289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c6bcf-dfe7-4d4d-bc95-854c894fab2b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:55.860236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d29e9-db3a-44b4-b2e8-ec6315c8ba3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:55.860886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d29e9-db3a-44b4-b2e8-ec6315c8ba3f service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:55.861166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d29e9-db3a-44b4-b2e8-ec6315c8ba3f service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:55.861436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d29e9-db3a-44b4-b2e8-ec6315c8ba3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:55.872076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d29e9-db3a-44b4-b2e8-ec6315c8ba3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:55.874563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d29e9-db3a-44b4-b2e8-ec6315c8ba3f service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:55.892478 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1889/3809] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:55 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:55.925049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7f1b-58db-4275-b5b7-753b2c9f893f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:55.925417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7f1b-58db-4275-b5b7-753b2c9f893f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:55.925774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a7f1b-58db-4275-b5b7-753b2c9f893f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:55.947654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7a1a7f1b-58db-4275-b5b7-753b2c9f893f None None] MFA Rules not processed for user `afb66e4243204192acf54cf0a02fe777`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:55.949080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7a1a7f1b-58db-4275-b5b7-753b2c9f893f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:55.956824 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1921/3810] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:55.989417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0359e8-47b6-421b-a48e-ba2c689c46e1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:55.989755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0359e8-47b6-421b-a48e-ba2c689c46e1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:55.989994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0359e8-47b6-421b-a48e-ba2c689c46e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:56.012445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3b0359e8-47b6-421b-a48e-ba2c689c46e1 None None] MFA Rules not processed for user `afb66e4243204192acf54cf0a02fe777`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:56.014132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3b0359e8-47b6-421b-a48e-ba2c689c46e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:56.022204 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1890/3811] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:56.071915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb63e-9cf7-4e8e-81c6-eec4a61bde4e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:56.072415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb63e-9cf7-4e8e-81c6-eec4a61bde4e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:56.072919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb63e-9cf7-4e8e-81c6-eec4a61bde4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:56.112966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9e1bb63e-9cf7-4e8e-81c6-eec4a61bde4e None None] MFA Rules not processed for user `afb66e4243204192acf54cf0a02fe777`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:56.115223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9e1bb63e-9cf7-4e8e-81c6-eec4a61bde4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:56.134324 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1922/3812] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:56.359628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462525a5-1753-4830-b10a-35d33821bc77 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:56.359628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462525a5-1753-4830-b10a-35d33821bc77 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:56.359628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462525a5-1753-4830-b10a-35d33821bc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:56.389731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-462525a5-1753-4830-b10a-35d33821bc77 None None] MFA Rules not processed for user `afb66e4243204192acf54cf0a02fe777`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:56.391053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-462525a5-1753-4830-b10a-35d33821bc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:56.398819 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1891/3813] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:56 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:56.426662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bb63e-9cf7-4e8e-81c6-eec4a61bde4e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:56.553413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bb63e-9cf7-4e8e-81c6-eec4a61bde4e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:56.561923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:56.563069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:56.563556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:56.564049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] PATH_INFO: `/v3/users/afb66e4243204192acf54cf0a02fe777` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:56.566561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb66e4243204192acf54cf0a02fe777)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:56.570357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:56.573441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:56.648033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb66e4243204192acf54cf0a02fe777'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:56.649056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb66e4243204192acf54cf0a02fe777'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:56.659976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb66e4243204192acf54cf0a02fe777'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:56.672318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb66e4243204192acf54cf0a02fe777'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:56.695874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb66e4243204192acf54cf0a02fe777'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:56.704587 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1923/3814] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:30:56 2022] DELETE /identity/v3/users/afb66e4243204192acf54cf0a02fe777 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:56.712151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573a4d-fa98-4ae6-ab60-3168e72e438a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:56.712998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573a4d-fa98-4ae6-ab60-3168e72e438a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:56.713182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573a4d-fa98-4ae6-ab60-3168e72e438a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:56.746985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d1573a4d-fa98-4ae6-ab60-3168e72e438a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:56.749243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d1573a4d-fa98-4ae6-ab60-3168e72e438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:56.861274 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1892/3815] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:56.882492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:56.885778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:56.995431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92573610-831a-424a-acae-a535c0ee1f10 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:57.002547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab191d-4e99-4338-9f07-93f0707d3c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:57.003649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab191d-4e99-4338-9f07-93f0707d3c29 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:57.004218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab191d-4e99-4338-9f07-93f0707d3c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:57.004761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab191d-4e99-4338-9f07-93f0707d3c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:57.022584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab191d-4e99-4338-9f07-93f0707d3c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:57.025858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab191d-4e99-4338-9f07-93f0707d3c29 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:57.047983 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1924/3816] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:30:57.650428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573a4d-fa98-4ae6-ab60-3168e72e438a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:57.653259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d1573a4d-fa98-4ae6-ab60-3168e72e438a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:57.700898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573a4d-fa98-4ae6-ab60-3168e72e438a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:57.728815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:57.730231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:57.730777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:57.731178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] PATH_INFO: `/v3/projects/18fe98d072ac4dd8a312c30f4267ef23` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:57.735211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18fe98d072ac4dd8a312c30f4267ef23)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:57.739978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:57.842805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18fe98d072ac4dd8a312c30f4267ef23', 'request_id': 'req-35b927de-a038-4e1b-aa03-2ea7f7e320b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.853541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18fe98d072ac4dd8a312c30f4267ef23', 'request_id': 'req-35b927de-a038-4e1b-aa03-2ea7f7e320b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.863265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18fe98d072ac4dd8a312c30f4267ef23', 'request_id': 'req-35b927de-a038-4e1b-aa03-2ea7f7e320b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.879319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] The token cache is being invalidate because project 18fe98d072ac4dd8a312c30f4267ef23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:30:57.879780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.880614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35b927de-a038-4e1b-aa03-2ea7f7e320b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:30:57.882905 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1893/3817] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:30:57 2022] DELETE /identity/v3/projects/18fe98d072ac4dd8a312c30f4267ef23 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:57.891073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881071-e762-4411-a92e-aa35313c9ff9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:57.891816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881071-e762-4411-a92e-aa35313c9ff9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:57.892006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881071-e762-4411-a92e-aa35313c9ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:57.932696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0c881071-e762-4411-a92e-aa35313c9ff9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:57.935649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0c881071-e762-4411-a92e-aa35313c9ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:58.053178 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1925/3818] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:58.063892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ef82-b272-4841-b36c-4fb320dff6ba None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:58.064239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ef82-b272-4841-b36c-4fb320dff6ba None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:58.064458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ef82-b272-4841-b36c-4fb320dff6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:58.082719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:58.090764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ba08ef82-b272-4841-b36c-4fb320dff6ba None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:58.093726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ba08ef82-b272-4841-b36c-4fb320dff6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:58.104464 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1894/3819] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:30:58.109662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c881071-e762-4411-a92e-aa35313c9ff9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:58.121907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c881071-e762-4411-a92e-aa35313c9ff9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:58.127574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addd63f-a591-4244-b1fe-ff0cd5ca3fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:58.128316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd63f-a591-4244-b1fe-ff0cd5ca3fff admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:58.128523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd63f-a591-4244-b1fe-ff0cd5ca3fff admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:58.128790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd63f-a591-4244-b1fe-ff0cd5ca3fff admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:58.129504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addd63f-a591-4244-b1fe-ff0cd5ca3fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:30:58.129773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addd63f-a591-4244-b1fe-ff0cd5ca3fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:58.131489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addd63f-a591-4244-b1fe-ff0cd5ca3fff admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:58.152118 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1926/3820] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:30:58.153586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ef82-b272-4841-b36c-4fb320dff6ba None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:58.163948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ef82-b272-4841-b36c-4fb320dff6ba None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:58.172658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1e7da-ac99-4d35-8aa6-17d70a9b87d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:58.173319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1e7da-ac99-4d35-8aa6-17d70a9b87d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:58.173597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1e7da-ac99-4d35-8aa6-17d70a9b87d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:58.173866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1e7da-ac99-4d35-8aa6-17d70a9b87d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:58.174567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1e7da-ac99-4d35-8aa6-17d70a9b87d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:58.176548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1e7da-ac99-4d35-8aa6-17d70a9b87d5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:58.222140 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1895/3821] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:30:58 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:58.228557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addd63f-a591-4244-b1fe-ff0cd5ca3fff admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:58.245071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addd63f-a591-4244-b1fe-ff0cd5ca3fff admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:58.251459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:58.326382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03c2fb-0315-4cac-9c67-75d1d96dbd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:58.327128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c2fb-0315-4cac-9c67-75d1d96dbd9d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:58.327438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c2fb-0315-4cac-9c67-75d1d96dbd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:58.327743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c2fb-0315-4cac-9c67-75d1d96dbd9d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:58.328446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03c2fb-0315-4cac-9c67-75d1d96dbd9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:58.330630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03c2fb-0315-4cac-9c67-75d1d96dbd9d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:58.359114 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1927/3822] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:30:58 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:30:58.364852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1e7da-ac99-4d35-8aa6-17d70a9b87d5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:58.378506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1e7da-ac99-4d35-8aa6-17d70a9b87d5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:58.384101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ffc0-dbbd-4f31-809e-284efc438853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:58.384747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ffc0-dbbd-4f31-809e-284efc438853 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:58.385026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ffc0-dbbd-4f31-809e-284efc438853 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:58.385297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ffc0-dbbd-4f31-809e-284efc438853 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:58.386507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36ffc0-dbbd-4f31-809e-284efc438853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:58.389334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b36ffc0-dbbd-4f31-809e-284efc438853 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:58.401664 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1896/3823] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:58.407333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03c2fb-0315-4cac-9c67-75d1d96dbd9d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:58.422024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03c2fb-0315-4cac-9c67-75d1d96dbd9d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:58.429019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04d61e-61a4-40de-8d9d-7b35c79c57ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:58.429987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04d61e-61a4-40de-8d9d-7b35c79c57ec admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:58.430406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04d61e-61a4-40de-8d9d-7b35c79c57ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:58.430808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04d61e-61a4-40de-8d9d-7b35c79c57ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:58.432363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04d61e-61a4-40de-8d9d-7b35c79c57ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:58.434832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04d61e-61a4-40de-8d9d-7b35c79c57ec admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:58.450519 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1928/3824] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:30:58.456061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ffc0-dbbd-4f31-809e-284efc438853 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:58.475511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36ffc0-dbbd-4f31-809e-284efc438853 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:58.484898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c591ad-91e3-45dc-b974-cee4e76da379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:58.486256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c591ad-91e3-45dc-b974-cee4e76da379 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:58.486834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c591ad-91e3-45dc-b974-cee4e76da379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:58.487432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c591ad-91e3-45dc-b974-cee4e76da379 admin admin] PATH_INFO: `/v3/projects/c3cddae9f4e7420f8b6acdc11db5ca1f/users/8b289f82629141c1917a8138f2584783/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:58.518846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c591ad-91e3-45dc-b974-cee4e76da379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cddae9f4e7420f8b6acdc11db5ca1f, user_id=8b289f82629141c1917a8138f2584783, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:58.524368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c591ad-91e3-45dc-b974-cee4e76da379 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:58.546424 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1897/3825] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:30:58 2022] PUT /identity/v3/projects/c3cddae9f4e7420f8b6acdc11db5ca1f/users/8b289f82629141c1917a8138f2584783/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:30:58.553067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c739d2-b5d5-4c61-aca0-64d20ba0173f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:58.553487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c739d2-b5d5-4c61-aca0-64d20ba0173f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:58.553907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c739d2-b5d5-4c61-aca0-64d20ba0173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:58.577265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-21c739d2-b5d5-4c61-aca0-64d20ba0173f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:30:58.578608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-21c739d2-b5d5-4c61-aca0-64d20ba0173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:58.659143 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1929/3826] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:30:58.676961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c591ad-91e3-45dc-b974-cee4e76da379 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:30:58.685468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b3c591ad-91e3-45dc-b974-cee4e76da379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:30:58.804457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c591ad-91e3-45dc-b974-cee4e76da379 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:30:58.810397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63b7ba-a82c-480f-afed-165a5ffb3a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:30:58.811260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b7ba-a82c-480f-afed-165a5ffb3a2b service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:30:58.811788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b7ba-a82c-480f-afed-165a5ffb3a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:30:58.812236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b7ba-a82c-480f-afed-165a5ffb3a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:30:58.830252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63b7ba-a82c-480f-afed-165a5ffb3a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:30:58.834796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63b7ba-a82c-480f-afed-165a5ffb3a2b service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:30:58.852685 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1898/3827] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:06.394741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953de6-3203-46d4-a67e-d98504f35967 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:06.395362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953de6-3203-46d4-a67e-d98504f35967 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:06.395362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34953de6-3203-46d4-a67e-d98504f35967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:06.427691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-34953de6-3203-46d4-a67e-d98504f35967 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:06.431020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-34953de6-3203-46d4-a67e-d98504f35967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:06.617940 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1930/3828] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:31:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:06.703316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63b7ba-a82c-480f-afed-165a5ffb3a2b service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:06.705118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7b63b7ba-a82c-480f-afed-165a5ffb3a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:06.854280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63b7ba-a82c-480f-afed-165a5ffb3a2b service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:06.866293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56f67d-8975-42ad-a5af-978e41b0b7a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:06.866934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56f67d-8975-42ad-a5af-978e41b0b7a5 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:06.867211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56f67d-8975-42ad-a5af-978e41b0b7a5 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:06.870691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56f67d-8975-42ad-a5af-978e41b0b7a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:06.905136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56f67d-8975-42ad-a5af-978e41b0b7a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:06.910970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56f67d-8975-42ad-a5af-978e41b0b7a5 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:06.960984 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1899/3829] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:31:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:31:07.403584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34953de6-3203-46d4-a67e-d98504f35967 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:07.407414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-34953de6-3203-46d4-a67e-d98504f35967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:07.472702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34953de6-3203-46d4-a67e-d98504f35967 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:07.499600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:07.501530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:07.502540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:07.503082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] PATH_INFO: `/v3/users/46f7a2f32b0540fd8bbb2f0ff3073427` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:07.505822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f7a2f32b0540fd8bbb2f0ff3073427)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:07.520152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:07.704856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:07.812221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f7a2f32b0540fd8bbb2f0ff3073427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:07.813714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f7a2f32b0540fd8bbb2f0ff3073427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:07.839379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f7a2f32b0540fd8bbb2f0ff3073427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:07.870736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f7a2f32b0540fd8bbb2f0ff3073427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:07.957488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f7a2f32b0540fd8bbb2f0ff3073427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:07.985612 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1931/3830] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:31:07 2022] DELETE /identity/v3/users/46f7a2f32b0540fd8bbb2f0ff3073427 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:08.384931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4d0f-e8f2-4bf7-aefe-3c981992f79d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:08.385727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4d0f-e8f2-4bf7-aefe-3c981992f79d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:08.385727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f4d0f-e8f2-4bf7-aefe-3c981992f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:08.483553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a59f4d0f-e8f2-4bf7-aefe-3c981992f79d None None] MFA Rules not processed for user `8b289f82629141c1917a8138f2584783`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:08.487092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a59f4d0f-e8f2-4bf7-aefe-3c981992f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:08.563144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:08.641564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:08.643185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:08.689192 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1900/3831] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:08.690816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae4cc6-8021-445e-9d7a-acebfa8e8b14 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:08.691595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae4cc6-8021-445e-9d7a-acebfa8e8b14 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:08.693675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae4cc6-8021-445e-9d7a-acebfa8e8b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:08.757500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d8ae4cc6-8021-445e-9d7a-acebfa8e8b14 None None] MFA Rules not processed for user `8b289f82629141c1917a8138f2584783`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:08.763473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d8ae4cc6-8021-445e-9d7a-acebfa8e8b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:08.790297 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1901/3832] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:08.857300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e07e9a-e060-4be0-9e2b-9cc5f78b2f7d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:08.864741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:08.865415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:08.865718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:08.866094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] PATH_INFO: `/v3/projects/a1bfc45bbd204d6a90ae211e5ab8886d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:08.867420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bfc45bbd204d6a90ae211e5ab8886d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:08.869408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:09.064065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bfc45bbd204d6a90ae211e5ab8886d', 'request_id': 'req-151ab011-2f21-4314-b3aa-7263976fc628'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:09.086384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bfc45bbd204d6a90ae211e5ab8886d', 'request_id': 'req-151ab011-2f21-4314-b3aa-7263976fc628'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:09.103078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bfc45bbd204d6a90ae211e5ab8886d', 'request_id': 'req-151ab011-2f21-4314-b3aa-7263976fc628'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:09.147571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] The token cache is being invalidate because project a1bfc45bbd204d6a90ae211e5ab8886d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:31:09.148046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:09.149721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-151ab011-2f21-4314-b3aa-7263976fc628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:09.162835 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1932/3833] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:31:08 2022] DELETE /identity/v3/projects/a1bfc45bbd204d6a90ae211e5ab8886d => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:31:09.166031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d778-e299-47a2-a19b-48a3a6faadc8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:09.166571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d778-e299-47a2-a19b-48a3a6faadc8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:09.167081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d778-e299-47a2-a19b-48a3a6faadc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:09.237556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4d10d778-e299-47a2-a19b-48a3a6faadc8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:09.240848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4d10d778-e299-47a2-a19b-48a3a6faadc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:09.463632 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1902/3834] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:09.475145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2481d-fe19-46ce-b0f0-170f3791623a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:09.475601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2481d-fe19-46ce-b0f0-170f3791623a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:09.476032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2481d-fe19-46ce-b0f0-170f3791623a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:09.548938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-33d2481d-fe19-46ce-b0f0-170f3791623a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:09.553528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-33d2481d-fe19-46ce-b0f0-170f3791623a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:09.591396 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1933/3835] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:09.593707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d778-e299-47a2-a19b-48a3a6faadc8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:09.628327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d778-e299-47a2-a19b-48a3a6faadc8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:09.647513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95e76a-cbab-4b37-b299-bcf29bd629f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:09.648442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95e76a-cbab-4b37-b299-bcf29bd629f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:09.649737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95e76a-cbab-4b37-b299-bcf29bd629f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:09.650412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95e76a-cbab-4b37-b299-bcf29bd629f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:09.652114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95e76a-cbab-4b37-b299-bcf29bd629f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:31:09.653146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95e76a-cbab-4b37-b299-bcf29bd629f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:09.655166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95e76a-cbab-4b37-b299-bcf29bd629f5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:09.673651 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1903/3836] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:31:09.677963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2481d-fe19-46ce-b0f0-170f3791623a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:09.706756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2481d-fe19-46ce-b0f0-170f3791623a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:09.713513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec664-6c70-40ae-aa41-bafa4181abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:09.714781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec664-6c70-40ae-aa41-bafa4181abdd admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:09.715866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec664-6c70-40ae-aa41-bafa4181abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:09.716524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ec664-6c70-40ae-aa41-bafa4181abdd admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:09.718263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ec664-6c70-40ae-aa41-bafa4181abdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:09.720831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ec664-6c70-40ae-aa41-bafa4181abdd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:09.760156 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1934/3837] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:31:09 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:09.767772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95e76a-cbab-4b37-b299-bcf29bd629f5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:09.788962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95e76a-cbab-4b37-b299-bcf29bd629f5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:09.925217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e6062-f1b1-4d88-8d26-722642436993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:09.926237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6062-f1b1-4d88-8d26-722642436993 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:09.926723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6062-f1b1-4d88-8d26-722642436993 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:09.927278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e6062-f1b1-4d88-8d26-722642436993 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:09.928713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6062-f1b1-4d88-8d26-722642436993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:09.940150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e6062-f1b1-4d88-8d26-722642436993 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:10.055708 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1904/3838] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:31:09 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:10.058292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec664-6c70-40ae-aa41-bafa4181abdd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:10.088384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ec664-6c70-40ae-aa41-bafa4181abdd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:10.095094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff255fc-a2e1-4c28-874d-1a2238f5e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:10.096145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff255fc-a2e1-4c28-874d-1a2238f5e500 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:10.097546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff255fc-a2e1-4c28-874d-1a2238f5e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:10.099686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff255fc-a2e1-4c28-874d-1a2238f5e500 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:10.100806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff255fc-a2e1-4c28-874d-1a2238f5e500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:10.105973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff255fc-a2e1-4c28-874d-1a2238f5e500 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:10.109461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:10.137627 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1935/3839] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:10.137961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e6062-f1b1-4d88-8d26-722642436993 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:10.152652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e6062-f1b1-4d88-8d26-722642436993 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:10.172995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7450005-216f-4f16-8480-2778c10b66f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:10.172995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450005-216f-4f16-8480-2778c10b66f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:10.172995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450005-216f-4f16-8480-2778c10b66f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:10.172995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7450005-216f-4f16-8480-2778c10b66f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:10.173784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7450005-216f-4f16-8480-2778c10b66f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:10.176501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7450005-216f-4f16-8480-2778c10b66f7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:10.212636 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1905/3840] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:10.217275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff255fc-a2e1-4c28-874d-1a2238f5e500 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:10.233029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff255fc-a2e1-4c28-874d-1a2238f5e500 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:10.240720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a07173-3411-451e-b9a8-a419a9e8a0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:10.241236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a07173-3411-451e-b9a8-a419a9e8a0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:10.241769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a07173-3411-451e-b9a8-a419a9e8a0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:10.242393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a07173-3411-451e-b9a8-a419a9e8a0e7 admin admin] PATH_INFO: `/v3/projects/c6efb655a30d4679ade71cd6385dd2a6/users/ee5effb4577e42d7ba3b2b1c3305a687/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:10.286057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a07173-3411-451e-b9a8-a419a9e8a0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6efb655a30d4679ade71cd6385dd2a6, user_id=ee5effb4577e42d7ba3b2b1c3305a687, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:10.289997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a07173-3411-451e-b9a8-a419a9e8a0e7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:10.317458 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1936/3841] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:10 2022] PUT /identity/v3/projects/c6efb655a30d4679ade71cd6385dd2a6/users/ee5effb4577e42d7ba3b2b1c3305a687/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:10.320340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18f66d-c565-4099-9ada-adfd32040e30 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:10.323903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18f66d-c565-4099-9ada-adfd32040e30 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:10.327274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d18f66d-c565-4099-9ada-adfd32040e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:10.365547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8d18f66d-c565-4099-9ada-adfd32040e30 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:10.367522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8d18f66d-c565-4099-9ada-adfd32040e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:10.407817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:10.490694 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1906/3842] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:10.508362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a07173-3411-451e-b9a8-a419a9e8a0e7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:10.511557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-36a07173-3411-451e-b9a8-a419a9e8a0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:10.702560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a07173-3411-451e-b9a8-a419a9e8a0e7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:10.718553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23cdd6-2976-444c-9f95-cb3ba1643bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:10.720268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23cdd6-2976-444c-9f95-cb3ba1643bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:10.722188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23cdd6-2976-444c-9f95-cb3ba1643bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:10.722727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23cdd6-2976-444c-9f95-cb3ba1643bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:10.742082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23cdd6-2976-444c-9f95-cb3ba1643bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:10.744624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23cdd6-2976-444c-9f95-cb3ba1643bf3 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:10.763752 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1937/3843] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:11.102172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18f66d-c565-4099-9ada-adfd32040e30 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:11.106593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8d18f66d-c565-4099-9ada-adfd32040e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:11.231930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d18f66d-c565-4099-9ada-adfd32040e30 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:11.239325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363f3ba-165c-4eb2-ae82-67ee42bd870d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:11.240071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363f3ba-165c-4eb2-ae82-67ee42bd870d service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:11.240410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363f3ba-165c-4eb2-ae82-67ee42bd870d service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:11.241480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363f3ba-165c-4eb2-ae82-67ee42bd870d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:11.244605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3363f3ba-165c-4eb2-ae82-67ee42bd870d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:11.390064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363f3ba-165c-4eb2-ae82-67ee42bd870d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:11.395150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363f3ba-165c-4eb2-ae82-67ee42bd870d service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:11.419929 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1907/3844] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:20.756244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:21.410419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=72 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:21.846461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23cdd6-2976-444c-9f95-cb3ba1643bf3 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:21.851652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56012b-a930-4165-a1be-124418b5f14c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:21.852225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56012b-a930-4165-a1be-124418b5f14c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:21.852669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56012b-a930-4165-a1be-124418b5f14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:21.870761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23cdd6-2976-444c-9f95-cb3ba1643bf3 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:21.885512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd762d8-b34b-42e0-953a-eb224c132067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:21.886549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd762d8-b34b-42e0-953a-eb224c132067 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:21.887182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd762d8-b34b-42e0-953a-eb224c132067 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:21.888906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd762d8-b34b-42e0-953a-eb224c132067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:21.891349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8bd762d8-b34b-42e0-953a-eb224c132067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:21.895643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ea56012b-a930-4165-a1be-124418b5f14c None None] MFA Rules not processed for user `2e944e3030a1404c9862d953fedfb94a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:21.897406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ea56012b-a930-4165-a1be-124418b5f14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:21.929320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd762d8-b34b-42e0-953a-eb224c132067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:21.931495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd762d8-b34b-42e0-953a-eb224c132067 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:21.979404 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1938/3845] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:21.999598 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1908/3846] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:22.765427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa7b9c-a545-4d2a-8572-b0393467ba2b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:22.765427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa7b9c-a545-4d2a-8572-b0393467ba2b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:22.765427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa7b9c-a545-4d2a-8572-b0393467ba2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:22.867987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9caa7b9c-a545-4d2a-8572-b0393467ba2b None None] MFA Rules not processed for user `ee5effb4577e42d7ba3b2b1c3305a687`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:22.871723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9caa7b9c-a545-4d2a-8572-b0393467ba2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:23.198189 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1939/3847] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:23.198781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b905-4aaf-460f-bc3c-f75dac56bc21 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:23.199256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b905-4aaf-460f-bc3c-f75dac56bc21 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:23.199699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986b905-4aaf-460f-bc3c-f75dac56bc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:23.338893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4986b905-4aaf-460f-bc3c-f75dac56bc21 None None] MFA Rules not processed for user `ee5effb4577e42d7ba3b2b1c3305a687`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:23.341616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4986b905-4aaf-460f-bc3c-f75dac56bc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:23.407327 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1909/3848] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:31:24.035310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411e8ba-bba8-4389-a9e0-e3eaceeb2645 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:24.035925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411e8ba-bba8-4389-a9e0-e3eaceeb2645 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:24.041695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411e8ba-bba8-4389-a9e0-e3eaceeb2645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:24.121790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3411e8ba-bba8-4389-a9e0-e3eaceeb2645 None None] MFA Rules not processed for user `358a4edea635469d9a9f64e941b6ed53`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:24.127228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3411e8ba-bba8-4389-a9e0-e3eaceeb2645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:24.377992 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1940/3849] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:26.978477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986b905-4aaf-460f-bc3c-f75dac56bc21 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:26.982481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4986b905-4aaf-460f-bc3c-f75dac56bc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:27.190774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986b905-4aaf-460f-bc3c-f75dac56bc21 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:27.199555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949b961-df8e-42df-b1f0-eb77f6fea21a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:27.200252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949b961-df8e-42df-b1f0-eb77f6fea21a service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:27.200527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949b961-df8e-42df-b1f0-eb77f6fea21a service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:27.200794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949b961-df8e-42df-b1f0-eb77f6fea21a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:27.252639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949b961-df8e-42df-b1f0-eb77f6fea21a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:27.252639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949b961-df8e-42df-b1f0-eb77f6fea21a service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:27.264734 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1910/3850] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:34.361289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=63 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:37.253544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=56 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:45.077653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411e8ba-bba8-4389-a9e0-e3eaceeb2645 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:45.079239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3411e8ba-bba8-4389-a9e0-e3eaceeb2645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:45.519212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411e8ba-bba8-4389-a9e0-e3eaceeb2645 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:45.526708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62cc67-f4f7-44b7-9380-ce24c533c1cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:45.527336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62cc67-f4f7-44b7-9380-ce24c533c1cb service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:45.527613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62cc67-f4f7-44b7-9380-ce24c533c1cb service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:45.527880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62cc67-f4f7-44b7-9380-ce24c533c1cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:45.531991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0a62cc67-f4f7-44b7-9380-ce24c533c1cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:45.600251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62cc67-f4f7-44b7-9380-ce24c533c1cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:45.610845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62cc67-f4f7-44b7-9380-ce24c533c1cb service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:45.685556 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1941/3851] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:31:46.123835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949b961-df8e-42df-b1f0-eb77f6fea21a service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:46.125980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0949b961-df8e-42df-b1f0-eb77f6fea21a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:46.153197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949b961-df8e-42df-b1f0-eb77f6fea21a service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:46.165213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:46.166643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:46.167374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:46.168075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] PATH_INFO: `/v3/users/72bc94a22eae41b09ba69cd3a595e1e9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:46.171796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72bc94a22eae41b09ba69cd3a595e1e9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:46.175843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:46.302008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72bc94a22eae41b09ba69cd3a595e1e9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:46.357773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72bc94a22eae41b09ba69cd3a595e1e9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:46.408255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72bc94a22eae41b09ba69cd3a595e1e9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:46.433949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72bc94a22eae41b09ba69cd3a595e1e9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:46.438721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72bc94a22eae41b09ba69cd3a595e1e9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:46.466140 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1911/3852] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:31:46 2022] DELETE /identity/v3/users/72bc94a22eae41b09ba69cd3a595e1e9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:31:46.706673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62cc67-f4f7-44b7-9380-ce24c533c1cb service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:46.708686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0a62cc67-f4f7-44b7-9380-ce24c533c1cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:46.866612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62cc67-f4f7-44b7-9380-ce24c533c1cb service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:46.922001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:46.948556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd8d75-7b1e-4922-b9f7-da364b03304b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:46.950240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8d75-7b1e-4922-b9f7-da364b03304b service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:46.950945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8d75-7b1e-4922-b9f7-da364b03304b service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:46.951691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd8d75-7b1e-4922-b9f7-da364b03304b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:46.955837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-30dd8d75-7b1e-4922-b9f7-da364b03304b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:47.176246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd8d75-7b1e-4922-b9f7-da364b03304b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:47.181927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd8d75-7b1e-4922-b9f7-da364b03304b service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:47.183869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:47.187284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:47.198340 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1942/3853] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:31:47.443006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd8d75-7b1e-4922-b9f7-da364b03304b service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:47.444553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-30dd8d75-7b1e-4922-b9f7-da364b03304b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:47.488478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4336f3-e875-4bab-a5a7-90d970176422 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:47.504715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:47.505516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:47.505799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:47.506276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] PATH_INFO: `/v3/projects/1b5cb5820bb9414bb5174473073d33a6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:47.509307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5cb5820bb9414bb5174473073d33a6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:47.516026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:47.596025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd8d75-7b1e-4922-b9f7-da364b03304b service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:47.610364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819f97b-bef4-4c87-94b3-f1676d39f178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:47.611343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f97b-bef4-4c87-94b3-f1676d39f178 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:47.611803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f97b-bef4-4c87-94b3-f1676d39f178 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:47.612084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f97b-bef4-4c87-94b3-f1676d39f178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:47.621540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2819f97b-bef4-4c87-94b3-f1676d39f178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:47.649214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819f97b-bef4-4c87-94b3-f1676d39f178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:47.651356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819f97b-bef4-4c87-94b3-f1676d39f178 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:47.663486 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1943/3854] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:31:47.672411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5cb5820bb9414bb5174473073d33a6', 'request_id': 'req-eba50cdd-6afd-4876-a2c6-d78b3ba94971'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:47.697211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5cb5820bb9414bb5174473073d33a6', 'request_id': 'req-eba50cdd-6afd-4876-a2c6-d78b3ba94971'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:47.708279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5cb5820bb9414bb5174473073d33a6', 'request_id': 'req-eba50cdd-6afd-4876-a2c6-d78b3ba94971'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:47.723676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] The token cache is being invalidate because project 1b5cb5820bb9414bb5174473073d33a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:31:47.724056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:47.724857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:31:47.732037 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1912/3855] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:31:47 2022] DELETE /identity/v3/projects/1b5cb5820bb9414bb5174473073d33a6 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:31:47.734320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac924d-5bc0-452e-9cd9-82779ca6d1c0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:47.735158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac924d-5bc0-452e-9cd9-82779ca6d1c0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:47.735158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac924d-5bc0-452e-9cd9-82779ca6d1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:47.829736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c6ac924d-5bc0-452e-9cd9-82779ca6d1c0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:47.831082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c6ac924d-5bc0-452e-9cd9-82779ca6d1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:47.937713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:47.940032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:47.954044 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1944/3856] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:47.954886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:47.969718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea2b12-fb53-411b-83b6-61e4471b7e95 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:47.970669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea2b12-fb53-411b-83b6-61e4471b7e95 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:47.971390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea2b12-fb53-411b-83b6-61e4471b7e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.012683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-21ea2b12-fb53-411b-83b6-61e4471b7e95 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:48.015735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-21ea2b12-fb53-411b-83b6-61e4471b7e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:48.026293 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1945/3857] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:48.030382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea2b12-fb53-411b-83b6-61e4471b7e95 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:48.066643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea2b12-fb53-411b-83b6-61e4471b7e95 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:48.075424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e9a9-c1ae-47e7-bc86-349da40e55c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:48.078251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e9a9-c1ae-47e7-bc86-349da40e55c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:48.078758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e9a9-c1ae-47e7-bc86-349da40e55c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:48.079540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e9a9-c1ae-47e7-bc86-349da40e55c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.080897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e9a9-c1ae-47e7-bc86-349da40e55c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:31:48.081621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e9a9-c1ae-47e7-bc86-349da40e55c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:48.085150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e9a9-c1ae-47e7-bc86-349da40e55c0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:48.094076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:48.128350 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1946/3858] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:31:48.133818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e9a9-c1ae-47e7-bc86-349da40e55c0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:48.137341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba50cdd-6afd-4876-a2c6-d78b3ba94971 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:48.142269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec344dad-8a37-45a6-bfee-157bec3c24c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:48.143265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec344dad-8a37-45a6-bfee-157bec3c24c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:48.143749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec344dad-8a37-45a6-bfee-157bec3c24c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:48.144245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec344dad-8a37-45a6-bfee-157bec3c24c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.146534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ec344dad-8a37-45a6-bfee-157bec3c24c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:48.156151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e9a9-c1ae-47e7-bc86-349da40e55c0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:48.165726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899ec94-7b1b-40f8-aae1-e5006434c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:48.166934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899ec94-7b1b-40f8-aae1-e5006434c321 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:48.169240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899ec94-7b1b-40f8-aae1-e5006434c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:48.169240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899ec94-7b1b-40f8-aae1-e5006434c321 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.171154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899ec94-7b1b-40f8-aae1-e5006434c321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:48.179007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899ec94-7b1b-40f8-aae1-e5006434c321 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:48.241394 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1947/3859] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:31:48 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:48.243039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899ec94-7b1b-40f8-aae1-e5006434c321 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:48.303110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec344dad-8a37-45a6-bfee-157bec3c24c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:48.306907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec344dad-8a37-45a6-bfee-157bec3c24c3 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:48.340237 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1913/3860] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:48.348920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899ec94-7b1b-40f8-aae1-e5006434c321 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:48.355298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be0e75-fe5a-4334-96e7-9488cdcf8f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:48.355949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be0e75-fe5a-4334-96e7-9488cdcf8f52 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:48.357449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be0e75-fe5a-4334-96e7-9488cdcf8f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:48.357449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be0e75-fe5a-4334-96e7-9488cdcf8f52 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.357849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be0e75-fe5a-4334-96e7-9488cdcf8f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:48.359598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be0e75-fe5a-4334-96e7-9488cdcf8f52 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:48.392282 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1948/3861] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:31:48 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:31:48.399390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec344dad-8a37-45a6-bfee-157bec3c24c3 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:48.423874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec344dad-8a37-45a6-bfee-157bec3c24c3 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:48.436849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092932af-5f50-40ab-8025-7ad6b7ba45f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:48.438160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092932af-5f50-40ab-8025-7ad6b7ba45f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:48.439401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092932af-5f50-40ab-8025-7ad6b7ba45f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:48.439401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092932af-5f50-40ab-8025-7ad6b7ba45f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.443774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092932af-5f50-40ab-8025-7ad6b7ba45f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:48.445573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092932af-5f50-40ab-8025-7ad6b7ba45f3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:48.464392 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1914/3862] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:48.471035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be0e75-fe5a-4334-96e7-9488cdcf8f52 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:48.510955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be0e75-fe5a-4334-96e7-9488cdcf8f52 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:48.538309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f729ce1-afe2-4c11-8e78-d9786c60d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:48.539968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729ce1-afe2-4c11-8e78-d9786c60d9ea admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:48.540463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729ce1-afe2-4c11-8e78-d9786c60d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:48.540932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729ce1-afe2-4c11-8e78-d9786c60d9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.542021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f729ce1-afe2-4c11-8e78-d9786c60d9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:48.548708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f729ce1-afe2-4c11-8e78-d9786c60d9ea admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:48.580643 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1949/3863] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:31:48.586947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092932af-5f50-40ab-8025-7ad6b7ba45f3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:48.599644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092932af-5f50-40ab-8025-7ad6b7ba45f3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:48.606070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a68d72-ef5e-4191-b041-c019b0053327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:48.607371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a68d72-ef5e-4191-b041-c019b0053327 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:48.607902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a68d72-ef5e-4191-b041-c019b0053327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:48.608410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a68d72-ef5e-4191-b041-c019b0053327 admin admin] PATH_INFO: `/v3/projects/5336c1b502c949f39f1c2868e09bce4e/users/84933dd631ac4adbb499c5072b7caf0d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.644021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a68d72-ef5e-4191-b041-c019b0053327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5336c1b502c949f39f1c2868e09bce4e, user_id=84933dd631ac4adbb499c5072b7caf0d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:48.647773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a68d72-ef5e-4191-b041-c019b0053327 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:48.672544 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1915/3864] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:31:48 2022] PUT /identity/v3/projects/5336c1b502c949f39f1c2868e09bce4e/users/84933dd631ac4adbb499c5072b7caf0d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:31:48.682486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2a67e-8f2a-4ad7-ace1-3ceee6e2029e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:48.682486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2a67e-8f2a-4ad7-ace1-3ceee6e2029e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:48.682486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2a67e-8f2a-4ad7-ace1-3ceee6e2029e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.710257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4ea2a67e-8f2a-4ad7-ace1-3ceee6e2029e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:48.711570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ea2a67e-8f2a-4ad7-ace1-3ceee6e2029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:48.805172 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1950/3865] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:48.818268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a68d72-ef5e-4191-b041-c019b0053327 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:48.821352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e9a68d72-ef5e-4191-b041-c019b0053327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:48.914181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a68d72-ef5e-4191-b041-c019b0053327 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:48.920364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c86ff-79b3-4277-b91b-116e2ed2f9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:48.921012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c86ff-79b3-4277-b91b-116e2ed2f9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:48.921294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c86ff-79b3-4277-b91b-116e2ed2f9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:48.921565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c86ff-79b3-4277-b91b-116e2ed2f9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:48.933164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c86ff-79b3-4277-b91b-116e2ed2f9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:48.935240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c86ff-79b3-4277-b91b-116e2ed2f9f2 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:48.946507 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1916/3866] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:49.320993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2a67e-8f2a-4ad7-ace1-3ceee6e2029e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:49.323780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ea2a67e-8f2a-4ad7-ace1-3ceee6e2029e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:49.520221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:49.590264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2a67e-8f2a-4ad7-ace1-3ceee6e2029e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:49.601821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14185-5dd2-4854-b799-f6006a263cd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:49.603374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14185-5dd2-4854-b799-f6006a263cd4 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:49.604336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14185-5dd2-4854-b799-f6006a263cd4 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:49.607525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14185-5dd2-4854-b799-f6006a263cd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:49.610079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-77c14185-5dd2-4854-b799-f6006a263cd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:49.646111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c14185-5dd2-4854-b799-f6006a263cd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:49.651150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c14185-5dd2-4854-b799-f6006a263cd4 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:49.678994 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1951/3867] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:31:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:31:56.052664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98219235-1af8-4295-bc91-0aeccbb80a47 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:56.054453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98219235-1af8-4295-bc91-0aeccbb80a47 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:56.054949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98219235-1af8-4295-bc91-0aeccbb80a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:56.085227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:56.104812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-98219235-1af8-4295-bc91-0aeccbb80a47 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:56.106595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-98219235-1af8-4295-bc91-0aeccbb80a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:56.217358 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1917/3868] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:31:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:31:56.225214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14185-5dd2-4854-b799-f6006a263cd4 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:31:56.226722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-77c14185-5dd2-4854-b799-f6006a263cd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:31:56.397352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14185-5dd2-4854-b799-f6006a263cd4 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:31:56.404568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5992f-9c91-4295-8abc-620d30238171 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:31:56.405385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5992f-9c91-4295-8abc-620d30238171 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:56.405693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5992f-9c91-4295-8abc-620d30238171 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:56.405953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5992f-9c91-4295-8abc-620d30238171 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:56.419591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5992f-9c91-4295-8abc-620d30238171 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:31:56.421229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5992f-9c91-4295-8abc-620d30238171 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:31:56.438482 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1952/3869] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:31:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:31:59.685800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359a739-ddeb-40bc-8680-68185521476c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:31:59.685800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359a739-ddeb-40bc-8680-68185521476c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:31:59.685800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359a739-ddeb-40bc-8680-68185521476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:31:59.782573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6359a739-ddeb-40bc-8680-68185521476c None None] MFA Rules not processed for user `84933dd631ac4adbb499c5072b7caf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:31:59.784060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6359a739-ddeb-40bc-8680-68185521476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:00.114274 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1918/3870] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:31:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:00.136561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee789f-fa22-40b6-be0f-43d03f90ae02 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:00.138390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee789f-fa22-40b6-be0f-43d03f90ae02 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:00.138390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee789f-fa22-40b6-be0f-43d03f90ae02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:00.188576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0cee789f-fa22-40b6-be0f-43d03f90ae02 None None] MFA Rules not processed for user `84933dd631ac4adbb499c5072b7caf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:00.189863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0cee789f-fa22-40b6-be0f-43d03f90ae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:00.226943 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1953/3871] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:00.780629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359a739-ddeb-40bc-8680-68185521476c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:00.785065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6359a739-ddeb-40bc-8680-68185521476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:01.089296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359a739-ddeb-40bc-8680-68185521476c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:01.114254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20b98d-0fb3-48db-9f97-54a749705fc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:01.114254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b98d-0fb3-48db-9f97-54a749705fc5 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:01.114254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b98d-0fb3-48db-9f97-54a749705fc5 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:01.114254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20b98d-0fb3-48db-9f97-54a749705fc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:01.126932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:01.132601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20b98d-0fb3-48db-9f97-54a749705fc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:01.134532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da20b98d-0fb3-48db-9f97-54a749705fc5 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:01.180928 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1919/3872] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:07.712961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372e0d-f3a0-4723-8e4f-ca794bd71859 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:07.715134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372e0d-f3a0-4723-8e4f-ca794bd71859 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:07.716231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372e0d-f3a0-4723-8e4f-ca794bd71859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:07.932910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-dc372e0d-f3a0-4723-8e4f-ca794bd71859 None None] MFA Rules not processed for user `2e944e3030a1404c9862d953fedfb94a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:07.935300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dc372e0d-f3a0-4723-8e4f-ca794bd71859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:08.427578 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1954/3873] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 717 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:11.153765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:12.388950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20b98d-0fb3-48db-9f97-54a749705fc5 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:12.394700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-da20b98d-0fb3-48db-9f97-54a749705fc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:12.521480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20b98d-0fb3-48db-9f97-54a749705fc5 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:12.528340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:12.529306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:12.529933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:12.530390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] PATH_INFO: `/v3/users/cabd5ca94ba1400ab58cef69212365c8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:12.533330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] RBAC: Authorizing `identity:delete_user(user_id=cabd5ca94ba1400ab58cef69212365c8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:12.535278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:12.611725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cabd5ca94ba1400ab58cef69212365c8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:12.623953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cabd5ca94ba1400ab58cef69212365c8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:12.646828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cabd5ca94ba1400ab58cef69212365c8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:12.664099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cabd5ca94ba1400ab58cef69212365c8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:12.666469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9883f5c-9429-4421-9cbe-0a667d78c7af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cabd5ca94ba1400ab58cef69212365c8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:12.686006 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1920/3874] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:32:12 2022] DELETE /identity/v3/users/cabd5ca94ba1400ab58cef69212365c8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:13.026202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc372e0d-f3a0-4723-8e4f-ca794bd71859 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:13.068887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc372e0d-f3a0-4723-8e4f-ca794bd71859 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:13.157225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:13.173255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:13.174236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:13.175217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:13.175217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] PATH_INFO: `/v3/projects/f421e020e5bb441692dd0fa885a3b7ae` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:13.176904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f421e020e5bb441692dd0fa885a3b7ae)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:13.179956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:13.275098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f421e020e5bb441692dd0fa885a3b7ae', 'request_id': 'req-7ad268df-5a60-4190-8608-35d06713c49d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:13.284899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f421e020e5bb441692dd0fa885a3b7ae', 'request_id': 'req-7ad268df-5a60-4190-8608-35d06713c49d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:13.298605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f421e020e5bb441692dd0fa885a3b7ae', 'request_id': 'req-7ad268df-5a60-4190-8608-35d06713c49d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:13.319276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] The token cache is being invalidate because project f421e020e5bb441692dd0fa885a3b7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:32:13.319628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:13.320461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ad268df-5a60-4190-8608-35d06713c49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:13.326704 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1955/3875] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:32:13 2022] DELETE /identity/v3/projects/f421e020e5bb441692dd0fa885a3b7ae => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:13.328569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389eee2-0c20-44a1-87e5-a4b01c6b9afe None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:13.328863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389eee2-0c20-44a1-87e5-a4b01c6b9afe None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:13.329138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389eee2-0c20-44a1-87e5-a4b01c6b9afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:13.441213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0389eee2-0c20-44a1-87e5-a4b01c6b9afe None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:13.443533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0389eee2-0c20-44a1-87e5-a4b01c6b9afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:13.649734 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1921/3876] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:13.769724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144286c0-721d-47c7-98dd-7fea87088958 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:13.770040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144286c0-721d-47c7-98dd-7fea87088958 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:13.770310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144286c0-721d-47c7-98dd-7fea87088958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:13.824230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-144286c0-721d-47c7-98dd-7fea87088958 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:13.827327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-144286c0-721d-47c7-98dd-7fea87088958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:13.862708 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1956/3877] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:13.867595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389eee2-0c20-44a1-87e5-a4b01c6b9afe None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:13.890500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389eee2-0c20-44a1-87e5-a4b01c6b9afe None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:13.899405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e9929-464d-40a4-9934-182f9b06415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:13.901839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e9929-464d-40a4-9934-182f9b06415b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:13.902406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e9929-464d-40a4-9934-182f9b06415b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:13.902884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e9929-464d-40a4-9934-182f9b06415b admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:13.904118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e9929-464d-40a4-9934-182f9b06415b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:32:13.904687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e9929-464d-40a4-9934-182f9b06415b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:13.908311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e9929-464d-40a4-9934-182f9b06415b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:13.936152 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1922/3878] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:32:13.943500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144286c0-721d-47c7-98dd-7fea87088958 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:13.961978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144286c0-721d-47c7-98dd-7fea87088958 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:13.993638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183699f-edfb-4c4b-ae0c-14acfdb4ddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:13.995973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183699f-edfb-4c4b-ae0c-14acfdb4ddb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:13.995973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183699f-edfb-4c4b-ae0c-14acfdb4ddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:13.995973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183699f-edfb-4c4b-ae0c-14acfdb4ddb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:13.996968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183699f-edfb-4c4b-ae0c-14acfdb4ddb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:13.999234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183699f-edfb-4c4b-ae0c-14acfdb4ddb8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:14.037959 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1957/3879] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:32:13 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:32:14.043339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e9929-464d-40a4-9934-182f9b06415b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:14.054926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e9929-464d-40a4-9934-182f9b06415b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:14.063103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:14.190471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629264a-4b4b-4192-bda3-d9f01549a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:14.191444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629264a-4b4b-4192-bda3-d9f01549a639 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:14.191886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629264a-4b4b-4192-bda3-d9f01549a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:14.192362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629264a-4b4b-4192-bda3-d9f01549a639 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:14.193189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629264a-4b4b-4192-bda3-d9f01549a639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:14.210254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9629264a-4b4b-4192-bda3-d9f01549a639 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:14.301864 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1923/3880] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:32:14 2022] POST /identity/v3/users => generated 302 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:32:14.303446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183699f-edfb-4c4b-ae0c-14acfdb4ddb8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:14.317964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183699f-edfb-4c4b-ae0c-14acfdb4ddb8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:14.332758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b38f0-3b4c-45a8-b794-8fa25d3c9773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:14.333418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b38f0-3b4c-45a8-b794-8fa25d3c9773 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:14.333688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b38f0-3b4c-45a8-b794-8fa25d3c9773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:14.334215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b38f0-3b4c-45a8-b794-8fa25d3c9773 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:14.335116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b38f0-3b4c-45a8-b794-8fa25d3c9773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:14.337028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b38f0-3b4c-45a8-b794-8fa25d3c9773 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:14.366400 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1958/3881] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:32:14.373850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629264a-4b4b-4192-bda3-d9f01549a639 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:14.407283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629264a-4b4b-4192-bda3-d9f01549a639 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:14.427714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec96e92-4716-45e0-b72e-2551b0aa391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:14.428752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec96e92-4716-45e0-b72e-2551b0aa391d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:14.429211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec96e92-4716-45e0-b72e-2551b0aa391d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:14.429667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec96e92-4716-45e0-b72e-2551b0aa391d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:14.430849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec96e92-4716-45e0-b72e-2551b0aa391d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:14.454168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec96e92-4716-45e0-b72e-2551b0aa391d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:14.536616 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1924/3882] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:32:14.542729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b38f0-3b4c-45a8-b794-8fa25d3c9773 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:14.561910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b38f0-3b4c-45a8-b794-8fa25d3c9773 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:14.589093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ceb62-2461-4c79-9ed8-f9a02d60c504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:14.590209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ceb62-2461-4c79-9ed8-f9a02d60c504 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:14.590670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ceb62-2461-4c79-9ed8-f9a02d60c504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:14.591104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ceb62-2461-4c79-9ed8-f9a02d60c504 admin admin] PATH_INFO: `/v3/projects/ba5284d2a74b423eb87f3bd75f7fe416/users/02d9c132a2484d73aab0fc0f25020a5d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:14.627713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ceb62-2461-4c79-9ed8-f9a02d60c504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5284d2a74b423eb87f3bd75f7fe416, user_id=02d9c132a2484d73aab0fc0f25020a5d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:14.632486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ceb62-2461-4c79-9ed8-f9a02d60c504 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:14.671311 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1959/3883] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:32:14 2022] PUT /identity/v3/projects/ba5284d2a74b423eb87f3bd75f7fe416/users/02d9c132a2484d73aab0fc0f25020a5d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:32:14.679049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb960-38b2-4aa1-bd0d-046781fb4fa5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:14.679049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb960-38b2-4aa1-bd0d-046781fb4fa5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:14.679374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fb960-38b2-4aa1-bd0d-046781fb4fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:14.732582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bd3fb960-38b2-4aa1-bd0d-046781fb4fa5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:14.734113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bd3fb960-38b2-4aa1-bd0d-046781fb4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:14.998874 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1925/3884] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:15.013821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ceb62-2461-4c79-9ed8-f9a02d60c504 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:15.015721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-180ceb62-2461-4c79-9ed8-f9a02d60c504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:15.146442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ceb62-2461-4c79-9ed8-f9a02d60c504 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:15.157280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3693-c5c4-4dd9-9139-673c8ce77c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:15.159184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3693-c5c4-4dd9-9139-673c8ce77c4d service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:15.159693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3693-c5c4-4dd9-9139-673c8ce77c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:15.160211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3693-c5c4-4dd9-9139-673c8ce77c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:15.186966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd3693-c5c4-4dd9-9139-673c8ce77c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:15.189194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd3693-c5c4-4dd9-9139-673c8ce77c4d service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:15.206722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:15.216047 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1960/3885] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:16.049373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fb960-38b2-4aa1-bd0d-046781fb4fa5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:16.051108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bd3fb960-38b2-4aa1-bd0d-046781fb4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:16.077326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fb960-38b2-4aa1-bd0d-046781fb4fa5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:16.104068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:16.107759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:16.108361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:16.108909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] PATH_INFO: `/v3/users/8b289f82629141c1917a8138f2584783` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:16.111518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b289f82629141c1917a8138f2584783)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:16.120229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:16.214526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b289f82629141c1917a8138f2584783'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:16.229440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b289f82629141c1917a8138f2584783'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:16.249811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b289f82629141c1917a8138f2584783'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:16.261957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b289f82629141c1917a8138f2584783'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:16.263108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b580cb0-6216-49c2-89ef-5d9f08192819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b289f82629141c1917a8138f2584783'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:16.266691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:16.272400 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1926/3886] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:32:16 2022] DELETE /identity/v3/users/8b289f82629141c1917a8138f2584783 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:17.068823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3693-c5c4-4dd9-9139-673c8ce77c4d service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:17.087602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3693-c5c4-4dd9-9139-673c8ce77c4d service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:17.374860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:17.378932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:17.379961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:17.385076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] PATH_INFO: `/v3/projects/c3cddae9f4e7420f8b6acdc11db5ca1f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:17.391381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3cddae9f4e7420f8b6acdc11db5ca1f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:17.401668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:17.528960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cddae9f4e7420f8b6acdc11db5ca1f', 'request_id': 'req-5d36339a-ab27-434b-92ef-199d912ba6f8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:17.548666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cddae9f4e7420f8b6acdc11db5ca1f', 'request_id': 'req-5d36339a-ab27-434b-92ef-199d912ba6f8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:17.568246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cddae9f4e7420f8b6acdc11db5ca1f', 'request_id': 'req-5d36339a-ab27-434b-92ef-199d912ba6f8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:17.635932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] The token cache is being invalidate because project c3cddae9f4e7420f8b6acdc11db5ca1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:32:17.638166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:17.644726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d36339a-ab27-434b-92ef-199d912ba6f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:17.657458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a0f58-97d5-4289-a0b7-e059ed5e6261 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:17.658445 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1961/3887] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:32:17 2022] DELETE /identity/v3/projects/c3cddae9f4e7420f8b6acdc11db5ca1f => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:17.659211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a0f58-97d5-4289-a0b7-e059ed5e6261 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:17.660336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a0f58-97d5-4289-a0b7-e059ed5e6261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:17.716082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a19a0f58-97d5-4289-a0b7-e059ed5e6261 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:17.718191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a19a0f58-97d5-4289-a0b7-e059ed5e6261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:17.867683 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1927/3888] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:17.877262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe90560-7419-46aa-8bc2-2a45a5b9aca7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:17.877698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe90560-7419-46aa-8bc2-2a45a5b9aca7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:17.878112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe90560-7419-46aa-8bc2-2a45a5b9aca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:17.911681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2fe90560-7419-46aa-8bc2-2a45a5b9aca7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:17.913653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2fe90560-7419-46aa-8bc2-2a45a5b9aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:17.928475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a0f58-97d5-4289-a0b7-e059ed5e6261 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:17.936037 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1962/3889] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:17.940188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a0f58-97d5-4289-a0b7-e059ed5e6261 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:17.945574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac33fe-3196-4dd0-bc9f-b0b88298ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:17.946973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac33fe-3196-4dd0-bc9f-b0b88298ea39 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:17.947415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac33fe-3196-4dd0-bc9f-b0b88298ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:17.948130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac33fe-3196-4dd0-bc9f-b0b88298ea39 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:17.948966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac33fe-3196-4dd0-bc9f-b0b88298ea39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:32:17.949377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac33fe-3196-4dd0-bc9f-b0b88298ea39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:17.951428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac33fe-3196-4dd0-bc9f-b0b88298ea39 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:18.001645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe90560-7419-46aa-8bc2-2a45a5b9aca7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:18.008077 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1928/3890] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:32:18.035372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe90560-7419-46aa-8bc2-2a45a5b9aca7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:18.058707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e65e30-b39a-4a6f-915c-e57eb01d4588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:18.060313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65e30-b39a-4a6f-915c-e57eb01d4588 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:18.060904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65e30-b39a-4a6f-915c-e57eb01d4588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:18.061568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65e30-b39a-4a6f-915c-e57eb01d4588 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:18.062928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e65e30-b39a-4a6f-915c-e57eb01d4588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:18.067084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e65e30-b39a-4a6f-915c-e57eb01d4588 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:18.142701 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1963/3891] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:32:17 2022] POST /identity/v3/projects => generated 395 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:32:18.150259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac33fe-3196-4dd0-bc9f-b0b88298ea39 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:18.181350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac33fe-3196-4dd0-bc9f-b0b88298ea39 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:18.392431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9b9dd-393e-4e30-9e0a-63596c659045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:18.394859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9b9dd-393e-4e30-9e0a-63596c659045 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:18.395478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9b9dd-393e-4e30-9e0a-63596c659045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:18.396638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9b9dd-393e-4e30-9e0a-63596c659045 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:18.398440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9b9dd-393e-4e30-9e0a-63596c659045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:18.405098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9b9dd-393e-4e30-9e0a-63596c659045 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:18.466663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e65e30-b39a-4a6f-915c-e57eb01d4588 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:18.470023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1929/3892] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:32:18 2022] POST /identity/v3/users => generated 298 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:32:18.497896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e65e30-b39a-4a6f-915c-e57eb01d4588 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:18.509725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcdb04-1f41-480c-8ca2-09423afdca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:18.511715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcdb04-1f41-480c-8ca2-09423afdca21 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:18.512360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcdb04-1f41-480c-8ca2-09423afdca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:18.512985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcdb04-1f41-480c-8ca2-09423afdca21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:18.515050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcdb04-1f41-480c-8ca2-09423afdca21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:18.521284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcdb04-1f41-480c-8ca2-09423afdca21 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:18.561403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9b9dd-393e-4e30-9e0a-63596c659045 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:18.574819 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1964/3893] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:32:18.594934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9b9dd-393e-4e30-9e0a-63596c659045 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:18.615245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a962f5b-d429-4d29-8ef3-70270c519b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:18.616691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a962f5b-d429-4d29-8ef3-70270c519b3a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:18.617332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a962f5b-d429-4d29-8ef3-70270c519b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:18.617902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a962f5b-d429-4d29-8ef3-70270c519b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:18.620478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a962f5b-d429-4d29-8ef3-70270c519b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:18.630578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a962f5b-d429-4d29-8ef3-70270c519b3a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:18.657147 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1930/3894] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:32:18.666779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcdb04-1f41-480c-8ca2-09423afdca21 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:18.692350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcdb04-1f41-480c-8ca2-09423afdca21 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:18.726344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43a946-6a94-45b3-98b1-fd3d749b64a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:18.727078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43a946-6a94-45b3-98b1-fd3d749b64a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:18.728104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43a946-6a94-45b3-98b1-fd3d749b64a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:18.728104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43a946-6a94-45b3-98b1-fd3d749b64a0 admin admin] PATH_INFO: `/v3/projects/700c99d5f9a7437bb2733ef2e5a581da/users/ff65e416926c4720a4c26d3d5ee61519/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:18.762535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43a946-6a94-45b3-98b1-fd3d749b64a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=700c99d5f9a7437bb2733ef2e5a581da, user_id=ff65e416926c4720a4c26d3d5ee61519, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:18.766443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43a946-6a94-45b3-98b1-fd3d749b64a0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:18.801050 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1965/3895] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:32:18 2022] PUT /identity/v3/projects/700c99d5f9a7437bb2733ef2e5a581da/users/ff65e416926c4720a4c26d3d5ee61519/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:18.809442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516508-18a1-4944-8449-0c91b407e818 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:18.810081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516508-18a1-4944-8449-0c91b407e818 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:18.810508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7516508-18a1-4944-8449-0c91b407e818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:18.858507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d7516508-18a1-4944-8449-0c91b407e818 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:18.862729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d7516508-18a1-4944-8449-0c91b407e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:18.984915 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1931/3896] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:19.008624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43a946-6a94-45b3-98b1-fd3d749b64a0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:19.012457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7d43a946-6a94-45b3-98b1-fd3d749b64a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:19.093341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:19.157089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43a946-6a94-45b3-98b1-fd3d749b64a0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:19.168995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a7234-1ffe-4c45-81b4-77a9531905fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:19.170149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a7234-1ffe-4c45-81b4-77a9531905fc service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:19.170629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a7234-1ffe-4c45-81b4-77a9531905fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:19.170938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a7234-1ffe-4c45-81b4-77a9531905fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:19.228750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a7234-1ffe-4c45-81b4-77a9531905fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:19.230464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a7234-1ffe-4c45-81b4-77a9531905fc service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:19.282080 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1966/3897] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:32:20.832384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516508-18a1-4944-8449-0c91b407e818 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:20.834331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d7516508-18a1-4944-8449-0c91b407e818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:20.853756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:21.020659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7516508-18a1-4944-8449-0c91b407e818 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:21.050281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b94203-e990-4a48-9916-c61c0ecfda21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:21.050982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b94203-e990-4a48-9916-c61c0ecfda21 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:21.051240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b94203-e990-4a48-9916-c61c0ecfda21 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:21.051472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b94203-e990-4a48-9916-c61c0ecfda21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:21.053403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e0b94203-e990-4a48-9916-c61c0ecfda21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:21.191655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b94203-e990-4a48-9916-c61c0ecfda21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:21.193402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b94203-e990-4a48-9916-c61c0ecfda21 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:21.244995 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1932/3898] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:23.318420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a7234-1ffe-4c45-81b4-77a9531905fc service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:23.320100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d66a7234-1ffe-4c45-81b4-77a9531905fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:23.338400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a7234-1ffe-4c45-81b4-77a9531905fc service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:23.358255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd028-5632-4ad1-b199-d8558e6ad4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:23.359571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd028-5632-4ad1-b199-d8558e6ad4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:23.360247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd028-5632-4ad1-b199-d8558e6ad4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:23.361383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dd028-5632-4ad1-b199-d8558e6ad4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:23.367100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-861dd028-5632-4ad1-b199-d8558e6ad4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:23.404127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd028-5632-4ad1-b199-d8558e6ad4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:23.405610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dd028-5632-4ad1-b199-d8558e6ad4b8 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:23.433461 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1967/3899] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:25.073819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28e280-3a0c-4dcb-93f3-a8e716bc3f6d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:25.075080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28e280-3a0c-4dcb-93f3-a8e716bc3f6d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:25.075766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d28e280-3a0c-4dcb-93f3-a8e716bc3f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:25.098702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4d28e280-3a0c-4dcb-93f3-a8e716bc3f6d None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:25.100369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4d28e280-3a0c-4dcb-93f3-a8e716bc3f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:25.265752 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1933/3900] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:32:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:25.280056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd028-5632-4ad1-b199-d8558e6ad4b8 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:25.282923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-861dd028-5632-4ad1-b199-d8558e6ad4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:25.377120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dd028-5632-4ad1-b199-d8558e6ad4b8 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:25.409655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10db9e-0e4e-41b5-8d38-b1d80715c0ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:25.410638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10db9e-0e4e-41b5-8d38-b1d80715c0ee service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:25.411107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10db9e-0e4e-41b5-8d38-b1d80715c0ee service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:25.411551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10db9e-0e4e-41b5-8d38-b1d80715c0ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:25.445581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10db9e-0e4e-41b5-8d38-b1d80715c0ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:25.458163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10db9e-0e4e-41b5-8d38-b1d80715c0ee service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:25.503383 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1968/3901] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:32:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:29.616178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff3c9a-ee10-48f7-b699-78697de745bb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:29.617626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff3c9a-ee10-48f7-b699-78697de745bb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:29.619360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff3c9a-ee10-48f7-b699-78697de745bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:29.702193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-58ff3c9a-ee10-48f7-b699-78697de745bb None None] MFA Rules not processed for user `ee5effb4577e42d7ba3b2b1c3305a687`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:29.705177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-58ff3c9a-ee10-48f7-b699-78697de745bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:29.860116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:29.929205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1934/3902] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:29.974088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f95f3-1253-4f56-bc28-04a52398547f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:29.974622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f95f3-1253-4f56-bc28-04a52398547f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:29.974718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f95f3-1253-4f56-bc28-04a52398547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:30.060704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fb2f95f3-1253-4f56-bc28-04a52398547f None None] MFA Rules not processed for user `02d9c132a2484d73aab0fc0f25020a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:30.064603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fb2f95f3-1253-4f56-bc28-04a52398547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:30.317906 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1969/3903] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:30.975224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff3c9a-ee10-48f7-b699-78697de745bb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:31.027474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff3c9a-ee10-48f7-b699-78697de745bb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:31.062065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5cefe2-a2ca-4466-8597-b5146677d3ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:31.063171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cefe2-a2ca-4466-8597-b5146677d3ae service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:31.063844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cefe2-a2ca-4466-8597-b5146677d3ae service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:31.064525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5cefe2-a2ca-4466-8597-b5146677d3ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:31.092912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cefe2-a2ca-4466-8597-b5146677d3ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:31.096261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5cefe2-a2ca-4466-8597-b5146677d3ae service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:31.121791 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1935/3904] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:30 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:31.340092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b5fcd-77a7-41c0-a6d0-3c43a55d9d67 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:31.340873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b5fcd-77a7-41c0-a6d0-3c43a55d9d67 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:31.340873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b5fcd-77a7-41c0-a6d0-3c43a55d9d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:31.405921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-232b5fcd-77a7-41c0-a6d0-3c43a55d9d67 None None] MFA Rules not processed for user `ff65e416926c4720a4c26d3d5ee61519`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:31.407192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-232b5fcd-77a7-41c0-a6d0-3c43a55d9d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:31.455446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:31.534757 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1970/3905] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:31.552624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e92430-ee20-44e2-be94-517eb2e5cec3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:31.553035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e92430-ee20-44e2-be94-517eb2e5cec3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:31.553459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e92430-ee20-44e2-be94-517eb2e5cec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:31.583446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-92e92430-ee20-44e2-be94-517eb2e5cec3 None None] MFA Rules not processed for user `ff65e416926c4720a4c26d3d5ee61519`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:31.586318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-92e92430-ee20-44e2-be94-517eb2e5cec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:31.612125 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1936/3906] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:33.038607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b5fcd-77a7-41c0-a6d0-3c43a55d9d67 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:33.064281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b5fcd-77a7-41c0-a6d0-3c43a55d9d67 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:33.084065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4a6cb-8e55-44eb-b29f-f004f7fe57c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:33.085171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4a6cb-8e55-44eb-b29f-f004f7fe57c0 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:33.085672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4a6cb-8e55-44eb-b29f-f004f7fe57c0 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:33.086199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4a6cb-8e55-44eb-b29f-f004f7fe57c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:33.119830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4a6cb-8e55-44eb-b29f-f004f7fe57c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:33.126188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4a6cb-8e55-44eb-b29f-f004f7fe57c0 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:33.178345 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1971/3907] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:33 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:39.291102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e92430-ee20-44e2-be94-517eb2e5cec3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:39.293390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-92e92430-ee20-44e2-be94-517eb2e5cec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:39.399090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4a6cb-8e55-44eb-b29f-f004f7fe57c0 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:39.402820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fca4a6cb-8e55-44eb-b29f-f004f7fe57c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:39.453913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4a6cb-8e55-44eb-b29f-f004f7fe57c0 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:39.463260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:39.464461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:39.464936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:39.465548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] PATH_INFO: `/v3/users/02d9c132a2484d73aab0fc0f25020a5d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:39.469351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d9c132a2484d73aab0fc0f25020a5d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:39.474010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:39.549151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e92430-ee20-44e2-be94-517eb2e5cec3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:39.561236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c0fd5-cca2-4b1b-99ce-42a31aeff017 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:39.561953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c0fd5-cca2-4b1b-99ce-42a31aeff017 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:39.562240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c0fd5-cca2-4b1b-99ce-42a31aeff017 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:39.562634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c0fd5-cca2-4b1b-99ce-42a31aeff017 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:39.565953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ff1c0fd5-cca2-4b1b-99ce-42a31aeff017 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:39.604389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c0fd5-cca2-4b1b-99ce-42a31aeff017 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:39.609544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c0fd5-cca2-4b1b-99ce-42a31aeff017 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:39.615948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d9c132a2484d73aab0fc0f25020a5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:39.617058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d9c132a2484d73aab0fc0f25020a5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:39.629588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d9c132a2484d73aab0fc0f25020a5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:39.642655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d9c132a2484d73aab0fc0f25020a5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:39.653210 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1937/3908] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:39.708607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-015b7d59-d8f8-460c-a993-59392f0157e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d9c132a2484d73aab0fc0f25020a5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:39.721827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1972/3909] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:32:39 2022] DELETE /identity/v3/users/02d9c132a2484d73aab0fc0f25020a5d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:40.050062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c0fd5-cca2-4b1b-99ce-42a31aeff017 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:40.069645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c0fd5-cca2-4b1b-99ce-42a31aeff017 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:40.169082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:40.169082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:40.169618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:40.169618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] PATH_INFO: `/v3/projects/ba5284d2a74b423eb87f3bd75f7fe416` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:40.171514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5284d2a74b423eb87f3bd75f7fe416)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:40.173532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:40.252205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5284d2a74b423eb87f3bd75f7fe416', 'request_id': 'req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:40.265430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5284d2a74b423eb87f3bd75f7fe416', 'request_id': 'req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:40.267662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:40.289912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5284d2a74b423eb87f3bd75f7fe416', 'request_id': 'req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:40.319854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] The token cache is being invalidate because project ba5284d2a74b423eb87f3bd75f7fe416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:32:40.321577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:40.322124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae94d2b2-9a5f-4307-ab71-0b4f46a79cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:40.330896 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1938/3910] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:32:40 2022] DELETE /identity/v3/projects/ba5284d2a74b423eb87f3bd75f7fe416 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:32:40.334052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabad0c-9e52-49e4-bb4f-8775d6063fa6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:40.334325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabad0c-9e52-49e4-bb4f-8775d6063fa6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:40.334663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabad0c-9e52-49e4-bb4f-8775d6063fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:40.374679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1cabad0c-9e52-49e4-bb4f-8775d6063fa6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:40.377697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1cabad0c-9e52-49e4-bb4f-8775d6063fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:40.700337 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1973/3911] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:40.708650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9a9c-27e6-4c76-b75b-a8482fd887d8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:40.708934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9a9c-27e6-4c76-b75b-a8482fd887d8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:40.709195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d9a9c-27e6-4c76-b75b-a8482fd887d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:40.782729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-942d9a9c-27e6-4c76-b75b-a8482fd887d8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:40.787633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-942d9a9c-27e6-4c76-b75b-a8482fd887d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:40.831872 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1939/3912] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:40.834297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabad0c-9e52-49e4-bb4f-8775d6063fa6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:40.893395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabad0c-9e52-49e4-bb4f-8775d6063fa6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:40.906268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3066a-765b-473d-8ebf-ff6deeb614b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:40.907765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3066a-765b-473d-8ebf-ff6deeb614b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:40.908677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3066a-765b-473d-8ebf-ff6deeb614b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:40.909674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3066a-765b-473d-8ebf-ff6deeb614b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:40.916153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3066a-765b-473d-8ebf-ff6deeb614b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:32:40.927806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3066a-765b-473d-8ebf-ff6deeb614b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:40.931783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3066a-765b-473d-8ebf-ff6deeb614b6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:40.973775 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1974/3913] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:32:40.980255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d9a9c-27e6-4c76-b75b-a8482fd887d8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:41.003591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d9a9c-27e6-4c76-b75b-a8482fd887d8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:41.042425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90733828-cf2d-4cc7-8133-fa07e5e31e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:41.044494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90733828-cf2d-4cc7-8133-fa07e5e31e83 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:41.046171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90733828-cf2d-4cc7-8133-fa07e5e31e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:41.046961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90733828-cf2d-4cc7-8133-fa07e5e31e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:41.049605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90733828-cf2d-4cc7-8133-fa07e5e31e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:41.058830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90733828-cf2d-4cc7-8133-fa07e5e31e83 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:41.163019 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1940/3914] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:32:40 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:32:41.170384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3066a-765b-473d-8ebf-ff6deeb614b6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:41.200546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3066a-765b-473d-8ebf-ff6deeb614b6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:41.256362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:41.482307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae035e-276b-4d96-a3e4-117bda84333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:41.483009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae035e-276b-4d96-a3e4-117bda84333a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:41.483285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae035e-276b-4d96-a3e4-117bda84333a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:41.483568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae035e-276b-4d96-a3e4-117bda84333a admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:41.484219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae035e-276b-4d96-a3e4-117bda84333a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:41.486452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae035e-276b-4d96-a3e4-117bda84333a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:41.538488 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1975/3915] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:32:41 2022] POST /identity/v3/users => generated 283 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:32:41.544259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90733828-cf2d-4cc7-8133-fa07e5e31e83 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:41.568957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90733828-cf2d-4cc7-8133-fa07e5e31e83 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:41.583371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4803cae-0ca2-4223-93b1-7c5121306077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:41.585018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803cae-0ca2-4223-93b1-7c5121306077 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:41.585780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803cae-0ca2-4223-93b1-7c5121306077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:41.586567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4803cae-0ca2-4223-93b1-7c5121306077 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:41.589061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4803cae-0ca2-4223-93b1-7c5121306077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:41.598800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4803cae-0ca2-4223-93b1-7c5121306077 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:41.637401 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1941/3916] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:32:41.644208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae035e-276b-4d96-a3e4-117bda84333a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:41.668838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae035e-276b-4d96-a3e4-117bda84333a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:41.694919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ba751-cd8f-44f2-bd99-bbfe9a566a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:41.696172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ba751-cd8f-44f2-bd99-bbfe9a566a86 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:41.696630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ba751-cd8f-44f2-bd99-bbfe9a566a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:41.697068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ba751-cd8f-44f2-bd99-bbfe9a566a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:41.697960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ba751-cd8f-44f2-bd99-bbfe9a566a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:41.699829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ba751-cd8f-44f2-bd99-bbfe9a566a86 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:41.724443 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1976/3917] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:32:41.731316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4803cae-0ca2-4223-93b1-7c5121306077 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:41.766463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4803cae-0ca2-4223-93b1-7c5121306077 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:41.788495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17459-9ca3-4850-9507-49e9c8f174f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:41.789719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17459-9ca3-4850-9507-49e9c8f174f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:41.790239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17459-9ca3-4850-9507-49e9c8f174f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:41.791010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17459-9ca3-4850-9507-49e9c8f174f2 admin admin] PATH_INFO: `/v3/projects/628005d1913b4e8688ec94eda94fa898/users/156adbbf6e3b4111b49b7e6e17b9825d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:41.855713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f17459-9ca3-4850-9507-49e9c8f174f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=628005d1913b4e8688ec94eda94fa898, user_id=156adbbf6e3b4111b49b7e6e17b9825d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:41.861516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f17459-9ca3-4850-9507-49e9c8f174f2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:41.896157 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1942/3918] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:32:41 2022] PUT /identity/v3/projects/628005d1913b4e8688ec94eda94fa898/users/156adbbf6e3b4111b49b7e6e17b9825d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:41.905248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6f2d5-9d7a-43a0-a2c0-7b625a381f43 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:41.905563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6f2d5-9d7a-43a0-a2c0-7b625a381f43 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:41.906069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6f2d5-9d7a-43a0-a2c0-7b625a381f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:41.961449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1ec6f2d5-9d7a-43a0-a2c0-7b625a381f43 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:41.969844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1ec6f2d5-9d7a-43a0-a2c0-7b625a381f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:42.181595 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1977/3919] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:42.202735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17459-9ca3-4850-9507-49e9c8f174f2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:42.205014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-19f17459-9ca3-4850-9507-49e9c8f174f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:42.354819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17459-9ca3-4850-9507-49e9c8f174f2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:42.368666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1ed3-f43a-4014-a054-9522a1484d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:42.370149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1ed3-f43a-4014-a054-9522a1484d3b service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:42.371043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1ed3-f43a-4014-a054-9522a1484d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:42.371556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1ed3-f43a-4014-a054-9522a1484d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:42.383552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b1ed3-f43a-4014-a054-9522a1484d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:42.386321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b1ed3-f43a-4014-a054-9522a1484d3b service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:42.401743 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1943/3920] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:43.303047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6f2d5-9d7a-43a0-a2c0-7b625a381f43 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:43.304701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1ec6f2d5-9d7a-43a0-a2c0-7b625a381f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:43.358533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6f2d5-9d7a-43a0-a2c0-7b625a381f43 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:43.378982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:43.380266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:43.380894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:43.381651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] PATH_INFO: `/v3/users/358a4edea635469d9a9f64e941b6ed53` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:43.389356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358a4edea635469d9a9f64e941b6ed53)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:43.393270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:43.491816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358a4edea635469d9a9f64e941b6ed53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:43.498272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358a4edea635469d9a9f64e941b6ed53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:43.527067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358a4edea635469d9a9f64e941b6ed53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:43.547767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358a4edea635469d9a9f64e941b6ed53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:43.592677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fe922043-8b90-4e85-9205-ca04db9f4c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358a4edea635469d9a9f64e941b6ed53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:43.606444 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1978/3921] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:32:43 2022] DELETE /identity/v3/users/358a4edea635469d9a9f64e941b6ed53 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:46.229906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1ed3-f43a-4014-a054-9522a1484d3b service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:46.262137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1ed3-f43a-4014-a054-9522a1484d3b service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:46.421126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:46.421711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:46.422020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:46.422299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] PATH_INFO: `/v3/projects/4e408ce7d4134b9795d94877df77cf80` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:46.433811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e408ce7d4134b9795d94877df77cf80)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:46.433811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:46.549007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:46.621258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e408ce7d4134b9795d94877df77cf80', 'request_id': 'req-b89b259e-3aff-4ffe-b910-ebaf20d6c937'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:46.650594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e408ce7d4134b9795d94877df77cf80', 'request_id': 'req-b89b259e-3aff-4ffe-b910-ebaf20d6c937'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:46.663450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e408ce7d4134b9795d94877df77cf80', 'request_id': 'req-b89b259e-3aff-4ffe-b910-ebaf20d6c937'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:46.727253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] The token cache is being invalidate because project 4e408ce7d4134b9795d94877df77cf80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:32:46.727823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:46.734478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b89b259e-3aff-4ffe-b910-ebaf20d6c937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:32:46.736830 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1944/3922] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:32:46 2022] DELETE /identity/v3/projects/4e408ce7d4134b9795d94877df77cf80 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:46.743275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4f845-5529-426a-b4fb-dcc16a1c41f6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:46.743746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4f845-5529-426a-b4fb-dcc16a1c41f6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:46.744217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4f845-5529-426a-b4fb-dcc16a1c41f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:46.775261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:46.822029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-25b4f845-5529-426a-b4fb-dcc16a1c41f6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:46.823201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-25b4f845-5529-426a-b4fb-dcc16a1c41f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:46.983844 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1979/3923] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:46.997455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab5d0-88b3-4935-9ee0-89dad00e3851 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:46.997724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab5d0-88b3-4935-9ee0-89dad00e3851 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:46.998107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab5d0-88b3-4935-9ee0-89dad00e3851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:47.037339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-06eab5d0-88b3-4935-9ee0-89dad00e3851 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:47.042768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-06eab5d0-88b3-4935-9ee0-89dad00e3851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:47.076869 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1945/3924] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:47.080435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4f845-5529-426a-b4fb-dcc16a1c41f6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:47.093417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4f845-5529-426a-b4fb-dcc16a1c41f6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:47.110241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9a187-cedb-4f53-b0b2-5db1afe98c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:47.111112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9a187-cedb-4f53-b0b2-5db1afe98c07 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:47.111503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9a187-cedb-4f53-b0b2-5db1afe98c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:47.112150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9a187-cedb-4f53-b0b2-5db1afe98c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:47.113092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9a187-cedb-4f53-b0b2-5db1afe98c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:32:47.113641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9a187-cedb-4f53-b0b2-5db1afe98c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:47.120687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9a187-cedb-4f53-b0b2-5db1afe98c07 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:47.146235 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1980/3925] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:32:47.153002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab5d0-88b3-4935-9ee0-89dad00e3851 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:47.169923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab5d0-88b3-4935-9ee0-89dad00e3851 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:47.193441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7b17-e0fc-4998-ba5d-e9f6c3506eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:47.194131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7b17-e0fc-4998-ba5d-e9f6c3506eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:47.194411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7b17-e0fc-4998-ba5d-e9f6c3506eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:47.194684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b7b17-e0fc-4998-ba5d-e9f6c3506eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:47.208641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b7b17-e0fc-4998-ba5d-e9f6c3506eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:47.220538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b7b17-e0fc-4998-ba5d-e9f6c3506eb7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:47.294348 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1946/3926] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:32:47 2022] POST /identity/v3/projects => generated 389 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:32:47.297894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9a187-cedb-4f53-b0b2-5db1afe98c07 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:47.325844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9a187-cedb-4f53-b0b2-5db1afe98c07 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:47.502685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27784295-907c-4e81-9c31-5a93db931df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:47.503749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27784295-907c-4e81-9c31-5a93db931df1 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:47.504745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27784295-907c-4e81-9c31-5a93db931df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:47.505117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27784295-907c-4e81-9c31-5a93db931df1 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:47.507328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27784295-907c-4e81-9c31-5a93db931df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:47.512389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27784295-907c-4e81-9c31-5a93db931df1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:47.569161 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1981/3927] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:32:47 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:32:47.573618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7b17-e0fc-4998-ba5d-e9f6c3506eb7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:47.597088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b7b17-e0fc-4998-ba5d-e9f6c3506eb7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:47.610421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f748a9-9708-45c5-a772-f8ad3aea393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:47.612139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f748a9-9708-45c5-a772-f8ad3aea393d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:47.614572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f748a9-9708-45c5-a772-f8ad3aea393d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:47.616851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f748a9-9708-45c5-a772-f8ad3aea393d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:47.617804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f748a9-9708-45c5-a772-f8ad3aea393d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:47.627277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f748a9-9708-45c5-a772-f8ad3aea393d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:47.649085 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1947/3928] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:32:47.653022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27784295-907c-4e81-9c31-5a93db931df1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:47.665148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27784295-907c-4e81-9c31-5a93db931df1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:47.670418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf95ecd-8964-47d3-931a-d842c223c286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:47.671262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf95ecd-8964-47d3-931a-d842c223c286 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:47.671709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf95ecd-8964-47d3-931a-d842c223c286 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:47.672143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf95ecd-8964-47d3-931a-d842c223c286 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:47.672943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf95ecd-8964-47d3-931a-d842c223c286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:47.674805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf95ecd-8964-47d3-931a-d842c223c286 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:47.696081 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1982/3929] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:32:47.697139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f748a9-9708-45c5-a772-f8ad3aea393d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:47.709199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f748a9-9708-45c5-a772-f8ad3aea393d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:47.713573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98dfbf-1edb-4f7d-bf86-92fdbc8be7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:47.714682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98dfbf-1edb-4f7d-bf86-92fdbc8be7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:47.715091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98dfbf-1edb-4f7d-bf86-92fdbc8be7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:47.715543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98dfbf-1edb-4f7d-bf86-92fdbc8be7b1 admin admin] PATH_INFO: `/v3/projects/a701939f871d411283d8b3c32c79fc3d/users/a01a7cc74e3e497188bec2d673d650aa/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:47.757609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98dfbf-1edb-4f7d-bf86-92fdbc8be7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a701939f871d411283d8b3c32c79fc3d, user_id=a01a7cc74e3e497188bec2d673d650aa, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:47.761073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98dfbf-1edb-4f7d-bf86-92fdbc8be7b1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:47.801432 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1948/3930] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:32:47 2022] PUT /identity/v3/projects/a701939f871d411283d8b3c32c79fc3d/users/a01a7cc74e3e497188bec2d673d650aa/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:32:47.809759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76caec-e096-44de-b0ab-7cb520bd2a89 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:47.810799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76caec-e096-44de-b0ab-7cb520bd2a89 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:47.811149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76caec-e096-44de-b0ab-7cb520bd2a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:47.834125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5b76caec-e096-44de-b0ab-7cb520bd2a89 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:47.835487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5b76caec-e096-44de-b0ab-7cb520bd2a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:47.918181 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1983/3931] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:47.955906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98dfbf-1edb-4f7d-bf86-92fdbc8be7b1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:47.958507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8f98dfbf-1edb-4f7d-bf86-92fdbc8be7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:48.099919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98dfbf-1edb-4f7d-bf86-92fdbc8be7b1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:48.111433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074065f-23b9-49b1-b0cb-a15dceb08087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:48.112153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074065f-23b9-49b1-b0cb-a15dceb08087 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:48.113780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074065f-23b9-49b1-b0cb-a15dceb08087 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:48.114178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074065f-23b9-49b1-b0cb-a15dceb08087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:48.146315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074065f-23b9-49b1-b0cb-a15dceb08087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:48.149739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074065f-23b9-49b1-b0cb-a15dceb08087 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:48.174808 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1949/3932] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:54.487579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498226-32ef-42d9-8faa-670ac74b0abe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:54.488152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498226-32ef-42d9-8faa-670ac74b0abe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:54.488519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5498226-32ef-42d9-8faa-670ac74b0abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:54.555168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:54.583128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f5498226-32ef-42d9-8faa-670ac74b0abe None None] MFA Rules not processed for user `156adbbf6e3b4111b49b7e6e17b9825d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:54.585534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f5498226-32ef-42d9-8faa-670ac74b0abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:54.843487 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1984/3933] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:32:54.860926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498b5ab-2c5e-4253-b821-e5084ec716c3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:54.862067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498b5ab-2c5e-4253-b821-e5084ec716c3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:54.862748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498b5ab-2c5e-4253-b821-e5084ec716c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:54.967108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2498b5ab-2c5e-4253-b821-e5084ec716c3 None None] MFA Rules not processed for user `156adbbf6e3b4111b49b7e6e17b9825d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:32:54.976099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2498b5ab-2c5e-4253-b821-e5084ec716c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:55.036446 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1950/3934] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:32:55.891021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498226-32ef-42d9-8faa-670ac74b0abe None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:55.893412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f5498226-32ef-42d9-8faa-670ac74b0abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:56.124288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5498226-32ef-42d9-8faa-670ac74b0abe None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:56.180094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f038a47-8187-4a07-83b5-d6c2e54b0967 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:56.181367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f038a47-8187-4a07-83b5-d6c2e54b0967 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:56.184638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f038a47-8187-4a07-83b5-d6c2e54b0967 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:56.185260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f038a47-8187-4a07-83b5-d6c2e54b0967 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:56.247550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f038a47-8187-4a07-83b5-d6c2e54b0967 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:56.252362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f038a47-8187-4a07-83b5-d6c2e54b0967 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:56.302622 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1985/3935] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:32:59.715670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498b5ab-2c5e-4253-b821-e5084ec716c3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:32:59.718415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2498b5ab-2c5e-4253-b821-e5084ec716c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:59.756558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498b5ab-2c5e-4253-b821-e5084ec716c3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:32:59.764577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99bdf7-83cf-4f77-b244-5ee80c5f88a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:32:59.765560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99bdf7-83cf-4f77-b244-5ee80c5f88a8 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:59.766072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99bdf7-83cf-4f77-b244-5ee80c5f88a8 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:59.766699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99bdf7-83cf-4f77-b244-5ee80c5f88a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:59.768857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-be99bdf7-83cf-4f77-b244-5ee80c5f88a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:32:59.849670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:59.921079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365088-2b11-430c-a915-0fe2ea9cc162 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:32:59.922048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99bdf7-83cf-4f77-b244-5ee80c5f88a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:32:59.923743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365088-2b11-430c-a915-0fe2ea9cc162 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:32:59.926891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d365088-2b11-430c-a915-0fe2ea9cc162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:32:59.935453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99bdf7-83cf-4f77-b244-5ee80c5f88a8 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:32:59.966001 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1951/3936] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:32:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:33:00.118363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8d365088-2b11-430c-a915-0fe2ea9cc162 None None] MFA Rules not processed for user `a01a7cc74e3e497188bec2d673d650aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:00.120414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8d365088-2b11-430c-a915-0fe2ea9cc162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:00.266166 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1986/3937] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:32:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:00.271951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99bdf7-83cf-4f77-b244-5ee80c5f88a8 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:00.298838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99bdf7-83cf-4f77-b244-5ee80c5f88a8 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:00.312612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ea3ce-ae62-4e93-a646-f14b8bd4cecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:00.313669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ea3ce-ae62-4e93-a646-f14b8bd4cecb admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:00.314222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ea3ce-ae62-4e93-a646-f14b8bd4cecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:00.314709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ea3ce-ae62-4e93-a646-f14b8bd4cecb admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:00.316849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ea3ce-ae62-4e93-a646-f14b8bd4cecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:00.322744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ea3ce-ae62-4e93-a646-f14b8bd4cecb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:00.398678 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1952/3938] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:33:00 2022] POST /identity/v3/projects => generated 389 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:33:00.401073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d365088-2b11-430c-a915-0fe2ea9cc162 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:00.426298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d365088-2b11-430c-a915-0fe2ea9cc162 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:00.476817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:00.640337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761a3b9-0395-43f3-b09e-bf063f282522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:00.641676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761a3b9-0395-43f3-b09e-bf063f282522 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:00.642253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761a3b9-0395-43f3-b09e-bf063f282522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:00.642527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761a3b9-0395-43f3-b09e-bf063f282522 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:00.643239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761a3b9-0395-43f3-b09e-bf063f282522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:00.647593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761a3b9-0395-43f3-b09e-bf063f282522 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:00.728188 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1987/3939] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:33:00 2022] POST /identity/v3/users => generated 301 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:33:00.732148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ea3ce-ae62-4e93-a646-f14b8bd4cecb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:00.751964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ea3ce-ae62-4e93-a646-f14b8bd4cecb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:00.763754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba479c08-eadd-400d-914f-052b1cebfbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:00.766588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba479c08-eadd-400d-914f-052b1cebfbbf admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:00.768630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba479c08-eadd-400d-914f-052b1cebfbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:00.769184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba479c08-eadd-400d-914f-052b1cebfbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:00.770159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba479c08-eadd-400d-914f-052b1cebfbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:00.776157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba479c08-eadd-400d-914f-052b1cebfbbf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:00.811596 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1953/3940] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:33:00.816525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761a3b9-0395-43f3-b09e-bf063f282522 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:00.839847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761a3b9-0395-43f3-b09e-bf063f282522 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:00.858760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37120a-1428-41ed-94e9-5b279ddd4735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:00.864758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37120a-1428-41ed-94e9-5b279ddd4735 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:00.865047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37120a-1428-41ed-94e9-5b279ddd4735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:00.865336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37120a-1428-41ed-94e9-5b279ddd4735 admin admin] PATH_INFO: `/v3/projects/6d3f2aa46ad640739bb64bd4078c086c/users/8374e9c25534494f90f41423230f5321/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:00.944300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37120a-1428-41ed-94e9-5b279ddd4735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3f2aa46ad640739bb64bd4078c086c, user_id=8374e9c25534494f90f41423230f5321, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:00.950249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37120a-1428-41ed-94e9-5b279ddd4735 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:01.001790 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1988/3941] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:33:00 2022] PUT /identity/v3/projects/6d3f2aa46ad640739bb64bd4078c086c/users/8374e9c25534494f90f41423230f5321/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:33:01.006229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba479c08-eadd-400d-914f-052b1cebfbbf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:01.045487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba479c08-eadd-400d-914f-052b1cebfbbf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:01.244402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3349b-8d07-44ea-b5ce-8484867111d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:01.251796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3349b-8d07-44ea-b5ce-8484867111d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:01.254528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3349b-8d07-44ea-b5ce-8484867111d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:01.255742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3349b-8d07-44ea-b5ce-8484867111d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:01.262475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3349b-8d07-44ea-b5ce-8484867111d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:01.268857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3349b-8d07-44ea-b5ce-8484867111d5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:01.298129 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1954/3942] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:33:01.303956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37120a-1428-41ed-94e9-5b279ddd4735 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:01.334613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37120a-1428-41ed-94e9-5b279ddd4735 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:01.370551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47803cb5-9139-4107-ab02-5f5b8ae3c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:01.372908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803cb5-9139-4107-ab02-5f5b8ae3c1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:01.373386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803cb5-9139-4107-ab02-5f5b8ae3c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:01.374848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47803cb5-9139-4107-ab02-5f5b8ae3c1a9 admin admin] PATH_INFO: `/v3/projects/6d3f2aa46ad640739bb64bd4078c086c/users/8374e9c25534494f90f41423230f5321/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:01.383309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47803cb5-9139-4107-ab02-5f5b8ae3c1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3f2aa46ad640739bb64bd4078c086c, user_id=8374e9c25534494f90f41423230f5321, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:01.385629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47803cb5-9139-4107-ab02-5f5b8ae3c1a9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:01.436180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1989/3943] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:33:01 2022] PUT /identity/v3/projects/6d3f2aa46ad640739bb64bd4078c086c/users/8374e9c25534494f90f41423230f5321/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:33:01.772980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33773-2be2-4592-9a2b-ca008ae01bac None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:01.773863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33773-2be2-4592-9a2b-ca008ae01bac None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:01.774542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d33773-2be2-4592-9a2b-ca008ae01bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:01.796340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-07d33773-2be2-4592-9a2b-ca008ae01bac None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:01.798155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-07d33773-2be2-4592-9a2b-ca008ae01bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:01.975823 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1955/3944] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:33:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:01.999149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47803cb5-9139-4107-ab02-5f5b8ae3c1a9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:02.004611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-47803cb5-9139-4107-ab02-5f5b8ae3c1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:02.222911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47803cb5-9139-4107-ab02-5f5b8ae3c1a9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:02.265394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa34d9-848e-42cb-8ee0-e9650d3036b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:02.266312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa34d9-848e-42cb-8ee0-e9650d3036b9 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:02.268116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa34d9-848e-42cb-8ee0-e9650d3036b9 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:02.268739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa34d9-848e-42cb-8ee0-e9650d3036b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:02.297334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa34d9-848e-42cb-8ee0-e9650d3036b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:02.299927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa34d9-848e-42cb-8ee0-e9650d3036b9 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:02.316646 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1990/3945] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:33:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:03.246445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee4ff2-8cc5-438d-87ef-6f02dc89cc1a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:03.247549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee4ff2-8cc5-438d-87ef-6f02dc89cc1a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:03.248032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee4ff2-8cc5-438d-87ef-6f02dc89cc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:03.300873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d8ee4ff2-8cc5-438d-87ef-6f02dc89cc1a None None] MFA Rules not processed for user `36bbf0c01d0148aeab626e6d1bb1f0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:03.304341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d8ee4ff2-8cc5-438d-87ef-6f02dc89cc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:03.475437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:03.504403 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1956/3946] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:08.840427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b473-6e28-4013-ad8b-206473d31207 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:08.841350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b473-6e28-4013-ad8b-206473d31207 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:08.841785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478b473-6e28-4013-ad8b-206473d31207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:08.900418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d478b473-6e28-4013-ad8b-206473d31207 None None] MFA Rules not processed for user `ff65e416926c4720a4c26d3d5ee61519`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:08.906963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d478b473-6e28-4013-ad8b-206473d31207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:09.145102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:09.177506 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1991/3947] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:08 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:12.689534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa3d28-ca58-4e01-9aed-807818117839 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:12.690821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa3d28-ca58-4e01-9aed-807818117839 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:12.691580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa3d28-ca58-4e01-9aed-807818117839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:12.757143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-eafa3d28-ca58-4e01-9aed-807818117839 None None] MFA Rules not processed for user `ff65e416926c4720a4c26d3d5ee61519`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:12.764427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eafa3d28-ca58-4e01-9aed-807818117839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:12.794215 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1957/3948] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:13.681969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341297ce-2826-40bd-bd43-b98a59970800 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:13.682585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341297ce-2826-40bd-bd43-b98a59970800 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:13.682859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341297ce-2826-40bd-bd43-b98a59970800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:13.747237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-341297ce-2826-40bd-bd43-b98a59970800 None None] MFA Rules not processed for user `8374e9c25534494f90f41423230f5321`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:13.752063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-341297ce-2826-40bd-bd43-b98a59970800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:14.115922 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1992/3949] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:14.139879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa3d28-ca58-4e01-9aed-807818117839 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:14.144005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eafa3d28-ca58-4e01-9aed-807818117839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:14.408949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa3d28-ca58-4e01-9aed-807818117839 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:14.433939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d58575-41c8-473a-9cde-1cd2c57d3b31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:14.434693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d58575-41c8-473a-9cde-1cd2c57d3b31 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:14.435036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d58575-41c8-473a-9cde-1cd2c57d3b31 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:14.435377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d58575-41c8-473a-9cde-1cd2c57d3b31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:14.567799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d58575-41c8-473a-9cde-1cd2c57d3b31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:14.571110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d58575-41c8-473a-9cde-1cd2c57d3b31 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:14.607055 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1958/3950] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:14.757948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0858b-de45-49cb-ac83-6e31ff44b464 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:14.757948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0858b-de45-49cb-ac83-6e31ff44b464 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:14.757948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0858b-de45-49cb-ac83-6e31ff44b464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:14.792125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-26b0858b-de45-49cb-ac83-6e31ff44b464 None None] MFA Rules not processed for user `ff65e416926c4720a4c26d3d5ee61519`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:14.793404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-26b0858b-de45-49cb-ac83-6e31ff44b464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:14.836081 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1993/3951] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:17.022707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3cfe9-af71-4aac-9a5c-9894a772a245 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:17.023397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3cfe9-af71-4aac-9a5c-9894a772a245 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:17.023534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3cfe9-af71-4aac-9a5c-9894a772a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:17.076346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-85b3cfe9-af71-4aac-9a5c-9894a772a245 None None] MFA Rules not processed for user `ff65e416926c4720a4c26d3d5ee61519`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:17.077636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-85b3cfe9-af71-4aac-9a5c-9894a772a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:17.101929 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1959/3952] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:18.617470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164f8d4-4cfb-4bd8-b8b0-0d20db6a7c27 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:18.618120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164f8d4-4cfb-4bd8-b8b0-0d20db6a7c27 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:18.618256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164f8d4-4cfb-4bd8-b8b0-0d20db6a7c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:18.676388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4164f8d4-4cfb-4bd8-b8b0-0d20db6a7c27 None None] MFA Rules not processed for user `ff65e416926c4720a4c26d3d5ee61519`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:18.679589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4164f8d4-4cfb-4bd8-b8b0-0d20db6a7c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:18.703547 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1994/3953] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:23.943609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e9d23-148c-40e8-bfc3-ff8772e861d6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:23.944172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e9d23-148c-40e8-bfc3-ff8772e861d6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:23.944172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e9d23-148c-40e8-bfc3-ff8772e861d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:24.000935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-456e9d23-148c-40e8-bfc3-ff8772e861d6 None None] MFA Rules not processed for user `84933dd631ac4adbb499c5072b7caf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:24.006836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-456e9d23-148c-40e8-bfc3-ff8772e861d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:24.192715 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1960/3954] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:28.665285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=40 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:34.169835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:35.094230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164f8d4-4cfb-4bd8-b8b0-0d20db6a7c27 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:35.096769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4164f8d4-4cfb-4bd8-b8b0-0d20db6a7c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:35.302932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164f8d4-4cfb-4bd8-b8b0-0d20db6a7c27 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:35.311761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:35.315547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:35.316183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:35.316638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] PATH_INFO: `/v3/users/ff65e416926c4720a4c26d3d5ee61519` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:35.320901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff65e416926c4720a4c26d3d5ee61519)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:35.330126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:35.434847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff65e416926c4720a4c26d3d5ee61519'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:35.435822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff65e416926c4720a4c26d3d5ee61519'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:35.450613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff65e416926c4720a4c26d3d5ee61519'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:35.473307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff65e416926c4720a4c26d3d5ee61519'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:35.497065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9313ac91-aadb-47c9-b890-8dfa73ae10e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff65e416926c4720a4c26d3d5ee61519'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:35.507864 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1995/3955] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:33:35 2022] DELETE /identity/v3/users/ff65e416926c4720a4c26d3d5ee61519 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:33:35.908897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e9d23-148c-40e8-bfc3-ff8772e861d6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:35.938224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e9d23-148c-40e8-bfc3-ff8772e861d6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:36.088301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:36.089470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:36.090133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:36.090684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] PATH_INFO: `/v3/projects/700c99d5f9a7437bb2733ef2e5a581da` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:36.092573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=700c99d5f9a7437bb2733ef2e5a581da)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:36.095373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:36.248986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '700c99d5f9a7437bb2733ef2e5a581da', 'request_id': 'req-b68b3259-4515-4a8b-9271-53c40dfcbee8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:36.270685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '700c99d5f9a7437bb2733ef2e5a581da', 'request_id': 'req-b68b3259-4515-4a8b-9271-53c40dfcbee8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:36.293432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '700c99d5f9a7437bb2733ef2e5a581da', 'request_id': 'req-b68b3259-4515-4a8b-9271-53c40dfcbee8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:36.341764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] The token cache is being invalidate because project 700c99d5f9a7437bb2733ef2e5a581da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:33:36.342385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:36.347287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b68b3259-4515-4a8b-9271-53c40dfcbee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:36.360184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99293b32-6cd4-4463-85b6-cbd34ffeb6da None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:36.361294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99293b32-6cd4-4463-85b6-cbd34ffeb6da None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:36.361802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99293b32-6cd4-4463-85b6-cbd34ffeb6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:36.364940 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1961/3956] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:33:35 2022] DELETE /identity/v3/projects/700c99d5f9a7437bb2733ef2e5a581da => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:33:36.402213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-99293b32-6cd4-4463-85b6-cbd34ffeb6da None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:36.403969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-99293b32-6cd4-4463-85b6-cbd34ffeb6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:36.572155 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1996/3957] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:36.675326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bc2bd-9a0c-4447-89d2-e6d88757a7c5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:36.675896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bc2bd-9a0c-4447-89d2-e6d88757a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:36.676399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bc2bd-9a0c-4447-89d2-e6d88757a7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:36.712278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-305bc2bd-9a0c-4447-89d2-e6d88757a7c5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:36.713716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-305bc2bd-9a0c-4447-89d2-e6d88757a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:36.734619 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1962/3958] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:36.735780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99293b32-6cd4-4463-85b6-cbd34ffeb6da None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:36.747401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99293b32-6cd4-4463-85b6-cbd34ffeb6da None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:36.777690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a6f5d-78a7-446a-bd75-77093ff019b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:36.778806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a6f5d-78a7-446a-bd75-77093ff019b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:36.779288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a6f5d-78a7-446a-bd75-77093ff019b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:36.779758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a6f5d-78a7-446a-bd75-77093ff019b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:36.780629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a6f5d-78a7-446a-bd75-77093ff019b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:33:36.781418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a6f5d-78a7-446a-bd75-77093ff019b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:36.784079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a6f5d-78a7-446a-bd75-77093ff019b1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:36.800688 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1997/3959] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:33:36.805267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bc2bd-9a0c-4447-89d2-e6d88757a7c5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:36.819707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bc2bd-9a0c-4447-89d2-e6d88757a7c5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:36.825303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbe4d5-c040-41ce-8393-955db8ebfb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:36.826129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbe4d5-c040-41ce-8393-955db8ebfb09 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:36.826543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbe4d5-c040-41ce-8393-955db8ebfb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:36.826927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbe4d5-c040-41ce-8393-955db8ebfb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:36.827702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbe4d5-c040-41ce-8393-955db8ebfb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:36.829779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbe4d5-c040-41ce-8393-955db8ebfb09 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:36.895293 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1963/3960] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:33:36 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:33:36.900008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a6f5d-78a7-446a-bd75-77093ff019b1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:36.917303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a6f5d-78a7-446a-bd75-77093ff019b1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:36.922479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:37.025731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344707f-f5cc-407d-8a3e-f96920bbed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:37.027088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344707f-f5cc-407d-8a3e-f96920bbed6a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:37.027477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344707f-f5cc-407d-8a3e-f96920bbed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:37.029271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344707f-f5cc-407d-8a3e-f96920bbed6a admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:37.030126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344707f-f5cc-407d-8a3e-f96920bbed6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:37.033341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344707f-f5cc-407d-8a3e-f96920bbed6a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:37.124338 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1998/3961] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:33:36 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:33:37.126060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbe4d5-c040-41ce-8393-955db8ebfb09 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:37.142052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbe4d5-c040-41ce-8393-955db8ebfb09 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:37.149682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0de6c-0daa-434f-894f-0957e320d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:37.150371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0de6c-0daa-434f-894f-0957e320d181 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:37.150635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0de6c-0daa-434f-894f-0957e320d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:37.150907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0de6c-0daa-434f-894f-0957e320d181 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:37.151637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0de6c-0daa-434f-894f-0957e320d181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:37.153281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0de6c-0daa-434f-894f-0957e320d181 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:37.167450 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1964/3962] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:33:37.171763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344707f-f5cc-407d-8a3e-f96920bbed6a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:37.185265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344707f-f5cc-407d-8a3e-f96920bbed6a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:37.191314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ca4a9-e158-449d-824b-e76c72276a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:37.192103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ca4a9-e158-449d-824b-e76c72276a25 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:37.192426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ca4a9-e158-449d-824b-e76c72276a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:37.192698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ca4a9-e158-449d-824b-e76c72276a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:37.193353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ca4a9-e158-449d-824b-e76c72276a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:37.196498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ca4a9-e158-449d-824b-e76c72276a25 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:37.213068 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 1999/3963] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:33:37.214697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0de6c-0daa-434f-894f-0957e320d181 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:37.228110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0de6c-0daa-434f-894f-0957e320d181 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:37.235124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009c33f-d79a-47ee-b08f-8474e332675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:37.235843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009c33f-d79a-47ee-b08f-8474e332675d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:37.236123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009c33f-d79a-47ee-b08f-8474e332675d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:37.236443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009c33f-d79a-47ee-b08f-8474e332675d admin admin] PATH_INFO: `/v3/projects/2d9409727e6c4cf49d786fcd19faef64/users/d5b3e78152ff44719b4a43f203e24d26/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:37.259687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009c33f-d79a-47ee-b08f-8474e332675d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9409727e6c4cf49d786fcd19faef64, user_id=d5b3e78152ff44719b4a43f203e24d26, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:37.262963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009c33f-d79a-47ee-b08f-8474e332675d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:37.282800 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1965/3964] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:33:37 2022] PUT /identity/v3/projects/2d9409727e6c4cf49d786fcd19faef64/users/d5b3e78152ff44719b4a43f203e24d26/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:33:37.293008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679dce-4236-4419-a00d-edabce9d6a57 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:37.293554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679dce-4236-4419-a00d-edabce9d6a57 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:37.294067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679dce-4236-4419-a00d-edabce9d6a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:37.379633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9b679dce-4236-4419-a00d-edabce9d6a57 None None] MFA Rules not processed for user `d5b3e78152ff44719b4a43f203e24d26`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:37.386684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9b679dce-4236-4419-a00d-edabce9d6a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:37.470328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009c33f-d79a-47ee-b08f-8474e332675d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:37.472609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6009c33f-d79a-47ee-b08f-8474e332675d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:37.498403 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2000/3965] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:37.510527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282245-6449-4294-b30b-a3943d5d08ea None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:37.510916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282245-6449-4294-b30b-a3943d5d08ea None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:37.511572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282245-6449-4294-b30b-a3943d5d08ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:37.516606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:37.544298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9d282245-6449-4294-b30b-a3943d5d08ea None None] MFA Rules not processed for user `d5b3e78152ff44719b4a43f203e24d26`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:37.546148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9d282245-6449-4294-b30b-a3943d5d08ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:37.560577 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2001/3966] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:37.590189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009c33f-d79a-47ee-b08f-8474e332675d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:37.597102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8b285-5458-4a68-8183-15d92167d752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:37.597964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b285-5458-4a68-8183-15d92167d752 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:37.598446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b285-5458-4a68-8183-15d92167d752 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:37.599017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8b285-5458-4a68-8183-15d92167d752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:37.601654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-74b8b285-5458-4a68-8183-15d92167d752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:37.772063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b285-5458-4a68-8183-15d92167d752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:37.776667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8b285-5458-4a68-8183-15d92167d752 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:37.797442 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1966/3967] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:37.818552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d282245-6449-4294-b30b-a3943d5d08ea None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:37.823562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9d282245-6449-4294-b30b-a3943d5d08ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:37.864991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d282245-6449-4294-b30b-a3943d5d08ea None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:37.873229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72944a8-904d-423b-a522-7f95f7849067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:37.874306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72944a8-904d-423b-a522-7f95f7849067 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:37.875613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72944a8-904d-423b-a522-7f95f7849067 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:37.876324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72944a8-904d-423b-a522-7f95f7849067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:37.891664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72944a8-904d-423b-a522-7f95f7849067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:37.893594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72944a8-904d-423b-a522-7f95f7849067 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:37.913101 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2002/3968] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:39.293702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d24ba-f5d3-49d1-ab2a-bbd385cbe253 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:39.294437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d24ba-f5d3-49d1-ab2a-bbd385cbe253 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:39.294437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d24ba-f5d3-49d1-ab2a-bbd385cbe253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:39.317786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f91d24ba-f5d3-49d1-ab2a-bbd385cbe253 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:39.319092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f91d24ba-f5d3-49d1-ab2a-bbd385cbe253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:39.435521 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1967/3969] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:33:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:39.451927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72944a8-904d-423b-a522-7f95f7849067 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:39.454354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f72944a8-904d-423b-a522-7f95f7849067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:39.625321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:39.683049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72944a8-904d-423b-a522-7f95f7849067 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:39.697916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85a7e9-2739-45ea-a5fe-723edddafd5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:39.698665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85a7e9-2739-45ea-a5fe-723edddafd5c service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:39.699014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85a7e9-2739-45ea-a5fe-723edddafd5c service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:39.699366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85a7e9-2739-45ea-a5fe-723edddafd5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:39.721370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85a7e9-2739-45ea-a5fe-723edddafd5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:39.723532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85a7e9-2739-45ea-a5fe-723edddafd5c service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:39.753999 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2003/3970] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:33:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:42.249550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d24ba-f5d3-49d1-ab2a-bbd385cbe253 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:42.267694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d24ba-f5d3-49d1-ab2a-bbd385cbe253 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:42.283544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a209-b02f-40d3-ae7b-d165c59d3866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:42.289782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a209-b02f-40d3-ae7b-d165c59d3866 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:42.293049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a209-b02f-40d3-ae7b-d165c59d3866 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:42.294257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38a209-b02f-40d3-ae7b-d165c59d3866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:42.301478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4a38a209-b02f-40d3-ae7b-d165c59d3866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:42.351987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38a209-b02f-40d3-ae7b-d165c59d3866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:42.355266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a38a209-b02f-40d3-ae7b-d165c59d3866 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:42.375656 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1968/3971] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:48.087399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85a7e9-2739-45ea-a5fe-723edddafd5c service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:48.100535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85a7e9-2739-45ea-a5fe-723edddafd5c service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:48.122101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8625cd-439b-4ca9-96d5-2fd0ff57f270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:48.122731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8625cd-439b-4ca9-96d5-2fd0ff57f270 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:48.123000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8625cd-439b-4ca9-96d5-2fd0ff57f270 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:48.123281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8625cd-439b-4ca9-96d5-2fd0ff57f270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:48.125117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2a8625cd-439b-4ca9-96d5-2fd0ff57f270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:48.236639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8625cd-439b-4ca9-96d5-2fd0ff57f270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:48.238204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8625cd-439b-4ca9-96d5-2fd0ff57f270 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:48.261532 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2004/3972] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:52.362650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=77 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:56.137263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a209-b02f-40d3-ae7b-d165c59d3866 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:56.138941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4a38a209-b02f-40d3-ae7b-d165c59d3866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:56.177497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38a209-b02f-40d3-ae7b-d165c59d3866 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:56.187711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:56.188373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:56.188655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:56.188954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] PATH_INFO: `/v3/users/9a950251fb8644ec807a403a7e5cc53b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:56.193334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a950251fb8644ec807a403a7e5cc53b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:56.199546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:56.390263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a950251fb8644ec807a403a7e5cc53b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:56.432924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a950251fb8644ec807a403a7e5cc53b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:56.463917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a950251fb8644ec807a403a7e5cc53b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:56.480630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a950251fb8644ec807a403a7e5cc53b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:56.481581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-49a3b9dc-9fb3-4779-b2a1-1d98ce066989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a950251fb8644ec807a403a7e5cc53b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:56.499617 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1969/3973] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:33:56 2022] DELETE /identity/v3/users/9a950251fb8644ec807a403a7e5cc53b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:33:57.183449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8625cd-439b-4ca9-96d5-2fd0ff57f270 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:57.206642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8625cd-439b-4ca9-96d5-2fd0ff57f270 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:57.308794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:57.309842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:57.310283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:57.310672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] PATH_INFO: `/v3/projects/b3f861d097e740d7b9715eea23a4737f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:57.313704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f861d097e740d7b9715eea23a4737f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:57.315885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:57.557726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f861d097e740d7b9715eea23a4737f', 'request_id': 'req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:57.572805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f861d097e740d7b9715eea23a4737f', 'request_id': 'req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:57.605642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f861d097e740d7b9715eea23a4737f', 'request_id': 'req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:57.621209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] The token cache is being invalidate because project b3f861d097e740d7b9715eea23a4737f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:33:57.621506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:57.622221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b81d186-bba9-4765-adf3-64bf8c1b2d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:33:57.627352 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2005/3974] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:33:57 2022] DELETE /identity/v3/projects/b3f861d097e740d7b9715eea23a4737f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:33:57.629205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b165-a992-4bee-9e08-968aef462b4d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:57.629709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b165-a992-4bee-9e08-968aef462b4d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:57.629709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95b165-a992-4bee-9e08-968aef462b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:57.671119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-aa95b165-a992-4bee-9e08-968aef462b4d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:57.672299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aa95b165-a992-4bee-9e08-968aef462b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:57.843417 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1970/3975] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:33:57.851974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d37250-f89e-49bd-afff-2665735f0b27 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:57.852078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d37250-f89e-49bd-afff-2665735f0b27 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:57.852992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d37250-f89e-49bd-afff-2665735f0b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:57.904785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e2d37250-f89e-49bd-afff-2665735f0b27 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:57.906351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e2d37250-f89e-49bd-afff-2665735f0b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:57.920563 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2006/3976] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:57.927504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b165-a992-4bee-9e08-968aef462b4d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:57.941860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95b165-a992-4bee-9e08-968aef462b4d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:57.952028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b417cbd-b09a-4181-b9ff-d12f1e048e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:57.952836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b417cbd-b09a-4181-b9ff-d12f1e048e6b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:57.953550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b417cbd-b09a-4181-b9ff-d12f1e048e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:57.954122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b417cbd-b09a-4181-b9ff-d12f1e048e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:57.955157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b417cbd-b09a-4181-b9ff-d12f1e048e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:33:57.955825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b417cbd-b09a-4181-b9ff-d12f1e048e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:57.959171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b417cbd-b09a-4181-b9ff-d12f1e048e6b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:57.985035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d37250-f89e-49bd-afff-2665735f0b27 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:57.990356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:57.990639 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1971/3977] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:33:57.997430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d37250-f89e-49bd-afff-2665735f0b27 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:58.004053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79b276-12e4-41dd-9811-5c87331f4675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:58.004945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b276-12e4-41dd-9811-5c87331f4675 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:58.005586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b276-12e4-41dd-9811-5c87331f4675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:58.006043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79b276-12e4-41dd-9811-5c87331f4675 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:58.007202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79b276-12e4-41dd-9811-5c87331f4675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:58.010449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79b276-12e4-41dd-9811-5c87331f4675 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:58.065013 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2007/3978] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:33:57 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:33:58.066852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b417cbd-b09a-4181-b9ff-d12f1e048e6b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:58.083908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b417cbd-b09a-4181-b9ff-d12f1e048e6b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:58.201036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7305f8-3171-4284-8a23-524d8cc585ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:58.201907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7305f8-3171-4284-8a23-524d8cc585ad admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:58.202469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7305f8-3171-4284-8a23-524d8cc585ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:58.203589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7305f8-3171-4284-8a23-524d8cc585ad admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:58.204424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7305f8-3171-4284-8a23-524d8cc585ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:58.206792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7305f8-3171-4284-8a23-524d8cc585ad admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:58.222772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:58.275324 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1972/3979] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:33:58 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:33:58.276207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79b276-12e4-41dd-9811-5c87331f4675 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:58.288713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79b276-12e4-41dd-9811-5c87331f4675 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:58.300548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee3283-63eb-479b-a053-799a5c8d1e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:58.301730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee3283-63eb-479b-a053-799a5c8d1e7e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:58.302620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee3283-63eb-479b-a053-799a5c8d1e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:58.302620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee3283-63eb-479b-a053-799a5c8d1e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:58.303015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee3283-63eb-479b-a053-799a5c8d1e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:58.305144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee3283-63eb-479b-a053-799a5c8d1e7e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:58.321448 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2008/3980] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:33:58.325473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7305f8-3171-4284-8a23-524d8cc585ad admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:58.342210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7305f8-3171-4284-8a23-524d8cc585ad admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:58.348712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4082540-7a3e-4e2a-825e-e5fd6e72be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:58.349445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4082540-7a3e-4e2a-825e-e5fd6e72be1a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:58.349789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4082540-7a3e-4e2a-825e-e5fd6e72be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:58.350124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4082540-7a3e-4e2a-825e-e5fd6e72be1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:58.350954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4082540-7a3e-4e2a-825e-e5fd6e72be1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:58.352659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4082540-7a3e-4e2a-825e-e5fd6e72be1a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:58.369911 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1973/3981] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:33:58.371593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee3283-63eb-479b-a053-799a5c8d1e7e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:58.392616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee3283-63eb-479b-a053-799a5c8d1e7e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:58.404742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc13d61-0d1f-4504-a21f-681bf140f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:58.406346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc13d61-0d1f-4504-a21f-681bf140f35c admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:58.407058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc13d61-0d1f-4504-a21f-681bf140f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:58.407912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc13d61-0d1f-4504-a21f-681bf140f35c admin admin] PATH_INFO: `/v3/projects/1a3e3bbf355b4658b94102ea3a313d73/users/42e4ab2f389f4d40920d77d1b597adbe/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:58.452473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc13d61-0d1f-4504-a21f-681bf140f35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a3e3bbf355b4658b94102ea3a313d73, user_id=42e4ab2f389f4d40920d77d1b597adbe, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:58.455385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc13d61-0d1f-4504-a21f-681bf140f35c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:58.491367 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2009/3982] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:33:58 2022] PUT /identity/v3/projects/1a3e3bbf355b4658b94102ea3a313d73/users/42e4ab2f389f4d40920d77d1b597adbe/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:33:58.493689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9db3de-afc0-4c2d-9bd6-0ef67a49228c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:58.493979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9db3de-afc0-4c2d-9bd6-0ef67a49228c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:58.495461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9db3de-afc0-4c2d-9bd6-0ef67a49228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:58.545081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1c9db3de-afc0-4c2d-9bd6-0ef67a49228c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:58.549617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1c9db3de-afc0-4c2d-9bd6-0ef67a49228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:58.718647 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1974/3983] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:58.732543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc13d61-0d1f-4504-a21f-681bf140f35c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:58.735415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2dc13d61-0d1f-4504-a21f-681bf140f35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:58.861714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4be1a-6e4a-4a8d-a33d-bc3cb772d97a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:58.863053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4be1a-6e4a-4a8d-a33d-bc3cb772d97a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:58.865988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4be1a-6e4a-4a8d-a33d-bc3cb772d97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:58.867449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc13d61-0d1f-4504-a21f-681bf140f35c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:58.872228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463009-3b75-4f00-ac11-620c75f7c4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:58.872864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463009-3b75-4f00-ac11-620c75f7c4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:58.873159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463009-3b75-4f00-ac11-620c75f7c4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:58.873494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463009-3b75-4f00-ac11-620c75f7c4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:58.892009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89463009-3b75-4f00-ac11-620c75f7c4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:58.893655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89463009-3b75-4f00-ac11-620c75f7c4b7 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:58.919606 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2010/3984] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:33:58.926219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-06b4be1a-6e4a-4a8d-a33d-bc3cb772d97a None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:33:58.928719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-06b4be1a-6e4a-4a8d-a33d-bc3cb772d97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:59.072560 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1975/3985] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:33:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:33:59.088789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463009-3b75-4f00-ac11-620c75f7c4b7 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:33:59.091320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-89463009-3b75-4f00-ac11-620c75f7c4b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:33:59.259676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463009-3b75-4f00-ac11-620c75f7c4b7 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:33:59.266838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5c73c-24b8-4608-91d6-4b2b7a8cfda6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:33:59.267657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c73c-24b8-4608-91d6-4b2b7a8cfda6 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:33:59.267801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c73c-24b8-4608-91d6-4b2b7a8cfda6 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:33:59.268349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c73c-24b8-4608-91d6-4b2b7a8cfda6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:33:59.280847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5c73c-24b8-4608-91d6-4b2b7a8cfda6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:33:59.282675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5c73c-24b8-4608-91d6-4b2b7a8cfda6 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:33:59.315256 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2011/3986] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:33:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:00.212092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfef8a-d9b0-4dd4-8c76-13bbe25e79cf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:00.213051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfef8a-d9b0-4dd4-8c76-13bbe25e79cf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:00.213450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfef8a-d9b0-4dd4-8c76-13bbe25e79cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:00.265789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-39cfef8a-d9b0-4dd4-8c76-13bbe25e79cf None None] MFA Rules not processed for user `156adbbf6e3b4111b49b7e6e17b9825d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:00.267258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-39cfef8a-d9b0-4dd4-8c76-13bbe25e79cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:00.351435 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1976/3987] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:06.040218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096757-c065-45a1-a8eb-b6ac40c2c20d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:06.041274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096757-c065-45a1-a8eb-b6ac40c2c20d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:06.041748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096757-c065-45a1-a8eb-b6ac40c2c20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:06.074837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ef096757-c065-45a1-a8eb-b6ac40c2c20d None None] MFA Rules not processed for user `a01a7cc74e3e497188bec2d673d650aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:06.077101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ef096757-c065-45a1-a8eb-b6ac40c2c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:06.125972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:06.160296 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2012/3988] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:06.170587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe9b6-d8e5-448a-bd7d-40a632bea220 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:06.171307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe9b6-d8e5-448a-bd7d-40a632bea220 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:06.171307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fe9b6-d8e5-448a-bd7d-40a632bea220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:06.201981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-503fe9b6-d8e5-448a-bd7d-40a632bea220 None None] MFA Rules not processed for user `a01a7cc74e3e497188bec2d673d650aa`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:06.203638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-503fe9b6-d8e5-448a-bd7d-40a632bea220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:06.213545 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1977/3989] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:07.470680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096757-c065-45a1-a8eb-b6ac40c2c20d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:07.472255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ef096757-c065-45a1-a8eb-b6ac40c2c20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:07.504119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096757-c065-45a1-a8eb-b6ac40c2c20d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:07.512574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f010fc-f2c5-4da7-8b11-2945c6a88492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:07.513827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f010fc-f2c5-4da7-8b11-2945c6a88492 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:07.515419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f010fc-f2c5-4da7-8b11-2945c6a88492 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:07.515878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f010fc-f2c5-4da7-8b11-2945c6a88492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:07.524360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-95f010fc-f2c5-4da7-8b11-2945c6a88492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:07.546371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f010fc-f2c5-4da7-8b11-2945c6a88492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:07.551783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f010fc-f2c5-4da7-8b11-2945c6a88492 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:07.587042 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2013/3990] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:11.241957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294d3c7-2901-4af6-8082-9024985c9dcc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:11.243348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294d3c7-2901-4af6-8082-9024985c9dcc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:11.244934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294d3c7-2901-4af6-8082-9024985c9dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:11.306993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2294d3c7-2901-4af6-8082-9024985c9dcc None None] MFA Rules not processed for user `42e4ab2f389f4d40920d77d1b597adbe`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:11.309285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2294d3c7-2901-4af6-8082-9024985c9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:11.327915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:11.501191 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1978/3991] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:12.890430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f010fc-f2c5-4da7-8b11-2945c6a88492 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:12.892123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-95f010fc-f2c5-4da7-8b11-2945c6a88492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:12.915502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f010fc-f2c5-4da7-8b11-2945c6a88492 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:12.926490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:12.932218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:12.932802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:12.933300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] PATH_INFO: `/v3/users/ee5effb4577e42d7ba3b2b1c3305a687` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:12.935582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5effb4577e42d7ba3b2b1c3305a687)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:12.939232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:13.034117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5effb4577e42d7ba3b2b1c3305a687'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:13.035001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5effb4577e42d7ba3b2b1c3305a687'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:13.047140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5effb4577e42d7ba3b2b1c3305a687'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:13.056844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5effb4577e42d7ba3b2b1c3305a687'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:13.073373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3550e63-7471-4443-983c-b8555a6ad608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5effb4577e42d7ba3b2b1c3305a687'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:13.082013 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2014/3992] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:12 2022] DELETE /identity/v3/users/ee5effb4577e42d7ba3b2b1c3305a687 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:13.685134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294d3c7-2901-4af6-8082-9024985c9dcc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:13.698415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294d3c7-2901-4af6-8082-9024985c9dcc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:13.861199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:13.862235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:13.862658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:13.863258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] PATH_INFO: `/v3/projects/c6efb655a30d4679ade71cd6385dd2a6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:13.865095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6efb655a30d4679ade71cd6385dd2a6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:13.868046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:13.979915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6efb655a30d4679ade71cd6385dd2a6', 'request_id': 'req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:13.999854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6efb655a30d4679ade71cd6385dd2a6', 'request_id': 'req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:14.025157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6efb655a30d4679ade71cd6385dd2a6', 'request_id': 'req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:14.059610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] The token cache is being invalidate because project c6efb655a30d4679ade71cd6385dd2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:14.060060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:14.060863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6e0a48e1-6a07-4d58-9d7c-d629e77371ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:14.062548 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1979/3993] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:13 2022] DELETE /identity/v3/projects/c6efb655a30d4679ade71cd6385dd2a6 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:14.067831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aafc8e-f23d-4b78-885d-779e7a5c3c7c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:14.069754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aafc8e-f23d-4b78-885d-779e7a5c3c7c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:14.070376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aafc8e-f23d-4b78-885d-779e7a5c3c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:14.124800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a6aafc8e-f23d-4b78-885d-779e7a5c3c7c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:14.130909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a6aafc8e-f23d-4b78-885d-779e7a5c3c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:14.296073 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2015/3994] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:14.311975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ac20f-017b-465c-b8cf-0405965ad5c1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:14.315760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ac20f-017b-465c-b8cf-0405965ad5c1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:14.316266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ac20f-017b-465c-b8cf-0405965ad5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:14.367179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f58ac20f-017b-465c-b8cf-0405965ad5c1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:14.374985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f58ac20f-017b-465c-b8cf-0405965ad5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:14.414399 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1980/3995] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:14.419557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aafc8e-f23d-4b78-885d-779e7a5c3c7c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:14.439912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aafc8e-f23d-4b78-885d-779e7a5c3c7c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:14.455934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1de6eb-6864-4c1c-8207-799004379c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:14.457821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1de6eb-6864-4c1c-8207-799004379c83 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:14.459086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1de6eb-6864-4c1c-8207-799004379c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:14.460057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1de6eb-6864-4c1c-8207-799004379c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:14.462718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1de6eb-6864-4c1c-8207-799004379c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:14.464426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1de6eb-6864-4c1c-8207-799004379c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:14.469196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1de6eb-6864-4c1c-8207-799004379c83 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:14.504460 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2016/3996] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:14.509478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ac20f-017b-465c-b8cf-0405965ad5c1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:14.526172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ac20f-017b-465c-b8cf-0405965ad5c1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:14.534539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468192a-3877-4070-a628-b5cd61bec870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:14.535431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468192a-3877-4070-a628-b5cd61bec870 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:14.537277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468192a-3877-4070-a628-b5cd61bec870 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:14.538385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468192a-3877-4070-a628-b5cd61bec870 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:14.539784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468192a-3877-4070-a628-b5cd61bec870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:14.541805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468192a-3877-4070-a628-b5cd61bec870 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:14.595954 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1981/3997] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:14 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:14.606028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1de6eb-6864-4c1c-8207-799004379c83 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:14.624228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1de6eb-6864-4c1c-8207-799004379c83 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:14.683571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:14.759147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba600a-3f46-4e4f-9e7c-ea24bed34ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:14.759964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba600a-3f46-4e4f-9e7c-ea24bed34ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:14.760454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba600a-3f46-4e4f-9e7c-ea24bed34ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:14.760736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba600a-3f46-4e4f-9e7c-ea24bed34ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:14.761750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba600a-3f46-4e4f-9e7c-ea24bed34ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:14.763808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba600a-3f46-4e4f-9e7c-ea24bed34ac8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:14.795470 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2017/3998] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:34:14 2022] POST /identity/v3/users => generated 284 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:14.797456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468192a-3877-4070-a628-b5cd61bec870 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:14.810234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468192a-3877-4070-a628-b5cd61bec870 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:14.815629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efe8a8-3204-41a2-bd64-7b40e83d9ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:14.816559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efe8a8-3204-41a2-bd64-7b40e83d9ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:14.817030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efe8a8-3204-41a2-bd64-7b40e83d9ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:14.817302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2efe8a8-3204-41a2-bd64-7b40e83d9ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:14.818021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efe8a8-3204-41a2-bd64-7b40e83d9ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:14.820568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2efe8a8-3204-41a2-bd64-7b40e83d9ed8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:14.837118 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1982/3999] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:14.841454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba600a-3f46-4e4f-9e7c-ea24bed34ac8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:14.853178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba600a-3f46-4e4f-9e7c-ea24bed34ac8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:14.860805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77264eb2-7858-4323-9ec0-997ec79f6bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:14.861622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77264eb2-7858-4323-9ec0-997ec79f6bdf admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:14.862172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77264eb2-7858-4323-9ec0-997ec79f6bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:14.862601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77264eb2-7858-4323-9ec0-997ec79f6bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:14.864049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77264eb2-7858-4323-9ec0-997ec79f6bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:14.867003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77264eb2-7858-4323-9ec0-997ec79f6bdf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:14.888841 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2018/4000] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:14.891292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efe8a8-3204-41a2-bd64-7b40e83d9ed8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:14.897729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:14.904045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2efe8a8-3204-41a2-bd64-7b40e83d9ed8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:14.915740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db321c97-f236-4005-8606-6e3dbd8018ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:14.916583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db321c97-f236-4005-8606-6e3dbd8018ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:14.916865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db321c97-f236-4005-8606-6e3dbd8018ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:14.917129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db321c97-f236-4005-8606-6e3dbd8018ca admin admin] PATH_INFO: `/v3/projects/01c5aaeb5414461c9cd0a51d438c871a/users/8d7cf5000ed7468abf4330cc4c4cd02c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:14.941347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db321c97-f236-4005-8606-6e3dbd8018ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c5aaeb5414461c9cd0a51d438c871a, user_id=8d7cf5000ed7468abf4330cc4c4cd02c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:14.952207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db321c97-f236-4005-8606-6e3dbd8018ca admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:14.999318 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1983/4001] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:14 2022] PUT /identity/v3/projects/01c5aaeb5414461c9cd0a51d438c871a/users/8d7cf5000ed7468abf4330cc4c4cd02c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:15.011261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91cb54-fcd1-4d37-9ef5-803c2bc42961 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:15.011644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91cb54-fcd1-4d37-9ef5-803c2bc42961 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:15.011984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91cb54-fcd1-4d37-9ef5-803c2bc42961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:15.067224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-df91cb54-fcd1-4d37-9ef5-803c2bc42961 None None] MFA Rules not processed for user `8d7cf5000ed7468abf4330cc4c4cd02c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:15.075680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-df91cb54-fcd1-4d37-9ef5-803c2bc42961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:15.236719 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2019/4002] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:15.237659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db321c97-f236-4005-8606-6e3dbd8018ca admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:15.242444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-db321c97-f236-4005-8606-6e3dbd8018ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:15.347350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db321c97-f236-4005-8606-6e3dbd8018ca admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:15.357238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389b50-1db2-412f-bfed-568b756d47cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:15.371460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389b50-1db2-412f-bfed-568b756d47cd service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:15.371929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389b50-1db2-412f-bfed-568b756d47cd service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:15.372497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8389b50-1db2-412f-bfed-568b756d47cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:15.408624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8389b50-1db2-412f-bfed-568b756d47cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:15.410313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8389b50-1db2-412f-bfed-568b756d47cd service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:15.423703 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1984/4003] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:34:16.449730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8b69-b156-4a2b-8b7e-67f2e434678d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:16.450344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8b69-b156-4a2b-8b7e-67f2e434678d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:16.450475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a8b69-b156-4a2b-8b7e-67f2e434678d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:16.498719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2b4a8b69-b156-4a2b-8b7e-67f2e434678d None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:16.510162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b4a8b69-b156-4a2b-8b7e-67f2e434678d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:16.677331 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2020/4004] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:34:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:16.695391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389b50-1db2-412f-bfed-568b756d47cd service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:16.697713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f8389b50-1db2-412f-bfed-568b756d47cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:16.952381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8389b50-1db2-412f-bfed-568b756d47cd service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:16.966687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a263a5f-6fa1-4ad9-98f6-c845a13e1a04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:16.967623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a263a5f-6fa1-4ad9-98f6-c845a13e1a04 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:16.968108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a263a5f-6fa1-4ad9-98f6-c845a13e1a04 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:16.968650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a263a5f-6fa1-4ad9-98f6-c845a13e1a04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:16.994975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a263a5f-6fa1-4ad9-98f6-c845a13e1a04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:16.997411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a263a5f-6fa1-4ad9-98f6-c845a13e1a04 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:17.019221 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1985/4005] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:19.992841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8b69-b156-4a2b-8b7e-67f2e434678d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:19.995598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b4a8b69-b156-4a2b-8b7e-67f2e434678d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:20.181296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:20.250967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a8b69-b156-4a2b-8b7e-67f2e434678d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:20.260932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a263a5f-6fa1-4ad9-98f6-c845a13e1a04 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:20.264632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc97188-da51-4913-a380-690296f3018b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:20.265184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9a263a5f-6fa1-4ad9-98f6-c845a13e1a04 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:20.265810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97188-da51-4913-a380-690296f3018b service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:20.266341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97188-da51-4913-a380-690296f3018b service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:20.266806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc97188-da51-4913-a380-690296f3018b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:20.269534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2bc97188-da51-4913-a380-690296f3018b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:20.285862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc97188-da51-4913-a380-690296f3018b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:20.288480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc97188-da51-4913-a380-690296f3018b service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:20.310865 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2021/4006] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:34:20.435675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a263a5f-6fa1-4ad9-98f6-c845a13e1a04 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:20.461120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:20.462196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:20.463005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:20.463436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] PATH_INFO: `/v3/users/42e4ab2f389f4d40920d77d1b597adbe` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:20.465215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e4ab2f389f4d40920d77d1b597adbe)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:20.467317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:20.501909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:20.609980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e4ab2f389f4d40920d77d1b597adbe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:20.639650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e4ab2f389f4d40920d77d1b597adbe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:20.687544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e4ab2f389f4d40920d77d1b597adbe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:20.700875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e4ab2f389f4d40920d77d1b597adbe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:20.701588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-690e2693-ad80-492c-b5b1-c071a5368641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e4ab2f389f4d40920d77d1b597adbe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:20.715961 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1986/4007] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:20 2022] DELETE /identity/v3/users/42e4ab2f389f4d40920d77d1b597adbe => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:21.125041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc97188-da51-4913-a380-690296f3018b service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:21.147306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc97188-da51-4913-a380-690296f3018b service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:21.311197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:21.312207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:21.315557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:21.316070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] PATH_INFO: `/v3/projects/1a3e3bbf355b4658b94102ea3a313d73` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:21.321171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a3e3bbf355b4658b94102ea3a313d73)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:21.327577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:21.437131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a3e3bbf355b4658b94102ea3a313d73', 'request_id': 'req-424c5393-b3bd-46d5-ae49-4907a6545cbf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:21.481089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a3e3bbf355b4658b94102ea3a313d73', 'request_id': 'req-424c5393-b3bd-46d5-ae49-4907a6545cbf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:21.506360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a3e3bbf355b4658b94102ea3a313d73', 'request_id': 'req-424c5393-b3bd-46d5-ae49-4907a6545cbf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:21.556843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] The token cache is being invalidate because project 1a3e3bbf355b4658b94102ea3a313d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:21.557604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:21.575716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-424c5393-b3bd-46d5-ae49-4907a6545cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:21.579152 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2022/4008] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:21 2022] DELETE /identity/v3/projects/1a3e3bbf355b4658b94102ea3a313d73 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:21.588326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6951-43b1-4233-8418-88d8cb254aa7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:21.588923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6951-43b1-4233-8418-88d8cb254aa7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:21.589116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b6951-43b1-4233-8418-88d8cb254aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:21.627791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-499b6951-43b1-4233-8418-88d8cb254aa7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:21.629344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-499b6951-43b1-4233-8418-88d8cb254aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:21.821980 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1987/4009] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:21.831320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79e66-c42b-4cf8-a8b6-25d5b30967e4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:21.831826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79e66-c42b-4cf8-a8b6-25d5b30967e4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:21.832838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc79e66-c42b-4cf8-a8b6-25d5b30967e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:21.897645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7cc79e66-c42b-4cf8-a8b6-25d5b30967e4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:21.899390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7cc79e66-c42b-4cf8-a8b6-25d5b30967e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:21.920898 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2023/4010] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:21.926288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6951-43b1-4233-8418-88d8cb254aa7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:21.942970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b6951-43b1-4233-8418-88d8cb254aa7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:21.951963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a4485-b3ba-45f5-be4f-b4fe92d94dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:21.952605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a4485-b3ba-45f5-be4f-b4fe92d94dee admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:21.952880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a4485-b3ba-45f5-be4f-b4fe92d94dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:21.953145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330a4485-b3ba-45f5-be4f-b4fe92d94dee admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:21.953822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a4485-b3ba-45f5-be4f-b4fe92d94dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:21.954147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a4485-b3ba-45f5-be4f-b4fe92d94dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:21.959276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330a4485-b3ba-45f5-be4f-b4fe92d94dee admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:21.973206 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1988/4011] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:34:21.978753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc79e66-c42b-4cf8-a8b6-25d5b30967e4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:22.020112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc79e66-c42b-4cf8-a8b6-25d5b30967e4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:22.042438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc601f-6f1d-4c2d-bb84-ef1cc8401bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:22.042438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc601f-6f1d-4c2d-bb84-ef1cc8401bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:22.042895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc601f-6f1d-4c2d-bb84-ef1cc8401bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:22.043032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc601f-6f1d-4c2d-bb84-ef1cc8401bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:22.043602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc601f-6f1d-4c2d-bb84-ef1cc8401bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:22.046351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc601f-6f1d-4c2d-bb84-ef1cc8401bb8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:22.134755 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2024/4012] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:21 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:22.139307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a4485-b3ba-45f5-be4f-b4fe92d94dee admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:22.154051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330a4485-b3ba-45f5-be4f-b4fe92d94dee admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:22.264652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f5e9f-42c2-40e2-a1c6-c6d2fed24eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:22.265418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f5e9f-42c2-40e2-a1c6-c6d2fed24eac admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:22.265797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f5e9f-42c2-40e2-a1c6-c6d2fed24eac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:22.266189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f5e9f-42c2-40e2-a1c6-c6d2fed24eac admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:22.266966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f5e9f-42c2-40e2-a1c6-c6d2fed24eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:22.270412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f5e9f-42c2-40e2-a1c6-c6d2fed24eac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:22.327848 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1989/4013] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:34:22 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:22.332364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc601f-6f1d-4c2d-bb84-ef1cc8401bb8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:22.363725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc601f-6f1d-4c2d-bb84-ef1cc8401bb8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:22.390776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c38aa-e575-45c5-8398-26e2bf8d774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:22.390776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c38aa-e575-45c5-8398-26e2bf8d774a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:22.390776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c38aa-e575-45c5-8398-26e2bf8d774a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:22.390776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c38aa-e575-45c5-8398-26e2bf8d774a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:22.391968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c38aa-e575-45c5-8398-26e2bf8d774a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:22.393219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c38aa-e575-45c5-8398-26e2bf8d774a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:22.426651 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2025/4014] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:22.427842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f5e9f-42c2-40e2-a1c6-c6d2fed24eac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:22.446000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f5e9f-42c2-40e2-a1c6-c6d2fed24eac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:22.459904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcf03b-80ab-4937-bfef-375d7711ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:22.461676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcf03b-80ab-4937-bfef-375d7711ceb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:22.463757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcf03b-80ab-4937-bfef-375d7711ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:22.464194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcf03b-80ab-4937-bfef-375d7711ceb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:22.465798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcf03b-80ab-4937-bfef-375d7711ceb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:22.470510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcf03b-80ab-4937-bfef-375d7711ceb7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:22.473851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:22.535397 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1990/4015] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:22.537431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c38aa-e575-45c5-8398-26e2bf8d774a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:22.560651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c38aa-e575-45c5-8398-26e2bf8d774a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:22.571421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb85b0-3f94-4410-a7cf-9a52947645b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:22.572826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb85b0-3f94-4410-a7cf-9a52947645b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:22.573348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb85b0-3f94-4410-a7cf-9a52947645b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:22.573791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb85b0-3f94-4410-a7cf-9a52947645b3 admin admin] PATH_INFO: `/v3/projects/9e933e17e67b4393ad832a3d5f7c40ab/users/e4126e36aa844e4eba923e6c19ae46ae/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:22.604889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb85b0-3f94-4410-a7cf-9a52947645b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e933e17e67b4393ad832a3d5f7c40ab, user_id=e4126e36aa844e4eba923e6c19ae46ae, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:22.608699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb85b0-3f94-4410-a7cf-9a52947645b3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:22.624580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:22.679130 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2026/4016] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:22 2022] PUT /identity/v3/projects/9e933e17e67b4393ad832a3d5f7c40ab/users/e4126e36aa844e4eba923e6c19ae46ae/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:22.679362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2173896-0183-4343-b06c-f7e0d41d1549 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:22.679362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2173896-0183-4343-b06c-f7e0d41d1549 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:22.680265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2173896-0183-4343-b06c-f7e0d41d1549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:22.799408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f2173896-0183-4343-b06c-f7e0d41d1549 None None] MFA Rules not processed for user `e4126e36aa844e4eba923e6c19ae46ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:22.801099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f2173896-0183-4343-b06c-f7e0d41d1549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:23.005936 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1991/4017] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:23.011925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb85b0-3f94-4410-a7cf-9a52947645b3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:23.221137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb85b0-3f94-4410-a7cf-9a52947645b3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:23.239480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173aff6-4da9-40f0-8697-2d6a0f99a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:23.240665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173aff6-4da9-40f0-8697-2d6a0f99a4cd admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:23.242308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173aff6-4da9-40f0-8697-2d6a0f99a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:23.242703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173aff6-4da9-40f0-8697-2d6a0f99a4cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:23.243491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173aff6-4da9-40f0-8697-2d6a0f99a4cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:23.249508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173aff6-4da9-40f0-8697-2d6a0f99a4cd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:23.338154 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2027/4018] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:23 2022] POST /identity/v3/projects => generated 375 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:23.339046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2173896-0183-4343-b06c-f7e0d41d1549 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:23.362004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2173896-0183-4343-b06c-f7e0d41d1549 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:23.483607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d5967-0283-4946-a017-7399375feaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:23.484383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d5967-0283-4946-a017-7399375feaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:23.484504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d5967-0283-4946-a017-7399375feaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:23.484863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d5967-0283-4946-a017-7399375feaf9 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:23.486317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d5967-0283-4946-a017-7399375feaf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:23.488513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d5967-0283-4946-a017-7399375feaf9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:23.522779 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1992/4019] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:34:23 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:23.526989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173aff6-4da9-40f0-8697-2d6a0f99a4cd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:23.542821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173aff6-4da9-40f0-8697-2d6a0f99a4cd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:23.547312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c04c8-4982-4c17-beed-aaaa8b6e4563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:23.548630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c04c8-4982-4c17-beed-aaaa8b6e4563 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:23.549154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c04c8-4982-4c17-beed-aaaa8b6e4563 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:23.549742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c04c8-4982-4c17-beed-aaaa8b6e4563 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:23.550593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c04c8-4982-4c17-beed-aaaa8b6e4563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:23.552788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c04c8-4982-4c17-beed-aaaa8b6e4563 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:23.575539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d5967-0283-4946-a017-7399375feaf9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:23.586665 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2028/4020] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:23.593051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d5967-0283-4946-a017-7399375feaf9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:23.600085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54d2f-d21b-4e92-ae47-23caa34d988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:23.601412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54d2f-d21b-4e92-ae47-23caa34d988c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:23.601691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54d2f-d21b-4e92-ae47-23caa34d988c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:23.602077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54d2f-d21b-4e92-ae47-23caa34d988c admin admin] PATH_INFO: `/v3/projects/55efb85988af4bc4ac43179e590ff1c4/users/10ba4d3f036545af87da1d883a115383/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:23.625288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d54d2f-d21b-4e92-ae47-23caa34d988c admin admin] RBAC: Authorizing `identity:create_grant(project_id=55efb85988af4bc4ac43179e590ff1c4, user_id=10ba4d3f036545af87da1d883a115383, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:23.628375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d54d2f-d21b-4e92-ae47-23caa34d988c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:23.664872 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1993/4021] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:23 2022] PUT /identity/v3/projects/55efb85988af4bc4ac43179e590ff1c4/users/10ba4d3f036545af87da1d883a115383/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:23.672216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c04c8-4982-4c17-beed-aaaa8b6e4563 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:23.718211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c04c8-4982-4c17-beed-aaaa8b6e4563 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:23.887566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3e2a4-9970-40bf-940d-762595f459d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:23.889151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3e2a4-9970-40bf-940d-762595f459d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:23.889755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3e2a4-9970-40bf-940d-762595f459d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:23.890248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3e2a4-9970-40bf-940d-762595f459d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:23.891188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3e2a4-9970-40bf-940d-762595f459d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:23.894342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3e2a4-9970-40bf-940d-762595f459d0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:23.910409 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2029/4022] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:23.915043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54d2f-d21b-4e92-ae47-23caa34d988c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:23.939228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d54d2f-d21b-4e92-ae47-23caa34d988c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:23.947711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa1bfe-c752-405a-8659-450035eaaab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:23.951792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1bfe-c752-405a-8659-450035eaaab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:23.952122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1bfe-c752-405a-8659-450035eaaab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:23.952818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1bfe-c752-405a-8659-450035eaaab5 admin admin] PATH_INFO: `/v3/projects/55efb85988af4bc4ac43179e590ff1c4/users/10ba4d3f036545af87da1d883a115383/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:23.955058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa1bfe-c752-405a-8659-450035eaaab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55efb85988af4bc4ac43179e590ff1c4, user_id=10ba4d3f036545af87da1d883a115383, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:23.957809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa1bfe-c752-405a-8659-450035eaaab5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:23.973811 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1994/4023] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:23 2022] PUT /identity/v3/projects/55efb85988af4bc4ac43179e590ff1c4/users/10ba4d3f036545af87da1d883a115383/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:23.993638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639bc7f-0b04-47ed-9c76-bcf6de4e8a9c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:23.993638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639bc7f-0b04-47ed-9c76-bcf6de4e8a9c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:23.993638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639bc7f-0b04-47ed-9c76-bcf6de4e8a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:24.052209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a639bc7f-0b04-47ed-9c76-bcf6de4e8a9c None None] MFA Rules not processed for user `10ba4d3f036545af87da1d883a115383`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:24.053560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a639bc7f-0b04-47ed-9c76-bcf6de4e8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:24.222176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:24.261020 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2030/4024] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:24.267047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa1bfe-c752-405a-8659-450035eaaab5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:24.283923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa1bfe-c752-405a-8659-450035eaaab5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:24.290076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542cef-9dba-4906-859c-6a520427ad30 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba4d3f036545af87da1d883a115383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55efb85988af4bc4ac43179e590ff1c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:24.291096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542cef-9dba-4906-859c-6a520427ad30 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:24.291548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542cef-9dba-4906-859c-6a520427ad30 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:24.292008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9542cef-9dba-4906-859c-6a520427ad30 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:24.292840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9542cef-9dba-4906-859c-6a520427ad30 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:24.294108 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-e9542cef-9dba-4906-859c-6a520427ad30 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:24.294108 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:24.294108 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:24.295387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9542cef-9dba-4906-859c-6a520427ad30 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:24.335805 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1995/4025] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:34:24 2022] POST /identity/v3/domains => generated 245 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:24.341202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639bc7f-0b04-47ed-9c76-bcf6de4e8a9c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:24.353006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639bc7f-0b04-47ed-9c76-bcf6de4e8a9c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:24.477644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5001b-a619-4196-87fc-d280cd8c641c tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba4d3f036545af87da1d883a115383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55efb85988af4bc4ac43179e590ff1c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:24.482865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5001b-a619-4196-87fc-d280cd8c641c tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:24.483629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5001b-a619-4196-87fc-d280cd8c641c tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:24.484178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5001b-a619-4196-87fc-d280cd8c641c tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:24.508784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5001b-a619-4196-87fc-d280cd8c641c tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:24.510940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5001b-a619-4196-87fc-d280cd8c641c tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:24.593687 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2031/4026] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:24 2022] POST /identity/v3/projects => generated 409 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:24.595291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542cef-9dba-4906-859c-6a520427ad30 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:24.610281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9542cef-9dba-4906-859c-6a520427ad30 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:24.666850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:24.758845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c318205-6422-4d6d-803e-b5af83b8b186 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba4d3f036545af87da1d883a115383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55efb85988af4bc4ac43179e590ff1c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:24.760362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c318205-6422-4d6d-803e-b5af83b8b186 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:24.760920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c318205-6422-4d6d-803e-b5af83b8b186 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:24.761451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c318205-6422-4d6d-803e-b5af83b8b186 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:24.762990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c318205-6422-4d6d-803e-b5af83b8b186 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:24.766136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c318205-6422-4d6d-803e-b5af83b8b186 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:24.806964 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1996/4027] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:34:24 2022] POST /identity/v3/users => generated 348 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:24.811272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5001b-a619-4196-87fc-d280cd8c641c tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:24.835517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5001b-a619-4196-87fc-d280cd8c641c tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:24.844433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447a951-8a9d-4c01-b210-c64e8acbcaca tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba4d3f036545af87da1d883a115383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55efb85988af4bc4ac43179e590ff1c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:24.845252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447a951-8a9d-4c01-b210-c64e8acbcaca tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:24.845529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447a951-8a9d-4c01-b210-c64e8acbcaca tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:24.845835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447a951-8a9d-4c01-b210-c64e8acbcaca tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:24.846664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447a951-8a9d-4c01-b210-c64e8acbcaca tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:24.848640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447a951-8a9d-4c01-b210-c64e8acbcaca tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:24.867403 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2032/4028] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:24.982765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c318205-6422-4d6d-803e-b5af83b8b186 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:24.995118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c318205-6422-4d6d-803e-b5af83b8b186 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:25.001114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a29105-8f6d-4bf7-a5ec-149a7531b494 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba4d3f036545af87da1d883a115383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55efb85988af4bc4ac43179e590ff1c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:25.002461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29105-8f6d-4bf7-a5ec-149a7531b494 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:25.002965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29105-8f6d-4bf7-a5ec-149a7531b494 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:25.003342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a29105-8f6d-4bf7-a5ec-149a7531b494 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] PATH_INFO: `/v3/projects/22e8c33d2f1c49678661d1a245ccf22d/users/dc76634e26bb40ce9d22235e47b8b48e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:25.023935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a29105-8f6d-4bf7-a5ec-149a7531b494 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorizing `identity:create_grant(project_id=22e8c33d2f1c49678661d1a245ccf22d, user_id=dc76634e26bb40ce9d22235e47b8b48e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:25.026987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a29105-8f6d-4bf7-a5ec-149a7531b494 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:25.060525 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1997/4029] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:24 2022] PUT /identity/v3/projects/22e8c33d2f1c49678661d1a245ccf22d/users/dc76634e26bb40ce9d22235e47b8b48e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:25.063514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5faf88-9f34-4d8f-a19b-7814f2f18296 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:25.064430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5faf88-9f34-4d8f-a19b-7814f2f18296 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:25.064982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5faf88-9f34-4d8f-a19b-7814f2f18296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:25.372051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2f5faf88-9f34-4d8f-a19b-7814f2f18296 None None] MFA Rules not processed for user `dc76634e26bb40ce9d22235e47b8b48e`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:25.375213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2f5faf88-9f34-4d8f-a19b-7814f2f18296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:25.398516 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2033/4030] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:25 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:25.408298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c6b79-16f6-4280-8f3e-3e942e55414d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:25.408848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c6b79-16f6-4280-8f3e-3e942e55414d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:25.409124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c6b79-16f6-4280-8f3e-3e942e55414d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:25.433116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8d0c6b79-16f6-4280-8f3e-3e942e55414d None None] MFA Rules not processed for user `dc76634e26bb40ce9d22235e47b8b48e`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:25.434462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8d0c6b79-16f6-4280-8f3e-3e942e55414d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:25.446020 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1998/4031] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:25 2022] POST /identity/v3/auth/tokens => generated 3361 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:25.448346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5faf88-9f34-4d8f-a19b-7814f2f18296 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:25.462405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5faf88-9f34-4d8f-a19b-7814f2f18296 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:25.468497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897d46-b52a-4498-8ced-7aa577c74b8c tempest-test_project-1776056308 tempest-user-1171711870] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc76634e26bb40ce9d22235e47b8b48e', 'user_domain_id': '30b96c2c86e843a38b808f35f6d759d6', 'system_scope': None, 'project_id': '22e8c33d2f1c49678661d1a245ccf22d', 'project_domain_id': '30b96c2c86e843a38b808f35f6d759d6', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:25.469303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897d46-b52a-4498-8ced-7aa577c74b8c tempest-test_project-1776056308 tempest-user-1171711870] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:25.469694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897d46-b52a-4498-8ced-7aa577c74b8c tempest-test_project-1776056308 tempest-user-1171711870] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:25.470128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16897d46-b52a-4498-8ced-7aa577c74b8c tempest-test_project-1776056308 tempest-user-1171711870] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:25.482707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16897d46-b52a-4498-8ced-7aa577c74b8c tempest-test_project-1776056308 tempest-user-1171711870] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:25.488891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16897d46-b52a-4498-8ced-7aa577c74b8c tempest-test_project-1776056308 tempest-user-1171711870] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:25.512289 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2034/4032] 10.222.0.43 () {56 vars in 1284 bytes} [Tue Aug 30 04:34:25 2022] GET /identity/v3/auth/tokens => generated 3361 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:25.513303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c6b79-16f6-4280-8f3e-3e942e55414d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:25.619102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c6b79-16f6-4280-8f3e-3e942e55414d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:25.628330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba4d3f036545af87da1d883a115383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55efb85988af4bc4ac43179e590ff1c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:25.629212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:25.629498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:25.629906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] PATH_INFO: `/v3/users/dc76634e26bb40ce9d22235e47b8b48e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:25.634441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dc76634e26bb40ce9d22235e47b8b48e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:25.636468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:25.762837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc76634e26bb40ce9d22235e47b8b48e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:25.796573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc76634e26bb40ce9d22235e47b8b48e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:25.844988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc76634e26bb40ce9d22235e47b8b48e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:25.860416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc76634e26bb40ce9d22235e47b8b48e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:25.862550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc76634e26bb40ce9d22235e47b8b48e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:25.878118 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 1999/4033] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:25 2022] DELETE /identity/v3/users/dc76634e26bb40ce9d22235e47b8b48e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:25.886202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897d46-b52a-4498-8ced-7aa577c74b8c tempest-test_project-1776056308 tempest-user-1171711870] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:25.906333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16897d46-b52a-4498-8ced-7aa577c74b8c tempest-test_project-1776056308 tempest-user-1171711870] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:25.930245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:26.089627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba4d3f036545af87da1d883a115383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55efb85988af4bc4ac43179e590ff1c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:26.092170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:26.110805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:26.110805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] PATH_INFO: `/v3/projects/22e8c33d2f1c49678661d1a245ccf22d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:26.112995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorizing `identity:delete_project(project_id=22e8c33d2f1c49678661d1a245ccf22d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:26.118298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:26.228079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e8c33d2f1c49678661d1a245ccf22d', 'request_id': 'req-8b3c68ff-5030-4a0e-a715-0faffcc458cd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.244994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e8c33d2f1c49678661d1a245ccf22d', 'request_id': 'req-8b3c68ff-5030-4a0e-a715-0faffcc458cd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.264193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e8c33d2f1c49678661d1a245ccf22d', 'request_id': 'req-8b3c68ff-5030-4a0e-a715-0faffcc458cd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.285471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] The token cache is being invalidate because project 22e8c33d2f1c49678661d1a245ccf22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:26.285754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.286551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.289048 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2035/4034] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:25 2022] DELETE /identity/v3/projects/22e8c33d2f1c49678661d1a245ccf22d => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:26.293545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:26.295176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:26.305511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:26.322797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e86f9-d462-462a-b663-b38095790a81 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:26.654097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba4d3f036545af87da1d883a115383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55efb85988af4bc4ac43179e590ff1c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:26.656766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:26.657197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:26.657535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] PATH_INFO: `/v3/domains/30b96c2c86e843a38b808f35f6d759d6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:26.669342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=30b96c2c86e843a38b808f35f6d759d6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:26.671493 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:26.671493 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:26.671493 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:26.677440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:26.754558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.755413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.795365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.796403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:26.800226 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2000/4035] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:34:26 2022] PATCH /identity/v3/domains/30b96c2c86e843a38b808f35f6d759d6 => generated 246 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:34:26.807822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:26.812116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:26.873392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c68ff-5030-4a0e-a715-0faffcc458cd tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:27.067456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '10ba4d3f036545af87da1d883a115383', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55efb85988af4bc4ac43179e590ff1c4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:27.068577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:27.070240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:27.071433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] PATH_INFO: `/v3/domains/30b96c2c86e843a38b808f35f6d759d6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:27.107502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=30b96c2c86e843a38b808f35f6d759d6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:27.108760 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:27.108760 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:34:27.108760 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:34:27.110006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:27.186002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.191213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:27.194555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:27.251484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.284534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:27.371141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6', 'request_id': 'req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.383997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc9291-f4ea-44de-93a5-ec08a773e037 tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:27.387656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6', 'request_id': 'req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.402819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6', 'request_id': 'req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.425698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] The token cache is being invalidate because project 30b96c2c86e843a38b808f35f6d759d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:27.426361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.427598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.446943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6', 'request_id': 'req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.448218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6', 'request_id': 'req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.449076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '30b96c2c86e843a38b808f35f6d759d6', 'request_id': 'req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.468594 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2036/4036] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:34:26 2022] DELETE /identity/v3/domains/30b96c2c86e843a38b808f35f6d759d6 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:27.475430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:27.479034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:27.501160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:27.516373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71d1c0-a45b-4fdc-90ee-319f67994a76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:27.517509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71d1c0-a45b-4fdc-90ee-319f67994a76 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:27.518069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71d1c0-a45b-4fdc-90ee-319f67994a76 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:27.518555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71d1c0-a45b-4fdc-90ee-319f67994a76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:27.520761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4c71d1c0-a45b-4fdc-90ee-319f67994a76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:27.541062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71d1c0-a45b-4fdc-90ee-319f67994a76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:27.550639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71d1c0-a45b-4fdc-90ee-319f67994a76 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:27.576416 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2001/4037] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:34:27.586243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aea9da-b99b-46e5-8cc6-4fccc734fb5d tempest-TestDefaultProjectId-978762625 tempest-TestDefaultProjectId-978762625-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:27.594016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:27.595058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:27.595521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:27.595991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] PATH_INFO: `/v3/users/e4126e36aa844e4eba923e6c19ae46ae` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:27.598038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4126e36aa844e4eba923e6c19ae46ae)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:27.602138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:27.723255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4126e36aa844e4eba923e6c19ae46ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.724494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4126e36aa844e4eba923e6c19ae46ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.737927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4126e36aa844e4eba923e6c19ae46ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.751423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4126e36aa844e4eba923e6c19ae46ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.786767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4126e36aa844e4eba923e6c19ae46ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:27.825677 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2037/4038] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:27 2022] DELETE /identity/v3/users/e4126e36aa844e4eba923e6c19ae46ae => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:27.826792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862992d-60f0-4983-8ee7-0d4bdd946eb2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:27.827168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862992d-60f0-4983-8ee7-0d4bdd946eb2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:27.827706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862992d-60f0-4983-8ee7-0d4bdd946eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:27.876118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2862992d-60f0-4983-8ee7-0d4bdd946eb2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:27.878505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2862992d-60f0-4983-8ee7-0d4bdd946eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:27.977993 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2002/4039] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:27.988261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:27.990944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:28.003142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:28.094991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf39b70-793d-4884-95aa-5737d422b3b8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:28.103369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4708c-f8f4-4f0e-8595-24fa869821d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:28.104838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4708c-f8f4-4f0e-8595-24fa869821d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:28.105746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4708c-f8f4-4f0e-8595-24fa869821d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:28.106666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4708c-f8f4-4f0e-8595-24fa869821d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:28.136493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4708c-f8f4-4f0e-8595-24fa869821d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:28.139002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4708c-f8f4-4f0e-8595-24fa869821d0 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:28.152180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2038/4040] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:28.820354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862992d-60f0-4983-8ee7-0d4bdd946eb2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:28.823546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2862992d-60f0-4983-8ee7-0d4bdd946eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:28.845949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862992d-60f0-4983-8ee7-0d4bdd946eb2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:28.854405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:28.855602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:28.856143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:28.856619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] PATH_INFO: `/v3/projects/9e933e17e67b4393ad832a3d5f7c40ab` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:28.859170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e933e17e67b4393ad832a3d5f7c40ab)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:28.864475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:28.983450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e933e17e67b4393ad832a3d5f7c40ab', 'request_id': 'req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:29.007041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e933e17e67b4393ad832a3d5f7c40ab', 'request_id': 'req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:29.019765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e933e17e67b4393ad832a3d5f7c40ab', 'request_id': 'req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:29.047869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] The token cache is being invalidate because project 9e933e17e67b4393ad832a3d5f7c40ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:29.048553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:29.049999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:29.053677 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2003/4041] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:28 2022] DELETE /identity/v3/projects/9e933e17e67b4393ad832a3d5f7c40ab => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:29.061415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4708c-f8f4-4f0e-8595-24fa869821d0 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:29.085336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4708c-f8f4-4f0e-8595-24fa869821d0 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:29.243243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:29.244404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:29.244903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:29.245394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] PATH_INFO: `/v3/users/10ba4d3f036545af87da1d883a115383` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:29.252936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ba4d3f036545af87da1d883a115383)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:29.266256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:29.356795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ba4d3f036545af87da1d883a115383'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:29.357521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ba4d3f036545af87da1d883a115383'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:29.367962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ba4d3f036545af87da1d883a115383'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:29.380013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ba4d3f036545af87da1d883a115383'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:29.397980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c615c0ac-1926-44b4-8bc0-f47c3beebb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ba4d3f036545af87da1d883a115383'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:29.419266 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2039/4042] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:29 2022] DELETE /identity/v3/users/10ba4d3f036545af87da1d883a115383 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:29.839384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:29.841127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:29.867780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82933b-7db1-4991-9ee2-6f2bde8d99ff admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:30.029556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:30.031261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:30.031768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:30.032518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] PATH_INFO: `/v3/projects/55efb85988af4bc4ac43179e590ff1c4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:30.036068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] RBAC: Authorizing `identity:delete_project(project_id=55efb85988af4bc4ac43179e590ff1c4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:30.040094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:30.078139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:30.140080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55efb85988af4bc4ac43179e590ff1c4', 'request_id': 'req-942460b9-3482-4cd3-8bec-8e328d3e90af'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:30.154719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55efb85988af4bc4ac43179e590ff1c4', 'request_id': 'req-942460b9-3482-4cd3-8bec-8e328d3e90af'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:30.164714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55efb85988af4bc4ac43179e590ff1c4', 'request_id': 'req-942460b9-3482-4cd3-8bec-8e328d3e90af'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:30.179996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] The token cache is being invalidate because project 55efb85988af4bc4ac43179e590ff1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:30.180598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:30.181680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-942460b9-3482-4cd3-8bec-8e328d3e90af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:30.183863 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2004/4043] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:29 2022] DELETE /identity/v3/projects/55efb85988af4bc4ac43179e590ff1c4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:30.188906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37522436-26b6-4e73-b124-14397d043d96 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:30.190717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37522436-26b6-4e73-b124-14397d043d96 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:30.191135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37522436-26b6-4e73-b124-14397d043d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:30.220824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-37522436-26b6-4e73-b124-14397d043d96 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:30.223907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-37522436-26b6-4e73-b124-14397d043d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:30.264052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:30.356283 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2040/4044] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:30.364061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf045ff2-47bc-4895-8031-639145797635 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:30.364341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf045ff2-47bc-4895-8031-639145797635 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:30.364614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf045ff2-47bc-4895-8031-639145797635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:30.394411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cf045ff2-47bc-4895-8031-639145797635 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:30.396190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cf045ff2-47bc-4895-8031-639145797635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:30.405987 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2005/4045] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:30.410906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37522436-26b6-4e73-b124-14397d043d96 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:30.435348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37522436-26b6-4e73-b124-14397d043d96 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:30.445273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eb8ba-ec93-4d18-8c48-ed79c9cf1f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:30.446489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eb8ba-ec93-4d18-8c48-ed79c9cf1f47 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:30.446614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eb8ba-ec93-4d18-8c48-ed79c9cf1f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:30.447409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826eb8ba-ec93-4d18-8c48-ed79c9cf1f47 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:30.448253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eb8ba-ec93-4d18-8c48-ed79c9cf1f47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:30.448654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eb8ba-ec93-4d18-8c48-ed79c9cf1f47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:30.450506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826eb8ba-ec93-4d18-8c48-ed79c9cf1f47 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:30.469404 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2041/4046] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:30.473802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf045ff2-47bc-4895-8031-639145797635 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:30.491527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf045ff2-47bc-4895-8031-639145797635 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:30.497098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62aee6a-9e52-4673-903e-2b5af7708073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:30.498347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aee6a-9e52-4673-903e-2b5af7708073 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:30.498347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aee6a-9e52-4673-903e-2b5af7708073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:30.498869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62aee6a-9e52-4673-903e-2b5af7708073 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:30.500657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62aee6a-9e52-4673-903e-2b5af7708073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:30.502856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62aee6a-9e52-4673-903e-2b5af7708073 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:30.577316 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2006/4047] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:30 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:30.584853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eb8ba-ec93-4d18-8c48-ed79c9cf1f47 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:30.604469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826eb8ba-ec93-4d18-8c48-ed79c9cf1f47 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:30.725538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e65ec6-999e-4525-9537-06b136b690b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:30.726376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e65ec6-999e-4525-9537-06b136b690b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:30.726968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e65ec6-999e-4525-9537-06b136b690b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:30.727144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e65ec6-999e-4525-9537-06b136b690b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:30.728203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e65ec6-999e-4525-9537-06b136b690b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:30.732347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e65ec6-999e-4525-9537-06b136b690b2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:30.791034 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2042/4048] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:34:30 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:34:30.795409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62aee6a-9e52-4673-903e-2b5af7708073 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:30.828237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62aee6a-9e52-4673-903e-2b5af7708073 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:30.838836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baad538-f9a5-422c-918c-d73304ec3b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:30.840100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad538-f9a5-422c-918c-d73304ec3b64 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:30.840679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad538-f9a5-422c-918c-d73304ec3b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:30.840848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baad538-f9a5-422c-918c-d73304ec3b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:30.841596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baad538-f9a5-422c-918c-d73304ec3b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:30.847063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baad538-f9a5-422c-918c-d73304ec3b64 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:30.872245 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2007/4049] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:30.876532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e65ec6-999e-4525-9537-06b136b690b2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:30.898415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e65ec6-999e-4525-9537-06b136b690b2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:30.939530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ed9e7-a86e-4c6c-93d5-478349b91c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:30.940174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ed9e7-a86e-4c6c-93d5-478349b91c4a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:30.940452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ed9e7-a86e-4c6c-93d5-478349b91c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:30.940725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ed9e7-a86e-4c6c-93d5-478349b91c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:30.941474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ed9e7-a86e-4c6c-93d5-478349b91c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:30.943440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ed9e7-a86e-4c6c-93d5-478349b91c4a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:30.977314 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2043/4050] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:30.982056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baad538-f9a5-422c-918c-d73304ec3b64 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:31.001610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baad538-f9a5-422c-918c-d73304ec3b64 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:31.021088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374b251-113f-4010-812d-3a1dcfe9de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:31.022129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374b251-113f-4010-812d-3a1dcfe9de14 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:31.022414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374b251-113f-4010-812d-3a1dcfe9de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:31.022880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374b251-113f-4010-812d-3a1dcfe9de14 admin admin] PATH_INFO: `/v3/projects/cf010c2c4643420d9f6aaa26ab54f732/users/c0fb3c339ae4478186d3dc0c71a79a69/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:31.061778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374b251-113f-4010-812d-3a1dcfe9de14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf010c2c4643420d9f6aaa26ab54f732, user_id=c0fb3c339ae4478186d3dc0c71a79a69, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:31.067903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374b251-113f-4010-812d-3a1dcfe9de14 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:31.090830 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2008/4051] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:30 2022] PUT /identity/v3/projects/cf010c2c4643420d9f6aaa26ab54f732/users/c0fb3c339ae4478186d3dc0c71a79a69/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:31.109600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ca37d-ae58-4c29-8bea-6c99bf2ab1e1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:31.110020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ca37d-ae58-4c29-8bea-6c99bf2ab1e1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:31.110378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ca37d-ae58-4c29-8bea-6c99bf2ab1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:31.178108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7c7ca37d-ae58-4c29-8bea-6c99bf2ab1e1 None None] MFA Rules not processed for user `c0fb3c339ae4478186d3dc0c71a79a69`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:31.179669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c7ca37d-ae58-4c29-8bea-6c99bf2ab1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:31.286700 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2044/4052] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:31.291585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374b251-113f-4010-812d-3a1dcfe9de14 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:31.426678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374b251-113f-4010-812d-3a1dcfe9de14 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:31.446137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580cda9-4e70-4a43-872f-7c1674b76c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:31.449558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580cda9-4e70-4a43-872f-7c1674b76c45 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:31.449970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580cda9-4e70-4a43-872f-7c1674b76c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:31.450274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580cda9-4e70-4a43-872f-7c1674b76c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:31.455697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580cda9-4e70-4a43-872f-7c1674b76c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:31.463265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580cda9-4e70-4a43-872f-7c1674b76c45 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:31.543558 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2009/4053] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:31 2022] POST /identity/v3/projects => generated 371 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:34:31.545980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ca37d-ae58-4c29-8bea-6c99bf2ab1e1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:31.577456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ca37d-ae58-4c29-8bea-6c99bf2ab1e1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:31.611861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:31.767239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa138796-13c7-48ff-b3b7-dfeb12ec7349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:31.768705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa138796-13c7-48ff-b3b7-dfeb12ec7349 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:31.769134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa138796-13c7-48ff-b3b7-dfeb12ec7349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:31.770485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa138796-13c7-48ff-b3b7-dfeb12ec7349 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:31.772081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa138796-13c7-48ff-b3b7-dfeb12ec7349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:31.775343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa138796-13c7-48ff-b3b7-dfeb12ec7349 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:31.816538 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2045/4054] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:34:31 2022] POST /identity/v3/users => generated 292 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:31.822133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580cda9-4e70-4a43-872f-7c1674b76c45 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:31.839526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580cda9-4e70-4a43-872f-7c1674b76c45 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:31.851045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef766e-5c6f-406b-b75c-7c39756e6ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:31.853435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef766e-5c6f-406b-b75c-7c39756e6ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:31.854052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef766e-5c6f-406b-b75c-7c39756e6ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:31.854493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef766e-5c6f-406b-b75c-7c39756e6ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:31.856200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef766e-5c6f-406b-b75c-7c39756e6ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:31.858773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef766e-5c6f-406b-b75c-7c39756e6ae1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:31.879514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa138796-13c7-48ff-b3b7-dfeb12ec7349 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:31.891140 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2010/4055] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:31.894179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa138796-13c7-48ff-b3b7-dfeb12ec7349 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:31.900694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94020c9-8f97-4a2c-8795-fd358483f2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:31.901656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94020c9-8f97-4a2c-8795-fd358483f2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:31.902126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94020c9-8f97-4a2c-8795-fd358483f2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:31.902555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94020c9-8f97-4a2c-8795-fd358483f2fa admin admin] PATH_INFO: `/v3/projects/4eec521c03f34b1c8473e06056132ab9/users/233daff57aca43adbdc8676de10b4bf9/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:31.929616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94020c9-8f97-4a2c-8795-fd358483f2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eec521c03f34b1c8473e06056132ab9, user_id=233daff57aca43adbdc8676de10b4bf9, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:31.933296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94020c9-8f97-4a2c-8795-fd358483f2fa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:31.969652 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2046/4056] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:31 2022] PUT /identity/v3/projects/4eec521c03f34b1c8473e06056132ab9/users/233daff57aca43adbdc8676de10b4bf9/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:31.977706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef766e-5c6f-406b-b75c-7c39756e6ae1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:32.003015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef766e-5c6f-406b-b75c-7c39756e6ae1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:32.032959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:32.131113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb76e5-2dee-4c81-9035-470d994e9377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:32.132269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb76e5-2dee-4c81-9035-470d994e9377 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:32.132888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb76e5-2dee-4c81-9035-470d994e9377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:32.133437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb76e5-2dee-4c81-9035-470d994e9377 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:32.141976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb76e5-2dee-4c81-9035-470d994e9377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:32.144923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb76e5-2dee-4c81-9035-470d994e9377 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:32.170559 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2011/4057] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:32.172862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94020c9-8f97-4a2c-8795-fd358483f2fa admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:32.205439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94020c9-8f97-4a2c-8795-fd358483f2fa admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:32.220301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf4876-4b18-4e8c-a102-b93c550ff7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:32.221469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf4876-4b18-4e8c-a102-b93c550ff7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:32.221969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf4876-4b18-4e8c-a102-b93c550ff7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:32.222388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf4876-4b18-4e8c-a102-b93c550ff7b3 admin admin] PATH_INFO: `/v3/projects/4eec521c03f34b1c8473e06056132ab9/users/233daff57aca43adbdc8676de10b4bf9/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:32.227174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf4876-4b18-4e8c-a102-b93c550ff7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eec521c03f34b1c8473e06056132ab9, user_id=233daff57aca43adbdc8676de10b4bf9, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:32.230469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf4876-4b18-4e8c-a102-b93c550ff7b3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:32.253104 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2047/4058] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:32 2022] PUT /identity/v3/projects/4eec521c03f34b1c8473e06056132ab9/users/233daff57aca43adbdc8676de10b4bf9/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:32.273466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66912705-1675-41f1-990c-78375a6fc8ff None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:32.273948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66912705-1675-41f1-990c-78375a6fc8ff None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:32.274416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66912705-1675-41f1-990c-78375a6fc8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:32.345275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-66912705-1675-41f1-990c-78375a6fc8ff None None] MFA Rules not processed for user `233daff57aca43adbdc8676de10b4bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:32.348991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-66912705-1675-41f1-990c-78375a6fc8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:32.533062 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2012/4059] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:32.539998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf4876-4b18-4e8c-a102-b93c550ff7b3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:32.576967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf4876-4b18-4e8c-a102-b93c550ff7b3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:32.591980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8024e-00e1-4e46-b3b5-9ea818e0e6c2 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:32.593328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8024e-00e1-4e46-b3b5-9ea818e0e6c2 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:32.594060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8024e-00e1-4e46-b3b5-9ea818e0e6c2 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:32.594831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8024e-00e1-4e46-b3b5-9ea818e0e6c2 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:32.597081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8024e-00e1-4e46-b3b5-9ea818e0e6c2 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:32.600207 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-2df8024e-00e1-4e46-b3b5-9ea818e0e6c2 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:32.600207 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:34:32.600207 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:34:32.602372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8024e-00e1-4e46-b3b5-9ea818e0e6c2 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:32.658941 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2048/4060] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:34:32 2022] POST /identity/v3/domains => generated 275 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:34:32.663923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66912705-1675-41f1-990c-78375a6fc8ff None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:32.680579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66912705-1675-41f1-990c-78375a6fc8ff None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:32.812267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf892d6-5829-4af9-ba1b-47c3aa739c17 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:32.815208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf892d6-5829-4af9-ba1b-47c3aa739c17 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:32.817011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf892d6-5829-4af9-ba1b-47c3aa739c17 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:32.817494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf892d6-5829-4af9-ba1b-47c3aa739c17 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:32.825827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf892d6-5829-4af9-ba1b-47c3aa739c17 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:32.847015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf892d6-5829-4af9-ba1b-47c3aa739c17 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:32.938190 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2013/4061] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:32 2022] POST /identity/v3/projects => generated 401 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:32.939044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8024e-00e1-4e46-b3b5-9ea818e0e6c2 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:32.960873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8024e-00e1-4e46-b3b5-9ea818e0e6c2 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:33.069693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7d6ca-544c-4baa-b5ad-82804bb532f5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:33.070544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7d6ca-544c-4baa-b5ad-82804bb532f5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:33.070950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7d6ca-544c-4baa-b5ad-82804bb532f5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:33.071502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7d6ca-544c-4baa-b5ad-82804bb532f5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:33.072344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7d6ca-544c-4baa-b5ad-82804bb532f5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:33.074494 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-29e7d6ca-544c-4baa-b5ad-82804bb532f5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:33.074494 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:34:33.074494 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:34:33.076741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7d6ca-544c-4baa-b5ad-82804bb532f5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:33.107142 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2049/4062] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:32 2022] POST /identity/v3/groups => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:34:33.114321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf892d6-5829-4af9-ba1b-47c3aa739c17 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:33.142672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf892d6-5829-4af9-ba1b-47c3aa739c17 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:33.167557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe35b24-baca-4697-bf24-5bf5ca86ddeb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:33.171232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe35b24-baca-4697-bf24-5bf5ca86ddeb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:33.179044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe35b24-baca-4697-bf24-5bf5ca86ddeb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:33.179608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe35b24-baca-4697-bf24-5bf5ca86ddeb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:33.180537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe35b24-baca-4697-bf24-5bf5ca86ddeb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:33.183932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe35b24-baca-4697-bf24-5bf5ca86ddeb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:33.227778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:33.259571 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2014/4063] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:34:33 2022] POST /identity/v3/users => generated 445 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:33.262168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7d6ca-544c-4baa-b5ad-82804bb532f5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:33.287735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7d6ca-544c-4baa-b5ad-82804bb532f5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:33.299212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419dc32-1415-4173-a9a6-35fdc1ecf92b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:33.300761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419dc32-1415-4173-a9a6-35fdc1ecf92b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:33.304340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419dc32-1415-4173-a9a6-35fdc1ecf92b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:33.305214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419dc32-1415-4173-a9a6-35fdc1ecf92b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:33.308147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419dc32-1415-4173-a9a6-35fdc1ecf92b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:33.314125 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-b419dc32-1415-4173-a9a6-35fdc1ecf92b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:33.314125 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:34:33.314125 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:34:33.316626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419dc32-1415-4173-a9a6-35fdc1ecf92b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:33.389789 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2050/4064] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:34:33 2022] POST /identity/v3/roles => generated 240 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:33.390884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe35b24-baca-4697-bf24-5bf5ca86ddeb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:33.434396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe35b24-baca-4697-bf24-5bf5ca86ddeb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:33.441132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c62f4-67da-4999-bcc4-5c037a2bac76 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:33.442100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c62f4-67da-4999-bcc4-5c037a2bac76 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:33.442576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c62f4-67da-4999-bcc4-5c037a2bac76 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:33.442980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c62f4-67da-4999-bcc4-5c037a2bac76 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/970a6485edfe44e28f21f963435d6ec1/inherited_to_projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:33.454008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c62f4-67da-4999-bcc4-5c037a2bac76 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2955da0d00724b6180b8cb4a1bb7a8d8, group_id=a976f7f40d0e46038ad107c63ba3ef9e, role_id=970a6485edfe44e28f21f963435d6ec1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:33.458365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c62f4-67da-4999-bcc4-5c037a2bac76 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:33.506670 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2015/4065] 10.222.0.43 () {60 vars in 1585 bytes} [Tue Aug 30 04:34:33 2022] PUT /identity/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/970a6485edfe44e28f21f963435d6ec1/inherited_to_projects => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:33.510364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419dc32-1415-4173-a9a6-35fdc1ecf92b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:33.553457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419dc32-1415-4173-a9a6-35fdc1ecf92b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:33.654008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:33.718890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da466-9b79-4b5a-a0b7-1aaef4f9562e tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:33.720185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da466-9b79-4b5a-a0b7-1aaef4f9562e tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:33.720711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da466-9b79-4b5a-a0b7-1aaef4f9562e tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:33.721300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842da466-9b79-4b5a-a0b7-1aaef4f9562e tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/970a6485edfe44e28f21f963435d6ec1/inherited_to_projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:33.727846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da466-9b79-4b5a-a0b7-1aaef4f9562e tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:check_grant(project_id=2955da0d00724b6180b8cb4a1bb7a8d8, group_id=a976f7f40d0e46038ad107c63ba3ef9e, role_id=970a6485edfe44e28f21f963435d6ec1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:33.728937 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-842da466-9b79-4b5a-a0b7-1aaef4f9562e tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:33.728937 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:34:33.728937 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:34:33.731267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842da466-9b79-4b5a-a0b7-1aaef4f9562e tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:33.746623 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2051/4066] 10.222.0.43 () {58 vars in 1567 bytes} [Tue Aug 30 04:34:33 2022] HEAD /identity/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/970a6485edfe44e28f21f963435d6ec1/inherited_to_projects => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:33.748193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c62f4-67da-4999-bcc4-5c037a2bac76 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:33.769638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c62f4-67da-4999-bcc4-5c037a2bac76 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:33.778633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:33.780770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:33.781309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:33.781845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/970a6485edfe44e28f21f963435d6ec1/inherited_to_projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:33.788873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=2955da0d00724b6180b8cb4a1bb7a8d8, group_id=a976f7f40d0e46038ad107c63ba3ef9e, role_id=970a6485edfe44e28f21f963435d6ec1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:33.791190 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:33.791190 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:33.791190 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:33.794193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:33.804688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role 970a6485edfe44e28f21f963435d6ec1 was removed from group a976f7f40d0e46038ad107c63ba3ef9e on project 2955da0d00724b6180b8cb4a1bb7a8d8. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:33.805066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:33.806388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:33.854022 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2016/4067] 10.222.0.43 () {58 vars in 1569 bytes} [Tue Aug 30 04:34:33 2022] DELETE /identity/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/970a6485edfe44e28f21f963435d6ec1/inherited_to_projects => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:33.855930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da466-9b79-4b5a-a0b7-1aaef4f9562e tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:33.859219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-842da466-9b79-4b5a-a0b7-1aaef4f9562e tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:33.899153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842da466-9b79-4b5a-a0b7-1aaef4f9562e tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:34.050650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:34.051406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:34.051963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:34.052648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles/970a6485edfe44e28f21f963435d6ec1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:34.061024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_role(role_id=970a6485edfe44e28f21f963435d6ec1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:34.065504 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:34.065504 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:34:34.065504 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:34:34.066559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:34.135154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role 970a6485edfe44e28f21f963435d6ec1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:34.135482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:34.136370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:34.145526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:34.146091 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2052/4068] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:33 2022] DELETE /identity/v3/roles/970a6485edfe44e28f21f963435d6ec1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:34.159388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471f085-5389-48a4-b6f4-e2ce62e17baa tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:34.263298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aed7bb-45fd-47d7-aed4-7b2907d40a79 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:34.264113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aed7bb-45fd-47d7-aed4-7b2907d40a79 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:34.264649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aed7bb-45fd-47d7-aed4-7b2907d40a79 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:34.265668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aed7bb-45fd-47d7-aed4-7b2907d40a79 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:34.267332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aed7bb-45fd-47d7-aed4-7b2907d40a79 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:34.269599 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-47aed7bb-45fd-47d7-aed4-7b2907d40a79 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:34.269599 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:34.269599 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:34.274858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aed7bb-45fd-47d7-aed4-7b2907d40a79 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:34.310081 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2017/4069] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:34:34 2022] POST /identity/v3/roles => generated 239 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:34.314214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:34.316804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:34.338406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71acd0a-8cf2-4718-b038-a37b834c747f tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:34.344850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d949c14-9144-4249-8385-857a91ee6429 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:34.346787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949c14-9144-4249-8385-857a91ee6429 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:34.355886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949c14-9144-4249-8385-857a91ee6429 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:34.356788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d949c14-9144-4249-8385-857a91ee6429 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/users/415c624513b84fe99e6542c647cf2d3a/roles/f52b4c4b2cd3404ab6282afee29e45bc/inherited_to_projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:34.378213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d949c14-9144-4249-8385-857a91ee6429 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2955da0d00724b6180b8cb4a1bb7a8d8, user_id=415c624513b84fe99e6542c647cf2d3a, role_id=f52b4c4b2cd3404ab6282afee29e45bc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:34.383142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d949c14-9144-4249-8385-857a91ee6429 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:34.404010 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2053/4070] 10.222.0.43 () {60 vars in 1582 bytes} [Tue Aug 30 04:34:34 2022] PUT /identity/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/users/415c624513b84fe99e6542c647cf2d3a/roles/f52b4c4b2cd3404ab6282afee29e45bc/inherited_to_projects => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:34.408179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aed7bb-45fd-47d7-aed4-7b2907d40a79 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:34.426908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aed7bb-45fd-47d7-aed4-7b2907d40a79 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:34.568408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3402a58-2e6c-438c-bb1a-99f9f057d43d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:34.569176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3402a58-2e6c-438c-bb1a-99f9f057d43d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:34.569459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3402a58-2e6c-438c-bb1a-99f9f057d43d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:34.569782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3402a58-2e6c-438c-bb1a-99f9f057d43d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/users/415c624513b84fe99e6542c647cf2d3a/roles/f52b4c4b2cd3404ab6282afee29e45bc/inherited_to_projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:34.573424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3402a58-2e6c-438c-bb1a-99f9f057d43d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:check_grant(project_id=2955da0d00724b6180b8cb4a1bb7a8d8, user_id=415c624513b84fe99e6542c647cf2d3a, role_id=f52b4c4b2cd3404ab6282afee29e45bc)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:34.574064 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-d3402a58-2e6c-438c-bb1a-99f9f057d43d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:34.574064 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:34.574064 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:34.577211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3402a58-2e6c-438c-bb1a-99f9f057d43d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:34.586691 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2018/4071] 10.222.0.43 () {58 vars in 1564 bytes} [Tue Aug 30 04:34:34 2022] HEAD /identity/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/users/415c624513b84fe99e6542c647cf2d3a/roles/f52b4c4b2cd3404ab6282afee29e45bc/inherited_to_projects => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:34.590774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d949c14-9144-4249-8385-857a91ee6429 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:34.619171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d949c14-9144-4249-8385-857a91ee6429 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:34.624988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337f122-59c8-4f40-9520-221ab2973a4b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:34.625575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337f122-59c8-4f40-9520-221ab2973a4b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:34.626198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337f122-59c8-4f40-9520-221ab2973a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:34.645316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:34.650624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:34.652070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:34.653425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/users/415c624513b84fe99e6542c647cf2d3a/roles/f52b4c4b2cd3404ab6282afee29e45bc/inherited_to_projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:34.662530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7337f122-59c8-4f40-9520-221ab2973a4b None None] MFA Rules not processed for user `84933dd631ac4adbb499c5072b7caf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:34.664551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=2955da0d00724b6180b8cb4a1bb7a8d8, user_id=415c624513b84fe99e6542c647cf2d3a, role_id=f52b4c4b2cd3404ab6282afee29e45bc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:34.665046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7337f122-59c8-4f40-9520-221ab2973a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:34.667204 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:34.667204 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:34:34.667204 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:34:34.678486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:34.696815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role f52b4c4b2cd3404ab6282afee29e45bc was removed from user 415c624513b84fe99e6542c647cf2d3a on project 2955da0d00724b6180b8cb4a1bb7a8d8. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:34.697514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:34.699371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:34.731793 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2054/4072] 10.222.0.43 () {58 vars in 1566 bytes} [Tue Aug 30 04:34:34 2022] DELETE /identity/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/users/415c624513b84fe99e6542c647cf2d3a/roles/f52b4c4b2cd3404ab6282afee29e45bc/inherited_to_projects => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:34.735862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:34.737336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:34.795095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:34.817142 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2019/4073] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:34.856061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3312ea-67b6-4126-b748-abca83fce90b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:34.870512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:34.871257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:34.871704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:34.871982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles/f52b4c4b2cd3404ab6282afee29e45bc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:34.873507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f52b4c4b2cd3404ab6282afee29e45bc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:34.876966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:34.883270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:34.942707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role f52b4c4b2cd3404ab6282afee29e45bc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:34.943237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:34.944029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:34.946068 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2055/4074] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:34 2022] DELETE /identity/v3/roles/f52b4c4b2cd3404ab6282afee29e45bc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:34.951512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337f122-59c8-4f40-9520-221ab2973a4b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:34.967561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337f122-59c8-4f40-9520-221ab2973a4b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:35.096377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c6c28-00ef-49f4-a852-7ad94bca36a6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:35.097675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c6c28-00ef-49f4-a852-7ad94bca36a6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:35.097942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c6c28-00ef-49f4-a852-7ad94bca36a6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:35.098307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c6c28-00ef-49f4-a852-7ad94bca36a6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:35.099022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c6c28-00ef-49f4-a852-7ad94bca36a6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:35.100912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c6c28-00ef-49f4-a852-7ad94bca36a6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:35.130003 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2020/4075] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:34:34 2022] POST /identity/v3/roles => generated 239 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:35.136049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:35.137977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:35.159338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d618829-5d0a-47bf-b17c-b1aa22adf471 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:35.165061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9b9ef-3bf5-4559-8251-9ca082c130de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:35.166306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9b9ef-3bf5-4559-8251-9ca082c130de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:35.166711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9b9ef-3bf5-4559-8251-9ca082c130de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:35.167090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9b9ef-3bf5-4559-8251-9ca082c130de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/b16c66b9e51a4f659f3544209e97a587/inherited_to_projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:35.177634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9b9ef-3bf5-4559-8251-9ca082c130de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ffa8a9ada3b34464babee81a63d7bdc0, group_id=a976f7f40d0e46038ad107c63ba3ef9e, role_id=b16c66b9e51a4f659f3544209e97a587)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:35.187118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9b9ef-3bf5-4559-8251-9ca082c130de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:35.208791 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2056/4076] 10.222.0.43 () {60 vars in 1582 bytes} [Tue Aug 30 04:34:35 2022] PUT /identity/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/b16c66b9e51a4f659f3544209e97a587/inherited_to_projects => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:35.213460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c6c28-00ef-49f4-a852-7ad94bca36a6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:35.229346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c6c28-00ef-49f4-a852-7ad94bca36a6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:35.371606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a6fe8-0873-4d78-a301-730c6948e4a1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:35.372497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a6fe8-0873-4d78-a301-730c6948e4a1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:35.372878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a6fe8-0873-4d78-a301-730c6948e4a1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:35.373250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a6fe8-0873-4d78-a301-730c6948e4a1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/inherited_to_projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:35.376017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a6fe8-0873-4d78-a301-730c6948e4a1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=ffa8a9ada3b34464babee81a63d7bdc0, group_id=a976f7f40d0e46038ad107c63ba3ef9e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:35.377289 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-a68a6fe8-0873-4d78-a301-730c6948e4a1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:35.377289 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:35.377289 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:35.379681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a6fe8-0873-4d78-a301-730c6948e4a1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:35.406312 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2021/4077] 10.222.0.43 () {58 vars in 1464 bytes} [Tue Aug 30 04:34:35 2022] GET /identity/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/inherited_to_projects => generated 447 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:35.415585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9b9ef-3bf5-4559-8251-9ca082c130de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:35.421017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9b9ef-3bf5-4559-8251-9ca082c130de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:35.441346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1b672-0aee-4dc9-9716-c64f683a257b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:35.442739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1b672-0aee-4dc9-9716-c64f683a257b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:35.443556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1b672-0aee-4dc9-9716-c64f683a257b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:35.444117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1b672-0aee-4dc9-9716-c64f683a257b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/b16c66b9e51a4f659f3544209e97a587/inherited_to_projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:35.448081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1b672-0aee-4dc9-9716-c64f683a257b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=ffa8a9ada3b34464babee81a63d7bdc0, group_id=a976f7f40d0e46038ad107c63ba3ef9e, role_id=b16c66b9e51a4f659f3544209e97a587)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:35.452204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1b672-0aee-4dc9-9716-c64f683a257b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:35.464982 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2057/4078] 10.222.0.43 () {58 vars in 1564 bytes} [Tue Aug 30 04:34:35 2022] HEAD /identity/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/b16c66b9e51a4f659f3544209e97a587/inherited_to_projects => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:35.465599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a6fe8-0873-4d78-a301-730c6948e4a1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:35.481050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a6fe8-0873-4d78-a301-730c6948e4a1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:35.492010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:35.493591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:35.494308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:35.495129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/b16c66b9e51a4f659f3544209e97a587/inherited_to_projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:35.500198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ffa8a9ada3b34464babee81a63d7bdc0, group_id=a976f7f40d0e46038ad107c63ba3ef9e, role_id=b16c66b9e51a4f659f3544209e97a587)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:35.508281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:35.520768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role b16c66b9e51a4f659f3544209e97a587 was removed from group a976f7f40d0e46038ad107c63ba3ef9e on domain ffa8a9ada3b34464babee81a63d7bdc0. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:35.522498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:35.523214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:35.552369 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2022/4079] 10.222.0.43 () {58 vars in 1566 bytes} [Tue Aug 30 04:34:35 2022] DELETE /identity/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/groups/a976f7f40d0e46038ad107c63ba3ef9e/roles/b16c66b9e51a4f659f3544209e97a587/inherited_to_projects => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:35.554881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1b672-0aee-4dc9-9716-c64f683a257b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:35.559607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-43b1b672-0aee-4dc9-9716-c64f683a257b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:35.581286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1b672-0aee-4dc9-9716-c64f683a257b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:35.678277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:35.679873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:35.681302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:35.681903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles/b16c66b9e51a4f659f3544209e97a587` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:35.683840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b16c66b9e51a4f659f3544209e97a587)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:35.686675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:35.745268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role b16c66b9e51a4f659f3544209e97a587 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:35.746561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:35.747177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:35.756740 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2058/4080] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:35 2022] DELETE /identity/v3/roles/b16c66b9e51a4f659f3544209e97a587 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:35.757803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:35.771484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2cb38-cb20-4328-9aad-ea5353d56332 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:35.929030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8580-2ebe-4b03-8364-e9c787a0170b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:35.929965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8580-2ebe-4b03-8364-e9c787a0170b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:35.930429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8580-2ebe-4b03-8364-e9c787a0170b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:35.930890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c8580-2ebe-4b03-8364-e9c787a0170b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:35.932090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c8580-2ebe-4b03-8364-e9c787a0170b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:35.935705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c8580-2ebe-4b03-8364-e9c787a0170b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:35.958017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:35.982380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:35.984869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:35.989562 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2023/4081] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:34:35 2022] POST /identity/v3/roles => generated 240 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:34:36.013514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb773f0-dc85-4951-8cef-6b58277d87bb tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:36.030100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4a786-c7e6-4709-9df8-0ebf734c20de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:36.031456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4a786-c7e6-4709-9df8-0ebf734c20de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:36.032543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4a786-c7e6-4709-9df8-0ebf734c20de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:36.033019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4a786-c7e6-4709-9df8-0ebf734c20de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/53738bd62512440cb6093f0a1b60348b/inherited_to_projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:36.037702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4a786-c7e6-4709-9df8-0ebf734c20de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ffa8a9ada3b34464babee81a63d7bdc0, user_id=415c624513b84fe99e6542c647cf2d3a, role_id=53738bd62512440cb6093f0a1b60348b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:36.044696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4a786-c7e6-4709-9df8-0ebf734c20de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:36.079225 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2059/4082] 10.222.0.43 () {60 vars in 1579 bytes} [Tue Aug 30 04:34:35 2022] PUT /identity/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/53738bd62512440cb6093f0a1b60348b/inherited_to_projects => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:36.086257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8580-2ebe-4b03-8364-e9c787a0170b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:36.112511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c8580-2ebe-4b03-8364-e9c787a0170b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:36.227563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749b06a-11b4-4737-a5b9-4b728a068584 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:36.228609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749b06a-11b4-4737-a5b9-4b728a068584 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:36.228609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749b06a-11b4-4737-a5b9-4b728a068584 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:36.228923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749b06a-11b4-4737-a5b9-4b728a068584 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/inherited_to_projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:36.230607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749b06a-11b4-4737-a5b9-4b728a068584 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=ffa8a9ada3b34464babee81a63d7bdc0, user_id=415c624513b84fe99e6542c647cf2d3a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:36.233185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749b06a-11b4-4737-a5b9-4b728a068584 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:36.251558 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2024/4083] 10.222.0.43 () {58 vars in 1461 bytes} [Tue Aug 30 04:34:36 2022] GET /identity/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/inherited_to_projects => generated 447 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:34:36.252424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4a786-c7e6-4709-9df8-0ebf734c20de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:36.264855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4a786-c7e6-4709-9df8-0ebf734c20de tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:36.271068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e098c16-0134-4f98-90a2-45f322c9e8ac tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:36.271924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e098c16-0134-4f98-90a2-45f322c9e8ac tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:36.272270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e098c16-0134-4f98-90a2-45f322c9e8ac tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:36.272611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e098c16-0134-4f98-90a2-45f322c9e8ac tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/53738bd62512440cb6093f0a1b60348b/inherited_to_projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:36.275621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e098c16-0134-4f98-90a2-45f322c9e8ac tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=ffa8a9ada3b34464babee81a63d7bdc0, user_id=415c624513b84fe99e6542c647cf2d3a, role_id=53738bd62512440cb6093f0a1b60348b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:36.278533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e098c16-0134-4f98-90a2-45f322c9e8ac tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:36.290526 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2060/4084] 10.222.0.43 () {58 vars in 1561 bytes} [Tue Aug 30 04:34:36 2022] HEAD /identity/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/53738bd62512440cb6093f0a1b60348b/inherited_to_projects => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:36.292631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749b06a-11b4-4737-a5b9-4b728a068584 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:36.305381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749b06a-11b4-4737-a5b9-4b728a068584 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:36.310950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:36.311828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:36.312120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:36.312478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/53738bd62512440cb6093f0a1b60348b/inherited_to_projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:36.315383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ffa8a9ada3b34464babee81a63d7bdc0, user_id=415c624513b84fe99e6542c647cf2d3a, role_id=53738bd62512440cb6093f0a1b60348b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:36.318348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:36.327573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role 53738bd62512440cb6093f0a1b60348b was removed from user 415c624513b84fe99e6542c647cf2d3a on domain ffa8a9ada3b34464babee81a63d7bdc0. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:36.327959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:36.328733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:36.345938 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2025/4085] 10.222.0.43 () {58 vars in 1563 bytes} [Tue Aug 30 04:34:36 2022] DELETE /identity/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/53738bd62512440cb6093f0a1b60348b/inherited_to_projects => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:36.350233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e098c16-0134-4f98-90a2-45f322c9e8ac tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:36.353326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3e098c16-0134-4f98-90a2-45f322c9e8ac tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:36.367740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e098c16-0134-4f98-90a2-45f322c9e8ac tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:36.441189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:36.465526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:36.467387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:36.467839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:36.468413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles/53738bd62512440cb6093f0a1b60348b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:36.470380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_role(role_id=53738bd62512440cb6093f0a1b60348b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:36.472530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:36.541508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role 53738bd62512440cb6093f0a1b60348b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:36.542215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:36.543352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:36.546194 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2061/4086] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:36 2022] DELETE /identity/v3/roles/53738bd62512440cb6093f0a1b60348b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:36.554113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:36.572107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0ade2-7c2f-4ab9-ade5-4a8dac27210d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:36.664339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d04bd-1c34-4121-9ffe-5f23a02162b5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:36.664998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d04bd-1c34-4121-9ffe-5f23a02162b5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:36.665271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d04bd-1c34-4121-9ffe-5f23a02162b5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:36.665540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d04bd-1c34-4121-9ffe-5f23a02162b5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:36.666350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d04bd-1c34-4121-9ffe-5f23a02162b5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:36.668135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d04bd-1c34-4121-9ffe-5f23a02162b5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:36.695762 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2026/4087] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:34:36 2022] POST /identity/v3/roles => generated 239 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:36.699678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:36.702640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:36.719179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bccc5a1-129b-4d2f-9385-7aad55b47f89 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:36.729506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7fa53-c6a7-4940-9316-80366d3ec6ce tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:36.730442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7fa53-c6a7-4940-9316-80366d3ec6ce tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:36.730794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7fa53-c6a7-4940-9316-80366d3ec6ce tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:36.731134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7fa53-c6a7-4940-9316-80366d3ec6ce tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:36.731995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7fa53-c6a7-4940-9316-80366d3ec6ce tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:36.734400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7fa53-c6a7-4940-9316-80366d3ec6ce tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:36.804279 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2062/4088] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:36 2022] POST /identity/v3/projects => generated 408 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:36.805715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d04bd-1c34-4121-9ffe-5f23a02162b5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:36.817255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d04bd-1c34-4121-9ffe-5f23a02162b5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:36.956733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7fa53-c6a7-4940-9316-80366d3ec6ce tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:36.959320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d0b7fa53-c6a7-4940-9316-80366d3ec6ce tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:36.977423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14a836-9889-4468-86c7-77fc4da28f20 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:36.978460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a836-9889-4468-86c7-77fc4da28f20 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:36.978584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a836-9889-4468-86c7-77fc4da28f20 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:36.978786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a836-9889-4468-86c7-77fc4da28f20 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/ad3141613f6e42e2a027ab999dc702b2/inherited_to_projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:36.988799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14a836-9889-4468-86c7-77fc4da28f20 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ffa8a9ada3b34464babee81a63d7bdc0, user_id=415c624513b84fe99e6542c647cf2d3a, role_id=ad3141613f6e42e2a027ab999dc702b2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:36.992201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14a836-9889-4468-86c7-77fc4da28f20 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:37.031830 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2027/4089] 10.222.0.43 () {60 vars in 1579 bytes} [Tue Aug 30 04:34:36 2022] PUT /identity/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/ad3141613f6e42e2a027ab999dc702b2/inherited_to_projects => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:37.038696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14a836-9889-4468-86c7-77fc4da28f20 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:37.053900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:37.095492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7fa53-c6a7-4940-9316-80366d3ec6ce tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:37.250112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14a836-9889-4468-86c7-77fc4da28f20 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:37.251562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:37.252800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:37.253280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:37.255213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f9af5-b50c-41bc-8926-8ace2a080d73 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:37.255894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f9af5-b50c-41bc-8926-8ace2a080d73 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:37.256174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f9af5-b50c-41bc-8926-8ace2a080d73 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:37.256447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f9af5-b50c-41bc-8926-8ace2a080d73 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:37.258566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f9af5-b50c-41bc-8926-8ace2a080d73 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Adding query filter params (scope.project.id=2955da0d00724b6180b8cb4a1bb7a8d8, user.id=415c624513b84fe99e6542c647cf2d3a) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:37.258566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f9af5-b50c-41bc-8926-8ace2a080d73 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:37.259124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] PATH_INFO: `/v3/users/d5b3e78152ff44719b4a43f203e24d26` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:37.259355 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-cc2f9af5-b50c-41bc-8926-8ace2a080d73 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:37.259355 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:37.259355 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:37.260552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f9af5-b50c-41bc-8926-8ace2a080d73 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:37.261666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b3e78152ff44719b4a43f203e24d26)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:37.270310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:37.362774 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2028/4090] 10.222.0.43 () {58 vars in 1356 bytes} [Tue Aug 30 04:34:37 2022] GET /identity/v3/role_assignments?scope.project.id=2955da0d00724b6180b8cb4a1bb7a8d8&user.id=415c624513b84fe99e6542c647cf2d3a&effective => generated 648 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:37.377680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f9af5-b50c-41bc-8926-8ace2a080d73 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:37.409708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f9af5-b50c-41bc-8926-8ace2a080d73 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:37.439273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e04a6-c775-4245-85fd-d9b4da6ba183 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:37.440052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e04a6-c775-4245-85fd-d9b4da6ba183 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:37.440363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e04a6-c775-4245-85fd-d9b4da6ba183 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:37.440668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e04a6-c775-4245-85fd-d9b4da6ba183 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:37.441510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e04a6-c775-4245-85fd-d9b4da6ba183 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Adding query filter params (scope.project.id=82f97e84be8a4802871dea25c8031ac8, user.id=415c624513b84fe99e6542c647cf2d3a) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:37.441942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e04a6-c775-4245-85fd-d9b4da6ba183 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:37.446546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e04a6-c775-4245-85fd-d9b4da6ba183 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:37.480048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:37.527255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b3e78152ff44719b4a43f203e24d26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:37.527994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b3e78152ff44719b4a43f203e24d26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:37.535934 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2029/4091] 10.222.0.43 () {58 vars in 1356 bytes} [Tue Aug 30 04:34:37 2022] GET /identity/v3/role_assignments?scope.project.id=82f97e84be8a4802871dea25c8031ac8&user.id=415c624513b84fe99e6542c647cf2d3a&effective => generated 648 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:37.540828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e04a6-c775-4245-85fd-d9b4da6ba183 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:37.547903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b3e78152ff44719b4a43f203e24d26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:37.559084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e04a6-c775-4245-85fd-d9b4da6ba183 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:37.565145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b3e78152ff44719b4a43f203e24d26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:37.574403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:37.575704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:37.575984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:37.576258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/ad3141613f6e42e2a027ab999dc702b2/inherited_to_projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:37.585623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ffa8a9ada3b34464babee81a63d7bdc0, user_id=415c624513b84fe99e6542c647cf2d3a, role_id=ad3141613f6e42e2a027ab999dc702b2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:37.591529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:37.593345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-333b2241-fad7-4b06-b3fe-61dd82053b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b3e78152ff44719b4a43f203e24d26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:37.604433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role ad3141613f6e42e2a027ab999dc702b2 was removed from user 415c624513b84fe99e6542c647cf2d3a on domain ffa8a9ada3b34464babee81a63d7bdc0. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:37.604737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:37.609984 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2063/4092] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:36 2022] DELETE /identity/v3/users/d5b3e78152ff44719b4a43f203e24d26 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:37.611574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751849a-17c9-41ff-9b17-750e08fefd5a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:37.612504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751849a-17c9-41ff-9b17-750e08fefd5a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:37.612504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751849a-17c9-41ff-9b17-750e08fefd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:37.613096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:37.635737 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2030/4093] 10.222.0.43 () {58 vars in 1563 bytes} [Tue Aug 30 04:34:37 2022] DELETE /identity/v3/OS-INHERIT/domains/ffa8a9ada3b34464babee81a63d7bdc0/users/415c624513b84fe99e6542c647cf2d3a/roles/ad3141613f6e42e2a027ab999dc702b2/inherited_to_projects => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:37.642156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:37.645943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:37.663406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3751849a-17c9-41ff-9b17-750e08fefd5a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:37.667427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3751849a-17c9-41ff-9b17-750e08fefd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:37.774443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:37.833194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce7bd7-0db7-4724-8c20-44bccddc9f09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:37.844522 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2064/4094] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:37.853142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75cf55-9202-433b-80bd-4d146daa1367 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:37.853796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75cf55-9202-433b-80bd-4d146daa1367 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:37.854114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75cf55-9202-433b-80bd-4d146daa1367 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:37.854386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75cf55-9202-433b-80bd-4d146daa1367 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:37.855152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75cf55-9202-433b-80bd-4d146daa1367 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Adding query filter params (scope.project.id=2955da0d00724b6180b8cb4a1bb7a8d8, user.id=415c624513b84fe99e6542c647cf2d3a) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:37.855459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75cf55-9202-433b-80bd-4d146daa1367 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:37.858098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75cf55-9202-433b-80bd-4d146daa1367 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:37.889662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751849a-17c9-41ff-9b17-750e08fefd5a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:37.892964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3751849a-17c9-41ff-9b17-750e08fefd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:38.012502 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2031/4095] 10.222.0.43 () {58 vars in 1356 bytes} [Tue Aug 30 04:34:37 2022] GET /identity/v3/role_assignments?scope.project.id=2955da0d00724b6180b8cb4a1bb7a8d8&user.id=415c624513b84fe99e6542c647cf2d3a&effective => generated 228 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:38.020542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75cf55-9202-433b-80bd-4d146daa1367 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:38.065910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75cf55-9202-433b-80bd-4d146daa1367 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:38.080372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e768c-9b50-4ffd-8867-e7ea24ce041d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:38.082277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e768c-9b50-4ffd-8867-e7ea24ce041d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:38.082658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e768c-9b50-4ffd-8867-e7ea24ce041d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:38.083011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e768c-9b50-4ffd-8867-e7ea24ce041d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:38.084886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e768c-9b50-4ffd-8867-e7ea24ce041d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Adding query filter params (scope.project.id=82f97e84be8a4802871dea25c8031ac8, user.id=415c624513b84fe99e6542c647cf2d3a) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:38.085249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e768c-9b50-4ffd-8867-e7ea24ce041d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:38.088535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751849a-17c9-41ff-9b17-750e08fefd5a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:38.091462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e768c-9b50-4ffd-8867-e7ea24ce041d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:38.095436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25431191-be59-4025-90a4-9d28b6f59aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:38.096092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25431191-be59-4025-90a4-9d28b6f59aed service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:38.096375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25431191-be59-4025-90a4-9d28b6f59aed service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:38.096644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25431191-be59-4025-90a4-9d28b6f59aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:38.128867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25431191-be59-4025-90a4-9d28b6f59aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:38.130781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25431191-be59-4025-90a4-9d28b6f59aed service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:38.191249 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2065/4096] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:34:38.218408 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2032/4097] 10.222.0.43 () {58 vars in 1356 bytes} [Tue Aug 30 04:34:38 2022] GET /identity/v3/role_assignments?scope.project.id=82f97e84be8a4802871dea25c8031ac8&user.id=415c624513b84fe99e6542c647cf2d3a&effective => generated 228 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:38.219698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25431191-be59-4025-90a4-9d28b6f59aed service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:38.242616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25431191-be59-4025-90a4-9d28b6f59aed service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:38.249161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:38.250000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:38.250383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:38.250819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/projects/82f97e84be8a4802871dea25c8031ac8` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:38.253306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82f97e84be8a4802871dea25c8031ac8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:38.259911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:38.458100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f97e84be8a4802871dea25c8031ac8', 'request_id': 'req-577ab04c-acbb-4296-bb32-5bc502899d70'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:38.458100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:38.470930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f97e84be8a4802871dea25c8031ac8', 'request_id': 'req-577ab04c-acbb-4296-bb32-5bc502899d70'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:38.486610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f97e84be8a4802871dea25c8031ac8', 'request_id': 'req-577ab04c-acbb-4296-bb32-5bc502899d70'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:38.544860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] The token cache is being invalidate because project 82f97e84be8a4802871dea25c8031ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:38.545167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:38.548664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:38.555855 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2066/4098] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:38 2022] DELETE /identity/v3/projects/82f97e84be8a4802871dea25c8031ac8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:38.558924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e768c-9b50-4ffd-8867-e7ea24ce041d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:38.561986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4a9e768c-9b50-4ffd-8867-e7ea24ce041d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:38.589633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e768c-9b50-4ffd-8867-e7ea24ce041d tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:38.765974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:38.765974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:38.765974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:38.766498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles/ad3141613f6e42e2a027ab999dc702b2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:38.766498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ad3141613f6e42e2a027ab999dc702b2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:38.768802 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:38.768802 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:38.768802 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:38.769263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:38.848497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role ad3141613f6e42e2a027ab999dc702b2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:38.848932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:38.850626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:38.865603 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2033/4099] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:38 2022] DELETE /identity/v3/roles/ad3141613f6e42e2a027ab999dc702b2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:38.867736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:38.887208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ab04c-acbb-4296-bb32-5bc502899d70 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:39.049774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2f00-5272-4f3f-b955-1e5faaeb60c6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:39.054376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2f00-5272-4f3f-b955-1e5faaeb60c6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:39.054873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2f00-5272-4f3f-b955-1e5faaeb60c6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:39.055157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f2f00-5272-4f3f-b955-1e5faaeb60c6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:39.056381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f2f00-5272-4f3f-b955-1e5faaeb60c6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:39.058931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f2f00-5272-4f3f-b955-1e5faaeb60c6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:39.112385 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2067/4100] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:34:38 2022] POST /identity/v3/roles => generated 240 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:39.116614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:39.118991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:39.163202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb9e63-c696-4050-a900-9f07a837a9f3 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:39.188031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97382c8-3c4e-465c-b127-96c14a093847 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:39.189060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97382c8-3c4e-465c-b127-96c14a093847 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:39.192681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97382c8-3c4e-465c-b127-96c14a093847 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:39.193732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97382c8-3c4e-465c-b127-96c14a093847 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:39.197131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97382c8-3c4e-465c-b127-96c14a093847 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:39.209287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97382c8-3c4e-465c-b127-96c14a093847 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:39.335569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:39.373514 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2034/4101] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:39 2022] POST /identity/v3/projects => generated 410 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:39.377339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2f00-5272-4f3f-b955-1e5faaeb60c6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:39.414903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f2f00-5272-4f3f-b955-1e5faaeb60c6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:39.596701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36146d04-5fb4-45bc-a8ea-20763357fa3a tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:39.600364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36146d04-5fb4-45bc-a8ea-20763357fa3a tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:39.600754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36146d04-5fb4-45bc-a8ea-20763357fa3a tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:39.601048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36146d04-5fb4-45bc-a8ea-20763357fa3a tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/users/415c624513b84fe99e6542c647cf2d3a/roles/2005113dfdd54067ba61c2324793d3df/inherited_to_projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:39.610384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36146d04-5fb4-45bc-a8ea-20763357fa3a tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2955da0d00724b6180b8cb4a1bb7a8d8, user_id=415c624513b84fe99e6542c647cf2d3a, role_id=2005113dfdd54067ba61c2324793d3df)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:39.616187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36146d04-5fb4-45bc-a8ea-20763357fa3a tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:39.667038 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2068/4102] 10.222.0.43 () {60 vars in 1582 bytes} [Tue Aug 30 04:34:39 2022] PUT /identity/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/users/415c624513b84fe99e6542c647cf2d3a/roles/2005113dfdd54067ba61c2324793d3df/inherited_to_projects => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:39.671612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97382c8-3c4e-465c-b127-96c14a093847 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:39.697913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97382c8-3c4e-465c-b127-96c14a093847 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:39.845982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36146d04-5fb4-45bc-a8ea-20763357fa3a tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:39.847722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-36146d04-5fb4-45bc-a8ea-20763357fa3a tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:39.876252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7cf44-e204-42b3-b211-fbd8523d2de1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:39.879092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7cf44-e204-42b3-b211-fbd8523d2de1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:39.879411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7cf44-e204-42b3-b211-fbd8523d2de1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:39.880459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7cf44-e204-42b3-b211-fbd8523d2de1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:39.880627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7cf44-e204-42b3-b211-fbd8523d2de1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Adding query filter params (scope.project.id=20cf1c877fc24a28977be01b38a33915, user.id=415c624513b84fe99e6542c647cf2d3a) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:39.880855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7cf44-e204-42b3-b211-fbd8523d2de1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:39.890064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7cf44-e204-42b3-b211-fbd8523d2de1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:40.030598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36146d04-5fb4-45bc-a8ea-20763357fa3a tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:40.039299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:40.041333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:40.042087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:40.042708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] PATH_INFO: `/v3/projects/2d9409727e6c4cf49d786fcd19faef64` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:40.046152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9409727e6c4cf49d786fcd19faef64)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:40.048834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:40.060796 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2035/4103] 10.222.0.43 () {58 vars in 1356 bytes} [Tue Aug 30 04:34:39 2022] GET /identity/v3/role_assignments?scope.project.id=20cf1c877fc24a28977be01b38a33915&user.id=415c624513b84fe99e6542c647cf2d3a&effective => generated 649 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:34:40.062934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:40.065521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7cf44-e204-42b3-b211-fbd8523d2de1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:40.085566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7cf44-e204-42b3-b211-fbd8523d2de1 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:40.093285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:40.094426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:40.094708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:40.094995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/users/415c624513b84fe99e6542c647cf2d3a/roles/2005113dfdd54067ba61c2324793d3df/inherited_to_projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:40.099750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=2955da0d00724b6180b8cb4a1bb7a8d8, user_id=415c624513b84fe99e6542c647cf2d3a, role_id=2005113dfdd54067ba61c2324793d3df)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:40.103071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:40.112184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role 2005113dfdd54067ba61c2324793d3df was removed from user 415c624513b84fe99e6542c647cf2d3a on project 2955da0d00724b6180b8cb4a1bb7a8d8. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:40.112534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:40.113660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:40.144852 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2036/4104] 10.222.0.43 () {58 vars in 1566 bytes} [Tue Aug 30 04:34:40 2022] DELETE /identity/v3/OS-INHERIT/projects/2955da0d00724b6180b8cb4a1bb7a8d8/users/415c624513b84fe99e6542c647cf2d3a/roles/2005113dfdd54067ba61c2324793d3df/inherited_to_projects => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:40.146680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:40.151413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:40.194838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9409727e6c4cf49d786fcd19faef64', 'request_id': 'req-2ef265e0-6061-4985-8bb7-3991646d13b5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:40.228308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9409727e6c4cf49d786fcd19faef64', 'request_id': 'req-2ef265e0-6061-4985-8bb7-3991646d13b5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:40.249089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9409727e6c4cf49d786fcd19faef64', 'request_id': 'req-2ef265e0-6061-4985-8bb7-3991646d13b5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:40.289195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] The token cache is being invalidate because project 2d9409727e6c4cf49d786fcd19faef64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:40.289473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:40.292367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2ef265e0-6061-4985-8bb7-3991646d13b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:40.298703 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2069/4105] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:39 2022] DELETE /identity/v3/projects/2d9409727e6c4cf49d786fcd19faef64 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:40.300375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b88c3-d487-45db-947e-a224499b9ba2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:40.300663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b88c3-d487-45db-947e-a224499b9ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:40.301090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b88c3-d487-45db-947e-a224499b9ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:40.340861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c8d44-ca9d-4625-8b8a-457b1584a1d5 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:40.346887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-434b88c3-d487-45db-947e-a224499b9ba2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:40.351221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-434b88c3-d487-45db-947e-a224499b9ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:40.501767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:40.532080 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2070/4106] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:40.533895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844022f-f145-4e90-906e-9f05a7852140 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:40.534199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844022f-f145-4e90-906e-9f05a7852140 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:40.534468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844022f-f145-4e90-906e-9f05a7852140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:40.567004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba6776-7db5-4d3a-a5fa-e533dbeddba6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:40.568185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba6776-7db5-4d3a-a5fa-e533dbeddba6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:40.568739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba6776-7db5-4d3a-a5fa-e533dbeddba6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:40.569257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba6776-7db5-4d3a-a5fa-e533dbeddba6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:40.570220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba6776-7db5-4d3a-a5fa-e533dbeddba6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Adding query filter params (scope.project.id=20cf1c877fc24a28977be01b38a33915, user.id=415c624513b84fe99e6542c647cf2d3a) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:40.570687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba6776-7db5-4d3a-a5fa-e533dbeddba6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:40.572814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba6776-7db5-4d3a-a5fa-e533dbeddba6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:40.574966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6844022f-f145-4e90-906e-9f05a7852140 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:40.578727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6844022f-f145-4e90-906e-9f05a7852140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:40.604910 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2071/4107] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:40.606592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844022f-f145-4e90-906e-9f05a7852140 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:40.627376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844022f-f145-4e90-906e-9f05a7852140 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:40.641855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4970d7-4dc0-4c7b-871e-be556ac828bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:40.642702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4970d7-4dc0-4c7b-871e-be556ac828bb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:40.642939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4970d7-4dc0-4c7b-871e-be556ac828bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:40.643352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4970d7-4dc0-4c7b-871e-be556ac828bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:40.644205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4970d7-4dc0-4c7b-871e-be556ac828bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:40.644362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4970d7-4dc0-4c7b-871e-be556ac828bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:40.651201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4970d7-4dc0-4c7b-871e-be556ac828bb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:40.720669 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2072/4108] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:34:40.722741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4970d7-4dc0-4c7b-871e-be556ac828bb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:40.765547 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2037/4109] 10.222.0.43 () {58 vars in 1356 bytes} [Tue Aug 30 04:34:40 2022] GET /identity/v3/role_assignments?scope.project.id=20cf1c877fc24a28977be01b38a33915&user.id=415c624513b84fe99e6542c647cf2d3a&effective => generated 228 bytes in 620 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:40.766698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4970d7-4dc0-4c7b-871e-be556ac828bb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:40.770246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba6776-7db5-4d3a-a5fa-e533dbeddba6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:40.775960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b4ba6776-7db5-4d3a-a5fa-e533dbeddba6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:40.787640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7168c41-7632-41b8-8f0d-1749bbb7b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:40.788295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7168c41-7632-41b8-8f0d-1749bbb7b8cf admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:40.788574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7168c41-7632-41b8-8f0d-1749bbb7b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:40.789526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7168c41-7632-41b8-8f0d-1749bbb7b8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:40.790870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7168c41-7632-41b8-8f0d-1749bbb7b8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:40.794206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7168c41-7632-41b8-8f0d-1749bbb7b8cf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:40.812480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba6776-7db5-4d3a-a5fa-e533dbeddba6 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:40.825313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:40.827183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:40.827903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:40.828632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/projects/20cf1c877fc24a28977be01b38a33915` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:40.833493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_project(project_id=20cf1c877fc24a28977be01b38a33915)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:40.847690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:40.884895 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2073/4110] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:40 2022] POST /identity/v3/projects => generated 389 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:40.886691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7168c41-7632-41b8-8f0d-1749bbb7b8cf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:41.044380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cf1c877fc24a28977be01b38a33915', 'request_id': 'req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.068165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cf1c877fc24a28977be01b38a33915', 'request_id': 'req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.079808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cf1c877fc24a28977be01b38a33915', 'request_id': 'req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.090687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:41.095795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7168c41-7632-41b8-8f0d-1749bbb7b8cf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:41.110355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] The token cache is being invalidate because project 20cf1c877fc24a28977be01b38a33915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:41.110658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.115165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.118386 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2038/4111] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:40 2022] DELETE /identity/v3/projects/20cf1c877fc24a28977be01b38a33915 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:41.124192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:41.125736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:41.391952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09778-9a67-4372-8086-c8bacb59c80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:41.392794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09778-9a67-4372-8086-c8bacb59c80c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:41.393243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09778-9a67-4372-8086-c8bacb59c80c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:41.393592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09778-9a67-4372-8086-c8bacb59c80c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:41.394422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d09778-9a67-4372-8086-c8bacb59c80c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:41.396985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d09778-9a67-4372-8086-c8bacb59c80c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:41.417063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca20d0-ef64-4199-8894-6aa3c48ab5dd tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:41.430655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:41.431463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:41.431670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:41.431932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/roles/2005113dfdd54067ba61c2324793d3df` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:41.434790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2005113dfdd54067ba61c2324793d3df)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:41.437784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:41.456329 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2074/4112] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:34:40 2022] POST /identity/v3/users => generated 295 bytes in 566 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:34:41.458151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09778-9a67-4372-8086-c8bacb59c80c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:41.460506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-03d09778-9a67-4372-8086-c8bacb59c80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:41.476093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:41.499277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09778-9a67-4372-8086-c8bacb59c80c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:41.525919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec185b2-ba6b-49f2-b581-9bde5a1cfcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:41.527025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec185b2-ba6b-49f2-b581-9bde5a1cfcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:41.527471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec185b2-ba6b-49f2-b581-9bde5a1cfcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:41.527946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec185b2-ba6b-49f2-b581-9bde5a1cfcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:41.528996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invalidating the token cache because role 2005113dfdd54067ba61c2324793d3df has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:41.529136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec185b2-ba6b-49f2-b581-9bde5a1cfcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:41.530061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.532087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.538560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec185b2-ba6b-49f2-b581-9bde5a1cfcc7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:41.538766 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2039/4113] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:41 2022] DELETE /identity/v3/roles/2005113dfdd54067ba61c2324793d3df => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:41.540537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:41.542378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:41.577924 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2075/4114] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:34:41.579921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec185b2-ba6b-49f2-b581-9bde5a1cfcc7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:41.584179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bec185b2-ba6b-49f2-b581-9bde5a1cfcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:41.657574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec185b2-ba6b-49f2-b581-9bde5a1cfcc7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:41.675666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b9913-ded8-4389-b9b5-f86bde1bb38b tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:41.688629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:41.689209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:41.689485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:41.689757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/users/415c624513b84fe99e6542c647cf2d3a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:41.691139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_user(user_id=415c624513b84fe99e6542c647cf2d3a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:41.694202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:41.799767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415c624513b84fe99e6542c647cf2d3a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.812717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415c624513b84fe99e6542c647cf2d3a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.851866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415c624513b84fe99e6542c647cf2d3a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.868615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415c624513b84fe99e6542c647cf2d3a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.870398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415c624513b84fe99e6542c647cf2d3a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:41.888829 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2040/4115] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:41 2022] DELETE /identity/v3/users/415c624513b84fe99e6542c647cf2d3a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:41.889035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:41.892807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:42.062729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba24f70-403f-4dea-b884-1b772e7a5826 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:42.080393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100ebc-923b-4469-ba2d-996b258228bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:42.081710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100ebc-923b-4469-ba2d-996b258228bd service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:42.082472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100ebc-923b-4469-ba2d-996b258228bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:42.083277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb100ebc-923b-4469-ba2d-996b258228bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:42.086982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fb100ebc-923b-4469-ba2d-996b258228bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:42.114681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb100ebc-923b-4469-ba2d-996b258228bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:42.119713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb100ebc-923b-4469-ba2d-996b258228bd service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:42.163654 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2041/4116] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:42.165543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100ebc-923b-4469-ba2d-996b258228bd service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:42.168059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fb100ebc-923b-4469-ba2d-996b258228bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:42.168273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09260ba-0db8-45d7-84ca-8cacde491c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:42.168987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09260ba-0db8-45d7-84ca-8cacde491c3d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:42.169459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09260ba-0db8-45d7-84ca-8cacde491c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:42.170032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09260ba-0db8-45d7-84ca-8cacde491c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:42.170824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09260ba-0db8-45d7-84ca-8cacde491c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:42.172793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09260ba-0db8-45d7-84ca-8cacde491c3d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:42.190447 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2076/4117] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:41 2022] GET /identity/v3/roles => generated 1420 bytes in 611 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:42.193756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09260ba-0db8-45d7-84ca-8cacde491c3d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:42.196106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:42.197017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c09260ba-0db8-45d7-84ca-8cacde491c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:42.231656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09260ba-0db8-45d7-84ca-8cacde491c3d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:42.341397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff634f7-6cd5-4bdf-b055-ec517b91834e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:42.342713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff634f7-6cd5-4bdf-b055-ec517b91834e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:42.343235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff634f7-6cd5-4bdf-b055-ec517b91834e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:42.343666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff634f7-6cd5-4bdf-b055-ec517b91834e admin admin] PATH_INFO: `/v3/projects/b27172c71ec04eaf8f6362422cab72a1/users/95df76be403a478aa03361450ea1b130/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:42.369863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb100ebc-923b-4469-ba2d-996b258228bd service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:42.371334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff634f7-6cd5-4bdf-b055-ec517b91834e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b27172c71ec04eaf8f6362422cab72a1, user_id=95df76be403a478aa03361450ea1b130, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:42.375635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de5a0a-920d-4423-bd0f-dcda42ef60c9 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:42.376660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de5a0a-920d-4423-bd0f-dcda42ef60c9 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:42.377139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de5a0a-920d-4423-bd0f-dcda42ef60c9 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:42.377622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff634f7-6cd5-4bdf-b055-ec517b91834e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:42.378331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de5a0a-920d-4423-bd0f-dcda42ef60c9 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/groups/a976f7f40d0e46038ad107c63ba3ef9e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:42.380928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de5a0a-920d-4423-bd0f-dcda42ef60c9 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a976f7f40d0e46038ad107c63ba3ef9e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:42.383719 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-09de5a0a-920d-4423-bd0f-dcda42ef60c9 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:42.383719 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:42.383719 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:42.386083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de5a0a-920d-4423-bd0f-dcda42ef60c9 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:42.406286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:42.432546 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2077/4118] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:42 2022] PUT /identity/v3/projects/b27172c71ec04eaf8f6362422cab72a1/users/95df76be403a478aa03361450ea1b130/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:42.439844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675cf8-26ec-439e-ab09-5c7ef4801047 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:42.440430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675cf8-26ec-439e-ab09-5c7ef4801047 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:42.441409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1675cf8-26ec-439e-ab09-5c7ef4801047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:42.504183 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2042/4119] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:34:42 2022] DELETE /identity/v3/groups/a976f7f40d0e46038ad107c63ba3ef9e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:42.508789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de5a0a-920d-4423-bd0f-dcda42ef60c9 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:42.512962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c1675cf8-26ec-439e-ab09-5c7ef4801047 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:42.516064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c1675cf8-26ec-439e-ab09-5c7ef4801047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:42.695303 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2078/4120] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:42.718440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de5a0a-920d-4423-bd0f-dcda42ef60c9 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:42.729080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:42.731397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:42.732026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:42.732667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/projects/2955da0d00724b6180b8cb4a1bb7a8d8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:42.735234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2955da0d00724b6180b8cb4a1bb7a8d8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:42.740530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:42.761246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1675cf8-26ec-439e-ab09-5c7ef4801047 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:42.764594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c1675cf8-26ec-439e-ab09-5c7ef4801047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:42.887415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2955da0d00724b6180b8cb4a1bb7a8d8', 'request_id': 'req-de543e89-ddd5-4884-a9e0-01eabb485c09'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:42.917347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2955da0d00724b6180b8cb4a1bb7a8d8', 'request_id': 'req-de543e89-ddd5-4884-a9e0-01eabb485c09'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:42.926722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1675cf8-26ec-439e-ab09-5c7ef4801047 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:42.941295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2955da0d00724b6180b8cb4a1bb7a8d8', 'request_id': 'req-de543e89-ddd5-4884-a9e0-01eabb485c09'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:42.961409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:42.979438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] The token cache is being invalidate because project 2955da0d00724b6180b8cb4a1bb7a8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:42.980121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:42.982352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:42.995302 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2043/4121] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:42 2022] DELETE /identity/v3/projects/2955da0d00724b6180b8cb4a1bb7a8d8 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:42.999596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:43.001765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:43.036369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bf92e-2a6d-45a7-9885-6a031944db4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:43.037998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bf92e-2a6d-45a7-9885-6a031944db4b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:43.037998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bf92e-2a6d-45a7-9885-6a031944db4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:43.042642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7bf92e-2a6d-45a7-9885-6a031944db4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:43.049217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9c7bf92e-2a6d-45a7-9885-6a031944db4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:43.232387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bf92e-2a6d-45a7-9885-6a031944db4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:43.234081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7bf92e-2a6d-45a7-9885-6a031944db4b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:43.258963 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2079/4122] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:43.360038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de543e89-ddd5-4884-a9e0-01eabb485c09 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:43.386104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:43.391717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:43.392543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:43.394617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/domains/ffa8a9ada3b34464babee81a63d7bdc0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:43.398041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ffa8a9ada3b34464babee81a63d7bdc0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:43.403193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:43.487245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:43.488539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:43.560640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:43.561768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:43.572644 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2044/4123] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:34:42 2022] PATCH /identity/v3/domains/ffa8a9ada3b34464babee81a63d7bdc0 => generated 276 bytes in 573 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:34:43.573843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bf92e-2a6d-45a7-9885-6a031944db4b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:43.588231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7bf92e-2a6d-45a7-9885-6a031944db4b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:43.601642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:43.806220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '233daff57aca43adbdc8676de10b4bf9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4eec521c03f34b1c8473e06056132ab9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:43.806928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:43.810094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:43.813768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] PATH_INFO: `/v3/domains/ffa8a9ada3b34464babee81a63d7bdc0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:43.843656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ffa8a9ada3b34464babee81a63d7bdc0)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:43.848325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:43.914829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:43.948685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.012420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0', 'request_id': 'req-f28d1345-df7b-4fc9-a0f1-bac696df14ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.023442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0', 'request_id': 'req-f28d1345-df7b-4fc9-a0f1-bac696df14ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.035759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0', 'request_id': 'req-f28d1345-df7b-4fc9-a0f1-bac696df14ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.076402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] The token cache is being invalidate because project ffa8a9ada3b34464babee81a63d7bdc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:44.078988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.080914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.100673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0', 'request_id': 'req-f28d1345-df7b-4fc9-a0f1-bac696df14ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.101714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0', 'request_id': 'req-f28d1345-df7b-4fc9-a0f1-bac696df14ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.102601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28d1345-df7b-4fc9-a0f1-bac696df14ae tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ffa8a9ada3b34464babee81a63d7bdc0', 'request_id': 'req-f28d1345-df7b-4fc9-a0f1-bac696df14ae'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.119123 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2080/4124] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:34:43 2022] DELETE /identity/v3/domains/ffa8a9ada3b34464babee81a63d7bdc0 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:44.121567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:44.125602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:44.342637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3c2a3-ffe8-4ffd-a8b5-aecfefe28fa8 tempest-InheritsV3TestJSON-494336905 tempest-InheritsV3TestJSON-494336905-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:44.495668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:44.496338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:44.499287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:44.499623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] PATH_INFO: `/v3/users/c0fb3c339ae4478186d3dc0c71a79a69` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:44.502908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0fb3c339ae4478186d3dc0c71a79a69)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:44.504985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:44.534168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:44.659650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0fb3c339ae4478186d3dc0c71a79a69'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.681793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0fb3c339ae4478186d3dc0c71a79a69'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.724258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0fb3c339ae4478186d3dc0c71a79a69'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.744422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0fb3c339ae4478186d3dc0c71a79a69'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.746346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0fb3c339ae4478186d3dc0c71a79a69'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:44.776254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1d4a-1939-4819-b083-56625a8d2abc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:44.777417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1d4a-1939-4819-b083-56625a8d2abc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:44.779056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec1d4a-1939-4819-b083-56625a8d2abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:44.784958 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2045/4125] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:44 2022] DELETE /identity/v3/users/c0fb3c339ae4478186d3dc0c71a79a69 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:44.830061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-26ec1d4a-1939-4819-b083-56625a8d2abc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:44.832406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-26ec1d4a-1939-4819-b083-56625a8d2abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:44.965657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:45.011124 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2081/4126] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:45.028213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:45.029821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:45.228167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5da3dc-c350-4b64-b37c-d4e908f86a72 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:45.240839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c70f73-ea33-43bb-9f39-b6e8f8193b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:45.243928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c70f73-ea33-43bb-9f39-b6e8f8193b76 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:45.244404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c70f73-ea33-43bb-9f39-b6e8f8193b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:45.244820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c70f73-ea33-43bb-9f39-b6e8f8193b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:45.268379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c70f73-ea33-43bb-9f39-b6e8f8193b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:45.272210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c70f73-ea33-43bb-9f39-b6e8f8193b76 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:45.300469 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2046/4127] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:46.288040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1d4a-1939-4819-b083-56625a8d2abc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:46.290429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-26ec1d4a-1939-4819-b083-56625a8d2abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:46.313279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec1d4a-1939-4819-b083-56625a8d2abc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:46.321310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:46.322250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:46.322666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:46.323435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] PATH_INFO: `/v3/projects/cf010c2c4643420d9f6aaa26ab54f732` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:46.324951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf010c2c4643420d9f6aaa26ab54f732)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:46.327261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:46.500877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf010c2c4643420d9f6aaa26ab54f732', 'request_id': 'req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:46.538046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf010c2c4643420d9f6aaa26ab54f732', 'request_id': 'req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:46.561068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf010c2c4643420d9f6aaa26ab54f732', 'request_id': 'req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:46.649257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] The token cache is being invalidate because project cf010c2c4643420d9f6aaa26ab54f732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:46.650806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:46.652912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:46.661769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2082/4128] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:46 2022] DELETE /identity/v3/projects/cf010c2c4643420d9f6aaa26ab54f732 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:46.664667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c70f73-ea33-43bb-9f39-b6e8f8193b76 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:46.681918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c70f73-ea33-43bb-9f39-b6e8f8193b76 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:46.819612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:46.820661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:46.821174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:46.821656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] PATH_INFO: `/v3/users/233daff57aca43adbdc8676de10b4bf9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:46.823302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=233daff57aca43adbdc8676de10b4bf9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:46.825559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:46.898710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:46.939199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233daff57aca43adbdc8676de10b4bf9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:46.956605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233daff57aca43adbdc8676de10b4bf9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:47.017210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233daff57aca43adbdc8676de10b4bf9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:47.040991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233daff57aca43adbdc8676de10b4bf9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:47.042607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5edc5be0-fbf2-444f-bd4a-0212d76b21f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233daff57aca43adbdc8676de10b4bf9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:47.068746 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2047/4129] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:46 2022] DELETE /identity/v3/users/233daff57aca43adbdc8676de10b4bf9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:47.794865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:47.796662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:47.844589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4aebea-5480-4e3a-a539-6e49a4c7c51a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:47.960580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:47.961735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:47.962324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:47.962912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] PATH_INFO: `/v3/projects/4eec521c03f34b1c8473e06056132ab9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:47.964735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eec521c03f34b1c8473e06056132ab9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:47.969815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:48.053550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eec521c03f34b1c8473e06056132ab9', 'request_id': 'req-c0a8751b-0109-4a65-9a48-910c03db981e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:48.067367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eec521c03f34b1c8473e06056132ab9', 'request_id': 'req-c0a8751b-0109-4a65-9a48-910c03db981e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:48.085398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eec521c03f34b1c8473e06056132ab9', 'request_id': 'req-c0a8751b-0109-4a65-9a48-910c03db981e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:48.102502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:48.111665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] The token cache is being invalidate because project 4eec521c03f34b1c8473e06056132ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:48.112501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:48.113802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0a8751b-0109-4a65-9a48-910c03db981e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:48.116461 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2083/4130] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:47 2022] DELETE /identity/v3/projects/4eec521c03f34b1c8473e06056132ab9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:48.121729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2c85-d31d-4978-bc83-95a982fd4b5e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:48.122794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2c85-d31d-4978-bc83-95a982fd4b5e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:48.123277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af2c85-d31d-4978-bc83-95a982fd4b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:48.171319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f9af2c85-d31d-4978-bc83-95a982fd4b5e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:48.173094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f9af2c85-d31d-4978-bc83-95a982fd4b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:48.357801 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2048/4131] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:34:48.366807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4d09-bdcf-4cd1-a2ae-bf213ce0d2ba None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:48.367251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4d09-bdcf-4cd1-a2ae-bf213ce0d2ba None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:48.367676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b4d09-bdcf-4cd1-a2ae-bf213ce0d2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:48.411261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6e3b4d09-bdcf-4cd1-a2ae-bf213ce0d2ba None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:48.419713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6e3b4d09-bdcf-4cd1-a2ae-bf213ce0d2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:48.435282 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2084/4132] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:48.439682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2c85-d31d-4978-bc83-95a982fd4b5e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:48.455998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af2c85-d31d-4978-bc83-95a982fd4b5e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:48.474938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b524ec-ce2d-4595-b8c6-2028b2af50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:48.475750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b524ec-ce2d-4595-b8c6-2028b2af50eb admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:48.489723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b524ec-ce2d-4595-b8c6-2028b2af50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:48.489723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b524ec-ce2d-4595-b8c6-2028b2af50eb admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:48.489723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b524ec-ce2d-4595-b8c6-2028b2af50eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:34:48.489723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b524ec-ce2d-4595-b8c6-2028b2af50eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:48.489723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b524ec-ce2d-4595-b8c6-2028b2af50eb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:48.520325 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2049/4133] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:48.521980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b4d09-bdcf-4cd1-a2ae-bf213ce0d2ba None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:48.536099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b4d09-bdcf-4cd1-a2ae-bf213ce0d2ba None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:48.550718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706ce85-849c-46ff-9f8c-91f00d007233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:48.551372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706ce85-849c-46ff-9f8c-91f00d007233 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:48.551649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706ce85-849c-46ff-9f8c-91f00d007233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:48.551912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706ce85-849c-46ff-9f8c-91f00d007233 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:48.552822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706ce85-849c-46ff-9f8c-91f00d007233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:48.558195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706ce85-849c-46ff-9f8c-91f00d007233 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:48.617248 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2085/4134] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:48 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:34:48.621223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b524ec-ce2d-4595-b8c6-2028b2af50eb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:48.636730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b524ec-ce2d-4595-b8c6-2028b2af50eb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:48.728008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52654cb9-764f-4cce-9a6a-c50c61b4bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:48.728630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654cb9-764f-4cce-9a6a-c50c61b4bb83 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:48.728909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654cb9-764f-4cce-9a6a-c50c61b4bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:48.729223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654cb9-764f-4cce-9a6a-c50c61b4bb83 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:48.730002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52654cb9-764f-4cce-9a6a-c50c61b4bb83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:48.732109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52654cb9-764f-4cce-9a6a-c50c61b4bb83 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:48.776280 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2050/4135] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:34:48 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:48.778977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706ce85-849c-46ff-9f8c-91f00d007233 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:48.796999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706ce85-849c-46ff-9f8c-91f00d007233 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:48.804309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71c6cb-ba21-4aeb-a06e-f69413fc0250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:48.805468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71c6cb-ba21-4aeb-a06e-f69413fc0250 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:48.806014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71c6cb-ba21-4aeb-a06e-f69413fc0250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:48.806502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71c6cb-ba21-4aeb-a06e-f69413fc0250 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:48.808059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71c6cb-ba21-4aeb-a06e-f69413fc0250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:48.810254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71c6cb-ba21-4aeb-a06e-f69413fc0250 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:48.835170 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2086/4136] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:48.839540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52654cb9-764f-4cce-9a6a-c50c61b4bb83 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:48.868391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52654cb9-764f-4cce-9a6a-c50c61b4bb83 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:48.891546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8210af-7f71-4d95-b2d8-f10ef0a7701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:48.892183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8210af-7f71-4d95-b2d8-f10ef0a7701c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:48.892473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8210af-7f71-4d95-b2d8-f10ef0a7701c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:48.892749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8210af-7f71-4d95-b2d8-f10ef0a7701c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:48.912485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8210af-7f71-4d95-b2d8-f10ef0a7701c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:48.915946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8210af-7f71-4d95-b2d8-f10ef0a7701c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:48.992566 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2051/4137] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:48.994026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71c6cb-ba21-4aeb-a06e-f69413fc0250 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:49.021330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71c6cb-ba21-4aeb-a06e-f69413fc0250 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:49.034669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d1f01-4bb1-4a7c-b328-3596e43a1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:49.035368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d1f01-4bb1-4a7c-b328-3596e43a1f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:49.035647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d1f01-4bb1-4a7c-b328-3596e43a1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:49.035928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d1f01-4bb1-4a7c-b328-3596e43a1f09 admin admin] PATH_INFO: `/v3/projects/11ec0a8789954f3e92a09abbdf8b7bf4/users/3453ef676beb442fb1dde67a3e9bc4a3/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:49.102963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d1f01-4bb1-4a7c-b328-3596e43a1f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ec0a8789954f3e92a09abbdf8b7bf4, user_id=3453ef676beb442fb1dde67a3e9bc4a3, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:49.105930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d1f01-4bb1-4a7c-b328-3596e43a1f09 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:49.138788 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2087/4138] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:48 2022] PUT /identity/v3/projects/11ec0a8789954f3e92a09abbdf8b7bf4/users/3453ef676beb442fb1dde67a3e9bc4a3/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:49.163543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd0c6-38b2-4e39-a5af-431e3a03bb81 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:49.164374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd0c6-38b2-4e39-a5af-431e3a03bb81 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:49.164374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddd0c6-38b2-4e39-a5af-431e3a03bb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:49.235830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-86ddd0c6-38b2-4e39-a5af-431e3a03bb81 None None] MFA Rules not processed for user `3453ef676beb442fb1dde67a3e9bc4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:49.237470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-86ddd0c6-38b2-4e39-a5af-431e3a03bb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:49.250958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:49.396301 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2052/4139] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:49.403952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d1f01-4bb1-4a7c-b328-3596e43a1f09 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:49.552768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d1f01-4bb1-4a7c-b328-3596e43a1f09 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:49.564434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a059e7-0d8e-475b-80f5-8b29d4d62f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:49.565083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a059e7-0d8e-475b-80f5-8b29d4d62f38 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:49.565363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a059e7-0d8e-475b-80f5-8b29d4d62f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:49.565635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a059e7-0d8e-475b-80f5-8b29d4d62f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:49.566915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a059e7-0d8e-475b-80f5-8b29d4d62f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:49.578687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a059e7-0d8e-475b-80f5-8b29d4d62f38 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:49.625992 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2088/4140] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:34:49 2022] POST /identity/v3/projects => generated 367 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:49.631519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd0c6-38b2-4e39-a5af-431e3a03bb81 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:49.651922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddd0c6-38b2-4e39-a5af-431e3a03bb81 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:49.779503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b19131-b3d4-4e16-a138-b8e8f72908fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:49.780081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b19131-b3d4-4e16-a138-b8e8f72908fa admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:49.780366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b19131-b3d4-4e16-a138-b8e8f72908fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:49.780642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b19131-b3d4-4e16-a138-b8e8f72908fa admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:49.781306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b19131-b3d4-4e16-a138-b8e8f72908fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:49.783471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b19131-b3d4-4e16-a138-b8e8f72908fa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:49.819073 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2053/4141] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:34:49 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:49.824592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a059e7-0d8e-475b-80f5-8b29d4d62f38 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:49.854124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a059e7-0d8e-475b-80f5-8b29d4d62f38 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:49.866729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04d588-dfe8-484b-9c3f-4aa05b4c6e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:49.867443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04d588-dfe8-484b-9c3f-4aa05b4c6e2b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:49.867725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04d588-dfe8-484b-9c3f-4aa05b4c6e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:49.867996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04d588-dfe8-484b-9c3f-4aa05b4c6e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:49.868829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04d588-dfe8-484b-9c3f-4aa05b4c6e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:49.872562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04d588-dfe8-484b-9c3f-4aa05b4c6e2b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:49.904895 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2089/4142] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:34:49.906282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b19131-b3d4-4e16-a138-b8e8f72908fa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:49.925738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b19131-b3d4-4e16-a138-b8e8f72908fa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:49.936149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ba169-fdad-4ee1-8665-28368190478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:49.936852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ba169-fdad-4ee1-8665-28368190478e admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:49.937132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ba169-fdad-4ee1-8665-28368190478e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:49.937641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ba169-fdad-4ee1-8665-28368190478e admin admin] PATH_INFO: `/v3/projects/6db285936ec8444bade2095eb8b6eb49/users/32e2d941a84b4242af81e5b94487fe7a/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:50.004456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ba169-fdad-4ee1-8665-28368190478e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db285936ec8444bade2095eb8b6eb49, user_id=32e2d941a84b4242af81e5b94487fe7a, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:50.015832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ba169-fdad-4ee1-8665-28368190478e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:50.056704 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2054/4143] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:49 2022] PUT /identity/v3/projects/6db285936ec8444bade2095eb8b6eb49/users/32e2d941a84b4242af81e5b94487fe7a/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:50.061005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04d588-dfe8-484b-9c3f-4aa05b4c6e2b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:50.080348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04d588-dfe8-484b-9c3f-4aa05b4c6e2b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:50.304766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a6ed6-d357-482c-ac4c-e8483489d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:50.305994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6ed6-d357-482c-ac4c-e8483489d035 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:50.306181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6ed6-d357-482c-ac4c-e8483489d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:50.306410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a6ed6-d357-482c-ac4c-e8483489d035 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:50.307072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a6ed6-d357-482c-ac4c-e8483489d035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:50.308765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a6ed6-d357-482c-ac4c-e8483489d035 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:50.341322 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2090/4144] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:34:50.342835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ba169-fdad-4ee1-8665-28368190478e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:50.361192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ba169-fdad-4ee1-8665-28368190478e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:50.377767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862729cd-481e-4525-96e0-93348d646129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:50.378727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862729cd-481e-4525-96e0-93348d646129 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:50.379156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862729cd-481e-4525-96e0-93348d646129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:50.379574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862729cd-481e-4525-96e0-93348d646129 admin admin] PATH_INFO: `/v3/projects/6db285936ec8444bade2095eb8b6eb49/users/32e2d941a84b4242af81e5b94487fe7a/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:50.386459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862729cd-481e-4525-96e0-93348d646129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db285936ec8444bade2095eb8b6eb49, user_id=32e2d941a84b4242af81e5b94487fe7a, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:50.395404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862729cd-481e-4525-96e0-93348d646129 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:50.438437 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2055/4145] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:34:50 2022] PUT /identity/v3/projects/6db285936ec8444bade2095eb8b6eb49/users/32e2d941a84b4242af81e5b94487fe7a/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:50.456396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac71e-a8ed-4962-a878-857b65a14ddb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:50.456630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac71e-a8ed-4962-a878-857b65a14ddb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:50.456905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aac71e-a8ed-4962-a878-857b65a14ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:50.470614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:50.542412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-51aac71e-a8ed-4962-a878-857b65a14ddb None None] MFA Rules not processed for user `32e2d941a84b4242af81e5b94487fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:50.543976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51aac71e-a8ed-4962-a878-857b65a14ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:50.799088 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2091/4146] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:50.804517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862729cd-481e-4525-96e0-93348d646129 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:50.831835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862729cd-481e-4525-96e0-93348d646129 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:50.853267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4e2e-7860-4d97-a272-c27545ef3322 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:50.853758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4e2e-7860-4d97-a272-c27545ef3322 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:50.854244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4e2e-7860-4d97-a272-c27545ef3322 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:50.854790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4e2e-7860-4d97-a272-c27545ef3322 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:50.856146 n-d-820368-36 devstack@keystone.service[82099]: WARNING oslo_log.versionutils [None req-b73a4e2e-7860-4d97-a272-c27545ef3322 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 30 04:34:50.856843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a4e2e-7860-4d97-a272-c27545ef3322 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:50.858329 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-b73a4e2e-7860-4d97-a272-c27545ef3322 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:50.858329 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:50.858329 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:50.867196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a4e2e-7860-4d97-a272-c27545ef3322 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:50.881718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aac71e-a8ed-4962-a878-857b65a14ddb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:50.890628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51aac71e-a8ed-4962-a878-857b65a14ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:50.961411 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2056/4147] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:34:50 2022] POST /identity/v3/policies => generated 230 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:50.967194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4e2e-7860-4d97-a272-c27545ef3322 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:51.012028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4e2e-7860-4d97-a272-c27545ef3322 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:51.057740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d76a21-cd9f-47e6-87ff-9cdd0eb6735f tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:51.058465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d76a21-cd9f-47e6-87ff-9cdd0eb6735f tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:51.058744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d76a21-cd9f-47e6-87ff-9cdd0eb6735f tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:51.059018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d76a21-cd9f-47e6-87ff-9cdd0eb6735f tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies/918a12a0c320468e85decc65bf74f314` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:51.059996 n-d-820368-36 devstack@keystone.service[82099]: WARNING oslo_log.versionutils [None req-f2d76a21-cd9f-47e6-87ff-9cdd0eb6735f tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 30 04:34:51.060521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d76a21-cd9f-47e6-87ff-9cdd0eb6735f tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=918a12a0c320468e85decc65bf74f314)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:51.061838 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-f2d76a21-cd9f-47e6-87ff-9cdd0eb6735f tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:51.061838 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:51.061838 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:51.074877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d76a21-cd9f-47e6-87ff-9cdd0eb6735f tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:51.155482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aac71e-a8ed-4962-a878-857b65a14ddb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:51.156996 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2057/4148] 10.222.0.43 () {60 vars in 1252 bytes} [Tue Aug 30 04:34:50 2022] PATCH /identity/v3/policies/918a12a0c320468e85decc65bf74f314 => generated 236 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:51.159952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d76a21-cd9f-47e6-87ff-9cdd0eb6735f tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:51.170759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f37ad6-991f-406c-97b2-e50d1741be49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:51.171415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f37ad6-991f-406c-97b2-e50d1741be49 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:51.178357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f37ad6-991f-406c-97b2-e50d1741be49 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:51.178357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f37ad6-991f-406c-97b2-e50d1741be49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:51.195455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-82f37ad6-991f-406c-97b2-e50d1741be49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:51.205744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d76a21-cd9f-47e6-87ff-9cdd0eb6735f tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:51.234215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e596b-88e0-4414-89f2-3246610319d5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:51.234451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e596b-88e0-4414-89f2-3246610319d5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:51.234647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e596b-88e0-4414-89f2-3246610319d5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:51.234928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e596b-88e0-4414-89f2-3246610319d5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies/918a12a0c320468e85decc65bf74f314` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:51.235778 n-d-820368-36 devstack@keystone.service[82099]: WARNING oslo_log.versionutils [None req-095e596b-88e0-4414-89f2-3246610319d5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 30 04:34:51.236342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e596b-88e0-4414-89f2-3246610319d5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=918a12a0c320468e85decc65bf74f314)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:51.237649 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-095e596b-88e0-4414-89f2-3246610319d5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:51.237649 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:51.237649 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:51.258036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e596b-88e0-4414-89f2-3246610319d5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:51.283144 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2058/4149] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:34:51 2022] GET /identity/v3/policies/918a12a0c320468e85decc65bf74f314 => generated 236 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:51.293143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e596b-88e0-4414-89f2-3246610319d5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:51.322457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e596b-88e0-4414-89f2-3246610319d5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:51.333425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4d46c-fa0f-4b61-b4a9-ad32ea6336b6 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:51.334811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4d46c-fa0f-4b61-b4a9-ad32ea6336b6 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:51.335301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4d46c-fa0f-4b61-b4a9-ad32ea6336b6 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:51.335719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4d46c-fa0f-4b61-b4a9-ad32ea6336b6 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies/918a12a0c320468e85decc65bf74f314` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:51.337045 n-d-820368-36 devstack@keystone.service[82099]: WARNING oslo_log.versionutils [None req-21f4d46c-fa0f-4b61-b4a9-ad32ea6336b6 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 30 04:34:51.337786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4d46c-fa0f-4b61-b4a9-ad32ea6336b6 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=918a12a0c320468e85decc65bf74f314)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:51.339511 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-21f4d46c-fa0f-4b61-b4a9-ad32ea6336b6 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:51.339511 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:51.339511 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:51.340764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4d46c-fa0f-4b61-b4a9-ad32ea6336b6 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:51.365205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2059/4150] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:51 2022] DELETE /identity/v3/policies/918a12a0c320468e85decc65bf74f314 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:51.374993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4d46c-fa0f-4b61-b4a9-ad32ea6336b6 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:51.385195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:51.391300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4d46c-fa0f-4b61-b4a9-ad32ea6336b6 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:51.401978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed15c8e-4942-4f2f-a919-9f18a5079bf5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:51.404031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed15c8e-4942-4f2f-a919-9f18a5079bf5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:51.404897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed15c8e-4942-4f2f-a919-9f18a5079bf5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:51.405564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed15c8e-4942-4f2f-a919-9f18a5079bf5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:51.410834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed15c8e-4942-4f2f-a919-9f18a5079bf5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:51.420339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed15c8e-4942-4f2f-a919-9f18a5079bf5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:51.487044 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2060/4151] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:34:51 2022] POST /identity/v3/policies => generated 229 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:51.492370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed15c8e-4942-4f2f-a919-9f18a5079bf5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:51.512329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed15c8e-4942-4f2f-a919-9f18a5079bf5 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:51.526748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc82b-09d6-413b-a27c-4be5b498f074 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:51.527797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc82b-09d6-413b-a27c-4be5b498f074 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:51.528309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc82b-09d6-413b-a27c-4be5b498f074 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:51.528796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc82b-09d6-413b-a27c-4be5b498f074 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:51.530419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdc82b-09d6-413b-a27c-4be5b498f074 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:51.543095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f37ad6-991f-406c-97b2-e50d1741be49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:51.544338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f37ad6-991f-406c-97b2-e50d1741be49 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:51.548014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdc82b-09d6-413b-a27c-4be5b498f074 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:51.573477 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2092/4152] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:51.592867 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2061/4153] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:34:51 2022] POST /identity/v3/policies => generated 228 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:51.597055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f37ad6-991f-406c-97b2-e50d1741be49 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:51.621725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f37ad6-991f-406c-97b2-e50d1741be49 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:51.632625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df8fdb-4202-4d23-993b-fe2e1f1f1169 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:51.633294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df8fdb-4202-4d23-993b-fe2e1f1f1169 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:51.634068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df8fdb-4202-4d23-993b-fe2e1f1f1169 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:51.634368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df8fdb-4202-4d23-993b-fe2e1f1f1169 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:51.635394 n-d-820368-36 devstack@keystone.service[82098]: WARNING oslo_log.versionutils [None req-24df8fdb-4202-4d23-993b-fe2e1f1f1169 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 30 04:34:51.635900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df8fdb-4202-4d23-993b-fe2e1f1f1169 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:51.638684 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-24df8fdb-4202-4d23-993b-fe2e1f1f1169 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:51.638684 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:34:51.638684 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:34:51.639625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df8fdb-4202-4d23-993b-fe2e1f1f1169 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:51.717622 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2093/4154] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:34:51 2022] POST /identity/v3/policies => generated 229 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:34:51.724003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc82b-09d6-413b-a27c-4be5b498f074 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:51.739946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc82b-09d6-413b-a27c-4be5b498f074 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:51.756543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4cea4-afe9-4aba-bdb8-4b728b1bfbd9 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:51.758515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4cea4-afe9-4aba-bdb8-4b728b1bfbd9 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:51.760276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4cea4-afe9-4aba-bdb8-4b728b1bfbd9 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:51.760835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4cea4-afe9-4aba-bdb8-4b728b1bfbd9 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:51.762160 n-d-820368-36 devstack@keystone.service[82099]: WARNING oslo_log.versionutils [None req-8dd4cea4-afe9-4aba-bdb8-4b728b1bfbd9 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 30 04:34:51.764037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4cea4-afe9-4aba-bdb8-4b728b1bfbd9 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:51.768322 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-8dd4cea4-afe9-4aba-bdb8-4b728b1bfbd9 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:51.768322 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:34:51.768322 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:34:51.770464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4cea4-afe9-4aba-bdb8-4b728b1bfbd9 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:51.797639 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2062/4155] 10.222.0.43 () {58 vars in 1131 bytes} [Tue Aug 30 04:34:51 2022] GET /identity/v3/policies => generated 762 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:34:51.800441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df8fdb-4202-4d23-993b-fe2e1f1f1169 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:51.822516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df8fdb-4202-4d23-993b-fe2e1f1f1169 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:51.850920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfce758-4459-4f87-bd20-c9107592274c tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:51.851602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce758-4459-4f87-bd20-c9107592274c tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:51.851904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce758-4459-4f87-bd20-c9107592274c tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:51.852202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfce758-4459-4f87-bd20-c9107592274c tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies/c1237af307f24beba27b311dd1d492d6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:51.867149 n-d-820368-36 devstack@keystone.service[82098]: WARNING oslo_log.versionutils [None req-8cfce758-4459-4f87-bd20-c9107592274c tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 30 04:34:51.868990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfce758-4459-4f87-bd20-c9107592274c tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=c1237af307f24beba27b311dd1d492d6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:51.870745 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-8cfce758-4459-4f87-bd20-c9107592274c tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:34:51.870745 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:34:51.870745 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:34:51.875957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfce758-4459-4f87-bd20-c9107592274c tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:51.950674 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2094/4156] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:51 2022] DELETE /identity/v3/policies/c1237af307f24beba27b311dd1d492d6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:51.951354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4cea4-afe9-4aba-bdb8-4b728b1bfbd9 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:51.967363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4cea4-afe9-4aba-bdb8-4b728b1bfbd9 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:51.988883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ffade-f19a-40df-bc4c-6a075e391796 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:51.989964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffade-f19a-40df-bc4c-6a075e391796 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:51.989964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffade-f19a-40df-bc4c-6a075e391796 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:51.990266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffade-f19a-40df-bc4c-6a075e391796 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies/6270d9f5f2ad4bbdaba0aa367d72ff42` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:51.992535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ffade-f19a-40df-bc4c-6a075e391796 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=6270d9f5f2ad4bbdaba0aa367d72ff42)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:51.996065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ffade-f19a-40df-bc4c-6a075e391796 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:52.037454 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2063/4157] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:51 2022] DELETE /identity/v3/policies/6270d9f5f2ad4bbdaba0aa367d72ff42 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:52.040564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfce758-4459-4f87-bd20-c9107592274c tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:52.066650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfce758-4459-4f87-bd20-c9107592274c tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:52.082170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171cbf7-e39c-494b-9596-882ca570a767 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e2d941a84b4242af81e5b94487fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6db285936ec8444bade2095eb8b6eb49', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:52.086338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171cbf7-e39c-494b-9596-882ca570a767 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:52.086945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171cbf7-e39c-494b-9596-882ca570a767 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:52.087427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171cbf7-e39c-494b-9596-882ca570a767 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] PATH_INFO: `/v3/policies/e01460f234604293b66e139d97812989` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:52.090608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171cbf7-e39c-494b-9596-882ca570a767 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=e01460f234604293b66e139d97812989)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:52.094829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171cbf7-e39c-494b-9596-882ca570a767 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:52.101525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:52.151582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ffade-f19a-40df-bc4c-6a075e391796 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:52.152194 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2095/4158] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:52 2022] DELETE /identity/v3/policies/e01460f234604293b66e139d97812989 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:52.172805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ffade-f19a-40df-bc4c-6a075e391796 tempest-PoliciesTestJSON-124032065 tempest-PoliciesTestJSON-124032065-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:52.189431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:52.190290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:52.190664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:52.191038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] PATH_INFO: `/v3/users/3453ef676beb442fb1dde67a3e9bc4a3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:52.195824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3453ef676beb442fb1dde67a3e9bc4a3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:52.198213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:52.381289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3453ef676beb442fb1dde67a3e9bc4a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:52.409756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3453ef676beb442fb1dde67a3e9bc4a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:52.460758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3453ef676beb442fb1dde67a3e9bc4a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:52.499192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3453ef676beb442fb1dde67a3e9bc4a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:52.501377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3453ef676beb442fb1dde67a3e9bc4a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:52.564955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d6efc-ff40-45ea-b5d8-d120cd3539d7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:52.565511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d6efc-ff40-45ea-b5d8-d120cd3539d7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:52.566031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d6efc-ff40-45ea-b5d8-d120cd3539d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:52.571353 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2064/4159] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:52 2022] DELETE /identity/v3/users/3453ef676beb442fb1dde67a3e9bc4a3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:34:52.711972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-832d6efc-ff40-45ea-b5d8-d120cd3539d7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:52.729690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-832d6efc-ff40-45ea-b5d8-d120cd3539d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:52.992145 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2096/4160] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:34:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:53.046850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:53.050941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:53.271485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5057b-dcc7-4dfd-9046-41d23dcfc101 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:53.281799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d106f97-42d3-4da1-b4d1-26ddf9ed787a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:53.282479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d106f97-42d3-4da1-b4d1-26ddf9ed787a service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:53.282751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d106f97-42d3-4da1-b4d1-26ddf9ed787a service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:53.283016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d106f97-42d3-4da1-b4d1-26ddf9ed787a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:53.319766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d106f97-42d3-4da1-b4d1-26ddf9ed787a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:53.321692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d106f97-42d3-4da1-b4d1-26ddf9ed787a service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:53.340461 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2065/4161] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:54.854676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d6efc-ff40-45ea-b5d8-d120cd3539d7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:54.858116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-832d6efc-ff40-45ea-b5d8-d120cd3539d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:54.898749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d6efc-ff40-45ea-b5d8-d120cd3539d7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:54.917072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:54.918223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:54.918697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:54.919170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] PATH_INFO: `/v3/projects/11ec0a8789954f3e92a09abbdf8b7bf4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:54.926303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ec0a8789954f3e92a09abbdf8b7bf4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:54.949266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:55.161182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ec0a8789954f3e92a09abbdf8b7bf4', 'request_id': 'req-3c74deec-b3d2-4790-9701-7424be47acb3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:55.174284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ec0a8789954f3e92a09abbdf8b7bf4', 'request_id': 'req-3c74deec-b3d2-4790-9701-7424be47acb3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:55.193674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ec0a8789954f3e92a09abbdf8b7bf4', 'request_id': 'req-3c74deec-b3d2-4790-9701-7424be47acb3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:55.220974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] The token cache is being invalidate because project 11ec0a8789954f3e92a09abbdf8b7bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:34:55.221279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:55.222182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:55.230679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d106f97-42d3-4da1-b4d1-26ddf9ed787a service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:55.231430 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2097/4162] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:54 2022] DELETE /identity/v3/projects/11ec0a8789954f3e92a09abbdf8b7bf4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:55.248328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d106f97-42d3-4da1-b4d1-26ddf9ed787a service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:55.300842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:55.406916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:55.408386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:55.409051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:55.409853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] PATH_INFO: `/v3/users/32e2d941a84b4242af81e5b94487fe7a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:55.420707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e2d941a84b4242af81e5b94487fe7a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:55.426796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:55.577085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e2d941a84b4242af81e5b94487fe7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:55.601521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e2d941a84b4242af81e5b94487fe7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:55.676913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e2d941a84b4242af81e5b94487fe7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:55.707000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e2d941a84b4242af81e5b94487fe7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:55.707944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d1331b39-bbc7-4609-87b2-72dfae7f7b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e2d941a84b4242af81e5b94487fe7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:34:55.748254 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2066/4163] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:34:55 2022] DELETE /identity/v3/users/32e2d941a84b4242af81e5b94487fe7a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:34:55.774569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:55.776151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:56.048142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74deec-b3d2-4790-9701-7424be47acb3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:56.106101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:56.342112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2af7f-d198-44bf-b4b3-e409a311cb3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:56.342804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2af7f-d198-44bf-b4b3-e409a311cb3d service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:56.343092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2af7f-d198-44bf-b4b3-e409a311cb3d service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:56.343365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2af7f-d198-44bf-b4b3-e409a311cb3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:56.355488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-49f2af7f-d198-44bf-b4b3-e409a311cb3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:56.380946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2af7f-d198-44bf-b4b3-e409a311cb3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:56.388006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2af7f-d198-44bf-b4b3-e409a311cb3d service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:56.414631 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2098/4164] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:34:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:34:56.478145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484ed6-5f38-49d9-9c41-f6b2c0cff741 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:56.478692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484ed6-5f38-49d9-9c41-f6b2c0cff741 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:56.478692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd484ed6-5f38-49d9-9c41-f6b2c0cff741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:56.737156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bd484ed6-5f38-49d9-9c41-f6b2c0cff741 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:34:56.738656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bd484ed6-5f38-49d9-9c41-f6b2c0cff741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:57.010301 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2067/4165] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:34:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 532 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:34:57.046395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2af7f-d198-44bf-b4b3-e409a311cb3d service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:57.048295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-49f2af7f-d198-44bf-b4b3-e409a311cb3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:57.351055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2af7f-d198-44bf-b4b3-e409a311cb3d service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:57.370641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074a54c-e72a-4f45-bf3f-728c9bf97387 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:57.372654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a54c-e72a-4f45-bf3f-728c9bf97387 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:57.373282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a54c-e72a-4f45-bf3f-728c9bf97387 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:57.375071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a54c-e72a-4f45-bf3f-728c9bf97387 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:57.429521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074a54c-e72a-4f45-bf3f-728c9bf97387 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:57.431181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074a54c-e72a-4f45-bf3f-728c9bf97387 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:34:57.468508 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2099/4166] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:34:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:59.762872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484ed6-5f38-49d9-9c41-f6b2c0cff741 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:34:59.764767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bd484ed6-5f38-49d9-9c41-f6b2c0cff741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:34:59.816280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:59.949143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd484ed6-5f38-49d9-9c41-f6b2c0cff741 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:34:59.967016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:34:59.967819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:34:59.968203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:34:59.968576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] PATH_INFO: `/v3/projects/6db285936ec8444bade2095eb8b6eb49` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:34:59.970077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db285936ec8444bade2095eb8b6eb49)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:34:59.972512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:00.109931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db285936ec8444bade2095eb8b6eb49', 'request_id': 'req-a87ce9af-3327-430d-8dbc-d76039f72bda'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:00.137405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db285936ec8444bade2095eb8b6eb49', 'request_id': 'req-a87ce9af-3327-430d-8dbc-d76039f72bda'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:00.148487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db285936ec8444bade2095eb8b6eb49', 'request_id': 'req-a87ce9af-3327-430d-8dbc-d76039f72bda'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:00.176202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] The token cache is being invalidate because project 6db285936ec8444bade2095eb8b6eb49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:00.176663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:00.178217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a87ce9af-3327-430d-8dbc-d76039f72bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:00.182388 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2068/4167] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:34:59 2022] DELETE /identity/v3/projects/6db285936ec8444bade2095eb8b6eb49 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:00.191020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547e7d-48c8-4115-bded-03529d013699 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:00.191492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547e7d-48c8-4115-bded-03529d013699 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:00.191586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0547e7d-48c8-4115-bded-03529d013699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:00.260805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c0547e7d-48c8-4115-bded-03529d013699 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:00.262335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c0547e7d-48c8-4115-bded-03529d013699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:00.562387 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2100/4168] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:00.566366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ba75-9de0-454a-8776-2745b0121603 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:00.567082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ba75-9de0-454a-8776-2745b0121603 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:00.567900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2ba75-9de0-454a-8776-2745b0121603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:00.671172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4ef2ba75-9de0-454a-8776-2745b0121603 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:00.672558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4ef2ba75-9de0-454a-8776-2745b0121603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:00.705189 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2069/4169] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:00.710035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547e7d-48c8-4115-bded-03529d013699 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:00.730607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0547e7d-48c8-4115-bded-03529d013699 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:00.742533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adede98-b056-4186-bd03-2a19c78d6446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:00.743646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adede98-b056-4186-bd03-2a19c78d6446 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:00.744260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adede98-b056-4186-bd03-2a19c78d6446 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:00.744735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adede98-b056-4186-bd03-2a19c78d6446 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:00.745664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adede98-b056-4186-bd03-2a19c78d6446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:00.746210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adede98-b056-4186-bd03-2a19c78d6446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:00.748216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adede98-b056-4186-bd03-2a19c78d6446 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:00.764180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:00.777557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ba75-9de0-454a-8776-2745b0121603 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:00.780897 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2101/4170] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:00.796902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2ba75-9de0-454a-8776-2745b0121603 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:00.813250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbe47c-8b5d-440c-aabe-aba2eeb360d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:00.818226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbe47c-8b5d-440c-aabe-aba2eeb360d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:00.819543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbe47c-8b5d-440c-aabe-aba2eeb360d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:00.820153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbe47c-8b5d-440c-aabe-aba2eeb360d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:00.821206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbe47c-8b5d-440c-aabe-aba2eeb360d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:00.839729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbe47c-8b5d-440c-aabe-aba2eeb360d4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:00.943273 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2070/4171] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:00 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:00.946890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adede98-b056-4186-bd03-2a19c78d6446 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:00.966940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adede98-b056-4186-bd03-2a19c78d6446 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:01.115903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730d77c-7b03-4ccb-97a5-007963bb0f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:01.116571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d77c-7b03-4ccb-97a5-007963bb0f70 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:01.116866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d77c-7b03-4ccb-97a5-007963bb0f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:01.117127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d77c-7b03-4ccb-97a5-007963bb0f70 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:01.117796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730d77c-7b03-4ccb-97a5-007963bb0f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:01.121705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730d77c-7b03-4ccb-97a5-007963bb0f70 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:01.184116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbe47c-8b5d-440c-aabe-aba2eeb360d4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:01.186061 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2102/4172] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:00 2022] POST /identity/v3/users => generated 285 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:01.198902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbe47c-8b5d-440c-aabe-aba2eeb360d4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:01.213889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20cfb3-0cdb-43b1-8793-90d4092c1b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:01.214528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20cfb3-0cdb-43b1-8793-90d4092c1b67 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:01.214804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20cfb3-0cdb-43b1-8793-90d4092c1b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:01.215071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20cfb3-0cdb-43b1-8793-90d4092c1b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:01.215740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20cfb3-0cdb-43b1-8793-90d4092c1b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:01.217401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a20cfb3-0cdb-43b1-8793-90d4092c1b67 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:01.253263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730d77c-7b03-4ccb-97a5-007963bb0f70 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:01.255529 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2071/4173] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:01.276670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730d77c-7b03-4ccb-97a5-007963bb0f70 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:01.296578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759fe3e-7231-4b8b-aaf4-2864eae8476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:01.297246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759fe3e-7231-4b8b-aaf4-2864eae8476b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:01.297500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759fe3e-7231-4b8b-aaf4-2864eae8476b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:01.297951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759fe3e-7231-4b8b-aaf4-2864eae8476b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:01.298615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759fe3e-7231-4b8b-aaf4-2864eae8476b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:01.306029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759fe3e-7231-4b8b-aaf4-2864eae8476b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:01.335392 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2103/4174] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:01.339688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20cfb3-0cdb-43b1-8793-90d4092c1b67 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:01.357440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20cfb3-0cdb-43b1-8793-90d4092c1b67 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:01.387458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5e8fb-765c-4261-8115-fab7f405bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:01.392870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5e8fb-765c-4261-8115-fab7f405bcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:01.394265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5e8fb-765c-4261-8115-fab7f405bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:01.396540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5e8fb-765c-4261-8115-fab7f405bcdb admin admin] PATH_INFO: `/v3/projects/813aaa5b597c435ba0b248a545e3b273/users/ff1702c1a902465cb89d25177611355b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:01.452910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5e8fb-765c-4261-8115-fab7f405bcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=813aaa5b597c435ba0b248a545e3b273, user_id=ff1702c1a902465cb89d25177611355b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:01.469115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5e8fb-765c-4261-8115-fab7f405bcdb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:01.513614 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2072/4175] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:01 2022] PUT /identity/v3/projects/813aaa5b597c435ba0b248a545e3b273/users/ff1702c1a902465cb89d25177611355b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:01.525712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247367fd-3705-41fd-8d96-c64c638c5cbe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:01.526297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247367fd-3705-41fd-8d96-c64c638c5cbe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:01.526705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247367fd-3705-41fd-8d96-c64c638c5cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:01.584765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-247367fd-3705-41fd-8d96-c64c638c5cbe None None] MFA Rules not processed for user `ff1702c1a902465cb89d25177611355b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:01.593311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-247367fd-3705-41fd-8d96-c64c638c5cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:01.817549 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2104/4176] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:01.822610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5e8fb-765c-4261-8115-fab7f405bcdb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:01.836628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5e8fb-765c-4261-8115-fab7f405bcdb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:01.852098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667cd2d-022b-4dd0-92af-f03bbc971b0c tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff1702c1a902465cb89d25177611355b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813aaa5b597c435ba0b248a545e3b273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:01.853270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667cd2d-022b-4dd0-92af-f03bbc971b0c tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:01.853782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667cd2d-022b-4dd0-92af-f03bbc971b0c tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:01.854318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667cd2d-022b-4dd0-92af-f03bbc971b0c tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b/application_credentials` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:01.856430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667cd2d-022b-4dd0-92af-f03bbc971b0c tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorizing `identity:create_application_credential(user_id=ff1702c1a902465cb89d25177611355b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:01.858006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667cd2d-022b-4dd0-92af-f03bbc971b0c tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:01.879423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247367fd-3705-41fd-8d96-c64c638c5cbe None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:01.881327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-247367fd-3705-41fd-8d96-c64c638c5cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:02.021633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:02.088718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247367fd-3705-41fd-8d96-c64c638c5cbe None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:02.122499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:02.123459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:02.123767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:02.124251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] PATH_INFO: `/v3/users/8d7cf5000ed7468abf4330cc4c4cd02c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:02.126087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7cf5000ed7468abf4330cc4c4cd02c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:02.134548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:02.186470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:02.205334 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2073/4177] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Aug 30 04:35:01 2022] POST /identity/v3/users/ff1702c1a902465cb89d25177611355b/application_credentials => generated 921 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:02.207602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667cd2d-022b-4dd0-92af-f03bbc971b0c tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:02.235232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667cd2d-022b-4dd0-92af-f03bbc971b0c tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:02.252044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459fb57-35ac-439d-8b83-e1a984399b4d tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff1702c1a902465cb89d25177611355b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813aaa5b597c435ba0b248a545e3b273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:02.253206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459fb57-35ac-439d-8b83-e1a984399b4d tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:02.255951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459fb57-35ac-439d-8b83-e1a984399b4d tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:02.256337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459fb57-35ac-439d-8b83-e1a984399b4d tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b/access_rules/4dc2a9c76974421b8a385f308bac988f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:02.259302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459fb57-35ac-439d-8b83-e1a984399b4d tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorizing `identity:delete_access_rule(user_id=ff1702c1a902465cb89d25177611355b, access_rule_id=4dc2a9c76974421b8a385f308bac988f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:02.267746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459fb57-35ac-439d-8b83-e1a984399b4d tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:02.310351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7cf5000ed7468abf4330cc4c4cd02c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:02.312274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7cf5000ed7468abf4330cc4c4cd02c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:02.338465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7cf5000ed7468abf4330cc4c4cd02c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-9459fb57-35ac-439d-8b83-e1a984399b4d tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application session.delete(ref) Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application yield resource Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:35:02.346817 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise self.value Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application session.commit() Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:35:02.348041 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._synchronize( Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise AssertionError( Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 30 04:35:02.349480 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:35:02.350694 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:35:02.352102 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 30 04:35:02.352102 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 30 04:35:02.352102 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 30 04:35:02.352102 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 30 04:35:02.352102 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 30 04:35:02.352102 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:02.352941 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2074/4178] 10.222.0.43 () {58 vars in 1362 bytes} [Tue Aug 30 04:35:02 2022] DELETE /identity/v3/users/ff1702c1a902465cb89d25177611355b/access_rules/4dc2a9c76974421b8a385f308bac988f => generated 89 bytes in 147 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:35:02.357984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459fb57-35ac-439d-8b83-e1a984399b4d tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:02.360497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7cf5000ed7468abf4330cc4c4cd02c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:02.384669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459fb57-35ac-439d-8b83-e1a984399b4d tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:02.408727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87332218-1ca2-47b9-af1a-015ed601d9ef tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff1702c1a902465cb89d25177611355b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813aaa5b597c435ba0b248a545e3b273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:02.409932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332218-1ca2-47b9-af1a-015ed601d9ef tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:02.410513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332218-1ca2-47b9-af1a-015ed601d9ef tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:02.411455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e629f166-cb42-4154-8dde-9dd172b2a128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7cf5000ed7468abf4330cc4c4cd02c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:02.412081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87332218-1ca2-47b9-af1a-015ed601d9ef tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b/application_credentials/29d6f6fc02ab480c9d2e741463833dce` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:02.431576 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2105/4179] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:01 2022] DELETE /identity/v3/users/8d7cf5000ed7468abf4330cc4c4cd02c => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:02.435962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2374-1e28-45d5-86a6-c59fee468dde None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:02.436398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2374-1e28-45d5-86a6-c59fee468dde None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:02.436774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b2374-1e28-45d5-86a6-c59fee468dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:02.458628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87332218-1ca2-47b9-af1a-015ed601d9ef tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ff1702c1a902465cb89d25177611355b, application_credential_id=29d6f6fc02ab480c9d2e741463833dce)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:02.460573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87332218-1ca2-47b9-af1a-015ed601d9ef tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:02.502020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-894b2374-1e28-45d5-86a6-c59fee468dde None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:02.504872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-894b2374-1e28-45d5-86a6-c59fee468dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:02.555872 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2075/4180] 10.222.0.43 () {58 vars in 1395 bytes} [Tue Aug 30 04:35:02 2022] DELETE /identity/v3/users/ff1702c1a902465cb89d25177611355b/application_credentials/29d6f6fc02ab480c9d2e741463833dce => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:02.558924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87332218-1ca2-47b9-af1a-015ed601d9ef tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:02.561625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-87332218-1ca2-47b9-af1a-015ed601d9ef tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:02.589487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87332218-1ca2-47b9-af1a-015ed601d9ef tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:02.689807 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2106/4181] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:02.740856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b2374-1e28-45d5-86a6-c59fee468dde None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:02.744521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-894b2374-1e28-45d5-86a6-c59fee468dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:02.760434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf06e7-8161-46b0-8258-773f32846dbe tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff1702c1a902465cb89d25177611355b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813aaa5b597c435ba0b248a545e3b273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:02.761337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf06e7-8161-46b0-8258-773f32846dbe tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:02.761718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf06e7-8161-46b0-8258-773f32846dbe tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:02.763126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf06e7-8161-46b0-8258-773f32846dbe tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b/access_rules` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:02.764980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf06e7-8161-46b0-8258-773f32846dbe tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorizing `identity:list_access_rules(user_id=ff1702c1a902465cb89d25177611355b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:02.767657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf06e7-8161-46b0-8258-773f32846dbe tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:02.796534 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2076/4182] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Aug 30 04:35:02 2022] GET /identity/v3/users/ff1702c1a902465cb89d25177611355b/access_rules => generated 369 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:02.798874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf06e7-8161-46b0-8258-773f32846dbe tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:02.823581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf06e7-8161-46b0-8258-773f32846dbe tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:02.841664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7f0aa-ebb5-454d-bee4-a6a04c486fba tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff1702c1a902465cb89d25177611355b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813aaa5b597c435ba0b248a545e3b273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:02.842939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7f0aa-ebb5-454d-bee4-a6a04c486fba tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:02.843662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7f0aa-ebb5-454d-bee4-a6a04c486fba tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:02.844139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7f0aa-ebb5-454d-bee4-a6a04c486fba tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b/access_rules/4dc2a9c76974421b8a385f308bac988f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:02.857631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7f0aa-ebb5-454d-bee4-a6a04c486fba tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorizing `identity:delete_access_rule(user_id=ff1702c1a902465cb89d25177611355b, access_rule_id=4dc2a9c76974421b8a385f308bac988f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:02.869327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7f0aa-ebb5-454d-bee4-a6a04c486fba tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:02.941152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b2374-1e28-45d5-86a6-c59fee468dde None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:02.943760 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2077/4183] 10.222.0.43 () {58 vars in 1362 bytes} [Tue Aug 30 04:35:02 2022] DELETE /identity/v3/users/ff1702c1a902465cb89d25177611355b/access_rules/4dc2a9c76974421b8a385f308bac988f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:02.948041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7f0aa-ebb5-454d-bee4-a6a04c486fba tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:02.952065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17bf3a-987b-44ad-b17c-93d438f03c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:02.952861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17bf3a-987b-44ad-b17c-93d438f03c3d service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:02.953474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17bf3a-987b-44ad-b17c-93d438f03c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:02.953855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17bf3a-987b-44ad-b17c-93d438f03c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:02.967664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17bf3a-987b-44ad-b17c-93d438f03c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:02.969967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17bf3a-987b-44ad-b17c-93d438f03c3d service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:02.985697 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2107/4184] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:02.991164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7f0aa-ebb5-454d-bee4-a6a04c486fba tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:03.017854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e26f-5d8c-469b-9a14-287e90c273d9 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff1702c1a902465cb89d25177611355b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813aaa5b597c435ba0b248a545e3b273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:03.018560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e26f-5d8c-469b-9a14-287e90c273d9 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:03.018843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e26f-5d8c-469b-9a14-287e90c273d9 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:03.019115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e26f-5d8c-469b-9a14-287e90c273d9 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b/access_rules` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:03.034498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e26f-5d8c-469b-9a14-287e90c273d9 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorizing `identity:list_access_rules(user_id=ff1702c1a902465cb89d25177611355b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:03.036049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e26f-5d8c-469b-9a14-287e90c273d9 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:03.073948 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2078/4185] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Aug 30 04:35:02 2022] GET /identity/v3/users/ff1702c1a902465cb89d25177611355b/access_rules => generated 158 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:03.075640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17bf3a-987b-44ad-b17c-93d438f03c3d service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:03.100721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17bf3a-987b-44ad-b17c-93d438f03c3d service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:03.110865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d1db2-181f-43a9-9d4d-f1011ca1d645 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff1702c1a902465cb89d25177611355b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813aaa5b597c435ba0b248a545e3b273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:03.112915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d1db2-181f-43a9-9d4d-f1011ca1d645 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:03.113372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d1db2-181f-43a9-9d4d-f1011ca1d645 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:03.113953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d1db2-181f-43a9-9d4d-f1011ca1d645 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b/application_credentials` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:03.119627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d1db2-181f-43a9-9d4d-f1011ca1d645 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorizing `identity:create_application_credential(user_id=ff1702c1a902465cb89d25177611355b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:03.122329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d1db2-181f-43a9-9d4d-f1011ca1d645 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:03.209239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:03.361752 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2108/4186] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Aug 30 04:35:03 2022] POST /identity/v3/users/ff1702c1a902465cb89d25177611355b/application_credentials => generated 920 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:03.363325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e26f-5d8c-469b-9a14-287e90c273d9 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:03.401132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e26f-5d8c-469b-9a14-287e90c273d9 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:03.418073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a696edd-135b-44d5-9075-4e4a86a02c45 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff1702c1a902465cb89d25177611355b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813aaa5b597c435ba0b248a545e3b273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:03.418748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a696edd-135b-44d5-9075-4e4a86a02c45 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:03.419044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a696edd-135b-44d5-9075-4e4a86a02c45 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:03.419319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a696edd-135b-44d5-9075-4e4a86a02c45 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b/access_rules` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:03.421527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a696edd-135b-44d5-9075-4e4a86a02c45 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorizing `identity:list_access_rules(user_id=ff1702c1a902465cb89d25177611355b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:03.423471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a696edd-135b-44d5-9075-4e4a86a02c45 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:03.449677 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2079/4187] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Aug 30 04:35:03 2022] GET /identity/v3/users/ff1702c1a902465cb89d25177611355b/access_rules => generated 369 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:03.456240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d1db2-181f-43a9-9d4d-f1011ca1d645 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:03.494150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d1db2-181f-43a9-9d4d-f1011ca1d645 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:03.500082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326dfb0-dc57-4c20-9c7c-50ae42259da8 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff1702c1a902465cb89d25177611355b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813aaa5b597c435ba0b248a545e3b273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:03.500781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326dfb0-dc57-4c20-9c7c-50ae42259da8 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:03.501050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326dfb0-dc57-4c20-9c7c-50ae42259da8 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:03.501321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326dfb0-dc57-4c20-9c7c-50ae42259da8 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b/application_credentials` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:03.502071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326dfb0-dc57-4c20-9c7c-50ae42259da8 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorizing `identity:create_application_credential(user_id=ff1702c1a902465cb89d25177611355b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:03.503279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326dfb0-dc57-4c20-9c7c-50ae42259da8 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:03.679841 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2109/4188] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Aug 30 04:35:03 2022] POST /identity/v3/users/ff1702c1a902465cb89d25177611355b/application_credentials => generated 921 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:03.684993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a696edd-135b-44d5-9075-4e4a86a02c45 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:03.752886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a696edd-135b-44d5-9075-4e4a86a02c45 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:03.758904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58379c55-6ac1-4897-b524-cc1c07e10b07 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff1702c1a902465cb89d25177611355b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '813aaa5b597c435ba0b248a545e3b273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:03.759600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58379c55-6ac1-4897-b524-cc1c07e10b07 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:03.759862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58379c55-6ac1-4897-b524-cc1c07e10b07 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:03.760133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58379c55-6ac1-4897-b524-cc1c07e10b07 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b/access_rules/16f0b48ea55e437c961e951c5d1dd9d0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:03.764551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58379c55-6ac1-4897-b524-cc1c07e10b07 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorizing `identity:get_access_rule(user_id=ff1702c1a902465cb89d25177611355b, access_rule_id=16f0b48ea55e437c961e951c5d1dd9d0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:03.765436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58379c55-6ac1-4897-b524-cc1c07e10b07 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:03.794372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2080/4189] 10.222.0.43 () {58 vars in 1359 bytes} [Tue Aug 30 04:35:03 2022] GET /identity/v3/users/ff1702c1a902465cb89d25177611355b/access_rules/16f0b48ea55e437c961e951c5d1dd9d0 => generated 229 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:03.800832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326dfb0-dc57-4c20-9c7c-50ae42259da8 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:03.803595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9326dfb0-dc57-4c20-9c7c-50ae42259da8 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:03.848213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326dfb0-dc57-4c20-9c7c-50ae42259da8 tempest-AccessRulesV3Test-621532010 tempest-AccessRulesV3Test-621532010-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:03.863486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:03.864612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:03.865137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:03.865616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] PATH_INFO: `/v3/users/ff1702c1a902465cb89d25177611355b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:03.868922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1702c1a902465cb89d25177611355b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:03.879360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:04.071958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9184550-12b4-4e33-8078-a3c05743a48f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:04.072616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9184550-12b4-4e33-8078-a3c05743a48f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:04.073085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9184550-12b4-4e33-8078-a3c05743a48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:04.141334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1702c1a902465cb89d25177611355b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:04.145244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1702c1a902465cb89d25177611355b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:04.167463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b9184550-12b4-4e33-8078-a3c05743a48f None None] MFA Rules not processed for user `36bbf0c01d0148aeab626e6d1bb1f0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:04.174800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b9184550-12b4-4e33-8078-a3c05743a48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:04.176220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1702c1a902465cb89d25177611355b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:04.213453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1702c1a902465cb89d25177611355b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:04.357655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=82,keystone:INSERT=8,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:04.360481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:04.377426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f705ec9-6f8e-4be1-809b-5dbec4975739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1702c1a902465cb89d25177611355b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:04.396734 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2110/4190] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:03 2022] DELETE /identity/v3/users/ff1702c1a902465cb89d25177611355b => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:04.401711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a4404-ba33-4f62-983d-5692fdd75239 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:04.401711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a4404-ba33-4f62-983d-5692fdd75239 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:04.405930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a4404-ba33-4f62-983d-5692fdd75239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:04.428593 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2081/4191] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:04.504788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-693a4404-ba33-4f62-983d-5692fdd75239 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:04.506147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-693a4404-ba33-4f62-983d-5692fdd75239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:04.690422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2111/4192] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:04.709477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9184550-12b4-4e33-8078-a3c05743a48f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:04.711431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b9184550-12b4-4e33-8078-a3c05743a48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:04.743285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9184550-12b4-4e33-8078-a3c05743a48f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:04.745289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a4404-ba33-4f62-983d-5692fdd75239 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:04.747617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-693a4404-ba33-4f62-983d-5692fdd75239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:04.787311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a4404-ba33-4f62-983d-5692fdd75239 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:04.814959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:04.818703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:04.819195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:04.820547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] PATH_INFO: `/v3/projects/01c5aaeb5414461c9cd0a51d438c871a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:04.826132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c5aaeb5414461c9cd0a51d438c871a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:04.830748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:04.910549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2e581-5eb7-40e9-86b0-44123bdf6848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:04.912067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2e581-5eb7-40e9-86b0-44123bdf6848 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:04.912541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2e581-5eb7-40e9-86b0-44123bdf6848 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:04.913411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2e581-5eb7-40e9-86b0-44123bdf6848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:04.946354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2e581-5eb7-40e9-86b0-44123bdf6848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:04.949470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2e581-5eb7-40e9-86b0-44123bdf6848 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:04.972051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c5aaeb5414461c9cd0a51d438c871a', 'request_id': 'req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:04.989404 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2082/4193] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:04.992367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c5aaeb5414461c9cd0a51d438c871a', 'request_id': 'req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:04.993002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2e581-5eb7-40e9-86b0-44123bdf6848 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:04.996259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-acf2e581-5eb7-40e9-86b0-44123bdf6848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:05.008589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c5aaeb5414461c9cd0a51d438c871a', 'request_id': 'req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:05.029839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2e581-5eb7-40e9-86b0-44123bdf6848 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:05.048119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] The token cache is being invalidate because project 01c5aaeb5414461c9cd0a51d438c871a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:05.048442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:05.049181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd464b3c-1c3f-4a88-a1f9-9323c92d9d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:05.051467 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2112/4194] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:04 2022] DELETE /identity/v3/projects/01c5aaeb5414461c9cd0a51d438c871a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:05.065770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630a233-4575-4002-bd87-1c2091956c33 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:05.067723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630a233-4575-4002-bd87-1c2091956c33 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:05.068419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630a233-4575-4002-bd87-1c2091956c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:05.109556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8630a233-4575-4002-bd87-1c2091956c33 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:05.111355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8630a233-4575-4002-bd87-1c2091956c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:05.193696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:05.194455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:05.194625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:05.196988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] PATH_INFO: `/v3/users/2e944e3030a1404c9862d953fedfb94a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:05.200614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e944e3030a1404c9862d953fedfb94a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:05.206015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:05.213958 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2113/4195] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:05.223053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7b1b5-26e6-4d2a-b49a-56b14c98729e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:05.225756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7b1b5-26e6-4d2a-b49a-56b14c98729e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:05.227451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7b1b5-26e6-4d2a-b49a-56b14c98729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:05.290091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-57b7b1b5-26e6-4d2a-b49a-56b14c98729e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:05.291623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-57b7b1b5-26e6-4d2a-b49a-56b14c98729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:05.325294 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2114/4196] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:05.328427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7b1b5-26e6-4d2a-b49a-56b14c98729e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:05.344306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e944e3030a1404c9862d953fedfb94a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:05.349254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7b1b5-26e6-4d2a-b49a-56b14c98729e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:05.370005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e944e3030a1404c9862d953fedfb94a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:05.376156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07a62-3c20-42b5-9171-7661785f17b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:05.377545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07a62-3c20-42b5-9171-7661785f17b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:05.378145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07a62-3c20-42b5-9171-7661785f17b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:05.378238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c07a62-3c20-42b5-9171-7661785f17b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:05.378845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c07a62-3c20-42b5-9171-7661785f17b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:05.379255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c07a62-3c20-42b5-9171-7661785f17b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:05.385522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c07a62-3c20-42b5-9171-7661785f17b2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:05.402601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:05.407174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e944e3030a1404c9862d953fedfb94a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:05.420143 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2115/4197] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:05.424874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07a62-3c20-42b5-9171-7661785f17b2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:05.429475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e944e3030a1404c9862d953fedfb94a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:05.430687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e944e3030a1404c9862d953fedfb94a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:05.450482 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2083/4198] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:04 2022] DELETE /identity/v3/users/2e944e3030a1404c9862d953fedfb94a => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:05.453412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c07a62-3c20-42b5-9171-7661785f17b2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:05.586157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe6f1e-3d61-490f-8671-9abad1056548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:05.587365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe6f1e-3d61-490f-8671-9abad1056548 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:05.587647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe6f1e-3d61-490f-8671-9abad1056548 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:05.587918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe6f1e-3d61-490f-8671-9abad1056548 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:05.588584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe6f1e-3d61-490f-8671-9abad1056548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:05.592032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe6f1e-3d61-490f-8671-9abad1056548 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:05.630364 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2116/4199] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:05 2022] POST /identity/v3/projects => generated 391 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:05.633205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:05.641244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:05.657478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ca1bd-ee8c-42e6-9e48-b39be4e28c4e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:05.669346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:05.747423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d49b26-3841-47ac-9d61-897e7448f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:05.748220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49b26-3841-47ac-9d61-897e7448f039 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:05.748495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49b26-3841-47ac-9d61-897e7448f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:05.748786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d49b26-3841-47ac-9d61-897e7448f039 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:05.749466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d49b26-3841-47ac-9d61-897e7448f039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:05.751680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d49b26-3841-47ac-9d61-897e7448f039 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:05.786590 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2084/4200] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:05 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:05.787527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe6f1e-3d61-490f-8671-9abad1056548 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:05.804999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe6f1e-3d61-490f-8671-9abad1056548 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:05.819999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d547ff8-965c-4982-b529-dc956b3aaa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:05.822464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d547ff8-965c-4982-b529-dc956b3aaa4f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:05.823018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d547ff8-965c-4982-b529-dc956b3aaa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:05.823532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d547ff8-965c-4982-b529-dc956b3aaa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:05.824559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d547ff8-965c-4982-b529-dc956b3aaa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:05.827816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d547ff8-965c-4982-b529-dc956b3aaa4f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:05.851674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d49b26-3841-47ac-9d61-897e7448f039 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:05.862450 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2117/4201] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:05.867401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d49b26-3841-47ac-9d61-897e7448f039 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:05.875464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120cd99-a696-4eb6-be53-27b5eaefa128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:05.876519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120cd99-a696-4eb6-be53-27b5eaefa128 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:05.877096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120cd99-a696-4eb6-be53-27b5eaefa128 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:05.877590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120cd99-a696-4eb6-be53-27b5eaefa128 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:05.878739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120cd99-a696-4eb6-be53-27b5eaefa128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:05.882148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120cd99-a696-4eb6-be53-27b5eaefa128 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:05.897331 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2085/4202] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:05.901939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d547ff8-965c-4982-b529-dc956b3aaa4f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:05.914245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d547ff8-965c-4982-b529-dc956b3aaa4f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:05.920224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c8ff-9bae-40a8-bb35-f1324d3e7521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:05.921208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c8ff-9bae-40a8-bb35-f1324d3e7521 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:05.921501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c8ff-9bae-40a8-bb35-f1324d3e7521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:05.921769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c8ff-9bae-40a8-bb35-f1324d3e7521 admin admin] PATH_INFO: `/v3/projects/7919c2fa32984c39a31200695c6da542/users/f59f5f1181204b48a50aead509c3c20e/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:05.944097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967c8ff-9bae-40a8-bb35-f1324d3e7521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7919c2fa32984c39a31200695c6da542, user_id=f59f5f1181204b48a50aead509c3c20e, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:05.946876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967c8ff-9bae-40a8-bb35-f1324d3e7521 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:05.974972 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2118/4203] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:05 2022] PUT /identity/v3/projects/7919c2fa32984c39a31200695c6da542/users/f59f5f1181204b48a50aead509c3c20e/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:05.997940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55571a5-d22f-454a-ac43-3d6f02d3b6fb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:05.997940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55571a5-d22f-454a-ac43-3d6f02d3b6fb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:05.997940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55571a5-d22f-454a-ac43-3d6f02d3b6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:06.023161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a55571a5-d22f-454a-ac43-3d6f02d3b6fb None None] MFA Rules not processed for user `f59f5f1181204b48a50aead509c3c20e`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:06.024486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a55571a5-d22f-454a-ac43-3d6f02d3b6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:06.192909 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2086/4204] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:06.194175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c8ff-9bae-40a8-bb35-f1324d3e7521 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:06.312933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c8ff-9bae-40a8-bb35-f1324d3e7521 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:06.320578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10951a87-4986-4824-96fd-5ce14d2b3294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:06.321655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10951a87-4986-4824-96fd-5ce14d2b3294 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:06.322214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10951a87-4986-4824-96fd-5ce14d2b3294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:06.322725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10951a87-4986-4824-96fd-5ce14d2b3294 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:06.323616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10951a87-4986-4824-96fd-5ce14d2b3294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:06.325939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10951a87-4986-4824-96fd-5ce14d2b3294 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:06.403661 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2119/4205] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:06 2022] POST /identity/v3/projects => generated 391 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:06.408532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55571a5-d22f-454a-ac43-3d6f02d3b6fb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:06.436906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55571a5-d22f-454a-ac43-3d6f02d3b6fb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:06.610240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e4507-af26-4673-b627-99dd4a127404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:06.611041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e4507-af26-4673-b627-99dd4a127404 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:06.611328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e4507-af26-4673-b627-99dd4a127404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:06.611606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e4507-af26-4673-b627-99dd4a127404 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:06.612309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e4507-af26-4673-b627-99dd4a127404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:06.615332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e4507-af26-4673-b627-99dd4a127404 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:06.664825 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2087/4206] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:06 2022] POST /identity/v3/users => generated 302 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:06.666920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10951a87-4986-4824-96fd-5ce14d2b3294 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:06.683297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10951a87-4986-4824-96fd-5ce14d2b3294 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:06.702431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc4794-9b0b-4bc9-af11-1dbc47b8a11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:06.703268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc4794-9b0b-4bc9-af11-1dbc47b8a11a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:06.704509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc4794-9b0b-4bc9-af11-1dbc47b8a11a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:06.705452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc4794-9b0b-4bc9-af11-1dbc47b8a11a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:06.706932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc4794-9b0b-4bc9-af11-1dbc47b8a11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:06.711203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc4794-9b0b-4bc9-af11-1dbc47b8a11a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:06.749473 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2120/4207] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:06.753787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e4507-af26-4673-b627-99dd4a127404 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:06.788063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e4507-af26-4673-b627-99dd4a127404 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:06.807126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65bf06-ac74-437b-9807-c0e6b3ac36b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:06.808224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bf06-ac74-437b-9807-c0e6b3ac36b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:06.808692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bf06-ac74-437b-9807-c0e6b3ac36b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:06.809134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65bf06-ac74-437b-9807-c0e6b3ac36b8 admin admin] PATH_INFO: `/v3/projects/d2985cb033a243fcbc3ead74a9384e5e/users/b0e52d4d6f294c999a25a21da294a66e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:06.822925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:06.869494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65bf06-ac74-437b-9807-c0e6b3ac36b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2985cb033a243fcbc3ead74a9384e5e, user_id=b0e52d4d6f294c999a25a21da294a66e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:06.874944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65bf06-ac74-437b-9807-c0e6b3ac36b8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:06.924775 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2088/4208] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:06 2022] PUT /identity/v3/projects/d2985cb033a243fcbc3ead74a9384e5e/users/b0e52d4d6f294c999a25a21da294a66e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:06.926001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc4794-9b0b-4bc9-af11-1dbc47b8a11a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:06.956210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc4794-9b0b-4bc9-af11-1dbc47b8a11a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:07.007852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:07.126671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85f904-3fec-4361-a9a7-9c860b60e4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:07.127389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f904-3fec-4361-a9a7-9c860b60e4bd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:07.127663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f904-3fec-4361-a9a7-9c860b60e4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:07.127929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85f904-3fec-4361-a9a7-9c860b60e4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:07.129434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85f904-3fec-4361-a9a7-9c860b60e4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:07.132603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85f904-3fec-4361-a9a7-9c860b60e4bd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:07.146906 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2121/4209] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:07.153142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65bf06-ac74-437b-9807-c0e6b3ac36b8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:07.191762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65bf06-ac74-437b-9807-c0e6b3ac36b8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:07.195619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85f904-3fec-4361-a9a7-9c860b60e4bd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:07.207294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a70527-a2f5-4ece-9778-52747d0a5b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:07.209113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a70527-a2f5-4ece-9778-52747d0a5b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:07.209565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a70527-a2f5-4ece-9778-52747d0a5b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:07.210075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a70527-a2f5-4ece-9778-52747d0a5b96 admin admin] PATH_INFO: `/v3/projects/d2985cb033a243fcbc3ead74a9384e5e/users/b0e52d4d6f294c999a25a21da294a66e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:07.216741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cd85f904-3fec-4361-a9a7-9c860b60e4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:07.219314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a70527-a2f5-4ece-9778-52747d0a5b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2985cb033a243fcbc3ead74a9384e5e, user_id=b0e52d4d6f294c999a25a21da294a66e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:07.233428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a70527-a2f5-4ece-9778-52747d0a5b96 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:07.249926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85f904-3fec-4361-a9a7-9c860b60e4bd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:07.264319 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2089/4210] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:07 2022] PUT /identity/v3/projects/d2985cb033a243fcbc3ead74a9384e5e/users/b0e52d4d6f294c999a25a21da294a66e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:07.360406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf8819-63d3-4286-a44c-7c1d7ba2cf54 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:07.360766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf8819-63d3-4286-a44c-7c1d7ba2cf54 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:07.360958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf8819-63d3-4286-a44c-7c1d7ba2cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:07.407646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ccaf8819-63d3-4286-a44c-7c1d7ba2cf54 None None] MFA Rules not processed for user `b0e52d4d6f294c999a25a21da294a66e`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:07.408910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ccaf8819-63d3-4286-a44c-7c1d7ba2cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:07.470433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:07.471357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:07.471487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:07.471833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] PATH_INFO: `/v3/projects/b768d75b29ac4ad18cd34e44b1382004` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:07.479545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b768d75b29ac4ad18cd34e44b1382004)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:07.483270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:07.608833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b768d75b29ac4ad18cd34e44b1382004', 'request_id': 'req-90b063ce-1066-4ccc-a122-2e590bf591bf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:07.624306 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2090/4211] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:07.653175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf8819-63d3-4286-a44c-7c1d7ba2cf54 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:07.660009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b768d75b29ac4ad18cd34e44b1382004', 'request_id': 'req-90b063ce-1066-4ccc-a122-2e590bf591bf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:07.711100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf8819-63d3-4286-a44c-7c1d7ba2cf54 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:07.711903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b768d75b29ac4ad18cd34e44b1382004', 'request_id': 'req-90b063ce-1066-4ccc-a122-2e590bf591bf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:07.745590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] The token cache is being invalidate because project b768d75b29ac4ad18cd34e44b1382004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:07.748722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:07.750903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-90b063ce-1066-4ccc-a122-2e590bf591bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:07.753669 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2122/4212] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:07 2022] DELETE /identity/v3/projects/b768d75b29ac4ad18cd34e44b1382004 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:07.762179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfa7fa-a755-49e3-829f-a89ebffa775b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:07.762451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfa7fa-a755-49e3-829f-a89ebffa775b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:07.762725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfa7fa-a755-49e3-829f-a89ebffa775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:07.830392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9ecfa7fa-a755-49e3-829f-a89ebffa775b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:07.835564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9ecfa7fa-a755-49e3-829f-a89ebffa775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:07.907514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba57f44-6993-4d96-9dd3-14641165b9fd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:07.908172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba57f44-6993-4d96-9dd3-14641165b9fd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:07.908454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba57f44-6993-4d96-9dd3-14641165b9fd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:07.908724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba57f44-6993-4d96-9dd3-14641165b9fd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:07.909820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba57f44-6993-4d96-9dd3-14641165b9fd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:07.916132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba57f44-6993-4d96-9dd3-14641165b9fd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:07.948769 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2091/4213] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:35:07 2022] POST /identity/v3/domains => generated 276 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:07.953910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba57f44-6993-4d96-9dd3-14641165b9fd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:07.956086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:07.960176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6ba57f44-6993-4d96-9dd3-14641165b9fd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:08.011752 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2123/4214] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:08.027247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a5c87-0d17-439c-bf55-0e881692aab7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:08.027531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a5c87-0d17-439c-bf55-0e881692aab7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:08.027981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a5c87-0d17-439c-bf55-0e881692aab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:08.150000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:08.163643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-903a5c87-0d17-439c-bf55-0e881692aab7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:08.165864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-903a5c87-0d17-439c-bf55-0e881692aab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:08.246302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba57f44-6993-4d96-9dd3-14641165b9fd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:08.267846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314463d8-6080-4d15-b581-4b7881bf517a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:08.270627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314463d8-6080-4d15-b581-4b7881bf517a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:08.273376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314463d8-6080-4d15-b581-4b7881bf517a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:08.273845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314463d8-6080-4d15-b581-4b7881bf517a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/665169ea83b842c2b467df08d528f571/config` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:08.278331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314463d8-6080-4d15-b581-4b7881bf517a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=665169ea83b842c2b467df08d528f571)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:08.283632 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-314463d8-6080-4d15-b581-4b7881bf517a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:08.283632 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:35:08.283632 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:35:08.286390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314463d8-6080-4d15-b581-4b7881bf517a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:08.460367 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2092/4215] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:35:07 2022] PUT /identity/v3/domains/665169ea83b842c2b467df08d528f571/config => generated 138 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:08.462817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314463d8-6080-4d15-b581-4b7881bf517a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:08.469435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-314463d8-6080-4d15-b581-4b7881bf517a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:08.543712 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2124/4216] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:08.544677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a5c87-0d17-439c-bf55-0e881692aab7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:08.565658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a5c87-0d17-439c-bf55-0e881692aab7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:08.585903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db85086-fcc5-4e37-b9dc-8a2621d2e8a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:08.586611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db85086-fcc5-4e37-b9dc-8a2621d2e8a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:08.586910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db85086-fcc5-4e37-b9dc-8a2621d2e8a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:08.587162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db85086-fcc5-4e37-b9dc-8a2621d2e8a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/665169ea83b842c2b467df08d528f571/config/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:08.595124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db85086-fcc5-4e37-b9dc-8a2621d2e8a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=665169ea83b842c2b467df08d528f571, group=identity)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:08.597046 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-7db85086-fcc5-4e37-b9dc-8a2621d2e8a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:08.597046 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:08.597046 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:08.597511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db85086-fcc5-4e37-b9dc-8a2621d2e8a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:08.616291 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2125/4217] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Aug 30 04:35:08 2022] GET /identity/v3/domains/665169ea83b842c2b467df08d528f571/config/identity => generated 45 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:08.617017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db85086-fcc5-4e37-b9dc-8a2621d2e8a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:08.668263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314463d8-6080-4d15-b581-4b7881bf517a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:08.668495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db85086-fcc5-4e37-b9dc-8a2621d2e8a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:08.692385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242bdb-764e-408a-8ca0-c243cfd952e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:08.693041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242bdb-764e-408a-8ca0-c243cfd952e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:08.693349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242bdb-764e-408a-8ca0-c243cfd952e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:08.693573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242bdb-764e-408a-8ca0-c243cfd952e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:08.694284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c242bdb-764e-408a-8ca0-c243cfd952e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:08.694775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c242bdb-764e-408a-8ca0-c243cfd952e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:08.697067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:08.697945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:08.698108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:08.698273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] PATH_INFO: `/v3/projects/813aaa5b597c435ba0b248a545e3b273` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:08.708748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813aaa5b597c435ba0b248a545e3b273)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:08.709324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:08.711095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c242bdb-764e-408a-8ca0-c243cfd952e3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:08.745926 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2126/4218] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:08.746967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242bdb-764e-408a-8ca0-c243cfd952e3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:08.803120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242bdb-764e-408a-8ca0-c243cfd952e3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:08.824778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd973d3-79d0-43b2-a962-15d9effe00f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:08.826234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd973d3-79d0-43b2-a962-15d9effe00f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:08.828957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd973d3-79d0-43b2-a962-15d9effe00f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:08.829693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd973d3-79d0-43b2-a962-15d9effe00f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/665169ea83b842c2b467df08d528f571/config/identity/driver` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:08.835029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd973d3-79d0-43b2-a962-15d9effe00f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=665169ea83b842c2b467df08d528f571, group=identity, option=driver)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:08.844500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd973d3-79d0-43b2-a962-15d9effe00f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:08.904364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813aaa5b597c435ba0b248a545e3b273', 'request_id': 'req-6c18eed7-2d6a-483b-98b6-99a8c850fab2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:08.906766 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2127/4219] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Aug 30 04:35:08 2022] GET /identity/v3/domains/665169ea83b842c2b467df08d528f571/config/identity/driver => generated 31 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:08.909534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd973d3-79d0-43b2-a962-15d9effe00f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:08.938097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813aaa5b597c435ba0b248a545e3b273', 'request_id': 'req-6c18eed7-2d6a-483b-98b6-99a8c850fab2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:08.970392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813aaa5b597c435ba0b248a545e3b273', 'request_id': 'req-6c18eed7-2d6a-483b-98b6-99a8c850fab2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:09.000426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd973d3-79d0-43b2-a962-15d9effe00f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:09.024010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] The token cache is being invalidate because project 813aaa5b597c435ba0b248a545e3b273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:09.024757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:09.033498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:09.036685 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2093/4220] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:08 2022] DELETE /identity/v3/projects/813aaa5b597c435ba0b248a545e3b273 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:09.038544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:09.052296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:09.326398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:09.366437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18eed7-2d6a-483b-98b6-99a8c850fab2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:09.385855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a650516-bfb0-46c3-9f65-875066cdba19 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:09.387015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a650516-bfb0-46c3-9f65-875066cdba19 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:09.387540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a650516-bfb0-46c3-9f65-875066cdba19 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:09.388006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a650516-bfb0-46c3-9f65-875066cdba19 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/665169ea83b842c2b467df08d528f571/config/ldap` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:09.393011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a650516-bfb0-46c3-9f65-875066cdba19 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=665169ea83b842c2b467df08d528f571, group=ldap)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:09.394945 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-5a650516-bfb0-46c3-9f65-875066cdba19 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:09.394945 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:35:09.394945 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:35:09.397564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a650516-bfb0-46c3-9f65-875066cdba19 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:09.430324 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2094/4221] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Aug 30 04:35:09 2022] GET /identity/v3/domains/665169ea83b842c2b467df08d528f571/config/ldap => generated 106 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:09.430989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cd54c-030f-4364-9654-c6f1db496544 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:09.431426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cd54c-030f-4364-9654-c6f1db496544 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:09.431673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cd54c-030f-4364-9654-c6f1db496544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:09.475009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93d558-adb2-4985-a3dc-dc261462c385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:09.476001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d558-adb2-4985-a3dc-dc261462c385 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:09.476738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d558-adb2-4985-a3dc-dc261462c385 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:09.476975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93d558-adb2-4985-a3dc-dc261462c385 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:09.490444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93d558-adb2-4985-a3dc-dc261462c385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:09.499169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff93d558-adb2-4985-a3dc-dc261462c385 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:09.531637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-831cd54c-030f-4364-9654-c6f1db496544 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:09.533457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-831cd54c-030f-4364-9654-c6f1db496544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:09.582205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2095/4222] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:09.583835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cd54c-030f-4364-9654-c6f1db496544 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:09.660152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cd54c-030f-4364-9654-c6f1db496544 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:09.667380 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2128/4223] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:08 2022] POST /identity/v3/projects => generated 371 bytes in 760 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:09.669659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e43461-df4e-4147-be2c-ff8bafc30f73 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:09.671081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e43461-df4e-4147-be2c-ff8bafc30f73 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:09.675092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e43461-df4e-4147-be2c-ff8bafc30f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:09.762159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-07e43461-df4e-4147-be2c-ff8bafc30f73 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:09.762159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-07e43461-df4e-4147-be2c-ff8bafc30f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:09.850065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bdd55-7543-4f3f-ada6-09fc7b7df4e2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:09.851178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bdd55-7543-4f3f-ada6-09fc7b7df4e2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:09.851738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bdd55-7543-4f3f-ada6-09fc7b7df4e2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:09.851738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bdd55-7543-4f3f-ada6-09fc7b7df4e2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/665169ea83b842c2b467df08d528f571/config/ldap/url` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:09.855147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bdd55-7543-4f3f-ada6-09fc7b7df4e2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=665169ea83b842c2b467df08d528f571, group=ldap, option=url)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:09.863306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bdd55-7543-4f3f-ada6-09fc7b7df4e2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:09.870209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:09.890707 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2096/4224] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Aug 30 04:35:09 2022] GET /identity/v3/domains/665169ea83b842c2b467df08d528f571/config/ldap/url => generated 46 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:09.894507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bdd55-7543-4f3f-ada6-09fc7b7df4e2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:09.902517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-658bdd55-7543-4f3f-ada6-09fc7b7df4e2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:10.037139 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2129/4225] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:10.037139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e43461-df4e-4147-be2c-ff8bafc30f73 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:10.059178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e43461-df4e-4147-be2c-ff8bafc30f73 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:10.074860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8666-1d63-4899-8612-c732d5d493b2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:10.075578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8666-1d63-4899-8612-c732d5d493b2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:10.075864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8666-1d63-4899-8612-c732d5d493b2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:10.076141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae8666-1d63-4899-8612-c732d5d493b2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/665169ea83b842c2b467df08d528f571/config/ldap/user_tree_dn` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:10.077452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae8666-1d63-4899-8612-c732d5d493b2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=665169ea83b842c2b467df08d528f571, group=ldap, option=user_tree_dn)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:10.079128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae8666-1d63-4899-8612-c732d5d493b2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:10.096839 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2130/4226] 10.222.0.43 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:10 2022] GET /identity/v3/domains/665169ea83b842c2b467df08d528f571/config/ldap/user_tree_dn => generated 63 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:10.097785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8666-1d63-4899-8612-c732d5d493b2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:10.123509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae8666-1d63-4899-8612-c732d5d493b2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:10.150538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8e3ef-a297-463b-8b3e-e83b9dca7cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:10.151886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8e3ef-a297-463b-8b3e-e83b9dca7cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:10.152174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8e3ef-a297-463b-8b3e-e83b9dca7cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:10.152605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8e3ef-a297-463b-8b3e-e83b9dca7cd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:10.153558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8e3ef-a297-463b-8b3e-e83b9dca7cd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:10.153693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8e3ef-a297-463b-8b3e-e83b9dca7cd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:10.155412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8e3ef-a297-463b-8b3e-e83b9dca7cd4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:10.166623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bdd55-7543-4f3f-ada6-09fc7b7df4e2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:10.183484 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2131/4227] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:10.184493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8e3ef-a297-463b-8b3e-e83b9dca7cd4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:10.185789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1002-d19e-480e-ab7e-945575a70a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:10.186531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1002-d19e-480e-ab7e-945575a70a50 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:10.186838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1002-d19e-480e-ab7e-945575a70a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:10.187072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d1002-d19e-480e-ab7e-945575a70a50 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:10.187782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1002-d19e-480e-ab7e-945575a70a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:10.194265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d1002-d19e-480e-ab7e-945575a70a50 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:10.225467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8e3ef-a297-463b-8b3e-e83b9dca7cd4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:10.241494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c294b4-ee96-44d7-be13-9c971c440dfc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:10.245606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c294b4-ee96-44d7-be13-9c971c440dfc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:10.245606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c294b4-ee96-44d7-be13-9c971c440dfc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:10.245606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c294b4-ee96-44d7-be13-9c971c440dfc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/665169ea83b842c2b467df08d528f571/config` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:10.250385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c294b4-ee96-44d7-be13-9c971c440dfc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=665169ea83b842c2b467df08d528f571)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:10.255715 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-22c294b4-ee96-44d7-be13-9c971c440dfc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:10.255715 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:10.255715 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:10.257084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c294b4-ee96-44d7-be13-9c971c440dfc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:10.262415 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2097/4228] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:09 2022] POST /identity/v3/users => generated 286 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:10.266004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1002-d19e-480e-ab7e-945575a70a50 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:10.279071 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2132/4229] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:10 2022] DELETE /identity/v3/domains/665169ea83b842c2b467df08d528f571/config => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:10.280277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c294b4-ee96-44d7-be13-9c971c440dfc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:10.320265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c294b4-ee96-44d7-be13-9c971c440dfc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:10.342778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b9571-fdfe-4864-8499-f74745fb2cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:10.343429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b9571-fdfe-4864-8499-f74745fb2cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:10.344161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b9571-fdfe-4864-8499-f74745fb2cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:10.344161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b9571-fdfe-4864-8499-f74745fb2cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:10.344643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b9571-fdfe-4864-8499-f74745fb2cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:10.346344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b9571-fdfe-4864-8499-f74745fb2cb1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:10.355148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d1002-d19e-480e-ab7e-945575a70a50 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:10.372485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ef19d-268e-48f1-8c21-bba325344b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:10.373545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ef19d-268e-48f1-8c21-bba325344b70 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:10.373824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ef19d-268e-48f1-8c21-bba325344b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:10.374169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ef19d-268e-48f1-8c21-bba325344b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:10.374822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ef19d-268e-48f1-8c21-bba325344b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:10.377043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ef19d-268e-48f1-8c21-bba325344b70 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:10.393793 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2133/4230] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:10.417430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b9571-fdfe-4864-8499-f74745fb2cb1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:10.438549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b9571-fdfe-4864-8499-f74745fb2cb1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:10.444030 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2098/4231] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:10 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:10.445220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ef19d-268e-48f1-8c21-bba325344b70 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:10.603868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:10.640708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ef19d-268e-48f1-8c21-bba325344b70 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:10.668032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29f3f-b6d1-4266-9db7-14164acfd6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:10.668271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:10.668719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29f3f-b6d1-4266-9db7-14164acfd6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:10.669003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29f3f-b6d1-4266-9db7-14164acfd6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:10.669300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e29f3f-b6d1-4266-9db7-14164acfd6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:10.669968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e29f3f-b6d1-4266-9db7-14164acfd6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:10.670149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:10.670527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:10.671300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/665169ea83b842c2b467df08d528f571` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:10.671617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e29f3f-b6d1-4266-9db7-14164acfd6d4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:10.673784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=665169ea83b842c2b467df08d528f571)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:10.675104 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:10.675104 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:10.675104 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:10.676226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:10.690972 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2099/4232] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:10.695522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29f3f-b6d1-4266-9db7-14164acfd6d4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:10.704734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '665169ea83b842c2b467df08d528f571'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:10.706290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '665169ea83b842c2b467df08d528f571'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:10.718346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e29f3f-b6d1-4266-9db7-14164acfd6d4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:10.811243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '665169ea83b842c2b467df08d528f571'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:10.813750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '665169ea83b842c2b467df08d528f571'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:10.814569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dc9e3-dda9-483d-bc59-52b4746c81e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:10.816924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc9e3-dda9-483d-bc59-52b4746c81e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:10.817396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc9e3-dda9-483d-bc59-52b4746c81e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:10.817771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914dc9e3-dda9-483d-bc59-52b4746c81e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:10.820212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dc9e3-dda9-483d-bc59-52b4746c81e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:10.824543 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2134/4233] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:35:10 2022] PATCH /identity/v3/domains/665169ea83b842c2b467df08d528f571 => generated 277 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:10.828943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:10.834120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:10.834375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914dc9e3-dda9-483d-bc59-52b4746c81e3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:10.873183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab5ba1-3cf9-4bb1-8f12-4c76ab702160 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:10.890169 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2100/4234] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:10 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:10.891451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dc9e3-dda9-483d-bc59-52b4746c81e3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:10.900207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-914dc9e3-dda9-483d-bc59-52b4746c81e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:10.902489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7428b3-76ac-40cc-a258-442099f50a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:10.906163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7428b3-76ac-40cc-a258-442099f50a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:10.914103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7428b3-76ac-40cc-a258-442099f50a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:10.915739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7428b3-76ac-40cc-a258-442099f50a95 admin admin] PATH_INFO: `/v3/projects/0e6d691539884e368f15b71eeea6871c/users/e5e536ba36df437f9611c808dcdc0539/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:11.000459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7428b3-76ac-40cc-a258-442099f50a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6d691539884e368f15b71eeea6871c, user_id=e5e536ba36df437f9611c808dcdc0539, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:11.003320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7428b3-76ac-40cc-a258-442099f50a95 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:11.048415 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2135/4235] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:10 2022] PUT /identity/v3/projects/0e6d691539884e368f15b71eeea6871c/users/e5e536ba36df437f9611c808dcdc0539/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:11.048415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7428b3-76ac-40cc-a258-442099f50a95 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:11.049178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6b7428b3-76ac-40cc-a258-442099f50a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:11.101354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914dc9e3-dda9-483d-bc59-52b4746c81e3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:11.201530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:11.240747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7428b3-76ac-40cc-a258-442099f50a95 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:11.254449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aede2-5bd6-4267-ace7-b59b72dae83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:11.261674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aede2-5bd6-4267-ace7-b59b72dae83e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:11.261674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aede2-5bd6-4267-ace7-b59b72dae83e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:11.261674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aede2-5bd6-4267-ace7-b59b72dae83e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:11.261674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aede2-5bd6-4267-ace7-b59b72dae83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:11.263244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aede2-5bd6-4267-ace7-b59b72dae83e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:11.286987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:11.287731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:11.288014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:11.288290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/665169ea83b842c2b467df08d528f571` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:11.304395 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2136/4236] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:11.306658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf225a20-5c47-4787-925d-fe5c0c786641 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:11.307067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf225a20-5c47-4787-925d-fe5c0c786641 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:11.308806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf225a20-5c47-4787-925d-fe5c0c786641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:11.318799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=665169ea83b842c2b467df08d528f571)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:11.319913 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:11.319913 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:35:11.319913 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:35:11.321829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:11.364507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:11.366044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cf225a20-5c47-4787-925d-fe5c0c786641 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:11.372598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cf225a20-5c47-4787-925d-fe5c0c786641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:11.394699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '665169ea83b842c2b467df08d528f571'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:11.404514 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2137/4237] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:11.404745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '665169ea83b842c2b467df08d528f571'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:11.404842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf225a20-5c47-4787-925d-fe5c0c786641 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:11.469554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf225a20-5c47-4787-925d-fe5c0c786641 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:11.487135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb01df-c572-4c49-870a-420061e841b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:11.487820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb01df-c572-4c49-870a-420061e841b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:11.488137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb01df-c572-4c49-870a-420061e841b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:11.488934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb01df-c572-4c49-870a-420061e841b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:11.491238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb01df-c572-4c49-870a-420061e841b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:11.497440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb01df-c572-4c49-870a-420061e841b9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:11.531461 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2138/4238] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:11.538982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb01df-c572-4c49-870a-420061e841b9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:11.551865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665169ea83b842c2b467df08d528f571', 'request_id': 'req-251fb732-a176-4410-a103-02de864c65ec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:11.563128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb01df-c572-4c49-870a-420061e841b9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:11.576631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665169ea83b842c2b467df08d528f571', 'request_id': 'req-251fb732-a176-4410-a103-02de864c65ec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:11.590098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665169ea83b842c2b467df08d528f571', 'request_id': 'req-251fb732-a176-4410-a103-02de864c65ec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:11.647159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] The token cache is being invalidate because project 665169ea83b842c2b467df08d528f571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:11.647727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:11.658811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:11.694179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '665169ea83b842c2b467df08d528f571', 'request_id': 'req-251fb732-a176-4410-a103-02de864c65ec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:11.697091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '665169ea83b842c2b467df08d528f571', 'request_id': 'req-251fb732-a176-4410-a103-02de864c65ec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:11.725445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '665169ea83b842c2b467df08d528f571', 'request_id': 'req-251fb732-a176-4410-a103-02de864c65ec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:11.750039 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2101/4239] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:35:10 2022] DELETE /identity/v3/domains/665169ea83b842c2b467df08d528f571 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:11.751388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:11.760098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:11.782663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69630421-8a65-47b9-bda3-332f4aba29f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:11.783986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69630421-8a65-47b9-bda3-332f4aba29f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:11.783986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69630421-8a65-47b9-bda3-332f4aba29f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:11.784383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69630421-8a65-47b9-bda3-332f4aba29f2 admin admin] PATH_INFO: `/v3/projects/d83ccb2eccbe4750b4b2ae68c4c75959/users/bb9948c2d5464ca69ba3d98e5c9a5dd6/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:11.844766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69630421-8a65-47b9-bda3-332f4aba29f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83ccb2eccbe4750b4b2ae68c4c75959, user_id=bb9948c2d5464ca69ba3d98e5c9a5dd6, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:11.847734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69630421-8a65-47b9-bda3-332f4aba29f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:11.870868 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2139/4240] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:11 2022] PUT /identity/v3/projects/d83ccb2eccbe4750b4b2ae68c4c75959/users/bb9948c2d5464ca69ba3d98e5c9a5dd6/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:11.871659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69630421-8a65-47b9-bda3-332f4aba29f2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:11.876671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-69630421-8a65-47b9-bda3-332f4aba29f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:11.970957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69630421-8a65-47b9-bda3-332f4aba29f2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:11.973342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fb732-a176-4410-a103-02de864c65ec tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:11.977174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d2f98-9122-47c7-adcc-877f4622ab41 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:11.978043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d2f98-9122-47c7-adcc-877f4622ab41 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:11.978415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d2f98-9122-47c7-adcc-877f4622ab41 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:11.978802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d2f98-9122-47c7-adcc-877f4622ab41 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:11.979592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d2f98-9122-47c7-adcc-877f4622ab41 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:11.981353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d2f98-9122-47c7-adcc-877f4622ab41 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:12.007413 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2140/4241] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:35:11 2022] POST /identity/v3/domains => generated 277 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:12.013594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221fe6a-d3a9-4944-9299-048a968b681c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:12.015547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221fe6a-d3a9-4944-9299-048a968b681c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:12.017589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221fe6a-d3a9-4944-9299-048a968b681c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:12.123966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d221fe6a-d3a9-4944-9299-048a968b681c None None] MFA Rules not processed for user `bb9948c2d5464ca69ba3d98e5c9a5dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:12.127792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d221fe6a-d3a9-4944-9299-048a968b681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:12.162859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1ff9-dbff-4495-92b8-0cfb423bafc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:12.164272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1ff9-dbff-4495-92b8-0cfb423bafc4 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:12.165993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1ff9-dbff-4495-92b8-0cfb423bafc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:12.166397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1ff9-dbff-4495-92b8-0cfb423bafc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:12.173774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4f2a1ff9-dbff-4495-92b8-0cfb423bafc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:12.226051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:12.308242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:12.403022 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2141/4242] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:12.403022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221fe6a-d3a9-4944-9299-048a968b681c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:12.440571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1ff9-dbff-4495-92b8-0cfb423bafc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:12.448358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1ff9-dbff-4495-92b8-0cfb423bafc4 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:12.491809 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2102/4243] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:12.501443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1ff9-dbff-4495-92b8-0cfb423bafc4 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:12.612034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221fe6a-d3a9-4944-9299-048a968b681c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:12.622661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4375-ef23-4ad8-8241-1a552a206fc2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:12.623488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4375-ef23-4ad8-8241-1a552a206fc2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:12.623872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4375-ef23-4ad8-8241-1a552a206fc2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:12.624281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4375-ef23-4ad8-8241-1a552a206fc2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:12.625086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e4375-ef23-4ad8-8241-1a552a206fc2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=ca21d6ed905e4f47931fd795d6eba401)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:12.626974 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-781e4375-ef23-4ad8-8241-1a552a206fc2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:12.626974 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:12.626974 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:12.628968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e4375-ef23-4ad8-8241-1a552a206fc2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:12.675124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1ff9-dbff-4495-92b8-0cfb423bafc4 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:12.699212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab5967-484f-4bbd-9475-547cb2a5b16c tempest-IdentityCatalogTest-549951913 tempest-IdentityCatalogTest-549951913-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb9948c2d5464ca69ba3d98e5c9a5dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd83ccb2eccbe4750b4b2ae68c4c75959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:12.700015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab5967-484f-4bbd-9475-547cb2a5b16c tempest-IdentityCatalogTest-549951913 tempest-IdentityCatalogTest-549951913-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:12.703204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab5967-484f-4bbd-9475-547cb2a5b16c tempest-IdentityCatalogTest-549951913 tempest-IdentityCatalogTest-549951913-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:12.703563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab5967-484f-4bbd-9475-547cb2a5b16c tempest-IdentityCatalogTest-549951913 tempest-IdentityCatalogTest-549951913-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:12.704302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab5967-484f-4bbd-9475-547cb2a5b16c tempest-IdentityCatalogTest-549951913 tempest-IdentityCatalogTest-549951913-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:12.705521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab5967-484f-4bbd-9475-547cb2a5b16c tempest-IdentityCatalogTest-549951913 tempest-IdentityCatalogTest-549951913-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:12.717133 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2103/4244] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Aug 30 04:35:12 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:12.717133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbbdd4-bfeb-491f-a416-71af4d0f291d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:12.717133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbbdd4-bfeb-491f-a416-71af4d0f291d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:12.717133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbbdd4-bfeb-491f-a416-71af4d0f291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:12.750756 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2142/4245] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:35:12 2022] PUT /identity/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config => generated 138 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:12.751635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4375-ef23-4ad8-8241-1a552a206fc2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:12.757045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-781e4375-ef23-4ad8-8241-1a552a206fc2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:12.784856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0efbbdd4-bfeb-491f-a416-71af4d0f291d None None] MFA Rules not processed for user `95df76be403a478aa03361450ea1b130`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:12.787921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0efbbdd4-bfeb-491f-a416-71af4d0f291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:12.890682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4375-ef23-4ad8-8241-1a552a206fc2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:12.901422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:12.902368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:12.905180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:12.905629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] PATH_INFO: `/v3/users/bb9948c2d5464ca69ba3d98e5c9a5dd6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:12.907079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9948c2d5464ca69ba3d98e5c9a5dd6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:12.912220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:12.957101 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2104/4246] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:12.958742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbbdd4-bfeb-491f-a416-71af4d0f291d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:12.988901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbbdd4-bfeb-491f-a416-71af4d0f291d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:12.999522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c3528-3d24-4c1b-8450-f247a9275b90 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:13.000479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c3528-3d24-4c1b-8450-f247a9275b90 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:13.000932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c3528-3d24-4c1b-8450-f247a9275b90 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:13.001788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c3528-3d24-4c1b-8450-f247a9275b90 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:13.003290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c3528-3d24-4c1b-8450-f247a9275b90 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=ca21d6ed905e4f47931fd795d6eba401)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:13.004425 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-c84c3528-3d24-4c1b-8450-f247a9275b90 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:13.004425 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:35:13.004425 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:35:13.015156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c3528-3d24-4c1b-8450-f247a9275b90 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:13.017298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:13.036791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9948c2d5464ca69ba3d98e5c9a5dd6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:13.042328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9948c2d5464ca69ba3d98e5c9a5dd6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:13.072242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9948c2d5464ca69ba3d98e5c9a5dd6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:13.077754 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2105/4247] 10.222.0.43 () {60 vars in 1271 bytes} [Tue Aug 30 04:35:12 2022] PATCH /identity/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config => generated 141 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:13.077754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c3528-3d24-4c1b-8450-f247a9275b90 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:13.079684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c84c3528-3d24-4c1b-8450-f247a9275b90 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:13.091844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9948c2d5464ca69ba3d98e5c9a5dd6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:13.147292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9948c2d5464ca69ba3d98e5c9a5dd6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:13.152246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:13.170098 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2143/4248] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:12 2022] DELETE /identity/v3/users/bb9948c2d5464ca69ba3d98e5c9a5dd6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:13.171164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:13.176731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:13.279945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c3528-3d24-4c1b-8450-f247a9275b90 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:13.310585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d010-9f2a-401c-af23-c78990517e4d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:13.317475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bb236-fbdc-4ef0-91f2-f70cb457bf2c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:13.319779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb236-fbdc-4ef0-91f2-f70cb457bf2c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:13.320172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb236-fbdc-4ef0-91f2-f70cb457bf2c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:13.320605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bb236-fbdc-4ef0-91f2-f70cb457bf2c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:13.322071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bb236-fbdc-4ef0-91f2-f70cb457bf2c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ca21d6ed905e4f47931fd795d6eba401)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:13.324203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bb236-fbdc-4ef0-91f2-f70cb457bf2c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:13.332662 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2144/4249] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:13 2022] GET /identity/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config => generated 141 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:13.335666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769ed7-d0c4-4afe-93f4-a65d0a1db6dc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:13.337367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769ed7-d0c4-4afe-93f4-a65d0a1db6dc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:13.338100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769ed7-d0c4-4afe-93f4-a65d0a1db6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:13.380705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-58769ed7-d0c4-4afe-93f4-a65d0a1db6dc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:13.384444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-58769ed7-d0c4-4afe-93f4-a65d0a1db6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:13.450298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28122c-e891-48f7-b31d-ef5dbb9a8ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:13.451898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28122c-e891-48f7-b31d-ef5dbb9a8ade service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:13.452739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28122c-e891-48f7-b31d-ef5dbb9a8ade service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:13.453416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28122c-e891-48f7-b31d-ef5dbb9a8ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:13.457228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ea28122c-e891-48f7-b31d-ef5dbb9a8ade service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:13.507980 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2145/4250] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:13.507980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769ed7-d0c4-4afe-93f4-a65d0a1db6dc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:13.531404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769ed7-d0c4-4afe-93f4-a65d0a1db6dc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:13.538096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd905595-3c5f-47f9-bc77-4c453edb8826 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:13.538900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905595-3c5f-47f9-bc77-4c453edb8826 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:13.539275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905595-3c5f-47f9-bc77-4c453edb8826 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:13.540408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905595-3c5f-47f9-bc77-4c453edb8826 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:13.540797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd905595-3c5f-47f9-bc77-4c453edb8826 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ca21d6ed905e4f47931fd795d6eba401)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:13.547330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd905595-3c5f-47f9-bc77-4c453edb8826 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:13.569002 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2146/4251] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:13 2022] DELETE /identity/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:13.570191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd905595-3c5f-47f9-bc77-4c453edb8826 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:13.575665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cd905595-3c5f-47f9-bc77-4c453edb8826 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:13.600475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28122c-e891-48f7-b31d-ef5dbb9a8ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:13.602467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28122c-e891-48f7-b31d-ef5dbb9a8ade service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:13.626897 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2106/4252] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:13.627788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28122c-e891-48f7-b31d-ef5dbb9a8ade service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:13.659569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28122c-e891-48f7-b31d-ef5dbb9a8ade service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:13.688936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a6225-5928-4f5d-a5a8-5ece5d4be431 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:13.689778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a6225-5928-4f5d-a5a8-5ece5d4be431 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:13.689994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a6225-5928-4f5d-a5a8-5ece5d4be431 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:13.690249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a6225-5928-4f5d-a5a8-5ece5d4be431 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:13.695934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a6225-5928-4f5d-a5a8-5ece5d4be431 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ca21d6ed905e4f47931fd795d6eba401)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:13.707550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a6225-5928-4f5d-a5a8-5ece5d4be431 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:13.710747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:13.733811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd905595-3c5f-47f9-bc77-4c453edb8826 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:13.738843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120dc30-0f78-4ac7-a9dc-8650dc4fa1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:13.739651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120dc30-0f78-4ac7-a9dc-8650dc4fa1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:13.739966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120dc30-0f78-4ac7-a9dc-8650dc4fa1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:13.740327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120dc30-0f78-4ac7-a9dc-8650dc4fa1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3a5a6225-5928-4f5d-a5a8-5ece5d4be431 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Could not find any options in domain configuration for domain ca21d6ed905e4f47931fd795d6eba401.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain ca21d6ed905e4f47931fd795d6eba401. Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:35:13.750006 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 30 04:35:13.750964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 30 04:35:13.750964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 30 04:35:13.750964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 30 04:35:13.750964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:35:13.750964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:35:13.750964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 30 04:35:13.750964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 30 04:35:13.750964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain ca21d6ed905e4f47931fd795d6eba401. Aug 30 04:35:13.750964 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:13.755440 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2107/4253] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:13 2022] GET /identity/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config => generated 151 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:35:13.766082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a6225-5928-4f5d-a5a8-5ece5d4be431 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:13.789591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a6225-5928-4f5d-a5a8-5ece5d4be431 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:13.802991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e95c3-6134-4e13-a9fe-b3b70b61dbdb tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:13.803676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e95c3-6134-4e13-a9fe-b3b70b61dbdb tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:13.803960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e95c3-6134-4e13-a9fe-b3b70b61dbdb tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:13.804254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e95c3-6134-4e13-a9fe-b3b70b61dbdb tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:13.804834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e95c3-6134-4e13-a9fe-b3b70b61dbdb tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ca21d6ed905e4f47931fd795d6eba401)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:13.805930 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-e21e95c3-6134-4e13-a9fe-b3b70b61dbdb tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:13.805930 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:35:13.805930 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:35:13.806842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e95c3-6134-4e13-a9fe-b3b70b61dbdb tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:13.807424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120dc30-0f78-4ac7-a9dc-8650dc4fa1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:13.814493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120dc30-0f78-4ac7-a9dc-8650dc4fa1c5 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:13.828516 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2108/4254] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:13 2022] DELETE /identity/v3/domains/ca21d6ed905e4f47931fd795d6eba401/config => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:13.829681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e95c3-6134-4e13-a9fe-b3b70b61dbdb tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:13.855200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e95c3-6134-4e13-a9fe-b3b70b61dbdb tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:13.867641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:13.869271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:13.869565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:13.871371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/ca21d6ed905e4f47931fd795d6eba401` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:13.873089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ca21d6ed905e4f47931fd795d6eba401)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:13.877465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:13.885421 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2147/4255] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:13.933605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:13.938588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:13.994478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:13.995770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.003261 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2109/4256] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:35:13 2022] PATCH /identity/v3/domains/ca21d6ed905e4f47931fd795d6eba401 => generated 278 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:35:14.005788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120dc30-0f78-4ac7-a9dc-8650dc4fa1c5 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:14.056959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120dc30-0f78-4ac7-a9dc-8650dc4fa1c5 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:14.287230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:14.288375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:14.289199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:14.289795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/ca21d6ed905e4f47931fd795d6eba401` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:14.330797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ca21d6ed905e4f47931fd795d6eba401)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:14.334245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:14.467329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.499530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.675699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401', 'request_id': 'req-898c78cf-5ae8-40b0-9084-8f721835d6a3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.685052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401', 'request_id': 'req-898c78cf-5ae8-40b0-9084-8f721835d6a3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.698699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401', 'request_id': 'req-898c78cf-5ae8-40b0-9084-8f721835d6a3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.733337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] The token cache is being invalidate because project ca21d6ed905e4f47931fd795d6eba401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:14.733647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.737378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.765342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401', 'request_id': 'req-898c78cf-5ae8-40b0-9084-8f721835d6a3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.768545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401', 'request_id': 'req-898c78cf-5ae8-40b0-9084-8f721835d6a3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.771267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ca21d6ed905e4f47931fd795d6eba401', 'request_id': 'req-898c78cf-5ae8-40b0-9084-8f721835d6a3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:14.803290 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2148/4257] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:35:14 2022] DELETE /identity/v3/domains/ca21d6ed905e4f47931fd795d6eba401 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:14.808392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:14.812660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:14.884181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4855c3-6c7d-4226-bf31-13de26fe7074 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:14.893159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:15.111710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f136fba-4ebf-4a7a-8727-d9ce5c626714 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:15.112389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f136fba-4ebf-4a7a-8727-d9ce5c626714 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:15.112670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f136fba-4ebf-4a7a-8727-d9ce5c626714 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:15.112945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f136fba-4ebf-4a7a-8727-d9ce5c626714 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:15.113689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f136fba-4ebf-4a7a-8727-d9ce5c626714 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:15.117479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f136fba-4ebf-4a7a-8727-d9ce5c626714 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:15.156167 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2110/4258] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:35:14 2022] POST /identity/v3/domains => generated 277 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:15.160501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:15.162304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:15.193078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c78cf-5ae8-40b0-9084-8f721835d6a3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:15.264644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:15.371403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10738b-62f9-4a88-a0cb-b2c5ccd647b8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:15.372562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10738b-62f9-4a88-a0cb-b2c5ccd647b8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:15.372709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10738b-62f9-4a88-a0cb-b2c5ccd647b8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:15.373077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10738b-62f9-4a88-a0cb-b2c5ccd647b8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:15.374814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10738b-62f9-4a88-a0cb-b2c5ccd647b8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=610c558e73cd4d4c830da0f2665f6e2d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:15.379090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10738b-62f9-4a88-a0cb-b2c5ccd647b8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:15.483268 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2149/4259] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:35:15 2022] PUT /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config => generated 138 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:15.487525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f136fba-4ebf-4a7a-8727-d9ce5c626714 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:15.505453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f136fba-4ebf-4a7a-8727-d9ce5c626714 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:15.516100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3858d-0794-47cd-b7c0-6831654e00c9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:15.516784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3858d-0794-47cd-b7c0-6831654e00c9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:15.517060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3858d-0794-47cd-b7c0-6831654e00c9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:15.517336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3858d-0794-47cd-b7c0-6831654e00c9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:15.518347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3858d-0794-47cd-b7c0-6831654e00c9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=610c558e73cd4d4c830da0f2665f6e2d, group=identity)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:15.520086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3858d-0794-47cd-b7c0-6831654e00c9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:15.594645 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2111/4260] 10.222.0.43 () {60 vars in 1297 bytes} [Tue Aug 30 04:35:15 2022] PATCH /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity => generated 177 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:15.599144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10738b-62f9-4a88-a0cb-b2c5ccd647b8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:15.613700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10738b-62f9-4a88-a0cb-b2c5ccd647b8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:15.626960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db0ea-d84e-4ee5-bdcd-6c82b4d994cc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:15.627752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db0ea-d84e-4ee5-bdcd-6c82b4d994cc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:15.627857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db0ea-d84e-4ee5-bdcd-6c82b4d994cc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:15.628125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7db0ea-d84e-4ee5-bdcd-6c82b4d994cc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity/driver` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:15.628819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7db0ea-d84e-4ee5-bdcd-6c82b4d994cc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=610c558e73cd4d4c830da0f2665f6e2d, group=identity, option=driver)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:15.632483 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-4b7db0ea-d84e-4ee5-bdcd-6c82b4d994cc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:15.632483 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:15.632483 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:15.633423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7db0ea-d84e-4ee5-bdcd-6c82b4d994cc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:15.703696 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2150/4261] 10.222.0.43 () {60 vars in 1318 bytes} [Tue Aug 30 04:35:15 2022] PATCH /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity/driver => generated 176 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:15.712503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3858d-0794-47cd-b7c0-6831654e00c9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:15.736768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3858d-0794-47cd-b7c0-6831654e00c9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:15.757682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d838b-824d-4002-8c8b-3783b41dd577 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:15.758774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d838b-824d-4002-8c8b-3783b41dd577 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:15.759252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d838b-824d-4002-8c8b-3783b41dd577 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:15.759727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d838b-824d-4002-8c8b-3783b41dd577 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity/driver` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:15.761984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d838b-824d-4002-8c8b-3783b41dd577 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=610c558e73cd4d4c830da0f2665f6e2d, group=identity, option=driver)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:15.766174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db0ea-d84e-4ee5-bdcd-6c82b4d994cc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:15.769085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4b7db0ea-d84e-4ee5-bdcd-6c82b4d994cc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:15.781451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d838b-824d-4002-8c8b-3783b41dd577 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:15.857984 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2112/4262] 10.222.0.43 () {58 vars in 1299 bytes} [Tue Aug 30 04:35:15 2022] DELETE /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity/driver => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:15.863056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d838b-824d-4002-8c8b-3783b41dd577 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:15.906643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d838b-824d-4002-8c8b-3783b41dd577 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:15.932720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587afca-9bae-4ff9-b7be-d6514475a1ba tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:15.933860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587afca-9bae-4ff9-b7be-d6514475a1ba tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:15.934377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587afca-9bae-4ff9-b7be-d6514475a1ba tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:15.934865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587afca-9bae-4ff9-b7be-d6514475a1ba tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity/driver` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:15.956923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587afca-9bae-4ff9-b7be-d6514475a1ba tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=610c558e73cd4d4c830da0f2665f6e2d, group=identity, option=driver)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:15.961414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587afca-9bae-4ff9-b7be-d6514475a1ba tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:15.994842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7db0ea-d84e-4ee5-bdcd-6c82b4d994cc tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:16.000273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:16.001427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:16.002256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:16.003166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] PATH_INFO: `/v3/projects/d83ccb2eccbe4750b4b2ae68c4c75959` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:16.005359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83ccb2eccbe4750b4b2ae68c4c75959)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:16.008400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6587afca-9bae-4ff9-b7be-d6514475a1ba tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Could not find option driver in group identity in domain configuration for domain 610c558e73cd4d4c830da0f2665f6e2d.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 610c558e73cd4d4c830da0f2665f6e2d. Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:35:16.019090 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 30 04:35:16.020891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 30 04:35:16.020891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 30 04:35:16.020891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 30 04:35:16.020891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:35:16.020891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:35:16.020891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 30 04:35:16.020891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 30 04:35:16.020891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 610c558e73cd4d4c830da0f2665f6e2d. Aug 30 04:35:16.020891 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:16.029600 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2113/4263] 10.222.0.43 () {58 vars in 1296 bytes} [Tue Aug 30 04:35:15 2022] GET /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity/driver => generated 171 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:35:16.035365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587afca-9bae-4ff9-b7be-d6514475a1ba tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:16.094311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587afca-9bae-4ff9-b7be-d6514475a1ba tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:16.155188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83ccb2eccbe4750b4b2ae68c4c75959', 'request_id': 'req-30ae9503-44b3-4d9a-8f99-013be03d6759'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:16.176790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83ccb2eccbe4750b4b2ae68c4c75959', 'request_id': 'req-30ae9503-44b3-4d9a-8f99-013be03d6759'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:16.226203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83ccb2eccbe4750b4b2ae68c4c75959', 'request_id': 'req-30ae9503-44b3-4d9a-8f99-013be03d6759'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:16.247829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:16.264105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] The token cache is being invalidate because project d83ccb2eccbe4750b4b2ae68c4c75959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:16.264610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:16.265486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-30ae9503-44b3-4d9a-8f99-013be03d6759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:16.272273 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2151/4264] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:15 2022] DELETE /identity/v3/projects/d83ccb2eccbe4750b4b2ae68c4c75959 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:16.281006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0532c2-f282-44ca-b237-86edd62d38c3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:16.281670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0532c2-f282-44ca-b237-86edd62d38c3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:16.282514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0532c2-f282-44ca-b237-86edd62d38c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:16.343292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96cc9d-0f6f-4b02-8b46-7dc2c48b52f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:16.343292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96cc9d-0f6f-4b02-8b46-7dc2c48b52f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:16.343691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96cc9d-0f6f-4b02-8b46-7dc2c48b52f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:16.343691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96cc9d-0f6f-4b02-8b46-7dc2c48b52f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:16.344412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96cc9d-0f6f-4b02-8b46-7dc2c48b52f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=610c558e73cd4d4c830da0f2665f6e2d, group=identity)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:16.346011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96cc9d-0f6f-4b02-8b46-7dc2c48b52f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:16.390618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9d0532c2-f282-44ca-b237-86edd62d38c3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:16.393307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9d0532c2-f282-44ca-b237-86edd62d38c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:16.423290 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2114/4265] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Aug 30 04:35:16 2022] DELETE /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:16.429142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96cc9d-0f6f-4b02-8b46-7dc2c48b52f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:16.431203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-da96cc9d-0f6f-4b02-8b46-7dc2c48b52f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:16.495228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96cc9d-0f6f-4b02-8b46-7dc2c48b52f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:16.517664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb61ff-350f-4dee-ab29-dd957dc6a12a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:16.518851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb61ff-350f-4dee-ab29-dd957dc6a12a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:16.519918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb61ff-350f-4dee-ab29-dd957dc6a12a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:16.521312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb61ff-350f-4dee-ab29-dd957dc6a12a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:16.527246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb61ff-350f-4dee-ab29-dd957dc6a12a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=610c558e73cd4d4c830da0f2665f6e2d, group=identity)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:16.535631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb61ff-350f-4dee-ab29-dd957dc6a12a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-caeb61ff-350f-4dee-ab29-dd957dc6a12a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Could not find group identity in domain configuration for domain 610c558e73cd4d4c830da0f2665f6e2d.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 610c558e73cd4d4c830da0f2665f6e2d. Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:35:16.569815 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 30 04:35:16.570798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 30 04:35:16.570798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 30 04:35:16.570798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 30 04:35:16.570798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:35:16.570798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:35:16.570798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 30 04:35:16.570798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 30 04:35:16.570798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 610c558e73cd4d4c830da0f2665f6e2d. Aug 30 04:35:16.570798 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:16.576931 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2115/4266] 10.222.0.43 () {58 vars in 1275 bytes} [Tue Aug 30 04:35:16 2022] GET /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config/identity => generated 154 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:35:16.578000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb61ff-350f-4dee-ab29-dd957dc6a12a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:16.624912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb61ff-350f-4dee-ab29-dd957dc6a12a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:16.651602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd691f6b-152a-48ba-a1c9-43cab1425fc8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:16.652976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd691f6b-152a-48ba-a1c9-43cab1425fc8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:16.653719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd691f6b-152a-48ba-a1c9-43cab1425fc8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:16.654232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd691f6b-152a-48ba-a1c9-43cab1425fc8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:16.654361 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2152/4267] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:16.655707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd691f6b-152a-48ba-a1c9-43cab1425fc8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=610c558e73cd4d4c830da0f2665f6e2d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:16.658924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd691f6b-152a-48ba-a1c9-43cab1425fc8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:16.667334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb5233-1fb0-465b-bd5a-f11ae9f8310e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:16.668280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb5233-1fb0-465b-bd5a-f11ae9f8310e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:16.669644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb5233-1fb0-465b-bd5a-f11ae9f8310e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:16.696962 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2116/4268] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:16 2022] DELETE /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d/config => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:16.701969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd691f6b-152a-48ba-a1c9-43cab1425fc8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:16.746585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd691f6b-152a-48ba-a1c9-43cab1425fc8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:16.757327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:16.758241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:16.758449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:16.758623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:16.760542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=610c558e73cd4d4c830da0f2665f6e2d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:16.767304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:16.777371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:16.819672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:16.820907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:16.844424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-56fb5233-1fb0-465b-bd5a-f11ae9f8310e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:16.847992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-56fb5233-1fb0-465b-bd5a-f11ae9f8310e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:16.897779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:16.902483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:16.916070 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2117/4269] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:35:16 2022] PATCH /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d => generated 278 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:16.917533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:16.919074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:17.028632 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2153/4270] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:17.041383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb5233-1fb0-465b-bd5a-f11ae9f8310e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:17.081107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb5233-1fb0-465b-bd5a-f11ae9f8310e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:17.130033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7941-adfa-40df-80d2-f4e35c6bc065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:17.132422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7941-adfa-40df-80d2-f4e35c6bc065 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:17.136080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7941-adfa-40df-80d2-f4e35c6bc065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:17.137371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d7941-adfa-40df-80d2-f4e35c6bc065 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:17.138300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed81a83-c224-497b-9054-f43eb3935a5a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:17.141220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d7941-adfa-40df-80d2-f4e35c6bc065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:17.143410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d7941-adfa-40df-80d2-f4e35c6bc065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:17.145457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d7941-adfa-40df-80d2-f4e35c6bc065 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:17.146974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:17.148300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:17.148708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:17.170877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:17.222297 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2154/4271] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:17.254896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7941-adfa-40df-80d2-f4e35c6bc065 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:17.285344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=610c558e73cd4d4c830da0f2665f6e2d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:17.291774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:17.314797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d7941-adfa-40df-80d2-f4e35c6bc065 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:17.338957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f0872-279f-4b50-9c3e-3d71d49e87da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:17.342627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f0872-279f-4b50-9c3e-3d71d49e87da admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:17.343526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f0872-279f-4b50-9c3e-3d71d49e87da admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:17.344401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f0872-279f-4b50-9c3e-3d71d49e87da admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:17.347122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f0872-279f-4b50-9c3e-3d71d49e87da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:17.353672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f0872-279f-4b50-9c3e-3d71d49e87da admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:17.421908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:17.434720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:17.499878 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2155/4272] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:17 2022] POST /identity/v3/projects => generated 387 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:17.500819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f0872-279f-4b50-9c3e-3d71d49e87da admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:17.598246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d', 'request_id': 'req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:17.659362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d', 'request_id': 'req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:17.678937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d', 'request_id': 'req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:17.711404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f0872-279f-4b50-9c3e-3d71d49e87da admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:17.723518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] The token cache is being invalidate because project 610c558e73cd4d4c830da0f2665f6e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:17.727192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:17.727997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:17.756074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:17.767398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d', 'request_id': 'req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:17.770835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d', 'request_id': 'req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:17.781244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '610c558e73cd4d4c830da0f2665f6e2d', 'request_id': 'req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:17.821232 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2118/4273] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:35:16 2022] DELETE /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:17.829754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:17.834841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:17.857407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:17.953806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f2d29-5d46-48bf-8c1f-576c9bbf4a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:17.954406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f2d29-5d46-48bf-8c1f-576c9bbf4a1a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:17.954686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f2d29-5d46-48bf-8c1f-576c9bbf4a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:17.954965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f2d29-5d46-48bf-8c1f-576c9bbf4a1a admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:17.955628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f2d29-5d46-48bf-8c1f-576c9bbf4a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:17.957742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f2d29-5d46-48bf-8c1f-576c9bbf4a1a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.013665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f84e05-bb50-4d2a-89a3-19be6fa28e5d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.014855 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2156/4274] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:17 2022] POST /identity/v3/users => generated 294 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:18.019963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f2d29-5d46-48bf-8c1f-576c9bbf4a1a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.026515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24e19-21c2-4809-9bbf-12053a03c718 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.026955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7b8f2d29-5d46-48bf-8c1f-576c9bbf4a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:18.027966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24e19-21c2-4809-9bbf-12053a03c718 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.028403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24e19-21c2-4809-9bbf-12053a03c718 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.029013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb24e19-21c2-4809-9bbf-12053a03c718 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.029755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb24e19-21c2-4809-9bbf-12053a03c718 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.031009 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-aeb24e19-21c2-4809-9bbf-12053a03c718 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:18.031009 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:35:18.031009 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:35:18.035803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb24e19-21c2-4809-9bbf-12053a03c718 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.056079 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2119/4275] 10.222.0.43 () {58 vars in 1173 bytes} [Tue Aug 30 04:35:17 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:18.057427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24e19-21c2-4809-9bbf-12053a03c718 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.080145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f2d29-5d46-48bf-8c1f-576c9bbf4a1a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.081342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb24e19-21c2-4809-9bbf-12053a03c718 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.099799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6678037-22a3-4cc3-95e0-7f8a94488ac9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.100834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6678037-22a3-4cc3-95e0-7f8a94488ac9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.101279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6678037-22a3-4cc3-95e0-7f8a94488ac9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.101697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6678037-22a3-4cc3-95e0-7f8a94488ac9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.102537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6678037-22a3-4cc3-95e0-7f8a94488ac9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.104452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6678037-22a3-4cc3-95e0-7f8a94488ac9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.110287 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2120/4276] 10.222.0.43 () {58 vars in 1200 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.111637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6678037-22a3-4cc3-95e0-7f8a94488ac9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.116137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27411440-bd09-49b5-ae52-78a555bac435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.118316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27411440-bd09-49b5-ae52-78a555bac435 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.118650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27411440-bd09-49b5-ae52-78a555bac435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.119040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27411440-bd09-49b5-ae52-78a555bac435 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.119978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27411440-bd09-49b5-ae52-78a555bac435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.140850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6678037-22a3-4cc3-95e0-7f8a94488ac9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.141238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27411440-bd09-49b5-ae52-78a555bac435 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.158425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec7572-8435-4a60-926e-130c74b1e482 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.159123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec7572-8435-4a60-926e-130c74b1e482 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.159397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec7572-8435-4a60-926e-130c74b1e482 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.159669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec7572-8435-4a60-926e-130c74b1e482 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.160636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec7572-8435-4a60-926e-130c74b1e482 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.162614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ec7572-8435-4a60-926e-130c74b1e482 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.167331 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2121/4277] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.168332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec7572-8435-4a60-926e-130c74b1e482 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.176222 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2157/4278] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:18.177380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27411440-bd09-49b5-ae52-78a555bac435 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.193833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ec7572-8435-4a60-926e-130c74b1e482 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.204834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9fa4e-6b80-4780-8e83-97011b6fa591 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.205506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9fa4e-6b80-4780-8e83-97011b6fa591 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.205755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9fa4e-6b80-4780-8e83-97011b6fa591 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.206058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9fa4e-6b80-4780-8e83-97011b6fa591 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.206678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9fa4e-6b80-4780-8e83-97011b6fa591 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.208461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9fa4e-6b80-4780-8e83-97011b6fa591 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.220035 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2122/4279] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.221201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9fa4e-6b80-4780-8e83-97011b6fa591 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.229897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27411440-bd09-49b5-ae52-78a555bac435 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.243264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9fa4e-6b80-4780-8e83-97011b6fa591 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.245634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba3b32-0d86-4c41-b20d-9bbe9e491cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.246396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3b32-0d86-4c41-b20d-9bbe9e491cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.246759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3b32-0d86-4c41-b20d-9bbe9e491cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.247100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba3b32-0d86-4c41-b20d-9bbe9e491cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.249588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba3b32-0d86-4c41-b20d-9bbe9e491cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.254206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba3b32-0d86-4c41-b20d-9bbe9e491cf2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.260909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5d918-f2f1-48e8-9046-433110a437df tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.261954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5d918-f2f1-48e8-9046-433110a437df tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.262443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5d918-f2f1-48e8-9046-433110a437df tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.262890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5d918-f2f1-48e8-9046-433110a437df tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.263872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5d918-f2f1-48e8-9046-433110a437df tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.266027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5d918-f2f1-48e8-9046-433110a437df tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.275528 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2123/4280] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:18.276810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5d918-f2f1-48e8-9046-433110a437df tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.295281 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2158/4281] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:18.296459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba3b32-0d86-4c41-b20d-9bbe9e491cf2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.302118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5d918-f2f1-48e8-9046-433110a437df tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.323426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba3b32-0d86-4c41-b20d-9bbe9e491cf2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.323856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6178c38-9e45-4300-b2bd-868a5df6e02c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.325020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178c38-9e45-4300-b2bd-868a5df6e02c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.325521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178c38-9e45-4300-b2bd-868a5df6e02c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.326114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6178c38-9e45-4300-b2bd-868a5df6e02c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.327303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6178c38-9e45-4300-b2bd-868a5df6e02c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.329706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6178c38-9e45-4300-b2bd-868a5df6e02c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.334835 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2124/4282] 10.222.0.43 () {58 vars in 1200 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.336138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6178c38-9e45-4300-b2bd-868a5df6e02c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.339077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac1618-b92e-49ca-8dbb-04cb644b3a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.339807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1618-b92e-49ca-8dbb-04cb644b3a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.340633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1618-b92e-49ca-8dbb-04cb644b3a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.344893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac1618-b92e-49ca-8dbb-04cb644b3a8e admin admin] PATH_INFO: `/v3/projects/2173d423557b40dab65b77dbc4155d18/users/7c236fad4a5b4bce92a2ce4a64f09bff/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.364049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6178c38-9e45-4300-b2bd-868a5df6e02c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.375996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c566f0-eb69-4308-8ec8-e6c9e500583b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.376849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c566f0-eb69-4308-8ec8-e6c9e500583b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.377241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c566f0-eb69-4308-8ec8-e6c9e500583b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.377624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c566f0-eb69-4308-8ec8-e6c9e500583b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.378690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c566f0-eb69-4308-8ec8-e6c9e500583b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.380697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c566f0-eb69-4308-8ec8-e6c9e500583b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.389506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac1618-b92e-49ca-8dbb-04cb644b3a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2173d423557b40dab65b77dbc4155d18, user_id=7c236fad4a5b4bce92a2ce4a64f09bff, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.393011 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2125/4283] 10.222.0.43 () {58 vars in 1203 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.393948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac1618-b92e-49ca-8dbb-04cb644b3a8e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.394070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c566f0-eb69-4308-8ec8-e6c9e500583b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.421304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c566f0-eb69-4308-8ec8-e6c9e500583b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.435326 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2159/4284] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:18 2022] PUT /identity/v3/projects/2173d423557b40dab65b77dbc4155d18/users/7c236fad4a5b4bce92a2ce4a64f09bff/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:18.450853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9ade-550e-478e-a99c-7474b6999e13 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.451144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9ade-550e-478e-a99c-7474b6999e13 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.451420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9ade-550e-478e-a99c-7474b6999e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.553566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e8ba9ade-550e-478e-a99c-7474b6999e13 None None] MFA Rules not processed for user `7c236fad4a5b4bce92a2ce4a64f09bff`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:18.554889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e8ba9ade-550e-478e-a99c-7474b6999e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:18.565527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552eee-7ce5-44bd-b372-3c7daeb8dc52 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.566231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552eee-7ce5-44bd-b372-3c7daeb8dc52 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.566508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552eee-7ce5-44bd-b372-3c7daeb8dc52 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.566781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e552eee-7ce5-44bd-b372-3c7daeb8dc52 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.567578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e552eee-7ce5-44bd-b372-3c7daeb8dc52 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.571726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e552eee-7ce5-44bd-b372-3c7daeb8dc52 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.578933 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2126/4285] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.579911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552eee-7ce5-44bd-b372-3c7daeb8dc52 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.607526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e552eee-7ce5-44bd-b372-3c7daeb8dc52 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.635509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3167751-7011-45fd-805e-2d9228581426 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.636201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167751-7011-45fd-805e-2d9228581426 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.636542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167751-7011-45fd-805e-2d9228581426 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.636802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167751-7011-45fd-805e-2d9228581426 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.637418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3167751-7011-45fd-805e-2d9228581426 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.639216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3167751-7011-45fd-805e-2d9228581426 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.642726 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2127/4286] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.656861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3167751-7011-45fd-805e-2d9228581426 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.671307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3167751-7011-45fd-805e-2d9228581426 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.685620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541eabf-648a-4b49-9a30-3904187d82c3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.686517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541eabf-648a-4b49-9a30-3904187d82c3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.686801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541eabf-648a-4b49-9a30-3904187d82c3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.687073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541eabf-648a-4b49-9a30-3904187d82c3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.687679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541eabf-648a-4b49-9a30-3904187d82c3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.689361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541eabf-648a-4b49-9a30-3904187d82c3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.694478 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2128/4287] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.695330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541eabf-648a-4b49-9a30-3904187d82c3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.726882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541eabf-648a-4b49-9a30-3904187d82c3 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.753419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea428a-3fd2-483f-a6e3-517238814ba4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.754297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea428a-3fd2-483f-a6e3-517238814ba4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.754758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea428a-3fd2-483f-a6e3-517238814ba4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.755351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea428a-3fd2-483f-a6e3-517238814ba4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.756102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea428a-3fd2-483f-a6e3-517238814ba4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.758345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea428a-3fd2-483f-a6e3-517238814ba4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.774165 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2160/4288] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:18.778259 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2129/4289] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.779548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba9ade-550e-478e-a99c-7474b6999e13 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.789290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea428a-3fd2-483f-a6e3-517238814ba4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.793809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c7ea428a-3fd2-483f-a6e3-517238814ba4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:18.819481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba9ade-550e-478e-a99c-7474b6999e13 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.835576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843918-6ade-435d-a309-81db18b2a52c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.836242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843918-6ade-435d-a309-81db18b2a52c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.836531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843918-6ade-435d-a309-81db18b2a52c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.836857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843918-6ade-435d-a309-81db18b2a52c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.837469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f843918-6ade-435d-a309-81db18b2a52c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.843204 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-8f843918-6ade-435d-a309-81db18b2a52c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:18.843204 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:18.843204 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:18.843851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f843918-6ade-435d-a309-81db18b2a52c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.850357 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2161/4290] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.851381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843918-6ade-435d-a309-81db18b2a52c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.885076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843918-6ade-435d-a309-81db18b2a52c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.898430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af7532-7980-455e-92f3-d94f60e712db tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.899121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7532-7980-455e-92f3-d94f60e712db tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.899404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7532-7980-455e-92f3-d94f60e712db tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.899686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af7532-7980-455e-92f3-d94f60e712db tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.900301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af7532-7980-455e-92f3-d94f60e712db tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.902015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af7532-7980-455e-92f3-d94f60e712db tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.910860 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2162/4291] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.914990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af7532-7980-455e-92f3-d94f60e712db tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.942196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af7532-7980-455e-92f3-d94f60e712db tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.962277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbb1ce-f42c-41ad-a887-d3418866a392 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.962966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbb1ce-f42c-41ad-a887-d3418866a392 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.963245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbb1ce-f42c-41ad-a887-d3418866a392 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.963515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbb1ce-f42c-41ad-a887-d3418866a392 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:18.964137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbb1ce-f42c-41ad-a887-d3418866a392 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:18.970274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbb1ce-f42c-41ad-a887-d3418866a392 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:18.974615 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2163/4292] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:18.976347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea428a-3fd2-483f-a6e3-517238814ba4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:18.979350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbb1ce-f42c-41ad-a887-d3418866a392 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:18.991627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1d63a-4ae9-437b-b4ce-627d2ae79dde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:18.992601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d63a-4ae9-437b-b4ce-627d2ae79dde service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:18.993030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d63a-4ae9-437b-b4ce-627d2ae79dde service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:18.993499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1d63a-4ae9-437b-b4ce-627d2ae79dde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.018051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1d63a-4ae9-437b-b4ce-627d2ae79dde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:19.026225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1d63a-4ae9-437b-b4ce-627d2ae79dde service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:19.044643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbb1ce-f42c-41ad-a887-d3418866a392 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.066329 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2130/4293] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:19.072307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344159b8-0c67-47e7-9f46-54d3ad9535f4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.076043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344159b8-0c67-47e7-9f46-54d3ad9535f4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.079399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344159b8-0c67-47e7-9f46-54d3ad9535f4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.079831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344159b8-0c67-47e7-9f46-54d3ad9535f4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.088787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344159b8-0c67-47e7-9f46-54d3ad9535f4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:19.090668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344159b8-0c67-47e7-9f46-54d3ad9535f4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:19.098897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1d63a-4ae9-437b-b4ce-627d2ae79dde service glance] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:19.100510 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2164/4294] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:18 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:19.116618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1d63a-4ae9-437b-b4ce-627d2ae79dde service glance] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.128872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815dfdb-01cd-498f-b395-4fc1fa91dd26 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.130170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815dfdb-01cd-498f-b395-4fc1fa91dd26 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.130453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815dfdb-01cd-498f-b395-4fc1fa91dd26 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.130825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815dfdb-01cd-498f-b395-4fc1fa91dd26 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.132070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815dfdb-01cd-498f-b395-4fc1fa91dd26 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:19.134034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815dfdb-01cd-498f-b395-4fc1fa91dd26 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:19.140027 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2131/4295] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:19 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:19.140802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344159b8-0c67-47e7-9f46-54d3ad9535f4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:19.161551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344159b8-0c67-47e7-9f46-54d3ad9535f4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.190074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5150ce-bf0b-4fca-9cd3-95e7783bf5ab tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.201923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5150ce-bf0b-4fca-9cd3-95e7783bf5ab tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.203262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5150ce-bf0b-4fca-9cd3-95e7783bf5ab tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.203680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5150ce-bf0b-4fca-9cd3-95e7783bf5ab tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.204525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5150ce-bf0b-4fca-9cd3-95e7783bf5ab tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:19.210925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5150ce-bf0b-4fca-9cd3-95e7783bf5ab tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:19.216813 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2165/4296] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Aug 30 04:35:19 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:19.220366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815dfdb-01cd-498f-b395-4fc1fa91dd26 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:19.241218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815dfdb-01cd-498f-b395-4fc1fa91dd26 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.256205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b7920-41fd-4381-96c8-8899b0acdc86 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.257440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7920-41fd-4381-96c8-8899b0acdc86 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.257736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7920-41fd-4381-96c8-8899b0acdc86 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.258182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7920-41fd-4381-96c8-8899b0acdc86 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.259100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b7920-41fd-4381-96c8-8899b0acdc86 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:19.267158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b7920-41fd-4381-96c8-8899b0acdc86 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:19.272435 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2132/4297] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:19 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:19.277042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5150ce-bf0b-4fca-9cd3-95e7783bf5ab tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:19.309308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47089b7-35c1-4a03-843e-7dcd19ef2aee None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.310529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47089b7-35c1-4a03-843e-7dcd19ef2aee None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.310949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47089b7-35c1-4a03-843e-7dcd19ef2aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.313210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5150ce-bf0b-4fca-9cd3-95e7783bf5ab tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.328176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:19.329743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda197f8-fc72-42db-8564-3030133da2dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.334839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda197f8-fc72-42db-8564-3030133da2dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.337716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda197f8-fc72-42db-8564-3030133da2dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.338590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda197f8-fc72-42db-8564-3030133da2dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.340568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda197f8-fc72-42db-8564-3030133da2dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:19.346824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda197f8-fc72-42db-8564-3030133da2dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:19.358486 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2166/4298] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:19 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:19.364589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda197f8-fc72-42db-8564-3030133da2dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:19.370529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c47089b7-35c1-4a03-843e-7dcd19ef2aee None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:19.375859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c47089b7-35c1-4a03-843e-7dcd19ef2aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:19.396590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda197f8-fc72-42db-8564-3030133da2dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.431955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df82256-7f14-4369-976a-f7bfd8e9f8d1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.435174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df82256-7f14-4369-976a-f7bfd8e9f8d1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.437950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df82256-7f14-4369-976a-f7bfd8e9f8d1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.439491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df82256-7f14-4369-976a-f7bfd8e9f8d1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.440510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df82256-7f14-4369-976a-f7bfd8e9f8d1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:19.448628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df82256-7f14-4369-976a-f7bfd8e9f8d1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:19.463217 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2167/4299] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Aug 30 04:35:19 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:19.467176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df82256-7f14-4369-976a-f7bfd8e9f8d1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:19.501419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df82256-7f14-4369-976a-f7bfd8e9f8d1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.526661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5afb4-2ac4-4227-877d-738c571914f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.527580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5afb4-2ac4-4227-877d-738c571914f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.527966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5afb4-2ac4-4227-877d-738c571914f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.528342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5afb4-2ac4-4227-877d-738c571914f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.529066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5afb4-2ac4-4227-877d-738c571914f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:19.530921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5afb4-2ac4-4227-877d-738c571914f6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:19.535918 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2168/4300] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:19 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:19.539380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff41bc-fcee-453e-be62-79c6d1e61abd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.539761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff41bc-fcee-453e-be62-79c6d1e61abd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.540117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff41bc-fcee-453e-be62-79c6d1e61abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.607091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-83ff41bc-fcee-453e-be62-79c6d1e61abd None None] MFA Rules not processed for user `95df76be403a478aa03361450ea1b130`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:19.608582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-83ff41bc-fcee-453e-be62-79c6d1e61abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:19.634944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:19.740213 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2133/4301] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:35:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:19.744034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47089b7-35c1-4a03-843e-7dcd19ef2aee None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:19.814744 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2169/4302] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:19 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:19.819174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff41bc-fcee-453e-be62-79c6d1e61abd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:19.821514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-83ff41bc-fcee-453e-be62-79c6d1e61abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:19.830245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47089b7-35c1-4a03-843e-7dcd19ef2aee None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.878877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a654a3d-fd7d-4025-b450-44fcc17ba6d8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.882724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a654a3d-fd7d-4025-b450-44fcc17ba6d8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.883017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a654a3d-fd7d-4025-b450-44fcc17ba6d8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.883300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a654a3d-fd7d-4025-b450-44fcc17ba6d8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.883934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a654a3d-fd7d-4025-b450-44fcc17ba6d8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:19.888181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a654a3d-fd7d-4025-b450-44fcc17ba6d8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:19.891589 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2134/4303] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Aug 30 04:35:19 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:19.898002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a654a3d-fd7d-4025-b450-44fcc17ba6d8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:19.921156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a654a3d-fd7d-4025-b450-44fcc17ba6d8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.943213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49784211-cf0f-465a-b46e-a179825efa7a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.944110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49784211-cf0f-465a-b46e-a179825efa7a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.944479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49784211-cf0f-465a-b46e-a179825efa7a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:19.944763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49784211-cf0f-465a-b46e-a179825efa7a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:19.945397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49784211-cf0f-465a-b46e-a179825efa7a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:19.947164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49784211-cf0f-465a-b46e-a179825efa7a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:19.955337 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2135/4304] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:19 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:19.959615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49784211-cf0f-465a-b46e-a179825efa7a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:19.981749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49784211-cf0f-465a-b46e-a179825efa7a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.989034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff41bc-fcee-453e-be62-79c6d1e61abd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:19.998602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41205c2b-2c2b-426a-b105-d13dd9b5bb43 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.999241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e929-190a-4609-8a26-1e6f07d92363 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:19.999717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41205c2b-2c2b-426a-b105-d13dd9b5bb43 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:19.999956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e929-190a-4609-8a26-1e6f07d92363 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.000247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e929-190a-4609-8a26-1e6f07d92363 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.000521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e929-190a-4609-8a26-1e6f07d92363 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.000732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41205c2b-2c2b-426a-b105-d13dd9b5bb43 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.003243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41205c2b-2c2b-426a-b105-d13dd9b5bb43 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.004374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41205c2b-2c2b-426a-b105-d13dd9b5bb43 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.012144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41205c2b-2c2b-426a-b105-d13dd9b5bb43 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.014480 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2136/4305] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Aug 30 04:35:19 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:20.018170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41205c2b-2c2b-426a-b105-d13dd9b5bb43 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.018812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027e929-190a-4609-8a26-1e6f07d92363 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.020339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027e929-190a-4609-8a26-1e6f07d92363 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.033599 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2170/4306] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:35:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:20.045311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41205c2b-2c2b-426a-b105-d13dd9b5bb43 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.062533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4e5d1-075d-4d7a-9075-0d371fcbceae tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.063421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e5d1-075d-4d7a-9075-0d371fcbceae tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.063942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e5d1-075d-4d7a-9075-0d371fcbceae tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.064534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e5d1-075d-4d7a-9075-0d371fcbceae tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.065176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e5d1-075d-4d7a-9075-0d371fcbceae tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.067419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e5d1-075d-4d7a-9075-0d371fcbceae tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.069276 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2137/4307] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:20.074102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e929-190a-4609-8a26-1e6f07d92363 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.104663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e929-190a-4609-8a26-1e6f07d92363 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.114183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1893189-63c7-4bdc-8992-e310a0b8c213 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.115806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893189-63c7-4bdc-8992-e310a0b8c213 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.116410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893189-63c7-4bdc-8992-e310a0b8c213 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.117005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1893189-63c7-4bdc-8992-e310a0b8c213 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.118011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1893189-63c7-4bdc-8992-e310a0b8c213 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.120006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1893189-63c7-4bdc-8992-e310a0b8c213 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.122877 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2171/4308] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:20.127038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4e5d1-075d-4d7a-9075-0d371fcbceae tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.175281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4e5d1-075d-4d7a-9075-0d371fcbceae tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.187446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39362aa9-6422-4294-bbf0-edee86021bdf tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.188839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39362aa9-6422-4294-bbf0-edee86021bdf tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.189476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39362aa9-6422-4294-bbf0-edee86021bdf tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.190331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39362aa9-6422-4294-bbf0-edee86021bdf tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.191601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39362aa9-6422-4294-bbf0-edee86021bdf tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.198190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39362aa9-6422-4294-bbf0-edee86021bdf tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.203638 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2138/4309] 10.222.0.43 () {58 vars in 1290 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:20.208929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1893189-63c7-4bdc-8992-e310a0b8c213 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.265037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1893189-63c7-4bdc-8992-e310a0b8c213 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.284571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246ba46-c2a0-48e0-aa8d-e95078f5be51 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.286071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246ba46-c2a0-48e0-aa8d-e95078f5be51 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.300504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246ba46-c2a0-48e0-aa8d-e95078f5be51 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.302386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246ba46-c2a0-48e0-aa8d-e95078f5be51 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.309861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246ba46-c2a0-48e0-aa8d-e95078f5be51 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.328690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246ba46-c2a0-48e0-aa8d-e95078f5be51 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.338903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39362aa9-6422-4294-bbf0-edee86021bdf tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.340287 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2172/4310] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:20.373049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39362aa9-6422-4294-bbf0-edee86021bdf tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.388598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380332c-7f1d-4f81-852e-5fe0f6b53e2a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.390087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380332c-7f1d-4f81-852e-5fe0f6b53e2a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.391134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380332c-7f1d-4f81-852e-5fe0f6b53e2a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.391658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380332c-7f1d-4f81-852e-5fe0f6b53e2a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.393469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380332c-7f1d-4f81-852e-5fe0f6b53e2a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.406094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380332c-7f1d-4f81-852e-5fe0f6b53e2a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.412189 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2139/4311] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 30 04:35:20.416920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246ba46-c2a0-48e0-aa8d-e95078f5be51 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.456487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246ba46-c2a0-48e0-aa8d-e95078f5be51 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.480064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92757ea5-8fcb-4093-8924-3c44843d47c7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.483644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92757ea5-8fcb-4093-8924-3c44843d47c7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.483644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92757ea5-8fcb-4093-8924-3c44843d47c7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.483644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92757ea5-8fcb-4093-8924-3c44843d47c7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.485221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92757ea5-8fcb-4093-8924-3c44843d47c7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.492901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92757ea5-8fcb-4093-8924-3c44843d47c7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.497308 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2173/4312] 10.222.0.43 () {58 vars in 1308 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 30 04:35:20.501629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380332c-7f1d-4f81-852e-5fe0f6b53e2a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.519730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380332c-7f1d-4f81-852e-5fe0f6b53e2a tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.534661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a313bdd-7b04-4daf-b6e1-949f8762430f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.536293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a313bdd-7b04-4daf-b6e1-949f8762430f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.536849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a313bdd-7b04-4daf-b6e1-949f8762430f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.537287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a313bdd-7b04-4daf-b6e1-949f8762430f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.538125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a313bdd-7b04-4daf-b6e1-949f8762430f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.542674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a313bdd-7b04-4daf-b6e1-949f8762430f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.545777 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2140/4313] 10.222.0.43 () {58 vars in 1290 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 30 04:35:20.556184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92757ea5-8fcb-4093-8924-3c44843d47c7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.593175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92757ea5-8fcb-4093-8924-3c44843d47c7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.604912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe3a4b-d91f-4171-98a9-d489e6d81c7b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.606720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe3a4b-d91f-4171-98a9-d489e6d81c7b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.607174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe3a4b-d91f-4171-98a9-d489e6d81c7b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.607930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe3a4b-d91f-4171-98a9-d489e6d81c7b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.611299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe3a4b-d91f-4171-98a9-d489e6d81c7b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.615824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe3a4b-d91f-4171-98a9-d489e6d81c7b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.620544 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2174/4314] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:20.630436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a313bdd-7b04-4daf-b6e1-949f8762430f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.656292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a313bdd-7b04-4daf-b6e1-949f8762430f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.674788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437d23b-e98f-443b-ad2e-6beb85cc93dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.676496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437d23b-e98f-443b-ad2e-6beb85cc93dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.677794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437d23b-e98f-443b-ad2e-6beb85cc93dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.684707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437d23b-e98f-443b-ad2e-6beb85cc93dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.685441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437d23b-e98f-443b-ad2e-6beb85cc93dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.687153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437d23b-e98f-443b-ad2e-6beb85cc93dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.689923 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2141/4315] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 30 04:35:20.696994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe3a4b-d91f-4171-98a9-d489e6d81c7b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.746447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe3a4b-d91f-4171-98a9-d489e6d81c7b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.798330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e47e07-484f-4dec-9239-ccc12c6b3527 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.799536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e47e07-484f-4dec-9239-ccc12c6b3527 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.800018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e47e07-484f-4dec-9239-ccc12c6b3527 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.800491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e47e07-484f-4dec-9239-ccc12c6b3527 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.814604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e47e07-484f-4dec-9239-ccc12c6b3527 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.820953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e47e07-484f-4dec-9239-ccc12c6b3527 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.826094 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2175/4316] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:20.830372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437d23b-e98f-443b-ad2e-6beb85cc93dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.847287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437d23b-e98f-443b-ad2e-6beb85cc93dd tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.907148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c40073-5102-4a6f-933e-d1bc6c2c028f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.908499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40073-5102-4a6f-933e-d1bc6c2c028f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.909997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40073-5102-4a6f-933e-d1bc6c2c028f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.910690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c40073-5102-4a6f-933e-d1bc6c2c028f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.911437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c40073-5102-4a6f-933e-d1bc6c2c028f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.921545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c40073-5102-4a6f-933e-d1bc6c2c028f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.934165 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2142/4317] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:20.939759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e47e07-484f-4dec-9239-ccc12c6b3527 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:20.963453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e47e07-484f-4dec-9239-ccc12c6b3527 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:20.982649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8532b2-eb32-413f-8e4b-85c9b58057c8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:20.983340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8532b2-eb32-413f-8e4b-85c9b58057c8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:20.983620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8532b2-eb32-413f-8e4b-85c9b58057c8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:20.983896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8532b2-eb32-413f-8e4b-85c9b58057c8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:20.984504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8532b2-eb32-413f-8e4b-85c9b58057c8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:20.986221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8532b2-eb32-413f-8e4b-85c9b58057c8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:20.992510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c40073-5102-4a6f-933e-d1bc6c2c028f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.002339 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2176/4318] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:21.008996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c40073-5102-4a6f-933e-d1bc6c2c028f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.033420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a923-bfde-4975-b4f1-c5f810b88510 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.034127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a923-bfde-4975-b4f1-c5f810b88510 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.034325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a923-bfde-4975-b4f1-c5f810b88510 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.034776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a923-bfde-4975-b4f1-c5f810b88510 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.035555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a923-bfde-4975-b4f1-c5f810b88510 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.038102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a923-bfde-4975-b4f1-c5f810b88510 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.039557 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2143/4319] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Aug 30 04:35:20 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 30 04:35:21.044483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8532b2-eb32-413f-8e4b-85c9b58057c8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.076930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8532b2-eb32-413f-8e4b-85c9b58057c8 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.100094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fdacd-e0f6-4dd3-8eba-a7b130135902 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.100855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fdacd-e0f6-4dd3-8eba-a7b130135902 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.101164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fdacd-e0f6-4dd3-8eba-a7b130135902 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.101406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fdacd-e0f6-4dd3-8eba-a7b130135902 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.102186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fdacd-e0f6-4dd3-8eba-a7b130135902 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.103846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fdacd-e0f6-4dd3-8eba-a7b130135902 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.110163 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2177/4320] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:21.111526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a923-bfde-4975-b4f1-c5f810b88510 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.129846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a923-bfde-4975-b4f1-c5f810b88510 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.158963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9c3fb-d1d6-4d4d-ad7f-084ed66aa020 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.159702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c3fb-d1d6-4d4d-ad7f-084ed66aa020 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.160094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c3fb-d1d6-4d4d-ad7f-084ed66aa020 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.160483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9c3fb-d1d6-4d4d-ad7f-084ed66aa020 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.161275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c3fb-d1d6-4d4d-ad7f-084ed66aa020 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.163827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9c3fb-d1d6-4d4d-ad7f-084ed66aa020 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.168809 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2144/4321] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 30 04:35:21.172998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fdacd-e0f6-4dd3-8eba-a7b130135902 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.189508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fdacd-e0f6-4dd3-8eba-a7b130135902 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.223911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220f04c-6f38-4fdb-bbe8-c64c1d0f16e7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.224606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f04c-6f38-4fdb-bbe8-c64c1d0f16e7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.224892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f04c-6f38-4fdb-bbe8-c64c1d0f16e7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.225173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f04c-6f38-4fdb-bbe8-c64c1d0f16e7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.225799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220f04c-6f38-4fdb-bbe8-c64c1d0f16e7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.244512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc110a-e0dc-409c-86d5-881df20a3f10 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.245090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc110a-e0dc-409c-86d5-881df20a3f10 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.245514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc110a-e0dc-409c-86d5-881df20a3f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.249390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220f04c-6f38-4fdb-bbe8-c64c1d0f16e7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.265262 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2178/4322] 10.222.0.43 () {58 vars in 1257 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:21.266533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220f04c-6f38-4fdb-bbe8-c64c1d0f16e7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.283237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220f04c-6f38-4fdb-bbe8-c64c1d0f16e7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.286715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-03dc110a-e0dc-409c-86d5-881df20a3f10 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:21.289031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-03dc110a-e0dc-409c-86d5-881df20a3f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:21.304083 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2145/4323] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:35:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:21.312826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc110a-e0dc-409c-86d5-881df20a3f10 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.323285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a7961-ff7f-4ac3-a4b0-f85578e1f7f7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.323992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a7961-ff7f-4ac3-a4b0-f85578e1f7f7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.324276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a7961-ff7f-4ac3-a4b0-f85578e1f7f7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.324558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a7961-ff7f-4ac3-a4b0-f85578e1f7f7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.325181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a7961-ff7f-4ac3-a4b0-f85578e1f7f7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.326895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a7961-ff7f-4ac3-a4b0-f85578e1f7f7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.330657 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2179/4324] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:21.336438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc110a-e0dc-409c-86d5-881df20a3f10 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.338970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a7961-ff7f-4ac3-a4b0-f85578e1f7f7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.353486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d792e8f-95bc-436d-9b7b-d557435fdb9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.360825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d792e8f-95bc-436d-9b7b-d557435fdb9a service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.362190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d792e8f-95bc-436d-9b7b-d557435fdb9a service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.362651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d792e8f-95bc-436d-9b7b-d557435fdb9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.392693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d792e8f-95bc-436d-9b7b-d557435fdb9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.396874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d792e8f-95bc-436d-9b7b-d557435fdb9a service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.397138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a7961-ff7f-4ac3-a4b0-f85578e1f7f7 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.417814 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2146/4325] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:21.431923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529397e7-f3fe-4050-9a11-e4222b1dfb4b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.433732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529397e7-f3fe-4050-9a11-e4222b1dfb4b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.444825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529397e7-f3fe-4050-9a11-e4222b1dfb4b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.447111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529397e7-f3fe-4050-9a11-e4222b1dfb4b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.449681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529397e7-f3fe-4050-9a11-e4222b1dfb4b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.454450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529397e7-f3fe-4050-9a11-e4222b1dfb4b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.464151 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2180/4326] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:21.471003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d792e8f-95bc-436d-9b7b-d557435fdb9a service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.507316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d792e8f-95bc-436d-9b7b-d557435fdb9a service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.530314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0d24-5478-4e89-81dd-b3ed77a66224 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.531057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0d24-5478-4e89-81dd-b3ed77a66224 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.531329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0d24-5478-4e89-81dd-b3ed77a66224 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.531727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0d24-5478-4e89-81dd-b3ed77a66224 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.532737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef0d24-5478-4e89-81dd-b3ed77a66224 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.586457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef0d24-5478-4e89-81dd-b3ed77a66224 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.597910 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2147/4327] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:21.599279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529397e7-f3fe-4050-9a11-e4222b1dfb4b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.612784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529397e7-f3fe-4050-9a11-e4222b1dfb4b tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.675039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdbb85-6dd7-4c91-aab0-4523799146b4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.676111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdbb85-6dd7-4c91-aab0-4523799146b4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.676633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdbb85-6dd7-4c91-aab0-4523799146b4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.697642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdbb85-6dd7-4c91-aab0-4523799146b4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.702872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdbb85-6dd7-4c91-aab0-4523799146b4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.705807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdbb85-6dd7-4c91-aab0-4523799146b4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.727775 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2181/4328] 10.222.0.43 () {58 vars in 1212 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 30 04:35:21.734054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0d24-5478-4e89-81dd-b3ed77a66224 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.777412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0d24-5478-4e89-81dd-b3ed77a66224 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.814056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda5fb-6b9f-4cdb-86b0-2b759fd9d96c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.814738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda5fb-6b9f-4cdb-86b0-2b759fd9d96c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.815225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda5fb-6b9f-4cdb-86b0-2b759fd9d96c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.815692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda5fb-6b9f-4cdb-86b0-2b759fd9d96c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.816784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afda5fb-6b9f-4cdb-86b0-2b759fd9d96c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.837286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afda5fb-6b9f-4cdb-86b0-2b759fd9d96c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.839263 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2148/4329] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:21.845599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdbb85-6dd7-4c91-aab0-4523799146b4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:21.907616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdbb85-6dd7-4c91-aab0-4523799146b4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:21.944186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59371604-9602-4905-836d-aad55cb6066d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:21.946518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371604-9602-4905-836d-aad55cb6066d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:21.950009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371604-9602-4905-836d-aad55cb6066d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:21.955862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371604-9602-4905-836d-aad55cb6066d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:21.961769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59371604-9602-4905-836d-aad55cb6066d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:21.979308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59371604-9602-4905-836d-aad55cb6066d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:21.982843 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2182/4330] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:21.987219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda5fb-6b9f-4cdb-86b0-2b759fd9d96c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.024811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda5fb-6b9f-4cdb-86b0-2b759fd9d96c tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.051121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af43eb-3f8d-481e-9d6a-a8760e941798 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.058174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af43eb-3f8d-481e-9d6a-a8760e941798 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.059363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af43eb-3f8d-481e-9d6a-a8760e941798 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.060173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af43eb-3f8d-481e-9d6a-a8760e941798 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.062641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af43eb-3f8d-481e-9d6a-a8760e941798 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.075259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af43eb-3f8d-481e-9d6a-a8760e941798 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.082736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59371604-9602-4905-836d-aad55cb6066d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.092755 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2149/4331] 10.222.0.43 () {58 vars in 1218 bytes} [Tue Aug 30 04:35:21 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:22.121101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59371604-9602-4905-836d-aad55cb6066d tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.142395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e343a6-a24c-499c-883a-e0787a3dcac2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.144265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e343a6-a24c-499c-883a-e0787a3dcac2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.145186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e343a6-a24c-499c-883a-e0787a3dcac2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.147666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e343a6-a24c-499c-883a-e0787a3dcac2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.151256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e343a6-a24c-499c-883a-e0787a3dcac2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.156102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e343a6-a24c-499c-883a-e0787a3dcac2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.167629 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2183/4332] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:22 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:22.172243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af43eb-3f8d-481e-9d6a-a8760e941798 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.209303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af43eb-3f8d-481e-9d6a-a8760e941798 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.232218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5577c8-c69a-4c71-a360-022c06bcd3e9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.233913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5577c8-c69a-4c71-a360-022c06bcd3e9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.234399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5577c8-c69a-4c71-a360-022c06bcd3e9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.234804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5577c8-c69a-4c71-a360-022c06bcd3e9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.235564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5577c8-c69a-4c71-a360-022c06bcd3e9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.241730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5577c8-c69a-4c71-a360-022c06bcd3e9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.246330 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2150/4333] 10.222.0.43 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:22 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:22.248304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e343a6-a24c-499c-883a-e0787a3dcac2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.290943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e343a6-a24c-499c-883a-e0787a3dcac2 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.362498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337a432-3744-42e2-a434-080a8b72c272 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.367858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337a432-3744-42e2-a434-080a8b72c272 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.377402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337a432-3744-42e2-a434-080a8b72c272 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.380877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337a432-3744-42e2-a434-080a8b72c272 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.397334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337a432-3744-42e2-a434-080a8b72c272 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.415302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337a432-3744-42e2-a434-080a8b72c272 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.429090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5577c8-c69a-4c71-a360-022c06bcd3e9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.442925 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2184/4334] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Aug 30 04:35:22 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:22.449504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5577c8-c69a-4c71-a360-022c06bcd3e9 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.459371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226d04a-3fb0-4432-a14d-98c1fab3e8e1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.460500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226d04a-3fb0-4432-a14d-98c1fab3e8e1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.460500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226d04a-3fb0-4432-a14d-98c1fab3e8e1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.460837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226d04a-3fb0-4432-a14d-98c1fab3e8e1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.461310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226d04a-3fb0-4432-a14d-98c1fab3e8e1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.468467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226d04a-3fb0-4432-a14d-98c1fab3e8e1 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.468781 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2151/4335] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Aug 30 04:35:22 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:22.472864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337a432-3744-42e2-a434-080a8b72c272 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.516456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337a432-3744-42e2-a434-080a8b72c272 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.523139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c946b0-97e5-4a8e-ac64-41b47a512f73 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.523730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c946b0-97e5-4a8e-ac64-41b47a512f73 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.524294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c946b0-97e5-4a8e-ac64-41b47a512f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.534618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49c36c-588b-41ec-ab2a-c22025c50da6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.535385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49c36c-588b-41ec-ab2a-c22025c50da6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.535677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49c36c-588b-41ec-ab2a-c22025c50da6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.536157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49c36c-588b-41ec-ab2a-c22025c50da6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.536928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49c36c-588b-41ec-ab2a-c22025c50da6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.540582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed49c36c-588b-41ec-ab2a-c22025c50da6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.547033 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2185/4336] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:35:22 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:22.551094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49c36c-588b-41ec-ab2a-c22025c50da6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.575612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed49c36c-588b-41ec-ab2a-c22025c50da6 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.584250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b4c946b0-97e5-4a8e-ac64-41b47a512f73 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:22.585531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b4c946b0-97e5-4a8e-ac64-41b47a512f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:22.603223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4dd06-d45c-4d47-9791-675227b65aa4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.604526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4dd06-d45c-4d47-9791-675227b65aa4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.605442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4dd06-d45c-4d47-9791-675227b65aa4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.606415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4dd06-d45c-4d47-9791-675227b65aa4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.608026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4dd06-d45c-4d47-9791-675227b65aa4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.613863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4dd06-d45c-4d47-9791-675227b65aa4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.619619 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2152/4337] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:35:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:22.622742 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2186/4338] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:22 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:22.626635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c946b0-97e5-4a8e-ac64-41b47a512f73 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.668973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c946b0-97e5-4a8e-ac64-41b47a512f73 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.684515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d861465-f27f-4649-8441-0a92fd2a456e tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.685482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d861465-f27f-4649-8441-0a92fd2a456e tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.685946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d861465-f27f-4649-8441-0a92fd2a456e tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.686462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d861465-f27f-4649-8441-0a92fd2a456e tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.687686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d861465-f27f-4649-8441-0a92fd2a456e tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.698331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d861465-f27f-4649-8441-0a92fd2a456e tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.699987 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2153/4339] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Aug 30 04:35:22 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:35:22.700962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4dd06-d45c-4d47-9791-675227b65aa4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.707917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d861465-f27f-4649-8441-0a92fd2a456e tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.726791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4dd06-d45c-4d47-9791-675227b65aa4 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.750436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d861465-f27f-4649-8441-0a92fd2a456e tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.773387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503a0b0-9ae8-48b1-8aaa-d97f969a3c9f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.774155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503a0b0-9ae8-48b1-8aaa-d97f969a3c9f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.775047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503a0b0-9ae8-48b1-8aaa-d97f969a3c9f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.775335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503a0b0-9ae8-48b1-8aaa-d97f969a3c9f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/610c558e73cd4d4c830da0f2665f6e2d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.792324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09849f2-b00e-48d5-99f2-9882ec986ad6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.793366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503a0b0-9ae8-48b1-8aaa-d97f969a3c9f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:35:22.801715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09849f2-b00e-48d5-99f2-9882ec986ad6 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.802653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09849f2-b00e-48d5-99f2-9882ec986ad6 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-3503a0b0-9ae8-48b1-8aaa-d97f969a3c9f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Could not find domain: 610c558e73cd4d4c830da0f2665f6e2d.: keystone.exception.DomainNotFound: Could not find domain: 610c558e73cd4d4c830da0f2665f6e2d. Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 610c558e73cd4d4c830da0f2665f6e2d. Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:35:22.805067 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:35:22.807099 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:35:22.809014 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 610c558e73cd4d4c830da0f2665f6e2d. Aug 30 04:35:22.811258 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:22.812391 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2154/4340] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:35:22 2022] PATCH /identity/v3/domains/610c558e73cd4d4c830da0f2665f6e2d => generated 112 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:35:22.812953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09849f2-b00e-48d5-99f2-9882ec986ad6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.815314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503a0b0-9ae8-48b1-8aaa-d97f969a3c9f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.836391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503a0b0-9ae8-48b1-8aaa-d97f969a3c9f tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.850267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09849f2-b00e-48d5-99f2-9882ec986ad6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:22.851271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22738cb-971f-4146-b657-a6cb53389996 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.853154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09849f2-b00e-48d5-99f2-9882ec986ad6 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:22.857710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22738cb-971f-4146-b657-a6cb53389996 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.858464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22738cb-971f-4146-b657-a6cb53389996 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.858920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22738cb-971f-4146-b657-a6cb53389996 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/ca21d6ed905e4f47931fd795d6eba401` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:22.887842 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2187/4341] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:35:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:22.903192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22738cb-971f-4146-b657-a6cb53389996 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-a22738cb-971f-4146-b657-a6cb53389996 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Could not find domain: ca21d6ed905e4f47931fd795d6eba401.: keystone.exception.DomainNotFound: Could not find domain: ca21d6ed905e4f47931fd795d6eba401. Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ca21d6ed905e4f47931fd795d6eba401. Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:35:22.913060 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:35:22.914164 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:35:22.915045 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ca21d6ed905e4f47931fd795d6eba401. Aug 30 04:35:22.915929 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:22.918360 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2155/4342] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:35:22 2022] PATCH /identity/v3/domains/ca21d6ed905e4f47931fd795d6eba401 => generated 112 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:35:22.925908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09849f2-b00e-48d5-99f2-9882ec986ad6 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:22.969571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09849f2-b00e-48d5-99f2-9882ec986ad6 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:22.979057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df0823-0ee2-4bcb-a728-960cf845a763 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0e52d4d6f294c999a25a21da294a66e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2985cb033a243fcbc3ead74a9384e5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:22.980269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0823-0ee2-4bcb-a728-960cf845a763 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:22.980814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0823-0ee2-4bcb-a728-960cf845a763 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:22.981295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df0823-0ee2-4bcb-a728-960cf845a763 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] PATH_INFO: `/v3/domains/665169ea83b842c2b467df08d528f571` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:23.026067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df0823-0ee2-4bcb-a728-960cf845a763 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-94df0823-0ee2-4bcb-a728-960cf845a763 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Could not find domain: 665169ea83b842c2b467df08d528f571.: keystone.exception.DomainNotFound: Could not find domain: 665169ea83b842c2b467df08d528f571. Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 665169ea83b842c2b467df08d528f571. Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:35:23.033753 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:35:23.034932 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:35:23.036353 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 665169ea83b842c2b467df08d528f571. Aug 30 04:35:23.037769 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:35:23.047554 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2188/4343] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:35:22 2022] PATCH /identity/v3/domains/665169ea83b842c2b467df08d528f571 => generated 112 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:35:23.053626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22738cb-971f-4146-b657-a6cb53389996 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:23.065984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a22738cb-971f-4146-b657-a6cb53389996 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:23.307094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9618404-ed33-48a2-918c-9c61aac08676 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:23.307589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9618404-ed33-48a2-918c-9c61aac08676 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:23.307968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9618404-ed33-48a2-918c-9c61aac08676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:23.321381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:23.365365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f9618404-ed33-48a2-918c-9c61aac08676 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:23.367732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f9618404-ed33-48a2-918c-9c61aac08676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:23.377204 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2189/4344] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:35:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:23.393964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22738cb-971f-4146-b657-a6cb53389996 tempest-DomainConfigurationTestJSON-1857579763 tempest-DomainConfigurationTestJSON-1857579763-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:23.395948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9618404-ed33-48a2-918c-9c61aac08676 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:23.415945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:23.417556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:23.418047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:23.419495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] PATH_INFO: `/v3/users/f59f5f1181204b48a50aead509c3c20e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:23.421709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f59f5f1181204b48a50aead509c3c20e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:23.426549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:23.437357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9618404-ed33-48a2-918c-9c61aac08676 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:23.459027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e6853-2a7e-4053-ad91-c450e23c45b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:23.460002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e6853-2a7e-4053-ad91-c450e23c45b4 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:23.463533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e6853-2a7e-4053-ad91-c450e23c45b4 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:23.465360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e6853-2a7e-4053-ad91-c450e23c45b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:23.491024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:23.499879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e6853-2a7e-4053-ad91-c450e23c45b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:23.501800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e6853-2a7e-4053-ad91-c450e23c45b4 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:23.525930 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2190/4345] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:35:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:35:23.683691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f59f5f1181204b48a50aead509c3c20e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:23.718745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f59f5f1181204b48a50aead509c3c20e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:23.771488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f59f5f1181204b48a50aead509c3c20e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:23.794579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f59f5f1181204b48a50aead509c3c20e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:23.797005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f59f5f1181204b48a50aead509c3c20e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:23.809054 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2156/4346] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:23 2022] DELETE /identity/v3/users/f59f5f1181204b48a50aead509c3c20e => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:23.810643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060d7a-783a-47a1-b05d-0e2ad2c83c69 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:23.811112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060d7a-783a-47a1-b05d-0e2ad2c83c69 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:23.811529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4060d7a-783a-47a1-b05d-0e2ad2c83c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:23.878487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a4060d7a-783a-47a1-b05d-0e2ad2c83c69 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:23.882669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a4060d7a-783a-47a1-b05d-0e2ad2c83c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:24.157592 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2191/4347] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:24.275018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:24.277386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:24.533995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ffe59-0e79-4f6e-b051-7538d94d18ca admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:24.562156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566ce9c-eb2f-4c17-8cc2-c12a5dce5b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:24.562885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566ce9c-eb2f-4c17-8cc2-c12a5dce5b82 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:24.563270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566ce9c-eb2f-4c17-8cc2-c12a5dce5b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:24.570386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566ce9c-eb2f-4c17-8cc2-c12a5dce5b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:24.605458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566ce9c-eb2f-4c17-8cc2-c12a5dce5b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:24.610547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566ce9c-eb2f-4c17-8cc2-c12a5dce5b82 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:24.658038 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2157/4348] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:24.802523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762368a-aaf5-4b26-8fc0-651d225f48ab None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:24.803794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762368a-aaf5-4b26-8fc0-651d225f48ab None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:24.804812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762368a-aaf5-4b26-8fc0-651d225f48ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:24.835185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1762368a-aaf5-4b26-8fc0-651d225f48ab None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:24.836816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1762368a-aaf5-4b26-8fc0-651d225f48ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:24.994544 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2192/4349] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:35:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:24.994749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566ce9c-eb2f-4c17-8cc2-c12a5dce5b82 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:24.999332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4566ce9c-eb2f-4c17-8cc2-c12a5dce5b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:25.383834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566ce9c-eb2f-4c17-8cc2-c12a5dce5b82 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:25.402750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ef040-c1cc-43ba-add4-672b3b9a1374 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:25.404520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef040-c1cc-43ba-add4-672b3b9a1374 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:25.405070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef040-c1cc-43ba-add4-672b3b9a1374 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:25.405656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ef040-c1cc-43ba-add4-672b3b9a1374 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:25.431093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ef040-c1cc-43ba-add4-672b3b9a1374 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:25.439216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ef040-c1cc-43ba-add4-672b3b9a1374 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:25.452801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:25.470378 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2158/4350] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:35:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:25.492988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762368a-aaf5-4b26-8fc0-651d225f48ab None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:25.495951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1762368a-aaf5-4b26-8fc0-651d225f48ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:25.859212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762368a-aaf5-4b26-8fc0-651d225f48ab None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:25.897466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53007cc3-cb99-4e81-b26e-21506f62f530 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:25.898850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53007cc3-cb99-4e81-b26e-21506f62f530 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:25.906453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53007cc3-cb99-4e81-b26e-21506f62f530 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:25.907296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53007cc3-cb99-4e81-b26e-21506f62f530 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:25.932436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-53007cc3-cb99-4e81-b26e-21506f62f530 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:25.999861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53007cc3-cb99-4e81-b26e-21506f62f530 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:26.004523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53007cc3-cb99-4e81-b26e-21506f62f530 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:26.041821 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2193/4351] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:35:26.355685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81e16a-1cf2-401e-aab2-290a5f6488b5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:26.356026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81e16a-1cf2-401e-aab2-290a5f6488b5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:26.356226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81e16a-1cf2-401e-aab2-290a5f6488b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:26.513288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-da81e16a-1cf2-401e-aab2-290a5f6488b5 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:26.515528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-da81e16a-1cf2-401e-aab2-290a5f6488b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:26.551902 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2159/4352] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:35:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:26.575485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53007cc3-cb99-4e81-b26e-21506f62f530 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:26.605910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53007cc3-cb99-4e81-b26e-21506f62f530 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:26.617280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17568d-bd89-4614-b854-9d19d22e469a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:26.618102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17568d-bd89-4614-b854-9d19d22e469a service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:26.618496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17568d-bd89-4614-b854-9d19d22e469a service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:26.618880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17568d-bd89-4614-b854-9d19d22e469a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:26.688196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17568d-bd89-4614-b854-9d19d22e469a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:26.698173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17568d-bd89-4614-b854-9d19d22e469a service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:26.757305 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2194/4353] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:35:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:26.786977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81e16a-1cf2-401e-aab2-290a5f6488b5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:26.789984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-da81e16a-1cf2-401e-aab2-290a5f6488b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:26.875870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81e16a-1cf2-401e-aab2-290a5f6488b5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:26.899459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:26.903270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:26.905395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:26.906844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] PATH_INFO: `/v3/projects/7919c2fa32984c39a31200695c6da542` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:26.913489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7919c2fa32984c39a31200695c6da542)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:26.921526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:27.114841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7919c2fa32984c39a31200695c6da542', 'request_id': 'req-19ed726b-a485-48f0-a45a-293171a7d0e5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.167212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7919c2fa32984c39a31200695c6da542', 'request_id': 'req-19ed726b-a485-48f0-a45a-293171a7d0e5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.229944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7919c2fa32984c39a31200695c6da542', 'request_id': 'req-19ed726b-a485-48f0-a45a-293171a7d0e5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.301087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] The token cache is being invalidate because project 7919c2fa32984c39a31200695c6da542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:27.302716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.303538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.309945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17568d-bd89-4614-b854-9d19d22e469a service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:27.312246 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2160/4354] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:26 2022] DELETE /identity/v3/projects/7919c2fa32984c39a31200695c6da542 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:27.312566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4e17568d-bd89-4614-b854-9d19d22e469a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:27.313715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:27.318909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:27.388334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17568d-bd89-4614-b854-9d19d22e469a service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:27.432353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:27.568094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed726b-a485-48f0-a45a-293171a7d0e5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:27.579130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:27.580383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:27.580870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:27.582206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] PATH_INFO: `/v3/users/b0e52d4d6f294c999a25a21da294a66e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:27.587613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e52d4d6f294c999a25a21da294a66e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:27.600720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:27.602393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:27.608255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:27.608565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:27.609860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] PATH_INFO: `/v3/users/7c236fad4a5b4bce92a2ce4a64f09bff` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:27.616340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c236fad4a5b4bce92a2ce4a64f09bff)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:27.623269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:27.750333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e52d4d6f294c999a25a21da294a66e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.777565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e52d4d6f294c999a25a21da294a66e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.800766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c236fad4a5b4bce92a2ce4a64f09bff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.802664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c236fad4a5b4bce92a2ce4a64f09bff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.822011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e52d4d6f294c999a25a21da294a66e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.825497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c236fad4a5b4bce92a2ce4a64f09bff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.840867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:27.846637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c236fad4a5b4bce92a2ce4a64f09bff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.865566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e52d4d6f294c999a25a21da294a66e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.867961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa15204c-ecd7-4242-843f-b9dca1c1876b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e52d4d6f294c999a25a21da294a66e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.888192 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2161/4355] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:27 2022] DELETE /identity/v3/users/b0e52d4d6f294c999a25a21da294a66e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:27.899498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c236fad4a5b4bce92a2ce4a64f09bff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:27.922460 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2195/4356] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:27 2022] DELETE /identity/v3/users/7c236fad4a5b4bce92a2ce4a64f09bff => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:27.930115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ad2a-270a-4313-990e-77a557a9b684 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:27.930722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ad2a-270a-4313-990e-77a557a9b684 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:27.931048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867ad2a-270a-4313-990e-77a557a9b684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:27.991190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8867ad2a-270a-4313-990e-77a557a9b684 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:27.992504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8867ad2a-270a-4313-990e-77a557a9b684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:28.172624 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2162/4357] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:28.249023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:28.250642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:28.438720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50468-d8da-4f0f-bbd4-22ff7ad24a8b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:28.445072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a69cbf-312a-4d59-b9f4-43e3c579905b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:28.446273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a69cbf-312a-4d59-b9f4-43e3c579905b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:28.446802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a69cbf-312a-4d59-b9f4-43e3c579905b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:28.447220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a69cbf-312a-4d59-b9f4-43e3c579905b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:28.461270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a69cbf-312a-4d59-b9f4-43e3c579905b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:28.463452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a69cbf-312a-4d59-b9f4-43e3c579905b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:28.483900 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2196/4358] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:29.624278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ad2a-270a-4313-990e-77a557a9b684 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:29.627312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8867ad2a-270a-4313-990e-77a557a9b684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:29.651905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84cfd0-5b2f-4476-b228-2701084562ca None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:29.653071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84cfd0-5b2f-4476-b228-2701084562ca None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:29.653514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84cfd0-5b2f-4476-b228-2701084562ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:29.678630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0e84cfd0-5b2f-4476-b228-2701084562ca None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:29.679313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867ad2a-270a-4313-990e-77a557a9b684 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:29.681805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0e84cfd0-5b2f-4476-b228-2701084562ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:29.704910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:29.705761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:29.706069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:29.706357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] PATH_INFO: `/v3/projects/d2985cb033a243fcbc3ead74a9384e5e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:29.707966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2985cb033a243fcbc3ead74a9384e5e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:29.710015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:29.813594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:29.898700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2985cb033a243fcbc3ead74a9384e5e', 'request_id': 'req-b352f92d-0a01-4aff-8f16-946260c1bc92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.904007 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2197/4359] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:35:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:29.924024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2985cb033a243fcbc3ead74a9384e5e', 'request_id': 'req-b352f92d-0a01-4aff-8f16-946260c1bc92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:29.933404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84cfd0-5b2f-4476-b228-2701084562ca None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:29.939002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0e84cfd0-5b2f-4476-b228-2701084562ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:29.958056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2985cb033a243fcbc3ead74a9384e5e', 'request_id': 'req-b352f92d-0a01-4aff-8f16-946260c1bc92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.007763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] The token cache is being invalidate because project d2985cb033a243fcbc3ead74a9384e5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:30.008414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.009172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.011146 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2163/4360] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:29 2022] DELETE /identity/v3/projects/d2985cb033a243fcbc3ead74a9384e5e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:30.012187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:30.014036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:30.120740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84cfd0-5b2f-4476-b228-2701084562ca None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:30.174810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352f92d-0a01-4aff-8f16-946260c1bc92 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:30.187927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:30.189103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.189483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.189898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] PATH_INFO: `/v3/projects/2173d423557b40dab65b77dbc4155d18` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.192947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2173d423557b40dab65b77dbc4155d18)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:30.197982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:30.251340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:30.265131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5e119-0246-4aa5-a83c-a9a4f37ebe74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:30.266806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5e119-0246-4aa5-a83c-a9a4f37ebe74 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.267716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5e119-0246-4aa5-a83c-a9a4f37ebe74 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.268471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5e119-0246-4aa5-a83c-a9a4f37ebe74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.274318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-07d5e119-0246-4aa5-a83c-a9a4f37ebe74 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:30.372699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2173d423557b40dab65b77dbc4155d18', 'request_id': 'req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.429738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2173d423557b40dab65b77dbc4155d18', 'request_id': 'req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.445479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2173d423557b40dab65b77dbc4155d18', 'request_id': 'req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.469527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] The token cache is being invalidate because project 2173d423557b40dab65b77dbc4155d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:30.469828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.470729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b4ee56c-dc8f-471f-9f85-1e1def8c6e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:30.472717 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2164/4361] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:30 2022] DELETE /identity/v3/projects/2173d423557b40dab65b77dbc4155d18 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:30.478233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97360488-4f0a-492b-83bc-cf97b51516de None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.478575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97360488-4f0a-492b-83bc-cf97b51516de None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.480133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97360488-4f0a-492b-83bc-cf97b51516de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.513768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-97360488-4f0a-492b-83bc-cf97b51516de None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:30.513997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5e119-0246-4aa5-a83c-a9a4f37ebe74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:30.515771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5e119-0246-4aa5-a83c-a9a4f37ebe74 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:30.516134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-97360488-4f0a-492b-83bc-cf97b51516de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:30.550706 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2198/4362] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:35:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:35:30.553997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce40b7-90b4-47ee-902f-bd9808fc2cdd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.554436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce40b7-90b4-47ee-902f-bd9808fc2cdd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.554902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce40b7-90b4-47ee-902f-bd9808fc2cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.621312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-37ce40b7-90b4-47ee-902f-bd9808fc2cdd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:30.627595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-37ce40b7-90b4-47ee-902f-bd9808fc2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:30.669580 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2165/4363] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:30.670140 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2199/4364] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:30.671558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4722-dc66-4b93-a64a-e7aafeb84d2e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.671737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4722-dc66-4b93-a64a-e7aafeb84d2e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.672011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a4722-dc66-4b93-a64a-e7aafeb84d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.683272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3e46d-0079-43b6-aedf-b479f7ce1989 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.683919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3e46d-0079-43b6-aedf-b479f7ce1989 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.684408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3e46d-0079-43b6-aedf-b479f7ce1989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.725683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-547a4722-dc66-4b93-a64a-e7aafeb84d2e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:30.728159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-547a4722-dc66-4b93-a64a-e7aafeb84d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:30.747060 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2166/4365] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:30.756685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4722-dc66-4b93-a64a-e7aafeb84d2e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:30.758715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-76c3e46d-0079-43b6-aedf-b479f7ce1989 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:30.760377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-76c3e46d-0079-43b6-aedf-b479f7ce1989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:30.787660 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2200/4366] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:30.789197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a4722-dc66-4b93-a64a-e7aafeb84d2e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:30.790428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3e46d-0079-43b6-aedf-b479f7ce1989 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:30.802529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90394b93-d599-4158-9a0b-b6abd5c3e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:30.803671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90394b93-d599-4158-9a0b-b6abd5c3e959 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.804686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90394b93-d599-4158-9a0b-b6abd5c3e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.804938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90394b93-d599-4158-9a0b-b6abd5c3e959 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.805794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90394b93-d599-4158-9a0b-b6abd5c3e959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:30.807775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90394b93-d599-4158-9a0b-b6abd5c3e959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:30.810907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90394b93-d599-4158-9a0b-b6abd5c3e959 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:30.815205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3e46d-0079-43b6-aedf-b479f7ce1989 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:30.832025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dae83b-d982-426c-a5ee-0bd6ba964738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:30.832873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dae83b-d982-426c-a5ee-0bd6ba964738 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.833329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dae83b-d982-426c-a5ee-0bd6ba964738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.833619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dae83b-d982-426c-a5ee-0bd6ba964738 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.834343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dae83b-d982-426c-a5ee-0bd6ba964738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:30.834650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dae83b-d982-426c-a5ee-0bd6ba964738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:30.842547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dae83b-d982-426c-a5ee-0bd6ba964738 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:30.854651 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2167/4367] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:30.868195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90394b93-d599-4158-9a0b-b6abd5c3e959 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:30.884291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:30.891678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90394b93-d599-4158-9a0b-b6abd5c3e959 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:30.897849 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2201/4368] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:30.899361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dae83b-d982-426c-a5ee-0bd6ba964738 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:30.909959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973d8c-fada-4bd4-b747-69f609e8f7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:30.910794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973d8c-fada-4bd4-b747-69f609e8f7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.911016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973d8c-fada-4bd4-b747-69f609e8f7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.911273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97973d8c-fada-4bd4-b747-69f609e8f7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.911939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97973d8c-fada-4bd4-b747-69f609e8f7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:30.916863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97973d8c-fada-4bd4-b747-69f609e8f7a8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:30.923714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dae83b-d982-426c-a5ee-0bd6ba964738 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:30.936062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6c91-9f40-4b78-b9ac-f4d11ac2892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:30.939714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6c91-9f40-4b78-b9ac-f4d11ac2892e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:30.939997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6c91-9f40-4b78-b9ac-f4d11ac2892e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:30.940477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c6c91-9f40-4b78-b9ac-f4d11ac2892e admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:30.941344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6c91-9f40-4b78-b9ac-f4d11ac2892e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:30.943762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c6c91-9f40-4b78-b9ac-f4d11ac2892e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:30.981602 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2168/4369] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:30 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:30.982510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973d8c-fada-4bd4-b747-69f609e8f7a8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.007392 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2202/4370] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:30 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:31.012271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6c91-9f40-4b78-b9ac-f4d11ac2892e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.133973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97973d8c-fada-4bd4-b747-69f609e8f7a8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.167642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:31.301638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265063c-39d0-4e2c-a40e-0194472a90c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.302548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265063c-39d0-4e2c-a40e-0194472a90c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.303017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265063c-39d0-4e2c-a40e-0194472a90c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.306296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265063c-39d0-4e2c-a40e-0194472a90c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.306832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265063c-39d0-4e2c-a40e-0194472a90c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.308995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265063c-39d0-4e2c-a40e-0194472a90c7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:31.311322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c6c91-9f40-4b78-b9ac-f4d11ac2892e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.320200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d75b62-04da-4b18-af5b-54baf0d3af12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.321347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d75b62-04da-4b18-af5b-54baf0d3af12 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.323945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d75b62-04da-4b18-af5b-54baf0d3af12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.325481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d75b62-04da-4b18-af5b-54baf0d3af12 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.327822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d75b62-04da-4b18-af5b-54baf0d3af12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.332699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d75b62-04da-4b18-af5b-54baf0d3af12 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:31.349944 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2169/4371] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:30 2022] POST /identity/v3/users => generated 289 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:31.355090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265063c-39d0-4e2c-a40e-0194472a90c7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.386048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265063c-39d0-4e2c-a40e-0194472a90c7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.397298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397d181-069f-495b-86d8-292d2a353ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.400242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397d181-069f-495b-86d8-292d2a353ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.400242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397d181-069f-495b-86d8-292d2a353ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.400242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4397d181-069f-495b-86d8-292d2a353ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.401194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397d181-069f-495b-86d8-292d2a353ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.401470 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2203/4372] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:31 2022] POST /identity/v3/users => generated 287 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:31.403535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d75b62-04da-4b18-af5b-54baf0d3af12 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.404464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4397d181-069f-495b-86d8-292d2a353ed4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:31.425439 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2170/4373] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:31.431923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397d181-069f-495b-86d8-292d2a353ed4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.438430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d75b62-04da-4b18-af5b-54baf0d3af12 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.454157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fbade-1555-43a6-8169-444826508c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.455829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4397d181-069f-495b-86d8-292d2a353ed4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.463331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fbade-1555-43a6-8169-444826508c35 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.463780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fbade-1555-43a6-8169-444826508c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.464356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fbade-1555-43a6-8169-444826508c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.465434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fbade-1555-43a6-8169-444826508c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.471593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c4fa0-65f8-4bf9-9967-216aa14fb6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.473133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c4fa0-65f8-4bf9-9967-216aa14fb6ad admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.475337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c4fa0-65f8-4bf9-9967-216aa14fb6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.475337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370c4fa0-65f8-4bf9-9967-216aa14fb6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.475660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fbade-1555-43a6-8169-444826508c35 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:31.475797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c4fa0-65f8-4bf9-9967-216aa14fb6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.482332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370c4fa0-65f8-4bf9-9967-216aa14fb6ad admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:31.525510 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2171/4374] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:31.525510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c4fa0-65f8-4bf9-9967-216aa14fb6ad admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.525992 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2204/4375] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:31.526730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fbade-1555-43a6-8169-444826508c35 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.547673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fbade-1555-43a6-8169-444826508c35 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.550327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370c4fa0-65f8-4bf9-9967-216aa14fb6ad admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.559513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16784c-b4d1-4949-b39e-7d8938c24a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.560180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16784c-b4d1-4949-b39e-7d8938c24a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.560453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16784c-b4d1-4949-b39e-7d8938c24a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.560753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16784c-b4d1-4949-b39e-7d8938c24a23 admin admin] PATH_INFO: `/v3/projects/b65ee593aa4547ab869504542d0565e2/users/0a59d68ad94e4cbdbccffae138a8fc47/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.560924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39adfa0-f50f-46d0-bed7-4efd7a01f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.561799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39adfa0-f50f-46d0-bed7-4efd7a01f56e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.562315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39adfa0-f50f-46d0-bed7-4efd7a01f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.562661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39adfa0-f50f-46d0-bed7-4efd7a01f56e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.563410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39adfa0-f50f-46d0-bed7-4efd7a01f56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.565464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39adfa0-f50f-46d0-bed7-4efd7a01f56e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:31.581716 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2172/4376] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:31.586839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39adfa0-f50f-46d0-bed7-4efd7a01f56e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.602712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39adfa0-f50f-46d0-bed7-4efd7a01f56e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:31.604546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16784c-b4d1-4949-b39e-7d8938c24a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65ee593aa4547ab869504542d0565e2, user_id=0a59d68ad94e4cbdbccffae138a8fc47, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.608061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16784c-b4d1-4949-b39e-7d8938c24a23 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:31.613007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14155b6-7212-48a9-b0f4-8ca0da162085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:31.613961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14155b6-7212-48a9-b0f4-8ca0da162085 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.614543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14155b6-7212-48a9-b0f4-8ca0da162085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.614996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14155b6-7212-48a9-b0f4-8ca0da162085 admin admin] PATH_INFO: `/v3/projects/1e5589cdb9af4752989c4227a3daa078/users/cd4ddb7417c5469c95c55fe3b40de7a4/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.658357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14155b6-7212-48a9-b0f4-8ca0da162085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5589cdb9af4752989c4227a3daa078, user_id=cd4ddb7417c5469c95c55fe3b40de7a4, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:31.667725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14155b6-7212-48a9-b0f4-8ca0da162085 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:31.669311 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2205/4377] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:31 2022] PUT /identity/v3/projects/b65ee593aa4547ab869504542d0565e2/users/0a59d68ad94e4cbdbccffae138a8fc47/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:31.691131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffc1ba-16ef-4b80-9f59-d1a93674a881 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.693579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffc1ba-16ef-4b80-9f59-d1a93674a881 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.694522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffc1ba-16ef-4b80-9f59-d1a93674a881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.705119 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2173/4378] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:31 2022] PUT /identity/v3/projects/1e5589cdb9af4752989c4227a3daa078/users/cd4ddb7417c5469c95c55fe3b40de7a4/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:31.727696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d8c2b-aa7e-4cf9-bfa5-c18f6122fae1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:31.728254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d8c2b-aa7e-4cf9-bfa5-c18f6122fae1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:31.728987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d8c2b-aa7e-4cf9-bfa5-c18f6122fae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:31.774107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1bffc1ba-16ef-4b80-9f59-d1a93674a881 None None] MFA Rules not processed for user `0a59d68ad94e4cbdbccffae138a8fc47`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:31.776877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1bffc1ba-16ef-4b80-9f59-d1a93674a881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:31.851094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ab3d8c2b-aa7e-4cf9-bfa5-c18f6122fae1 None None] MFA Rules not processed for user `cd4ddb7417c5469c95c55fe3b40de7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:31.852412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ab3d8c2b-aa7e-4cf9-bfa5-c18f6122fae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:31.917235 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2206/4379] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:31.917235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffc1ba-16ef-4b80-9f59-d1a93674a881 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:31.917235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1bffc1ba-16ef-4b80-9f59-d1a93674a881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:31.973837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:32.019405 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2174/4380] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:32.019405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975e1d-677b-421a-a1a9-ce401b84a07b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.019405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975e1d-677b-421a-a1a9-ce401b84a07b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.019405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab975e1d-677b-421a-a1a9-ce401b84a07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.053559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ab975e1d-677b-421a-a1a9-ce401b84a07b None None] MFA Rules not processed for user `156adbbf6e3b4111b49b7e6e17b9825d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:32.057985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ab975e1d-677b-421a-a1a9-ce401b84a07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:32.087026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffc1ba-16ef-4b80-9f59-d1a93674a881 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.093344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29a0d0-c251-40df-af3e-6fd1f598c88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.094150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29a0d0-c251-40df-af3e-6fd1f598c88c service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.097228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29a0d0-c251-40df-af3e-6fd1f598c88c service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.097583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29a0d0-c251-40df-af3e-6fd1f598c88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.102151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4b29a0d0-c251-40df-af3e-6fd1f598c88c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:32.140698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:32.193925 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2175/4381] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:32.193925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab975e1d-677b-421a-a1a9-ce401b84a07b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.219104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29a0d0-c251-40df-af3e-6fd1f598c88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.222409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29a0d0-c251-40df-af3e-6fd1f598c88c service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.257826 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2207/4382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:32.258886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29a0d0-c251-40df-af3e-6fd1f598c88c service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.341600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab975e1d-677b-421a-a1a9-ce401b84a07b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.351205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafb280-05d3-4227-8759-356b5c0926cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.351887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb280-05d3-4227-8759-356b5c0926cf admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.352181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb280-05d3-4227-8759-356b5c0926cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.352434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafb280-05d3-4227-8759-356b5c0926cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.353099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafb280-05d3-4227-8759-356b5c0926cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.355457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafb280-05d3-4227-8759-356b5c0926cf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.398083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29a0d0-c251-40df-af3e-6fd1f598c88c service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.409637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd3570-0dea-4050-b498-71608ef9ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.410330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd3570-0dea-4050-b498-71608ef9ea14 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.410805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd3570-0dea-4050-b498-71608ef9ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.411381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd3570-0dea-4050-b498-71608ef9ea14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.412049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd3570-0dea-4050-b498-71608ef9ea14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.414055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd3570-0dea-4050-b498-71608ef9ea14 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.418475 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2176/4383] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:32.419570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafb280-05d3-4227-8759-356b5c0926cf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.468954 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2208/4384] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:32.470583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd3570-0dea-4050-b498-71608ef9ea14 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.507018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafb280-05d3-4227-8759-356b5c0926cf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.576073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:32.599191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66691815-5f0e-4f7e-9fba-084c0ce1dd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.602255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691815-5f0e-4f7e-9fba-084c0ce1dd74 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.602649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691815-5f0e-4f7e-9fba-084c0ce1dd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.602927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66691815-5f0e-4f7e-9fba-084c0ce1dd74 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.603607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66691815-5f0e-4f7e-9fba-084c0ce1dd74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.605974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66691815-5f0e-4f7e-9fba-084c0ce1dd74 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.613315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd3570-0dea-4050-b498-71608ef9ea14 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.631758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef740b2-648e-4696-81e5-6de59555e559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.632689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef740b2-648e-4696-81e5-6de59555e559 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.633575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef740b2-648e-4696-81e5-6de59555e559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.634051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef740b2-648e-4696-81e5-6de59555e559 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.634887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef740b2-648e-4696-81e5-6de59555e559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.637264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef740b2-648e-4696-81e5-6de59555e559 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.640514 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2177/4385] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:32.641667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66691815-5f0e-4f7e-9fba-084c0ce1dd74 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.648919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:32.654506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66691815-5f0e-4f7e-9fba-084c0ce1dd74 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.661311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c439ea-96ce-48c4-a102-a7e64f43c3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.662139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c439ea-96ce-48c4-a102-a7e64f43c3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.662522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c439ea-96ce-48c4-a102-a7e64f43c3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.662869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c439ea-96ce-48c4-a102-a7e64f43c3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.663812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c439ea-96ce-48c4-a102-a7e64f43c3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.666377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c439ea-96ce-48c4-a102-a7e64f43c3d4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.689770 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2178/4386] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:32.690900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c439ea-96ce-48c4-a102-a7e64f43c3d4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.694107 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2209/4387] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:32 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:32.698019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef740b2-648e-4696-81e5-6de59555e559 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.704904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c439ea-96ce-48c4-a102-a7e64f43c3d4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.711213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee63c-92e6-4d20-a199-4ee625b7cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.711836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee63c-92e6-4d20-a199-4ee625b7cdcb admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.712055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee63c-92e6-4d20-a199-4ee625b7cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.712971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee63c-92e6-4d20-a199-4ee625b7cdcb admin admin] PATH_INFO: `/v3/projects/28e39366937b4b9d96d36f0facc42185/users/9eb448c1213748d6b1cc7eae0a0526c6/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.717777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef740b2-648e-4696-81e5-6de59555e559 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.728436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacded4-0fd0-403f-bec7-ae0c015876f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.730724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacded4-0fd0-403f-bec7-ae0c015876f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.731334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacded4-0fd0-403f-bec7-ae0c015876f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.731823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacded4-0fd0-403f-bec7-ae0c015876f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.733023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacded4-0fd0-403f-bec7-ae0c015876f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.733931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee63c-92e6-4d20-a199-4ee625b7cdcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e39366937b4b9d96d36f0facc42185, user_id=9eb448c1213748d6b1cc7eae0a0526c6, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.736540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacded4-0fd0-403f-bec7-ae0c015876f7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.736665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee63c-92e6-4d20-a199-4ee625b7cdcb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.761584 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2210/4388] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:32.767081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacded4-0fd0-403f-bec7-ae0c015876f7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.769053 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2179/4389] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:32 2022] PUT /identity/v3/projects/28e39366937b4b9d96d36f0facc42185/users/9eb448c1213748d6b1cc7eae0a0526c6/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:32.770810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee63c-92e6-4d20-a199-4ee625b7cdcb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.783509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacded4-0fd0-403f-bec7-ae0c015876f7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.923164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee63c-92e6-4d20-a199-4ee625b7cdcb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.931190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90460410-eda1-4930-b545-4dc685835a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.932265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90460410-eda1-4930-b545-4dc685835a5b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.932696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90460410-eda1-4930-b545-4dc685835a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.933280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90460410-eda1-4930-b545-4dc685835a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.934337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90460410-eda1-4930-b545-4dc685835a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.936225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90460410-eda1-4930-b545-4dc685835a5b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.955695 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2180/4390] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:32.958054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90460410-eda1-4930-b545-4dc685835a5b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:32.973174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90460410-eda1-4930-b545-4dc685835a5b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:32.979350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb29d7-c659-4dcf-86dd-543f5ebd30cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.980448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb29d7-c659-4dcf-86dd-543f5ebd30cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.980921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb29d7-c659-4dcf-86dd-543f5ebd30cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.981352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb29d7-c659-4dcf-86dd-543f5ebd30cc admin admin] PATH_INFO: `/v3/projects/28e39366937b4b9d96d36f0facc42185/users/9eb448c1213748d6b1cc7eae0a0526c6/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:32.983897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb29d7-c659-4dcf-86dd-543f5ebd30cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e39366937b4b9d96d36f0facc42185, user_id=9eb448c1213748d6b1cc7eae0a0526c6, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:32.987196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb29d7-c659-4dcf-86dd-543f5ebd30cc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:32.996254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4e48b-e788-4b20-bb9f-fac2b66b9dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:32.997326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4e48b-e788-4b20-bb9f-fac2b66b9dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:32.998105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4e48b-e788-4b20-bb9f-fac2b66b9dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:32.998317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4e48b-e788-4b20-bb9f-fac2b66b9dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.013810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4e48b-e788-4b20-bb9f-fac2b66b9dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.015074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4e48b-e788-4b20-bb9f-fac2b66b9dc6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.015621 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2181/4391] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:32 2022] PUT /identity/v3/projects/28e39366937b4b9d96d36f0facc42185/users/9eb448c1213748d6b1cc7eae0a0526c6/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:33.017830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab47a-d16b-4e01-8795-b3f2d3dea98b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.018423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab47a-d16b-4e01-8795-b3f2d3dea98b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.019147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab47a-d16b-4e01-8795-b3f2d3dea98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.057040 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2211/4392] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:33.058661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-688ab47a-d16b-4e01-8795-b3f2d3dea98b None None] MFA Rules not processed for user `9eb448c1213748d6b1cc7eae0a0526c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:33.060145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-688ab47a-d16b-4e01-8795-b3f2d3dea98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:33.060942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4e48b-e788-4b20-bb9f-fac2b66b9dc6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.089219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4e48b-e788-4b20-bb9f-fac2b66b9dc6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.172234 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2182/4393] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:33.174176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab47a-d16b-4e01-8795-b3f2d3dea98b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.177089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-688ab47a-d16b-4e01-8795-b3f2d3dea98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:33.271566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:33.303510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab47a-d16b-4e01-8795-b3f2d3dea98b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.309035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6bdf0-7e3d-4b07-8876-d0c9f9a45b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.309925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6bdf0-7e3d-4b07-8876-d0c9f9a45b82 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.310289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6bdf0-7e3d-4b07-8876-d0c9f9a45b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.310672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6bdf0-7e3d-4b07-8876-d0c9f9a45b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.312729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-27a6bdf0-7e3d-4b07-8876-d0c9f9a45b82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:33.326058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6bdf0-7e3d-4b07-8876-d0c9f9a45b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.328456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6bdf0-7e3d-4b07-8876-d0c9f9a45b82 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.339046 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2183/4394] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:33.340170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6bdf0-7e3d-4b07-8876-d0c9f9a45b82 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.357020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6bdf0-7e3d-4b07-8876-d0c9f9a45b82 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.361503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560baebb-cb4d-4930-8299-f32e5e087fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.361503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560baebb-cb4d-4930-8299-f32e5e087fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.361856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560baebb-cb4d-4930-8299-f32e5e087fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.362088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560baebb-cb4d-4930-8299-f32e5e087fb0 admin admin] PATH_INFO: `/v3/projects/502d667c25d3420fa097c45ec61f9af7/users/69ff48e8d3124899b1b79cd8b489d4fd/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.366221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8abacd-dfee-47e2-866d-02af09bdb593 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.366221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8abacd-dfee-47e2-866d-02af09bdb593 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.366221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8abacd-dfee-47e2-866d-02af09bdb593 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.366599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8abacd-dfee-47e2-866d-02af09bdb593 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.366599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8abacd-dfee-47e2-866d-02af09bdb593 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.367467 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-bb8abacd-dfee-47e2-866d-02af09bdb593 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:33.367467 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:35:33.367467 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:35:33.369410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8abacd-dfee-47e2-866d-02af09bdb593 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.407973 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2184/4395] 10.222.0.43 () {60 vars in 1185 bytes} [Tue Aug 30 04:35:33 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:33.409895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bae0fa-512f-48cd-8756-aa7a71e0fe15 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.409895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bae0fa-512f-48cd-8756-aa7a71e0fe15 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.410293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bae0fa-512f-48cd-8756-aa7a71e0fe15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.418163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560baebb-cb4d-4930-8299-f32e5e087fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502d667c25d3420fa097c45ec61f9af7, user_id=69ff48e8d3124899b1b79cd8b489d4fd, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.428708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560baebb-cb4d-4930-8299-f32e5e087fb0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.479840 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2212/4396] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:33 2022] PUT /identity/v3/projects/502d667c25d3420fa097c45ec61f9af7/users/69ff48e8d3124899b1b79cd8b489d4fd/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:33.481790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560baebb-cb4d-4930-8299-f32e5e087fb0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.515460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f0bae0fa-512f-48cd-8756-aa7a71e0fe15 None None] MFA Rules not processed for user `e5e536ba36df437f9611c808dcdc0539`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:33.517611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f0bae0fa-512f-48cd-8756-aa7a71e0fe15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:33.664171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:33.733361 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2185/4397] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:33.736701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bbc13-bd25-4ff6-a4fd-51f6a2945e86 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.737256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bbc13-bd25-4ff6-a4fd-51f6a2945e86 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.737733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bbc13-bd25-4ff6-a4fd-51f6a2945e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.772865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560baebb-cb4d-4930-8299-f32e5e087fb0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.786135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2b7bbc13-bd25-4ff6-a4fd-51f6a2945e86 None None] MFA Rules not processed for user `69ff48e8d3124899b1b79cd8b489d4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:33.789656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2b7bbc13-bd25-4ff6-a4fd-51f6a2945e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:33.792454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132acb40-0870-47d1-9169-51e67743ca4a tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.793580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132acb40-0870-47d1-9169-51e67743ca4a tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.794119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132acb40-0870-47d1-9169-51e67743ca4a tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.794583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132acb40-0870-47d1-9169-51e67743ca4a tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1822ffde4bd6474681b7b4cd1d81e870` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.795636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132acb40-0870-47d1-9169-51e67743ca4a tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=1822ffde4bd6474681b7b4cd1d81e870)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.797607 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-132acb40-0870-47d1-9169-51e67743ca4a tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:33.797607 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:33.797607 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:33.811669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132acb40-0870-47d1-9169-51e67743ca4a tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.832461 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2213/4398] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Aug 30 04:35:33 2022] GET /identity/v3/OS-OAUTH1/consumers/1822ffde4bd6474681b7b4cd1d81e870 => generated 219 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:33.835413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb345c-23a9-43f6-93f9-d510b5db8b21 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.835901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb345c-23a9-43f6-93f9-d510b5db8b21 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.837112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb345c-23a9-43f6-93f9-d510b5db8b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.884821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-98eb345c-23a9-43f6-93f9-d510b5db8b21 None None] MFA Rules not processed for user `e5e536ba36df437f9611c808dcdc0539`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:33.888638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-98eb345c-23a9-43f6-93f9-d510b5db8b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:33.933093 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2214/4399] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:33.933093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb345c-23a9-43f6-93f9-d510b5db8b21 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:33.957223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb345c-23a9-43f6-93f9-d510b5db8b21 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:33.968452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:33.969132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:33.969413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:33.969684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1822ffde4bd6474681b7b4cd1d81e870` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:33.970323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1822ffde4bd6474681b7b4cd1d81e870)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:33.971424 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:33.971424 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:33.971424 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:33.972376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:33.972650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invalidating token cache because consumer 1822ffde4bd6474681b7b4cd1d81e870 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:33.973052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:33.975067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:33.986084 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2186/4400] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:34.007383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bbc13-bd25-4ff6-a4fd-51f6a2945e86 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.009586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2b7bbc13-bd25-4ff6-a4fd-51f6a2945e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:34.041336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1822ffde4bd6474681b7b4cd1d81e870', 'request_id': 'req-ed1ed72b-6cff-40d9-81a3-5c58451f301f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.067460 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2215/4401] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Aug 30 04:35:33 2022] DELETE /identity/v3/OS-OAUTH1/consumers/1822ffde4bd6474681b7b4cd1d81e870 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:34.072776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.074632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:34.102232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ed72b-6cff-40d9-81a3-5c58451f301f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.110365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55083d-41c4-42b9-8ad4-bdcff89eb511 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.111504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55083d-41c4-42b9-8ad4-bdcff89eb511 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.112198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55083d-41c4-42b9-8ad4-bdcff89eb511 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.112540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55083d-41c4-42b9-8ad4-bdcff89eb511 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.113925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55083d-41c4-42b9-8ad4-bdcff89eb511 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.116762 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-bb55083d-41c4-42b9-8ad4-bdcff89eb511 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:34.116762 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:34.116762 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:34.118655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55083d-41c4-42b9-8ad4-bdcff89eb511 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.154790 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2216/4402] 10.222.0.43 () {60 vars in 1185 bytes} [Tue Aug 30 04:35:34 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 265 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:34.158545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55083d-41c4-42b9-8ad4-bdcff89eb511 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.167985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:34.180823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55083d-41c4-42b9-8ad4-bdcff89eb511 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.186283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f1895-4591-4e2b-a891-616c6cc5cf4f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.187318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f1895-4591-4e2b-a891-616c6cc5cf4f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.187600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f1895-4591-4e2b-a891-616c6cc5cf4f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.187872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f1895-4591-4e2b-a891-616c6cc5cf4f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7e67b3d0f53945c8b024e04cf6808ff6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.188630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f1895-4591-4e2b-a891-616c6cc5cf4f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=7e67b3d0f53945c8b024e04cf6808ff6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.190385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f1895-4591-4e2b-a891-616c6cc5cf4f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.192350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bbc13-bd25-4ff6-a4fd-51f6a2945e86 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.200576 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2217/4403] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Aug 30 04:35:34 2022] GET /identity/v3/OS-OAUTH1/consumers/7e67b3d0f53945c8b024e04cf6808ff6 => generated 219 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:34.202984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f1895-4591-4e2b-a891-616c6cc5cf4f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.206962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1001c-19fa-4922-8c72-d128701a8a98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.208342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1001c-19fa-4922-8c72-d128701a8a98 service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.209347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1001c-19fa-4922-8c72-d128701a8a98 service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.209551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1001c-19fa-4922-8c72-d128701a8a98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.216616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-36e1001c-19fa-4922-8c72-d128701a8a98 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:34.219684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f1895-4591-4e2b-a891-616c6cc5cf4f tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.226435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.227198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.227480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.227751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7e67b3d0f53945c8b024e04cf6808ff6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.228441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=7e67b3d0f53945c8b024e04cf6808ff6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.230102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.231832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invalidating token cache because consumer 7e67b3d0f53945c8b024e04cf6808ff6 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:34.232156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.233268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.250464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '7e67b3d0f53945c8b024e04cf6808ff6', 'request_id': 'req-15e81398-4b3b-461f-8b7e-ab97d556b965'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.277757 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2218/4404] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Aug 30 04:35:34 2022] DELETE /identity/v3/OS-OAUTH1/consumers/7e67b3d0f53945c8b024e04cf6808ff6 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:34.279022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.282167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:34.302535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e81398-4b3b-461f-8b7e-ab97d556b965 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.307919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6ebc0-24cc-482b-b90b-01dadc2b7343 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.308737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6ebc0-24cc-482b-b90b-01dadc2b7343 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.309019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6ebc0-24cc-482b-b90b-01dadc2b7343 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.309300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6ebc0-24cc-482b-b90b-01dadc2b7343 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7e67b3d0f53945c8b024e04cf6808ff6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.310157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6ebc0-24cc-482b-b90b-01dadc2b7343 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=7e67b3d0f53945c8b024e04cf6808ff6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.312444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6ebc0-24cc-482b-b90b-01dadc2b7343 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-6dd6ebc0-24cc-482b-b90b-01dadc2b7343 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 30 04:35:34.349844 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 30 04:35:34.352032 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 30 04:35:34.352032 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 30 04:35:34.352032 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 30 04:35:34.352032 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 30 04:35:34.352032 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 30 04:35:34.352032 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 30 04:35:34.352032 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 30 04:35:34.352032 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 30 04:35:34.352032 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:35:34.356224 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2219/4405] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Aug 30 04:35:34 2022] GET /identity/v3/OS-OAUTH1/consumers/7e67b3d0f53945c8b024e04cf6808ff6 => generated 74 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:35:34.358306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6ebc0-24cc-482b-b90b-01dadc2b7343 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.371739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6ebc0-24cc-482b-b90b-01dadc2b7343 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.377455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.378214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.378494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.378767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/7e67b3d0f53945c8b024e04cf6808ff6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.380207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=7e67b3d0f53945c8b024e04cf6808ff6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.381537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.381825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invalidating token cache because consumer 7e67b3d0f53945c8b024e04cf6808ff6 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:34.382130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.383096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 30 04:35:34.409006 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 30 04:35:34.411027 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:35:34.412468 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2220/4406] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Aug 30 04:35:34 2022] DELETE /identity/v3/OS-OAUTH1/consumers/7e67b3d0f53945c8b024e04cf6808ff6 => generated 74 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:35:34.419699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1001c-19fa-4922-8c72-d128701a8a98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.420112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.422163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1001c-19fa-4922-8c72-d128701a8a98 service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.425205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:34.454103 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2187/4407] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:34.484618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175fee1-00d5-4391-8737-cb06d9b9231c tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.496705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650469-ba1c-4a08-b003-e6bc186568fe tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.497447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650469-ba1c-4a08-b003-e6bc186568fe tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.497732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650469-ba1c-4a08-b003-e6bc186568fe tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.506820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da650469-ba1c-4a08-b003-e6bc186568fe tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.507694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da650469-ba1c-4a08-b003-e6bc186568fe tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.517209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da650469-ba1c-4a08-b003-e6bc186568fe tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.544871 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2221/4408] 10.222.0.43 () {60 vars in 1185 bytes} [Tue Aug 30 04:35:34 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:34.551965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1001c-19fa-4922-8c72-d128701a8a98 service glance] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.576372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1001c-19fa-4922-8c72-d128701a8a98 service glance] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.590898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df9fef-daba-4774-b2c6-4466391692ef tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.591620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9fef-daba-4774-b2c6-4466391692ef tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.592128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9fef-daba-4774-b2c6-4466391692ef tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.593990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df9fef-daba-4774-b2c6-4466391692ef tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.594227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df9fef-daba-4774-b2c6-4466391692ef tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.604013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df9fef-daba-4774-b2c6-4466391692ef tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.674677 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2188/4409] 10.222.0.43 () {60 vars in 1185 bytes} [Tue Aug 30 04:35:34 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:34.677021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650469-ba1c-4a08-b003-e6bc186568fe tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.702934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da650469-ba1c-4a08-b003-e6bc186568fe tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.718430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf794da2-2983-4b6f-bff3-8862a4f47d06 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.719314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794da2-2983-4b6f-bff3-8862a4f47d06 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.720068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794da2-2983-4b6f-bff3-8862a4f47d06 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.722101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794da2-2983-4b6f-bff3-8862a4f47d06 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.722928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf794da2-2983-4b6f-bff3-8862a4f47d06 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.725001 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-bf794da2-2983-4b6f-bff3-8862a4f47d06 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:34.725001 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:34.725001 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:34.729282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf794da2-2983-4b6f-bff3-8862a4f47d06 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.738663 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2222/4410] 10.222.0.43 () {58 vars in 1164 bytes} [Tue Aug 30 04:35:34 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:34.743463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df9fef-daba-4774-b2c6-4466391692ef tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.758384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df9fef-daba-4774-b2c6-4466391692ef tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.762212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214552a0-5dfe-4cbb-a30e-1de17690b403 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.762839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214552a0-5dfe-4cbb-a30e-1de17690b403 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.763517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214552a0-5dfe-4cbb-a30e-1de17690b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.774427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.777302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.778277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.779223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b9e44f678f0a45bd9b344d58cbb7a7c4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.781787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b9e44f678f0a45bd9b344d58cbb7a7c4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.786065 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:34.786065 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:35:34.786065 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:35:34.789923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.791081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invalidating token cache because consumer b9e44f678f0a45bd9b344d58cbb7a7c4 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:34.791584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.793962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.811814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-214552a0-5dfe-4cbb-a30e-1de17690b403 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:34.816334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-214552a0-5dfe-4cbb-a30e-1de17690b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:34.849625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b9e44f678f0a45bd9b344d58cbb7a7c4', 'request_id': 'req-9e21d192-35e8-4459-8678-3d852314f6d1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.885581 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2189/4411] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Aug 30 04:35:34 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b9e44f678f0a45bd9b344d58cbb7a7c4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:34.889467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.895141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:34.903047 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2223/4412] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:35:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:34.917509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214552a0-5dfe-4cbb-a30e-1de17690b403 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:34.921387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-214552a0-5dfe-4cbb-a30e-1de17690b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:34.930295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21d192-35e8-4459-8678-3d852314f6d1 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:34.938606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:34.939291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:34.939577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:34.939847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c9857d7a0cb5492fa14eaa6c16b2479a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:34.940458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c9857d7a0cb5492fa14eaa6c16b2479a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:34.942292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:34.942548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invalidating token cache because consumer c9857d7a0cb5492fa14eaa6c16b2479a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:34.942816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.943847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.978448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c9857d7a0cb5492fa14eaa6c16b2479a', 'request_id': 'req-57270603-e3db-4b35-8e0b-06057530d411'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:34.985222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:35.032413 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2190/4413] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Aug 30 04:35:34 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c9857d7a0cb5492fa14eaa6c16b2479a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:35.039224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:35.044652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:35.080251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57270603-e3db-4b35-8e0b-06057530d411 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:35.085632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214552a0-5dfe-4cbb-a30e-1de17690b403 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:35.101973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51360f9-61c7-49b9-8838-4ee1bcfb0b67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:35.102763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51360f9-61c7-49b9-8838-4ee1bcfb0b67 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:35.103130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51360f9-61c7-49b9-8838-4ee1bcfb0b67 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:35.103582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51360f9-61c7-49b9-8838-4ee1bcfb0b67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:35.106066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b51360f9-61c7-49b9-8838-4ee1bcfb0b67 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:35.111083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf109a3-db9a-4684-b396-63f3a23809a9 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:35.112198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf109a3-db9a-4684-b396-63f3a23809a9 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:35.115365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf109a3-db9a-4684-b396-63f3a23809a9 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:35.115733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf109a3-db9a-4684-b396-63f3a23809a9 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:35.116553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf109a3-db9a-4684-b396-63f3a23809a9 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:35.118291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf109a3-db9a-4684-b396-63f3a23809a9 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:35.134722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51360f9-61c7-49b9-8838-4ee1bcfb0b67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:35.142735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51360f9-61c7-49b9-8838-4ee1bcfb0b67 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:35.169775 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2191/4414] 10.222.0.43 () {60 vars in 1185 bytes} [Tue Aug 30 04:35:35 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:35.175787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf109a3-db9a-4684-b396-63f3a23809a9 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:35.184450 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2224/4415] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:35:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:35:35.243423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf109a3-db9a-4684-b396-63f3a23809a9 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:35.257039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36743b7b-d0fc-4403-a740-077c11adcb9b tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:35.258656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743b7b-d0fc-4403-a740-077c11adcb9b tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:35.259269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743b7b-d0fc-4403-a740-077c11adcb9b tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:35.259770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36743b7b-d0fc-4403-a740-077c11adcb9b tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d3de4c0a619d4675b63d48746a9434e5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:35.260893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36743b7b-d0fc-4403-a740-077c11adcb9b tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=d3de4c0a619d4675b63d48746a9434e5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:35.263177 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-36743b7b-d0fc-4403-a740-077c11adcb9b tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:35.263177 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:35:35.263177 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:35:35.265322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36743b7b-d0fc-4403-a740-077c11adcb9b tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:35.320396 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2192/4416] 10.222.0.43 () {60 vars in 1285 bytes} [Tue Aug 30 04:35:35 2022] PATCH /identity/v3/OS-OAUTH1/consumers/d3de4c0a619d4675b63d48746a9434e5 => generated 221 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:35.323577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51360f9-61c7-49b9-8838-4ee1bcfb0b67 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:35.340134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51360f9-61c7-49b9-8838-4ee1bcfb0b67 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:35.354885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d4a8b-5cfd-41fa-a289-d043d1750aff tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:35.355739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d4a8b-5cfd-41fa-a289-d043d1750aff tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:35.356003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d4a8b-5cfd-41fa-a289-d043d1750aff tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:35.356320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d4a8b-5cfd-41fa-a289-d043d1750aff tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d3de4c0a619d4675b63d48746a9434e5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:35.357320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d4a8b-5cfd-41fa-a289-d043d1750aff tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=d3de4c0a619d4675b63d48746a9434e5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:35.362820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d4a8b-5cfd-41fa-a289-d043d1750aff tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:35.374961 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2225/4417] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Aug 30 04:35:35 2022] GET /identity/v3/OS-OAUTH1/consumers/d3de4c0a619d4675b63d48746a9434e5 => generated 221 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:35.379512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36743b7b-d0fc-4403-a740-077c11adcb9b tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:35.398273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36743b7b-d0fc-4403-a740-077c11adcb9b tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:35.415338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb448c1213748d6b1cc7eae0a0526c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28e39366937b4b9d96d36f0facc42185', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:35.416275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:35.416655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:35.417104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/d3de4c0a619d4675b63d48746a9434e5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:35.417814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=d3de4c0a619d4675b63d48746a9434e5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:35.419653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:35.420049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invalidating token cache because consumer d3de4c0a619d4675b63d48746a9434e5 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:35.420441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:35.422388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:35.447969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'd3de4c0a619d4675b63d48746a9434e5', 'request_id': 'req-e120b95c-0ce1-4840-a201-ad69b8758d01'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:35.485839 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2193/4418] 10.222.0.43 () {58 vars in 1266 bytes} [Tue Aug 30 04:35:35 2022] DELETE /identity/v3/OS-OAUTH1/consumers/d3de4c0a619d4675b63d48746a9434e5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:35.487431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d4a8b-5cfd-41fa-a289-d043d1750aff tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:35.490122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-748d4a8b-5cfd-41fa-a289-d043d1750aff tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:35.504169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:35.507614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:35.653034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:35.712674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d4a8b-5cfd-41fa-a289-d043d1750aff tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:35.743499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:35.744684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:35.745183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:35.745639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] PATH_INFO: `/v3/users/0a59d68ad94e4cbdbccffae138a8fc47` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:35.750932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a59d68ad94e4cbdbccffae138a8fc47)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:35.758311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:35.783014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120b95c-0ce1-4840-a201-ad69b8758d01 tempest-OAUTHConsumersV3Test-1181815830 tempest-OAUTHConsumersV3Test-1181815830-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:35.806122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de573631-2245-4fca-a3c4-74dd41f74208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:35.806973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573631-2245-4fca-a3c4-74dd41f74208 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:35.808022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573631-2245-4fca-a3c4-74dd41f74208 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:35.809444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573631-2245-4fca-a3c4-74dd41f74208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:35.814939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-de573631-2245-4fca-a3c4-74dd41f74208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:35.854890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de573631-2245-4fca-a3c4-74dd41f74208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:35.861402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de573631-2245-4fca-a3c4-74dd41f74208 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:35.903384 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2194/4419] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:35.904390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de573631-2245-4fca-a3c4-74dd41f74208 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:35.910911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a59d68ad94e4cbdbccffae138a8fc47'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:35.912073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-de573631-2245-4fca-a3c4-74dd41f74208 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:35.912896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a59d68ad94e4cbdbccffae138a8fc47'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:35.948317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a59d68ad94e4cbdbccffae138a8fc47'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:35.963363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de573631-2245-4fca-a3c4-74dd41f74208 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:35.976131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a59d68ad94e4cbdbccffae138a8fc47'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:35.993519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700eee42-9796-442f-9c3b-78818be51d3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:35.994263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eee42-9796-442f-9c3b-78818be51d3c service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:35.994545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eee42-9796-442f-9c3b-78818be51d3c service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:35.994817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700eee42-9796-442f-9c3b-78818be51d3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:36.004844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-011b4ac3-77c0-42ee-a118-a00d81ea371d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a59d68ad94e4cbdbccffae138a8fc47'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:36.013576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-700eee42-9796-442f-9c3b-78818be51d3c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:36.038376 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2226/4420] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:35 2022] DELETE /identity/v3/users/0a59d68ad94e4cbdbccffae138a8fc47 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:36.042209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57ef3-21e9-4c39-aefe-fa496125ee7b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:36.044925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57ef3-21e9-4c39-aefe-fa496125ee7b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:36.045286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf57ef3-21e9-4c39-aefe-fa496125ee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:36.053629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700eee42-9796-442f-9c3b-78818be51d3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:36.062913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700eee42-9796-442f-9c3b-78818be51d3c service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:36.121969 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2195/4421] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:36.155316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7bf57ef3-21e9-4c39-aefe-fa496125ee7b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:36.177949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7bf57ef3-21e9-4c39-aefe-fa496125ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:36.266305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:36.341540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ad1bb-4561-4bef-acc2-e88ace7537b3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:36.341863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ad1bb-4561-4bef-acc2-e88ace7537b3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:36.342759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ad1bb-4561-4bef-acc2-e88ace7537b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:36.385578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0e9ad1bb-4561-4bef-acc2-e88ace7537b3 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:36.388008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0e9ad1bb-4561-4bef-acc2-e88ace7537b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:36.411227 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2227/4422] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:36.492665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57ef3-21e9-4c39-aefe-fa496125ee7b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:36.495696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7bf57ef3-21e9-4c39-aefe-fa496125ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:36.543167 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2196/4423] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:35:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:36.560025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ad1bb-4561-4bef-acc2-e88ace7537b3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:36.562176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0e9ad1bb-4561-4bef-acc2-e88ace7537b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:36.718784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf57ef3-21e9-4c39-aefe-fa496125ee7b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:36.744357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71897ca-775a-4e44-8646-daea7b4518ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:36.748025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71897ca-775a-4e44-8646-daea7b4518ae service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:36.751284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71897ca-775a-4e44-8646-daea7b4518ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:36.751717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71897ca-775a-4e44-8646-daea7b4518ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:36.776120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ad1bb-4561-4bef-acc2-e88ace7537b3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:36.784739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71897ca-775a-4e44-8646-daea7b4518ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:36.790189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71897ca-775a-4e44-8646-daea7b4518ae service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:36.794596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0eca6-1350-4429-933a-c58c1534228b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:36.797933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0eca6-1350-4429-933a-c58c1534228b service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:36.798289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0eca6-1350-4429-933a-c58c1534228b service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:36.798465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0eca6-1350-4429-933a-c58c1534228b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:36.809703 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2228/4424] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:35:36.823328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0eca6-1350-4429-933a-c58c1534228b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:36.825426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0eca6-1350-4429-933a-c58c1534228b service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:36.858885 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2197/4425] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:35:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:37.032766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71897ca-775a-4e44-8646-daea7b4518ae service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:37.034273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f71897ca-775a-4e44-8646-daea7b4518ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:37.071753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71897ca-775a-4e44-8646-daea7b4518ae service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:37.082347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:37.083818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:37.088099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:37.091149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] PATH_INFO: `/v3/users/cd4ddb7417c5469c95c55fe3b40de7a4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:37.093561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4ddb7417c5469c95c55fe3b40de7a4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:37.101735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:37.226756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4ddb7417c5469c95c55fe3b40de7a4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.228185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4ddb7417c5469c95c55fe3b40de7a4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.241764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4ddb7417c5469c95c55fe3b40de7a4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.257051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4ddb7417c5469c95c55fe3b40de7a4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.304606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4ddb7417c5469c95c55fe3b40de7a4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.321152 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2229/4426] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:37 2022] DELETE /identity/v3/users/cd4ddb7417c5469c95c55fe3b40de7a4 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:37.326071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2fe9c-5c23-44ac-abfe-e617e385415f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:37.326341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2fe9c-5c23-44ac-abfe-e617e385415f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:37.326612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2fe9c-5c23-44ac-abfe-e617e385415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:37.363468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6ba2fe9c-5c23-44ac-abfe-e617e385415f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:37.366901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6ba2fe9c-5c23-44ac-abfe-e617e385415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:37.447148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:37.489565 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2198/4427] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:37.538419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:37.540350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:37.759463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:37.759795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2fe9c-5c23-44ac-abfe-e617e385415f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:37.762376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6ba2fe9c-5c23-44ac-abfe-e617e385415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:37.804420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2fe9c-5c23-44ac-abfe-e617e385415f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:37.826895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:37.828396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c8647-a1f0-4923-8c5b-7a7665032a70 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:37.830448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:37.831057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:37.832610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] PATH_INFO: `/v3/projects/b65ee593aa4547ab869504542d0565e2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:37.835102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65ee593aa4547ab869504542d0565e2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:37.839525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:37.857543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a22f2-395d-47be-8e7e-479d9354a86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:37.859487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a22f2-395d-47be-8e7e-479d9354a86f service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:37.859992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a22f2-395d-47be-8e7e-479d9354a86f service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:37.862999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a22f2-395d-47be-8e7e-479d9354a86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:37.919410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a22f2-395d-47be-8e7e-479d9354a86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:37.920876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a22f2-395d-47be-8e7e-479d9354a86f service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:37.960969 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2230/4428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:37.974133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65ee593aa4547ab869504542d0565e2', 'request_id': 'req-b281deb0-d274-474b-9cc9-89a227da4ae6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:37.984704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65ee593aa4547ab869504542d0565e2', 'request_id': 'req-b281deb0-d274-474b-9cc9-89a227da4ae6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.020157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65ee593aa4547ab869504542d0565e2', 'request_id': 'req-b281deb0-d274-474b-9cc9-89a227da4ae6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.051178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] The token cache is being invalidate because project b65ee593aa4547ab869504542d0565e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:38.052832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.055156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.064862 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2199/4429] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:37 2022] DELETE /identity/v3/projects/b65ee593aa4547ab869504542d0565e2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:38.066843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a22f2-395d-47be-8e7e-479d9354a86f service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:38.083061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a22f2-395d-47be-8e7e-479d9354a86f service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:38.199162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:38.200600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:38.201079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:38.201502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] PATH_INFO: `/v3/users/9eb448c1213748d6b1cc7eae0a0526c6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:38.203264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb448c1213748d6b1cc7eae0a0526c6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:38.208905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:38.343825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb448c1213748d6b1cc7eae0a0526c6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.345488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb448c1213748d6b1cc7eae0a0526c6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.377117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb448c1213748d6b1cc7eae0a0526c6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.400133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb448c1213748d6b1cc7eae0a0526c6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.448533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb448c1213748d6b1cc7eae0a0526c6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.485329 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2231/4430] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:38 2022] DELETE /identity/v3/users/9eb448c1213748d6b1cc7eae0a0526c6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:38.564745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:38.566336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:38.595158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281deb0-d274-474b-9cc9-89a227da4ae6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:38.751126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:38.752030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:38.752315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:38.752616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] PATH_INFO: `/v3/projects/1e5589cdb9af4752989c4227a3daa078` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:38.755370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5589cdb9af4752989c4227a3daa078)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:38.758574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:38.846362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5589cdb9af4752989c4227a3daa078', 'request_id': 'req-37626ca4-a991-4127-8bdc-e240547ec36d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.858972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5589cdb9af4752989c4227a3daa078', 'request_id': 'req-37626ca4-a991-4127-8bdc-e240547ec36d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.867827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5589cdb9af4752989c4227a3daa078', 'request_id': 'req-37626ca4-a991-4127-8bdc-e240547ec36d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.877392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:38.884292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] The token cache is being invalidate because project 1e5589cdb9af4752989c4227a3daa078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:38.884607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.885361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:38.887463 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2200/4431] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:38 2022] DELETE /identity/v3/projects/1e5589cdb9af4752989c4227a3daa078 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:38.892433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:38.895926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:38.914915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125328d1-0e30-46d4-8de7-5cd15e8b6f12 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:38.991945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:39.000892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:39.001690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:39.002146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:39.002700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] PATH_INFO: `/v3/users/69ff48e8d3124899b1b79cd8b489d4fd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:39.005268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ff48e8d3124899b1b79cd8b489d4fd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:39.009410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:39.086215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ff48e8d3124899b1b79cd8b489d4fd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.086882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ff48e8d3124899b1b79cd8b489d4fd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.100131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ff48e8d3124899b1b79cd8b489d4fd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.116607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ff48e8d3124899b1b79cd8b489d4fd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.138980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ee832b37-a384-4822-b64f-11948722d695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ff48e8d3124899b1b79cd8b489d4fd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.148441 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2232/4432] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:38 2022] DELETE /identity/v3/users/69ff48e8d3124899b1b79cd8b489d4fd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:39.303449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:39.308029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:39.342084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37626ca4-a991-4127-8bdc-e240547ec36d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:39.491130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:39.492398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:39.494863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:39.495740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] PATH_INFO: `/v3/projects/28e39366937b4b9d96d36f0facc42185` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:39.497603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e39366937b4b9d96d36f0facc42185)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:39.507241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:39.745970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e39366937b4b9d96d36f0facc42185', 'request_id': 'req-4a9b9093-4d36-485b-9dae-edc4fa6028aa'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.791706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e39366937b4b9d96d36f0facc42185', 'request_id': 'req-4a9b9093-4d36-485b-9dae-edc4fa6028aa'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.805055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e39366937b4b9d96d36f0facc42185', 'request_id': 'req-4a9b9093-4d36-485b-9dae-edc4fa6028aa'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.824325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] The token cache is being invalidate because project 28e39366937b4b9d96d36f0facc42185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:39.824708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.826664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a9b9093-4d36-485b-9dae-edc4fa6028aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:39.829952 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2201/4433] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:39 2022] DELETE /identity/v3/projects/28e39366937b4b9d96d36f0facc42185 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:39.836235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640130b-a399-42ce-979e-47623cfa2163 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:39.836812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640130b-a399-42ce-979e-47623cfa2163 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:39.837415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640130b-a399-42ce-979e-47623cfa2163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:39.888036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e640130b-a399-42ce-979e-47623cfa2163 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:39.888590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e640130b-a399-42ce-979e-47623cfa2163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:40.033523 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2233/4434] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:40.050404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8d6e-e016-4bf9-8d3e-0da2b5262aa2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.051058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8d6e-e016-4bf9-8d3e-0da2b5262aa2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.051058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f8d6e-e016-4bf9-8d3e-0da2b5262aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.091489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-740f8d6e-e016-4bf9-8d3e-0da2b5262aa2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:40.093152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-740f8d6e-e016-4bf9-8d3e-0da2b5262aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:40.124455 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2202/4435] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:40.132177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640130b-a399-42ce-979e-47623cfa2163 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.158196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640130b-a399-42ce-979e-47623cfa2163 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.179948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53bc6c-8a26-4a45-840c-134fa5da60e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.179948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53bc6c-8a26-4a45-840c-134fa5da60e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.179948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53bc6c-8a26-4a45-840c-134fa5da60e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.179948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53bc6c-8a26-4a45-840c-134fa5da60e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.181348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53bc6c-8a26-4a45-840c-134fa5da60e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:40.181348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53bc6c-8a26-4a45-840c-134fa5da60e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.188344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53bc6c-8a26-4a45-840c-134fa5da60e8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.224796 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2234/4436] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:40.231025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8d6e-e016-4bf9-8d3e-0da2b5262aa2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.249839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f8d6e-e016-4bf9-8d3e-0da2b5262aa2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.268947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679f9da-9e3d-4d53-913f-523d2329919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.271354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f9da-9e3d-4d53-913f-523d2329919b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.278457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f9da-9e3d-4d53-913f-523d2329919b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.279033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679f9da-9e3d-4d53-913f-523d2329919b admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.295116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679f9da-9e3d-4d53-913f-523d2329919b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.297538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679f9da-9e3d-4d53-913f-523d2329919b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.358478 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2203/4437] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:40 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:40.363126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53bc6c-8a26-4a45-840c-134fa5da60e8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.388633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53bc6c-8a26-4a45-840c-134fa5da60e8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.550560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92267a51-51f7-4309-8879-36aeabc2f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.551620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92267a51-51f7-4309-8879-36aeabc2f5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.552001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92267a51-51f7-4309-8879-36aeabc2f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.552441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92267a51-51f7-4309-8879-36aeabc2f5d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.553361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92267a51-51f7-4309-8879-36aeabc2f5d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.555791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92267a51-51f7-4309-8879-36aeabc2f5d9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.598071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:40.598275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679f9da-9e3d-4d53-913f-523d2329919b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.621262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7679f9da-9e3d-4d53-913f-523d2329919b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:40.624341 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2235/4438] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:40 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:40.628376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92267a51-51f7-4309-8879-36aeabc2f5d9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.651275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92267a51-51f7-4309-8879-36aeabc2f5d9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.665433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679f9da-9e3d-4d53-913f-523d2329919b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.670094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9114-3cd5-4fe2-bc36-ec0990e2aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.670960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9114-3cd5-4fe2-bc36-ec0990e2aea0 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.671390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9114-3cd5-4fe2-bc36-ec0990e2aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.671869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed9114-3cd5-4fe2-bc36-ec0990e2aea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.672682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9114-3cd5-4fe2-bc36-ec0990e2aea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.674499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed9114-3cd5-4fe2-bc36-ec0990e2aea0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.678925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.679954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.680273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.680554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] PATH_INFO: `/v3/projects/502d667c25d3420fa097c45ec61f9af7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.684555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502d667c25d3420fa097c45ec61f9af7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.696287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.702529 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2236/4439] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:40.706697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9114-3cd5-4fe2-bc36-ec0990e2aea0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.732606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed9114-3cd5-4fe2-bc36-ec0990e2aea0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.742679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36873591-17d9-4b01-a955-72575f722428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:40.743313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36873591-17d9-4b01-a955-72575f722428 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.743599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36873591-17d9-4b01-a955-72575f722428 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.743866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36873591-17d9-4b01-a955-72575f722428 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.744523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36873591-17d9-4b01-a955-72575f722428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:40.758414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36873591-17d9-4b01-a955-72575f722428 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:40.774384 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2237/4440] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:40.775702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36873591-17d9-4b01-a955-72575f722428 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:40.801105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36873591-17d9-4b01-a955-72575f722428 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:40.829737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502d667c25d3420fa097c45ec61f9af7', 'request_id': 'req-3488d938-b106-46a9-be72-da2f2fc41019'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:40.847476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502d667c25d3420fa097c45ec61f9af7', 'request_id': 'req-3488d938-b106-46a9-be72-da2f2fc41019'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:40.853626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:40.872966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502d667c25d3420fa097c45ec61f9af7', 'request_id': 'req-3488d938-b106-46a9-be72-da2f2fc41019'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:40.907869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] The token cache is being invalidate because project 502d667c25d3420fa097c45ec61f9af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:40.908215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:40.911264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3488d938-b106-46a9-be72-da2f2fc41019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:40.914667 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2204/4441] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:40 2022] DELETE /identity/v3/projects/502d667c25d3420fa097c45ec61f9af7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:40.922494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68168f69-489d-40c8-844d-2cc5fc4a01d7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:40.922983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68168f69-489d-40c8-844d-2cc5fc4a01d7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:40.923480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68168f69-489d-40c8-844d-2cc5fc4a01d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:40.996768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-68168f69-489d-40c8-844d-2cc5fc4a01d7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:40.999076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-68168f69-489d-40c8-844d-2cc5fc4a01d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:41.004969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d66f00-fca5-4f0f-b94c-692d60b7d279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.006620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66f00-fca5-4f0f-b94c-692d60b7d279 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.007123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66f00-fca5-4f0f-b94c-692d60b7d279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.007735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66f00-fca5-4f0f-b94c-692d60b7d279 admin admin] PATH_INFO: `/v3/projects/07aa502cbc6f46a1a161939421f1ffab/users/686e1ce6c3b54a14b1c58a15e66e4329/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.039114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2205/4442] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:41.049658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecddfa-8146-49ac-83ac-16cc42c6c758 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.050258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecddfa-8146-49ac-83ac-16cc42c6c758 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.050899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cecddfa-8146-49ac-83ac-16cc42c6c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.056167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d66f00-fca5-4f0f-b94c-692d60b7d279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07aa502cbc6f46a1a161939421f1ffab, user_id=686e1ce6c3b54a14b1c58a15e66e4329, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.060404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d66f00-fca5-4f0f-b94c-692d60b7d279 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.087796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1cecddfa-8146-49ac-83ac-16cc42c6c758 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:41.089449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1cecddfa-8146-49ac-83ac-16cc42c6c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:41.102179 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2238/4443] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:40 2022] PUT /identity/v3/projects/07aa502cbc6f46a1a161939421f1ffab/users/686e1ce6c3b54a14b1c58a15e66e4329/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:41.116587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b662e9e-465d-4cb6-925c-89d52dda7c1d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.116974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b662e9e-465d-4cb6-925c-89d52dda7c1d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.117459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b662e9e-465d-4cb6-925c-89d52dda7c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.204548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2b662e9e-465d-4cb6-925c-89d52dda7c1d None None] MFA Rules not processed for user `686e1ce6c3b54a14b1c58a15e66e4329`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:41.205819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b662e9e-465d-4cb6-925c-89d52dda7c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:41.331961 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2206/4444] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:41.334667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecddfa-8146-49ac-83ac-16cc42c6c758 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.350541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cecddfa-8146-49ac-83ac-16cc42c6c758 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.359042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce926e9-0c79-452a-8089-e23645cae5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.360072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce926e9-0c79-452a-8089-e23645cae5aa admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.360400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce926e9-0c79-452a-8089-e23645cae5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.361010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce926e9-0c79-452a-8089-e23645cae5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.362506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce926e9-0c79-452a-8089-e23645cae5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:41.363011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce926e9-0c79-452a-8089-e23645cae5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.372049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce926e9-0c79-452a-8089-e23645cae5aa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.409209 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2239/4445] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:41.409209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b662e9e-465d-4cb6-925c-89d52dda7c1d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.424896 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2207/4446] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:41.424896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce926e9-0c79-452a-8089-e23645cae5aa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.424896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dce926e9-0c79-452a-8089-e23645cae5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:41.441330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b662e9e-465d-4cb6-925c-89d52dda7c1d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.456699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3cf82-1e7d-427d-b391-cc19b1da428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.457567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3cf82-1e7d-427d-b391-cc19b1da428a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.457747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3cf82-1e7d-427d-b391-cc19b1da428a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.457961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3cf82-1e7d-427d-b391-cc19b1da428a admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.458747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3cf82-1e7d-427d-b391-cc19b1da428a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.460994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3cf82-1e7d-427d-b391-cc19b1da428a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.497141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce926e9-0c79-452a-8089-e23645cae5aa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.526343 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2240/4447] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:41 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:41.532843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3cf82-1e7d-427d-b391-cc19b1da428a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.537099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e5116-beec-41f4-8af2-29aa7b0ec7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.539943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e5116-beec-41f4-8af2-29aa7b0ec7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.542635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e5116-beec-41f4-8af2-29aa7b0ec7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.543981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e5116-beec-41f4-8af2-29aa7b0ec7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.548463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e5116-beec-41f4-8af2-29aa7b0ec7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.563491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e5116-beec-41f4-8af2-29aa7b0ec7d6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.586315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:41.646818 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2208/4448] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:41 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:41.651209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e5116-beec-41f4-8af2-29aa7b0ec7d6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.777952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3cf82-1e7d-427d-b391-cc19b1da428a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.861065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e5116-beec-41f4-8af2-29aa7b0ec7d6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.880374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365df005-23fb-4db4-b7bd-bc3981be10b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.883859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df005-23fb-4db4-b7bd-bc3981be10b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.887944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df005-23fb-4db4-b7bd-bc3981be10b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.888781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df005-23fb-4db4-b7bd-bc3981be10b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.892090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365df005-23fb-4db4-b7bd-bc3981be10b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.906056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365df005-23fb-4db4-b7bd-bc3981be10b7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:41.945103 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2209/4449] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:41 2022] POST /identity/v3/users => generated 298 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:41.946745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365df005-23fb-4db4-b7bd-bc3981be10b7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:41.971298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365df005-23fb-4db4-b7bd-bc3981be10b7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:41.987553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e270b2e-f367-407e-85b9-75d2127ee8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:41.988425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e270b2e-f367-407e-85b9-75d2127ee8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:41.990412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e270b2e-f367-407e-85b9-75d2127ee8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:41.990789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e270b2e-f367-407e-85b9-75d2127ee8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:41.991674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e270b2e-f367-407e-85b9-75d2127ee8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:41.997124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e270b2e-f367-407e-85b9-75d2127ee8c4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:42.008026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce95683-92f7-45e7-9f7a-8ed4867fc15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:42.008674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce95683-92f7-45e7-9f7a-8ed4867fc15d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:42.009748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce95683-92f7-45e7-9f7a-8ed4867fc15d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:42.010075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce95683-92f7-45e7-9f7a-8ed4867fc15d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:42.010967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce95683-92f7-45e7-9f7a-8ed4867fc15d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:42.013094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce95683-92f7-45e7-9f7a-8ed4867fc15d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:42.058976 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2210/4450] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:42.064595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e270b2e-f367-407e-85b9-75d2127ee8c4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:42.071023 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2241/4451] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:41 2022] POST /identity/v3/users => generated 289 bytes in 538 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:42.071887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce95683-92f7-45e7-9f7a-8ed4867fc15d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:42.094135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce95683-92f7-45e7-9f7a-8ed4867fc15d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:42.106556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661fba5-48ba-4f7b-a3dd-95663d57f64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:42.107080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e270b2e-f367-407e-85b9-75d2127ee8c4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:42.107267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661fba5-48ba-4f7b-a3dd-95663d57f64b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:42.107501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661fba5-48ba-4f7b-a3dd-95663d57f64b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:42.107777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661fba5-48ba-4f7b-a3dd-95663d57f64b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:42.108475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661fba5-48ba-4f7b-a3dd-95663d57f64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:42.119509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6661fba5-48ba-4f7b-a3dd-95663d57f64b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:42.133900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a961968-aec4-4805-913e-15625919a172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:42.134806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a961968-aec4-4805-913e-15625919a172 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:42.136684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a961968-aec4-4805-913e-15625919a172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:42.136968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a961968-aec4-4805-913e-15625919a172 admin admin] PATH_INFO: `/v3/projects/ed5bb8a229f6450585e92b2d7156c1a8/users/c63b50e7f7ae482981508e222c5102ca/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:42.138986 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2242/4452] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:42.146974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661fba5-48ba-4f7b-a3dd-95663d57f64b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:42.175065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6661fba5-48ba-4f7b-a3dd-95663d57f64b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:42.183484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd562c0-5810-4d96-a2f4-26449d4031b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:42.184819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd562c0-5810-4d96-a2f4-26449d4031b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:42.185116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd562c0-5810-4d96-a2f4-26449d4031b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:42.185388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd562c0-5810-4d96-a2f4-26449d4031b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:42.186111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd562c0-5810-4d96-a2f4-26449d4031b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:42.194428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd562c0-5810-4d96-a2f4-26449d4031b4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:42.196167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a961968-aec4-4805-913e-15625919a172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5bb8a229f6450585e92b2d7156c1a8, user_id=c63b50e7f7ae482981508e222c5102ca, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:42.207740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a961968-aec4-4805-913e-15625919a172 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:42.216011 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2243/4453] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:42.224003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd562c0-5810-4d96-a2f4-26449d4031b4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:42.237862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:42.246539 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2211/4454] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:42 2022] PUT /identity/v3/projects/ed5bb8a229f6450585e92b2d7156c1a8/users/c63b50e7f7ae482981508e222c5102ca/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:42.252396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a961968-aec4-4805-913e-15625919a172 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:42.253468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd562c0-5810-4d96-a2f4-26449d4031b4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:42.417581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a5a23-877e-4870-8836-5741fdb84559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:42.418712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a5a23-877e-4870-8836-5741fdb84559 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:42.419342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a5a23-877e-4870-8836-5741fdb84559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:42.419807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a5a23-877e-4870-8836-5741fdb84559 admin admin] PATH_INFO: `/v3/projects/9f783a3231a0424389d59a7ee7cc854e/users/13dc8f3d064b4e2a91e655be345b6231/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:42.446411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a961968-aec4-4805-913e-15625919a172 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:42.477799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fcf84-db49-460e-bfaf-81a56829689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:42.478991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fcf84-db49-460e-bfaf-81a56829689a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:42.479490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fcf84-db49-460e-bfaf-81a56829689a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:42.479988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fcf84-db49-460e-bfaf-81a56829689a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:42.481651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fcf84-db49-460e-bfaf-81a56829689a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:42.482110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a5a23-877e-4870-8836-5741fdb84559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f783a3231a0424389d59a7ee7cc854e, user_id=13dc8f3d064b4e2a91e655be345b6231, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:42.484766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fcf84-db49-460e-bfaf-81a56829689a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:42.484898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a5a23-877e-4870-8836-5741fdb84559 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:42.510591 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2244/4455] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:42 2022] PUT /identity/v3/projects/9f783a3231a0424389d59a7ee7cc854e/users/13dc8f3d064b4e2a91e655be345b6231/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:42.515407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a5a23-877e-4870-8836-5741fdb84559 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:42.518806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f77a5a23-877e-4870-8836-5741fdb84559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:42.530794 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2212/4456] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:42.532515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ec52b-cc2f-4ad2-b41b-67d72d4ec009 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:42.534228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ec52b-cc2f-4ad2-b41b-67d72d4ec009 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:42.534702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ec52b-cc2f-4ad2-b41b-67d72d4ec009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:42.609496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8a2ec52b-cc2f-4ad2-b41b-67d72d4ec009 None None] MFA Rules not processed for user `13dc8f3d064b4e2a91e655be345b6231`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:42.610956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8a2ec52b-cc2f-4ad2-b41b-67d72d4ec009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:42.642056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:42.773168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a5a23-877e-4870-8836-5741fdb84559 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:42.778741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:42.780045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:42.780287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:42.780766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] PATH_INFO: `/v3/users/84933dd631ac4adbb499c5072b7caf0d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:42.782159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84933dd631ac4adbb499c5072b7caf0d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:42.793726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:42.794565 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2213/4457] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:42.796122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ec52b-cc2f-4ad2-b41b-67d72d4ec009 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:42.810938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ec52b-cc2f-4ad2-b41b-67d72d4ec009 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:42.818843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6b291-c55a-4070-8d2a-41fc1f6e38fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:42.819547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6b291-c55a-4070-8d2a-41fc1f6e38fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:42.819826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6b291-c55a-4070-8d2a-41fc1f6e38fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:42.820098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6b291-c55a-4070-8d2a-41fc1f6e38fd admin admin] PATH_INFO: `/v3/projects/ed5bb8a229f6450585e92b2d7156c1a8/users/c63b50e7f7ae482981508e222c5102ca/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:42.822759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6b291-c55a-4070-8d2a-41fc1f6e38fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed5bb8a229f6450585e92b2d7156c1a8, user_id=c63b50e7f7ae482981508e222c5102ca, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:42.825462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6b291-c55a-4070-8d2a-41fc1f6e38fd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:42.839329 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2214/4458] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:42 2022] PUT /identity/v3/projects/ed5bb8a229f6450585e92b2d7156c1a8/users/c63b50e7f7ae482981508e222c5102ca/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:42.840360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6b291-c55a-4070-8d2a-41fc1f6e38fd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:42.974448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84933dd631ac4adbb499c5072b7caf0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:42.975243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84933dd631ac4adbb499c5072b7caf0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:42.990111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84933dd631ac4adbb499c5072b7caf0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:42.993973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6b291-c55a-4070-8d2a-41fc1f6e38fd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:43.002560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84933dd631ac4adbb499c5072b7caf0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:43.005572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be241b3-828a-4dac-83d1-ee2e102843aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:43.008068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be241b3-828a-4dac-83d1-ee2e102843aa admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:43.008570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be241b3-828a-4dac-83d1-ee2e102843aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:43.009715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be241b3-828a-4dac-83d1-ee2e102843aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:43.010653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be241b3-828a-4dac-83d1-ee2e102843aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:43.015270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be241b3-828a-4dac-83d1-ee2e102843aa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:43.037004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e71a6151-114e-4894-9026-5658bd8b852e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84933dd631ac4adbb499c5072b7caf0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:43.045167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:43.050396 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2245/4459] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:42 2022] DELETE /identity/v3/users/84933dd631ac4adbb499c5072b7caf0d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:43.052886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a5668-8aaa-4372-95c7-0b1fdf840ac3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:43.053419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a5668-8aaa-4372-95c7-0b1fdf840ac3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:43.054363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a5668-8aaa-4372-95c7-0b1fdf840ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:43.068600 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2215/4460] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:42 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:43.072953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be241b3-828a-4dac-83d1-ee2e102843aa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:43.076228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5be241b3-828a-4dac-83d1-ee2e102843aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:43.113971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-495a5668-8aaa-4372-95c7-0b1fdf840ac3 None None] MFA Rules not processed for user `c63b50e7f7ae482981508e222c5102ca`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:43.115969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-495a5668-8aaa-4372-95c7-0b1fdf840ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:43.248155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be241b3-828a-4dac-83d1-ee2e102843aa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:43.258942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d276288-9776-4909-af01-5eda301d3f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:43.260007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d276288-9776-4909-af01-5eda301d3f52 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:43.260390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d276288-9776-4909-af01-5eda301d3f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:43.260916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d276288-9776-4909-af01-5eda301d3f52 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:43.261790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d276288-9776-4909-af01-5eda301d3f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:43.264143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d276288-9776-4909-af01-5eda301d3f52 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:43.314818 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2216/4461] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:43 2022] POST /identity/v3/users => generated 295 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:43.320798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d276288-9776-4909-af01-5eda301d3f52 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:43.349406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d276288-9776-4909-af01-5eda301d3f52 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:43.357395 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2246/4462] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:43.359779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a5668-8aaa-4372-95c7-0b1fdf840ac3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:43.367271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77053766-9363-4547-a8c8-45a0fe58de37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:43.369333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77053766-9363-4547-a8c8-45a0fe58de37 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:43.370320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77053766-9363-4547-a8c8-45a0fe58de37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:43.371365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77053766-9363-4547-a8c8-45a0fe58de37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:43.373438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77053766-9363-4547-a8c8-45a0fe58de37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:43.378515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a5668-8aaa-4372-95c7-0b1fdf840ac3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:43.382155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77053766-9363-4547-a8c8-45a0fe58de37 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:43.387442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafc513-e5c7-4297-8e88-b281d5856965 tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63b50e7f7ae482981508e222c5102ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5bb8a229f6450585e92b2d7156c1a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:43.388906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafc513-e5c7-4297-8e88-b281d5856965 tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:43.389589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafc513-e5c7-4297-8e88-b281d5856965 tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:43.390365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafc513-e5c7-4297-8e88-b281d5856965 tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:43.392710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafc513-e5c7-4297-8e88-b281d5856965 tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:43.400098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafc513-e5c7-4297-8e88-b281d5856965 tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:43.420835 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2217/4463] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:43.430137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77053766-9363-4547-a8c8-45a0fe58de37 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:43.475895 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2247/4464] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:43 2022] POST /identity/v3/projects => generated 360 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:43.477624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafc513-e5c7-4297-8e88-b281d5856965 tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:43.479771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5fafc513-e5c7-4297-8e88-b281d5856965 tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:43.483872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77053766-9363-4547-a8c8-45a0fe58de37 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:43.485583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:43.631582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafc513-e5c7-4297-8e88-b281d5856965 tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:43.642322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:43.645936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:43.646891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:43.649890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] PATH_INFO: `/v3/projects/5336c1b502c949f39f1c2868e09bce4e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:43.652336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5336c1b502c949f39f1c2868e09bce4e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:43.654765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fe19a-c36a-4e39-b3a6-d749bbc9eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:43.655948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fe19a-c36a-4e39-b3a6-d749bbc9eee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:43.656413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fe19a-c36a-4e39-b3a6-d749bbc9eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:43.656777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fe19a-c36a-4e39-b3a6-d749bbc9eee6 admin admin] PATH_INFO: `/v3/projects/3ebb98ec28614da4b7f11e2043e90e36/users/1607710da10b4baea4a933a33e6d544e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:43.674048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:43.720351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fe19a-c36a-4e39-b3a6-d749bbc9eee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebb98ec28614da4b7f11e2043e90e36, user_id=1607710da10b4baea4a933a33e6d544e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:43.732382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fe19a-c36a-4e39-b3a6-d749bbc9eee6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:43.756838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5336c1b502c949f39f1c2868e09bce4e', 'request_id': 'req-17e2ca67-c74d-4467-a67f-6583db005ddf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:43.775387 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2218/4465] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:43 2022] PUT /identity/v3/projects/3ebb98ec28614da4b7f11e2043e90e36/users/1607710da10b4baea4a933a33e6d544e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:43.781768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fe19a-c36a-4e39-b3a6-d749bbc9eee6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:43.785507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5336c1b502c949f39f1c2868e09bce4e', 'request_id': 'req-17e2ca67-c74d-4467-a67f-6583db005ddf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:43.788942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-398fe19a-c36a-4e39-b3a6-d749bbc9eee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:43.804461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5336c1b502c949f39f1c2868e09bce4e', 'request_id': 'req-17e2ca67-c74d-4467-a67f-6583db005ddf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:43.829386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] The token cache is being invalidate because project 5336c1b502c949f39f1c2868e09bce4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:43.829714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:43.830653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:43.832484 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2248/4466] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:43 2022] DELETE /identity/v3/projects/5336c1b502c949f39f1c2868e09bce4e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:43.833720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:43.837997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:43.925122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fe19a-c36a-4e39-b3a6-d749bbc9eee6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:43.930890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211afee7-b6f1-43a9-a920-2e8260c183f9 tempest-ProjectsNegativeTestJSON-1815314484 tempest-ProjectsNegativeTestJSON-1815314484-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686e1ce6c3b54a14b1c58a15e66e4329', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '07aa502cbc6f46a1a161939421f1ffab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:43.931564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211afee7-b6f1-43a9-a920-2e8260c183f9 tempest-ProjectsNegativeTestJSON-1815314484 tempest-ProjectsNegativeTestJSON-1815314484-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:43.931848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211afee7-b6f1-43a9-a920-2e8260c183f9 tempest-ProjectsNegativeTestJSON-1815314484 tempest-ProjectsNegativeTestJSON-1815314484-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:43.932280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211afee7-b6f1-43a9-a920-2e8260c183f9 tempest-ProjectsNegativeTestJSON-1815314484 tempest-ProjectsNegativeTestJSON-1815314484-project] PATH_INFO: `/v3/projects/659e803d47b24d83901ea6f876707f59` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:43.933630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211afee7-b6f1-43a9-a920-2e8260c183f9 tempest-ProjectsNegativeTestJSON-1815314484 tempest-ProjectsNegativeTestJSON-1815314484-project] RBAC: Authorizing `identity:delete_project(project_id=659e803d47b24d83901ea6f876707f59)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-211afee7-b6f1-43a9-a920-2e8260c183f9 tempest-ProjectsNegativeTestJSON-1815314484 tempest-ProjectsNegativeTestJSON-1815314484-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Aug 30 04:35:43.943159 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 30 04:35:43.944255 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 30 04:35:43.944255 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 30 04:35:43.944255 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 30 04:35:43.944255 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 30 04:35:43.944255 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:35:43.944255 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 30 04:35:43.944255 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 30 04:35:43.944255 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:35:43.945018 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2219/4467] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:43 2022] DELETE /identity/v3/projects/659e803d47b24d83901ea6f876707f59 => generated 136 bytes in 169 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:35:43.946436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb22f0-5319-43cf-8f41-6221f99c7e53 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:43.946719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb22f0-5319-43cf-8f41-6221f99c7e53 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:43.947449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb22f0-5319-43cf-8f41-6221f99c7e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:43.959783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:43.979401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3fcb22f0-5319-43cf-8f41-6221f99c7e53 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:43.981730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3fcb22f0-5319-43cf-8f41-6221f99c7e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:43.990436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2ca67-c74d-4467-a67f-6583db005ddf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:44.052072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:44.118498 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2220/4468] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:44.118498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb22f0-5319-43cf-8f41-6221f99c7e53 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:44.120319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d6461-b4bb-4394-a86e-fa63112483f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:44.120775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3fcb22f0-5319-43cf-8f41-6221f99c7e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:44.121454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d6461-b4bb-4394-a86e-fa63112483f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:44.121965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d6461-b4bb-4394-a86e-fa63112483f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:44.122463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d6461-b4bb-4394-a86e-fa63112483f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:44.123421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d6461-b4bb-4394-a86e-fa63112483f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:44.125447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d6461-b4bb-4394-a86e-fa63112483f7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:44.181293 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2249/4469] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:44.185550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0721c4f-14b1-4be3-b95d-3f69584e3a4e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:44.188744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0721c4f-14b1-4be3-b95d-3f69584e3a4e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:44.189391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0721c4f-14b1-4be3-b95d-3f69584e3a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:44.237677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e0721c4f-14b1-4be3-b95d-3f69584e3a4e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:44.240399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e0721c4f-14b1-4be3-b95d-3f69584e3a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:44.259247 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2250/4470] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:44.260598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0721c4f-14b1-4be3-b95d-3f69584e3a4e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:44.265769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb22f0-5319-43cf-8f41-6221f99c7e53 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:44.272549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0721c4f-14b1-4be3-b95d-3f69584e3a4e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:44.273468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c63b50e7f7ae482981508e222c5102ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ed5bb8a229f6450585e92b2d7156c1a8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:44.274338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:44.275017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:44.275017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] PATH_INFO: `/v3/projects/659e803d47b24d83901ea6f876707f59` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:44.278339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] RBAC: Authorizing `identity:delete_project(project_id=659e803d47b24d83901ea6f876707f59)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:44.280672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:44.281094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a096b-ccfe-4393-9cd2-774f38b44f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:44.282186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a096b-ccfe-4393-9cd2-774f38b44f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:44.282756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a096b-ccfe-4393-9cd2-774f38b44f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:44.283281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a096b-ccfe-4393-9cd2-774f38b44f55 admin admin] PATH_INFO: `/v3/projects/3ebb98ec28614da4b7f11e2043e90e36/users/1607710da10b4baea4a933a33e6d544e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:44.286091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a096b-ccfe-4393-9cd2-774f38b44f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebb98ec28614da4b7f11e2043e90e36, user_id=1607710da10b4baea4a933a33e6d544e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:44.289852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a096b-ccfe-4393-9cd2-774f38b44f55 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:44.324212 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2251/4471] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:44 2022] PUT /identity/v3/projects/3ebb98ec28614da4b7f11e2043e90e36/users/1607710da10b4baea4a933a33e6d544e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:44.324212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a096b-ccfe-4393-9cd2-774f38b44f55 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:44.402838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659e803d47b24d83901ea6f876707f59', 'request_id': 'req-1a68d3f7-d052-4c07-a8b6-d30430642f3d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:44.414039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659e803d47b24d83901ea6f876707f59', 'request_id': 'req-1a68d3f7-d052-4c07-a8b6-d30430642f3d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:44.425275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659e803d47b24d83901ea6f876707f59', 'request_id': 'req-1a68d3f7-d052-4c07-a8b6-d30430642f3d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:44.438120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a096b-ccfe-4393-9cd2-774f38b44f55 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:44.440865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] The token cache is being invalidate because project 659e803d47b24d83901ea6f876707f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:44.441704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:44.442745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a68d3f7-d052-4c07-a8b6-d30430642f3d tempest-ProjectsNegativeTestJSON-696387545 tempest-ProjectsNegativeTestJSON-696387545-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:44.444640 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2221/4472] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:44 2022] DELETE /identity/v3/projects/659e803d47b24d83901ea6f876707f59 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:44.446295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10befa25-5346-4755-9fda-bc9ef2fd6e35 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:44.447265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10befa25-5346-4755-9fda-bc9ef2fd6e35 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:44.447755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10befa25-5346-4755-9fda-bc9ef2fd6e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:44.575001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-10befa25-5346-4755-9fda-bc9ef2fd6e35 None None] MFA Rules not processed for user `1607710da10b4baea4a933a33e6d544e`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:44.577409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-10befa25-5346-4755-9fda-bc9ef2fd6e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:44.593762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852f1a1-3f33-4005-a359-628e9c208f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:44.594718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f1a1-3f33-4005-a359-628e9c208f03 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:44.595104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f1a1-3f33-4005-a359-628e9c208f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:44.595434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852f1a1-3f33-4005-a359-628e9c208f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:44.596127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852f1a1-3f33-4005-a359-628e9c208f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:44.596448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852f1a1-3f33-4005-a359-628e9c208f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:44.600177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852f1a1-3f33-4005-a359-628e9c208f03 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:44.617906 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2252/4473] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:44.617906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852f1a1-3f33-4005-a359-628e9c208f03 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:44.627050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d852f1a1-3f33-4005-a359-628e9c208f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:44.645804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852f1a1-3f33-4005-a359-628e9c208f03 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:44.651116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:44.663161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:44.663833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:44.664107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:44.664442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] PATH_INFO: `/v3/users/686e1ce6c3b54a14b1c58a15e66e4329` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:44.666756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] RBAC: Authorizing `identity:delete_user(user_id=686e1ce6c3b54a14b1c58a15e66e4329)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:44.671491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:44.756395 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2222/4474] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:44.758755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10befa25-5346-4755-9fda-bc9ef2fd6e35 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:44.760618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-10befa25-5346-4755-9fda-bc9ef2fd6e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:44.760766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686e1ce6c3b54a14b1c58a15e66e4329'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:44.761776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686e1ce6c3b54a14b1c58a15e66e4329'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:44.768554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:44.774756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686e1ce6c3b54a14b1c58a15e66e4329'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:44.787052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686e1ce6c3b54a14b1c58a15e66e4329'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:44.787313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10befa25-5346-4755-9fda-bc9ef2fd6e35 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:44.797830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7bd07-23ba-4371-b267-3874fe153d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:44.799078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7bd07-23ba-4371-b267-3874fe153d9a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:44.799583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7bd07-23ba-4371-b267-3874fe153d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:44.800230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7bd07-23ba-4371-b267-3874fe153d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:44.802955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7bd07-23ba-4371-b267-3874fe153d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:44.807139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7bd07-23ba-4371-b267-3874fe153d9a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:44.808173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686e1ce6c3b54a14b1c58a15e66e4329'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:44.817272 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2253/4475] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:44 2022] DELETE /identity/v3/users/686e1ce6c3b54a14b1c58a15e66e4329 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:44.821694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:44.823823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:44.865057 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2223/4476] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:44 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:44.866740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d531c-f738-4693-b2cd-a68741ca9215 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:44.867846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d531c-f738-4693-b2cd-a68741ca9215 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:44.869363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d531c-f738-4693-b2cd-a68741ca9215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:44.918241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-292d531c-f738-4693-b2cd-a68741ca9215 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:44.921335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-292d531c-f738-4693-b2cd-a68741ca9215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:44.977921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6875f-fecf-4773-8982-4dc9528b706e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:45.222388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f330e-5a50-419d-af9c-4b15c12befd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:45.226899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f330e-5a50-419d-af9c-4b15c12befd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:45.227420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f330e-5a50-419d-af9c-4b15c12befd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:45.227915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f330e-5a50-419d-af9c-4b15c12befd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:45.234139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-894f330e-5a50-419d-af9c-4b15c12befd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:45.241565 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2224/4477] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:45.243150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d531c-f738-4693-b2cd-a68741ca9215 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:45.244931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-292d531c-f738-4693-b2cd-a68741ca9215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:45.271241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d531c-f738-4693-b2cd-a68741ca9215 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:45.277645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cfbbb-84de-4390-a5fb-c16feba8dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:45.278430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cfbbb-84de-4390-a5fb-c16feba8dbba admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:45.278782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cfbbb-84de-4390-a5fb-c16feba8dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:45.279125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cfbbb-84de-4390-a5fb-c16feba8dbba admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:45.280076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cfbbb-84de-4390-a5fb-c16feba8dbba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:45.283816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cfbbb-84de-4390-a5fb-c16feba8dbba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:45.318130 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2225/4478] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:45 2022] POST /identity/v3/users => generated 290 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:45.319769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cfbbb-84de-4390-a5fb-c16feba8dbba admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:45.326885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4b6cfbbb-84de-4390-a5fb-c16feba8dbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:45.357451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cfbbb-84de-4390-a5fb-c16feba8dbba admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:45.386864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4305a01-7334-4e92-860e-3f2a37fabcb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:45.390973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4305a01-7334-4e92-860e-3f2a37fabcb8 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:45.391677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4305a01-7334-4e92-860e-3f2a37fabcb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:45.394449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4305a01-7334-4e92-860e-3f2a37fabcb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:45.404476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f330e-5a50-419d-af9c-4b15c12befd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:45.406392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f330e-5a50-419d-af9c-4b15c12befd4 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:45.416863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4305a01-7334-4e92-860e-3f2a37fabcb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:45.419041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4305a01-7334-4e92-860e-3f2a37fabcb8 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:45.420637 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2254/4479] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:45.421990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f330e-5a50-419d-af9c-4b15c12befd4 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:45.432036 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2226/4480] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:45.436340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f330e-5a50-419d-af9c-4b15c12befd4 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:45.447393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e3848-fab2-44b8-b7ff-dac425c8a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:45.448731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3848-fab2-44b8-b7ff-dac425c8a8aa admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:45.448731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3848-fab2-44b8-b7ff-dac425c8a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:45.449263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3848-fab2-44b8-b7ff-dac425c8a8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:45.449738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e3848-fab2-44b8-b7ff-dac425c8a8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:45.452009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e3848-fab2-44b8-b7ff-dac425c8a8aa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:45.465419 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2255/4481] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:45.475211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4305a01-7334-4e92-860e-3f2a37fabcb8 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:45.494610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4305a01-7334-4e92-860e-3f2a37fabcb8 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:45.511218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f673ff3-e77a-412f-8e27-864f295f34d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:45.512538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673ff3-e77a-412f-8e27-864f295f34d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:45.516508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673ff3-e77a-412f-8e27-864f295f34d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:45.516508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f673ff3-e77a-412f-8e27-864f295f34d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:45.519669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f673ff3-e77a-412f-8e27-864f295f34d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:45.523715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f673ff3-e77a-412f-8e27-864f295f34d5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:45.548867 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2227/4482] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:45.550360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e3848-fab2-44b8-b7ff-dac425c8a8aa admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:45.586045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e3848-fab2-44b8-b7ff-dac425c8a8aa admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:45.630050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314af197-3a16-481e-9ea1-380bae820c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:45.631083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af197-3a16-481e-9ea1-380bae820c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:45.631479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af197-3a16-481e-9ea1-380bae820c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:45.631770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314af197-3a16-481e-9ea1-380bae820c32 admin admin] PATH_INFO: `/v3/projects/25d8f98f418a4ffcb373e69d9121dad4/users/5e44cf9ac29f4f769979caa170d744ad/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:45.701505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af197-3a16-481e-9ea1-380bae820c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d8f98f418a4ffcb373e69d9121dad4, user_id=5e44cf9ac29f4f769979caa170d744ad, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:45.704370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314af197-3a16-481e-9ea1-380bae820c32 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:45.736299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:45.754747 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2256/4483] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:45 2022] PUT /identity/v3/projects/25d8f98f418a4ffcb373e69d9121dad4/users/5e44cf9ac29f4f769979caa170d744ad/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:45.781746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a9362-c3d7-4fd8-85af-4aa2aa0816f6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:45.782496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a9362-c3d7-4fd8-85af-4aa2aa0816f6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:45.783022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a9362-c3d7-4fd8-85af-4aa2aa0816f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:45.852199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d51a9362-c3d7-4fd8-85af-4aa2aa0816f6 None None] MFA Rules not processed for user `5e44cf9ac29f4f769979caa170d744ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:45.855093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d51a9362-c3d7-4fd8-85af-4aa2aa0816f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:46.004600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:46.049674 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2228/4484] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:46.061025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6d9d0-bc3c-43a8-8d34-c9df63826393 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:46.061308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6d9d0-bc3c-43a8-8d34-c9df63826393 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:46.061581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6d9d0-bc3c-43a8-8d34-c9df63826393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:46.084931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7ce6d9d0-bc3c-43a8-8d34-c9df63826393 None None] MFA Rules not processed for user `5e44cf9ac29f4f769979caa170d744ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:46.086316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7ce6d9d0-bc3c-43a8-8d34-c9df63826393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:46.095164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2257/4485] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:46.953028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a9362-c3d7-4fd8-85af-4aa2aa0816f6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:46.960699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d51a9362-c3d7-4fd8-85af-4aa2aa0816f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:47.131433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a9362-c3d7-4fd8-85af-4aa2aa0816f6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:47.140324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937c02f-e194-45b9-a7a3-9698e97b9970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:47.140969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937c02f-e194-45b9-a7a3-9698e97b9970 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:47.141239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937c02f-e194-45b9-a7a3-9698e97b9970 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:47.141607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937c02f-e194-45b9-a7a3-9698e97b9970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:47.153155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937c02f-e194-45b9-a7a3-9698e97b9970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:47.156810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b937c02f-e194-45b9-a7a3-9698e97b9970 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:47.177303 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2229/4486] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:35:48.270781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6d9d0-bc3c-43a8-8d34-c9df63826393 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:48.272297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7ce6d9d0-bc3c-43a8-8d34-c9df63826393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:48.428688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6d9d0-bc3c-43a8-8d34-c9df63826393 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:48.436327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:48.437024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:48.437301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:48.437570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] PATH_INFO: `/v3/projects/07aa502cbc6f46a1a161939421f1ffab` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:48.443021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07aa502cbc6f46a1a161939421f1ffab)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:48.445059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:48.557477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07aa502cbc6f46a1a161939421f1ffab', 'request_id': 'req-5cf15605-7937-4341-a6ec-596923cf0395'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:48.582456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07aa502cbc6f46a1a161939421f1ffab', 'request_id': 'req-5cf15605-7937-4341-a6ec-596923cf0395'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:48.624294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07aa502cbc6f46a1a161939421f1ffab', 'request_id': 'req-5cf15605-7937-4341-a6ec-596923cf0395'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:48.652826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] The token cache is being invalidate because project 07aa502cbc6f46a1a161939421f1ffab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:48.653590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:48.654729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:48.658247 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2258/4487] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:48 2022] DELETE /identity/v3/projects/07aa502cbc6f46a1a161939421f1ffab => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:48.662796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937c02f-e194-45b9-a7a3-9698e97b9970 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:48.690085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b937c02f-e194-45b9-a7a3-9698e97b9970 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:48.836712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:48.837398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:48.837675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:48.837976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] PATH_INFO: `/v3/users/c63b50e7f7ae482981508e222c5102ca` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:48.840883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63b50e7f7ae482981508e222c5102ca)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:48.843877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:49.009438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63b50e7f7ae482981508e222c5102ca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:49.024510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63b50e7f7ae482981508e222c5102ca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:49.052330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63b50e7f7ae482981508e222c5102ca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:49.056993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:49.071677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63b50e7f7ae482981508e222c5102ca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:49.073387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4acc7869-0914-41dd-8f71-25254666074f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63b50e7f7ae482981508e222c5102ca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:49.098541 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2230/4488] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:48 2022] DELETE /identity/v3/users/c63b50e7f7ae482981508e222c5102ca => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:49.117096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:49.141342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:49.217988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf15605-7937-4341-a6ec-596923cf0395 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:49.393147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:49.394427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:49.394427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:49.394427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] PATH_INFO: `/v3/users/13dc8f3d064b4e2a91e655be345b6231` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:49.397926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=13dc8f3d064b4e2a91e655be345b6231)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:49.403841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:49.476200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:49.517048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13dc8f3d064b4e2a91e655be345b6231'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:49.519523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13dc8f3d064b4e2a91e655be345b6231'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:49.545970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13dc8f3d064b4e2a91e655be345b6231'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:49.579158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13dc8f3d064b4e2a91e655be345b6231'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:49.606707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13dc8f3d064b4e2a91e655be345b6231'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:49.618854 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2259/4489] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:49 2022] DELETE /identity/v3/users/13dc8f3d064b4e2a91e655be345b6231 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:49.625725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13205420-d1f1-40c2-adb7-d2445efc35f5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:49.626826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13205420-d1f1-40c2-adb7-d2445efc35f5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:49.627302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13205420-d1f1-40c2-adb7-d2445efc35f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:49.716015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-13205420-d1f1-40c2-adb7-d2445efc35f5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:49.717280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-13205420-d1f1-40c2-adb7-d2445efc35f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:49.903594 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2231/4490] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:49.957626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:49.964874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:50.130170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13205420-d1f1-40c2-adb7-d2445efc35f5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:50.132258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-13205420-d1f1-40c2-adb7-d2445efc35f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:50.156781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13205420-d1f1-40c2-adb7-d2445efc35f5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:50.176890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:50.177775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:50.178112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:50.178436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] PATH_INFO: `/v3/projects/ed5bb8a229f6450585e92b2d7156c1a8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:50.182810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed5bb8a229f6450585e92b2d7156c1a8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:50.185230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:50.186319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f18d7-ef3d-438b-a8b8-5adbbca878dc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:50.190526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ec88a-9a7a-4d03-a9db-be58a972200c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:50.191189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ec88a-9a7a-4d03-a9db-be58a972200c service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:50.191453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ec88a-9a7a-4d03-a9db-be58a972200c service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:50.191725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ec88a-9a7a-4d03-a9db-be58a972200c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:50.214140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ec88a-9a7a-4d03-a9db-be58a972200c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:50.215328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ec88a-9a7a-4d03-a9db-be58a972200c service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:50.227108 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2260/4491] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:50.311173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed5bb8a229f6450585e92b2d7156c1a8', 'request_id': 'req-0b4772ea-04fe-431c-a008-2471e53fa11c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:50.327190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed5bb8a229f6450585e92b2d7156c1a8', 'request_id': 'req-0b4772ea-04fe-431c-a008-2471e53fa11c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:50.336832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed5bb8a229f6450585e92b2d7156c1a8', 'request_id': 'req-0b4772ea-04fe-431c-a008-2471e53fa11c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:50.360042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] The token cache is being invalidate because project ed5bb8a229f6450585e92b2d7156c1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:50.360572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:50.362085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0b4772ea-04fe-431c-a008-2471e53fa11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:50.367247 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2232/4492] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:50 2022] DELETE /identity/v3/projects/ed5bb8a229f6450585e92b2d7156c1a8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:50.369397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992f28-3110-45a7-b64a-ff79cb4faded None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:50.370198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992f28-3110-45a7-b64a-ff79cb4faded None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:50.370638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2992f28-3110-45a7-b64a-ff79cb4faded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:50.392643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c2992f28-3110-45a7-b64a-ff79cb4faded None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:50.393992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c2992f28-3110-45a7-b64a-ff79cb4faded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:50.526030 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2261/4493] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:50.534419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9daf0-cc7e-423f-b5d5-3bea5a950852 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:50.534419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9daf0-cc7e-423f-b5d5-3bea5a950852 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:50.534419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9daf0-cc7e-423f-b5d5-3bea5a950852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:50.578881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7ad9daf0-cc7e-423f-b5d5-3bea5a950852 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:50.580394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ad9daf0-cc7e-423f-b5d5-3bea5a950852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:50.598436 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2233/4494] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:50.599870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2992f28-3110-45a7-b64a-ff79cb4faded None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:50.618047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2992f28-3110-45a7-b64a-ff79cb4faded None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:50.628318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e2fc3-aa13-4f03-b168-904e97eb8263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:50.629963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e2fc3-aa13-4f03-b168-904e97eb8263 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:50.630588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e2fc3-aa13-4f03-b168-904e97eb8263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:50.631508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e2fc3-aa13-4f03-b168-904e97eb8263 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:50.632872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e2fc3-aa13-4f03-b168-904e97eb8263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:50.633440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e2fc3-aa13-4f03-b168-904e97eb8263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:50.648588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e2fc3-aa13-4f03-b168-904e97eb8263 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:50.710265 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2262/4495] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:50.713620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9daf0-cc7e-423f-b5d5-3bea5a950852 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:50.744878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9daf0-cc7e-423f-b5d5-3bea5a950852 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:50.775136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf026535-dd57-4310-8407-ecc60e0657e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:50.777505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf026535-dd57-4310-8407-ecc60e0657e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:50.777852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf026535-dd57-4310-8407-ecc60e0657e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:50.778292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf026535-dd57-4310-8407-ecc60e0657e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:50.779064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf026535-dd57-4310-8407-ecc60e0657e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:50.781259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf026535-dd57-4310-8407-ecc60e0657e3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:50.850811 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2234/4496] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:50 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:50.852830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e2fc3-aa13-4f03-b168-904e97eb8263 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:50.887776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e2fc3-aa13-4f03-b168-904e97eb8263 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:50.924269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:50.959919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a6d94-b456-4c37-9d68-28430da98b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:50.960783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6d94-b456-4c37-9d68-28430da98b79 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:50.960897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6d94-b456-4c37-9d68-28430da98b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:50.961086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a6d94-b456-4c37-9d68-28430da98b79 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:50.961719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a6d94-b456-4c37-9d68-28430da98b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:50.964116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a6d94-b456-4c37-9d68-28430da98b79 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:50.999344 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2263/4497] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:50 2022] POST /identity/v3/users => generated 284 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:51.004133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf026535-dd57-4310-8407-ecc60e0657e3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.016036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf026535-dd57-4310-8407-ecc60e0657e3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:51.022060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65cd5d-87cd-4530-87b3-9e2bffa0c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:51.023670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65cd5d-87cd-4530-87b3-9e2bffa0c0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:51.023936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65cd5d-87cd-4530-87b3-9e2bffa0c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:51.024225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65cd5d-87cd-4530-87b3-9e2bffa0c0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:51.024879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65cd5d-87cd-4530-87b3-9e2bffa0c0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:51.026574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65cd5d-87cd-4530-87b3-9e2bffa0c0f4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:51.037646 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2235/4498] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:35:51.043063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a6d94-b456-4c37-9d68-28430da98b79 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.053807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a6d94-b456-4c37-9d68-28430da98b79 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:51.059166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de7e26-82f8-4608-856c-9d7c86b2ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:51.059789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de7e26-82f8-4608-856c-9d7c86b2ff87 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:51.060063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de7e26-82f8-4608-856c-9d7c86b2ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:51.060331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de7e26-82f8-4608-856c-9d7c86b2ff87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:51.060973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de7e26-82f8-4608-856c-9d7c86b2ff87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:51.062625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de7e26-82f8-4608-856c-9d7c86b2ff87 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:51.078062 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2264/4499] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:51.080646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65cd5d-87cd-4530-87b3-9e2bffa0c0f4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.103915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65cd5d-87cd-4530-87b3-9e2bffa0c0f4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:51.118624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157416e-7767-425d-b614-f7dada1db481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:51.119356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157416e-7767-425d-b614-f7dada1db481 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:51.119633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157416e-7767-425d-b614-f7dada1db481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:51.119904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157416e-7767-425d-b614-f7dada1db481 admin admin] PATH_INFO: `/v3/projects/f9a38275e1f946ec8ad0dbd9b4631f50/users/6052edc02ad94878a0cee2e9defdd6b3/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:51.148434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157416e-7767-425d-b614-f7dada1db481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a38275e1f946ec8ad0dbd9b4631f50, user_id=6052edc02ad94878a0cee2e9defdd6b3, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:51.151193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157416e-7767-425d-b614-f7dada1db481 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:51.175066 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2236/4500] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:51 2022] PUT /identity/v3/projects/f9a38275e1f946ec8ad0dbd9b4631f50/users/6052edc02ad94878a0cee2e9defdd6b3/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:51.196477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079546-e66f-4ca3-9247-55981c96b318 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:51.197025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079546-e66f-4ca3-9247-55981c96b318 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:51.197510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02079546-e66f-4ca3-9247-55981c96b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:51.243361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-02079546-e66f-4ca3-9247-55981c96b318 None None] MFA Rules not processed for user `6052edc02ad94878a0cee2e9defdd6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:51.244647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-02079546-e66f-4ca3-9247-55981c96b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:51.327026 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2265/4501] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:51.332102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157416e-7767-425d-b614-f7dada1db481 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.352245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:51.433845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157416e-7767-425d-b614-f7dada1db481 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:51.441486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7355da-de8c-40e3-ac7c-1729f1a22125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:51.443021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7355da-de8c-40e3-ac7c-1729f1a22125 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:51.443021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7355da-de8c-40e3-ac7c-1729f1a22125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:51.443021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7355da-de8c-40e3-ac7c-1729f1a22125 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:51.443765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7355da-de8c-40e3-ac7c-1729f1a22125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:51.446560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7355da-de8c-40e3-ac7c-1729f1a22125 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:51.490098 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2237/4502] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:51 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:51.494375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02079546-e66f-4ca3-9247-55981c96b318 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.508937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02079546-e66f-4ca3-9247-55981c96b318 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:51.593608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c3230-1218-4246-b366-63fcf672ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:51.594910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c3230-1218-4246-b366-63fcf672ea55 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:51.595750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c3230-1218-4246-b366-63fcf672ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:51.596013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c3230-1218-4246-b366-63fcf672ea55 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:51.596884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c3230-1218-4246-b366-63fcf672ea55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:51.599656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c3230-1218-4246-b366-63fcf672ea55 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:51.627118 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2266/4503] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:51 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:51.631705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7355da-de8c-40e3-ac7c-1729f1a22125 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.646429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7355da-de8c-40e3-ac7c-1729f1a22125 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:51.654533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b72dd-4218-4878-bad6-bd462ca7ce25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:51.654893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b72dd-4218-4878-bad6-bd462ca7ce25 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:51.655348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b72dd-4218-4878-bad6-bd462ca7ce25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:51.656201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b72dd-4218-4878-bad6-bd462ca7ce25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:51.660370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b72dd-4218-4878-bad6-bd462ca7ce25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:51.663865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b72dd-4218-4878-bad6-bd462ca7ce25 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:51.702858 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2238/4504] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:51.707760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c3230-1218-4246-b366-63fcf672ea55 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.726088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c3230-1218-4246-b366-63fcf672ea55 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:51.732539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af061d-8834-4861-9584-e8e3270c32fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:51.733233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af061d-8834-4861-9584-e8e3270c32fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:51.733508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af061d-8834-4861-9584-e8e3270c32fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:51.733818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af061d-8834-4861-9584-e8e3270c32fd admin admin] PATH_INFO: `/v3/projects/cdbc0a9e07714df7a11f92f7337fbb58/users/7553800067d4466e9f6e1736d91435da/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:51.760284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af061d-8834-4861-9584-e8e3270c32fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdbc0a9e07714df7a11f92f7337fbb58, user_id=7553800067d4466e9f6e1736d91435da, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:51.762603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af061d-8834-4861-9584-e8e3270c32fd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:51.786113 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2267/4505] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:51 2022] PUT /identity/v3/projects/cdbc0a9e07714df7a11f92f7337fbb58/users/7553800067d4466e9f6e1736d91435da/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:51.791414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b72dd-4218-4878-bad6-bd462ca7ce25 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.824974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b72dd-4218-4878-bad6-bd462ca7ce25 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:51.957279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c021d2-c4c8-41a5-b521-df490fe56ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:51.957995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c021d2-c4c8-41a5-b521-df490fe56ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:51.958271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c021d2-c4c8-41a5-b521-df490fe56ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:51.958537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c021d2-c4c8-41a5-b521-df490fe56ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:51.959171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c021d2-c4c8-41a5-b521-df490fe56ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:51.961647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c021d2-c4c8-41a5-b521-df490fe56ff3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:51.978189 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2239/4506] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:51.980177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af061d-8834-4861-9584-e8e3270c32fd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.990314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c021d2-c4c8-41a5-b521-df490fe56ff3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:51.993784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a9c021d2-c4c8-41a5-b521-df490fe56ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:52.001131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af061d-8834-4861-9584-e8e3270c32fd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:52.013021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508a633-f7e5-45cc-a708-6cedf5a7c800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:52.013713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a633-f7e5-45cc-a708-6cedf5a7c800 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:52.014025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a633-f7e5-45cc-a708-6cedf5a7c800 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:52.014305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a633-f7e5-45cc-a708-6cedf5a7c800 admin admin] PATH_INFO: `/v3/projects/cdbc0a9e07714df7a11f92f7337fbb58/users/7553800067d4466e9f6e1736d91435da/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:52.027501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508a633-f7e5-45cc-a708-6cedf5a7c800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdbc0a9e07714df7a11f92f7337fbb58, user_id=7553800067d4466e9f6e1736d91435da, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:52.029918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c021d2-c4c8-41a5-b521-df490fe56ff3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:52.030687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508a633-f7e5-45cc-a708-6cedf5a7c800 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:52.033213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:52.047198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:52.050396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:52.050909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:52.051332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] PATH_INFO: `/v3/projects/9f783a3231a0424389d59a7ee7cc854e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:52.062045 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2268/4507] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:51 2022] PUT /identity/v3/projects/cdbc0a9e07714df7a11f92f7337fbb58/users/7553800067d4466e9f6e1736d91435da/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:52.062262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f783a3231a0424389d59a7ee7cc854e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:52.062262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:52.069794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778140-fc38-40df-a31a-42db001744e8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:52.070111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778140-fc38-40df-a31a-42db001744e8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:52.070392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6778140-fc38-40df-a31a-42db001744e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:52.162392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e6778140-fc38-40df-a31a-42db001744e8 None None] MFA Rules not processed for user `7553800067d4466e9f6e1736d91435da`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:52.163590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e6778140-fc38-40df-a31a-42db001744e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:52.194088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f783a3231a0424389d59a7ee7cc854e', 'request_id': 'req-5f649a84-7e69-4f38-a285-53a0dc690b1e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:52.212162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f783a3231a0424389d59a7ee7cc854e', 'request_id': 'req-5f649a84-7e69-4f38-a285-53a0dc690b1e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:52.221607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f783a3231a0424389d59a7ee7cc854e', 'request_id': 'req-5f649a84-7e69-4f38-a285-53a0dc690b1e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:52.251988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] The token cache is being invalidate because project 9f783a3231a0424389d59a7ee7cc854e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:52.251988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:52.253550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:52.258161 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2240/4508] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:51 2022] DELETE /identity/v3/projects/9f783a3231a0424389d59a7ee7cc854e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:52.262511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:52.267952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:52.281907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:52.332648 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2269/4509] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:52.337624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6778140-fc38-40df-a31a-42db001744e8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:52.357051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6778140-fc38-40df-a31a-42db001744e8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:52.367113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184f7ce-c38a-42f0-9ef9-80351c250439 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:52.368043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184f7ce-c38a-42f0-9ef9-80351c250439 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:52.368541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184f7ce-c38a-42f0-9ef9-80351c250439 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:52.369003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184f7ce-c38a-42f0-9ef9-80351c250439 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:52.369817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184f7ce-c38a-42f0-9ef9-80351c250439 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:52.375414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5184f7ce-c38a-42f0-9ef9-80351c250439 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:52.400495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f649a84-7e69-4f38-a285-53a0dc690b1e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:52.407292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:52.407955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:52.408232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:52.408509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] PATH_INFO: `/v3/users/1607710da10b4baea4a933a33e6d544e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:52.410077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1607710da10b4baea4a933a33e6d544e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:52.412183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:52.458503 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2270/4510] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:52 2022] POST /identity/v3/projects => generated 359 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:52.473417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184f7ce-c38a-42f0-9ef9-80351c250439 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:52.474421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1607710da10b4baea4a933a33e6d544e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:52.490237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1607710da10b4baea4a933a33e6d544e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:52.512101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1607710da10b4baea4a933a33e6d544e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:52.528522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1607710da10b4baea4a933a33e6d544e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:52.531229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1607710da10b4baea4a933a33e6d544e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:52.544115 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2241/4511] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:52 2022] DELETE /identity/v3/users/1607710da10b4baea4a933a33e6d544e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:52.608763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5184f7ce-c38a-42f0-9ef9-80351c250439 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:52.794652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb938943-2ffe-4ca7-819f-7ad0e139e17b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:52.795848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938943-2ffe-4ca7-819f-7ad0e139e17b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:52.796307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938943-2ffe-4ca7-819f-7ad0e139e17b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:52.796705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938943-2ffe-4ca7-819f-7ad0e139e17b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:52.797546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb938943-2ffe-4ca7-819f-7ad0e139e17b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:52.800135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb938943-2ffe-4ca7-819f-7ad0e139e17b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:52.818751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:52.863122 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2271/4512] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:52 2022] POST /identity/v3/users => generated 371 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:52.868024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:52.877114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:52.912907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f1288-a9d3-431c-9740-053a3ba131d4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:52.923875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84615e22-8994-41e7-9172-11c6f9afc766 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:52.925044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84615e22-8994-41e7-9172-11c6f9afc766 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:52.925631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84615e22-8994-41e7-9172-11c6f9afc766 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:52.926467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84615e22-8994-41e7-9172-11c6f9afc766 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/6221f5ac618e45ebbb8584e9caf37862` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:52.959053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84615e22-8994-41e7-9172-11c6f9afc766 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:get_user(user_id=6221f5ac618e45ebbb8584e9caf37862)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:52.970001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84615e22-8994-41e7-9172-11c6f9afc766 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:52.978644 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2242/4513] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:35:52 2022] GET /identity/v3/users/6221f5ac618e45ebbb8584e9caf37862 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:52.985597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb938943-2ffe-4ca7-819f-7ad0e139e17b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:53.013617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb938943-2ffe-4ca7-819f-7ad0e139e17b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:53.050732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:53.054057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:53.055881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:53.059074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/6221f5ac618e45ebbb8584e9caf37862` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:53.065639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6221f5ac618e45ebbb8584e9caf37862)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:53.071623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:53.174140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6221f5ac618e45ebbb8584e9caf37862'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.176385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6221f5ac618e45ebbb8584e9caf37862'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.189801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6221f5ac618e45ebbb8584e9caf37862'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.203880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6221f5ac618e45ebbb8584e9caf37862'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.240296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6221f5ac618e45ebbb8584e9caf37862'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.257685 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2272/4514] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:52 2022] DELETE /identity/v3/users/6221f5ac618e45ebbb8584e9caf37862 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:53.262289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84615e22-8994-41e7-9172-11c6f9afc766 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:53.264473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-84615e22-8994-41e7-9172-11c6f9afc766 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:53.288513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84615e22-8994-41e7-9172-11c6f9afc766 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:53.403310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:53.404718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:53.405392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:53.406116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects/fd051c77c5f44606b904680505e4f68d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:53.411227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd051c77c5f44606b904680505e4f68d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:53.416089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:53.440682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:53.571534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd051c77c5f44606b904680505e4f68d', 'request_id': 'req-48403fbe-f210-44fd-ac0e-3e0293ca31b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.587922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd051c77c5f44606b904680505e4f68d', 'request_id': 'req-48403fbe-f210-44fd-ac0e-3e0293ca31b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.600537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd051c77c5f44606b904680505e4f68d', 'request_id': 'req-48403fbe-f210-44fd-ac0e-3e0293ca31b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.621055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] The token cache is being invalidate because project fd051c77c5f44606b904680505e4f68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:53.621909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.623176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.629450 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2243/4515] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:53 2022] DELETE /identity/v3/projects/fd051c77c5f44606b904680505e4f68d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:53.633962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:53.647866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c839973-9788-4e40-8401-981f1ae610bc tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:53.772752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:53.774434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:53.787910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8a0a9-25c9-4f4b-9d50-b752c89f6e04 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:53.791002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8a0a9-25c9-4f4b-9d50-b752c89f6e04 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:53.792562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8a0a9-25c9-4f4b-9d50-b752c89f6e04 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:53.793066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8a0a9-25c9-4f4b-9d50-b752c89f6e04 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:53.797098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8a0a9-25c9-4f4b-9d50-b752c89f6e04 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:53.807983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8a0a9-25c9-4f4b-9d50-b752c89f6e04 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:53.871911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48403fbe-f210-44fd-ac0e-3e0293ca31b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:53.885806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:53.886589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:53.887100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:53.887455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] PATH_INFO: `/v3/projects/3ebb98ec28614da4b7f11e2043e90e36` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:53.888987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebb98ec28614da4b7f11e2043e90e36)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:53.891206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:53.937979 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2273/4516] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:53 2022] POST /identity/v3/projects => generated 359 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:53.943912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8a0a9-25c9-4f4b-9d50-b752c89f6e04 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:53.946574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1be8a0a9-25c9-4f4b-9d50-b752c89f6e04 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:53.981609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebb98ec28614da4b7f11e2043e90e36', 'request_id': 'req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:53.994698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebb98ec28614da4b7f11e2043e90e36', 'request_id': 'req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:54.008990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebb98ec28614da4b7f11e2043e90e36', 'request_id': 'req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:54.025822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] The token cache is being invalidate because project 3ebb98ec28614da4b7f11e2043e90e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:54.026687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:54.027771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e0faa3e7-9fd3-4e14-a6db-721fa10504b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:54.029967 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2244/4517] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:53 2022] DELETE /identity/v3/projects/3ebb98ec28614da4b7f11e2043e90e36 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:35:54.036644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5457329-b056-4292-9cd6-5618f811a8cc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.037359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5457329-b056-4292-9cd6-5618f811a8cc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.037906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5457329-b056-4292-9cd6-5618f811a8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.071036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b5457329-b056-4292-9cd6-5618f811a8cc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:54.072765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b5457329-b056-4292-9cd6-5618f811a8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:54.098705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:54.132017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8a0a9-25c9-4f4b-9d50-b752c89f6e04 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:54.183286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:54.271249 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2245/4518] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:35:54.273333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d59014-3615-4cb2-89f0-9c53d628c4fb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.273627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d59014-3615-4cb2-89f0-9c53d628c4fb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.273946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d59014-3615-4cb2-89f0-9c53d628c4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.285971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd8b6d-222b-45f2-b80c-72330412ba44 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:54.286617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd8b6d-222b-45f2-b80c-72330412ba44 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.286899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd8b6d-222b-45f2-b80c-72330412ba44 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.287174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd8b6d-222b-45f2-b80c-72330412ba44 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.287857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd8b6d-222b-45f2-b80c-72330412ba44 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:54.292350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd8b6d-222b-45f2-b80c-72330412ba44 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:54.298962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d9d59014-3615-4cb2-89f0-9c53d628c4fb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:54.300270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d9d59014-3615-4cb2-89f0-9c53d628c4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:54.314254 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2246/4519] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:54.317166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d59014-3615-4cb2-89f0-9c53d628c4fb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:54.336271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d59014-3615-4cb2-89f0-9c53d628c4fb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:54.351154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06675b2-11eb-43e8-bd81-a72df050c691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:54.351800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06675b2-11eb-43e8-bd81-a72df050c691 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.352196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06675b2-11eb-43e8-bd81-a72df050c691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.352368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06675b2-11eb-43e8-bd81-a72df050c691 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.353006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06675b2-11eb-43e8-bd81-a72df050c691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:35:54.353307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06675b2-11eb-43e8-bd81-a72df050c691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:54.355180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06675b2-11eb-43e8-bd81-a72df050c691 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:54.382059 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2274/4520] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:53 2022] POST /identity/v3/users => generated 414 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:54.389961 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2247/4521] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:54.390282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd8b6d-222b-45f2-b80c-72330412ba44 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:54.391156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06675b2-11eb-43e8-bd81-a72df050c691 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:54.391943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-18bd8b6d-222b-45f2-b80c-72330412ba44 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:54.410697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06675b2-11eb-43e8-bd81-a72df050c691 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:54.421079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4740e-2815-46b4-b8db-24c5dda44386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:54.421798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4740e-2815-46b4-b8db-24c5dda44386 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.422107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4740e-2815-46b4-b8db-24c5dda44386 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.422380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4740e-2815-46b4-b8db-24c5dda44386 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.423033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4740e-2815-46b4-b8db-24c5dda44386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:54.425017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4740e-2815-46b4-b8db-24c5dda44386 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:54.446798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd8b6d-222b-45f2-b80c-72330412ba44 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:54.479146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abfbc8-4e52-48f4-8c37-939fdfbf9b5f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:54.480366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abfbc8-4e52-48f4-8c37-939fdfbf9b5f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.480951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abfbc8-4e52-48f4-8c37-939fdfbf9b5f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.481453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abfbc8-4e52-48f4-8c37-939fdfbf9b5f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.482941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abfbc8-4e52-48f4-8c37-939fdfbf9b5f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:54.486958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abfbc8-4e52-48f4-8c37-939fdfbf9b5f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:54.504881 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2248/4522] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:54 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:54.513571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4740e-2815-46b4-b8db-24c5dda44386 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:54.620700 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2275/4523] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:35:54 2022] POST /identity/v3/roles => generated 240 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:54.642866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abfbc8-4e52-48f4-8c37-939fdfbf9b5f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:54.713092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4740e-2815-46b4-b8db-24c5dda44386 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:54.724397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4471f1-8139-428e-8c3c-685f66d71d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:54.724915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abfbc8-4e52-48f4-8c37-939fdfbf9b5f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:54.725136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4471f1-8139-428e-8c3c-685f66d71d0c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.725408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4471f1-8139-428e-8c3c-685f66d71d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.725686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4471f1-8139-428e-8c3c-685f66d71d0c admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.726383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4471f1-8139-428e-8c3c-685f66d71d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:54.729012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4471f1-8139-428e-8c3c-685f66d71d0c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:54.776016 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2249/4524] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:35:54 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:54.777067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4471f1-8139-428e-8c3c-685f66d71d0c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:54.803664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4471f1-8139-428e-8c3c-685f66d71d0c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:54.812262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a11c0f-7e2f-49e2-8b32-bbe63704021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:54.814131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11c0f-7e2f-49e2-8b32-bbe63704021f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.814281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11c0f-7e2f-49e2-8b32-bbe63704021f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.814511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11c0f-7e2f-49e2-8b32-bbe63704021f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.815568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a11c0f-7e2f-49e2-8b32-bbe63704021f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:54.817734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a11c0f-7e2f-49e2-8b32-bbe63704021f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:54.835566 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2250/4525] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:54 2022] GET /identity/v3/roles => generated 1651 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:54.836747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a11c0f-7e2f-49e2-8b32-bbe63704021f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:54.848311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a11c0f-7e2f-49e2-8b32-bbe63704021f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:54.870915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4616c-0433-4080-8deb-f6fa5564c0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:54.871554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4616c-0433-4080-8deb-f6fa5564c0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.871834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4616c-0433-4080-8deb-f6fa5564c0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.872138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4616c-0433-4080-8deb-f6fa5564c0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.873053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4616c-0433-4080-8deb-f6fa5564c0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:54.874685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4616c-0433-4080-8deb-f6fa5564c0c7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:54.899079 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2251/4526] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:35:54 2022] GET /identity/v3/roles => generated 1651 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:35:54.900168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4616c-0433-4080-8deb-f6fa5564c0c7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:54.907400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97aa25-2c0c-407c-83e6-5d0a82d7bbe0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:54.908461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97aa25-2c0c-407c-83e6-5d0a82d7bbe0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.908947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97aa25-2c0c-407c-83e6-5d0a82d7bbe0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.909473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97aa25-2c0c-407c-83e6-5d0a82d7bbe0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/ec0ba3db85484bceb3f028eb6002d63f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.929165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4616c-0433-4080-8deb-f6fa5564c0c7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:54.940699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97aa25-2c0c-407c-83e6-5d0a82d7bbe0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:get_user(user_id=ec0ba3db85484bceb3f028eb6002d63f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:54.946156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97aa25-2c0c-407c-83e6-5d0a82d7bbe0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:54.949792 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2276/4527] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:35:54 2022] GET /identity/v3/users/ec0ba3db85484bceb3f028eb6002d63f => generated 414 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:54.955066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97aa25-2c0c-407c-83e6-5d0a82d7bbe0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:54.959422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8597f-2a70-4e87-bcfe-944b47a630c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:54.960946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8597f-2a70-4e87-bcfe-944b47a630c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.961523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8597f-2a70-4e87-bcfe-944b47a630c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.962156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8597f-2a70-4e87-bcfe-944b47a630c4 admin admin] PATH_INFO: `/v3/projects/5f85c627636c421c88707c0501a53f08/users/04382a029fb94a989366d9eab1b3b0bc/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.971123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97aa25-2c0c-407c-83e6-5d0a82d7bbe0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:54.980770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630c8ec-9f77-4a4b-b03b-ca87b76d1c83 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:54.981949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c8ec-9f77-4a4b-b03b-ca87b76d1c83 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:54.982395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c8ec-9f77-4a4b-b03b-ca87b76d1c83 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:54.983035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630c8ec-9f77-4a4b-b03b-ca87b76d1c83 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/roles/e452cbd38aea4e959a264904f7205ef2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:54.985081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630c8ec-9f77-4a4b-b03b-ca87b76d1c83 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:get_role(role_id=e452cbd38aea4e959a264904f7205ef2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:54.986316 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-5630c8ec-9f77-4a4b-b03b-ca87b76d1c83 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:54.986316 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:54.986316 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:54.987625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630c8ec-9f77-4a4b-b03b-ca87b76d1c83 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:54.990290 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2277/4528] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:35:54 2022] GET /identity/v3/roles/e452cbd38aea4e959a264904f7205ef2 => generated 240 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:54.996683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630c8ec-9f77-4a4b-b03b-ca87b76d1c83 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:55.020453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630c8ec-9f77-4a4b-b03b-ca87b76d1c83 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:55.028657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba9271-1f8e-4dca-a341-de06a3b85054 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:55.029779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba9271-1f8e-4dca-a341-de06a3b85054 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:55.030370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba9271-1f8e-4dca-a341-de06a3b85054 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:55.030907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba9271-1f8e-4dca-a341-de06a3b85054 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:55.032471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba9271-1f8e-4dca-a341-de06a3b85054 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:55.034158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8597f-2a70-4e87-bcfe-944b47a630c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f85c627636c421c88707c0501a53f08, user_id=04382a029fb94a989366d9eab1b3b0bc, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:55.036570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba9271-1f8e-4dca-a341-de06a3b85054 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:55.046589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8597f-2a70-4e87-bcfe-944b47a630c4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:55.101761 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2252/4529] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:54 2022] PUT /identity/v3/projects/5f85c627636c421c88707c0501a53f08/users/04382a029fb94a989366d9eab1b3b0bc/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:55.110944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f3d6-02fa-4775-aa65-8ab048ba9003 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:55.111836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f3d6-02fa-4775-aa65-8ab048ba9003 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:55.112238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff0f3d6-02fa-4775-aa65-8ab048ba9003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:55.148997 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2278/4530] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:54 2022] POST /identity/v3/projects => generated 360 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:35:55.162280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba9271-1f8e-4dca-a341-de06a3b85054 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:55.188707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5ff0f3d6-02fa-4775-aa65-8ab048ba9003 None None] MFA Rules not processed for user `04382a029fb94a989366d9eab1b3b0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:55.192665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5ff0f3d6-02fa-4775-aa65-8ab048ba9003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:55.250483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:55.317114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:55.371152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba9271-1f8e-4dca-a341-de06a3b85054 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:55.378078 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2253/4531] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:35:55.382968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91fda4-875b-48b7-8e40-1f2b00de0bd7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:55.384031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91fda4-875b-48b7-8e40-1f2b00de0bd7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:55.384494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91fda4-875b-48b7-8e40-1f2b00de0bd7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:55.384981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91fda4-875b-48b7-8e40-1f2b00de0bd7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects/5ab52ede0614411dae7fb9ede64e889b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:55.387614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91fda4-875b-48b7-8e40-1f2b00de0bd7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:get_project(project_id=5ab52ede0614411dae7fb9ede64e889b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:55.390437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91fda4-875b-48b7-8e40-1f2b00de0bd7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:55.402476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0f3d6-02fa-4775-aa65-8ab048ba9003 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:55.414335 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2279/4532] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:35:55 2022] GET /identity/v3/projects/5ab52ede0614411dae7fb9ede64e889b => generated 360 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:55.420801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff0f3d6-02fa-4775-aa65-8ab048ba9003 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:55.445508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91fda4-875b-48b7-8e40-1f2b00de0bd7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:55.449048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3d91fda4-875b-48b7-8e40-1f2b00de0bd7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:55.462245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf934b-83b5-46e6-8341-e0f390f8ca2f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:55.470848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf934b-83b5-46e6-8341-e0f390f8ca2f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:55.470848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf934b-83b5-46e6-8341-e0f390f8ca2f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:55.470848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf934b-83b5-46e6-8341-e0f390f8ca2f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects/5ab52ede0614411dae7fb9ede64e889b/users/ec0ba3db85484bceb3f028eb6002d63f/roles/e452cbd38aea4e959a264904f7205ef2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:55.480749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf934b-83b5-46e6-8341-e0f390f8ca2f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5ab52ede0614411dae7fb9ede64e889b, user_id=ec0ba3db85484bceb3f028eb6002d63f, role_id=e452cbd38aea4e959a264904f7205ef2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:55.488669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf934b-83b5-46e6-8341-e0f390f8ca2f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:55.531110 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2254/4533] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:55 2022] PUT /identity/v3/projects/5ab52ede0614411dae7fb9ede64e889b/users/ec0ba3db85484bceb3f028eb6002d63f/roles/e452cbd38aea4e959a264904f7205ef2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:55.537129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf934b-83b5-46e6-8341-e0f390f8ca2f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:55.597060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91fda4-875b-48b7-8e40-1f2b00de0bd7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:55.713733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf934b-83b5-46e6-8341-e0f390f8ca2f tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:55.719543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccc95b-0c7c-4f6e-9785-255c35cbcec2 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:55.720357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc95b-0c7c-4f6e-9785-255c35cbcec2 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:55.720738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc95b-0c7c-4f6e-9785-255c35cbcec2 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:55.721109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc95b-0c7c-4f6e-9785-255c35cbcec2 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:55.721867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccc95b-0c7c-4f6e-9785-255c35cbcec2 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:55.724112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccc95b-0c7c-4f6e-9785-255c35cbcec2 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:55.726758 n-d-820368-36 devstack@keystone.service[82099]: WARNING keystone.server.flask.common [None req-50ccc95b-0c7c-4f6e-9785-255c35cbcec2 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 04:35:55.770077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e635a0-06a4-47bf-ad36-4208ae7ca4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:55.770725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e635a0-06a4-47bf-ad36-4208ae7ca4ad service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:55.771007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e635a0-06a4-47bf-ad36-4208ae7ca4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:55.773204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e635a0-06a4-47bf-ad36-4208ae7ca4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:55.827120 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2255/4534] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:35:55 2022] POST /identity/v3/projects => generated 359 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:55.829757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccc95b-0c7c-4f6e-9785-255c35cbcec2 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:55.975612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e635a0-06a4-47bf-ad36-4208ae7ca4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:55.977468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e635a0-06a4-47bf-ad36-4208ae7ca4ad service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:56.002045 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2280/4535] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:35:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:35:56.016811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccc95b-0c7c-4f6e-9785-255c35cbcec2 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:56.022842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123de31-d820-46ce-a1fb-8b1dc4b41110 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:56.023834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123de31-d820-46ce-a1fb-8b1dc4b41110 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:56.024280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123de31-d820-46ce-a1fb-8b1dc4b41110 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:56.024728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123de31-d820-46ce-a1fb-8b1dc4b41110 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects/e8bc6d682ca94f0a988a2a027c98cb93` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:56.026596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123de31-d820-46ce-a1fb-8b1dc4b41110 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:get_project(project_id=e8bc6d682ca94f0a988a2a027c98cb93)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:56.030366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123de31-d820-46ce-a1fb-8b1dc4b41110 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:56.033050 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2256/4536] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:35:55 2022] GET /identity/v3/projects/e8bc6d682ca94f0a988a2a027c98cb93 => generated 359 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:56.038355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e635a0-06a4-47bf-ad36-4208ae7ca4ad service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:56.051852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e635a0-06a4-47bf-ad36-4208ae7ca4ad service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:56.057627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4229cfe-02fc-43fe-89c7-636534c49404 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:56.058460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4229cfe-02fc-43fe-89c7-636534c49404 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:56.058746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4229cfe-02fc-43fe-89c7-636534c49404 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:56.059642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4229cfe-02fc-43fe-89c7-636534c49404 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects/e8bc6d682ca94f0a988a2a027c98cb93/users/ec0ba3db85484bceb3f028eb6002d63f/roles/e452cbd38aea4e959a264904f7205ef2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:56.061859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4229cfe-02fc-43fe-89c7-636534c49404 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e8bc6d682ca94f0a988a2a027c98cb93, user_id=ec0ba3db85484bceb3f028eb6002d63f, role_id=e452cbd38aea4e959a264904f7205ef2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:56.065296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4229cfe-02fc-43fe-89c7-636534c49404 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:56.120546 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2281/4537] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:35:56 2022] PUT /identity/v3/projects/e8bc6d682ca94f0a988a2a027c98cb93/users/ec0ba3db85484bceb3f028eb6002d63f/roles/e452cbd38aea4e959a264904f7205ef2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:56.126730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123de31-d820-46ce-a1fb-8b1dc4b41110 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:56.147932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123de31-d820-46ce-a1fb-8b1dc4b41110 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:56.259513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:56.348427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a11333-39dc-418e-829e-f8db916bafde tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:56.353319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a11333-39dc-418e-829e-f8db916bafde tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:56.353319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a11333-39dc-418e-829e-f8db916bafde tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:56.353319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a11333-39dc-418e-829e-f8db916bafde tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/ec0ba3db85484bceb3f028eb6002d63f/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:56.353319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a11333-39dc-418e-829e-f8db916bafde tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=ec0ba3db85484bceb3f028eb6002d63f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:56.355683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a11333-39dc-418e-829e-f8db916bafde tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:56.521522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4229cfe-02fc-43fe-89c7-636534c49404 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:56.521969 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2257/4538] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:56 2022] GET /identity/v3/users/ec0ba3db85484bceb3f028eb6002d63f/projects => generated 843 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:56.553893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4229cfe-02fc-43fe-89c7-636534c49404 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:56.584942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:56.586091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:56.586587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:56.587081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects/e8bc6d682ca94f0a988a2a027c98cb93` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:56.590255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e8bc6d682ca94f0a988a2a027c98cb93)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:56.599076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:56.826900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:56.858175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bc6d682ca94f0a988a2a027c98cb93', 'request_id': 'req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:56.929582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bc6d682ca94f0a988a2a027c98cb93', 'request_id': 'req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:56.962012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bc6d682ca94f0a988a2a027c98cb93', 'request_id': 'req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.012603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] The token cache is being invalidate because project e8bc6d682ca94f0a988a2a027c98cb93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:57.013127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.014848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.028128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a11333-39dc-418e-829e-f8db916bafde tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:57.031131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c2a11333-39dc-418e-829e-f8db916bafde tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:57.036611 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2282/4539] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:56 2022] DELETE /identity/v3/projects/e8bc6d682ca94f0a988a2a027c98cb93 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:57.074994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a11333-39dc-418e-829e-f8db916bafde tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:57.187846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:57.188603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:57.188989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:57.204275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects/5ab52ede0614411dae7fb9ede64e889b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:57.204275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5ab52ede0614411dae7fb9ede64e889b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:57.204275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:57.301109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab52ede0614411dae7fb9ede64e889b', 'request_id': 'req-849af358-2ac4-4e0f-af01-ef08cd3adff7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.323892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab52ede0614411dae7fb9ede64e889b', 'request_id': 'req-849af358-2ac4-4e0f-af01-ef08cd3adff7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.334698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab52ede0614411dae7fb9ede64e889b', 'request_id': 'req-849af358-2ac4-4e0f-af01-ef08cd3adff7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.365120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] The token cache is being invalidate because project 5ab52ede0614411dae7fb9ede64e889b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:57.365596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.367178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.370595 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2258/4540] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:57 2022] DELETE /identity/v3/projects/5ab52ede0614411dae7fb9ede64e889b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:57.378141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:57.411470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7094-4b0a-4d84-b65f-9c2ea3bc53e4 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:57.503386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:57.505078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:57.505890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:57.506348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/roles/e452cbd38aea4e959a264904f7205ef2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:57.508130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e452cbd38aea4e959a264904f7205ef2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:57.510266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:57.603586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invalidating the token cache because role e452cbd38aea4e959a264904f7205ef2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:57.604536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.606042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.609772 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2283/4541] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:57 2022] DELETE /identity/v3/roles/e452cbd38aea4e959a264904f7205ef2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:57.614501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:57.616614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:57.633242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849af358-2ac4-4e0f-af01-ef08cd3adff7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:57.724894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:57.791087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:57.792340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:57.792905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:57.793534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/ec0ba3db85484bceb3f028eb6002d63f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:57.799751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ec0ba3db85484bceb3f028eb6002d63f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:57.808084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:57.905010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0ba3db85484bceb3f028eb6002d63f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.914719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0ba3db85484bceb3f028eb6002d63f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.937397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0ba3db85484bceb3f028eb6002d63f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.951056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0ba3db85484bceb3f028eb6002d63f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.951677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0ba3db85484bceb3f028eb6002d63f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:57.960612 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2259/4542] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:35:57 2022] DELETE /identity/v3/users/ec0ba3db85484bceb3f028eb6002d63f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:57.965317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:57.967935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:57.982427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f7e15-d891-40ba-97ee-73a2e93ba256 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.079054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.079893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.080272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.080645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects/a731d0b5834c413697cc32f3161d5c7e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.082209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a731d0b5834c413697cc32f3161d5c7e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.084517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.148017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:58.177484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a731d0b5834c413697cc32f3161d5c7e', 'request_id': 'req-ac43b4b0-1f6c-4ba9-883b-46e668531e71'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.192404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a731d0b5834c413697cc32f3161d5c7e', 'request_id': 'req-ac43b4b0-1f6c-4ba9-883b-46e668531e71'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.202650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a731d0b5834c413697cc32f3161d5c7e', 'request_id': 'req-ac43b4b0-1f6c-4ba9-883b-46e668531e71'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.229124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] The token cache is being invalidate because project a731d0b5834c413697cc32f3161d5c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:58.229703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.230746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac43b4b0-1f6c-4ba9-883b-46e668531e71 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.238128 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2284/4543] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:35:57 2022] DELETE /identity/v3/projects/a731d0b5834c413697cc32f3161d5c7e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:35:58.240155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.241781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:58.267910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b6bc7-aecb-45dd-ab0c-1942b49c326e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.374832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.375681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.376093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.376425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/6052edc02ad94878a0cee2e9defdd6b3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.377907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:update_user(user_id=6052edc02ad94878a0cee2e9defdd6b3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.379687 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:58.379687 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:35:58.379687 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:35:58.382912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.491793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6052edc02ad94878a0cee2e9defdd6b3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.512540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invalidating the token cache because user 6052edc02ad94878a0cee2e9defdd6b3 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:58.512948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.514284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.516264 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2260/4544] 10.222.0.43 () {60 vars in 1243 bytes} [Tue Aug 30 04:35:58 2022] PATCH /identity/v3/users/6052edc02ad94878a0cee2e9defdd6b3 => generated 297 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:58.522509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417326e-4560-4414-91a5-5af8f1365702 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.523177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417326e-4560-4414-91a5-5af8f1365702 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.523768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417326e-4560-4414-91a5-5af8f1365702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.579448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3417326e-4560-4414-91a5-5af8f1365702 None None] MFA Rules not processed for user `6052edc02ad94878a0cee2e9defdd6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:58.580711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3417326e-4560-4414-91a5-5af8f1365702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:58.591192 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2285/4545] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:58 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:58.594566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.596500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:58.621336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4ae48-fa9e-4093-8683-1a40a50a83b0 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.633042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80c1e8-a19f-4c5f-9288-0bd57dd3f3cf tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.633713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80c1e8-a19f-4c5f-9288-0bd57dd3f3cf tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.634040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80c1e8-a19f-4c5f-9288-0bd57dd3f3cf tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.634320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80c1e8-a19f-4c5f-9288-0bd57dd3f3cf tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/6052edc02ad94878a0cee2e9defdd6b3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.639513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80c1e8-a19f-4c5f-9288-0bd57dd3f3cf tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:update_user(user_id=6052edc02ad94878a0cee2e9defdd6b3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.642796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80c1e8-a19f-4c5f-9288-0bd57dd3f3cf tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.711643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d80c1e8-a19f-4c5f-9288-0bd57dd3f3cf tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6052edc02ad94878a0cee2e9defdd6b3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.722748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=12,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:58.729391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d80c1e8-a19f-4c5f-9288-0bd57dd3f3cf tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invalidating the token cache because user 6052edc02ad94878a0cee2e9defdd6b3 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:58.729723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d80c1e8-a19f-4c5f-9288-0bd57dd3f3cf tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.731130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d80c1e8-a19f-4c5f-9288-0bd57dd3f3cf tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.732952 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2261/4546] 10.222.0.43 () {60 vars in 1243 bytes} [Tue Aug 30 04:35:58 2022] PATCH /identity/v3/users/6052edc02ad94878a0cee2e9defdd6b3 => generated 297 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:58.736809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417326e-4560-4414-91a5-5af8f1365702 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:58.759795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417326e-4560-4414-91a5-5af8f1365702 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:58.772506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:58.774336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.774336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.774336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/6052edc02ad94878a0cee2e9defdd6b3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.797364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:update_user(user_id=6052edc02ad94878a0cee2e9defdd6b3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:58.799032 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:35:58.799032 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:35:58.799032 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:35:58.800485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:58.883356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6052edc02ad94878a0cee2e9defdd6b3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.899654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invalidating the token cache because user 6052edc02ad94878a0cee2e9defdd6b3 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:58.901239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.903351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:58.913796 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2286/4547] 10.222.0.43 () {60 vars in 1243 bytes} [Tue Aug 30 04:35:58 2022] PATCH /identity/v3/users/6052edc02ad94878a0cee2e9defdd6b3 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:58.916473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7ecf7-51fb-4a2c-9a6f-04775c620721 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:58.916643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7ecf7-51fb-4a2c-9a6f-04775c620721 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:58.916789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7ecf7-51fb-4a2c-9a6f-04775c620721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:58.984695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-75f7ecf7-51fb-4a2c-9a6f-04775c620721 None None] MFA Rules not processed for user `6052edc02ad94878a0cee2e9defdd6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:35:58.985789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-75f7ecf7-51fb-4a2c-9a6f-04775c620721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:59.007591 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2262/4548] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:35:58 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:59.007918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:59.009841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:59.044585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7600bc-3ddc-4c57-883b-61faace5f157 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:59.064081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:59.065229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:59.067492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:59.067492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/6052edc02ad94878a0cee2e9defdd6b3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:59.075293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:update_user(user_id=6052edc02ad94878a0cee2e9defdd6b3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:59.081086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:59.167304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6052edc02ad94878a0cee2e9defdd6b3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:59.179532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invalidating the token cache because user 6052edc02ad94878a0cee2e9defdd6b3 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:35:59.180296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:59.181212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:59.190898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7ecf7-51fb-4a2c-9a6f-04775c620721 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:59.201139 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2287/4549] 10.222.0.43 () {60 vars in 1243 bytes} [Tue Aug 30 04:35:59 2022] PATCH /identity/v3/users/6052edc02ad94878a0cee2e9defdd6b3 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:35:59.210642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7ecf7-51fb-4a2c-9a6f-04775c620721 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:59.232003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123fb98d-59d7-408b-aaaf-d9e47ec0a05e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:59.233137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fb98d-59d7-408b-aaaf-d9e47ec0a05e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:59.233566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fb98d-59d7-408b-aaaf-d9e47ec0a05e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:59.234064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123fb98d-59d7-408b-aaaf-d9e47ec0a05e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:59.234546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fb98d-59d7-408b-aaaf-d9e47ec0a05e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:35:59.236493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123fb98d-59d7-408b-aaaf-d9e47ec0a05e tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:35:59.304963 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2263/4550] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:35:59 2022] POST /identity/v3/users => generated 265 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:35:59.309019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:35:59.310949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:35:59.344278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7eee9-b5cb-4301-a22b-a90b6af3e41b tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:35:59.355993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2554ca-ca1c-4425-8734-7e7dec29969a tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:35:59.356917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2554ca-ca1c-4425-8734-7e7dec29969a tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:35:59.357349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2554ca-ca1c-4425-8734-7e7dec29969a tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:35:59.358087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2554ca-ca1c-4425-8734-7e7dec29969a tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/27d5dff58603402c94457da652b41aac/password` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:35:59.540901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2a2554ca-ca1c-4425-8734-7e7dec29969a tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '27d5dff58603402c94457da652b41aac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:35:59.562645 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2288/4551] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:35:59 2022] POST /identity/v3/users/27d5dff58603402c94457da652b41aac/password => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:00.569458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5512481-7947-4273-8d2f-a8b261c6ca1e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:00.570420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5512481-7947-4273-8d2f-a8b261c6ca1e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:00.570420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5512481-7947-4273-8d2f-a8b261c6ca1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:00.613225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b5512481-7947-4273-8d2f-a8b261c6ca1e None None] MFA Rules not processed for user `27d5dff58603402c94457da652b41aac`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:00.615255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b5512481-7947-4273-8d2f-a8b261c6ca1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:00.620995 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2264/4552] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:00 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 04:36:00.629710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2554ca-ca1c-4425-8734-7e7dec29969a tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:00.644404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2554ca-ca1c-4425-8734-7e7dec29969a tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:00.657180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204109e-3ae2-4190-8d9b-590cf6dc6a9d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:00.657832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204109e-3ae2-4190-8d9b-590cf6dc6a9d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:00.658162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204109e-3ae2-4190-8d9b-590cf6dc6a9d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:00.658605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204109e-3ae2-4190-8d9b-590cf6dc6a9d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:00.683002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204109e-3ae2-4190-8d9b-590cf6dc6a9d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:00.686821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204109e-3ae2-4190-8d9b-590cf6dc6a9d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:00.698751 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2289/4553] 10.222.0.43 () {56 vars in 1263 bytes} [Tue Aug 30 04:36:00 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:00.703009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5512481-7947-4273-8d2f-a8b261c6ca1e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:00.726558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5512481-7947-4273-8d2f-a8b261c6ca1e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:00.740571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:00.741583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:00.742088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:00.742520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/27d5dff58603402c94457da652b41aac` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:00.743952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:delete_user(user_id=27d5dff58603402c94457da652b41aac)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:00.746403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:00.862579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d5dff58603402c94457da652b41aac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:00.879922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d5dff58603402c94457da652b41aac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:00.899805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d5dff58603402c94457da652b41aac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:00.914502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d5dff58603402c94457da652b41aac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:00.917084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d5dff58603402c94457da652b41aac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:00.934237 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2265/4554] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:00 2022] DELETE /identity/v3/users/27d5dff58603402c94457da652b41aac => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:00.935769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204109e-3ae2-4190-8d9b-590cf6dc6a9d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:00.951016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204109e-3ae2-4190-8d9b-590cf6dc6a9d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:01.006446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=7,keystone:UPDATE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:01.110874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bf06d-184a-48ae-8e73-4c043b0992ea tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:01.111901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf06d-184a-48ae-8e73-4c043b0992ea tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:01.112424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf06d-184a-48ae-8e73-4c043b0992ea tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:01.113062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf06d-184a-48ae-8e73-4c043b0992ea tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:01.114840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bf06d-184a-48ae-8e73-4c043b0992ea tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:01.118965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bf06d-184a-48ae-8e73-4c043b0992ea tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:01.192747 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2290/4555] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:00 2022] POST /identity/v3/users => generated 364 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:01.199141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:01.201239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:01.242287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89aef9-5c2f-4d96-837a-4355c7ea7756 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:01.250519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3fd10-8973-460f-a87f-d935f9366612 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:01.260381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3fd10-8973-460f-a87f-d935f9366612 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:01.260682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3fd10-8973-460f-a87f-d935f9366612 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:01.260968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3fd10-8973-460f-a87f-d935f9366612 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:01.261659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3fd10-8973-460f-a87f-d935f9366612 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:01.263666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3fd10-8973-460f-a87f-d935f9366612 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:01.335274 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2266/4556] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:01 2022] POST /identity/v3/projects => generated 359 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:01.340808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bf06d-184a-48ae-8e73-4c043b0992ea tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:01.358974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bf06d-184a-48ae-8e73-4c043b0992ea tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:01.465550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd064d-bf15-42e5-a652-ab057b719a37 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:01.466435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd064d-bf15-42e5-a652-ab057b719a37 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:01.466817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd064d-bf15-42e5-a652-ab057b719a37 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:01.467196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd064d-bf15-42e5-a652-ab057b719a37 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/b8fe71e8c1914e9f88a45c13b4759f2a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:01.507569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd064d-bf15-42e5-a652-ab057b719a37 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:update_user(user_id=b8fe71e8c1914e9f88a45c13b4759f2a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:01.514796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd064d-bf15-42e5-a652-ab057b719a37 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:01.634248 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2291/4557] 10.222.0.43 () {60 vars in 1244 bytes} [Tue Aug 30 04:36:01 2022] PATCH /identity/v3/users/b8fe71e8c1914e9f88a45c13b4759f2a => generated 524 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:36:01.639132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3fd10-8973-460f-a87f-d935f9366612 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:01.657235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3fd10-8973-460f-a87f-d935f9366612 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:01.670712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35253a-0fe7-4ad5-a3e0-9140bded4d2d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:01.671390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35253a-0fe7-4ad5-a3e0-9140bded4d2d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:01.671663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35253a-0fe7-4ad5-a3e0-9140bded4d2d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:01.671978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35253a-0fe7-4ad5-a3e0-9140bded4d2d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/b8fe71e8c1914e9f88a45c13b4759f2a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:01.716584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35253a-0fe7-4ad5-a3e0-9140bded4d2d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:get_user(user_id=b8fe71e8c1914e9f88a45c13b4759f2a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:01.719119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35253a-0fe7-4ad5-a3e0-9140bded4d2d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:01.726771 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2267/4558] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:36:01 2022] GET /identity/v3/users/b8fe71e8c1914e9f88a45c13b4759f2a => generated 390 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:36:01.732906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd064d-bf15-42e5-a652-ab057b719a37 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:01.744199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd064d-bf15-42e5-a652-ab057b719a37 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:01.767821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:01.768593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:01.768947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:01.769366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/projects/2de970e208e04863b5da184176a9e6ba` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:01.770957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2de970e208e04863b5da184176a9e6ba)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:01.773151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:01.905651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de970e208e04863b5da184176a9e6ba', 'request_id': 'req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:01.935251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de970e208e04863b5da184176a9e6ba', 'request_id': 'req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:01.961635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de970e208e04863b5da184176a9e6ba', 'request_id': 'req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.001783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] The token cache is being invalidate because project 2de970e208e04863b5da184176a9e6ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:02.002055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.004582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.015117 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2292/4559] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:01 2022] DELETE /identity/v3/projects/2de970e208e04863b5da184176a9e6ba => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:02.015991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35253a-0fe7-4ad5-a3e0-9140bded4d2d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:02.024313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2d35253a-0fe7-4ad5-a3e0-9140bded4d2d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:02.079493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35253a-0fe7-4ad5-a3e0-9140bded4d2d tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:02.323793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:02.359006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7553800067d4466e9f6e1736d91435da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cdbc0a9e07714df7a11f92f7337fbb58', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:02.359669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:02.366271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:02.366746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] PATH_INFO: `/v3/users/b8fe71e8c1914e9f88a45c13b4759f2a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:02.368282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b8fe71e8c1914e9f88a45c13b4759f2a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:02.370945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:02.515901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8fe71e8c1914e9f88a45c13b4759f2a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.546670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8fe71e8c1914e9f88a45c13b4759f2a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.584472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8fe71e8c1914e9f88a45c13b4759f2a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.608442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8fe71e8c1914e9f88a45c13b4759f2a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.609241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-38215e60-3326-498a-8ce1-d8b093ccbdf7 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8fe71e8c1914e9f88a45c13b4759f2a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:02.623552 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2268/4560] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:02 2022] DELETE /identity/v3/users/b8fe71e8c1914e9f88a45c13b4759f2a => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:02.629220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:02.631589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:02.646948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=2,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:02.857989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b8efe6-e210-4574-a4e2-31a9a2ba3510 tempest-UsersV3TestJSON-1596291452 tempest-UsersV3TestJSON-1596291452-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:03.084643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:03.095995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:03.096439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:03.096892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] PATH_INFO: `/v3/users/6052edc02ad94878a0cee2e9defdd6b3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:03.138038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6052edc02ad94878a0cee2e9defdd6b3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:03.144665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:03.324073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6052edc02ad94878a0cee2e9defdd6b3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:03.325945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6052edc02ad94878a0cee2e9defdd6b3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:03.357041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6052edc02ad94878a0cee2e9defdd6b3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:03.369645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6052edc02ad94878a0cee2e9defdd6b3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:03.392085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6052edc02ad94878a0cee2e9defdd6b3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:03.404712 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2293/4561] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:02 2022] DELETE /identity/v3/users/6052edc02ad94878a0cee2e9defdd6b3 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:03.407216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493979-9103-4dc0-abde-95344fc6f387 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:03.407735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493979-9103-4dc0-abde-95344fc6f387 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:03.408018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba493979-9103-4dc0-abde-95344fc6f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:03.467773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ba493979-9103-4dc0-abde-95344fc6f387 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:03.469668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ba493979-9103-4dc0-abde-95344fc6f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:03.671821 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2269/4562] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:03.689511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:03.691753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:03.792954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:03.912535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cbe07-cd89-4e92-93cc-88f0407949ec admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:03.921106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c63e0c-79a5-407c-9f28-1d30c62ae5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:03.923101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63e0c-79a5-407c-9f28-1d30c62ae5ff service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:03.924024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63e0c-79a5-407c-9f28-1d30c62ae5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:03.926142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c63e0c-79a5-407c-9f28-1d30c62ae5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:04.002243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c63e0c-79a5-407c-9f28-1d30c62ae5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:04.006898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c63e0c-79a5-407c-9f28-1d30c62ae5ff service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:04.044862 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2294/4563] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:04.170958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba493979-9103-4dc0-abde-95344fc6f387 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:04.170958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ba493979-9103-4dc0-abde-95344fc6f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:04.212120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba493979-9103-4dc0-abde-95344fc6f387 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:04.246626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:04.249707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:04.250745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:04.251755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] PATH_INFO: `/v3/users/5e44cf9ac29f4f769979caa170d744ad` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:04.254829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e44cf9ac29f4f769979caa170d744ad)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:04.258073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:04.447047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e44cf9ac29f4f769979caa170d744ad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:04.477197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e44cf9ac29f4f769979caa170d744ad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:04.528697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:04.567068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e44cf9ac29f4f769979caa170d744ad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:04.598592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e44cf9ac29f4f769979caa170d744ad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:04.603063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e44cf9ac29f4f769979caa170d744ad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:04.659656 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2270/4564] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:04 2022] DELETE /identity/v3/users/5e44cf9ac29f4f769979caa170d744ad => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:04.666481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c1dae-8e02-45e9-b896-76113700f90d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:04.666939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c1dae-8e02-45e9-b896-76113700f90d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:04.667509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c1dae-8e02-45e9-b896-76113700f90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:04.700336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e70c1dae-8e02-45e9-b896-76113700f90d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:04.702449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e70c1dae-8e02-45e9-b896-76113700f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:04.842073 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2295/4565] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:04.876191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:04.878756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:05.110504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7efd3a-8b7c-4c35-85f0-bde64db48b07 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:05.132268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04c12e-774d-44b9-b0be-cb20fbbef596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:05.138073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04c12e-774d-44b9-b0be-cb20fbbef596 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:05.139980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04c12e-774d-44b9-b0be-cb20fbbef596 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:05.141164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04c12e-774d-44b9-b0be-cb20fbbef596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:05.165239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c1dae-8e02-45e9-b896-76113700f90d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:05.167369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e70c1dae-8e02-45e9-b896-76113700f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:05.173340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04c12e-774d-44b9-b0be-cb20fbbef596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:05.179744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04c12e-774d-44b9-b0be-cb20fbbef596 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:05.194892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c1dae-8e02-45e9-b896-76113700f90d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:05.215424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:05.216599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:05.217254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:05.217834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] PATH_INFO: `/v3/projects/f9a38275e1f946ec8ad0dbd9b4631f50` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:05.219772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a38275e1f946ec8ad0dbd9b4631f50)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:05.222383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:05.246807 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2271/4566] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:36:05.334448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a38275e1f946ec8ad0dbd9b4631f50', 'request_id': 'req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:05.343131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a38275e1f946ec8ad0dbd9b4631f50', 'request_id': 'req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:05.355778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a38275e1f946ec8ad0dbd9b4631f50', 'request_id': 'req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:05.376328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] The token cache is being invalidate because project f9a38275e1f946ec8ad0dbd9b4631f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:05.376720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:05.377938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:05.383170 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2296/4567] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:05 2022] DELETE /identity/v3/projects/f9a38275e1f946ec8ad0dbd9b4631f50 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:05.387572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04c12e-774d-44b9-b0be-cb20fbbef596 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:05.407629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04c12e-774d-44b9-b0be-cb20fbbef596 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:05.540199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:05.541661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:05.542403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:05.543133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] PATH_INFO: `/v3/users/7553800067d4466e9f6e1736d91435da` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:05.546778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7553800067d4466e9f6e1736d91435da)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:05.551717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:05.702298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7553800067d4466e9f6e1736d91435da'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:05.720638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7553800067d4466e9f6e1736d91435da'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:05.755626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7553800067d4466e9f6e1736d91435da'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:05.769389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7553800067d4466e9f6e1736d91435da'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:05.770904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7553800067d4466e9f6e1736d91435da'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:05.789796 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2272/4568] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:05 2022] DELETE /identity/v3/users/7553800067d4466e9f6e1736d91435da => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:06.191824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:06.193304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:06.256877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:06.309354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:06.314559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:06.320935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fb3a8-2ba5-4d2d-8797-d0215137f9f7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:06.330311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:06.470539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802ce99-6f84-451b-848d-478b5f3c25ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:06.471493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802ce99-6f84-451b-848d-478b5f3c25ba service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:06.472080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802ce99-6f84-451b-848d-478b5f3c25ba service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:06.472595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802ce99-6f84-451b-848d-478b5f3c25ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:06.474810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8802ce99-6f84-451b-848d-478b5f3c25ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:06.474959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8541ee2-a962-4eb2-b191-bffe34d35717 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:06.480528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:06.481268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:06.481710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:06.482090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] PATH_INFO: `/v3/users/04382a029fb94a989366d9eab1b3b0bc` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:06.483345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04382a029fb94a989366d9eab1b3b0bc)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:06.486954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:06.489519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802ce99-6f84-451b-848d-478b5f3c25ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:06.491375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802ce99-6f84-451b-848d-478b5f3c25ba service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:06.504189 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2297/4569] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:06.505714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802ce99-6f84-451b-848d-478b5f3c25ba service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:06.507378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8802ce99-6f84-451b-848d-478b5f3c25ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:06.524118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802ce99-6f84-451b-848d-478b5f3c25ba service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:06.529642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:06.530944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:06.530944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:06.530944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] PATH_INFO: `/v3/projects/cdbc0a9e07714df7a11f92f7337fbb58` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:06.539467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdbc0a9e07714df7a11f92f7337fbb58)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:06.543165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:06.561468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04382a029fb94a989366d9eab1b3b0bc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.573524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04382a029fb94a989366d9eab1b3b0bc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.600572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04382a029fb94a989366d9eab1b3b0bc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.611326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04382a029fb94a989366d9eab1b3b0bc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.612911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04382a029fb94a989366d9eab1b3b0bc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.621159 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2273/4570] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:06 2022] DELETE /identity/v3/users/04382a029fb94a989366d9eab1b3b0bc => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:06.622783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:06.624899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:06.628851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdbc0a9e07714df7a11f92f7337fbb58', 'request_id': 'req-dc625508-b583-406b-8382-5e9bb24df0ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.637578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdbc0a9e07714df7a11f92f7337fbb58', 'request_id': 'req-dc625508-b583-406b-8382-5e9bb24df0ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.647498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdbc0a9e07714df7a11f92f7337fbb58', 'request_id': 'req-dc625508-b583-406b-8382-5e9bb24df0ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.662083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] The token cache is being invalidate because project cdbc0a9e07714df7a11f92f7337fbb58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:06.662445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.663419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc625508-b583-406b-8382-5e9bb24df0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.670997 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2298/4571] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:06 2022] DELETE /identity/v3/projects/cdbc0a9e07714df7a11f92f7337fbb58 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:06.670997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f47c10-bc8e-4b57-82aa-25526e3c20c6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:06.670997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f47c10-bc8e-4b57-82aa-25526e3c20c6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:06.670997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f47c10-bc8e-4b57-82aa-25526e3c20c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:06.697612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f4f47c10-bc8e-4b57-82aa-25526e3c20c6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:06.698915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f4f47c10-bc8e-4b57-82aa-25526e3c20c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:06.745682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4cdbf6-a7c3-4fc3-95c0-10190978e6b1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:06.755866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:06.756939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:06.757380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:06.757843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] PATH_INFO: `/v3/projects/25d8f98f418a4ffcb373e69d9121dad4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:06.759929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d8f98f418a4ffcb373e69d9121dad4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:06.763813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:06.815339 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2299/4572] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:06.821940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce35f-982b-4dc6-a6b0-530db82def9d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:06.821940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce35f-982b-4dc6-a6b0-530db82def9d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:06.821940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ce35f-982b-4dc6-a6b0-530db82def9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:06.829863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:06.837789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:06.860819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ea4ce35f-982b-4dc6-a6b0-530db82def9d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:06.863718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ea4ce35f-982b-4dc6-a6b0-530db82def9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:06.866987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d8f98f418a4ffcb373e69d9121dad4', 'request_id': 'req-1f58c9d8-466b-452b-bb7a-12722e1ca02c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.879473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d8f98f418a4ffcb373e69d9121dad4', 'request_id': 'req-1f58c9d8-466b-452b-bb7a-12722e1ca02c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.892071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d8f98f418a4ffcb373e69d9121dad4', 'request_id': 'req-1f58c9d8-466b-452b-bb7a-12722e1ca02c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.912409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] The token cache is being invalidate because project 25d8f98f418a4ffcb373e69d9121dad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:06.913048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.914311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:06.918464 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2274/4573] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:06 2022] DELETE /identity/v3/projects/25d8f98f418a4ffcb373e69d9121dad4 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:06.919713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:06.923762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:06.995955 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2300/4574] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:06.997584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb10f7-b73f-4bd5-b1fa-6d8222035360 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:06.997905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb10f7-b73f-4bd5-b1fa-6d8222035360 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:06.998554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb10f7-b73f-4bd5-b1fa-6d8222035360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.034184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e2bb10f7-b73f-4bd5-b1fa-6d8222035360 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:07.036715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e2bb10f7-b73f-4bd5-b1fa-6d8222035360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:07.047762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c9d8-466b-452b-bb7a-12722e1ca02c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.051245 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2301/4575] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:07.054834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614c452-ae52-4ba2-aa0a-1b249c64b9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.056599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08e04-dcd8-4d31-a0ac-682ff0829e3f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.056842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614c452-ae52-4ba2-aa0a-1b249c64b9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.057106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08e04-dcd8-4d31-a0ac-682ff0829e3f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.057308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614c452-ae52-4ba2-aa0a-1b249c64b9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.057778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614c452-ae52-4ba2-aa0a-1b249c64b9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.057966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e08e04-dcd8-4d31-a0ac-682ff0829e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.062678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a614c452-ae52-4ba2-aa0a-1b249c64b9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:07.082051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614c452-ae52-4ba2-aa0a-1b249c64b9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.084154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614c452-ae52-4ba2-aa0a-1b249c64b9c3 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.098782 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2275/4576] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:07.104616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c5e08e04-dcd8-4d31-a0ac-682ff0829e3f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:07.107675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c5e08e04-dcd8-4d31-a0ac-682ff0829e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:07.110717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faaca1-1782-4982-9b22-61a803e4a09a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.111188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faaca1-1782-4982-9b22-61a803e4a09a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.114626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faaca1-1782-4982-9b22-61a803e4a09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.133944 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2302/4577] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:07.140176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08e04-dcd8-4d31-a0ac-682ff0829e3f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.155768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-68faaca1-1782-4982-9b22-61a803e4a09a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:07.157068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-68faaca1-1782-4982-9b22-61a803e4a09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:07.165181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e08e04-dcd8-4d31-a0ac-682ff0829e3f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.171165 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2276/4578] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:07.173067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faaca1-1782-4982-9b22-61a803e4a09a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.178037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15539be-c83c-407f-8ba1-51b105b1fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.179506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15539be-c83c-407f-8ba1-51b105b1fe4c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.180913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15539be-c83c-407f-8ba1-51b105b1fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.181480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15539be-c83c-407f-8ba1-51b105b1fe4c admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.183684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15539be-c83c-407f-8ba1-51b105b1fe4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:07.184317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15539be-c83c-407f-8ba1-51b105b1fe4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.184450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faaca1-1782-4982-9b22-61a803e4a09a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.188893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15539be-c83c-407f-8ba1-51b105b1fe4c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.190785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3c730-d4b8-4e16-8c98-09aa7eeffd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.191714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3c730-d4b8-4e16-8c98-09aa7eeffd47 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.192216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3c730-d4b8-4e16-8c98-09aa7eeffd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.192636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3c730-d4b8-4e16-8c98-09aa7eeffd47 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.193411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3c730-d4b8-4e16-8c98-09aa7eeffd47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:07.193867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3c730-d4b8-4e16-8c98-09aa7eeffd47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.195995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3c730-d4b8-4e16-8c98-09aa7eeffd47 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.219951 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2277/4579] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:36:07.222301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3c730-d4b8-4e16-8c98-09aa7eeffd47 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.225411 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2303/4580] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:36:07.231884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15539be-c83c-407f-8ba1-51b105b1fe4c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.240185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3c730-d4b8-4e16-8c98-09aa7eeffd47 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.246477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6b2e9-c44b-443b-a697-288a2820c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.247822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6b2e9-c44b-443b-a697-288a2820c8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.248189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6b2e9-c44b-443b-a697-288a2820c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.248528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6b2e9-c44b-443b-a697-288a2820c8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.249300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6b2e9-c44b-443b-a697-288a2820c8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.251531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6b2e9-c44b-443b-a697-288a2820c8a0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.256736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15539be-c83c-407f-8ba1-51b105b1fe4c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.268475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f14647-f8b0-4dbc-8d94-b9e549f816dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.270780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f14647-f8b0-4dbc-8d94-b9e549f816dc admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.270780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f14647-f8b0-4dbc-8d94-b9e549f816dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.270780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f14647-f8b0-4dbc-8d94-b9e549f816dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.272312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f14647-f8b0-4dbc-8d94-b9e549f816dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.276421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f14647-f8b0-4dbc-8d94-b9e549f816dc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.284754 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2278/4581] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:07 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:07.291191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6b2e9-c44b-443b-a697-288a2820c8a0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.328050 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2304/4582] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:07 2022] POST /identity/v3/projects => generated 361 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:07.332740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f14647-f8b0-4dbc-8d94-b9e549f816dc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.411343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6b2e9-c44b-443b-a697-288a2820c8a0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.431590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f14647-f8b0-4dbc-8d94-b9e549f816dc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.444193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a200a1b-a2a8-4ffc-a926-06d1d6a46186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.445283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a200a1b-a2a8-4ffc-a926-06d1d6a46186 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.445570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a200a1b-a2a8-4ffc-a926-06d1d6a46186 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.445843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a200a1b-a2a8-4ffc-a926-06d1d6a46186 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.446538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a200a1b-a2a8-4ffc-a926-06d1d6a46186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.447792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:07.448577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a200a1b-a2a8-4ffc-a926-06d1d6a46186 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.477657 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2305/4583] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:07 2022] POST /identity/v3/users => generated 281 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:07.482053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a200a1b-a2a8-4ffc-a926-06d1d6a46186 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.499261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a200a1b-a2a8-4ffc-a926-06d1d6a46186 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.509358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13c22d-8168-4a59-82b6-37eb4d200990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.510687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13c22d-8168-4a59-82b6-37eb4d200990 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.511265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13c22d-8168-4a59-82b6-37eb4d200990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.512562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13c22d-8168-4a59-82b6-37eb4d200990 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.513599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13c22d-8168-4a59-82b6-37eb4d200990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.515456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a594a-aff1-4250-80bc-3fe0eb01ac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.516093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a594a-aff1-4250-80bc-3fe0eb01ac33 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.516368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a594a-aff1-4250-80bc-3fe0eb01ac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.516635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a594a-aff1-4250-80bc-3fe0eb01ac33 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.516820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e13c22d-8168-4a59-82b6-37eb4d200990 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.517280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a594a-aff1-4250-80bc-3fe0eb01ac33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.519737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a594a-aff1-4250-80bc-3fe0eb01ac33 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.542349 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2306/4584] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:36:07.549139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13c22d-8168-4a59-82b6-37eb4d200990 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.558552 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2279/4585] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:07 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:07.562201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13c22d-8168-4a59-82b6-37eb4d200990 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.563369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a594a-aff1-4250-80bc-3fe0eb01ac33 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.570121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793fff2-152e-49cf-b145-bc07b12c6983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.571249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793fff2-152e-49cf-b145-bc07b12c6983 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.571725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793fff2-152e-49cf-b145-bc07b12c6983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.572180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793fff2-152e-49cf-b145-bc07b12c6983 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.573051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793fff2-152e-49cf-b145-bc07b12c6983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.575569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793fff2-152e-49cf-b145-bc07b12c6983 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.582339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a594a-aff1-4250-80bc-3fe0eb01ac33 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.590526 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2307/4586] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:07.591518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563c4a5-de5d-46a6-901a-37ba430b0bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.592485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563c4a5-de5d-46a6-901a-37ba430b0bbc admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.592895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563c4a5-de5d-46a6-901a-37ba430b0bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.593335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563c4a5-de5d-46a6-901a-37ba430b0bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.594482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563c4a5-de5d-46a6-901a-37ba430b0bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.596209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793fff2-152e-49cf-b145-bc07b12c6983 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.597818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563c4a5-de5d-46a6-901a-37ba430b0bbc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.614743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793fff2-152e-49cf-b145-bc07b12c6983 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.617769 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2280/4587] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:36:07.623340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563c4a5-de5d-46a6-901a-37ba430b0bbc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.631356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd16ebb-c8ae-4394-893e-f2c77e3e1567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.632747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd16ebb-c8ae-4394-893e-f2c77e3e1567 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.633398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd16ebb-c8ae-4394-893e-f2c77e3e1567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.633712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd16ebb-c8ae-4394-893e-f2c77e3e1567 admin admin] PATH_INFO: `/v3/projects/9371408edca940debe4ef8d9297e66d2/users/fef9e5e22ced46e686a788d6d6e334db/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.646333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563c4a5-de5d-46a6-901a-37ba430b0bbc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.657954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c9ba7-c5de-45d0-8f9d-c099a002e42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.662928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9ba7-c5de-45d0-8f9d-c099a002e42c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.663663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9ba7-c5de-45d0-8f9d-c099a002e42c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.664289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c9ba7-c5de-45d0-8f9d-c099a002e42c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.665017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c9ba7-c5de-45d0-8f9d-c099a002e42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.667543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c9ba7-c5de-45d0-8f9d-c099a002e42c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.674271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd16ebb-c8ae-4394-893e-f2c77e3e1567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9371408edca940debe4ef8d9297e66d2, user_id=fef9e5e22ced46e686a788d6d6e334db, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.682776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd16ebb-c8ae-4394-893e-f2c77e3e1567 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.693625 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2281/4588] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:36:07.701472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c9ba7-c5de-45d0-8f9d-c099a002e42c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.709092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:07.729133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c9ba7-c5de-45d0-8f9d-c099a002e42c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:07.733406 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2308/4589] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:07 2022] PUT /identity/v3/projects/9371408edca940debe4ef8d9297e66d2/users/fef9e5e22ced46e686a788d6d6e334db/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:07.757729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636e3f-cc09-4aed-ad5b-a7bc88f7f9e2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.758648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636e3f-cc09-4aed-ad5b-a7bc88f7f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.758961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34636e3f-cc09-4aed-ad5b-a7bc88f7f9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.823029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-34636e3f-cc09-4aed-ad5b-a7bc88f7f9e2 None None] MFA Rules not processed for user `fef9e5e22ced46e686a788d6d6e334db`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:07.830419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-34636e3f-cc09-4aed-ad5b-a7bc88f7f9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:07.893035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307505c-3d3a-4129-aa3f-3dbcf5c85e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:07.895306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307505c-3d3a-4129-aa3f-3dbcf5c85e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:07.896817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307505c-3d3a-4129-aa3f-3dbcf5c85e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:07.897609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307505c-3d3a-4129-aa3f-3dbcf5c85e37 admin admin] PATH_INFO: `/v3/projects/f47e2092802f4e8b8b96d7adab2d4c33/users/c08bbaf86cc944dbaa12cc20224b0f50/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:07.945664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307505c-3d3a-4129-aa3f-3dbcf5c85e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f47e2092802f4e8b8b96d7adab2d4c33, user_id=c08bbaf86cc944dbaa12cc20224b0f50, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:07.952137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307505c-3d3a-4129-aa3f-3dbcf5c85e37 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:07.989523 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2282/4590] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:07 2022] PUT /identity/v3/projects/f47e2092802f4e8b8b96d7adab2d4c33/users/c08bbaf86cc944dbaa12cc20224b0f50/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:07.989523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307505c-3d3a-4129-aa3f-3dbcf5c85e37 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:07.990858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8307505c-3d3a-4129-aa3f-3dbcf5c85e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:08.048472 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2309/4591] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:08.051441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b9b90-1895-44e0-8296-c5c5ccaf0c96 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:08.051873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b9b90-1895-44e0-8296-c5c5ccaf0c96 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:08.052232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b9b90-1895-44e0-8296-c5c5ccaf0c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:08.089282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2d7b9b90-1895-44e0-8296-c5c5ccaf0c96 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:08.091056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2d7b9b90-1895-44e0-8296-c5c5ccaf0c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:08.186150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307505c-3d3a-4129-aa3f-3dbcf5c85e37 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:08.197188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:08.198439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:08.198966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:08.199518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] PATH_INFO: `/v3/projects/5f85c627636c421c88707c0501a53f08` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:08.202229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f85c627636c421c88707c0501a53f08)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:08.206692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:08.226158 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2310/4592] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:08.228675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b9b90-1895-44e0-8296-c5c5ccaf0c96 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:08.242312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b9b90-1895-44e0-8296-c5c5ccaf0c96 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:08.249006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:08.249792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:08.250071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:08.250322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] PATH_INFO: `/v3/users/fef9e5e22ced46e686a788d6d6e334db` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:08.251862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef9e5e22ced46e686a788d6d6e334db)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:08.254982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:08.275171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:08.359138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f85c627636c421c88707c0501a53f08', 'request_id': 'req-ac6325d8-1bc2-42fc-9b25-961289da49f0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:08.359390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef9e5e22ced46e686a788d6d6e334db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:08.362187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef9e5e22ced46e686a788d6d6e334db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:08.378886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef9e5e22ced46e686a788d6d6e334db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:08.384200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f85c627636c421c88707c0501a53f08', 'request_id': 'req-ac6325d8-1bc2-42fc-9b25-961289da49f0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:08.396613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f85c627636c421c88707c0501a53f08', 'request_id': 'req-ac6325d8-1bc2-42fc-9b25-961289da49f0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:08.405550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef9e5e22ced46e686a788d6d6e334db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:08.417409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] The token cache is being invalidate because project 5f85c627636c421c88707c0501a53f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:08.417790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:08.418966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:08.420841 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2283/4593] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:07 2022] DELETE /identity/v3/projects/5f85c627636c421c88707c0501a53f08 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:08.421658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:08.423172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:08.430098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1775fe53-5754-43e5-8fb3-916e2641e0d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef9e5e22ced46e686a788d6d6e334db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:08.432892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:08.440756 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2311/4594] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:08 2022] DELETE /identity/v3/users/fef9e5e22ced46e686a788d6d6e334db => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:08.442752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f0fb-2326-420b-991d-d03c5845c88b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:08.443581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f0fb-2326-420b-991d-d03c5845c88b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:08.444487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0f0fb-2326-420b-991d-d03c5845c88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:08.471413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-27b0f0fb-2326-420b-991d-d03c5845c88b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:08.472947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-27b0f0fb-2326-420b-991d-d03c5845c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:08.512423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6325d8-1bc2-42fc-9b25-961289da49f0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:08.585989 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2312/4595] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:08.589725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efdb34-9836-43cf-8081-72c4766a5c74 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:08.590864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efdb34-9836-43cf-8081-72c4766a5c74 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:08.590864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efdb34-9836-43cf-8081-72c4766a5c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:08.616185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fb053-73b7-484e-99ce-2d1eb1f77cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:08.617059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fb053-73b7-484e-99ce-2d1eb1f77cea service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:08.617234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fb053-73b7-484e-99ce-2d1eb1f77cea service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:08.617495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512fb053-73b7-484e-99ce-2d1eb1f77cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:08.619906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-512fb053-73b7-484e-99ce-2d1eb1f77cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:08.623464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-76efdb34-9836-43cf-8081-72c4766a5c74 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:08.625133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-76efdb34-9836-43cf-8081-72c4766a5c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:08.635978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fb053-73b7-484e-99ce-2d1eb1f77cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:08.637572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512fb053-73b7-484e-99ce-2d1eb1f77cea service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:08.646647 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2313/4596] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:08.648770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4ca55-bd57-4755-9d5e-d231335b0b0d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:08.649323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4ca55-bd57-4755-9d5e-d231335b0b0d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:08.650174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4ca55-bd57-4755-9d5e-d231335b0b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:08.659024 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2284/4597] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:08.661333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fb053-73b7-484e-99ce-2d1eb1f77cea service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:08.664129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-512fb053-73b7-484e-99ce-2d1eb1f77cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:08.689500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a7a4ca55-bd57-4755-9d5e-d231335b0b0d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:08.690790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512fb053-73b7-484e-99ce-2d1eb1f77cea service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:08.691955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a7a4ca55-bd57-4755-9d5e-d231335b0b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:08.697518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183180f-b357-4dd4-9e54-2f832ad379ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:08.698577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183180f-b357-4dd4-9e54-2f832ad379ae service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:08.699052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183180f-b357-4dd4-9e54-2f832ad379ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:08.699401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183180f-b357-4dd4-9e54-2f832ad379ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:08.711703 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2314/4598] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:08.713602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183180f-b357-4dd4-9e54-2f832ad379ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:08.715499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183180f-b357-4dd4-9e54-2f832ad379ae service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:08.717338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4ca55-bd57-4755-9d5e-d231335b0b0d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:08.735569 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2285/4599] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:08.738656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4ca55-bd57-4755-9d5e-d231335b0b0d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:08.744675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb17c3-db18-43e8-ba45-4d01e4978928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:08.745328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb17c3-db18-43e8-ba45-4d01e4978928 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:08.745615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb17c3-db18-43e8-ba45-4d01e4978928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:08.745931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb17c3-db18-43e8-ba45-4d01e4978928 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:08.746728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb17c3-db18-43e8-ba45-4d01e4978928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:08.747035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb17c3-db18-43e8-ba45-4d01e4978928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:08.748808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb17c3-db18-43e8-ba45-4d01e4978928 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:08.768530 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2315/4600] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:36:08.774357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183180f-b357-4dd4-9e54-2f832ad379ae service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:08.803138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183180f-b357-4dd4-9e54-2f832ad379ae service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:08.814447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b5dc1-0a8a-4883-abe4-2c74ab29202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:08.816411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b5dc1-0a8a-4883-abe4-2c74ab29202a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:08.817222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b5dc1-0a8a-4883-abe4-2c74ab29202a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:08.818006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b5dc1-0a8a-4883-abe4-2c74ab29202a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:08.819182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b5dc1-0a8a-4883-abe4-2c74ab29202a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:08.823136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b5dc1-0a8a-4883-abe4-2c74ab29202a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:08.874785 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2286/4601] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:08 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:08.886497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb17c3-db18-43e8-ba45-4d01e4978928 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:08.914643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb17c3-db18-43e8-ba45-4d01e4978928 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:09.080072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccf5ba-7702-4464-a4bc-27751a7d3c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:09.081056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccf5ba-7702-4464-a4bc-27751a7d3c20 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:09.082203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccf5ba-7702-4464-a4bc-27751a7d3c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:09.082582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccf5ba-7702-4464-a4bc-27751a7d3c20 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:09.084269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccf5ba-7702-4464-a4bc-27751a7d3c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:09.092131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccf5ba-7702-4464-a4bc-27751a7d3c20 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:09.146440 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2316/4602] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:08 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:09.154870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b5dc1-0a8a-4883-abe4-2c74ab29202a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:09.179167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b5dc1-0a8a-4883-abe4-2c74ab29202a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:09.185543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef84c0-582d-45bb-a771-bba3cbde7940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:09.187562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef84c0-582d-45bb-a771-bba3cbde7940 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:09.187562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef84c0-582d-45bb-a771-bba3cbde7940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:09.187562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef84c0-582d-45bb-a771-bba3cbde7940 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:09.188218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef84c0-582d-45bb-a771-bba3cbde7940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:09.190061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef84c0-582d-45bb-a771-bba3cbde7940 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:09.206018 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2287/4603] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:09.211477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccf5ba-7702-4464-a4bc-27751a7d3c20 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:09.234581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccf5ba-7702-4464-a4bc-27751a7d3c20 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:09.244394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78bfa9-937a-47a6-8afc-90cb03806c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:09.245471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78bfa9-937a-47a6-8afc-90cb03806c16 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:09.246004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78bfa9-937a-47a6-8afc-90cb03806c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:09.247568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78bfa9-937a-47a6-8afc-90cb03806c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:09.248805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78bfa9-937a-47a6-8afc-90cb03806c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:09.252310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78bfa9-937a-47a6-8afc-90cb03806c16 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:09.279624 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2317/4604] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:09.281936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef84c0-582d-45bb-a771-bba3cbde7940 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:09.296988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef84c0-582d-45bb-a771-bba3cbde7940 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:09.305595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b5e20-988f-4a8d-ba53-dcdf0f725e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:09.306606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b5e20-988f-4a8d-ba53-dcdf0f725e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:09.307079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b5e20-988f-4a8d-ba53-dcdf0f725e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:09.307355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b5e20-988f-4a8d-ba53-dcdf0f725e0d admin admin] PATH_INFO: `/v3/projects/4b059e29f41146389231ec9b6bcb565f/users/6efcc5e4e1f24d30ad164a8daa4e6d97/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:09.333987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b5e20-988f-4a8d-ba53-dcdf0f725e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b059e29f41146389231ec9b6bcb565f, user_id=6efcc5e4e1f24d30ad164a8daa4e6d97, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:09.337443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b5e20-988f-4a8d-ba53-dcdf0f725e0d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:09.340851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:09.387038 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2288/4605] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:09 2022] PUT /identity/v3/projects/4b059e29f41146389231ec9b6bcb565f/users/6efcc5e4e1f24d30ad164a8daa4e6d97/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:09.415225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8206c-f01c-43a8-a1a3-f0ccad474f65 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:09.416219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8206c-f01c-43a8-a1a3-f0ccad474f65 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:09.416761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8206c-f01c-43a8-a1a3-f0ccad474f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:09.556760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9df8206c-f01c-43a8-a1a3-f0ccad474f65 None None] MFA Rules not processed for user `6efcc5e4e1f24d30ad164a8daa4e6d97`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:09.561649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9df8206c-f01c-43a8-a1a3-f0ccad474f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:09.714603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b5e20-988f-4a8d-ba53-dcdf0f725e0d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:09.717933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b97b5e20-988f-4a8d-ba53-dcdf0f725e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:09.861778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:09.945582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b5e20-988f-4a8d-ba53-dcdf0f725e0d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:09.964110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:09.967547 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2318/4606] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:36:09.970994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:09.974492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:09.975210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] PATH_INFO: `/v3/projects/9371408edca940debe4ef8d9297e66d2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:09.979501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9371408edca940debe4ef8d9297e66d2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:09.985242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:10.086171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8206c-f01c-43a8-a1a3-f0ccad474f65 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:10.158639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9371408edca940debe4ef8d9297e66d2', 'request_id': 'req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:10.186440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9371408edca940debe4ef8d9297e66d2', 'request_id': 'req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:10.199005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9371408edca940debe4ef8d9297e66d2', 'request_id': 'req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:10.221841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] The token cache is being invalidate because project 9371408edca940debe4ef8d9297e66d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:10.222705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:10.223788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-03f7cdf0-9a86-48ac-957f-fb16ee0ed25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:10.226681 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2289/4607] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:09 2022] DELETE /identity/v3/projects/9371408edca940debe4ef8d9297e66d2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:10.229296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e98c-68e6-4d23-879a-0f38c37c3f59 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:10.229989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e98c-68e6-4d23-879a-0f38c37c3f59 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:10.231061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974e98c-68e6-4d23-879a-0f38c37c3f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:10.273472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9974e98c-68e6-4d23-879a-0f38c37c3f59 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:10.277824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9974e98c-68e6-4d23-879a-0f38c37c3f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:10.278262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8206c-f01c-43a8-a1a3-f0ccad474f65 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:10.402043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4a179-817d-4969-96a3-b4aac64c0536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:10.402345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4a179-817d-4969-96a3-b4aac64c0536 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:10.402734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4a179-817d-4969-96a3-b4aac64c0536 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:10.404377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4a179-817d-4969-96a3-b4aac64c0536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:10.409246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c4b4a179-817d-4969-96a3-b4aac64c0536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:10.471231 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2290/4608] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:36:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:10.474015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a9ea-1373-4961-9339-908e62b73df0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:10.474755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a9ea-1373-4961-9339-908e62b73df0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:10.475462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053a9ea-1373-4961-9339-908e62b73df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:10.518407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6053a9ea-1373-4961-9339-908e62b73df0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:10.521193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6053a9ea-1373-4961-9339-908e62b73df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:10.592574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:10.628977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4a179-817d-4969-96a3-b4aac64c0536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:10.632321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4a179-817d-4969-96a3-b4aac64c0536 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:10.663771 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2319/4609] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:10.665578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4a179-817d-4969-96a3-b4aac64c0536 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:10.670421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c4b4a179-817d-4969-96a3-b4aac64c0536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:10.726146 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2291/4610] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:10.729612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66646613-1565-4c6d-b125-80d4e650638e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:10.729612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66646613-1565-4c6d-b125-80d4e650638e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:10.729612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66646613-1565-4c6d-b125-80d4e650638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:10.819980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-66646613-1565-4c6d-b125-80d4e650638e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:10.822388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-66646613-1565-4c6d-b125-80d4e650638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:10.841189 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2292/4611] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:10.851020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66646613-1565-4c6d-b125-80d4e650638e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:10.874091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66646613-1565-4c6d-b125-80d4e650638e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:10.876915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:10.890625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b3766-95ce-4dcc-9c14-8a59dd0e6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:10.891941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3766-95ce-4dcc-9c14-8a59dd0e6975 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:10.892424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3766-95ce-4dcc-9c14-8a59dd0e6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:10.893173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3766-95ce-4dcc-9c14-8a59dd0e6975 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:10.894639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b3766-95ce-4dcc-9c14-8a59dd0e6975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:10.895410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b3766-95ce-4dcc-9c14-8a59dd0e6975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:10.900977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b3766-95ce-4dcc-9c14-8a59dd0e6975 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:10.942491 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2293/4612] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:36:10.949693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b3766-95ce-4dcc-9c14-8a59dd0e6975 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:10.954691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4a179-817d-4969-96a3-b4aac64c0536 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:10.973196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d453d4-348d-4a65-8383-169aea462a1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:10.975776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d453d4-348d-4a65-8383-169aea462a1b service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:10.977315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d453d4-348d-4a65-8383-169aea462a1b service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:10.977841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d453d4-348d-4a65-8383-169aea462a1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:10.998948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b3766-95ce-4dcc-9c14-8a59dd0e6975 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:11.015028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d453d4-348d-4a65-8383-169aea462a1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:11.019284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d453d4-348d-4a65-8383-169aea462a1b service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:11.032084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fc722-1ca6-4f38-952b-c33abdc203b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:11.033154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fc722-1ca6-4f38-952b-c33abdc203b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:11.033645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fc722-1ca6-4f38-952b-c33abdc203b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:11.034327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fc722-1ca6-4f38-952b-c33abdc203b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:11.035789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fc722-1ca6-4f38-952b-c33abdc203b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:11.046686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fc722-1ca6-4f38-952b-c33abdc203b0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:11.058453 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2320/4613] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:36:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:11.214822 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2294/4614] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:10 2022] POST /identity/v3/projects => generated 389 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:11.218745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d453d4-348d-4a65-8383-169aea462a1b service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:11.251072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d453d4-348d-4a65-8383-169aea462a1b service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:11.445590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680ff77-6438-46a1-91e0-d77339f1209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:11.446761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680ff77-6438-46a1-91e0-d77339f1209f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:11.446761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680ff77-6438-46a1-91e0-d77339f1209f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:11.447033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680ff77-6438-46a1-91e0-d77339f1209f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:11.447464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680ff77-6438-46a1-91e0-d77339f1209f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:11.449520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680ff77-6438-46a1-91e0-d77339f1209f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:11.528873 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2321/4615] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:11 2022] POST /identity/v3/users => generated 295 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:11.529480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fc722-1ca6-4f38-952b-c33abdc203b0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:11.563233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fc722-1ca6-4f38-952b-c33abdc203b0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:11.575169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93890b-bb58-4279-bfba-18eb74f944be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:11.576139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93890b-bb58-4279-bfba-18eb74f944be admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:11.576720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93890b-bb58-4279-bfba-18eb74f944be admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:11.577758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93890b-bb58-4279-bfba-18eb74f944be admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:11.580848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93890b-bb58-4279-bfba-18eb74f944be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:11.587143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93890b-bb58-4279-bfba-18eb74f944be admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:11.623207 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2295/4616] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:11.630023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680ff77-6438-46a1-91e0-d77339f1209f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:11.667670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680ff77-6438-46a1-91e0-d77339f1209f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:11.694200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1f1fa-b768-418d-9ad3-afd4ea0af8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:11.695259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1f1fa-b768-418d-9ad3-afd4ea0af8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:11.695741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1f1fa-b768-418d-9ad3-afd4ea0af8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:11.696257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1f1fa-b768-418d-9ad3-afd4ea0af8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:11.699298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1f1fa-b768-418d-9ad3-afd4ea0af8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:11.707051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1f1fa-b768-418d-9ad3-afd4ea0af8a4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:11.756649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93890b-bb58-4279-bfba-18eb74f944be admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:11.757484 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2322/4617] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:11.801339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93890b-bb58-4279-bfba-18eb74f944be admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:11.832978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7240e1-9b65-4ef7-88f5-40ce488fca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:11.839050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7240e1-9b65-4ef7-88f5-40ce488fca8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:11.839584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7240e1-9b65-4ef7-88f5-40ce488fca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:11.841224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7240e1-9b65-4ef7-88f5-40ce488fca8c admin admin] PATH_INFO: `/v3/projects/453ce0f999604b14b37d5adc9c0a9956/users/ea3e6c7f2764467d96c90a7e0d9db9cb/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:11.943270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7240e1-9b65-4ef7-88f5-40ce488fca8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=453ce0f999604b14b37d5adc9c0a9956, user_id=ea3e6c7f2764467d96c90a7e0d9db9cb, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:11.947064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7240e1-9b65-4ef7-88f5-40ce488fca8c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:11.989985 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2296/4618] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:11 2022] PUT /identity/v3/projects/453ce0f999604b14b37d5adc9c0a9956/users/ea3e6c7f2764467d96c90a7e0d9db9cb/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:12.016177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b5ab-dc54-450d-8aaa-241739728fb3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:12.017198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b5ab-dc54-450d-8aaa-241739728fb3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:12.017860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b5ab-dc54-450d-8aaa-241739728fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:12.111320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-63c8b5ab-dc54-450d-8aaa-241739728fb3 None None] MFA Rules not processed for user `ea3e6c7f2764467d96c90a7e0d9db9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:12.114935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-63c8b5ab-dc54-450d-8aaa-241739728fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:12.429170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7240e1-9b65-4ef7-88f5-40ce488fca8c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:12.430026 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2323/4619] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:12.749441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7240e1-9b65-4ef7-88f5-40ce488fca8c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:12.757923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881713e-a813-47f4-bbdc-943bee631c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:12.759111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881713e-a813-47f4-bbdc-943bee631c67 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:12.759111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881713e-a813-47f4-bbdc-943bee631c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:12.759111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881713e-a813-47f4-bbdc-943bee631c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:12.759773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881713e-a813-47f4-bbdc-943bee631c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:12.761849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881713e-a813-47f4-bbdc-943bee631c67 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:12.821851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b5ab-dc54-450d-8aaa-241739728fb3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:12.834995 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2297/4620] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:12 2022] POST /identity/v3/projects => generated 391 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:12.850382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b5ab-dc54-450d-8aaa-241739728fb3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:13.080418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:13.129305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175137e1-b395-40b9-9c1f-0bf30fa19167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:13.131214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175137e1-b395-40b9-9c1f-0bf30fa19167 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.131508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175137e1-b395-40b9-9c1f-0bf30fa19167 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.132075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175137e1-b395-40b9-9c1f-0bf30fa19167 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.137450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175137e1-b395-40b9-9c1f-0bf30fa19167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:13.142106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175137e1-b395-40b9-9c1f-0bf30fa19167 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:13.292242 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2324/4621] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:12 2022] POST /identity/v3/users => generated 302 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:13.295225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881713e-a813-47f4-bbdc-943bee631c67 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:13.350332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881713e-a813-47f4-bbdc-943bee631c67 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:13.378995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce84c76-269d-42dc-9fcd-a1c7aed0358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:13.381261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce84c76-269d-42dc-9fcd-a1c7aed0358b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.383214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce84c76-269d-42dc-9fcd-a1c7aed0358b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.384938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce84c76-269d-42dc-9fcd-a1c7aed0358b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.388364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce84c76-269d-42dc-9fcd-a1c7aed0358b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:13.394948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce84c76-269d-42dc-9fcd-a1c7aed0358b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:13.428061 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2298/4622] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:13.429267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175137e1-b395-40b9-9c1f-0bf30fa19167 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:13.452475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175137e1-b395-40b9-9c1f-0bf30fa19167 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:13.469364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e471-00cc-4fb7-baed-6afe9e8838da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:13.469796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e471-00cc-4fb7-baed-6afe9e8838da admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.470114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e471-00cc-4fb7-baed-6afe9e8838da admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.470398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7e471-00cc-4fb7-baed-6afe9e8838da admin admin] PATH_INFO: `/v3/projects/922a4b7960fc4a7cbbd909276dd8a267/users/c4dc288c6c6b42af826359296c15e594/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.522474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7e471-00cc-4fb7-baed-6afe9e8838da admin admin] RBAC: Authorizing `identity:create_grant(project_id=922a4b7960fc4a7cbbd909276dd8a267, user_id=c4dc288c6c6b42af826359296c15e594, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:13.525632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7e471-00cc-4fb7-baed-6afe9e8838da admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:13.564765 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2325/4623] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:13 2022] PUT /identity/v3/projects/922a4b7960fc4a7cbbd909276dd8a267/users/c4dc288c6c6b42af826359296c15e594/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:13.565957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce84c76-269d-42dc-9fcd-a1c7aed0358b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:13.586989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce84c76-269d-42dc-9fcd-a1c7aed0358b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:13.661453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:13.770761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85607db-69b7-4e32-b2e6-46cf2aac930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:13.771438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85607db-69b7-4e32-b2e6-46cf2aac930b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.771684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85607db-69b7-4e32-b2e6-46cf2aac930b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.773015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85607db-69b7-4e32-b2e6-46cf2aac930b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.774198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85607db-69b7-4e32-b2e6-46cf2aac930b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:13.788165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85607db-69b7-4e32-b2e6-46cf2aac930b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:13.818042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e471-00cc-4fb7-baed-6afe9e8838da admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:13.834230 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2299/4624] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:36:13.836751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7e471-00cc-4fb7-baed-6afe9e8838da admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:13.863075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d655115-fde8-488d-9fd3-72bab26bccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:13.863860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655115-fde8-488d-9fd3-72bab26bccbc admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:13.864144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655115-fde8-488d-9fd3-72bab26bccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:13.864418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d655115-fde8-488d-9fd3-72bab26bccbc admin admin] PATH_INFO: `/v3/projects/922a4b7960fc4a7cbbd909276dd8a267/users/c4dc288c6c6b42af826359296c15e594/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:13.876236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d655115-fde8-488d-9fd3-72bab26bccbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=922a4b7960fc4a7cbbd909276dd8a267, user_id=c4dc288c6c6b42af826359296c15e594, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:13.893531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d655115-fde8-488d-9fd3-72bab26bccbc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:14.000728 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2326/4625] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:13 2022] PUT /identity/v3/projects/922a4b7960fc4a7cbbd909276dd8a267/users/c4dc288c6c6b42af826359296c15e594/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:14.025675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a22d0-82c6-48c1-9634-6326acca8b3e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:14.028295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a22d0-82c6-48c1-9634-6326acca8b3e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:14.029203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a22d0-82c6-48c1-9634-6326acca8b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:14.110107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a68a22d0-82c6-48c1-9634-6326acca8b3e None None] MFA Rules not processed for user `c4dc288c6c6b42af826359296c15e594`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:14.112503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a68a22d0-82c6-48c1-9634-6326acca8b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:14.313741 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2300/4626] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:14 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:14.490309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d655115-fde8-488d-9fd3-72bab26bccbc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:14.493655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1d655115-fde8-488d-9fd3-72bab26bccbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:14.907500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d655115-fde8-488d-9fd3-72bab26bccbc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:14.918576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80544c4-48f2-4587-9c9e-b813050330db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:14.920154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80544c4-48f2-4587-9c9e-b813050330db service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:14.920866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80544c4-48f2-4587-9c9e-b813050330db service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:14.921603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80544c4-48f2-4587-9c9e-b813050330db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:15.170180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80544c4-48f2-4587-9c9e-b813050330db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:15.180253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80544c4-48f2-4587-9c9e-b813050330db service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:15.233178 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2327/4627] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:24.294319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=51 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:24.770252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a22d0-82c6-48c1-9634-6326acca8b3e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:24.772814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a68a22d0-82c6-48c1-9634-6326acca8b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:25.017489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a22d0-82c6-48c1-9634-6326acca8b3e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:25.027649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:25.029546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:25.030479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:25.031154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] PATH_INFO: `/v3/users/e5e536ba36df437f9611c808dcdc0539` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:25.034612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e536ba36df437f9611c808dcdc0539)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:25.040423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:25.203664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=69,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:25.211147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e536ba36df437f9611c808dcdc0539'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:25.240175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e536ba36df437f9611c808dcdc0539'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:25.290323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e536ba36df437f9611c808dcdc0539'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:25.320624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e536ba36df437f9611c808dcdc0539'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:25.321773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e1a952b9-e4ab-48e4-b0f5-42c69e64ddff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e536ba36df437f9611c808dcdc0539'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:25.370755 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2301/4628] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:24 2022] DELETE /identity/v3/users/e5e536ba36df437f9611c808dcdc0539 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:26.000137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80544c4-48f2-4587-9c9e-b813050330db service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:26.043270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80544c4-48f2-4587-9c9e-b813050330db service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:26.186382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307fc7a-f302-42a4-99c4-f0492f4588c7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:26.188977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307fc7a-f302-42a4-99c4-f0492f4588c7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:26.189545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307fc7a-f302-42a4-99c4-f0492f4588c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:26.217604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:26.218280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:26.218902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:26.219702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] PATH_INFO: `/v3/projects/0e6d691539884e368f15b71eeea6871c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:26.221620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6d691539884e368f15b71eeea6871c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:26.225361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:26.279052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0307fc7a-f302-42a4-99c4-f0492f4588c7 None None] MFA Rules not processed for user `c08bbaf86cc944dbaa12cc20224b0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:26.283745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0307fc7a-f302-42a4-99c4-f0492f4588c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:26.387589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6d691539884e368f15b71eeea6871c', 'request_id': 'req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:26.419739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6d691539884e368f15b71eeea6871c', 'request_id': 'req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:26.475429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6d691539884e368f15b71eeea6871c', 'request_id': 'req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:26.561228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] The token cache is being invalidate because project 0e6d691539884e368f15b71eeea6871c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:26.562731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:26.567371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fe4cb0d-7aac-4dd8-b325-b7fa0342c202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:26.571120 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2328/4629] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:25 2022] DELETE /identity/v3/projects/0e6d691539884e368f15b71eeea6871c => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:26.590947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede356c5-c214-47ea-a5fa-ee5604f26e92 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:26.600860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede356c5-c214-47ea-a5fa-ee5604f26e92 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:26.602258 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2302/4630] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:26.607388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede356c5-c214-47ea-a5fa-ee5604f26e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:26.628808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000891b6-e2a9-42aa-812b-ead39e504f9e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:26.629178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000891b6-e2a9-42aa-812b-ead39e504f9e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:26.629467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000891b6-e2a9-42aa-812b-ead39e504f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:26.771903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ede356c5-c214-47ea-a5fa-ee5604f26e92 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:26.776905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ede356c5-c214-47ea-a5fa-ee5604f26e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:26.789443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-000891b6-e2a9-42aa-812b-ead39e504f9e None None] MFA Rules not processed for user `c08bbaf86cc944dbaa12cc20224b0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:26.791346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-000891b6-e2a9-42aa-812b-ead39e504f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:26.839482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:27.054787 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2329/4631] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:27.055208 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2303/4632] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:27.063236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7497d-de8e-47a6-8ded-1eecd5100853 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:27.063811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7497d-de8e-47a6-8ded-1eecd5100853 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:27.064094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7497d-de8e-47a6-8ded-1eecd5100853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:27.077305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000891b6-e2a9-42aa-812b-ead39e504f9e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:27.079763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-000891b6-e2a9-42aa-812b-ead39e504f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:27.157125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-56c7497d-de8e-47a6-8ded-1eecd5100853 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:27.169440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-56c7497d-de8e-47a6-8ded-1eecd5100853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:27.222868 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2330/4633] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:27.228885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7497d-de8e-47a6-8ded-1eecd5100853 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:27.240350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7497d-de8e-47a6-8ded-1eecd5100853 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:27.270493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5bc9f-eccb-494e-a5d0-25c48a413fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:27.271208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5bc9f-eccb-494e-a5d0-25c48a413fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:27.271493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5bc9f-eccb-494e-a5d0-25c48a413fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:27.271758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5bc9f-eccb-494e-a5d0-25c48a413fa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:27.272503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5bc9f-eccb-494e-a5d0-25c48a413fa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:27.272821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5bc9f-eccb-494e-a5d0-25c48a413fa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:27.278583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5bc9f-eccb-494e-a5d0-25c48a413fa3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:27.315538 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2331/4634] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:36:27.321451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5bc9f-eccb-494e-a5d0-25c48a413fa3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:27.350651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5bc9f-eccb-494e-a5d0-25c48a413fa3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:27.375275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90f1a9-8818-4773-9b71-346ef1956ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:27.375972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f1a9-8818-4773-9b71-346ef1956ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:27.376481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f1a9-8818-4773-9b71-346ef1956ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:27.376821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90f1a9-8818-4773-9b71-346ef1956ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:27.377539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90f1a9-8818-4773-9b71-346ef1956ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:27.380846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90f1a9-8818-4773-9b71-346ef1956ae5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:27.423886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000891b6-e2a9-42aa-812b-ead39e504f9e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:27.440756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:27.448263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0e7f2-0efa-4fab-8f14-039f8d885aeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:27.452862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e7f2-0efa-4fab-8f14-039f8d885aeb service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:27.456044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e7f2-0efa-4fab-8f14-039f8d885aeb service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:27.458243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0e7f2-0efa-4fab-8f14-039f8d885aeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:27.501440 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2332/4635] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:27 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:27.501728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8b0e7f2-0efa-4fab-8f14-039f8d885aeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:27.506165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90f1a9-8818-4773-9b71-346ef1956ae5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:27.593862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0e7f2-0efa-4fab-8f14-039f8d885aeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:27.602952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0e7f2-0efa-4fab-8f14-039f8d885aeb service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:27.664268 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2304/4636] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:36:27.667631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0e7f2-0efa-4fab-8f14-039f8d885aeb service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:27.675088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8b0e7f2-0efa-4fab-8f14-039f8d885aeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:27.774570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90f1a9-8818-4773-9b71-346ef1956ae5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:27.789370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca53a-f2ba-41c1-aab0-34ec167b4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:27.790327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca53a-f2ba-41c1-aab0-34ec167b4625 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:27.790787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca53a-f2ba-41c1-aab0-34ec167b4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:27.791985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ca53a-f2ba-41c1-aab0-34ec167b4625 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:27.793805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca53a-f2ba-41c1-aab0-34ec167b4625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:27.808555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ca53a-f2ba-41c1-aab0-34ec167b4625 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:27.882271 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2333/4637] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:27 2022] POST /identity/v3/users => generated 287 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:27.886777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca53a-f2ba-41c1-aab0-34ec167b4625 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:27.945620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ca53a-f2ba-41c1-aab0-34ec167b4625 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:27.967615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5175-d6fe-4772-a972-955af3dbed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:27.968446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5175-d6fe-4772-a972-955af3dbed08 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:27.968733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5175-d6fe-4772-a972-955af3dbed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:27.969007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c5175-d6fe-4772-a972-955af3dbed08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:27.969863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c5175-d6fe-4772-a972-955af3dbed08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:27.974677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c5175-d6fe-4772-a972-955af3dbed08 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:28.013216 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2334/4638] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:28.013843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0e7f2-0efa-4fab-8f14-039f8d885aeb service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:28.017253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5175-d6fe-4772-a972-955af3dbed08 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:28.053235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c5175-d6fe-4772-a972-955af3dbed08 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:28.064693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b071b3f-175d-46bb-8819-0596829dc1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:28.066253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b071b3f-175d-46bb-8819-0596829dc1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:28.066253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b071b3f-175d-46bb-8819-0596829dc1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:28.066830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b071b3f-175d-46bb-8819-0596829dc1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:28.067268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b071b3f-175d-46bb-8819-0596829dc1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:28.069159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b071b3f-175d-46bb-8819-0596829dc1c4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:28.104920 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2335/4639] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:36:28.110863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b071b3f-175d-46bb-8819-0596829dc1c4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:28.133750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b071b3f-175d-46bb-8819-0596829dc1c4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:28.158054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126d916-cad3-4376-bf74-69726eaa33e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:28.159042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126d916-cad3-4376-bf74-69726eaa33e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:28.159677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126d916-cad3-4376-bf74-69726eaa33e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:28.161403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126d916-cad3-4376-bf74-69726eaa33e0 admin admin] PATH_INFO: `/v3/projects/bc7d3c04371441428df8b6b735b6f689/users/5204524ef91443cabc4fddab51972961/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:28.185176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17394362-b4ea-42d8-b977-8cd45be8bac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:28.186211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17394362-b4ea-42d8-b977-8cd45be8bac7 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:28.186390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17394362-b4ea-42d8-b977-8cd45be8bac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:28.186770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17394362-b4ea-42d8-b977-8cd45be8bac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:28.192163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-17394362-b4ea-42d8-b977-8cd45be8bac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:28.200748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126d916-cad3-4376-bf74-69726eaa33e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc7d3c04371441428df8b6b735b6f689, user_id=5204524ef91443cabc4fddab51972961, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:28.207686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d126d916-cad3-4376-bf74-69726eaa33e0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:28.218340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:28.240738 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2336/4640] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:28 2022] PUT /identity/v3/projects/bc7d3c04371441428df8b6b735b6f689/users/5204524ef91443cabc4fddab51972961/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:28.261133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee7b4-b0ea-4227-86ab-d3f0663d8e76 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:28.262579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee7b4-b0ea-4227-86ab-d3f0663d8e76 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:28.263362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee7b4-b0ea-4227-86ab-d3f0663d8e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:28.395489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5fdee7b4-b0ea-4227-86ab-d3f0663d8e76 None None] MFA Rules not processed for user `5204524ef91443cabc4fddab51972961`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:28.398672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5fdee7b4-b0ea-4227-86ab-d3f0663d8e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:28.493729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17394362-b4ea-42d8-b977-8cd45be8bac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:28.497759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17394362-b4ea-42d8-b977-8cd45be8bac7 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:28.550238 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2305/4641] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 885 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:28.628046 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2337/4642] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:28.642351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101acb27-6e43-423b-946f-519e73a9d626 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:28.642922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101acb27-6e43-423b-946f-519e73a9d626 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:28.643483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101acb27-6e43-423b-946f-519e73a9d626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:28.707314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-101acb27-6e43-423b-946f-519e73a9d626 None None] MFA Rules not processed for user `5204524ef91443cabc4fddab51972961`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:28.710712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-101acb27-6e43-423b-946f-519e73a9d626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:28.731776 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2306/4643] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:28.746548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdee7b4-b0ea-4227-86ab-d3f0663d8e76 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:28.748441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5fdee7b4-b0ea-4227-86ab-d3f0663d8e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:28.794628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:28.877937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdee7b4-b0ea-4227-86ab-d3f0663d8e76 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:28.888170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d548c7-9f51-4b95-a046-9a55e41ca40f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:28.889221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d548c7-9f51-4b95-a046-9a55e41ca40f service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:28.889619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d548c7-9f51-4b95-a046-9a55e41ca40f service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:28.890394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d548c7-9f51-4b95-a046-9a55e41ca40f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:28.906942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d548c7-9f51-4b95-a046-9a55e41ca40f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:28.910005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d548c7-9f51-4b95-a046-9a55e41ca40f service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:28.930829 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2338/4644] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:29.813541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8490461-e728-44e8-98e9-bf212f437f94 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:29.814383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8490461-e728-44e8-98e9-bf212f437f94 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:29.814383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8490461-e728-44e8-98e9-bf212f437f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:29.836321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d8490461-e728-44e8-98e9-bf212f437f94 None None] MFA Rules not processed for user `5204524ef91443cabc4fddab51972961`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:29.837651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d8490461-e728-44e8-98e9-bf212f437f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:29.870021 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2307/4645] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:37.010487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d548c7-9f51-4b95-a046-9a55e41ca40f service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:37.012953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-40d548c7-9f51-4b95-a046-9a55e41ca40f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:37.128018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d548c7-9f51-4b95-a046-9a55e41ca40f service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:37.133653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:37.134819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:37.135306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:37.135883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] PATH_INFO: `/v3/users/ea3e6c7f2764467d96c90a7e0d9db9cb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:37.138831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea3e6c7f2764467d96c90a7e0d9db9cb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:37.141503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:37.233453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea3e6c7f2764467d96c90a7e0d9db9cb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:37.234664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea3e6c7f2764467d96c90a7e0d9db9cb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:37.250108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea3e6c7f2764467d96c90a7e0d9db9cb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:37.278626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea3e6c7f2764467d96c90a7e0d9db9cb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:37.310502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea3e6c7f2764467d96c90a7e0d9db9cb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:37.342444 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2339/4646] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:37 2022] DELETE /identity/v3/users/ea3e6c7f2764467d96c90a7e0d9db9cb => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:37.345986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7feff-acf7-4eaf-b602-15639949ebd1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:37.347611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7feff-acf7-4eaf-b602-15639949ebd1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:37.349526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7feff-acf7-4eaf-b602-15639949ebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:37.442821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-03f7feff-acf7-4eaf-b602-15639949ebd1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:37.445554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-03f7feff-acf7-4eaf-b602-15639949ebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:37.637490 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2308/4647] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:37.662777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:37.672090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:37.846311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:37.951117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3c060-951a-4cac-bb65-5348b83834f4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:37.960182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649ffbe-2711-4d67-bee0-662f24beb386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:37.961528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649ffbe-2711-4d67-bee0-662f24beb386 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:37.962174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649ffbe-2711-4d67-bee0-662f24beb386 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:37.962744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649ffbe-2711-4d67-bee0-662f24beb386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:37.988799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649ffbe-2711-4d67-bee0-662f24beb386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:37.993949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649ffbe-2711-4d67-bee0-662f24beb386 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:38.021957 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2340/4648] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:38.795431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7feff-acf7-4eaf-b602-15639949ebd1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:38.798797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-03f7feff-acf7-4eaf-b602-15639949ebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:38.833352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7feff-acf7-4eaf-b602-15639949ebd1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:38.855421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:38.885996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:38.887172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:38.893953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] PATH_INFO: `/v3/projects/453ce0f999604b14b37d5adc9c0a9956` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:38.917262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=453ce0f999604b14b37d5adc9c0a9956)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:38.940435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:39.160139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453ce0f999604b14b37d5adc9c0a9956', 'request_id': 'req-69ae3636-ffc0-485f-99fa-734b5b936fa3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:39.205601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453ce0f999604b14b37d5adc9c0a9956', 'request_id': 'req-69ae3636-ffc0-485f-99fa-734b5b936fa3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:39.216993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453ce0f999604b14b37d5adc9c0a9956', 'request_id': 'req-69ae3636-ffc0-485f-99fa-734b5b936fa3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:39.251107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] The token cache is being invalidate because project 453ce0f999604b14b37d5adc9c0a9956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:39.252015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:39.255827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ae3636-ffc0-485f-99fa-734b5b936fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:39.261287 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2309/4649] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:38 2022] DELETE /identity/v3/projects/453ce0f999604b14b37d5adc9c0a9956 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:39.265220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649ffbe-2711-4d67-bee0-662f24beb386 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:39.291091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649ffbe-2711-4d67-bee0-662f24beb386 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:39.547347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:39.548180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:39.548504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:39.550408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] PATH_INFO: `/v3/users/c4dc288c6c6b42af826359296c15e594` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:39.552372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4dc288c6c6b42af826359296c15e594)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:39.556602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:39.651028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4dc288c6c6b42af826359296c15e594'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:39.652564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4dc288c6c6b42af826359296c15e594'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:39.665910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4dc288c6c6b42af826359296c15e594'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:39.681260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4dc288c6c6b42af826359296c15e594'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:39.700446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4dc288c6c6b42af826359296c15e594'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:39.724709 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2341/4650] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:36:39 2022] DELETE /identity/v3/users/c4dc288c6c6b42af826359296c15e594 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:40.585256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8e72-ab82-477e-a4e2-8bf9b3482ca8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:40.586760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8e72-ab82-477e-a4e2-8bf9b3482ca8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:40.587548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a8e72-ab82-477e-a4e2-8bf9b3482ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:40.637279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c14a8e72-ab82-477e-a4e2-8bf9b3482ca8 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:40.640431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c14a8e72-ab82-477e-a4e2-8bf9b3482ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:40.668019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:40.745979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:40.747273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:40.797637 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2310/4651] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:36:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:40.822969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8e72-ab82-477e-a4e2-8bf9b3482ca8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:40.824571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c14a8e72-ab82-477e-a4e2-8bf9b3482ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:40.875895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:40.913231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dfec9-a407-4113-8159-8ae730f68d9b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:40.927349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:40.928033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:40.928389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:40.928603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] PATH_INFO: `/v3/projects/922a4b7960fc4a7cbbd909276dd8a267` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:40.936973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922a4b7960fc4a7cbbd909276dd8a267)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:40.936973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:41.006271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922a4b7960fc4a7cbbd909276dd8a267', 'request_id': 'req-17bda9af-2a9e-45d2-a537-cd9afaf881f9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:41.014250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922a4b7960fc4a7cbbd909276dd8a267', 'request_id': 'req-17bda9af-2a9e-45d2-a537-cd9afaf881f9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:41.016303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a8e72-ab82-477e-a4e2-8bf9b3482ca8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:41.030189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922a4b7960fc4a7cbbd909276dd8a267', 'request_id': 'req-17bda9af-2a9e-45d2-a537-cd9afaf881f9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:41.056568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] The token cache is being invalidate because project 922a4b7960fc4a7cbbd909276dd8a267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:36:41.057178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:41.059092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17bda9af-2a9e-45d2-a537-cd9afaf881f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:36:41.062022 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2342/4652] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:36:40 2022] DELETE /identity/v3/projects/922a4b7960fc4a7cbbd909276dd8a267 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:41.069959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea797e07-93c1-43cb-8eab-4911006ad61f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:41.070795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea797e07-93c1-43cb-8eab-4911006ad61f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:41.071626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea797e07-93c1-43cb-8eab-4911006ad61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:41.110437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ea797e07-93c1-43cb-8eab-4911006ad61f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:41.111948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ea797e07-93c1-43cb-8eab-4911006ad61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:41.148467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769cde6-00cf-4cde-9306-406e3a133f70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:41.149220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769cde6-00cf-4cde-9306-406e3a133f70 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:41.149496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769cde6-00cf-4cde-9306-406e3a133f70 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:41.149828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769cde6-00cf-4cde-9306-406e3a133f70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:41.152608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a769cde6-00cf-4cde-9306-406e3a133f70 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:41.230907 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2343/4653] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:41.235705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736b6c6-d618-4961-90dc-49494bdac1ea None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:41.235968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736b6c6-d618-4961-90dc-49494bdac1ea None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:41.236275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769cde6-00cf-4cde-9306-406e3a133f70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:41.237411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736b6c6-d618-4961-90dc-49494bdac1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:41.238427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769cde6-00cf-4cde-9306-406e3a133f70 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:41.273729 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2311/4654] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:36:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:41.284896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d736b6c6-d618-4961-90dc-49494bdac1ea None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:41.285936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d736b6c6-d618-4961-90dc-49494bdac1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:41.321649 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2344/4655] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:41.335715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769cde6-00cf-4cde-9306-406e3a133f70 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:41.351009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:41.363631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769cde6-00cf-4cde-9306-406e3a133f70 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:41.375562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c63e7-3b1e-4065-b1bf-06a2fcdd7549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:41.376739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c63e7-3b1e-4065-b1bf-06a2fcdd7549 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:41.377300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c63e7-3b1e-4065-b1bf-06a2fcdd7549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:41.378027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c63e7-3b1e-4065-b1bf-06a2fcdd7549 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:41.379702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c63e7-3b1e-4065-b1bf-06a2fcdd7549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:36:41.380305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c63e7-3b1e-4065-b1bf-06a2fcdd7549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:41.383921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c63e7-3b1e-4065-b1bf-06a2fcdd7549 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:41.417121 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2312/4656] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:36:41.418065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736b6c6-d618-4961-90dc-49494bdac1ea None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:41.430496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736b6c6-d618-4961-90dc-49494bdac1ea None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:41.441518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f78d9-add3-4ccf-8e4a-46ee340636a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:41.442322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f78d9-add3-4ccf-8e4a-46ee340636a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:41.443167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f78d9-add3-4ccf-8e4a-46ee340636a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:41.443732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f78d9-add3-4ccf-8e4a-46ee340636a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:41.444575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f78d9-add3-4ccf-8e4a-46ee340636a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:41.447192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f78d9-add3-4ccf-8e4a-46ee340636a7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:41.491403 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2345/4657] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:41 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:41.498665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c63e7-3b1e-4065-b1bf-06a2fcdd7549 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:41.525603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c63e7-3b1e-4065-b1bf-06a2fcdd7549 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:41.732006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4664f-859c-484f-8b36-50edb6a92552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:41.736256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4664f-859c-484f-8b36-50edb6a92552 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:41.738724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4664f-859c-484f-8b36-50edb6a92552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:41.739844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4664f-859c-484f-8b36-50edb6a92552 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:41.743463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4664f-859c-484f-8b36-50edb6a92552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:41.755083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4664f-859c-484f-8b36-50edb6a92552 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:41.831493 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2313/4658] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:41 2022] POST /identity/v3/users => generated 292 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:41.837309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f78d9-add3-4ccf-8e4a-46ee340636a7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:41.867094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f78d9-add3-4ccf-8e4a-46ee340636a7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:41.887571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f6b5-9638-4d6d-a896-4d6abd6eee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:41.888329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f6b5-9638-4d6d-a896-4d6abd6eee84 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:41.888804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f6b5-9638-4d6d-a896-4d6abd6eee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:41.889198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f6b5-9638-4d6d-a896-4d6abd6eee84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:41.890238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f6b5-9638-4d6d-a896-4d6abd6eee84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:41.896692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f6b5-9638-4d6d-a896-4d6abd6eee84 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:41.918981 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2346/4659] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:41.926178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4664f-859c-484f-8b36-50edb6a92552 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:41.951621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4664f-859c-484f-8b36-50edb6a92552 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:41.968081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eee6f-2bd7-4662-bca1-d1a5cfaee457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:41.968434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eee6f-2bd7-4662-bca1-d1a5cfaee457 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:41.969045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eee6f-2bd7-4662-bca1-d1a5cfaee457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:41.970292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eee6f-2bd7-4662-bca1-d1a5cfaee457 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:41.971558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eee6f-2bd7-4662-bca1-d1a5cfaee457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:41.974175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6eee6f-2bd7-4662-bca1-d1a5cfaee457 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:41.997649 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2314/4660] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:36:42.005983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f6b5-9638-4d6d-a896-4d6abd6eee84 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:42.033388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f6b5-9638-4d6d-a896-4d6abd6eee84 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:42.044953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6a0c4-a29b-4215-b0bf-dbbd532abb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:42.047461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a0c4-a29b-4215-b0bf-dbbd532abb16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:42.047932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a0c4-a29b-4215-b0bf-dbbd532abb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:42.048624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6a0c4-a29b-4215-b0bf-dbbd532abb16 admin admin] PATH_INFO: `/v3/projects/e610821025df4db283c0bada512115ec/users/dde39d71ddf04547bf8411bdaeac4911/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:42.109740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6a0c4-a29b-4215-b0bf-dbbd532abb16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e610821025df4db283c0bada512115ec, user_id=dde39d71ddf04547bf8411bdaeac4911, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:42.124316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6a0c4-a29b-4215-b0bf-dbbd532abb16 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:42.210146 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2347/4661] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:42 2022] PUT /identity/v3/projects/e610821025df4db283c0bada512115ec/users/dde39d71ddf04547bf8411bdaeac4911/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:42.224120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10887c5b-0a1d-4355-bc2c-a63043bfab48 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:42.224419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10887c5b-0a1d-4355-bc2c-a63043bfab48 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:42.224835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10887c5b-0a1d-4355-bc2c-a63043bfab48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:42.280129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-10887c5b-0a1d-4355-bc2c-a63043bfab48 None None] MFA Rules not processed for user `dde39d71ddf04547bf8411bdaeac4911`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:42.284947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-10887c5b-0a1d-4355-bc2c-a63043bfab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:42.318362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5b4ca-24d8-4352-b345-78168e857cec None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:42.318835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5b4ca-24d8-4352-b345-78168e857cec None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:42.319312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5b4ca-24d8-4352-b345-78168e857cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:42.366783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-faf5b4ca-24d8-4352-b345-78168e857cec None None] MFA Rules not processed for user `156adbbf6e3b4111b49b7e6e17b9825d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:42.369503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-faf5b4ca-24d8-4352-b345-78168e857cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:42.382200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:42.403909 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2315/4662] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:42.409903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10887c5b-0a1d-4355-bc2c-a63043bfab48 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:42.468486 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2348/4663] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:42.543321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10887c5b-0a1d-4355-bc2c-a63043bfab48 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:42.552364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73df112-03fe-47ac-9f97-5aedb5d30c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:42.553124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73df112-03fe-47ac-9f97-5aedb5d30c1c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:42.553445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73df112-03fe-47ac-9f97-5aedb5d30c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:42.553732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73df112-03fe-47ac-9f97-5aedb5d30c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:42.556361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73df112-03fe-47ac-9f97-5aedb5d30c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:42.558942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73df112-03fe-47ac-9f97-5aedb5d30c1c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:42.564466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:42.607782 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2316/4664] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:36:42 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:36:42.615717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5b4ca-24d8-4352-b345-78168e857cec None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:42.645538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5b4ca-24d8-4352-b345-78168e857cec None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:42.736853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c3670-c727-42c0-b3c5-e2c6a437db96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:42.738160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c3670-c727-42c0-b3c5-e2c6a437db96 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:42.739380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c3670-c727-42c0-b3c5-e2c6a437db96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:42.739380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c3670-c727-42c0-b3c5-e2c6a437db96 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:42.739784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c3670-c727-42c0-b3c5-e2c6a437db96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:42.742967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c3670-c727-42c0-b3c5-e2c6a437db96 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:42.786441 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2349/4665] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:36:42 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:36:42.786697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73df112-03fe-47ac-9f97-5aedb5d30c1c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:42.808818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73df112-03fe-47ac-9f97-5aedb5d30c1c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:42.817353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35116d3-d3e2-4867-99fb-f63c26d6aec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:42.818328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35116d3-d3e2-4867-99fb-f63c26d6aec9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:42.818628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35116d3-d3e2-4867-99fb-f63c26d6aec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:42.818878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35116d3-d3e2-4867-99fb-f63c26d6aec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:42.819566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35116d3-d3e2-4867-99fb-f63c26d6aec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:42.821237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35116d3-d3e2-4867-99fb-f63c26d6aec9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:42.836429 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2317/4666] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:42.842662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c3670-c727-42c0-b3c5-e2c6a437db96 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:42.855312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c3670-c727-42c0-b3c5-e2c6a437db96 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:42.862775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1cb9c-bdf9-4e16-b920-4bb07ec566df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:42.863733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1cb9c-bdf9-4e16-b920-4bb07ec566df admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:42.864912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1cb9c-bdf9-4e16-b920-4bb07ec566df admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:42.864912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1cb9c-bdf9-4e16-b920-4bb07ec566df admin admin] PATH_INFO: `/v3/projects/f920514eea444784bd36d6a5fa127884/users/f9243ed15ed742ddb3afd52553eb4e83/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:42.887155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1cb9c-bdf9-4e16-b920-4bb07ec566df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f920514eea444784bd36d6a5fa127884, user_id=f9243ed15ed742ddb3afd52553eb4e83, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:42.890418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1cb9c-bdf9-4e16-b920-4bb07ec566df admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:42.926293 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2350/4667] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:42 2022] PUT /identity/v3/projects/f920514eea444784bd36d6a5fa127884/users/f9243ed15ed742ddb3afd52553eb4e83/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:36:42.929120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35116d3-d3e2-4867-99fb-f63c26d6aec9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:42.968162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35116d3-d3e2-4867-99fb-f63c26d6aec9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:43.082697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d986d-ecc6-4a5f-8f6e-4f5b85d8e9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:43.082697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d986d-ecc6-4a5f-8f6e-4f5b85d8e9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:43.082697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d986d-ecc6-4a5f-8f6e-4f5b85d8e9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:43.083298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d986d-ecc6-4a5f-8f6e-4f5b85d8e9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:43.084507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d986d-ecc6-4a5f-8f6e-4f5b85d8e9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:43.087998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d986d-ecc6-4a5f-8f6e-4f5b85d8e9b8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:43.114595 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2318/4668] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:36:43.116508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1cb9c-bdf9-4e16-b920-4bb07ec566df admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:43.165749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1cb9c-bdf9-4e16-b920-4bb07ec566df admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:43.185319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea42b-6a74-4fe2-b380-a5d87f325d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:43.186520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea42b-6a74-4fe2-b380-a5d87f325d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:43.187116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea42b-6a74-4fe2-b380-a5d87f325d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:43.187571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea42b-6a74-4fe2-b380-a5d87f325d02 admin admin] PATH_INFO: `/v3/projects/f920514eea444784bd36d6a5fa127884/users/f9243ed15ed742ddb3afd52553eb4e83/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:43.192059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea42b-6a74-4fe2-b380-a5d87f325d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f920514eea444784bd36d6a5fa127884, user_id=f9243ed15ed742ddb3afd52553eb4e83, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:43.199178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea42b-6a74-4fe2-b380-a5d87f325d02 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:43.226902 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2351/4669] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:36:43 2022] PUT /identity/v3/projects/f920514eea444784bd36d6a5fa127884/users/f9243ed15ed742ddb3afd52553eb4e83/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:36:43.245255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494340d3-ce72-410c-9b2e-7f21ae157518 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:43.245744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494340d3-ce72-410c-9b2e-7f21ae157518 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:43.246269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494340d3-ce72-410c-9b2e-7f21ae157518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:43.341459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-494340d3-ce72-410c-9b2e-7f21ae157518 None None] MFA Rules not processed for user `f9243ed15ed742ddb3afd52553eb4e83`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:43.343631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-494340d3-ce72-410c-9b2e-7f21ae157518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:43.482878 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2319/4670] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:43.508318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea42b-6a74-4fe2-b380-a5d87f325d02 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:43.511245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-665ea42b-6a74-4fe2-b380-a5d87f325d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:43.612126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea42b-6a74-4fe2-b380-a5d87f325d02 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:43.617208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff7ed-9e0d-475a-8a3c-8ac0dc03485a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:43.618067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff7ed-9e0d-475a-8a3c-8ac0dc03485a service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:43.618411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff7ed-9e0d-475a-8a3c-8ac0dc03485a service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:43.618748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff7ed-9e0d-475a-8a3c-8ac0dc03485a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:43.696999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:43.759570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff7ed-9e0d-475a-8a3c-8ac0dc03485a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:43.761749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ff7ed-9e0d-475a-8a3c-8ac0dc03485a service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:43.791171 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2352/4671] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:44.675267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494340d3-ce72-410c-9b2e-7f21ae157518 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:44.676679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-494340d3-ce72-410c-9b2e-7f21ae157518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:44.700777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494340d3-ce72-410c-9b2e-7f21ae157518 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:44.715203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595690fb-b820-4b12-888f-990828020f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:44.716385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595690fb-b820-4b12-888f-990828020f5b service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:44.717148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595690fb-b820-4b12-888f-990828020f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:44.719676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595690fb-b820-4b12-888f-990828020f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:44.785774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595690fb-b820-4b12-888f-990828020f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:44.808527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595690fb-b820-4b12-888f-990828020f5b service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:44.885811 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2320/4672] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:36:48.480359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff7ed-9e0d-475a-8a3c-8ac0dc03485a service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:48.482640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e58ff7ed-9e0d-475a-8a3c-8ac0dc03485a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:48.677576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff7ed-9e0d-475a-8a3c-8ac0dc03485a service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:48.686672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0fce0-5e8f-4b6a-aaab-6d8fc486cd73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:48.687916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0fce0-5e8f-4b6a-aaab-6d8fc486cd73 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:48.688249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0fce0-5e8f-4b6a-aaab-6d8fc486cd73 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:48.688706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0fce0-5e8f-4b6a-aaab-6d8fc486cd73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:48.691735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f6e0fce0-5e8f-4b6a-aaab-6d8fc486cd73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:48.714104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0fce0-5e8f-4b6a-aaab-6d8fc486cd73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:48.716482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0fce0-5e8f-4b6a-aaab-6d8fc486cd73 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:48.753184 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2353/4673] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:49.676639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595690fb-b820-4b12-888f-990828020f5b service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:49.691940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-595690fb-b820-4b12-888f-990828020f5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:49.824036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:49.877314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595690fb-b820-4b12-888f-990828020f5b service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:49.892822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27f67-eddb-4b86-a986-95b86012e3d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:49.897516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27f67-eddb-4b86-a986-95b86012e3d1 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:49.898168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27f67-eddb-4b86-a986-95b86012e3d1 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:49.898508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d27f67-eddb-4b86-a986-95b86012e3d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:49.902376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d1d27f67-eddb-4b86-a986-95b86012e3d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:49.932725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d27f67-eddb-4b86-a986-95b86012e3d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:49.934986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d27f67-eddb-4b86-a986-95b86012e3d1 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:49.972747 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2321/4674] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:51.558040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dac6e9-23e8-4232-9705-5c1c21788cfb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:51.558902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dac6e9-23e8-4232-9705-5c1c21788cfb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:51.559156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dac6e9-23e8-4232-9705-5c1c21788cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:51.582151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-14dac6e9-23e8-4232-9705-5c1c21788cfb None None] MFA Rules not processed for user `c08bbaf86cc944dbaa12cc20224b0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:51.583568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-14dac6e9-23e8-4232-9705-5c1c21788cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:51.685831 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2354/4675] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:52.325834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27f67-eddb-4b86-a986-95b86012e3d1 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:52.350164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d27f67-eddb-4b86-a986-95b86012e3d1 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:52.355339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39f08-a808-497b-aa54-6cd834dae568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:52.356498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39f08-a808-497b-aa54-6cd834dae568 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:52.359490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39f08-a808-497b-aa54-6cd834dae568 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:52.360441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39f08-a808-497b-aa54-6cd834dae568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:52.363868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a9f39f08-a808-497b-aa54-6cd834dae568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:52.401489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39f08-a808-497b-aa54-6cd834dae568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:52.406023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39f08-a808-497b-aa54-6cd834dae568 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:52.431627 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2322/4676] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:54.066261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dac6e9-23e8-4232-9705-5c1c21788cfb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:54.069063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-14dac6e9-23e8-4232-9705-5c1c21788cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:54.103347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ce837-45bf-4f4b-96bc-1971e7807537 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:54.103916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ce837-45bf-4f4b-96bc-1971e7807537 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:54.103916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ce837-45bf-4f4b-96bc-1971e7807537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:54.105945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dac6e9-23e8-4232-9705-5c1c21788cfb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:54.113347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024c7f1-5003-48f7-8c08-b06817345181 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:54.114671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c7f1-5003-48f7-8c08-b06817345181 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:54.115027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c7f1-5003-48f7-8c08-b06817345181 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:54.115412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024c7f1-5003-48f7-8c08-b06817345181 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:54.119338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4024c7f1-5003-48f7-8c08-b06817345181 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:54.135447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-239ce837-45bf-4f4b-96bc-1971e7807537 None None] MFA Rules not processed for user `c08bbaf86cc944dbaa12cc20224b0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:54.136950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-239ce837-45bf-4f4b-96bc-1971e7807537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:54.142883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024c7f1-5003-48f7-8c08-b06817345181 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:54.145751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4024c7f1-5003-48f7-8c08-b06817345181 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:54.154851 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2323/4677] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:36:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:54.165415 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2355/4678] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:55.496640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a62b-39db-47c6-85e9-aa969f993a86 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:55.497592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a62b-39db-47c6-85e9-aa969f993a86 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:55.498081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812a62b-39db-47c6-85e9-aa969f993a86 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:55.499908 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2324/4679] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 04:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:36:55.506510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7fbbf-e0d5-40fc-a7e0-43c04f8ba33f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:55.507070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7fbbf-e0d5-40fc-a7e0-43c04f8ba33f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:55.507070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7fbbf-e0d5-40fc-a7e0-43c04f8ba33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:55.561384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cac7fbbf-e0d5-40fc-a7e0-43c04f8ba33f None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:36:55.562861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cac7fbbf-e0d5-40fc-a7e0-43c04f8ba33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:55.574144 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2356/4680] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:36:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:36:55.609923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812a62b-39db-47c6-85e9-aa969f993a86 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:55.635611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812a62b-39db-47c6-85e9-aa969f993a86 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:55.646840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720738a5-cc92-4d4a-96a8-c0a85f843d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:55.648690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720738a5-cc92-4d4a-96a8-c0a85f843d1e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:55.649092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720738a5-cc92-4d4a-96a8-c0a85f843d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:55.649378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720738a5-cc92-4d4a-96a8-c0a85f843d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:55.675034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720738a5-cc92-4d4a-96a8-c0a85f843d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:55.676691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720738a5-cc92-4d4a-96a8-c0a85f843d1e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:55.692386 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2325/4681] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:36:57.860370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7fbbf-e0d5-40fc-a7e0-43c04f8ba33f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:36:57.884621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7fbbf-e0d5-40fc-a7e0-43c04f8ba33f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:36:57.898987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28157297-042a-4aeb-a977-f8889c85cda0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:36:57.899998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157297-042a-4aeb-a977-f8889c85cda0 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:36:57.900448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157297-042a-4aeb-a977-f8889c85cda0 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:36:57.900879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28157297-042a-4aeb-a977-f8889c85cda0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:36:57.903169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-28157297-042a-4aeb-a977-f8889c85cda0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:36:57.919620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28157297-042a-4aeb-a977-f8889c85cda0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:36:57.921624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28157297-042a-4aeb-a977-f8889c85cda0 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:36:57.940010 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2357/4682] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:36:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:02.144307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720738a5-cc92-4d4a-96a8-c0a85f843d1e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:02.265456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720738a5-cc92-4d4a-96a8-c0a85f843d1e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:02.275049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:02.276347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:02.277129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:02.277640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] PATH_INFO: `/v3/users/dde39d71ddf04547bf8411bdaeac4911` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:02.279957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde39d71ddf04547bf8411bdaeac4911)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:02.282975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:02.375870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde39d71ddf04547bf8411bdaeac4911'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:02.390546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde39d71ddf04547bf8411bdaeac4911'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:02.406611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde39d71ddf04547bf8411bdaeac4911'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:02.420805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde39d71ddf04547bf8411bdaeac4911'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:02.430460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde39d71ddf04547bf8411bdaeac4911'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:02.441515 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2326/4683] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:02 2022] DELETE /identity/v3/users/dde39d71ddf04547bf8411bdaeac4911 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:02.442968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50228d06-507d-41bb-8981-b107f377be5b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:02.443415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50228d06-507d-41bb-8981-b107f377be5b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:02.443495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50228d06-507d-41bb-8981-b107f377be5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:02.482242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-50228d06-507d-41bb-8981-b107f377be5b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:02.483475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-50228d06-507d-41bb-8981-b107f377be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:02.498550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:02.569296 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2358/4684] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:02.580998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:02.582643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:02.612272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:02.711646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcf32f-269a-48d8-977b-539b4ea20d06 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:02.725915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaf527-b81f-4a34-97c2-e4019f7720db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:02.732896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaf527-b81f-4a34-97c2-e4019f7720db service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:02.732896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaf527-b81f-4a34-97c2-e4019f7720db service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:02.732896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaf527-b81f-4a34-97c2-e4019f7720db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:02.759032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaf527-b81f-4a34-97c2-e4019f7720db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:02.762666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaf527-b81f-4a34-97c2-e4019f7720db service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:02.800503 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2327/4685] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:03.344789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50228d06-507d-41bb-8981-b107f377be5b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:03.346678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-50228d06-507d-41bb-8981-b107f377be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:03.367320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50228d06-507d-41bb-8981-b107f377be5b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:03.373580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:03.374620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:03.375125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:03.375609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] PATH_INFO: `/v3/projects/e610821025df4db283c0bada512115ec` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:03.377296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e610821025df4db283c0bada512115ec)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:03.389636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:03.467174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e610821025df4db283c0bada512115ec', 'request_id': 'req-8e4f567d-9be0-46c6-8b29-ee8912f496cc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:03.475971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e610821025df4db283c0bada512115ec', 'request_id': 'req-8e4f567d-9be0-46c6-8b29-ee8912f496cc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:03.487223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e610821025df4db283c0bada512115ec', 'request_id': 'req-8e4f567d-9be0-46c6-8b29-ee8912f496cc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:03.505307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] The token cache is being invalidate because project e610821025df4db283c0bada512115ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:03.505621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:03.509652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:03.509652 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2359/4686] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:03 2022] DELETE /identity/v3/projects/e610821025df4db283c0bada512115ec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:03.512393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaf527-b81f-4a34-97c2-e4019f7720db service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:03.528735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaf527-b81f-4a34-97c2-e4019f7720db service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:03.630003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:03.631000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:03.631268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:03.631531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] PATH_INFO: `/v3/users/f9243ed15ed742ddb3afd52553eb4e83` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:03.632754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9243ed15ed742ddb3afd52553eb4e83)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:03.634842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:03.705269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9243ed15ed742ddb3afd52553eb4e83'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:03.713102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9243ed15ed742ddb3afd52553eb4e83'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:03.730862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9243ed15ed742ddb3afd52553eb4e83'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:03.742250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9243ed15ed742ddb3afd52553eb4e83'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:03.742927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-213cdd2e-9278-4dfd-9b61-395bc73a7890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9243ed15ed742ddb3afd52553eb4e83'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:03.750162 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2328/4687] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:03 2022] DELETE /identity/v3/users/f9243ed15ed742ddb3afd52553eb4e83 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:03.974625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:03.976384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:03.992783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f567d-9be0-46c6-8b29-ee8912f496cc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:04.118325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:04.118983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:04.119449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:04.119883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] PATH_INFO: `/v3/projects/f920514eea444784bd36d6a5fa127884` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:04.121301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f920514eea444784bd36d6a5fa127884)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:04.125016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:04.216099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:04.230515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f920514eea444784bd36d6a5fa127884', 'request_id': 'req-823fdb23-3471-4697-99e0-e72d33918411'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:04.239736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f920514eea444784bd36d6a5fa127884', 'request_id': 'req-823fdb23-3471-4697-99e0-e72d33918411'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:04.255181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f920514eea444784bd36d6a5fa127884', 'request_id': 'req-823fdb23-3471-4697-99e0-e72d33918411'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:04.271639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] The token cache is being invalidate because project f920514eea444784bd36d6a5fa127884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:04.272394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:04.273371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-823fdb23-3471-4697-99e0-e72d33918411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:04.276725 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2360/4688] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:03 2022] DELETE /identity/v3/projects/f920514eea444784bd36d6a5fa127884 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:04.282579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b532-e907-4ca6-9f5d-22c88a95f7a6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:04.283172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b532-e907-4ca6-9f5d-22c88a95f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:04.283634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971b532-e907-4ca6-9f5d-22c88a95f7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:04.328110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8971b532-e907-4ca6-9f5d-22c88a95f7a6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:04.329679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8971b532-e907-4ca6-9f5d-22c88a95f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:04.406624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:04.476807 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2329/4689] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:04.485546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fb3eb-2b2d-4b4f-aa93-3b2e9ab9ab83 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:04.486211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fb3eb-2b2d-4b4f-aa93-3b2e9ab9ab83 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:04.486340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fb3eb-2b2d-4b4f-aa93-3b2e9ab9ab83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:04.508424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-306fb3eb-2b2d-4b4f-aa93-3b2e9ab9ab83 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:04.509688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-306fb3eb-2b2d-4b4f-aa93-3b2e9ab9ab83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:04.517694 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2361/4690] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:04.522196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971b532-e907-4ca6-9f5d-22c88a95f7a6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:04.532787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971b532-e907-4ca6-9f5d-22c88a95f7a6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:04.537671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e6999-cd63-42ae-be90-4945bcbb8824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:04.538335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e6999-cd63-42ae-be90-4945bcbb8824 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:04.538656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e6999-cd63-42ae-be90-4945bcbb8824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:04.538909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e6999-cd63-42ae-be90-4945bcbb8824 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:04.539560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e6999-cd63-42ae-be90-4945bcbb8824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:04.539852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e6999-cd63-42ae-be90-4945bcbb8824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:04.541488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e6999-cd63-42ae-be90-4945bcbb8824 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:04.555543 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2330/4691] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:37:04.560102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fb3eb-2b2d-4b4f-aa93-3b2e9ab9ab83 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:04.569801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fb3eb-2b2d-4b4f-aa93-3b2e9ab9ab83 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:04.588994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea6dfc-eb44-41c7-b138-39ed507de2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:04.589704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea6dfc-eb44-41c7-b138-39ed507de2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:04.590028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea6dfc-eb44-41c7-b138-39ed507de2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:04.590301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea6dfc-eb44-41c7-b138-39ed507de2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:04.591066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea6dfc-eb44-41c7-b138-39ed507de2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:04.593146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea6dfc-eb44-41c7-b138-39ed507de2c0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:04.659434 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2362/4692] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:04 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:04.659654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e6999-cd63-42ae-be90-4945bcbb8824 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:04.672923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e6999-cd63-42ae-be90-4945bcbb8824 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:04.769417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a8aea-da8d-416a-8d1a-b2636bb34926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:04.770375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a8aea-da8d-416a-8d1a-b2636bb34926 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:04.770811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a8aea-da8d-416a-8d1a-b2636bb34926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:04.771263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a8aea-da8d-416a-8d1a-b2636bb34926 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:04.772286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a8aea-da8d-416a-8d1a-b2636bb34926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:04.774563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a8aea-da8d-416a-8d1a-b2636bb34926 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:04.813842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea6dfc-eb44-41c7-b138-39ed507de2c0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:04.821991 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2331/4693] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:04 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:04.834763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea6dfc-eb44-41c7-b138-39ed507de2c0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:04.840744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5c3e5-9674-4b0d-93e6-30b6abf4011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:04.841369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5c3e5-9674-4b0d-93e6-30b6abf4011c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:04.841651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5c3e5-9674-4b0d-93e6-30b6abf4011c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:04.841955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5c3e5-9674-4b0d-93e6-30b6abf4011c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:04.842679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5c3e5-9674-4b0d-93e6-30b6abf4011c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:04.844569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5c3e5-9674-4b0d-93e6-30b6abf4011c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:04.856619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2363/4694] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:04.860753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a8aea-da8d-416a-8d1a-b2636bb34926 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:04.878714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a8aea-da8d-416a-8d1a-b2636bb34926 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:04.883958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b4e0b-aec7-493d-8e0c-ad1d33dce75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:04.884573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4e0b-aec7-493d-8e0c-ad1d33dce75b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:04.884853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4e0b-aec7-493d-8e0c-ad1d33dce75b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:04.885147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b4e0b-aec7-493d-8e0c-ad1d33dce75b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:04.885793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b4e0b-aec7-493d-8e0c-ad1d33dce75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:04.887484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b4e0b-aec7-493d-8e0c-ad1d33dce75b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:04.899750 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2332/4695] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:04.904325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5c3e5-9674-4b0d-93e6-30b6abf4011c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:04.915344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5c3e5-9674-4b0d-93e6-30b6abf4011c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:04.920780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35113d65-bb0f-48c6-be5e-1d3a74720e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:04.921526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113d65-bb0f-48c6-be5e-1d3a74720e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:04.921901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113d65-bb0f-48c6-be5e-1d3a74720e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:04.922239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35113d65-bb0f-48c6-be5e-1d3a74720e0d admin admin] PATH_INFO: `/v3/projects/7280b24a18eb44e8b6696200148f2239/users/3e14014b0314462d885a4c84bb207920/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:04.940363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35113d65-bb0f-48c6-be5e-1d3a74720e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7280b24a18eb44e8b6696200148f2239, user_id=3e14014b0314462d885a4c84bb207920, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:04.942885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35113d65-bb0f-48c6-be5e-1d3a74720e0d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:04.961403 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2364/4696] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:04 2022] PUT /identity/v3/projects/7280b24a18eb44e8b6696200148f2239/users/3e14014b0314462d885a4c84bb207920/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:04.976444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff45d5-26dd-4cac-9ba4-f88fee63df51 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:04.976845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff45d5-26dd-4cac-9ba4-f88fee63df51 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:04.977417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff45d5-26dd-4cac-9ba4-f88fee63df51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:05.019007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-17ff45d5-26dd-4cac-9ba4-f88fee63df51 None None] MFA Rules not processed for user `3e14014b0314462d885a4c84bb207920`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:05.020265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-17ff45d5-26dd-4cac-9ba4-f88fee63df51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:05.110160 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2333/4697] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:05.115118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35113d65-bb0f-48c6-be5e-1d3a74720e0d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:05.193275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35113d65-bb0f-48c6-be5e-1d3a74720e0d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:05.199625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8c9ee-c790-4eba-aa56-d1bf664e7037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:05.200274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8c9ee-c790-4eba-aa56-d1bf664e7037 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:05.200555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8c9ee-c790-4eba-aa56-d1bf664e7037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:05.200865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8c9ee-c790-4eba-aa56-d1bf664e7037 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:05.201674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8c9ee-c790-4eba-aa56-d1bf664e7037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:05.203693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8c9ee-c790-4eba-aa56-d1bf664e7037 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:05.235209 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2365/4698] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:05 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:05.239444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff45d5-26dd-4cac-9ba4-f88fee63df51 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:05.251905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff45d5-26dd-4cac-9ba4-f88fee63df51 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:05.289149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:05.345279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff9aca-784d-410a-87ed-4a4ca8e1ef20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:05.346212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff9aca-784d-410a-87ed-4a4ca8e1ef20 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:05.346499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff9aca-784d-410a-87ed-4a4ca8e1ef20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:05.346797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff9aca-784d-410a-87ed-4a4ca8e1ef20 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:05.347444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff9aca-784d-410a-87ed-4a4ca8e1ef20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:05.350196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff9aca-784d-410a-87ed-4a4ca8e1ef20 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:05.384689 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2334/4699] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:05 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:05.389488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8c9ee-c790-4eba-aa56-d1bf664e7037 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:05.402989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8c9ee-c790-4eba-aa56-d1bf664e7037 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:05.411248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79730de7-d772-4393-a494-91ea2914cac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:05.411643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79730de7-d772-4393-a494-91ea2914cac7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:05.412144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79730de7-d772-4393-a494-91ea2914cac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:05.412396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79730de7-d772-4393-a494-91ea2914cac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:05.413060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79730de7-d772-4393-a494-91ea2914cac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:05.414756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79730de7-d772-4393-a494-91ea2914cac7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:05.428620 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2366/4700] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:05.433814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff9aca-784d-410a-87ed-4a4ca8e1ef20 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:05.453364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff9aca-784d-410a-87ed-4a4ca8e1ef20 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:05.460790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be860159-6a0d-476b-a857-43cc0682d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:05.461586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be860159-6a0d-476b-a857-43cc0682d78d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:05.461934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be860159-6a0d-476b-a857-43cc0682d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:05.462269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be860159-6a0d-476b-a857-43cc0682d78d admin admin] PATH_INFO: `/v3/projects/c7e06952fcf4488682c8940d714816ac/users/da8eed2613eb47cdaf48ca0503891f3d/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:05.483426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be860159-6a0d-476b-a857-43cc0682d78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e06952fcf4488682c8940d714816ac, user_id=da8eed2613eb47cdaf48ca0503891f3d, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:05.488379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be860159-6a0d-476b-a857-43cc0682d78d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:05.508330 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2335/4701] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:05 2022] PUT /identity/v3/projects/c7e06952fcf4488682c8940d714816ac/users/da8eed2613eb47cdaf48ca0503891f3d/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:05.513587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79730de7-d772-4393-a494-91ea2914cac7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:05.527559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79730de7-d772-4393-a494-91ea2914cac7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:05.579944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:05.606178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d7a6e-9f0b-4ec4-9d6e-7d6aa350ae30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:05.606657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7a6e-9f0b-4ec4-9d6e-7d6aa350ae30 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:05.606938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7a6e-9f0b-4ec4-9d6e-7d6aa350ae30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:05.607201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d7a6e-9f0b-4ec4-9d6e-7d6aa350ae30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:05.607869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d7a6e-9f0b-4ec4-9d6e-7d6aa350ae30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:05.609574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d7a6e-9f0b-4ec4-9d6e-7d6aa350ae30 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:05.623673 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2367/4702] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:05.629486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be860159-6a0d-476b-a857-43cc0682d78d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:05.641135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be860159-6a0d-476b-a857-43cc0682d78d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:05.649307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca6c60-fe32-4b2c-b5cd-a250d0cb7877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:05.650002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca6c60-fe32-4b2c-b5cd-a250d0cb7877 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:05.650310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca6c60-fe32-4b2c-b5cd-a250d0cb7877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:05.650583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca6c60-fe32-4b2c-b5cd-a250d0cb7877 admin admin] PATH_INFO: `/v3/projects/c7e06952fcf4488682c8940d714816ac/users/da8eed2613eb47cdaf48ca0503891f3d/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:05.652819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca6c60-fe32-4b2c-b5cd-a250d0cb7877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e06952fcf4488682c8940d714816ac, user_id=da8eed2613eb47cdaf48ca0503891f3d, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:05.660578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca6c60-fe32-4b2c-b5cd-a250d0cb7877 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:05.670402 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2336/4703] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:05 2022] PUT /identity/v3/projects/c7e06952fcf4488682c8940d714816ac/users/da8eed2613eb47cdaf48ca0503891f3d/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:05.684313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7811-b3f6-409d-822e-34047d328f27 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:05.684671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7811-b3f6-409d-822e-34047d328f27 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:05.684904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd7811-b3f6-409d-822e-34047d328f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:05.724849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4bcd7811-b3f6-409d-822e-34047d328f27 None None] MFA Rules not processed for user `da8eed2613eb47cdaf48ca0503891f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:05.726343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4bcd7811-b3f6-409d-822e-34047d328f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:05.812455 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2368/4704] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:05.827647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca6c60-fe32-4b2c-b5cd-a250d0cb7877 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:05.830335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9aca6c60-fe32-4b2c-b5cd-a250d0cb7877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:05.929663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca6c60-fe32-4b2c-b5cd-a250d0cb7877 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:05.935160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f149cd-de2c-4f8b-a9a5-794ef8581d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:05.935813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f149cd-de2c-4f8b-a9a5-794ef8581d93 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:05.936077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f149cd-de2c-4f8b-a9a5-794ef8581d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:05.936370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f149cd-de2c-4f8b-a9a5-794ef8581d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:05.958111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f149cd-de2c-4f8b-a9a5-794ef8581d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:05.960074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f149cd-de2c-4f8b-a9a5-794ef8581d93 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:05.974218 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2337/4705] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:15.546721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd7811-b3f6-409d-822e-34047d328f27 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:15.572234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd7811-b3f6-409d-822e-34047d328f27 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:15.577408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6778ba-8435-4b4e-bc20-c06002bc8e5d tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8eed2613eb47cdaf48ca0503891f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7e06952fcf4488682c8940d714816ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:15.578094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6778ba-8435-4b4e-bc20-c06002bc8e5d tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.578379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6778ba-8435-4b4e-bc20-c06002bc8e5d tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.578661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6778ba-8435-4b4e-bc20-c06002bc8e5d tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:15.579371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6778ba-8435-4b4e-bc20-c06002bc8e5d tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:15.580252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6778ba-8435-4b4e-bc20-c06002bc8e5d tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:15.588688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6778ba-8435-4b4e-bc20-c06002bc8e5d tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:15.605076 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2369/4706] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:37:15.611601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f149cd-de2c-4f8b-a9a5-794ef8581d93 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:15.623159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f149cd-de2c-4f8b-a9a5-794ef8581d93 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:15.629043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a48b1a-a503-4c4d-90b4-1e4e62f5b596 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8eed2613eb47cdaf48ca0503891f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7e06952fcf4488682c8940d714816ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:15.629684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a48b1a-a503-4c4d-90b4-1e4e62f5b596 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.630010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a48b1a-a503-4c4d-90b4-1e4e62f5b596 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.630286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a48b1a-a503-4c4d-90b4-1e4e62f5b596 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:15.630949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a48b1a-a503-4c4d-90b4-1e4e62f5b596 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:15.632978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a48b1a-a503-4c4d-90b4-1e4e62f5b596 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:15.670910 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2338/4707] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:15 2022] POST /identity/v3/projects => generated 347 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:15.677825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6778ba-8435-4b4e-bc20-c06002bc8e5d tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:15.696420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6778ba-8435-4b4e-bc20-c06002bc8e5d tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:15.787685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b225-8c65-4a4b-ae0d-66cccb814588 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8eed2613eb47cdaf48ca0503891f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7e06952fcf4488682c8940d714816ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:15.788410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b225-8c65-4a4b-ae0d-66cccb814588 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:15.788941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b225-8c65-4a4b-ae0d-66cccb814588 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:15.789278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8b225-8c65-4a4b-ae0d-66cccb814588 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:15.790409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b225-8c65-4a4b-ae0d-66cccb814588 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:15.790782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b225-8c65-4a4b-ae0d-66cccb814588 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:15.792495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8b225-8c65-4a4b-ae0d-66cccb814588 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:15.815153 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2370/4708] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:37:16.993648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a48b1a-a503-4c4d-90b4-1e4e62f5b596 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:17.006410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a48b1a-a503-4c4d-90b4-1e4e62f5b596 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:17.011489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da8eed2613eb47cdaf48ca0503891f3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7e06952fcf4488682c8940d714816ac', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:17.012133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:17.012464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:17.012734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] PATH_INFO: `/v3/projects/df7c1e3682cc4cf79a122163a82f495e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:17.014135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: Authorizing `identity:delete_project(project_id=df7c1e3682cc4cf79a122163a82f495e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:17.016124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:17.085711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7c1e3682cc4cf79a122163a82f495e', 'request_id': 'req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:17.094998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7c1e3682cc4cf79a122163a82f495e', 'request_id': 'req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:17.098359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:17.104319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7c1e3682cc4cf79a122163a82f495e', 'request_id': 'req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:17.118254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] The token cache is being invalidate because project df7c1e3682cc4cf79a122163a82f495e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:17.118695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:17.119492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcc9e4c7-c30d-4e25-bb82-da9a31dcbb95 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:17.121015 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2339/4709] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:16 2022] DELETE /identity/v3/projects/df7c1e3682cc4cf79a122163a82f495e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:17.134051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b225-8c65-4a4b-ae0d-66cccb814588 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:17.136556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a6c8b225-8c65-4a4b-ae0d-66cccb814588 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:17.214761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:17.228900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8b225-8c65-4a4b-ae0d-66cccb814588 tempest-RoutersIpV6AdminTest-697211638 tempest-RoutersIpV6AdminTest-697211638-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:17.293019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c9dea-c0a5-42cb-b892-d08c13cd3d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:17.293642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c9dea-c0a5-42cb-b892-d08c13cd3d55 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:17.294002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c9dea-c0a5-42cb-b892-d08c13cd3d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:17.294274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c9dea-c0a5-42cb-b892-d08c13cd3d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:17.296142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-313c9dea-c0a5-42cb-b892-d08c13cd3d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:17.379880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c9dea-c0a5-42cb-b892-d08c13cd3d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:17.382032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c9dea-c0a5-42cb-b892-d08c13cd3d55 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:17.410018 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2371/4710] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:26.200270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a823d3-c672-4eed-acdf-2ea656948664 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:26.200844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a823d3-c672-4eed-acdf-2ea656948664 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:26.201170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a823d3-c672-4eed-acdf-2ea656948664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:26.250951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-78a823d3-c672-4eed-acdf-2ea656948664 None None] MFA Rules not processed for user `c08bbaf86cc944dbaa12cc20224b0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:26.257352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-78a823d3-c672-4eed-acdf-2ea656948664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:26.369970 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2340/4711] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:27.389758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=49 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:31.293958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c9dea-c0a5-42cb-b892-d08c13cd3d55 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:31.296395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-313c9dea-c0a5-42cb-b892-d08c13cd3d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:31.476933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c9dea-c0a5-42cb-b892-d08c13cd3d55 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:31.510515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:31.511865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:31.512487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:31.513301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] PATH_INFO: `/v3/users/5204524ef91443cabc4fddab51972961` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:31.518568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5204524ef91443cabc4fddab51972961)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:31.528994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:31.674570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5204524ef91443cabc4fddab51972961'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.675407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5204524ef91443cabc4fddab51972961'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.695090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5204524ef91443cabc4fddab51972961'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.718485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5204524ef91443cabc4fddab51972961'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.776247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5204524ef91443cabc4fddab51972961'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:31.794065 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2372/4712] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:31 2022] DELETE /identity/v3/users/5204524ef91443cabc4fddab51972961 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:31.800008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1df3d1-3876-430b-bc1a-40f111bb2e79 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:31.800946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1df3d1-3876-430b-bc1a-40f111bb2e79 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:31.800946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1df3d1-3876-430b-bc1a-40f111bb2e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:31.875358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5b1df3d1-3876-430b-bc1a-40f111bb2e79 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:31.877013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5b1df3d1-3876-430b-bc1a-40f111bb2e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:32.102770 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2341/4713] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:32.212401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:32.215663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:32.369614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18402de-e97e-4184-9806-87c8317284e8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:32.375982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce393c-5521-4b4b-9c43-16af7ec40cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:32.377138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce393c-5521-4b4b-9c43-16af7ec40cea service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:32.377731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce393c-5521-4b4b-9c43-16af7ec40cea service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:32.378560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce393c-5521-4b4b-9c43-16af7ec40cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:32.400845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce393c-5521-4b4b-9c43-16af7ec40cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:32.409000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce393c-5521-4b4b-9c43-16af7ec40cea service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:32.427632 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2373/4714] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:33.977775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1df3d1-3876-430b-bc1a-40f111bb2e79 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:33.979582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5b1df3d1-3876-430b-bc1a-40f111bb2e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:34.002058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1df3d1-3876-430b-bc1a-40f111bb2e79 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.011684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.013014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.013784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.014328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] PATH_INFO: `/v3/projects/bc7d3c04371441428df8b6b735b6f689` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.016221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc7d3c04371441428df8b6b735b6f689)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.023124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.096152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce393c-5521-4b4b-9c43-16af7ec40cea service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.097839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c2ce393c-5521-4b4b-9c43-16af7ec40cea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:34.124566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc7d3c04371441428df8b6b735b6f689', 'request_id': 'req-0780ddfd-813b-4f71-962b-50e2022f35fe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:34.137750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce393c-5521-4b4b-9c43-16af7ec40cea service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.172510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc7d3c04371441428df8b6b735b6f689', 'request_id': 'req-0780ddfd-813b-4f71-962b-50e2022f35fe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:34.198756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc7d3c04371441428df8b6b735b6f689', 'request_id': 'req-0780ddfd-813b-4f71-962b-50e2022f35fe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:34.229739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] The token cache is being invalidate because project bc7d3c04371441428df8b6b735b6f689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:34.232384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:34.233836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0780ddfd-813b-4f71-962b-50e2022f35fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:34.237685 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2342/4715] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:33 2022] DELETE /identity/v3/projects/bc7d3c04371441428df8b6b735b6f689 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:34.246387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e67938-b350-464e-8677-09998f9f6e1b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.247707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e67938-b350-464e-8677-09998f9f6e1b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.248311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e67938-b350-464e-8677-09998f9f6e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.256131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:34.313861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-82e67938-b350-464e-8677-09998f9f6e1b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:34.319233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-82e67938-b350-464e-8677-09998f9f6e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:34.343529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:34.348430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.349371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.349831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.350316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] PATH_INFO: `/v3/users/156adbbf6e3b4111b49b7e6e17b9825d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.351797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] RBAC: Authorizing `identity:delete_user(user_id=156adbbf6e3b4111b49b7e6e17b9825d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.354029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.476370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156adbbf6e3b4111b49b7e6e17b9825d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:34.477476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156adbbf6e3b4111b49b7e6e17b9825d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:34.492065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156adbbf6e3b4111b49b7e6e17b9825d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:34.508945 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2343/4716] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:34.510604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985cf4a-e81b-42d1-98a0-d88100c274bd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.510936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985cf4a-e81b-42d1-98a0-d88100c274bd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.511207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985cf4a-e81b-42d1-98a0-d88100c274bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.521978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156adbbf6e3b4111b49b7e6e17b9825d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:34.556070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156adbbf6e3b4111b49b7e6e17b9825d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:34.568840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0985cf4a-e81b-42d1-98a0-d88100c274bd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:34.572200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0985cf4a-e81b-42d1-98a0-d88100c274bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:34.572630 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2374/4717] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:34 2022] DELETE /identity/v3/users/156adbbf6e3b4111b49b7e6e17b9825d => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:34.742057 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2344/4718] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:34.747160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.763117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04d6e8-8b4d-43f7-bc5f-bbcb5fd4a315 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.770301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca8705-7e38-47d6-b486-185eeafdd780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.771469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca8705-7e38-47d6-b486-185eeafdd780 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.772064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca8705-7e38-47d6-b486-185eeafdd780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.773022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca8705-7e38-47d6-b486-185eeafdd780 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.773933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca8705-7e38-47d6-b486-185eeafdd780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:34.774238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca8705-7e38-47d6-b486-185eeafdd780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.776276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca8705-7e38-47d6-b486-185eeafdd780 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.804096 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2375/4719] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:37:34.809620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985cf4a-e81b-42d1-98a0-d88100c274bd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.824749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985cf4a-e81b-42d1-98a0-d88100c274bd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:34.833987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd9800-e552-4298-ae91-04da0828dff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:34.834635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd9800-e552-4298-ae91-04da0828dff2 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:34.834910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd9800-e552-4298-ae91-04da0828dff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:34.835173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd9800-e552-4298-ae91-04da0828dff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:34.836141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd9800-e552-4298-ae91-04da0828dff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:34.839919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd9800-e552-4298-ae91-04da0828dff2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:34.881556 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2345/4720] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:34 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:34.886098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca8705-7e38-47d6-b486-185eeafdd780 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:34.901036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca8705-7e38-47d6-b486-185eeafdd780 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:35.032118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c8e11-7d33-4918-b86a-a774f9b994e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.036379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c8e11-7d33-4918-b86a-a774f9b994e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.037148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c8e11-7d33-4918-b86a-a774f9b994e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.038552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c8e11-7d33-4918-b86a-a774f9b994e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.042812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c8e11-7d33-4918-b86a-a774f9b994e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.054260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c8e11-7d33-4918-b86a-a774f9b994e7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.111911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd9800-e552-4298-ae91-04da0828dff2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.114814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f7cd9800-e552-4298-ae91-04da0828dff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:35.126206 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2376/4721] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:34 2022] POST /identity/v3/users => generated 282 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:37:35.132789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c8e11-7d33-4918-b86a-a774f9b994e7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.148408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c8e11-7d33-4918-b86a-a774f9b994e7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:35.151195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd9800-e552-4298-ae91-04da0828dff2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:35.161943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73d81b-b064-4c81-b38a-01f448963f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.164630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.165308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.165609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.166130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73d81b-b064-4c81-b38a-01f448963f2e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.166653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73d81b-b064-4c81-b38a-01f448963f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.166936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73d81b-b064-4c81-b38a-01f448963f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.167681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73d81b-b064-4c81-b38a-01f448963f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.168463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] PATH_INFO: `/v3/projects/628005d1913b4e8688ec94eda94fa898` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.169916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=628005d1913b4e8688ec94eda94fa898)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.171899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.175765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73d81b-b064-4c81-b38a-01f448963f2e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.197715 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2377/4722] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:35.203177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73d81b-b064-4c81-b38a-01f448963f2e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.224244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73d81b-b064-4c81-b38a-01f448963f2e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:35.232760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac472f0-cb71-45cc-8262-215aa31c2ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.233934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac472f0-cb71-45cc-8262-215aa31c2ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.234504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac472f0-cb71-45cc-8262-215aa31c2ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.235073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac472f0-cb71-45cc-8262-215aa31c2ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.236444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac472f0-cb71-45cc-8262-215aa31c2ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.239409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac472f0-cb71-45cc-8262-215aa31c2ee3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.242078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:35.278947 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2378/4723] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:37:35.287518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac472f0-cb71-45cc-8262-215aa31c2ee3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.316331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac472f0-cb71-45cc-8262-215aa31c2ee3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:35.323526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628005d1913b4e8688ec94eda94fa898', 'request_id': 'req-6546f75b-2757-4fb1-8043-d5b45cc29f64'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:35.336050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628005d1913b4e8688ec94eda94fa898', 'request_id': 'req-6546f75b-2757-4fb1-8043-d5b45cc29f64'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:35.347043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628005d1913b4e8688ec94eda94fa898', 'request_id': 'req-6546f75b-2757-4fb1-8043-d5b45cc29f64'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:35.381192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] The token cache is being invalidate because project 628005d1913b4e8688ec94eda94fa898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:35.385180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:35.386677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6546f75b-2757-4fb1-8043-d5b45cc29f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:35.400695 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2346/4724] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:35 2022] DELETE /identity/v3/projects/628005d1913b4e8688ec94eda94fa898 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:35.404332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077022-4d22-403f-8fc0-46eb79828b57 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.404803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077022-4d22-403f-8fc0-46eb79828b57 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.405242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077022-4d22-403f-8fc0-46eb79828b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.437619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0c077022-4d22-403f-8fc0-46eb79828b57 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:35.439734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0c077022-4d22-403f-8fc0-46eb79828b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:35.456672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7f932-7147-4ed5-b2cf-0a42fcd47f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.459292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7f932-7147-4ed5-b2cf-0a42fcd47f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.461621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7f932-7147-4ed5-b2cf-0a42fcd47f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.462233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7f932-7147-4ed5-b2cf-0a42fcd47f65 admin admin] PATH_INFO: `/v3/projects/74910f91f5c646a998a67399e58637ac/users/289a4f76a1464cacbb5c0747cca419c5/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.470304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:35.526721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7f932-7147-4ed5-b2cf-0a42fcd47f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74910f91f5c646a998a67399e58637ac, user_id=289a4f76a1464cacbb5c0747cca419c5, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.532346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7f932-7147-4ed5-b2cf-0a42fcd47f65 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.566712 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2379/4725] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:35 2022] PUT /identity/v3/projects/74910f91f5c646a998a67399e58637ac/users/289a4f76a1464cacbb5c0747cca419c5/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:35.583329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434c9d-05c6-40c8-a887-d46fcdd7851d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.583793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434c9d-05c6-40c8-a887-d46fcdd7851d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.584177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434c9d-05c6-40c8-a887-d46fcdd7851d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.632110 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2347/4726] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:35.633613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72928e-3ddc-48b4-898d-34ae83207bdf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.633922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72928e-3ddc-48b4-898d-34ae83207bdf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.634200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72928e-3ddc-48b4-898d-34ae83207bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.674928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e2434c9d-05c6-40c8-a887-d46fcdd7851d None None] MFA Rules not processed for user `289a4f76a1464cacbb5c0747cca419c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:35.676344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e2434c9d-05c6-40c8-a887-d46fcdd7851d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:35.698502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cc72928e-3ddc-48b4-898d-34ae83207bdf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:35.701727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cc72928e-3ddc-48b4-898d-34ae83207bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:35.899799 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2348/4727] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:35.906038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72928e-3ddc-48b4-898d-34ae83207bdf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.914719 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2380/4728] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:35.922383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72928e-3ddc-48b4-898d-34ae83207bdf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:35.929355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62497e-5411-4a7d-a75a-029406e1cd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:35.930357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62497e-5411-4a7d-a75a-029406e1cd80 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:35.930799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62497e-5411-4a7d-a75a-029406e1cd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:35.931261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62497e-5411-4a7d-a75a-029406e1cd80 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:35.932132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62497e-5411-4a7d-a75a-029406e1cd80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:35.932616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62497e-5411-4a7d-a75a-029406e1cd80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:35.935425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a62497e-5411-4a7d-a75a-029406e1cd80 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:35.937902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434c9d-05c6-40c8-a887-d46fcdd7851d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.943062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e2434c9d-05c6-40c8-a887-d46fcdd7851d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:35.966189 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2349/4729] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:37:35.972071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62497e-5411-4a7d-a75a-029406e1cd80 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:35.999718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62497e-5411-4a7d-a75a-029406e1cd80 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:36.012827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df7769-78b3-439b-97d4-9ddcb3d2ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:36.014410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df7769-78b3-439b-97d4-9ddcb3d2ceac admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:36.015144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df7769-78b3-439b-97d4-9ddcb3d2ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:36.015887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df7769-78b3-439b-97d4-9ddcb3d2ceac admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:36.018417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df7769-78b3-439b-97d4-9ddcb3d2ceac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:36.028807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df7769-78b3-439b-97d4-9ddcb3d2ceac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:36.121265 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2350/4730] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:35 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:36.129279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df7769-78b3-439b-97d4-9ddcb3d2ceac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:36.266123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434c9d-05c6-40c8-a887-d46fcdd7851d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:36.275772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:36.362153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df7769-78b3-439b-97d4-9ddcb3d2ceac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:36.381162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfaf0f-4ab9-4b99-ab15-09c743c67abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:36.381821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfaf0f-4ab9-4b99-ab15-09c743c67abf admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:36.382137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfaf0f-4ab9-4b99-ab15-09c743c67abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:36.382406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfaf0f-4ab9-4b99-ab15-09c743c67abf admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:36.383071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfaf0f-4ab9-4b99-ab15-09c743c67abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:36.391817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfaf0f-4ab9-4b99-ab15-09c743c67abf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:36.470804 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2351/4731] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:36 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:36.473464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfaf0f-4ab9-4b99-ab15-09c743c67abf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:36.497709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57896f08-e7ec-41f3-a32d-7729f48c0a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:36.497709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57896f08-e7ec-41f3-a32d-7729f48c0a80 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:36.499752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57896f08-e7ec-41f3-a32d-7729f48c0a80 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:36.500258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57896f08-e7ec-41f3-a32d-7729f48c0a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:36.509207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfaf0f-4ab9-4b99-ab15-09c743c67abf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:36.517215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e51dbe-522e-4638-9749-e772ec7cf0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:36.521044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e51dbe-522e-4638-9749-e772ec7cf0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:36.521544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e51dbe-522e-4638-9749-e772ec7cf0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:36.522070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e51dbe-522e-4638-9749-e772ec7cf0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:36.524842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e51dbe-522e-4638-9749-e772ec7cf0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:36.526619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e51dbe-522e-4638-9749-e772ec7cf0a8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:36.587648 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2352/4732] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:36.593100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e51dbe-522e-4638-9749-e772ec7cf0a8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:36.603512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:36.621335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e51dbe-522e-4638-9749-e772ec7cf0a8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:36.630672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57896f08-e7ec-41f3-a32d-7729f48c0a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:36.634068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b4cb4-4dd8-4e8f-bbac-beae5b3b5d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:36.634857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b4cb4-4dd8-4e8f-bbac-beae5b3b5d10 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:36.635268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b4cb4-4dd8-4e8f-bbac-beae5b3b5d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:36.635671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b4cb4-4dd8-4e8f-bbac-beae5b3b5d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:36.636481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b4cb4-4dd8-4e8f-bbac-beae5b3b5d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:36.637167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57896f08-e7ec-41f3-a32d-7729f48c0a80 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:36.638854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b4cb4-4dd8-4e8f-bbac-beae5b3b5d10 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:36.670050 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2381/4733] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:37:36.672377 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2353/4734] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:36.676853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57896f08-e7ec-41f3-a32d-7729f48c0a80 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:36.700195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57896f08-e7ec-41f3-a32d-7729f48c0a80 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:36.711771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21d2db-8d91-42b8-8865-90db136096da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:36.712504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21d2db-8d91-42b8-8865-90db136096da admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:36.712779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21d2db-8d91-42b8-8865-90db136096da admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:36.713111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21d2db-8d91-42b8-8865-90db136096da admin admin] PATH_INFO: `/v3/projects/d513cfdf50b8418aa2c6092e0c25404b/users/d219e4505de3413db9db47ffe399c25f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:36.752409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21d2db-8d91-42b8-8865-90db136096da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d513cfdf50b8418aa2c6092e0c25404b, user_id=d219e4505de3413db9db47ffe399c25f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:36.757784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21d2db-8d91-42b8-8865-90db136096da admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:36.785009 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2382/4735] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:36 2022] PUT /identity/v3/projects/d513cfdf50b8418aa2c6092e0c25404b/users/d219e4505de3413db9db47ffe399c25f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:36.797382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0cf26-a977-46e7-bd58-ea6e9879e6c0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:36.797711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0cf26-a977-46e7-bd58-ea6e9879e6c0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:36.798176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0cf26-a977-46e7-bd58-ea6e9879e6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:36.844417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4ae0cf26-a977-46e7-bd58-ea6e9879e6c0 None None] MFA Rules not processed for user `d219e4505de3413db9db47ffe399c25f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:36.847081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4ae0cf26-a977-46e7-bd58-ea6e9879e6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:37.069369 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2354/4736] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:37.088277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21d2db-8d91-42b8-8865-90db136096da admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:37.092268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bb21d2db-8d91-42b8-8865-90db136096da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:37.203071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21d2db-8d91-42b8-8865-90db136096da admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:37.210888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b58f0-78a3-41a3-b5ca-c585c730f30d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:37.212873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b58f0-78a3-41a3-b5ca-c585c730f30d service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:37.213353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b58f0-78a3-41a3-b5ca-c585c730f30d service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:37.213785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b58f0-78a3-41a3-b5ca-c585c730f30d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:37.239818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b58f0-78a3-41a3-b5ca-c585c730f30d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:37.242044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b58f0-78a3-41a3-b5ca-c585c730f30d service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:37.264556 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2383/4737] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:37.558502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0cf26-a977-46e7-bd58-ea6e9879e6c0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:37.561970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4ae0cf26-a977-46e7-bd58-ea6e9879e6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:37.689589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0cf26-a977-46e7-bd58-ea6e9879e6c0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:37.697079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:37.698049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:37.698394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:37.698681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] PATH_INFO: `/v3/users/289a4f76a1464cacbb5c0747cca419c5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:37.700160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=289a4f76a1464cacbb5c0747cca419c5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:37.703837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:37.796587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289a4f76a1464cacbb5c0747cca419c5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:37.862949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289a4f76a1464cacbb5c0747cca419c5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:37.868348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fe3f4-1909-4582-9a4b-c8cf3fd75cc3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:37.868961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fe3f4-1909-4582-9a4b-c8cf3fd75cc3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:37.869421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943fe3f4-1909-4582-9a4b-c8cf3fd75cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:37.909970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289a4f76a1464cacbb5c0747cca419c5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:37.928121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289a4f76a1464cacbb5c0747cca419c5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:37.930063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de864d59-e6d8-4397-8e35-21c34c3648ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289a4f76a1464cacbb5c0747cca419c5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:37.936653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:37.949508 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2355/4738] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:37:37 2022] DELETE /identity/v3/users/289a4f76a1464cacbb5c0747cca419c5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:37.952830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-943fe3f4-1909-4582-9a4b-c8cf3fd75cc3 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:37.956858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-943fe3f4-1909-4582-9a4b-c8cf3fd75cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:37.958891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d86e8-93ef-4f74-8ab1-9c4c2087def8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:37.959215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d86e8-93ef-4f74-8ab1-9c4c2087def8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:37.959963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d86e8-93ef-4f74-8ab1-9c4c2087def8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:37.999290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-138d86e8-93ef-4f74-8ab1-9c4c2087def8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:38.000973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-138d86e8-93ef-4f74-8ab1-9c4c2087def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:38.062234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:38.106839 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2356/4739] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:38.151222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d86e8-93ef-4f74-8ab1-9c4c2087def8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:38.155343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-138d86e8-93ef-4f74-8ab1-9c4c2087def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:38.204525 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2384/4740] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:37:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 30 04:37:38.254873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fe3f4-1909-4582-9a4b-c8cf3fd75cc3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:38.260424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-943fe3f4-1909-4582-9a4b-c8cf3fd75cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:38.273408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d86e8-93ef-4f74-8ab1-9c4c2087def8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:38.279321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c7a7-bfbc-44dd-8d4a-c9d0c3fa3469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:38.280713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c7a7-bfbc-44dd-8d4a-c9d0c3fa3469 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:38.281793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c7a7-bfbc-44dd-8d4a-c9d0c3fa3469 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:38.283316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c7a7-bfbc-44dd-8d4a-c9d0c3fa3469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:38.313133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c7a7-bfbc-44dd-8d4a-c9d0c3fa3469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:38.316379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c7a7-bfbc-44dd-8d4a-c9d0c3fa3469 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:38.333238 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2357/4741] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:37:38.490529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943fe3f4-1909-4582-9a4b-c8cf3fd75cc3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:38.531678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57cced-b115-4783-a5fb-178a4c4276da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:38.534442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57cced-b115-4783-a5fb-178a4c4276da service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:38.535291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57cced-b115-4783-a5fb-178a4c4276da service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:38.535760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57cced-b115-4783-a5fb-178a4c4276da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:38.565206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57cced-b115-4783-a5fb-178a4c4276da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:38.568885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57cced-b115-4783-a5fb-178a4c4276da service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:38.577510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9622bbf-1102-4540-b847-a6c2d90a3b2c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:38.578163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9622bbf-1102-4540-b847-a6c2d90a3b2c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:38.578290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9622bbf-1102-4540-b847-a6c2d90a3b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:38.630341 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2385/4742] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:37:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:38.649609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e9622bbf-1102-4540-b847-a6c2d90a3b2c None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:38.653768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e9622bbf-1102-4540-b847-a6c2d90a3b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:38.706848 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2358/4743] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:37:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:37:38.750196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57cced-b115-4783-a5fb-178a4c4276da service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:38.774341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57cced-b115-4783-a5fb-178a4c4276da service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:38.791518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa27a1c-1c43-48d6-b6ab-29cdbcc39313 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:38.792932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa27a1c-1c43-48d6-b6ab-29cdbcc39313 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:38.793230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa27a1c-1c43-48d6-b6ab-29cdbcc39313 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:38.793521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa27a1c-1c43-48d6-b6ab-29cdbcc39313 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:38.826459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa27a1c-1c43-48d6-b6ab-29cdbcc39313 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:38.828183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa27a1c-1c43-48d6-b6ab-29cdbcc39313 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:38.854567 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2386/4744] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:37:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:40.016786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9622bbf-1102-4540-b847-a6c2d90a3b2c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:40.019470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e9622bbf-1102-4540-b847-a6c2d90a3b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:40.040058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9622bbf-1102-4540-b847-a6c2d90a3b2c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:40.053781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:40.053781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:40.053781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:40.053781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] PATH_INFO: `/v3/projects/74910f91f5c646a998a67399e58637ac` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:40.054454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=74910f91f5c646a998a67399e58637ac)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:40.057384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:40.222042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74910f91f5c646a998a67399e58637ac', 'request_id': 'req-f3fd4551-7155-4a83-bbda-381f7b693b9f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.251001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74910f91f5c646a998a67399e58637ac', 'request_id': 'req-f3fd4551-7155-4a83-bbda-381f7b693b9f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.293449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74910f91f5c646a998a67399e58637ac', 'request_id': 'req-f3fd4551-7155-4a83-bbda-381f7b693b9f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.368306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] The token cache is being invalidate because project 74910f91f5c646a998a67399e58637ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:37:40.368836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.370523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3fd4551-7155-4a83-bbda-381f7b693b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:37:40.374578 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2359/4745] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:37:40 2022] DELETE /identity/v3/projects/74910f91f5c646a998a67399e58637ac => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:37:40.382158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09be85-c906-46da-8448-79e032048bfe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:40.383105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09be85-c906-46da-8448-79e032048bfe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:40.383538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09be85-c906-46da-8448-79e032048bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:40.422491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4d09be85-c906-46da-8448-79e032048bfe None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:40.424157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4d09be85-c906-46da-8448-79e032048bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:40.533708 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2387/4746] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:40.542296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b5124-ef6e-47a3-85d7-cc2b4eb425e5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:40.542878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b5124-ef6e-47a3-85d7-cc2b4eb425e5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:40.543163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b5124-ef6e-47a3-85d7-cc2b4eb425e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:40.589839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7f6b5124-ef6e-47a3-85d7-cc2b4eb425e5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:40.591146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7f6b5124-ef6e-47a3-85d7-cc2b4eb425e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:40.615132 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2360/4747] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:40.619732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09be85-c906-46da-8448-79e032048bfe None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:40.638366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09be85-c906-46da-8448-79e032048bfe None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:40.651226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833e72e-5e0d-4b93-bf0f-558c064d7c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:40.652998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833e72e-5e0d-4b93-bf0f-558c064d7c2c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:40.653436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833e72e-5e0d-4b93-bf0f-558c064d7c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:40.656206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833e72e-5e0d-4b93-bf0f-558c064d7c2c admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:40.657555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833e72e-5e0d-4b93-bf0f-558c064d7c2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:37:40.660239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833e72e-5e0d-4b93-bf0f-558c064d7c2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:40.663314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833e72e-5e0d-4b93-bf0f-558c064d7c2c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:40.698730 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2388/4748] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:37:40.707025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b5124-ef6e-47a3-85d7-cc2b4eb425e5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:40.733539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b5124-ef6e-47a3-85d7-cc2b4eb425e5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:40.748499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d72c3-12fc-4e68-a77c-b5a804cf5369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:40.749435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d72c3-12fc-4e68-a77c-b5a804cf5369 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:40.749996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d72c3-12fc-4e68-a77c-b5a804cf5369 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:40.750504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d72c3-12fc-4e68-a77c-b5a804cf5369 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:40.751997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d72c3-12fc-4e68-a77c-b5a804cf5369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:40.760086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d72c3-12fc-4e68-a77c-b5a804cf5369 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:40.812573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:40.842504 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2361/4749] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:37:40 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:40.847364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833e72e-5e0d-4b93-bf0f-558c064d7c2c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:40.863263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833e72e-5e0d-4b93-bf0f-558c064d7c2c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:40.964893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:41.069169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6fd1e-93a4-45b3-a739-3d9437aa8be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:41.071426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6fd1e-93a4-45b3-a739-3d9437aa8be6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:41.072495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6fd1e-93a4-45b3-a739-3d9437aa8be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:41.073890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6fd1e-93a4-45b3-a739-3d9437aa8be6 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:41.075748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6fd1e-93a4-45b3-a739-3d9437aa8be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:41.081736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6fd1e-93a4-45b3-a739-3d9437aa8be6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:41.128750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3ff08-ac47-424b-9cf9-0eaf463a08ac None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:41.129324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3ff08-ac47-424b-9cf9-0eaf463a08ac None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:41.130035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3ff08-ac47-424b-9cf9-0eaf463a08ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:41.138281 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2389/4750] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:37:40 2022] POST /identity/v3/users => generated 288 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:37:41.143225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6fd1e-93a4-45b3-a739-3d9437aa8be6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:41.182978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6fd1e-93a4-45b3-a739-3d9437aa8be6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:41.195859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bcf3ff08-ac47-424b-9cf9-0eaf463a08ac None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:41.200913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02052-b2f0-4290-91b5-42a4c795d09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:41.201513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bcf3ff08-ac47-424b-9cf9-0eaf463a08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:41.202294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02052-b2f0-4290-91b5-42a4c795d09f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:41.202788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02052-b2f0-4290-91b5-42a4c795d09f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:41.203604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02052-b2f0-4290-91b5-42a4c795d09f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:41.204912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef02052-b2f0-4290-91b5-42a4c795d09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:41.211538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef02052-b2f0-4290-91b5-42a4c795d09f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:41.244373 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2390/4751] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:41.247164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02052-b2f0-4290-91b5-42a4c795d09f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:41.279377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02052-b2f0-4290-91b5-42a4c795d09f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:41.292516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b092-d368-457d-b4f7-77d384bad4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:41.293234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b092-d368-457d-b4f7-77d384bad4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:41.294116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b092-d368-457d-b4f7-77d384bad4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:41.294116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b092-d368-457d-b4f7-77d384bad4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:41.294414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266b092-d368-457d-b4f7-77d384bad4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:41.299863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266b092-d368-457d-b4f7-77d384bad4e2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:41.328716 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2391/4752] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:37:41.330579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b092-d368-457d-b4f7-77d384bad4e2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:41.358684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b092-d368-457d-b4f7-77d384bad4e2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:41.383741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db2963-47f7-4c3d-be5c-820786a3ade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:41.384959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db2963-47f7-4c3d-be5c-820786a3ade6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:41.385425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db2963-47f7-4c3d-be5c-820786a3ade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:41.385933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db2963-47f7-4c3d-be5c-820786a3ade6 admin admin] PATH_INFO: `/v3/projects/12b78869c9e74bff88dacb6cf3ad0f26/users/17fc1309afe74c32a5cd1c242ea5afaf/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:41.416866 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2362/4753] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:37:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:41.425540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db2963-47f7-4c3d-be5c-820786a3ade6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b78869c9e74bff88dacb6cf3ad0f26, user_id=17fc1309afe74c32a5cd1c242ea5afaf, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:41.438537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3ff08-ac47-424b-9cf9-0eaf463a08ac None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:41.439331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db2963-47f7-4c3d-be5c-820786a3ade6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:41.440082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bcf3ff08-ac47-424b-9cf9-0eaf463a08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:41.517923 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2392/4754] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:37:41 2022] PUT /identity/v3/projects/12b78869c9e74bff88dacb6cf3ad0f26/users/17fc1309afe74c32a5cd1c242ea5afaf/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:37:41.526278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f98d-b258-4f36-9eb0-11b90e508987 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:41.526601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f98d-b258-4f36-9eb0-11b90e508987 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:41.526739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1f98d-b258-4f36-9eb0-11b90e508987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:41.586773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5ab1f98d-b258-4f36-9eb0-11b90e508987 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:41.588754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5ab1f98d-b258-4f36-9eb0-11b90e508987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:41.634884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3ff08-ac47-424b-9cf9-0eaf463a08ac None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:41.816960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ccb23-5d31-4a57-afc7-91ac27d9eb57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:41.817854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ccb23-5d31-4a57-afc7-91ac27d9eb57 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:41.818510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ccb23-5d31-4a57-afc7-91ac27d9eb57 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:41.819061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ccb23-5d31-4a57-afc7-91ac27d9eb57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:41.826389 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2393/4755] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:41.863052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1f98d-b258-4f36-9eb0-11b90e508987 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:41.865795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5ab1f98d-b258-4f36-9eb0-11b90e508987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:41.937193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:42.051453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ccb23-5d31-4a57-afc7-91ac27d9eb57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:42.053245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ccb23-5d31-4a57-afc7-91ac27d9eb57 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:42.098691 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2363/4756] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:37:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:37:42.281671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1f98d-b258-4f36-9eb0-11b90e508987 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:42.304464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32286c-7c73-4be5-8ccf-cf28cb4c9966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:42.305918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32286c-7c73-4be5-8ccf-cf28cb4c9966 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:42.306540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32286c-7c73-4be5-8ccf-cf28cb4c9966 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:42.307121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc32286c-7c73-4be5-8ccf-cf28cb4c9966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:42.360461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32286c-7c73-4be5-8ccf-cf28cb4c9966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:42.363156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc32286c-7c73-4be5-8ccf-cf28cb4c9966 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:42.395574 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2394/4757] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:37:43.979177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7898e-3ad6-401b-a58c-5dd3e6c27c96 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:43.979778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7898e-3ad6-401b-a58c-5dd3e6c27c96 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:43.980014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7898e-3ad6-401b-a58c-5dd3e6c27c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:44.031117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-01b7898e-3ad6-401b-a58c-5dd3e6c27c96 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:44.033663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-01b7898e-3ad6-401b-a58c-5dd3e6c27c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:44.057846 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2364/4758] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:37:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:44.069754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32286c-7c73-4be5-8ccf-cf28cb4c9966 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:37:44.105274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc32286c-7c73-4be5-8ccf-cf28cb4c9966 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:37:44.171161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50a324-c939-4807-9204-4f3ad7faa685 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:37:44.175367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a324-c939-4807-9204-4f3ad7faa685 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:44.176208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a324-c939-4807-9204-4f3ad7faa685 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:44.176690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50a324-c939-4807-9204-4f3ad7faa685 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:44.196874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50a324-c939-4807-9204-4f3ad7faa685 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:37:44.203357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50a324-c939-4807-9204-4f3ad7faa685 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:37:44.222418 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2395/4759] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:37:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:45.972319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7996e-9f86-4f76-aed8-2f22770e9e3c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:45.972971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7996e-9f86-4f76-aed8-2f22770e9e3c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:45.976178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7996e-9f86-4f76-aed8-2f22770e9e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:46.012021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-78b7996e-9f86-4f76-aed8-2f22770e9e3c None None] MFA Rules not processed for user `d219e4505de3413db9db47ffe399c25f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:46.015740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-78b7996e-9f86-4f76-aed8-2f22770e9e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:46.113207 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2365/4760] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:47.639844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a626e4f-a628-41aa-b729-29f3e04e7527 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:47.640459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a626e4f-a628-41aa-b729-29f3e04e7527 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:47.640640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a626e4f-a628-41aa-b729-29f3e04e7527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:47.654082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:47.682741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9a626e4f-a628-41aa-b729-29f3e04e7527 None None] MFA Rules not processed for user `d219e4505de3413db9db47ffe399c25f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:47.684020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9a626e4f-a628-41aa-b729-29f3e04e7527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:47.712463 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2396/4761] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:53.626302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b62395-4fd8-4a89-bbb8-0257c88848a9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:37:53.627476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b62395-4fd8-4a89-bbb8-0257c88848a9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:37:53.628314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b62395-4fd8-4a89-bbb8-0257c88848a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:37:53.667716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-52b62395-4fd8-4a89-bbb8-0257c88848a9 None None] MFA Rules not processed for user `36bbf0c01d0148aeab626e6d1bb1f0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:37:53.672672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-52b62395-4fd8-4a89-bbb8-0257c88848a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:37:53.917358 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2366/4762] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:37:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:37:57.672505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:03.462506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0147c9-93da-45ac-b0c7-c61f02deead0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:03.463231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0147c9-93da-45ac-b0c7-c61f02deead0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:03.463231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0147c9-93da-45ac-b0c7-c61f02deead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:03.519334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fe0147c9-93da-45ac-b0c7-c61f02deead0 None None] MFA Rules not processed for user `17fc1309afe74c32a5cd1c242ea5afaf`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:03.521372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fe0147c9-93da-45ac-b0c7-c61f02deead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:03.622125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2397/4763] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:03.894471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=62 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:04.443895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b62395-4fd8-4a89-bbb8-0257c88848a9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:04.445292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-52b62395-4fd8-4a89-bbb8-0257c88848a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:04.670217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b62395-4fd8-4a89-bbb8-0257c88848a9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:04.680436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac433a-d89f-4e1d-ad05-29c1c59b137b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:04.681400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac433a-d89f-4e1d-ad05-29c1c59b137b service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:04.681862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac433a-d89f-4e1d-ad05-29c1c59b137b service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:04.682415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac433a-d89f-4e1d-ad05-29c1c59b137b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:04.695243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac433a-d89f-4e1d-ad05-29c1c59b137b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:04.697453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac433a-d89f-4e1d-ad05-29c1c59b137b service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:04.713669 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2367/4764] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:09.314820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f22f9-2745-48e9-a9a9-096f7690f762 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:09.315759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f22f9-2745-48e9-a9a9-096f7690f762 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:09.316216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f22f9-2745-48e9-a9a9-096f7690f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:09.346668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bb0f22f9-2745-48e9-a9a9-096f7690f762 None None] MFA Rules not processed for user `c08bbaf86cc944dbaa12cc20224b0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:09.348058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bb0f22f9-2745-48e9-a9a9-096f7690f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:09.510895 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2398/4765] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:10.618213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e30e-901d-4b9e-bc67-b893fd9c7e71 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:10.619323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e30e-901d-4b9e-bc67-b893fd9c7e71 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:10.619323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8e30e-901d-4b9e-bc67-b893fd9c7e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:10.655355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6bb8e30e-901d-4b9e-bc67-b893fd9c7e71 None None] MFA Rules not processed for user `17fc1309afe74c32a5cd1c242ea5afaf`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:10.657244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6bb8e30e-901d-4b9e-bc67-b893fd9c7e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:10.673634 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2368/4766] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:15.564013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f22f9-2745-48e9-a9a9-096f7690f762 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:15.566806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bb0f22f9-2745-48e9-a9a9-096f7690f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:15.652768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f22f9-2745-48e9-a9a9-096f7690f762 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:15.659202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b31064-36b7-4d52-a138-34a75a9f15f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:15.660326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31064-36b7-4d52-a138-34a75a9f15f1 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:15.660606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31064-36b7-4d52-a138-34a75a9f15f1 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:15.660873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b31064-36b7-4d52-a138-34a75a9f15f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:15.662901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-11b31064-36b7-4d52-a138-34a75a9f15f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:15.700648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b31064-36b7-4d52-a138-34a75a9f15f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:15.702194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b31064-36b7-4d52-a138-34a75a9f15f1 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:15.730051 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2399/4767] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:15.874640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e30e-901d-4b9e-bc67-b893fd9c7e71 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:15.876493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6bb8e30e-901d-4b9e-bc67-b893fd9c7e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:15.897728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8e30e-901d-4b9e-bc67-b893fd9c7e71 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:15.903468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790b6e0-a981-4da1-a263-a1c46ef4bab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:15.904376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b6e0-a981-4da1-a263-a1c46ef4bab0 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:15.905009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b6e0-a981-4da1-a263-a1c46ef4bab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:15.905435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790b6e0-a981-4da1-a263-a1c46ef4bab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:15.908145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1790b6e0-a981-4da1-a263-a1c46ef4bab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:15.924084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790b6e0-a981-4da1-a263-a1c46ef4bab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:15.926091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790b6e0-a981-4da1-a263-a1c46ef4bab0 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:15.944065 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2369/4768] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:16.396585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b31064-36b7-4d52-a138-34a75a9f15f1 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:16.426426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b31064-36b7-4d52-a138-34a75a9f15f1 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:16.441370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812bbda-104c-482b-be1b-640e8305d56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:16.442229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812bbda-104c-482b-be1b-640e8305d56a service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:16.442724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812bbda-104c-482b-be1b-640e8305d56a service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:16.443000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812bbda-104c-482b-be1b-640e8305d56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:16.446419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7812bbda-104c-482b-be1b-640e8305d56a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:16.468772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812bbda-104c-482b-be1b-640e8305d56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:16.470664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812bbda-104c-482b-be1b-640e8305d56a service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:16.489197 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2400/4769] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:22.229690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a940-791e-4910-9e7b-3908f03d0cd5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:22.230395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a940-791e-4910-9e7b-3908f03d0cd5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:22.230961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a940-791e-4910-9e7b-3908f03d0cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:22.286311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7802a940-791e-4910-9e7b-3908f03d0cd5 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:22.288887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7802a940-791e-4910-9e7b-3908f03d0cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:22.304828 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2370/4770] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:38:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:22.323603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812bbda-104c-482b-be1b-640e8305d56a service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:22.347999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812bbda-104c-482b-be1b-640e8305d56a service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:22.357728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33bc0a-1959-4c9c-9918-cb55ec71a1d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:22.358650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33bc0a-1959-4c9c-9918-cb55ec71a1d7 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:22.359143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33bc0a-1959-4c9c-9918-cb55ec71a1d7 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:22.359599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33bc0a-1959-4c9c-9918-cb55ec71a1d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:22.398733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33bc0a-1959-4c9c-9918-cb55ec71a1d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:22.400837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33bc0a-1959-4c9c-9918-cb55ec71a1d7 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:22.424682 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2401/4771] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:38:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:30.829040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802a940-791e-4910-9e7b-3908f03d0cd5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:30.831783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7802a940-791e-4910-9e7b-3908f03d0cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:30.903542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802a940-791e-4910-9e7b-3908f03d0cd5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:30.919428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:30.920365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:30.920759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:30.921193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] PATH_INFO: `/v3/users/6efcc5e4e1f24d30ad164a8daa4e6d97` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:30.932937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efcc5e4e1f24d30ad164a8daa4e6d97)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:30.935200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.079234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efcc5e4e1f24d30ad164a8daa4e6d97'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:31.100525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efcc5e4e1f24d30ad164a8daa4e6d97'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:31.128254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efcc5e4e1f24d30ad164a8daa4e6d97'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:31.145754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efcc5e4e1f24d30ad164a8daa4e6d97'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:31.146452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efcc5e4e1f24d30ad164a8daa4e6d97'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:31.165597 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2371/4772] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:30 2022] DELETE /identity/v3/users/6efcc5e4e1f24d30ad164a8daa4e6d97 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:31.171549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb97e3f-c4d0-45cf-ac83-809d70080e19 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.172136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb97e3f-c4d0-45cf-ac83-809d70080e19 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.172136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb97e3f-c4d0-45cf-ac83-809d70080e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.181310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:31.219925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4fb97e3f-c4d0-45cf-ac83-809d70080e19 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:31.221212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4fb97e3f-c4d0-45cf-ac83-809d70080e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:31.344967 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2402/4773] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:31.355809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:31.361084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:31.488071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:31.616779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308575e1-7f42-4ac6-92b6-cdf955d1da2e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:31.632090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcb165-942b-4cc0-9d91-02578412f6c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:31.659507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcb165-942b-4cc0-9d91-02578412f6c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:31.660049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcb165-942b-4cc0-9d91-02578412f6c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:31.665653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcb165-942b-4cc0-9d91-02578412f6c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:31.730606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcb165-942b-4cc0-9d91-02578412f6c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:31.732471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcb165-942b-4cc0-9d91-02578412f6c5 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:31.749683 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2372/4774] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:32.279682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a521f3e-16ac-4559-96b2-120a900ca896 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:32.280253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a521f3e-16ac-4559-96b2-120a900ca896 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:32.280457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a521f3e-16ac-4559-96b2-120a900ca896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:32.335550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8a521f3e-16ac-4559-96b2-120a900ca896 None None] MFA Rules not processed for user `c08bbaf86cc944dbaa12cc20224b0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:32.337639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8a521f3e-16ac-4559-96b2-120a900ca896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:32.488805 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2403/4775] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:38:32.554277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcb165-942b-4cc0-9d91-02578412f6c5 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:32.558338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-79fcb165-942b-4cc0-9d91-02578412f6c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:32.646719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcb165-942b-4cc0-9d91-02578412f6c5 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:32.695632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:32.697120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:32.697856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:32.698575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] PATH_INFO: `/v3/projects/4b059e29f41146389231ec9b6bcb565f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:32.702326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b059e29f41146389231ec9b6bcb565f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:32.707731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:32.872388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b059e29f41146389231ec9b6bcb565f', 'request_id': 'req-70f6ac4e-0865-4d55-9fff-8863a4a969a2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:32.919887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b059e29f41146389231ec9b6bcb565f', 'request_id': 'req-70f6ac4e-0865-4d55-9fff-8863a4a969a2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:33.031358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b059e29f41146389231ec9b6bcb565f', 'request_id': 'req-70f6ac4e-0865-4d55-9fff-8863a4a969a2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:33.091058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] The token cache is being invalidate because project 4b059e29f41146389231ec9b6bcb565f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:33.092226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:33.093775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-70f6ac4e-0865-4d55-9fff-8863a4a969a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:33.110059 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2373/4776] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:32 2022] DELETE /identity/v3/projects/4b059e29f41146389231ec9b6bcb565f => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:33.115817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd93f3-5361-4783-9377-a38e18eed0aa None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:33.117571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd93f3-5361-4783-9377-a38e18eed0aa None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:33.117973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd93f3-5361-4783-9377-a38e18eed0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:33.241223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-08dd93f3-5361-4783-9377-a38e18eed0aa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:33.247329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-08dd93f3-5361-4783-9377-a38e18eed0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:33.497915 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2404/4777] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:33.507266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bdb6f-159b-4ea4-84e5-ce724803bfd2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:33.507818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bdb6f-159b-4ea4-84e5-ce724803bfd2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:33.508355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bdb6f-159b-4ea4-84e5-ce724803bfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:33.561687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd69de4-8037-4481-b9ab-254a559196fd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:33.562928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd69de4-8037-4481-b9ab-254a559196fd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:33.563707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd69de4-8037-4481-b9ab-254a559196fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:33.576410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a81bdb6f-159b-4ea4-84e5-ce724803bfd2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:33.583938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a81bdb6f-159b-4ea4-84e5-ce724803bfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:33.632311 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2374/4778] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:33.634702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bdb6f-159b-4ea4-84e5-ce724803bfd2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:33.644838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ecd69de4-8037-4481-b9ab-254a559196fd None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:33.648678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ecd69de4-8037-4481-b9ab-254a559196fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:33.667935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bdb6f-159b-4ea4-84e5-ce724803bfd2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:33.694251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55508ce-3e13-482f-97a4-6aa01da5f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:33.695808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55508ce-3e13-482f-97a4-6aa01da5f7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:33.696433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55508ce-3e13-482f-97a4-6aa01da5f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:33.696966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55508ce-3e13-482f-97a4-6aa01da5f7e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:33.698202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55508ce-3e13-482f-97a4-6aa01da5f7e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:38:33.700094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55508ce-3e13-482f-97a4-6aa01da5f7e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:33.703043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55508ce-3e13-482f-97a4-6aa01da5f7e5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:33.750640 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2375/4779] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:38:33.752672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55508ce-3e13-482f-97a4-6aa01da5f7e5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:33.777017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55508ce-3e13-482f-97a4-6aa01da5f7e5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:33.797983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad11a17-8bc3-49d5-b716-003c9a875055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:33.798731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad11a17-8bc3-49d5-b716-003c9a875055 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:33.799466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad11a17-8bc3-49d5-b716-003c9a875055 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:33.799818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad11a17-8bc3-49d5-b716-003c9a875055 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:33.800855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad11a17-8bc3-49d5-b716-003c9a875055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:33.806027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:33.807009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad11a17-8bc3-49d5-b716-003c9a875055 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:33.848759 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2405/4780] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:38:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:33.874188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd69de4-8037-4481-b9ab-254a559196fd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:33.877748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ecd69de4-8037-4481-b9ab-254a559196fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:33.935650 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2376/4781] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:33 2022] POST /identity/v3/projects => generated 389 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:33.937999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad11a17-8bc3-49d5-b716-003c9a875055 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:34.102275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd69de4-8037-4481-b9ab-254a559196fd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:34.193994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad11a17-8bc3-49d5-b716-003c9a875055 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:34.210303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b50eba-50cf-40fd-a7bd-c1beca49c8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:34.211050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b50eba-50cf-40fd-a7bd-c1beca49c8dc admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:34.211391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b50eba-50cf-40fd-a7bd-c1beca49c8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:34.211722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b50eba-50cf-40fd-a7bd-c1beca49c8dc admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:34.212545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b50eba-50cf-40fd-a7bd-c1beca49c8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:34.215071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b50eba-50cf-40fd-a7bd-c1beca49c8dc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:34.223042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c5dd5-ebbf-402c-9ae1-b3c3e6f31e43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:34.223986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c5dd5-ebbf-402c-9ae1-b3c3e6f31e43 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:34.225359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c5dd5-ebbf-402c-9ae1-b3c3e6f31e43 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:34.225836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c5dd5-ebbf-402c-9ae1-b3c3e6f31e43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:34.277260 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2377/4782] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:33 2022] POST /identity/v3/users => generated 295 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:38:34.279278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b50eba-50cf-40fd-a7bd-c1beca49c8dc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:34.308179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:34.315871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b50eba-50cf-40fd-a7bd-c1beca49c8dc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:34.329795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59569041-e02d-4e25-aaf2-d7fdb672b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:34.332040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59569041-e02d-4e25-aaf2-d7fdb672b9bc admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:34.332421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59569041-e02d-4e25-aaf2-d7fdb672b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:34.332794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59569041-e02d-4e25-aaf2-d7fdb672b9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:34.333576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59569041-e02d-4e25-aaf2-d7fdb672b9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:34.335391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59569041-e02d-4e25-aaf2-d7fdb672b9bc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:34.349826 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2378/4783] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:34.353775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59569041-e02d-4e25-aaf2-d7fdb672b9bc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:34.380499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59569041-e02d-4e25-aaf2-d7fdb672b9bc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:34.393184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320007-9d0f-4476-99bb-a43b62fb5fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:34.394149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320007-9d0f-4476-99bb-a43b62fb5fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:34.395205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320007-9d0f-4476-99bb-a43b62fb5fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:34.395576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7320007-9d0f-4476-99bb-a43b62fb5fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:34.396413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7320007-9d0f-4476-99bb-a43b62fb5fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:34.400386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7320007-9d0f-4476-99bb-a43b62fb5fc2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:34.405278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c5dd5-ebbf-402c-9ae1-b3c3e6f31e43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:34.410966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c5dd5-ebbf-402c-9ae1-b3c3e6f31e43 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:34.429806 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2379/4784] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:34.435259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320007-9d0f-4476-99bb-a43b62fb5fc2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:34.438482 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2406/4785] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:38:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:38:34.457020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7320007-9d0f-4476-99bb-a43b62fb5fc2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:34.469736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1398001-ea43-420a-be27-afa0789abb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:34.472185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1398001-ea43-420a-be27-afa0789abb6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:34.477444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1398001-ea43-420a-be27-afa0789abb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:34.477444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1398001-ea43-420a-be27-afa0789abb6e admin admin] PATH_INFO: `/v3/projects/623bea31e9f14e3ab8c4a1a55e07e115/users/e3487e2a3e5c48f1b35f904ba31938bc/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:34.517217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1398001-ea43-420a-be27-afa0789abb6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=623bea31e9f14e3ab8c4a1a55e07e115, user_id=e3487e2a3e5c48f1b35f904ba31938bc, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:34.521223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1398001-ea43-420a-be27-afa0789abb6e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:34.552409 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2380/4786] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:34 2022] PUT /identity/v3/projects/623bea31e9f14e3ab8c4a1a55e07e115/users/e3487e2a3e5c48f1b35f904ba31938bc/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:34.566875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347802a9-06ae-4fdb-8fcb-f332d4cb19d7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:34.567470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347802a9-06ae-4fdb-8fcb-f332d4cb19d7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:34.567788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347802a9-06ae-4fdb-8fcb-f332d4cb19d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:34.658972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-347802a9-06ae-4fdb-8fcb-f332d4cb19d7 None None] MFA Rules not processed for user `e3487e2a3e5c48f1b35f904ba31938bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:34.661216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-347802a9-06ae-4fdb-8fcb-f332d4cb19d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:34.805339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:34.937862 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2407/4787] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:34.972821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1398001-ea43-420a-be27-afa0789abb6e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:34.975560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a1398001-ea43-420a-be27-afa0789abb6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:35.205978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1398001-ea43-420a-be27-afa0789abb6e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:35.219073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea7aa7-2780-4b98-a960-4bd59a0f7627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:35.219529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7aa7-2780-4b98-a960-4bd59a0f7627 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:35.219873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7aa7-2780-4b98-a960-4bd59a0f7627 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:35.223587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea7aa7-2780-4b98-a960-4bd59a0f7627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:35.232493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea7aa7-2780-4b98-a960-4bd59a0f7627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:35.234307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea7aa7-2780-4b98-a960-4bd59a0f7627 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:35.245915 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2381/4788] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:37.173750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347802a9-06ae-4fdb-8fcb-f332d4cb19d7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:37.177529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-347802a9-06ae-4fdb-8fcb-f332d4cb19d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:37.405459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347802a9-06ae-4fdb-8fcb-f332d4cb19d7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:37.432787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:37.433913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:37.435247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:37.440343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] PATH_INFO: `/v3/users/3e14014b0314462d885a4c84bb207920` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:37.446725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e14014b0314462d885a4c84bb207920)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:37.452739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:37.576045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea7aa7-2780-4b98-a960-4bd59a0f7627 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:37.578477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1fea7aa7-2780-4b98-a960-4bd59a0f7627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:37.604275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea7aa7-2780-4b98-a960-4bd59a0f7627 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:37.606671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e14014b0314462d885a4c84bb207920'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:37.607805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e14014b0314462d885a4c84bb207920'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:37.621231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399604fd-a359-40bc-9ec7-10a3847dc9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:37.623757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399604fd-a359-40bc-9ec7-10a3847dc9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:37.624028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399604fd-a359-40bc-9ec7-10a3847dc9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:37.628880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399604fd-a359-40bc-9ec7-10a3847dc9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:37.631946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e14014b0314462d885a4c84bb207920'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:37.644461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-399604fd-a359-40bc-9ec7-10a3847dc9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:37.646123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e14014b0314462d885a4c84bb207920'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:37.689128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-00444472-da87-4b08-8015-e7ca16aac660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e14014b0314462d885a4c84bb207920'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:37.711487 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2408/4789] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:37 2022] DELETE /identity/v3/users/3e14014b0314462d885a4c84bb207920 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:37.717629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446f75f-712e-47d5-97ea-69191d63b0ba None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:37.718776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446f75f-712e-47d5-97ea-69191d63b0ba None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:37.719195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446f75f-712e-47d5-97ea-69191d63b0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:37.769083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e446f75f-712e-47d5-97ea-69191d63b0ba None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:37.783009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e446f75f-712e-47d5-97ea-69191d63b0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:37.856864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399604fd-a359-40bc-9ec7-10a3847dc9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:37.859016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399604fd-a359-40bc-9ec7-10a3847dc9e2 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:37.902959 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2382/4790] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:37.933820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:38.036734 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2409/4791] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:38.132349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399604fd-a359-40bc-9ec7-10a3847dc9e2 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:38.149539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399604fd-a359-40bc-9ec7-10a3847dc9e2 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:38.375976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:38.416253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e7b4-3693-490f-ac67-87cb0808f574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:38.419014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e7b4-3693-490f-ac67-87cb0808f574 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:38.419972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e7b4-3693-490f-ac67-87cb0808f574 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:38.420740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561e7b4-3693-490f-ac67-87cb0808f574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:38.467393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e7b4-3693-490f-ac67-87cb0808f574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:38.471191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561e7b4-3693-490f-ac67-87cb0808f574 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:38.518965 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2383/4792] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:40.224021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446f75f-712e-47d5-97ea-69191d63b0ba None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:40.238853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e446f75f-712e-47d5-97ea-69191d63b0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:40.277993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446f75f-712e-47d5-97ea-69191d63b0ba None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:40.314609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:40.315978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:40.316481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:40.316979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] PATH_INFO: `/v3/projects/7280b24a18eb44e8b6696200148f2239` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:40.318602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7280b24a18eb44e8b6696200148f2239)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:40.320875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:40.513132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7280b24a18eb44e8b6696200148f2239', 'request_id': 'req-2bfef100-c33b-4ee0-888c-3536912f7c84'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.536109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7280b24a18eb44e8b6696200148f2239', 'request_id': 'req-2bfef100-c33b-4ee0-888c-3536912f7c84'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.572270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7280b24a18eb44e8b6696200148f2239', 'request_id': 'req-2bfef100-c33b-4ee0-888c-3536912f7c84'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.599599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] The token cache is being invalidate because project 7280b24a18eb44e8b6696200148f2239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:40.599902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.602563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.615399 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2410/4793] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:40 2022] DELETE /identity/v3/projects/7280b24a18eb44e8b6696200148f2239 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:40.616636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e7b4-3693-490f-ac67-87cb0808f574 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:40.647919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561e7b4-3693-490f-ac67-87cb0808f574 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:40.818857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:40.819576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:40.819856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:40.820134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] PATH_INFO: `/v3/users/da8eed2613eb47cdaf48ca0503891f3d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:40.824042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8eed2613eb47cdaf48ca0503891f3d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:40.828750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:40.965282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8eed2613eb47cdaf48ca0503891f3d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:40.991639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8eed2613eb47cdaf48ca0503891f3d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:41.026826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8eed2613eb47cdaf48ca0503891f3d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:41.038970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8eed2613eb47cdaf48ca0503891f3d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:41.039622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca1c3e72-cc49-44ad-bc41-5c311645bfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8eed2613eb47cdaf48ca0503891f3d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:41.058566 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2384/4794] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:38:40 2022] DELETE /identity/v3/users/da8eed2613eb47cdaf48ca0503891f3d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:38:42.636164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:42.640055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:42.693154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfef100-c33b-4ee0-888c-3536912f7c84 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:42.902293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:42.903321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:42.904600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:42.904813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] PATH_INFO: `/v3/projects/c7e06952fcf4488682c8940d714816ac` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:42.906384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e06952fcf4488682c8940d714816ac)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:42.915428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:43.062117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e06952fcf4488682c8940d714816ac', 'request_id': 'req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:43.084013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e06952fcf4488682c8940d714816ac', 'request_id': 'req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:43.105286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e06952fcf4488682c8940d714816ac', 'request_id': 'req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:43.125075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:43.143762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] The token cache is being invalidate because project c7e06952fcf4488682c8940d714816ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:38:43.144082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:43.144804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fdfa3b8-82bb-44b5-89e0-70cb09dd2d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:38:43.154640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b5400-a225-4f64-9bed-327a554b6144 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:43.155684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b5400-a225-4f64-9bed-327a554b6144 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:43.155684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b5400-a225-4f64-9bed-327a554b6144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:43.158779 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2411/4795] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:38:42 2022] DELETE /identity/v3/projects/c7e06952fcf4488682c8940d714816ac => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:43.205404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8b1b5400-a225-4f64-9bed-327a554b6144 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:43.210127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8b1b5400-a225-4f64-9bed-327a554b6144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:43.406746 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2385/4796] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:43.416284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c7b1a-6e4f-4e99-8176-38f3f35e0bd1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:43.416656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c7b1a-6e4f-4e99-8176-38f3f35e0bd1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:43.416816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c7b1a-6e4f-4e99-8176-38f3f35e0bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:43.485280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-763c7b1a-6e4f-4e99-8176-38f3f35e0bd1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:43.514089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-763c7b1a-6e4f-4e99-8176-38f3f35e0bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:43.549081 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2412/4797] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:43.549389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b5400-a225-4f64-9bed-327a554b6144 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:43.563062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b5400-a225-4f64-9bed-327a554b6144 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:43.586752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6f0f-a61f-479e-9b0c-7ed2a0496e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:43.587661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6f0f-a61f-479e-9b0c-7ed2a0496e4a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:43.587945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6f0f-a61f-479e-9b0c-7ed2a0496e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:43.588219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6f0f-a61f-479e-9b0c-7ed2a0496e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:43.588910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f6f0f-a61f-479e-9b0c-7ed2a0496e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:38:43.589214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f6f0f-a61f-479e-9b0c-7ed2a0496e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:43.591671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f6f0f-a61f-479e-9b0c-7ed2a0496e4a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:43.599702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:43.636561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c7b1a-6e4f-4e99-8176-38f3f35e0bd1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:43.654260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c7b1a-6e4f-4e99-8176-38f3f35e0bd1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:43.656098 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2386/4798] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:38:43.677088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a843c-ab4d-49e1-a57c-08b6940c6ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:43.677803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a843c-ab4d-49e1-a57c-08b6940c6ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:43.678173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a843c-ab4d-49e1-a57c-08b6940c6ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:43.678452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a843c-ab4d-49e1-a57c-08b6940c6ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:43.679248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a843c-ab4d-49e1-a57c-08b6940c6ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:43.685170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a843c-ab4d-49e1-a57c-08b6940c6ab6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:43.809252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6f0f-a61f-479e-9b0c-7ed2a0496e4a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:43.821411 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2413/4799] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:38:43 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:43.826655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6f0f-a61f-479e-9b0c-7ed2a0496e4a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:44.008764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc52e-56c0-41a3-be6b-ac990fd82fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:44.008764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc52e-56c0-41a3-be6b-ac990fd82fab admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:44.008764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc52e-56c0-41a3-be6b-ac990fd82fab admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:44.008764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecc52e-56c0-41a3-be6b-ac990fd82fab admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:44.009327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecc52e-56c0-41a3-be6b-ac990fd82fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:44.009327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecc52e-56c0-41a3-be6b-ac990fd82fab admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:44.071690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a843c-ab4d-49e1-a57c-08b6940c6ab6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:44.084062 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2387/4800] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:38:43 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:38:44.088944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a843c-ab4d-49e1-a57c-08b6940c6ab6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:44.103108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad40ee8-3b6b-4ccb-885b-7f05b38c4f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:44.104103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad40ee8-3b6b-4ccb-885b-7f05b38c4f16 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:44.106902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad40ee8-3b6b-4ccb-885b-7f05b38c4f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:44.107449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad40ee8-3b6b-4ccb-885b-7f05b38c4f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:44.108723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad40ee8-3b6b-4ccb-885b-7f05b38c4f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:44.119708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad40ee8-3b6b-4ccb-885b-7f05b38c4f16 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:44.163531 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2414/4801] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:44.170257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc52e-56c0-41a3-be6b-ac990fd82fab admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:44.209808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecc52e-56c0-41a3-be6b-ac990fd82fab admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:44.237663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c31519-8891-47b8-b238-d40470d41af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:44.238442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31519-8891-47b8-b238-d40470d41af1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:44.238845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31519-8891-47b8-b238-d40470d41af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:44.239228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31519-8891-47b8-b238-d40470d41af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:44.240002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c31519-8891-47b8-b238-d40470d41af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:44.256610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c31519-8891-47b8-b238-d40470d41af1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:44.313786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad40ee8-3b6b-4ccb-885b-7f05b38c4f16 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:44.324833 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2388/4802] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:38:44.348777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad40ee8-3b6b-4ccb-885b-7f05b38c4f16 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:44.356785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f07af6-44c1-40f5-84ab-4002c398ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:44.359002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07af6-44c1-40f5-84ab-4002c398ffa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:44.359505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07af6-44c1-40f5-84ab-4002c398ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:44.359948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f07af6-44c1-40f5-84ab-4002c398ffa3 admin admin] PATH_INFO: `/v3/projects/0616b3ca803f413f84fbea36f84a55e6/users/4fd789489a1a43c49ba4d27586616294/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:44.384229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f07af6-44c1-40f5-84ab-4002c398ffa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0616b3ca803f413f84fbea36f84a55e6, user_id=4fd789489a1a43c49ba4d27586616294, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:44.388029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f07af6-44c1-40f5-84ab-4002c398ffa3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:44.441077 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2415/4803] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:38:44 2022] PUT /identity/v3/projects/0616b3ca803f413f84fbea36f84a55e6/users/4fd789489a1a43c49ba4d27586616294/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:38:44.445948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8718c-90f6-4f30-a425-edcad2771732 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:44.446135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8718c-90f6-4f30-a425-edcad2771732 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:44.446638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8718c-90f6-4f30-a425-edcad2771732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:44.476136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f07af6-44c1-40f5-84ab-4002c398ffa3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:44.481591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-20f07af6-44c1-40f5-84ab-4002c398ffa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:44.556111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4cd8718c-90f6-4f30-a425-edcad2771732 None None] MFA Rules not processed for user `4fd789489a1a43c49ba4d27586616294`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:38:44.557494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4cd8718c-90f6-4f30-a425-edcad2771732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:44.655853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f07af6-44c1-40f5-84ab-4002c398ffa3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:44.667119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda20af-bc19-4b0f-ba8b-a42d05befaa8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:44.668260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda20af-bc19-4b0f-ba8b-a42d05befaa8 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:44.670547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda20af-bc19-4b0f-ba8b-a42d05befaa8 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:44.673355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda20af-bc19-4b0f-ba8b-a42d05befaa8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:44.679431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ecda20af-bc19-4b0f-ba8b-a42d05befaa8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:44.794836 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2389/4804] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:38:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:38:44.811368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8718c-90f6-4f30-a425-edcad2771732 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:44.813051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4cd8718c-90f6-4f30-a425-edcad2771732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:44.827819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda20af-bc19-4b0f-ba8b-a42d05befaa8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:44.830779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda20af-bc19-4b0f-ba8b-a42d05befaa8 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:44.851430 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2416/4805] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:38:45.059442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8718c-90f6-4f30-a425-edcad2771732 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:45.083066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e12b2e-65e3-47a8-9052-4d44d0dce3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:45.083443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12b2e-65e3-47a8-9052-4d44d0dce3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:45.083726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12b2e-65e3-47a8-9052-4d44d0dce3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:45.083983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12b2e-65e3-47a8-9052-4d44d0dce3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:45.107030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e12b2e-65e3-47a8-9052-4d44d0dce3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:45.111362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e12b2e-65e3-47a8-9052-4d44d0dce3b9 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:45.155862 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2390/4806] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:38:54.843663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=81,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:55.122645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:57.703931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda20af-bc19-4b0f-ba8b-a42d05befaa8 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:38:57.705930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ecda20af-bc19-4b0f-ba8b-a42d05befaa8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:57.723352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda20af-bc19-4b0f-ba8b-a42d05befaa8 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:38:57.730051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc0776-4071-4c2e-b1ee-946b1c7ff70a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:38:57.730681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc0776-4071-4c2e-b1ee-946b1c7ff70a service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:38:57.730955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc0776-4071-4c2e-b1ee-946b1c7ff70a service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:38:57.731232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc0776-4071-4c2e-b1ee-946b1c7ff70a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:38:57.737444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-15bc0776-4071-4c2e-b1ee-946b1c7ff70a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:38:57.809223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc0776-4071-4c2e-b1ee-946b1c7ff70a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:38:57.810903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc0776-4071-4c2e-b1ee-946b1c7ff70a service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:38:57.823806 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2417/4807] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:38:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:39:00.158403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688a999-73fc-4e09-b914-7d0a4c025357 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:00.158973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688a999-73fc-4e09-b914-7d0a4c025357 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:00.158973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688a999-73fc-4e09-b914-7d0a4c025357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:00.186302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3688a999-73fc-4e09-b914-7d0a4c025357 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:00.187833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3688a999-73fc-4e09-b914-7d0a4c025357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:00.288578 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2391/4808] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:39:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:00.307347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc0776-4071-4c2e-b1ee-946b1c7ff70a service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:00.309454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-15bc0776-4071-4c2e-b1ee-946b1c7ff70a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:00.461859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc0776-4071-4c2e-b1ee-946b1c7ff70a service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:00.468838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56087-1bbb-4f40-b053-ca4e72f33602 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:00.469750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56087-1bbb-4f40-b053-ca4e72f33602 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:00.470212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56087-1bbb-4f40-b053-ca4e72f33602 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:00.470626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56087-1bbb-4f40-b053-ca4e72f33602 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:00.482105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f56087-1bbb-4f40-b053-ca4e72f33602 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:00.486692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f56087-1bbb-4f40-b053-ca4e72f33602 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:00.498405 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2418/4809] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:39:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:02.018304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688a999-73fc-4e09-b914-7d0a4c025357 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:02.020638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3688a999-73fc-4e09-b914-7d0a4c025357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:02.199231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3688a999-73fc-4e09-b914-7d0a4c025357 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:02.214161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234e90d-563a-41da-a432-81e78d618279 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:02.215621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234e90d-563a-41da-a432-81e78d618279 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:02.216066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234e90d-563a-41da-a432-81e78d618279 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:02.216546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234e90d-563a-41da-a432-81e78d618279 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:02.218694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e234e90d-563a-41da-a432-81e78d618279 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:02.237191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234e90d-563a-41da-a432-81e78d618279 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:02.239436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234e90d-563a-41da-a432-81e78d618279 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:02.255969 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2392/4810] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:39:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:39:08.215143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56087-1bbb-4f40-b053-ca4e72f33602 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:08.218960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-16f56087-1bbb-4f40-b053-ca4e72f33602 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:08.315050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234e90d-563a-41da-a432-81e78d618279 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:08.316586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e234e90d-563a-41da-a432-81e78d618279 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:08.340918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234e90d-563a-41da-a432-81e78d618279 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:08.352574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfe0a3-9328-47c1-a8b2-ae3907cf52b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:08.353496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe0a3-9328-47c1-a8b2-ae3907cf52b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:08.354471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe0a3-9328-47c1-a8b2-ae3907cf52b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:08.355289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe0a3-9328-47c1-a8b2-ae3907cf52b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:08.359913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e7dfe0a3-9328-47c1-a8b2-ae3907cf52b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:08.385072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfe0a3-9328-47c1-a8b2-ae3907cf52b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:08.385989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56087-1bbb-4f40-b053-ca4e72f33602 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:08.390521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfe0a3-9328-47c1-a8b2-ae3907cf52b1 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:08.397052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:08.397797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:08.398148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:08.398760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] PATH_INFO: `/v3/users/e3487e2a3e5c48f1b35f904ba31938bc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:08.400625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3487e2a3e5c48f1b35f904ba31938bc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:08.405159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:08.412437 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2393/4811] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:39:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:39:08.512078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:08.551332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3487e2a3e5c48f1b35f904ba31938bc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:08.552111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3487e2a3e5c48f1b35f904ba31938bc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:08.569460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3487e2a3e5c48f1b35f904ba31938bc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:08.601640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3487e2a3e5c48f1b35f904ba31938bc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:08.626531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3487e2a3e5c48f1b35f904ba31938bc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:08.633583 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2419/4812] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:39:08 2022] DELETE /identity/v3/users/e3487e2a3e5c48f1b35f904ba31938bc => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:39:08.639935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856c8f4-d80b-4a94-95e6-a60997b6c02b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:08.640263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856c8f4-d80b-4a94-95e6-a60997b6c02b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:08.640617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856c8f4-d80b-4a94-95e6-a60997b6c02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:08.673455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1856c8f4-d80b-4a94-95e6-a60997b6c02b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:08.675295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1856c8f4-d80b-4a94-95e6-a60997b6c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:08.797112 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2394/4813] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:08.804046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:08.808510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:08.901631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2c084-cf8d-4756-938d-bf1e1804ceea admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:08.907045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476518bc-20b4-459a-a181-b99758619eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:08.908428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476518bc-20b4-459a-a181-b99758619eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:08.908812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476518bc-20b4-459a-a181-b99758619eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:08.909183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476518bc-20b4-459a-a181-b99758619eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:08.932710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476518bc-20b4-459a-a181-b99758619eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:08.934394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476518bc-20b4-459a-a181-b99758619eb4 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:08.964025 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2420/4814] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:39:09.223540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856c8f4-d80b-4a94-95e6-a60997b6c02b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:09.226810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1856c8f4-d80b-4a94-95e6-a60997b6c02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:09.262096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856c8f4-d80b-4a94-95e6-a60997b6c02b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:09.276368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:09.277103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:09.277447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:09.277783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] PATH_INFO: `/v3/projects/623bea31e9f14e3ab8c4a1a55e07e115` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:09.280699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=623bea31e9f14e3ab8c4a1a55e07e115)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:09.285169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:09.345430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:09.421025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '623bea31e9f14e3ab8c4a1a55e07e115', 'request_id': 'req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:09.449906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '623bea31e9f14e3ab8c4a1a55e07e115', 'request_id': 'req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:09.469941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '623bea31e9f14e3ab8c4a1a55e07e115', 'request_id': 'req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:09.509075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] The token cache is being invalidate because project 623bea31e9f14e3ab8c4a1a55e07e115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:39:09.509513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:09.510350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d73de9f7-19b8-43ee-96c1-94ecaf7e71f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:09.524047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd863f-ef4f-49dc-a021-718433650a1e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:09.524604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd863f-ef4f-49dc-a021-718433650a1e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:09.525624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd863f-ef4f-49dc-a021-718433650a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:09.543112 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2395/4815] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:39:09 2022] DELETE /identity/v3/projects/623bea31e9f14e3ab8c4a1a55e07e115 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:39:09.594897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-97bd863f-ef4f-49dc-a021-718433650a1e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:09.599574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-97bd863f-ef4f-49dc-a021-718433650a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:09.741345 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2421/4816] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:09.748793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f7893-979d-4ec3-917b-016877a9b04d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:09.749438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f7893-979d-4ec3-917b-016877a9b04d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:09.750466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f7893-979d-4ec3-917b-016877a9b04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:09.790177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-856f7893-979d-4ec3-917b-016877a9b04d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:09.794688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-856f7893-979d-4ec3-917b-016877a9b04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:09.818519 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2396/4817] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:09.823009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd863f-ef4f-49dc-a021-718433650a1e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:09.836641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd863f-ef4f-49dc-a021-718433650a1e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:09.860998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033403b-66ef-44c6-8481-5ea9c9d54f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:09.861705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033403b-66ef-44c6-8481-5ea9c9d54f65 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:09.862019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033403b-66ef-44c6-8481-5ea9c9d54f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:09.862292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033403b-66ef-44c6-8481-5ea9c9d54f65 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:09.868352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033403b-66ef-44c6-8481-5ea9c9d54f65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:39:09.868721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033403b-66ef-44c6-8481-5ea9c9d54f65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:09.870837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033403b-66ef-44c6-8481-5ea9c9d54f65 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:09.910753 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2422/4818] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:39:09.911418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f7893-979d-4ec3-917b-016877a9b04d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:09.921431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f7893-979d-4ec3-917b-016877a9b04d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:09.936531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479bad3-29a9-4ed2-a152-91be6d7be488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:09.937396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479bad3-29a9-4ed2-a152-91be6d7be488 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:09.937686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479bad3-29a9-4ed2-a152-91be6d7be488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:09.938088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479bad3-29a9-4ed2-a152-91be6d7be488 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:09.938849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479bad3-29a9-4ed2-a152-91be6d7be488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:09.940795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479bad3-29a9-4ed2-a152-91be6d7be488 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:10.011187 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2397/4819] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:39:09 2022] POST /identity/v3/projects => generated 357 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:39:10.015848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033403b-66ef-44c6-8481-5ea9c9d54f65 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:10.031421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033403b-66ef-44c6-8481-5ea9c9d54f65 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:10.141201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:10.241908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b638c-1894-41a7-bbf7-f0d99c163ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:10.244133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b638c-1894-41a7-bbf7-f0d99c163ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:10.244512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b638c-1894-41a7-bbf7-f0d99c163ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:10.246356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b638c-1894-41a7-bbf7-f0d99c163ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:10.247122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b638c-1894-41a7-bbf7-f0d99c163ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:10.254916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b638c-1894-41a7-bbf7-f0d99c163ce0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:10.317137 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2423/4820] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:39:10 2022] POST /identity/v3/users => generated 279 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:39:10.318371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479bad3-29a9-4ed2-a152-91be6d7be488 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:10.330044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479bad3-29a9-4ed2-a152-91be6d7be488 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:10.376984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e74376-1316-4d28-bb69-c8e6a0bea001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:10.377723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74376-1316-4d28-bb69-c8e6a0bea001 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:10.378040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74376-1316-4d28-bb69-c8e6a0bea001 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:10.378234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74376-1316-4d28-bb69-c8e6a0bea001 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:10.378927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e74376-1316-4d28-bb69-c8e6a0bea001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:10.380770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e74376-1316-4d28-bb69-c8e6a0bea001 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:10.399248 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2398/4821] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:39:10.401023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b638c-1894-41a7-bbf7-f0d99c163ce0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:10.414185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b638c-1894-41a7-bbf7-f0d99c163ce0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:10.460694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c0f1-f70e-4573-8372-85125316ee9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:10.461258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c0f1-f70e-4573-8372-85125316ee9d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:10.461539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c0f1-f70e-4573-8372-85125316ee9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:10.461813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c0f1-f70e-4573-8372-85125316ee9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:10.475545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c0f1-f70e-4573-8372-85125316ee9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:10.484637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c0f1-f70e-4573-8372-85125316ee9d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:10.516436 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2424/4822] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:39:10.521389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e74376-1316-4d28-bb69-c8e6a0bea001 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:10.539757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e74376-1316-4d28-bb69-c8e6a0bea001 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:10.576103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272cb5b-ccc2-4f65-885a-99114bf57032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:10.587257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272cb5b-ccc2-4f65-885a-99114bf57032 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:10.587898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272cb5b-ccc2-4f65-885a-99114bf57032 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:10.588493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272cb5b-ccc2-4f65-885a-99114bf57032 admin admin] PATH_INFO: `/v3/projects/798b37af0ba1447baf912866be1e3427/users/c04d0e4c2aa842d6b878ffd39e04a7a8/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:10.637211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272cb5b-ccc2-4f65-885a-99114bf57032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=798b37af0ba1447baf912866be1e3427, user_id=c04d0e4c2aa842d6b878ffd39e04a7a8, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:10.655772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272cb5b-ccc2-4f65-885a-99114bf57032 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:10.680228 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2399/4823] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:39:10 2022] PUT /identity/v3/projects/798b37af0ba1447baf912866be1e3427/users/c04d0e4c2aa842d6b878ffd39e04a7a8/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:39:10.693090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311b632-36dd-4454-8d36-86071417f11b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:10.697190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311b632-36dd-4454-8d36-86071417f11b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:10.697695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311b632-36dd-4454-8d36-86071417f11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:10.774660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4ab44-48d7-490f-b4ae-e23d37e43092 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:10.774964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4ab44-48d7-490f-b4ae-e23d37e43092 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:10.776484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4ab44-48d7-490f-b4ae-e23d37e43092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:10.811483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0311b632-36dd-4454-8d36-86071417f11b None None] MFA Rules not processed for user `c04d0e4c2aa842d6b878ffd39e04a7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:10.820240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-54d4ab44-48d7-490f-b4ae-e23d37e43092 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:10.821039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0311b632-36dd-4454-8d36-86071417f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:10.823682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-54d4ab44-48d7-490f-b4ae-e23d37e43092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:11.006347 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2425/4824] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:11.028091 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2400/4825] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:39:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:11.038591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311b632-36dd-4454-8d36-86071417f11b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:11.042544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0311b632-36dd-4454-8d36-86071417f11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:11.065990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4ab44-48d7-490f-b4ae-e23d37e43092 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:11.067554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-54d4ab44-48d7-490f-b4ae-e23d37e43092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:11.155639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:11.197834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4ab44-48d7-490f-b4ae-e23d37e43092 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:11.204912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e415c-1e45-4911-8679-c20b74efcb34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:11.206444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e415c-1e45-4911-8679-c20b74efcb34 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:11.207112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e415c-1e45-4911-8679-c20b74efcb34 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:11.207499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e415c-1e45-4911-8679-c20b74efcb34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:11.225656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e415c-1e45-4911-8679-c20b74efcb34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:11.227908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e415c-1e45-4911-8679-c20b74efcb34 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:11.240524 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2401/4826] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:39:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:11.242372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311b632-36dd-4454-8d36-86071417f11b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:11.262958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a6bd9-62e4-49f3-b824-ac078380d45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:11.263933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a6bd9-62e4-49f3-b824-ac078380d45a service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:11.264414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a6bd9-62e4-49f3-b824-ac078380d45a service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:11.264845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a6bd9-62e4-49f3-b824-ac078380d45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:11.294124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a6bd9-62e4-49f3-b824-ac078380d45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:11.295790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a6bd9-62e4-49f3-b824-ac078380d45a service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:11.318785 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2426/4827] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:39:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:39:18.041347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e415c-1e45-4911-8679-c20b74efcb34 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:18.043889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8c4e415c-1e45-4911-8679-c20b74efcb34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:18.293927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e415c-1e45-4911-8679-c20b74efcb34 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:18.306045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:18.307047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:18.307525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:18.308024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] PATH_INFO: `/v3/users/4fd789489a1a43c49ba4d27586616294` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:18.310514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd789489a1a43c49ba4d27586616294)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:18.314149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:18.416251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd789489a1a43c49ba4d27586616294'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:18.427014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd789489a1a43c49ba4d27586616294'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:18.459293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd789489a1a43c49ba4d27586616294'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:18.475345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd789489a1a43c49ba4d27586616294'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:18.476376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd789489a1a43c49ba4d27586616294'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:18.488038 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2402/4828] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:39:18 2022] DELETE /identity/v3/users/4fd789489a1a43c49ba4d27586616294 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:39:18.492946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e1e8-dceb-4aa9-8635-43cb698eebb7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:18.493506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e1e8-dceb-4aa9-8635-43cb698eebb7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:18.493506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486e1e8-dceb-4aa9-8635-43cb698eebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:18.563676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2486e1e8-dceb-4aa9-8635-43cb698eebb7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:18.564936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2486e1e8-dceb-4aa9-8635-43cb698eebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:18.689095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:18.728429 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2427/4829] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:39:18.734949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:18.737248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:18.914758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28352a9-ff8f-46e7-a4b7-a995e141b313 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:18.919360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eadb2f-8ab5-4d2a-a9e7-1f09e2d509a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:18.920172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eadb2f-8ab5-4d2a-a9e7-1f09e2d509a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:18.920661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eadb2f-8ab5-4d2a-a9e7-1f09e2d509a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:18.921035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eadb2f-8ab5-4d2a-a9e7-1f09e2d509a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:18.950675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eadb2f-8ab5-4d2a-a9e7-1f09e2d509a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:18.954440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eadb2f-8ab5-4d2a-a9e7-1f09e2d509a2 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:18.960776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:18.981726 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2403/4830] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:39:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:39:19.426221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e1e8-dceb-4aa9-8635-43cb698eebb7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:19.428107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2486e1e8-dceb-4aa9-8635-43cb698eebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:19.455507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486e1e8-dceb-4aa9-8635-43cb698eebb7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:19.482158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:19.483174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:19.483489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:19.483757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] PATH_INFO: `/v3/projects/0616b3ca803f413f84fbea36f84a55e6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:19.491676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0616b3ca803f413f84fbea36f84a55e6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:19.493970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:19.674375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0616b3ca803f413f84fbea36f84a55e6', 'request_id': 'req-083d4e0c-0810-4225-8406-682047d01ad0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:19.696422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0616b3ca803f413f84fbea36f84a55e6', 'request_id': 'req-083d4e0c-0810-4225-8406-682047d01ad0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:19.713469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0616b3ca803f413f84fbea36f84a55e6', 'request_id': 'req-083d4e0c-0810-4225-8406-682047d01ad0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:19.730840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] The token cache is being invalidate because project 0616b3ca803f413f84fbea36f84a55e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:39:19.731131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:19.737175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083d4e0c-0810-4225-8406-682047d01ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:39:19.745834 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2428/4831] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:39:19 2022] DELETE /identity/v3/projects/0616b3ca803f413f84fbea36f84a55e6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:39:19.747571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7a552-612a-496f-a3a1-daaeaec8cc4b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:19.748820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7a552-612a-496f-a3a1-daaeaec8cc4b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:19.749309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7a552-612a-496f-a3a1-daaeaec8cc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:19.803477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c7a7a552-612a-496f-a3a1-daaeaec8cc4b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:19.807692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c7a7a552-612a-496f-a3a1-daaeaec8cc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:20.005596 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2404/4832] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:20.007532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a399812-7724-4ff9-8d23-62be9e2d2c53 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:20.007992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a399812-7724-4ff9-8d23-62be9e2d2c53 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:20.008416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a399812-7724-4ff9-8d23-62be9e2d2c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:20.030263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7a399812-7724-4ff9-8d23-62be9e2d2c53 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:20.031839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7a399812-7724-4ff9-8d23-62be9e2d2c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:20.045280 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2429/4833] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:20.046782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7a552-612a-496f-a3a1-daaeaec8cc4b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:20.071481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7a552-612a-496f-a3a1-daaeaec8cc4b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:20.085076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f97f8-9e45-4e40-a5e9-6402810a5e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:20.086089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f97f8-9e45-4e40-a5e9-6402810a5e19 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:20.086643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f97f8-9e45-4e40-a5e9-6402810a5e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:20.087253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f97f8-9e45-4e40-a5e9-6402810a5e19 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:20.088346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f97f8-9e45-4e40-a5e9-6402810a5e19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:39:20.088826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f97f8-9e45-4e40-a5e9-6402810a5e19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:20.092172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f97f8-9e45-4e40-a5e9-6402810a5e19 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:20.133551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a399812-7724-4ff9-8d23-62be9e2d2c53 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:20.143355 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2405/4834] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:39:20.146821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a399812-7724-4ff9-8d23-62be9e2d2c53 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:20.160834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dded16d-7c54-4d70-9d6b-e72ecbf697de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:20.161752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dded16d-7c54-4d70-9d6b-e72ecbf697de admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:20.162200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dded16d-7c54-4d70-9d6b-e72ecbf697de admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:20.162928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dded16d-7c54-4d70-9d6b-e72ecbf697de admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:20.164919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dded16d-7c54-4d70-9d6b-e72ecbf697de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:20.167212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dded16d-7c54-4d70-9d6b-e72ecbf697de admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:20.243133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f97f8-9e45-4e40-a5e9-6402810a5e19 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:20.248630 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2430/4835] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:39:20 2022] POST /identity/v3/projects => generated 361 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:39:20.261560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f97f8-9e45-4e40-a5e9-6402810a5e19 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:20.363922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e645439-d9f8-4540-a74d-49266fe6bb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:20.364861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e645439-d9f8-4540-a74d-49266fe6bb05 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:20.365241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e645439-d9f8-4540-a74d-49266fe6bb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:20.365611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e645439-d9f8-4540-a74d-49266fe6bb05 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:20.366386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e645439-d9f8-4540-a74d-49266fe6bb05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:20.368997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e645439-d9f8-4540-a74d-49266fe6bb05 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:20.429664 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2406/4836] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:39:20 2022] POST /identity/v3/users => generated 281 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:39:20.432437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dded16d-7c54-4d70-9d6b-e72ecbf697de admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:20.458456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dded16d-7c54-4d70-9d6b-e72ecbf697de admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:20.476271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e8be9-591a-4f0a-9ec4-ef08e5882d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:20.478053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8be9-591a-4f0a-9ec4-ef08e5882d83 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:20.478436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8be9-591a-4f0a-9ec4-ef08e5882d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:20.478714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e8be9-591a-4f0a-9ec4-ef08e5882d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:20.479394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e8be9-591a-4f0a-9ec4-ef08e5882d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:20.486536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e8be9-591a-4f0a-9ec4-ef08e5882d83 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:20.511229 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2431/4837] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:39:20.513917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e645439-d9f8-4540-a74d-49266fe6bb05 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:20.530399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e645439-d9f8-4540-a74d-49266fe6bb05 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:20.541526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b23b8-2524-423e-b8bd-e6f2388c3b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:20.542191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b23b8-2524-423e-b8bd-e6f2388c3b45 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:20.542473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b23b8-2524-423e-b8bd-e6f2388c3b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:20.542748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b23b8-2524-423e-b8bd-e6f2388c3b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:20.543407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b23b8-2524-423e-b8bd-e6f2388c3b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:20.550287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b23b8-2524-423e-b8bd-e6f2388c3b45 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:20.585372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2407/4838] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:39:20.591012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e8be9-591a-4f0a-9ec4-ef08e5882d83 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:20.606026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e8be9-591a-4f0a-9ec4-ef08e5882d83 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:20.614189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83933b-542e-4eea-871e-2c9f4f166050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:20.614992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83933b-542e-4eea-871e-2c9f4f166050 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:20.615283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83933b-542e-4eea-871e-2c9f4f166050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:20.615706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83933b-542e-4eea-871e-2c9f4f166050 admin admin] PATH_INFO: `/v3/projects/b63700c0b3854dd09e71ad657cf125f0/users/0909f4eed303436c89cb253c2b44c52c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:20.647359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83933b-542e-4eea-871e-2c9f4f166050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63700c0b3854dd09e71ad657cf125f0, user_id=0909f4eed303436c89cb253c2b44c52c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:20.650464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83933b-542e-4eea-871e-2c9f4f166050 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:20.708068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f55bee-8302-4921-80ac-d9ead99d8655 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:20.708613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f55bee-8302-4921-80ac-d9ead99d8655 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:20.709059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f55bee-8302-4921-80ac-d9ead99d8655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:20.712684 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2432/4839] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:39:20 2022] PUT /identity/v3/projects/b63700c0b3854dd09e71ad657cf125f0/users/0909f4eed303436c89cb253c2b44c52c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:39:20.777208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b4f55bee-8302-4921-80ac-d9ead99d8655 None None] MFA Rules not processed for user `0909f4eed303436c89cb253c2b44c52c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:20.778921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b4f55bee-8302-4921-80ac-d9ead99d8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:21.071456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:21.130594 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2408/4840] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:39:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:21.155754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83933b-542e-4eea-871e-2c9f4f166050 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:21.158015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1b83933b-542e-4eea-871e-2c9f4f166050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:21.344706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83933b-542e-4eea-871e-2c9f4f166050 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:21.354528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71be50e-91db-4bc0-800e-51bee44b7120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:21.355191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be50e-91db-4bc0-800e-51bee44b7120 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:21.355474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be50e-91db-4bc0-800e-51bee44b7120 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:21.355806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71be50e-91db-4bc0-800e-51bee44b7120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:21.379803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71be50e-91db-4bc0-800e-51bee44b7120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:21.381316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71be50e-91db-4bc0-800e-51bee44b7120 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:21.407787 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2433/4841] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:39:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:39:24.053110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422664-e86d-4da5-a1b7-e25a0a6a2658 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:24.053701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422664-e86d-4da5-a1b7-e25a0a6a2658 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:24.053701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae422664-e86d-4da5-a1b7-e25a0a6a2658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:24.086614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ae422664-e86d-4da5-a1b7-e25a0a6a2658 None None] MFA Rules not processed for user `c08bbaf86cc944dbaa12cc20224b0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:24.087854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ae422664-e86d-4da5-a1b7-e25a0a6a2658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:24.226215 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2409/4842] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:39:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:31.392250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:33.445773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9058-c8f0-4427-b163-1c0cfc075547 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:33.446907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9058-c8f0-4427-b163-1c0cfc075547 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:33.447331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9058-c8f0-4427-b163-1c0cfc075547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:33.474590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-396e9058-c8f0-4427-b163-1c0cfc075547 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:33.476134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-396e9058-c8f0-4427-b163-1c0cfc075547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:33.584407 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2434/4843] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:39:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:39:33.601061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae422664-e86d-4da5-a1b7-e25a0a6a2658 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:33.603111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ae422664-e86d-4da5-a1b7-e25a0a6a2658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:33.803599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae422664-e86d-4da5-a1b7-e25a0a6a2658 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:33.822088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b6092-5c6e-4bf5-ac12-c32f55721872 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:33.822737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b6092-5c6e-4bf5-ac12-c32f55721872 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:33.823018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b6092-5c6e-4bf5-ac12-c32f55721872 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:33.823296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b6092-5c6e-4bf5-ac12-c32f55721872 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:33.846977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b6092-5c6e-4bf5-ac12-c32f55721872 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:33.848660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b6092-5c6e-4bf5-ac12-c32f55721872 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:33.858432 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2410/4844] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:39:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:42.272407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e9058-c8f0-4427-b163-1c0cfc075547 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:42.275226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-396e9058-c8f0-4427-b163-1c0cfc075547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:42.301177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e9058-c8f0-4427-b163-1c0cfc075547 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:42.317857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9d7ef-2fd8-4452-8c70-f4c62306d9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:42.318743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d7ef-2fd8-4452-8c70-f4c62306d9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:42.319320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d7ef-2fd8-4452-8c70-f4c62306d9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:42.320058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9d7ef-2fd8-4452-8c70-f4c62306d9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:42.327389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6ce9d7ef-2fd8-4452-8c70-f4c62306d9c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:42.357310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9d7ef-2fd8-4452-8c70-f4c62306d9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:42.358738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9d7ef-2fd8-4452-8c70-f4c62306d9c2 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:42.397190 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2435/4845] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:39:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:39:43.279783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b6092-5c6e-4bf5-ac12-c32f55721872 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:39:43.281493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6b0b6092-5c6e-4bf5-ac12-c32f55721872 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:43.526591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b6092-5c6e-4bf5-ac12-c32f55721872 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:39:43.541165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dc04d-e846-4530-9cc4-a7c5bc803ed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:39:43.542572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dc04d-e846-4530-9cc4-a7c5bc803ed9 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:43.545519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dc04d-e846-4530-9cc4-a7c5bc803ed9 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:43.546371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dc04d-e846-4530-9cc4-a7c5bc803ed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:43.551104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bf4dc04d-e846-4530-9cc4-a7c5bc803ed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:43.599694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dc04d-e846-4530-9cc4-a7c5bc803ed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:39:43.601550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dc04d-e846-4530-9cc4-a7c5bc803ed9 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:39:43.691439 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2411/4846] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:39:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:39:52.087524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740a5d7-910f-4f59-8570-46df073af89d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:39:52.088110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740a5d7-910f-4f59-8570-46df073af89d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:39:52.088110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740a5d7-910f-4f59-8570-46df073af89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:39:52.155986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c740a5d7-910f-4f59-8570-46df073af89d None None] MFA Rules not processed for user `c08bbaf86cc944dbaa12cc20224b0f50`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:39:52.159262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c740a5d7-910f-4f59-8570-46df073af89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:39:52.177114 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2436/4847] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:39:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:39:53.661708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:02.142961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=34 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:07.632784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dc04d-e846-4530-9cc4-a7c5bc803ed9 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:07.635188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bf4dc04d-e846-4530-9cc4-a7c5bc803ed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:07.672875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dc04d-e846-4530-9cc4-a7c5bc803ed9 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:07.691758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63171e2a-b3cd-49cb-ac74-34cbbdbbcc4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:07.692774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63171e2a-b3cd-49cb-ac74-34cbbdbbcc4b service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:07.694459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63171e2a-b3cd-49cb-ac74-34cbbdbbcc4b service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:07.695016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63171e2a-b3cd-49cb-ac74-34cbbdbbcc4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:07.697220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-63171e2a-b3cd-49cb-ac74-34cbbdbbcc4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:07.722816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63171e2a-b3cd-49cb-ac74-34cbbdbbcc4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:07.724872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63171e2a-b3cd-49cb-ac74-34cbbdbbcc4b service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:07.770247 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2412/4848] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:08.156791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d377b6-fd3b-4e39-a08a-e978dc81a392 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:08.158009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d377b6-fd3b-4e39-a08a-e978dc81a392 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:08.158435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d377b6-fd3b-4e39-a08a-e978dc81a392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:08.203018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a7d377b6-fd3b-4e39-a08a-e978dc81a392 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:08.206970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a7d377b6-fd3b-4e39-a08a-e978dc81a392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:08.249643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63171e2a-b3cd-49cb-ac74-34cbbdbbcc4b service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:08.252125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2437/4849] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:40:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:08.267809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63171e2a-b3cd-49cb-ac74-34cbbdbbcc4b service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:08.280134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc5ace-76bd-4690-8ae0-118250729f87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:08.284176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc5ace-76bd-4690-8ae0-118250729f87 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:08.284714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc5ace-76bd-4690-8ae0-118250729f87 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:08.285189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc5ace-76bd-4690-8ae0-118250729f87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:08.305670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc5ace-76bd-4690-8ae0-118250729f87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:08.307662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc5ace-76bd-4690-8ae0-118250729f87 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:08.317712 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2413/4850] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:40:08.867963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a88b5d-26e4-4546-b796-ba68a452acc7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:08.868246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a88b5d-26e4-4546-b796-ba68a452acc7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:08.868738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a88b5d-26e4-4546-b796-ba68a452acc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:08.943100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e4a88b5d-26e4-4546-b796-ba68a452acc7 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:08.944660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e4a88b5d-26e4-4546-b796-ba68a452acc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:08.986175 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2438/4851] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:40:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:09.003497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc5ace-76bd-4690-8ae0-118250729f87 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:09.026506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc5ace-76bd-4690-8ae0-118250729f87 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:09.038040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0c3f9-dda4-4d65-9979-b9a1625fddc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:09.039694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0c3f9-dda4-4d65-9979-b9a1625fddc2 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:09.040145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0c3f9-dda4-4d65-9979-b9a1625fddc2 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:09.041903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0c3f9-dda4-4d65-9979-b9a1625fddc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:09.070680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0c3f9-dda4-4d65-9979-b9a1625fddc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:09.075633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0c3f9-dda4-4d65-9979-b9a1625fddc2 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:09.096150 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2414/4852] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:09.792988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa70742-e3b2-427b-950b-d71fc8e84371 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:09.793984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa70742-e3b2-427b-950b-d71fc8e84371 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:09.794409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa70742-e3b2-427b-950b-d71fc8e84371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:09.834796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1aa70742-e3b2-427b-950b-d71fc8e84371 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:09.836302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1aa70742-e3b2-427b-950b-d71fc8e84371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:09.859517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0c3f9-dda4-4d65-9979-b9a1625fddc2 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:09.870257 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2439/4853] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:40:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:09.873308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0c3f9-dda4-4d65-9979-b9a1625fddc2 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:09.879609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee71ac-2510-46ff-9cd9-7f6f303436d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:09.880234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee71ac-2510-46ff-9cd9-7f6f303436d2 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:09.880509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee71ac-2510-46ff-9cd9-7f6f303436d2 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:09.880774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee71ac-2510-46ff-9cd9-7f6f303436d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:09.892894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee71ac-2510-46ff-9cd9-7f6f303436d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:09.895084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee71ac-2510-46ff-9cd9-7f6f303436d2 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:09.925490 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2415/4854] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:40:13.178249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa70742-e3b2-427b-950b-d71fc8e84371 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:13.200959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa70742-e3b2-427b-950b-d71fc8e84371 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:13.210172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102800d-409b-4de6-b027-b3c72fa7d8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:13.210806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102800d-409b-4de6-b027-b3c72fa7d8bd service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:13.211082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102800d-409b-4de6-b027-b3c72fa7d8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:13.211346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102800d-409b-4de6-b027-b3c72fa7d8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:13.220528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b102800d-409b-4de6-b027-b3c72fa7d8bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:13.420997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102800d-409b-4de6-b027-b3c72fa7d8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:13.422634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102800d-409b-4de6-b027-b3c72fa7d8bd service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:13.436423 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2440/4855] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:40:19.900641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=24 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:20.928372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1b9d-7810-4e58-a43b-9bf699f6fbbb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:20.929554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1b9d-7810-4e58-a43b-9bf699f6fbbb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:20.929744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a1b9d-7810-4e58-a43b-9bf699f6fbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:20.982435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4a0a1b9d-7810-4e58-a43b-9bf699f6fbbb None None] MFA Rules not processed for user `95df76be403a478aa03361450ea1b130`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:20.986662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4a0a1b9d-7810-4e58-a43b-9bf699f6fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:21.020934 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2416/4856] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:22.795461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102800d-409b-4de6-b027-b3c72fa7d8bd service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:22.807113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102800d-409b-4de6-b027-b3c72fa7d8bd service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:22.821580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ab0e-abe4-498c-ba9d-f90e54d1cda1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:22.822728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ab0e-abe4-498c-ba9d-f90e54d1cda1 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:22.823140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ab0e-abe4-498c-ba9d-f90e54d1cda1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:22.823505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ab0e-abe4-498c-ba9d-f90e54d1cda1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:22.825614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-66c8ab0e-abe4-498c-ba9d-f90e54d1cda1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:22.912540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8ab0e-abe4-498c-ba9d-f90e54d1cda1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:22.914455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8ab0e-abe4-498c-ba9d-f90e54d1cda1 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:22.928047 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2441/4857] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:40:23.109606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b3dcb-5da4-4d73-a419-93a05c023658 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:23.110597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b3dcb-5da4-4d73-a419-93a05c023658 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:23.111019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b3dcb-5da4-4d73-a419-93a05c023658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:23.148814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8d2b3dcb-5da4-4d73-a419-93a05c023658 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:23.150415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8d2b3dcb-5da4-4d73-a419-93a05c023658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:23.168460 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2417/4858] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:40:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:23.196758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ab0e-abe4-498c-ba9d-f90e54d1cda1 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:23.221410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ab0e-abe4-498c-ba9d-f90e54d1cda1 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:23.227026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70787af-adb2-444e-a722-c0f74d10354d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:23.227921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70787af-adb2-444e-a722-c0f74d10354d service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:23.228759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70787af-adb2-444e-a722-c0f74d10354d service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:23.228759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70787af-adb2-444e-a722-c0f74d10354d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:23.250606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70787af-adb2-444e-a722-c0f74d10354d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:23.257775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70787af-adb2-444e-a722-c0f74d10354d service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:23.272638 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2442/4859] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:23.538216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6adbb-96ab-4673-b8b8-e028c3d38d79 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:23.538502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6adbb-96ab-4673-b8b8-e028c3d38d79 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:23.538791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6adbb-96ab-4673-b8b8-e028c3d38d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:23.583635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d8c6adbb-96ab-4673-b8b8-e028c3d38d79 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:23.585076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d8c6adbb-96ab-4673-b8b8-e028c3d38d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:23.606096 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2418/4860] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:40:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:23.621677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70787af-adb2-444e-a722-c0f74d10354d service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:23.640656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70787af-adb2-444e-a722-c0f74d10354d service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:23.655645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb09f25-fbce-405f-8cc0-126c4a3d2494 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:23.656121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb09f25-fbce-405f-8cc0-126c4a3d2494 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:23.656395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb09f25-fbce-405f-8cc0-126c4a3d2494 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:23.656667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb09f25-fbce-405f-8cc0-126c4a3d2494 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:23.675388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb09f25-fbce-405f-8cc0-126c4a3d2494 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:23.677000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb09f25-fbce-405f-8cc0-126c4a3d2494 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:23.696352 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2443/4861] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:24.010520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952277b9-83f6-41d4-b589-70f5ed12bfb0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:24.011273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952277b9-83f6-41d4-b589-70f5ed12bfb0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:24.011794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952277b9-83f6-41d4-b589-70f5ed12bfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:24.042523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-952277b9-83f6-41d4-b589-70f5ed12bfb0 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:24.044718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-952277b9-83f6-41d4-b589-70f5ed12bfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:24.053540 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2419/4862] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:40:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:24.070375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb09f25-fbce-405f-8cc0-126c4a3d2494 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:24.088194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb09f25-fbce-405f-8cc0-126c4a3d2494 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:24.098824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe694f-46ed-4031-88c8-5cbaeabf5040 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:24.099993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe694f-46ed-4031-88c8-5cbaeabf5040 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:24.100669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe694f-46ed-4031-88c8-5cbaeabf5040 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:24.101383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe694f-46ed-4031-88c8-5cbaeabf5040 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:24.118547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe694f-46ed-4031-88c8-5cbaeabf5040 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:24.120520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe694f-46ed-4031-88c8-5cbaeabf5040 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:24.142705 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2444/4863] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:24.295785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952277b9-83f6-41d4-b589-70f5ed12bfb0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:24.297346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-952277b9-83f6-41d4-b589-70f5ed12bfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:24.317732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952277b9-83f6-41d4-b589-70f5ed12bfb0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:24.323990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:24.325232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:24.325732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:24.326592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] PATH_INFO: `/v3/users/d219e4505de3413db9db47ffe399c25f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:24.328280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d219e4505de3413db9db47ffe399c25f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:24.339731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:24.461354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd219e4505de3413db9db47ffe399c25f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:24.474517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd219e4505de3413db9db47ffe399c25f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:24.496141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd219e4505de3413db9db47ffe399c25f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:24.508029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd219e4505de3413db9db47ffe399c25f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:24.508706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd219e4505de3413db9db47ffe399c25f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:24.516745 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2420/4864] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:24 2022] DELETE /identity/v3/users/d219e4505de3413db9db47ffe399c25f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:40:24.523010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9249-eaa3-4072-bda1-e68b0da944b7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:24.523642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9249-eaa3-4072-bda1-e68b0da944b7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:24.524665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd9249-eaa3-4072-bda1-e68b0da944b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:24.598487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d7cd9249-eaa3-4072-bda1-e68b0da944b7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:24.600613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d7cd9249-eaa3-4072-bda1-e68b0da944b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:24.653757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:24.711111 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2445/4865] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:24.759236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:24.760942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:24.919100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae979f-d41d-4eeb-a7ea-228bae6a375f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:24.939499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef19aad-10dc-4e9c-8b94-efba61812d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:24.940487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef19aad-10dc-4e9c-8b94-efba61812d2e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:24.940939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef19aad-10dc-4e9c-8b94-efba61812d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:24.941375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef19aad-10dc-4e9c-8b94-efba61812d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:24.964818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef19aad-10dc-4e9c-8b94-efba61812d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:24.967228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef19aad-10dc-4e9c-8b94-efba61812d2e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:24.987713 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2421/4866] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:25.405887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd9249-eaa3-4072-bda1-e68b0da944b7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:25.407915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d7cd9249-eaa3-4072-bda1-e68b0da944b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:25.436226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd9249-eaa3-4072-bda1-e68b0da944b7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:25.446440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:25.447694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:25.448164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:25.448593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] PATH_INFO: `/v3/projects/d513cfdf50b8418aa2c6092e0c25404b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:25.450589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d513cfdf50b8418aa2c6092e0c25404b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:25.457114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:25.561455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd513cfdf50b8418aa2c6092e0c25404b', 'request_id': 'req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:25.599886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd513cfdf50b8418aa2c6092e0c25404b', 'request_id': 'req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:25.617527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd513cfdf50b8418aa2c6092e0c25404b', 'request_id': 'req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:25.654668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] The token cache is being invalidate because project d513cfdf50b8418aa2c6092e0c25404b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:25.654956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:25.655823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b0ea39b4-4668-4be9-9099-bd6d2820c5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:25.666309 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2446/4867] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:25 2022] DELETE /identity/v3/projects/d513cfdf50b8418aa2c6092e0c25404b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:25.667994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911992-b4a1-44ff-b1d6-c649ab71895e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:25.668499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911992-b4a1-44ff-b1d6-c649ab71895e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:25.668868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03911992-b4a1-44ff-b1d6-c649ab71895e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:25.719229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-03911992-b4a1-44ff-b1d6-c649ab71895e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:25.720855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-03911992-b4a1-44ff-b1d6-c649ab71895e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:25.814089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:25.880332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f0898-23d5-4b7e-9610-a435378830dc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:25.881694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f0898-23d5-4b7e-9610-a435378830dc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:25.884081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f0898-23d5-4b7e-9610-a435378830dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:25.894291 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2422/4868] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:25.925166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-932f0898-23d5-4b7e-9610-a435378830dc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:25.926935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-932f0898-23d5-4b7e-9610-a435378830dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:25.960894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03911992-b4a1-44ff-b1d6-c649ab71895e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:25.969382 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2447/4869] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:25.978548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03911992-b4a1-44ff-b1d6-c649ab71895e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:25.989912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f0898-23d5-4b7e-9610-a435378830dc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:25.991734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-932f0898-23d5-4b7e-9610-a435378830dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:25.999954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66b334-b438-474d-ba01-cc55a4daa8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:26.013639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66b334-b438-474d-ba01-cc55a4daa8bc admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:26.013639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66b334-b438-474d-ba01-cc55a4daa8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:26.013639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb66b334-b438-474d-ba01-cc55a4daa8bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:26.013639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66b334-b438-474d-ba01-cc55a4daa8bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:40:26.013639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66b334-b438-474d-ba01-cc55a4daa8bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:26.013639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb66b334-b438-474d-ba01-cc55a4daa8bc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:26.023287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f0898-23d5-4b7e-9610-a435378830dc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:26.041170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:26.042135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:26.042598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:26.043024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] PATH_INFO: `/v3/users/0909f4eed303436c89cb253c2b44c52c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:26.044178 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2423/4870] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:26.046980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0909f4eed303436c89cb253c2b44c52c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:26.049354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66b334-b438-474d-ba01-cc55a4daa8bc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:26.050893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:26.090006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb66b334-b438-474d-ba01-cc55a4daa8bc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:26.103053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bc367-25d5-4e9f-87cb-7b94a95be19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:26.104036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bc367-25d5-4e9f-87cb-7b94a95be19b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:26.104528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bc367-25d5-4e9f-87cb-7b94a95be19b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:26.104962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371bc367-25d5-4e9f-87cb-7b94a95be19b admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:26.117761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bc367-25d5-4e9f-87cb-7b94a95be19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:26.123564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371bc367-25d5-4e9f-87cb-7b94a95be19b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:26.199389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0909f4eed303436c89cb253c2b44c52c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:26.206298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0909f4eed303436c89cb253c2b44c52c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:26.206548 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2424/4871] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:26 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:26.208789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bc367-25d5-4e9f-87cb-7b94a95be19b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:26.235844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0909f4eed303436c89cb253c2b44c52c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:26.254145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0909f4eed303436c89cb253c2b44c52c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:26.283536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-810ce8f8-1c80-4c25-8e4e-70e6665bdda8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0909f4eed303436c89cb253c2b44c52c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:26.299385 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2448/4872] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:25 2022] DELETE /identity/v3/users/0909f4eed303436c89cb253c2b44c52c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:26.304298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e46615-eb8a-41a2-b8e7-3e9427ef1fa2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:26.304583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e46615-eb8a-41a2-b8e7-3e9427ef1fa2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:26.304857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e46615-eb8a-41a2-b8e7-3e9427ef1fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:26.343133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f1e46615-eb8a-41a2-b8e7-3e9427ef1fa2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:26.344112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f1e46615-eb8a-41a2-b8e7-3e9427ef1fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:26.363191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371bc367-25d5-4e9f-87cb-7b94a95be19b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:26.392173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:26.491285 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2449/4873] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:26.499406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df2415-2edb-4411-bc83-269204348c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:26.500297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df2415-2edb-4411-bc83-269204348c25 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:26.500831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df2415-2edb-4411-bc83-269204348c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:26.501302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df2415-2edb-4411-bc83-269204348c25 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:26.502219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df2415-2edb-4411-bc83-269204348c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:26.504513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df2415-2edb-4411-bc83-269204348c25 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:26.506903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e46615-eb8a-41a2-b8e7-3e9427ef1fa2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:26.508710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f1e46615-eb8a-41a2-b8e7-3e9427ef1fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:26.563854 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2425/4874] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:40:26 2022] POST /identity/v3/users => generated 293 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:26.569253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df2415-2edb-4411-bc83-269204348c25 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:26.573672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f0df2415-2edb-4411-bc83-269204348c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:26.600751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df2415-2edb-4411-bc83-269204348c25 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:26.609172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a43ad-6dc9-42f9-acc5-b862d3f2d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:26.611735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a43ad-6dc9-42f9-acc5-b862d3f2d4ff admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:26.612170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a43ad-6dc9-42f9-acc5-b862d3f2d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:26.612634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a43ad-6dc9-42f9-acc5-b862d3f2d4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:26.613527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a43ad-6dc9-42f9-acc5-b862d3f2d4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:26.616449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a43ad-6dc9-42f9-acc5-b862d3f2d4ff admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:26.632629 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2426/4875] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:26.655804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a43ad-6dc9-42f9-acc5-b862d3f2d4ff admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:26.663928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e46615-eb8a-41a2-b8e7-3e9427ef1fa2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:26.669808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360fdf3-2489-4388-ba75-408362781d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:26.670711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360fdf3-2489-4388-ba75-408362781d76 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:26.670711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360fdf3-2489-4388-ba75-408362781d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:26.671027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360fdf3-2489-4388-ba75-408362781d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:26.692411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a43ad-6dc9-42f9-acc5-b862d3f2d4ff admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:26.692967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360fdf3-2489-4388-ba75-408362781d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:26.694239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360fdf3-2489-4388-ba75-408362781d76 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:26.707940 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2450/4876] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:40:26.721659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bda90-6f40-475f-ad05-438d8f927fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:26.722563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bda90-6f40-475f-ad05-438d8f927fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:26.722918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bda90-6f40-475f-ad05-438d8f927fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:26.723267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bda90-6f40-475f-ad05-438d8f927fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:26.724379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4bda90-6f40-475f-ad05-438d8f927fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:26.728330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4bda90-6f40-475f-ad05-438d8f927fa0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:26.753770 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2427/4877] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:26.758589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360fdf3-2489-4388-ba75-408362781d76 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:26.788513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360fdf3-2489-4388-ba75-408362781d76 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:26.798400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6593-9b6e-401c-aa9f-e9efcdcef058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:26.800071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6593-9b6e-401c-aa9f-e9efcdcef058 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:26.800721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6593-9b6e-401c-aa9f-e9efcdcef058 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:26.802476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e6593-9b6e-401c-aa9f-e9efcdcef058 admin admin] PATH_INFO: `/v3/projects/4bf5bda171b849528d67c842b672e5c6/users/4515f0eb1c794afeb9879aa36f44685c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:26.844004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e6593-9b6e-401c-aa9f-e9efcdcef058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf5bda171b849528d67c842b672e5c6, user_id=4515f0eb1c794afeb9879aa36f44685c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:26.856036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e6593-9b6e-401c-aa9f-e9efcdcef058 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:26.885205 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2451/4878] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:26 2022] PUT /identity/v3/projects/4bf5bda171b849528d67c842b672e5c6/users/4515f0eb1c794afeb9879aa36f44685c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:26.897835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2d96-4150-4a78-8bb3-37e80aa7a8d9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:26.898158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2d96-4150-4a78-8bb3-37e80aa7a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:26.898429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb2d96-4150-4a78-8bb3-37e80aa7a8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:26.971082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b8bb2d96-4150-4a78-8bb3-37e80aa7a8d9 None None] MFA Rules not processed for user `4515f0eb1c794afeb9879aa36f44685c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:26.973189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8bb2d96-4150-4a78-8bb3-37e80aa7a8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:27.020105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:27.147495 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2428/4879] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:27.158576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6593-9b6e-401c-aa9f-e9efcdcef058 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:27.160510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4d5e6593-9b6e-401c-aa9f-e9efcdcef058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:27.315954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e6593-9b6e-401c-aa9f-e9efcdcef058 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:27.324116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fb428-2a55-4653-8d19-52b50620caaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:27.325199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb428-2a55-4653-8d19-52b50620caaf service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:27.325397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb428-2a55-4653-8d19-52b50620caaf service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:27.325734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb428-2a55-4653-8d19-52b50620caaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:27.343604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fb428-2a55-4653-8d19-52b50620caaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:27.345248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fb428-2a55-4653-8d19-52b50620caaf service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:27.363314 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2452/4880] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:40:27.883344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb2d96-4150-4a78-8bb3-37e80aa7a8d9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:27.885199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8bb2d96-4150-4a78-8bb3-37e80aa7a8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:28.071367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb2d96-4150-4a78-8bb3-37e80aa7a8d9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:28.091127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:28.091979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:28.092367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:28.092746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] PATH_INFO: `/v3/projects/b63700c0b3854dd09e71ad657cf125f0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:28.095106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63700c0b3854dd09e71ad657cf125f0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:28.097201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:28.293118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63700c0b3854dd09e71ad657cf125f0', 'request_id': 'req-b618242b-490c-48a2-9acb-1075766b6018'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:28.319388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63700c0b3854dd09e71ad657cf125f0', 'request_id': 'req-b618242b-490c-48a2-9acb-1075766b6018'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:28.348141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63700c0b3854dd09e71ad657cf125f0', 'request_id': 'req-b618242b-490c-48a2-9acb-1075766b6018'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:28.406389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] The token cache is being invalidate because project b63700c0b3854dd09e71ad657cf125f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:28.406839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:28.409079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b618242b-490c-48a2-9acb-1075766b6018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:28.415641 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2429/4881] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:27 2022] DELETE /identity/v3/projects/b63700c0b3854dd09e71ad657cf125f0 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:28.419749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010023-b9b6-49f3-9662-d36d68a12bfc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:28.420282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010023-b9b6-49f3-9662-d36d68a12bfc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:28.420282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04010023-b9b6-49f3-9662-d36d68a12bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:28.498280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-04010023-b9b6-49f3-9662-d36d68a12bfc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:28.505804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-04010023-b9b6-49f3-9662-d36d68a12bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:28.573097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:28.658344 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2453/4882] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:28.665373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70368a31-3972-46ac-8504-58a65cacff32 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:28.665674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70368a31-3972-46ac-8504-58a65cacff32 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:28.665976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70368a31-3972-46ac-8504-58a65cacff32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:28.720750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-70368a31-3972-46ac-8504-58a65cacff32 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:28.733469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-70368a31-3972-46ac-8504-58a65cacff32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:28.758918 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2430/4883] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:28.759730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04010023-b9b6-49f3-9662-d36d68a12bfc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:28.775905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04010023-b9b6-49f3-9662-d36d68a12bfc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:28.808011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110fb50-6c85-4ce5-8b62-d607139cda1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:28.808658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110fb50-6c85-4ce5-8b62-d607139cda1e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:28.809148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110fb50-6c85-4ce5-8b62-d607139cda1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:28.809485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110fb50-6c85-4ce5-8b62-d607139cda1e admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:28.810461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110fb50-6c85-4ce5-8b62-d607139cda1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:40:28.810768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110fb50-6c85-4ce5-8b62-d607139cda1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:28.812423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e110fb50-6c85-4ce5-8b62-d607139cda1e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:28.842632 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2454/4884] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:28.847197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70368a31-3972-46ac-8504-58a65cacff32 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:28.858277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70368a31-3972-46ac-8504-58a65cacff32 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:28.883105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d706e-e376-41db-9bf9-fbeef02ba4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:28.883430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d706e-e376-41db-9bf9-fbeef02ba4ac admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:28.883953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d706e-e376-41db-9bf9-fbeef02ba4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:28.883953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d706e-e376-41db-9bf9-fbeef02ba4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:28.884542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d706e-e376-41db-9bf9-fbeef02ba4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:28.893370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d706e-e376-41db-9bf9-fbeef02ba4ac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:29.021649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110fb50-6c85-4ce5-8b62-d607139cda1e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:29.029708 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2431/4885] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:28 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:40:29.036192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110fb50-6c85-4ce5-8b62-d607139cda1e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:29.045962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d706e-e376-41db-9bf9-fbeef02ba4ac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:29.050809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bd3d706e-e376-41db-9bf9-fbeef02ba4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:29.139408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:29.318199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389be2-7a7a-408a-83f4-4843f73cc521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:29.319082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389be2-7a7a-408a-83f4-4843f73cc521 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:29.319542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389be2-7a7a-408a-83f4-4843f73cc521 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:29.319856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48389be2-7a7a-408a-83f4-4843f73cc521 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:29.321199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48389be2-7a7a-408a-83f4-4843f73cc521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:29.323422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48389be2-7a7a-408a-83f4-4843f73cc521 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:29.335097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d706e-e376-41db-9bf9-fbeef02ba4ac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:29.344899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:29.346308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:29.346587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:29.347329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] PATH_INFO: `/v3/users/4515f0eb1c794afeb9879aa36f44685c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:29.356621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4515f0eb1c794afeb9879aa36f44685c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:29.363271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:29.395464 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2455/4886] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:40:29 2022] POST /identity/v3/users => generated 286 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:29.401274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389be2-7a7a-408a-83f4-4843f73cc521 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:29.442236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48389be2-7a7a-408a-83f4-4843f73cc521 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:29.462798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5d59-a25b-4d65-8b07-87e7ff017ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:29.463431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5d59-a25b-4d65-8b07-87e7ff017ffd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:29.463909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5d59-a25b-4d65-8b07-87e7ff017ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:29.464486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a5d59-a25b-4d65-8b07-87e7ff017ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:29.466321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a5d59-a25b-4d65-8b07-87e7ff017ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:29.471353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a5d59-a25b-4d65-8b07-87e7ff017ffd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:29.512282 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2456/4887] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:29.516170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5d59-a25b-4d65-8b07-87e7ff017ffd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:29.532368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4515f0eb1c794afeb9879aa36f44685c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:29.536530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a5d59-a25b-4d65-8b07-87e7ff017ffd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:29.540644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4515f0eb1c794afeb9879aa36f44685c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:29.549198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854ae4f-d3a0-44fd-8926-b546cca68b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:29.551925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854ae4f-d3a0-44fd-8926-b546cca68b89 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:29.552374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854ae4f-d3a0-44fd-8926-b546cca68b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:29.552826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854ae4f-d3a0-44fd-8926-b546cca68b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:29.556486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4515f0eb1c794afeb9879aa36f44685c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:29.556894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854ae4f-d3a0-44fd-8926-b546cca68b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:29.560336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854ae4f-d3a0-44fd-8926-b546cca68b89 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:29.566739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4515f0eb1c794afeb9879aa36f44685c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:29.567675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69ef37b1-4ccf-41de-9d2c-2f4a0b077aaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4515f0eb1c794afeb9879aa36f44685c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:29.576798 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2432/4888] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:29 2022] DELETE /identity/v3/users/4515f0eb1c794afeb9879aa36f44685c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:29.582279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62988-c8f0-4d3d-96da-d1f6df462cd1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:29.584129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62988-c8f0-4d3d-96da-d1f6df462cd1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:29.585333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62988-c8f0-4d3d-96da-d1f6df462cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:29.603197 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2457/4889] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:29.607698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854ae4f-d3a0-44fd-8926-b546cca68b89 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:29.615942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1854ae4f-d3a0-44fd-8926-b546cca68b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:29.640707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-64d62988-c8f0-4d3d-96da-d1f6df462cd1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:29.646147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-64d62988-c8f0-4d3d-96da-d1f6df462cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:29.648306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854ae4f-d3a0-44fd-8926-b546cca68b89 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:29.763598 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2433/4890] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:29.790161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d62988-c8f0-4d3d-96da-d1f6df462cd1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:29.791735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-64d62988-c8f0-4d3d-96da-d1f6df462cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:29.804044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caba96e-12c2-4a7c-b215-a76a5a1e868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:29.827246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba96e-12c2-4a7c-b215-a76a5a1e868b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:29.828954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba96e-12c2-4a7c-b215-a76a5a1e868b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:29.831594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba96e-12c2-4a7c-b215-a76a5a1e868b admin admin] PATH_INFO: `/v3/projects/55f0ca8088b34b88b39d3a8b94c46657/users/110d3c39e91b4281a1fd5d881b8beeef/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:29.895546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caba96e-12c2-4a7c-b215-a76a5a1e868b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f0ca8088b34b88b39d3a8b94c46657, user_id=110d3c39e91b4281a1fd5d881b8beeef, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:29.902772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caba96e-12c2-4a7c-b215-a76a5a1e868b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:29.939639 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2458/4891] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:29 2022] PUT /identity/v3/projects/55f0ca8088b34b88b39d3a8b94c46657/users/110d3c39e91b4281a1fd5d881b8beeef/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:29.950023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e05143-afda-4068-8f54-25785881d7cd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:29.950023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e05143-afda-4068-8f54-25785881d7cd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:29.950327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e05143-afda-4068-8f54-25785881d7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:29.959043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:29.965407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:29.991533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d62988-c8f0-4d3d-96da-d1f6df462cd1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:30.017384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-83e05143-afda-4068-8f54-25785881d7cd None None] MFA Rules not processed for user `110d3c39e91b4281a1fd5d881b8beeef`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:30.019101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-83e05143-afda-4068-8f54-25785881d7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:30.113660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cd819-436c-4aa8-b2c0-aff58eca1297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:30.114800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cd819-436c-4aa8-b2c0-aff58eca1297 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:30.115249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cd819-436c-4aa8-b2c0-aff58eca1297 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:30.115684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cd819-436c-4aa8-b2c0-aff58eca1297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:30.189036 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2459/4892] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:30.207914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e05143-afda-4068-8f54-25785881d7cd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:30.221070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e05143-afda-4068-8f54-25785881d7cd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:30.232910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4b7b3-fdd2-4db4-8165-cda3decee689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:30.233579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4b7b3-fdd2-4db4-8165-cda3decee689 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:30.233845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4b7b3-fdd2-4db4-8165-cda3decee689 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:30.234290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4b7b3-fdd2-4db4-8165-cda3decee689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:30.264526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4b7b3-fdd2-4db4-8165-cda3decee689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:30.265913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4b7b3-fdd2-4db4-8165-cda3decee689 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:30.286961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cd819-436c-4aa8-b2c0-aff58eca1297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:30.294872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cd819-436c-4aa8-b2c0-aff58eca1297 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:30.296323 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2460/4893] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:40:30.318339 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2434/4894] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:40:32.384765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4b7b3-fdd2-4db4-8165-cda3decee689 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:32.392777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-abe4b7b3-fdd2-4db4-8165-cda3decee689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:32.406738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cd819-436c-4aa8-b2c0-aff58eca1297 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:32.410686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-794cd819-436c-4aa8-b2c0-aff58eca1297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:32.471955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cd819-436c-4aa8-b2c0-aff58eca1297 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:32.481927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4b7b3-fdd2-4db4-8165-cda3decee689 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:32.485244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:32.486615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:32.487414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:32.488004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] PATH_INFO: `/v3/projects/4bf5bda171b849528d67c842b672e5c6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:32.489866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf5bda171b849528d67c842b672e5c6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:32.490165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:32.490819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:32.491092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:32.491419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] PATH_INFO: `/v3/users/36bbf0c01d0148aeab626e6d1bb1f0ee` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:32.493161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:32.514765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36bbf0c01d0148aeab626e6d1bb1f0ee)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:32.517701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:32.559449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf5bda171b849528d67c842b672e5c6', 'request_id': 'req-35520a59-1b77-45fb-967a-2518d93fd142'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:32.572247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf5bda171b849528d67c842b672e5c6', 'request_id': 'req-35520a59-1b77-45fb-967a-2518d93fd142'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:32.581838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf5bda171b849528d67c842b672e5c6', 'request_id': 'req-35520a59-1b77-45fb-967a-2518d93fd142'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:32.606033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36bbf0c01d0148aeab626e6d1bb1f0ee'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:32.607718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36bbf0c01d0148aeab626e6d1bb1f0ee'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:32.613512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] The token cache is being invalidate because project 4bf5bda171b849528d67c842b672e5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:32.614120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:32.615070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35520a59-1b77-45fb-967a-2518d93fd142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:32.622226 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2435/4895] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:32 2022] DELETE /identity/v3/projects/4bf5bda171b849528d67c842b672e5c6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:40:32.624991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2986a46-7f7c-4d6a-a9fc-5ecafc92107a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:32.625474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2986a46-7f7c-4d6a-a9fc-5ecafc92107a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:32.625957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2986a46-7f7c-4d6a-a9fc-5ecafc92107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:32.629125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36bbf0c01d0148aeab626e6d1bb1f0ee'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:32.647420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36bbf0c01d0148aeab626e6d1bb1f0ee'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:32.667457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f2986a46-7f7c-4d6a-a9fc-5ecafc92107a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:32.669218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b78bcf2c-9350-4a4d-af41-3d87cfc79d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36bbf0c01d0148aeab626e6d1bb1f0ee'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:32.670094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f2986a46-7f7c-4d6a-a9fc-5ecafc92107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:32.684136 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2461/4896] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:32 2022] DELETE /identity/v3/users/36bbf0c01d0148aeab626e6d1bb1f0ee => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:40:32.725450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:32.799503 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2436/4897] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:32.807329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbe9f5-756f-4d7d-90dd-10670a0efac1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:32.807646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbe9f5-756f-4d7d-90dd-10670a0efac1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:32.807886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbe9f5-756f-4d7d-90dd-10670a0efac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:32.840093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0bbbe9f5-756f-4d7d-90dd-10670a0efac1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:32.841362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0bbbe9f5-756f-4d7d-90dd-10670a0efac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:32.897227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:32.902623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2986a46-7f7c-4d6a-a9fc-5ecafc92107a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:32.904330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f2986a46-7f7c-4d6a-a9fc-5ecafc92107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:32.970407 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2462/4898] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:32.974702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbe9f5-756f-4d7d-90dd-10670a0efac1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:32.986280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbe9f5-756f-4d7d-90dd-10670a0efac1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:32.992397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46966064-40b2-4dcc-b995-ded57f4d0f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:32.993424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966064-40b2-4dcc-b995-ded57f4d0f13 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:32.994021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966064-40b2-4dcc-b995-ded57f4d0f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:32.994464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46966064-40b2-4dcc-b995-ded57f4d0f13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:32.995309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46966064-40b2-4dcc-b995-ded57f4d0f13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:40:32.995789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46966064-40b2-4dcc-b995-ded57f4d0f13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:32.997704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46966064-40b2-4dcc-b995-ded57f4d0f13 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:33.013588 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2463/4899] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:33.017246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46966064-40b2-4dcc-b995-ded57f4d0f13 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:33.044630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46966064-40b2-4dcc-b995-ded57f4d0f13 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:33.048590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2986a46-7f7c-4d6a-a9fc-5ecafc92107a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:33.056237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7808e-416d-4098-821b-c95649c9c1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:33.057260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7808e-416d-4098-821b-c95649c9c1e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.057716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7808e-416d-4098-821b-c95649c9c1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.058177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7808e-416d-4098-821b-c95649c9c1e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.059302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7808e-416d-4098-821b-c95649c9c1e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:33.062179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7808e-416d-4098-821b-c95649c9c1e9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:33.114977 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2464/4900] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:33 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:33.118530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7808e-416d-4098-821b-c95649c9c1e9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:33.171245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63543905-8371-483b-9364-fc3594d1dd7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:33.176820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63543905-8371-483b-9364-fc3594d1dd7f service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.177198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63543905-8371-483b-9364-fc3594d1dd7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.179688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63543905-8371-483b-9364-fc3594d1dd7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.183403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-63543905-8371-483b-9364-fc3594d1dd7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:33.204481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63543905-8371-483b-9364-fc3594d1dd7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:33.207884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63543905-8371-483b-9364-fc3594d1dd7f service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:33.222132 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2437/4901] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:33.223435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63543905-8371-483b-9364-fc3594d1dd7f service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:33.226265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-63543905-8371-483b-9364-fc3594d1dd7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:33.245824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63543905-8371-483b-9364-fc3594d1dd7f service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:33.310885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7808e-416d-4098-821b-c95649c9c1e9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:33.317209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d334d17-e06d-4f2e-8d83-ff9590a0d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:33.317857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d334d17-e06d-4f2e-8d83-ff9590a0d975 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.318220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d334d17-e06d-4f2e-8d83-ff9590a0d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.318496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d334d17-e06d-4f2e-8d83-ff9590a0d975 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.319321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d334d17-e06d-4f2e-8d83-ff9590a0d975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:33.321272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d334d17-e06d-4f2e-8d83-ff9590a0d975 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:33.354715 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2465/4902] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:40:33 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:33.358873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d334d17-e06d-4f2e-8d83-ff9590a0d975 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:33.376996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d334d17-e06d-4f2e-8d83-ff9590a0d975 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:33.383514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:33.384323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.384982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.385264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] PATH_INFO: `/v3/projects/f20bac72b3e549849fe2f19e9494127a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.392834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85490e0c-f290-498e-b64c-17e0ce494d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:33.393467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85490e0c-f290-498e-b64c-17e0ce494d75 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.393740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85490e0c-f290-498e-b64c-17e0ce494d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.394030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85490e0c-f290-498e-b64c-17e0ce494d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.395485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85490e0c-f290-498e-b64c-17e0ce494d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:33.400689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85490e0c-f290-498e-b64c-17e0ce494d75 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:33.413585 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2466/4903] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:33.418770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85490e0c-f290-498e-b64c-17e0ce494d75 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:33.424218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f20bac72b3e549849fe2f19e9494127a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:33.426319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:33.457197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85490e0c-f290-498e-b64c-17e0ce494d75 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:33.475973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae74e8-1b8e-481a-8cde-671047a28695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:33.476611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae74e8-1b8e-481a-8cde-671047a28695 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.476888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae74e8-1b8e-481a-8cde-671047a28695 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.477159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae74e8-1b8e-481a-8cde-671047a28695 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.477904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae74e8-1b8e-481a-8cde-671047a28695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:33.482934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae74e8-1b8e-481a-8cde-671047a28695 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:33.494509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:33.508633 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2467/4904] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:33.513961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae74e8-1b8e-481a-8cde-671047a28695 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:33.540657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae74e8-1b8e-481a-8cde-671047a28695 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:33.551508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f20bac72b3e549849fe2f19e9494127a', 'request_id': 'req-e9d1b774-c623-480c-9a05-946aab3a22f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:33.578878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f20bac72b3e549849fe2f19e9494127a', 'request_id': 'req-e9d1b774-c623-480c-9a05-946aab3a22f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:33.606484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f20bac72b3e549849fe2f19e9494127a', 'request_id': 'req-e9d1b774-c623-480c-9a05-946aab3a22f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:33.631996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] The token cache is being invalidate because project f20bac72b3e549849fe2f19e9494127a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:33.632295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:33.638207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9d1b774-c623-480c-9a05-946aab3a22f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:33.640165 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2438/4905] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:33 2022] DELETE /identity/v3/projects/f20bac72b3e549849fe2f19e9494127a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:33.644295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710c25-3301-4ed8-bb03-fbc910af1d09 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.644434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710c25-3301-4ed8-bb03-fbc910af1d09 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.644675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46710c25-3301-4ed8-bb03-fbc910af1d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.667305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b75c85-1a76-42a9-8323-28652a4961fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:33.668004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b75c85-1a76-42a9-8323-28652a4961fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.668365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b75c85-1a76-42a9-8323-28652a4961fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.668692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b75c85-1a76-42a9-8323-28652a4961fb admin admin] PATH_INFO: `/v3/projects/f3c06235117940439931972f680aed24/users/5c888adb6034407987b3fd1ea544ee8d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.696719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-46710c25-3301-4ed8-bb03-fbc910af1d09 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:33.698075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-46710c25-3301-4ed8-bb03-fbc910af1d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:33.721543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b75c85-1a76-42a9-8323-28652a4961fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c06235117940439931972f680aed24, user_id=5c888adb6034407987b3fd1ea544ee8d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:33.725465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b75c85-1a76-42a9-8323-28652a4961fb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:33.736318 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2439/4906] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:33.737739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb1b7-ef0d-44dd-8559-d709cf81c2b4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.737927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb1b7-ef0d-44dd-8559-d709cf81c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.738184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb1b7-ef0d-44dd-8559-d709cf81c2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.742995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:33.754675 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2468/4907] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:33 2022] PUT /identity/v3/projects/f3c06235117940439931972f680aed24/users/5c888adb6034407987b3fd1ea544ee8d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:33.759621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f4607-6c2b-4527-a42a-a165f6fc1610 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.760237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f4607-6c2b-4527-a42a-a165f6fc1610 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.760787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f4607-6c2b-4527-a42a-a165f6fc1610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.787289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-627f4607-6c2b-4527-a42a-a165f6fc1610 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:33.788766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-627f4607-6c2b-4527-a42a-a165f6fc1610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:33.802122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-362bb1b7-ef0d-44dd-8559-d709cf81c2b4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:33.803347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-362bb1b7-ef0d-44dd-8559-d709cf81c2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:33.878656 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2469/4908] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:33.887594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f4607-6c2b-4527-a42a-a165f6fc1610 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:33.895823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-627f4607-6c2b-4527-a42a-a165f6fc1610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:33.952922 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2440/4909] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:33.957219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bb1b7-ef0d-44dd-8559-d709cf81c2b4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:33.977793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bb1b7-ef0d-44dd-8559-d709cf81c2b4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:33.990770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd93c8-baca-49dd-9c5f-66d12853f594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:33.991417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd93c8-baca-49dd-9c5f-66d12853f594 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:33.991695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd93c8-baca-49dd-9c5f-66d12853f594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:33.991963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd93c8-baca-49dd-9c5f-66d12853f594 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:33.992625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd93c8-baca-49dd-9c5f-66d12853f594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:40:33.992923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd93c8-baca-49dd-9c5f-66d12853f594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:33.994585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd93c8-baca-49dd-9c5f-66d12853f594 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:34.025583 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2441/4910] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:40:34.026479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd93c8-baca-49dd-9c5f-66d12853f594 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:34.030128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f4607-6c2b-4527-a42a-a165f6fc1610 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:34.045199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52eba3-a754-440b-8a2d-045953847a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:34.046149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52eba3-a754-440b-8a2d-045953847a75 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:34.047063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52eba3-a754-440b-8a2d-045953847a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:34.047063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52eba3-a754-440b-8a2d-045953847a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:34.048064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd93c8-baca-49dd-9c5f-66d12853f594 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:34.054668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06767c4-42c8-43f7-849a-fb6686edf1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:34.055300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06767c4-42c8-43f7-849a-fb6686edf1bf admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:34.055575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06767c4-42c8-43f7-849a-fb6686edf1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:34.055837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06767c4-42c8-43f7-849a-fb6686edf1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:34.056472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06767c4-42c8-43f7-849a-fb6686edf1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:34.058425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06767c4-42c8-43f7-849a-fb6686edf1bf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:34.067775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52eba3-a754-440b-8a2d-045953847a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:34.071713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52eba3-a754-440b-8a2d-045953847a75 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:34.094089 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2470/4911] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:34.133983 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2442/4912] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:34 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:34.135744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52eba3-a754-440b-8a2d-045953847a75 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:34.150484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52eba3-a754-440b-8a2d-045953847a75 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:34.308506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440218f-de19-4202-9402-57d900d160d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:34.309586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440218f-de19-4202-9402-57d900d160d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:34.310011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440218f-de19-4202-9402-57d900d160d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:34.310346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440218f-de19-4202-9402-57d900d160d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:34.311608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440218f-de19-4202-9402-57d900d160d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:34.314124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440218f-de19-4202-9402-57d900d160d7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:34.345180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2471/4913] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:40:34 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:34.349275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06767c4-42c8-43f7-849a-fb6686edf1bf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:34.394160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06767c4-42c8-43f7-849a-fb6686edf1bf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:34.451342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a444e5b-36ad-4d16-9687-c388e2878d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:34.452369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a444e5b-36ad-4d16-9687-c388e2878d11 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:34.452369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a444e5b-36ad-4d16-9687-c388e2878d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:34.452558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a444e5b-36ad-4d16-9687-c388e2878d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:34.454582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a444e5b-36ad-4d16-9687-c388e2878d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:34.462256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a444e5b-36ad-4d16-9687-c388e2878d11 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:34.494172 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2443/4914] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:40:34.500425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440218f-de19-4202-9402-57d900d160d7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:34.524738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440218f-de19-4202-9402-57d900d160d7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:34.538353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ed16c-0499-4f2e-8fb1-bf5edbca3d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:34.539005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ed16c-0499-4f2e-8fb1-bf5edbca3d70 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:34.539405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ed16c-0499-4f2e-8fb1-bf5edbca3d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:34.539681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ed16c-0499-4f2e-8fb1-bf5edbca3d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:34.540333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ed16c-0499-4f2e-8fb1-bf5edbca3d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:34.541989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ed16c-0499-4f2e-8fb1-bf5edbca3d70 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:34.569055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a444e5b-36ad-4d16-9687-c388e2878d11 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:34.570256 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2472/4915] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:34.580455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a444e5b-36ad-4d16-9687-c388e2878d11 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:34.585647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b335cc3-d07b-4b7c-9680-be1c9a8c2772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:34.586351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b335cc3-d07b-4b7c-9680-be1c9a8c2772 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:34.586624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b335cc3-d07b-4b7c-9680-be1c9a8c2772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:34.586891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b335cc3-d07b-4b7c-9680-be1c9a8c2772 admin admin] PATH_INFO: `/v3/projects/dd4cd61c874e4cb9a5261a2ff29775cd/users/dec9d9537ea6485f90093ba6453e92b1/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:34.610271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b335cc3-d07b-4b7c-9680-be1c9a8c2772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4cd61c874e4cb9a5261a2ff29775cd, user_id=dec9d9537ea6485f90093ba6453e92b1, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:34.613190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b335cc3-d07b-4b7c-9680-be1c9a8c2772 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:34.641095 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2444/4916] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:34 2022] PUT /identity/v3/projects/dd4cd61c874e4cb9a5261a2ff29775cd/users/dec9d9537ea6485f90093ba6453e92b1/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:34.649418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f7d60-5350-4b30-b4e7-2bbb0ff5d45b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:34.649418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f7d60-5350-4b30-b4e7-2bbb0ff5d45b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:34.649418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f7d60-5350-4b30-b4e7-2bbb0ff5d45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:34.704809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-721f7d60-5350-4b30-b4e7-2bbb0ff5d45b None None] MFA Rules not processed for user `dec9d9537ea6485f90093ba6453e92b1`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:34.707897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-721f7d60-5350-4b30-b4e7-2bbb0ff5d45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:34.722864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:34.801022 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2473/4917] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:34.805652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b335cc3-d07b-4b7c-9680-be1c9a8c2772 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:34.877511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:34.910940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b335cc3-d07b-4b7c-9680-be1c9a8c2772 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:34.919990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463be4bd-6fde-42f9-b9f1-7bb32e3abfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:34.922276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be4bd-6fde-42f9-b9f1-7bb32e3abfa1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:34.923263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be4bd-6fde-42f9-b9f1-7bb32e3abfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:34.923418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be4bd-6fde-42f9-b9f1-7bb32e3abfa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:34.924746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463be4bd-6fde-42f9-b9f1-7bb32e3abfa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:34.927196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463be4bd-6fde-42f9-b9f1-7bb32e3abfa1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:34.983726 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2445/4918] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:34 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:34.988110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f7d60-5350-4b30-b4e7-2bbb0ff5d45b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:35.000118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f7d60-5350-4b30-b4e7-2bbb0ff5d45b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:35.117664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f96550-474c-44c8-aab1-b47068ce3602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:35.119785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f96550-474c-44c8-aab1-b47068ce3602 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:35.120982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f96550-474c-44c8-aab1-b47068ce3602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:35.121748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f96550-474c-44c8-aab1-b47068ce3602 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:35.122688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f96550-474c-44c8-aab1-b47068ce3602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:35.130905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f96550-474c-44c8-aab1-b47068ce3602 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:35.172191 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2474/4919] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:40:34 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:35.181539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463be4bd-6fde-42f9-b9f1-7bb32e3abfa1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:35.204195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463be4bd-6fde-42f9-b9f1-7bb32e3abfa1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:35.212864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6160b1-ed22-41f7-b51f-eafa9d4b6b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:35.214028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6160b1-ed22-41f7-b51f-eafa9d4b6b00 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:35.214551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6160b1-ed22-41f7-b51f-eafa9d4b6b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:35.215211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6160b1-ed22-41f7-b51f-eafa9d4b6b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:35.216394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6160b1-ed22-41f7-b51f-eafa9d4b6b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:35.222708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6160b1-ed22-41f7-b51f-eafa9d4b6b00 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:35.237269 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2446/4920] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:40:35.241735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f96550-474c-44c8-aab1-b47068ce3602 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:35.256916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f96550-474c-44c8-aab1-b47068ce3602 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:35.266310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea56b82-ee7c-4a04-b62d-705f8bb835bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:35.267501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea56b82-ee7c-4a04-b62d-705f8bb835bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:35.267978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea56b82-ee7c-4a04-b62d-705f8bb835bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:35.268596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea56b82-ee7c-4a04-b62d-705f8bb835bb admin admin] PATH_INFO: `/v3/projects/96841a6f7a544ab5a33c3d949b7a0590/users/bb31e7322933482eb863d54a49b46137/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:35.292025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea56b82-ee7c-4a04-b62d-705f8bb835bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=96841a6f7a544ab5a33c3d949b7a0590, user_id=bb31e7322933482eb863d54a49b46137, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:35.295313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea56b82-ee7c-4a04-b62d-705f8bb835bb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:35.323311 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2475/4921] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:35 2022] PUT /identity/v3/projects/96841a6f7a544ab5a33c3d949b7a0590/users/bb31e7322933482eb863d54a49b46137/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:35.323478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6160b1-ed22-41f7-b51f-eafa9d4b6b00 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:35.344925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6160b1-ed22-41f7-b51f-eafa9d4b6b00 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:35.429460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f761a81d-7c94-4528-ba55-8e998b2f5a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:35.430218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761a81d-7c94-4528-ba55-8e998b2f5a4a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:35.430585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761a81d-7c94-4528-ba55-8e998b2f5a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:35.430906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761a81d-7c94-4528-ba55-8e998b2f5a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:35.431632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761a81d-7c94-4528-ba55-8e998b2f5a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:35.433838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f761a81d-7c94-4528-ba55-8e998b2f5a4a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:35.445524 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2447/4922] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:35.449634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea56b82-ee7c-4a04-b62d-705f8bb835bb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:35.462514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea56b82-ee7c-4a04-b62d-705f8bb835bb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:35.470310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd013b3-824a-4ba6-8573-dc9613a3f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:35.471241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd013b3-824a-4ba6-8573-dc9613a3f1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:35.471607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd013b3-824a-4ba6-8573-dc9613a3f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:35.471932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd013b3-824a-4ba6-8573-dc9613a3f1f7 admin admin] PATH_INFO: `/v3/projects/96841a6f7a544ab5a33c3d949b7a0590/users/bb31e7322933482eb863d54a49b46137/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:35.474670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd013b3-824a-4ba6-8573-dc9613a3f1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96841a6f7a544ab5a33c3d949b7a0590, user_id=bb31e7322933482eb863d54a49b46137, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:35.477911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd013b3-824a-4ba6-8573-dc9613a3f1f7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:35.492189 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2476/4923] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:35 2022] PUT /identity/v3/projects/96841a6f7a544ab5a33c3d949b7a0590/users/bb31e7322933482eb863d54a49b46137/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:40:35.502982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71f84d-08c6-4e19-a7ac-1f01b699ce40 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:35.503492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71f84d-08c6-4e19-a7ac-1f01b699ce40 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:35.503601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71f84d-08c6-4e19-a7ac-1f01b699ce40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:35.543859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2f71f84d-08c6-4e19-a7ac-1f01b699ce40 None None] MFA Rules not processed for user `bb31e7322933482eb863d54a49b46137`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:35.545106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2f71f84d-08c6-4e19-a7ac-1f01b699ce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:35.664713 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2448/4924] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:35.668771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd013b3-824a-4ba6-8573-dc9613a3f1f7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:35.683420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd013b3-824a-4ba6-8573-dc9613a3f1f7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:35.689185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffa5e7-df51-44a2-9e78-7ee8527e1707 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb31e7322933482eb863d54a49b46137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96841a6f7a544ab5a33c3d949b7a0590', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:35.690251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffa5e7-df51-44a2-9e78-7ee8527e1707 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:35.690761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffa5e7-df51-44a2-9e78-7ee8527e1707 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:35.691270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffa5e7-df51-44a2-9e78-7ee8527e1707 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:35.692913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffa5e7-df51-44a2-9e78-7ee8527e1707 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:35.700455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fffa5e7-df51-44a2-9e78-7ee8527e1707 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:35.753801 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2477/4925] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:35 2022] POST /identity/v3/projects => generated 333 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:35.757859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71f84d-08c6-4e19-a7ac-1f01b699ce40 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:35.771083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71f84d-08c6-4e19-a7ac-1f01b699ce40 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:35.826442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:35.894658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26990-a678-4529-bb78-4d62e3ebd1ac tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb31e7322933482eb863d54a49b46137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96841a6f7a544ab5a33c3d949b7a0590', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:35.895312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26990-a678-4529-bb78-4d62e3ebd1ac tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:35.895596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26990-a678-4529-bb78-4d62e3ebd1ac tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:35.895859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e26990-a678-4529-bb78-4d62e3ebd1ac tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:35.896511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e26990-a678-4529-bb78-4d62e3ebd1ac tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:35.898469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e26990-a678-4529-bb78-4d62e3ebd1ac tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:35.961766 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2449/4926] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:40:35 2022] POST /identity/v3/projects => generated 332 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:35.965995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffa5e7-df51-44a2-9e78-7ee8527e1707 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:35.980158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffa5e7-df51-44a2-9e78-7ee8527e1707 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:36.034840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:36.063305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523b0a3-dd58-47a7-b5e0-2741f00e2f6f tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb31e7322933482eb863d54a49b46137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96841a6f7a544ab5a33c3d949b7a0590', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:36.064504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523b0a3-dd58-47a7-b5e0-2741f00e2f6f tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:36.065082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523b0a3-dd58-47a7-b5e0-2741f00e2f6f tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:36.065575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523b0a3-dd58-47a7-b5e0-2741f00e2f6f tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:36.066543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523b0a3-dd58-47a7-b5e0-2741f00e2f6f tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:36.069903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523b0a3-dd58-47a7-b5e0-2741f00e2f6f tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:36.150309 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2478/4927] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:35 2022] POST /identity/v3/projects => generated 357 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:40:36.150666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26990-a678-4529-bb78-4d62e3ebd1ac tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:36.172480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e26990-a678-4529-bb78-4d62e3ebd1ac tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:36.277819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1ab0-d4ef-497a-bcfe-2e423e8dffcf tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb31e7322933482eb863d54a49b46137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96841a6f7a544ab5a33c3d949b7a0590', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:36.279814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1ab0-d4ef-497a-bcfe-2e423e8dffcf tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:36.280355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1ab0-d4ef-497a-bcfe-2e423e8dffcf tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:36.280863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c1ab0-d4ef-497a-bcfe-2e423e8dffcf tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:36.281755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c1ab0-d4ef-497a-bcfe-2e423e8dffcf tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:36.283255 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-1e2c1ab0-d4ef-497a-bcfe-2e423e8dffcf tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:40:36.283255 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:40:36.283255 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:40:36.286039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c1ab0-d4ef-497a-bcfe-2e423e8dffcf tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:36.335223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523b0a3-dd58-47a7-b5e0-2741f00e2f6f tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:36.348699 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2450/4928] 10.222.0.43 () {58 vars in 1131 bytes} [Tue Aug 30 04:40:36 2022] GET /identity/v3/projects => generated 7193 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:36.354580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523b0a3-dd58-47a7-b5e0-2741f00e2f6f tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:36.363171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ee04e-f19a-49ba-9c87-132ed378489a tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb31e7322933482eb863d54a49b46137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96841a6f7a544ab5a33c3d949b7a0590', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:36.364098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ee04e-f19a-49ba-9c87-132ed378489a tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:36.364378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ee04e-f19a-49ba-9c87-132ed378489a tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:36.364646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ee04e-f19a-49ba-9c87-132ed378489a tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:36.365336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ee04e-f19a-49ba-9c87-132ed378489a tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:40:36.365647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ee04e-f19a-49ba-9c87-132ed378489a tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:36.369490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ee04e-f19a-49ba-9c87-132ed378489a tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:36.401746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1ab0-d4ef-497a-bcfe-2e423e8dffcf tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:36.417488 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2479/4929] 10.222.0.43 () {58 vars in 1158 bytes} [Tue Aug 30 04:40:36 2022] GET /identity/v3/projects?enabled=False => generated 444 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:36.419335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c1ab0-d4ef-497a-bcfe-2e423e8dffcf tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:36.425847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc071481-12d9-4699-a34c-c10a9d7dd964 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb31e7322933482eb863d54a49b46137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96841a6f7a544ab5a33c3d949b7a0590', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:36.426651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071481-12d9-4699-a34c-c10a9d7dd964 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:36.426932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071481-12d9-4699-a34c-c10a9d7dd964 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:36.427201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc071481-12d9-4699-a34c-c10a9d7dd964 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:36.427927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc071481-12d9-4699-a34c-c10a9d7dd964 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Adding query filter params (parent_id=4be97993f3e64ad7b2431458c15bfa5a) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:40:36.428230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc071481-12d9-4699-a34c-c10a9d7dd964 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:36.430313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc071481-12d9-4699-a34c-c10a9d7dd964 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:36.460255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ee04e-f19a-49ba-9c87-132ed378489a tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:36.460509 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2451/4930] 10.222.0.43 () {58 vars in 1216 bytes} [Tue Aug 30 04:40:36 2022] GET /identity/v3/projects?parent_id=4be97993f3e64ad7b2431458c15bfa5a => generated 497 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:36.481242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ee04e-f19a-49ba-9c87-132ed378489a tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:36.489275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb31e7322933482eb863d54a49b46137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96841a6f7a544ab5a33c3d949b7a0590', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:36.491309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:36.491657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:36.491990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] PATH_INFO: `/v3/projects/9038f562d7274883a49c08aa927dd0dd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:36.493490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9038f562d7274883a49c08aa927dd0dd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:36.496088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:36.569469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9038f562d7274883a49c08aa927dd0dd', 'request_id': 'req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:36.577493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9038f562d7274883a49c08aa927dd0dd', 'request_id': 'req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:36.593035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9038f562d7274883a49c08aa927dd0dd', 'request_id': 'req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:36.619052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] The token cache is being invalidate because project 9038f562d7274883a49c08aa927dd0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:36.619288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:36.620175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:36.623353 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2480/4931] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:36 2022] DELETE /identity/v3/projects/9038f562d7274883a49c08aa927dd0dd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:36.627485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc071481-12d9-4699-a34c-c10a9d7dd964 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:36.629653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cc071481-12d9-4699-a34c-c10a9d7dd964 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:36.651718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc071481-12d9-4699-a34c-c10a9d7dd964 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:36.735514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb31e7322933482eb863d54a49b46137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96841a6f7a544ab5a33c3d949b7a0590', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:36.736258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:36.736604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:36.736939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] PATH_INFO: `/v3/projects/4be97993f3e64ad7b2431458c15bfa5a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:36.738190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4be97993f3e64ad7b2431458c15bfa5a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:36.740185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:36.798467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:36.809957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be97993f3e64ad7b2431458c15bfa5a', 'request_id': 'req-39b45d5d-9813-49a5-9ef2-d5733f18a38b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:36.822392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be97993f3e64ad7b2431458c15bfa5a', 'request_id': 'req-39b45d5d-9813-49a5-9ef2-d5733f18a38b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:36.838664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be97993f3e64ad7b2431458c15bfa5a', 'request_id': 'req-39b45d5d-9813-49a5-9ef2-d5733f18a38b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:36.853406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] The token cache is being invalidate because project 4be97993f3e64ad7b2431458c15bfa5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:36.853743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:36.854515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:36.856967 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2452/4932] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:36 2022] DELETE /identity/v3/projects/4be97993f3e64ad7b2431458c15bfa5a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:36.861246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:36.878165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040c5c0-273c-4ee8-85bb-3f2a3de669c4 tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:36.964785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb31e7322933482eb863d54a49b46137', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96841a6f7a544ab5a33c3d949b7a0590', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:36.966635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:36.966997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:36.967538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] PATH_INFO: `/v3/projects/da848526076b4640b6840ac055c248cc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:36.969286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da848526076b4640b6840ac055c248cc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:36.974416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:37.065232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:37.085383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da848526076b4640b6840ac055c248cc', 'request_id': 'req-2936424c-79c2-4f8f-a958-9905039b55ff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:37.096934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da848526076b4640b6840ac055c248cc', 'request_id': 'req-2936424c-79c2-4f8f-a958-9905039b55ff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:37.111269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da848526076b4640b6840ac055c248cc', 'request_id': 'req-2936424c-79c2-4f8f-a958-9905039b55ff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:37.133530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] The token cache is being invalidate because project da848526076b4640b6840ac055c248cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:37.134169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:37.135804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2936424c-79c2-4f8f-a958-9905039b55ff tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:37.139354 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2481/4933] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:36 2022] DELETE /identity/v3/projects/da848526076b4640b6840ac055c248cc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:37.143429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:37.145278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:37.252061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b45d5d-9813-49a5-9ef2-d5733f18a38b tempest-ListProjectsTestJSON-280711218 tempest-ListProjectsTestJSON-280711218-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:37.339864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:37.342607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:37.342889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:37.343161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] PATH_INFO: `/v3/users/dec9d9537ea6485f90093ba6453e92b1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:37.344551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec9d9537ea6485f90093ba6453e92b1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:37.347844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:37.413714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec9d9537ea6485f90093ba6453e92b1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:37.425822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec9d9537ea6485f90093ba6453e92b1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:37.461014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec9d9537ea6485f90093ba6453e92b1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:37.463110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:37.473724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec9d9537ea6485f90093ba6453e92b1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:37.476039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec9d9537ea6485f90093ba6453e92b1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:37.490349 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2453/4934] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:37 2022] DELETE /identity/v3/users/dec9d9537ea6485f90093ba6453e92b1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:37.495032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160ba23-cad2-4fd0-ba7b-a4abdd8eaaf4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:37.495314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160ba23-cad2-4fd0-ba7b-a4abdd8eaaf4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:37.495686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160ba23-cad2-4fd0-ba7b-a4abdd8eaaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:37.536839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6160ba23-cad2-4fd0-ba7b-a4abdd8eaaf4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:37.538408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6160ba23-cad2-4fd0-ba7b-a4abdd8eaaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:37.721948 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2482/4935] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:37.748172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:37.752058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:37.860145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f0802-b175-4c9e-b6a9-fa78d0291d6e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:37.870444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e232aea-18b0-4399-8357-c1c05e86580e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:37.871605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232aea-18b0-4399-8357-c1c05e86580e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:37.873085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232aea-18b0-4399-8357-c1c05e86580e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:37.873854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e232aea-18b0-4399-8357-c1c05e86580e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:37.888836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e232aea-18b0-4399-8357-c1c05e86580e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:37.892506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e232aea-18b0-4399-8357-c1c05e86580e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:37.932749 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2454/4936] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:40.208442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160ba23-cad2-4fd0-ba7b-a4abdd8eaaf4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:40.211923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6160ba23-cad2-4fd0-ba7b-a4abdd8eaaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:40.230709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160ba23-cad2-4fd0-ba7b-a4abdd8eaaf4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:40.243111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:40.243839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:40.244124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:40.244397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] PATH_INFO: `/v3/projects/dd4cd61c874e4cb9a5261a2ff29775cd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:40.249564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4cd61c874e4cb9a5261a2ff29775cd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:40.255933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:40.353181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4cd61c874e4cb9a5261a2ff29775cd', 'request_id': 'req-271706f8-dced-4727-b199-058650c9ba3b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:40.366521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4cd61c874e4cb9a5261a2ff29775cd', 'request_id': 'req-271706f8-dced-4727-b199-058650c9ba3b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:40.379503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4cd61c874e4cb9a5261a2ff29775cd', 'request_id': 'req-271706f8-dced-4727-b199-058650c9ba3b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:40.398104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] The token cache is being invalidate because project dd4cd61c874e4cb9a5261a2ff29775cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:40.398525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:40.400464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:40.407619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e232aea-18b0-4399-8357-c1c05e86580e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:40.408182 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2483/4937] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:40 2022] DELETE /identity/v3/projects/dd4cd61c874e4cb9a5261a2ff29775cd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:40.419836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e232aea-18b0-4399-8357-c1c05e86580e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:40.589557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:40.590357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:40.590696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:40.591149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] PATH_INFO: `/v3/users/bb31e7322933482eb863d54a49b46137` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:40.599296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb31e7322933482eb863d54a49b46137)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:40.601451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:40.717730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb31e7322933482eb863d54a49b46137'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:40.727879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb31e7322933482eb863d54a49b46137'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:40.755642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb31e7322933482eb863d54a49b46137'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:40.768690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb31e7322933482eb863d54a49b46137'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:40.770488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2048b6dd-5bc6-4537-902b-54644526b7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb31e7322933482eb863d54a49b46137'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:40.785498 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2455/4938] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:40 2022] DELETE /identity/v3/users/bb31e7322933482eb863d54a49b46137 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:41.876729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:41.878291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:41.898541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271706f8-dced-4727-b199-058650c9ba3b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:42.008547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:42.039266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:42.040850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:42.041234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:42.041601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] PATH_INFO: `/v3/projects/96841a6f7a544ab5a33c3d949b7a0590` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:42.044044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] RBAC: Authorizing `identity:delete_project(project_id=96841a6f7a544ab5a33c3d949b7a0590)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:42.049003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:42.117325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96841a6f7a544ab5a33c3d949b7a0590', 'request_id': 'req-aa8e158d-c4a1-45c2-b227-03b5db6a839a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:42.126656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96841a6f7a544ab5a33c3d949b7a0590', 'request_id': 'req-aa8e158d-c4a1-45c2-b227-03b5db6a839a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:42.136805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96841a6f7a544ab5a33c3d949b7a0590', 'request_id': 'req-aa8e158d-c4a1-45c2-b227-03b5db6a839a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:42.151152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] The token cache is being invalidate because project 96841a6f7a544ab5a33c3d949b7a0590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:42.151529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:42.152767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa8e158d-c4a1-45c2-b227-03b5db6a839a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:42.154881 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2484/4939] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:41 2022] DELETE /identity/v3/projects/96841a6f7a544ab5a33c3d949b7a0590 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:42.159587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086de04-b512-4248-8b98-aa7cce202ab5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:42.160111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086de04-b512-4248-8b98-aa7cce202ab5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:42.160111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086de04-b512-4248-8b98-aa7cce202ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:42.188842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8086de04-b512-4248-8b98-aa7cce202ab5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:42.190550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8086de04-b512-4248-8b98-aa7cce202ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:42.206194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:42.279823 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2456/4940] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:42.288999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706545a0-88f0-46fb-9773-edf71ddc2a55 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:42.289749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706545a0-88f0-46fb-9773-edf71ddc2a55 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:42.290360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706545a0-88f0-46fb-9773-edf71ddc2a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:42.327949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-706545a0-88f0-46fb-9773-edf71ddc2a55 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:42.330183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-706545a0-88f0-46fb-9773-edf71ddc2a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:42.339455 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2485/4941] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:42.343727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086de04-b512-4248-8b98-aa7cce202ab5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:42.354809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086de04-b512-4248-8b98-aa7cce202ab5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:42.366899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205359-0fc4-47c3-931d-40a43985676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:42.367919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205359-0fc4-47c3-931d-40a43985676a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:42.368199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205359-0fc4-47c3-931d-40a43985676a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:42.368591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205359-0fc4-47c3-931d-40a43985676a admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:42.369813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd205359-0fc4-47c3-931d-40a43985676a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:40:42.370176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd205359-0fc4-47c3-931d-40a43985676a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:42.372459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd205359-0fc4-47c3-931d-40a43985676a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:42.389174 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2457/4942] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:42.393836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706545a0-88f0-46fb-9773-edf71ddc2a55 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:42.406747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706545a0-88f0-46fb-9773-edf71ddc2a55 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:42.413060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f352-adbb-4087-91c9-737d0df88a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:42.414602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f352-adbb-4087-91c9-737d0df88a1b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:42.414602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f352-adbb-4087-91c9-737d0df88a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:42.414602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f352-adbb-4087-91c9-737d0df88a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:42.415308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f352-adbb-4087-91c9-737d0df88a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:42.417310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f352-adbb-4087-91c9-737d0df88a1b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:42.457656 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2486/4943] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:42 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:42.458707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205359-0fc4-47c3-931d-40a43985676a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:42.478294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205359-0fc4-47c3-931d-40a43985676a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:42.614262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b38f18-7639-48aa-8cc4-dd867cb91fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:42.615180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b38f18-7639-48aa-8cc4-dd867cb91fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:42.615907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b38f18-7639-48aa-8cc4-dd867cb91fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:42.616346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b38f18-7639-48aa-8cc4-dd867cb91fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:42.617635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b38f18-7639-48aa-8cc4-dd867cb91fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:42.620004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b38f18-7639-48aa-8cc4-dd867cb91fd5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:42.662628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f352-adbb-4087-91c9-737d0df88a1b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:42.663205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2458/4944] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:40:42 2022] POST /identity/v3/users => generated 284 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:40:42.673931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f352-adbb-4087-91c9-737d0df88a1b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:42.681940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731e33a-97c1-4adb-ae0a-cfb9137d53e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:42.681940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731e33a-97c1-4adb-ae0a-cfb9137d53e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:42.681940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731e33a-97c1-4adb-ae0a-cfb9137d53e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:42.681940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731e33a-97c1-4adb-ae0a-cfb9137d53e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:42.682377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731e33a-97c1-4adb-ae0a-cfb9137d53e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:42.682655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731e33a-97c1-4adb-ae0a-cfb9137d53e6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:42.695742 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2487/4945] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:42.700169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b38f18-7639-48aa-8cc4-dd867cb91fd5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:42.711251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b38f18-7639-48aa-8cc4-dd867cb91fd5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:42.716214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91162d-8344-474f-a33a-4ffefc6b70b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:42.716847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91162d-8344-474f-a33a-4ffefc6b70b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:42.717129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91162d-8344-474f-a33a-4ffefc6b70b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:42.717401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91162d-8344-474f-a33a-4ffefc6b70b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:42.718092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91162d-8344-474f-a33a-4ffefc6b70b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:42.719748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91162d-8344-474f-a33a-4ffefc6b70b3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:42.741759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731e33a-97c1-4adb-ae0a-cfb9137d53e6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:42.748322 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2459/4946] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:40:42.755393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731e33a-97c1-4adb-ae0a-cfb9137d53e6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:42.762273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a49478-49d8-4db2-a8f9-24a449161ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:42.762435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49478-49d8-4db2-a8f9-24a449161ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:42.762664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49478-49d8-4db2-a8f9-24a449161ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:42.764420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49478-49d8-4db2-a8f9-24a449161ed5 admin admin] PATH_INFO: `/v3/projects/48defb2225c64c0fac418c67eea12813/users/b09ed6030caa4a09aa35795f8c4ee734/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:42.782827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a49478-49d8-4db2-a8f9-24a449161ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48defb2225c64c0fac418c67eea12813, user_id=b09ed6030caa4a09aa35795f8c4ee734, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:42.785630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a49478-49d8-4db2-a8f9-24a449161ed5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:42.815314 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2488/4947] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:42 2022] PUT /identity/v3/projects/48defb2225c64c0fac418c67eea12813/users/b09ed6030caa4a09aa35795f8c4ee734/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:42.828678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857a9a-1983-48b1-88fb-7fa3b9a74ce0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:42.828998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857a9a-1983-48b1-88fb-7fa3b9a74ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:42.829283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857a9a-1983-48b1-88fb-7fa3b9a74ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:42.871876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-18857a9a-1983-48b1-88fb-7fa3b9a74ce0 None None] MFA Rules not processed for user `b09ed6030caa4a09aa35795f8c4ee734`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:42.873098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-18857a9a-1983-48b1-88fb-7fa3b9a74ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:42.989077 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2460/4948] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:42.994439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a49478-49d8-4db2-a8f9-24a449161ed5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:43.008708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a49478-49d8-4db2-a8f9-24a449161ed5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:43.021301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ba6d7-655a-426d-bbf7-b95479c90695 tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ed6030caa4a09aa35795f8c4ee734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48defb2225c64c0fac418c67eea12813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:43.022510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ba6d7-655a-426d-bbf7-b95479c90695 tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:43.023003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ba6d7-655a-426d-bbf7-b95479c90695 tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:43.023523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ba6d7-655a-426d-bbf7-b95479c90695 tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] PATH_INFO: `/v3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:43.025837 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2489/4949] 10.222.0.43 () {58 vars in 1104 bytes} [Tue Aug 30 04:40:42 2022] GET /identity/v3 => generated 255 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:43.030593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18857a9a-1983-48b1-88fb-7fa3b9a74ce0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:43.040965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18857a9a-1983-48b1-88fb-7fa3b9a74ce0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:43.047979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddadbf-51a8-43dc-966e-6a4a5e93c42f tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ed6030caa4a09aa35795f8c4ee734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48defb2225c64c0fac418c67eea12813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:43.049359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddadbf-51a8-43dc-966e-6a4a5e93c42f tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:43.050989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddadbf-51a8-43dc-966e-6a4a5e93c42f tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:43.051566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddadbf-51a8-43dc-966e-6a4a5e93c42f tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] PATH_INFO: `/v3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:43.053991 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2461/4950] 10.222.0.43 () {58 vars in 1104 bytes} [Tue Aug 30 04:40:43 2022] GET /identity/v3 => generated 255 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:43.058735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ba6d7-655a-426d-bbf7-b95479c90695 tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:43.072936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ba6d7-655a-426d-bbf7-b95479c90695 tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:43.079830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26dfbd-fd8b-42df-81f7-b6b8b0828c2b tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b09ed6030caa4a09aa35795f8c4ee734', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48defb2225c64c0fac418c67eea12813', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:43.081654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26dfbd-fd8b-42df-81f7-b6b8b0828c2b tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:43.082218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26dfbd-fd8b-42df-81f7-b6b8b0828c2b tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:43.083145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26dfbd-fd8b-42df-81f7-b6b8b0828c2b tempest-TestApiDiscovery-724509669 tempest-TestApiDiscovery-724509669-project] PATH_INFO: `/v3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:43.085425 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2490/4951] 10.222.0.43 () {58 vars in 1104 bytes} [Tue Aug 30 04:40:43 2022] GET /identity/v3 => generated 255 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:40:43.091835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cb4e7-319f-4950-b9d6-ec919b9ad240 None None] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:43.092186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cb4e7-319f-4950-b9d6-ec919b9ad240 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:43.092379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cb4e7-319f-4950-b9d6-ec919b9ad240 None None] PATH_INFO: `/` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:43.093772 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2462/4952] 10.222.0.43 () {56 vars in 895 bytes} [Tue Aug 30 04:40:43 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:40:43.099457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e0d1e-ab3a-4b77-8f08-47fb78aedf71 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:43.099744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e0d1e-ab3a-4b77-8f08-47fb78aedf71 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:43.100018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e0d1e-ab3a-4b77-8f08-47fb78aedf71 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:43.106916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cb4e7-319f-4950-b9d6-ec919b9ad240 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:43.110161 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2491/4953] 10.222.0.43 () {56 vars in 895 bytes} [Tue Aug 30 04:40:43 2022] GET /identity/ => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 04:40:43.113585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:43.221245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cb4e7-319f-4950-b9d6-ec919b9ad240 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:43.226034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:43.226730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:43.227013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:43.227286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] PATH_INFO: `/v3/users/b09ed6030caa4a09aa35795f8c4ee734` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:43.228570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b09ed6030caa4a09aa35795f8c4ee734)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:43.230676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:43.296559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b09ed6030caa4a09aa35795f8c4ee734'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:43.306715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b09ed6030caa4a09aa35795f8c4ee734'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:43.321521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b09ed6030caa4a09aa35795f8c4ee734'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:43.337446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b09ed6030caa4a09aa35795f8c4ee734'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:43.338187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b09ed6030caa4a09aa35795f8c4ee734'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:43.351474 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2463/4954] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:43 2022] DELETE /identity/v3/users/b09ed6030caa4a09aa35795f8c4ee734 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:43.356110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72523bd1-e5ec-487a-8111-e0a476b8e7f6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:43.356452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72523bd1-e5ec-487a-8111-e0a476b8e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:43.356713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72523bd1-e5ec-487a-8111-e0a476b8e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:43.380333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-72523bd1-e5ec-487a-8111-e0a476b8e7f6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:43.381734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-72523bd1-e5ec-487a-8111-e0a476b8e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:43.440410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:43.456236 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2492/4955] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:43.466284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:43.468015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:43.566778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af38d2b-8de2-4c79-95f9-e739f0e48ba2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:43.572574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c499c-9f9f-4047-a51c-a1cdc344c89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:43.573137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c499c-9f9f-4047-a51c-a1cdc344c89b service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:43.573482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c499c-9f9f-4047-a51c-a1cdc344c89b service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:43.573753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c499c-9f9f-4047-a51c-a1cdc344c89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:43.610395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c499c-9f9f-4047-a51c-a1cdc344c89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:43.612284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c499c-9f9f-4047-a51c-a1cdc344c89b service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:43.633896 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2464/4956] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:45.591839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72523bd1-e5ec-487a-8111-e0a476b8e7f6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:45.593944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-72523bd1-e5ec-487a-8111-e0a476b8e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:45.625783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72523bd1-e5ec-487a-8111-e0a476b8e7f6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:45.646634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:45.649159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:45.650384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:45.655824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] PATH_INFO: `/v3/projects/48defb2225c64c0fac418c67eea12813` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:45.658660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48defb2225c64c0fac418c67eea12813)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:45.663160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:45.770458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48defb2225c64c0fac418c67eea12813', 'request_id': 'req-65135d73-f5c3-4abe-afa7-39b8e66a2693'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:45.784912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48defb2225c64c0fac418c67eea12813', 'request_id': 'req-65135d73-f5c3-4abe-afa7-39b8e66a2693'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:45.802125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48defb2225c64c0fac418c67eea12813', 'request_id': 'req-65135d73-f5c3-4abe-afa7-39b8e66a2693'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:45.825977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] The token cache is being invalidate because project 48defb2225c64c0fac418c67eea12813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:45.826948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:45.832367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65135d73-f5c3-4abe-afa7-39b8e66a2693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:45.834827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2493/4957] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:45 2022] DELETE /identity/v3/projects/48defb2225c64c0fac418c67eea12813 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:45.840240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc69d9-bf03-4304-9291-0aba9966394d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:45.841451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc69d9-bf03-4304-9291-0aba9966394d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:45.841738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc69d9-bf03-4304-9291-0aba9966394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:45.868578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3abc69d9-bf03-4304-9291-0aba9966394d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:45.869832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3abc69d9-bf03-4304-9291-0aba9966394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:45.896235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:45.960259 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2465/4958] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:45.969419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f82f0c-ab31-4aa8-a9db-dc5b9d8547e7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:45.969820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f82f0c-ab31-4aa8-a9db-dc5b9d8547e7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:45.970193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f82f0c-ab31-4aa8-a9db-dc5b9d8547e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:46.012345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e3f82f0c-ab31-4aa8-a9db-dc5b9d8547e7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:46.015586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e3f82f0c-ab31-4aa8-a9db-dc5b9d8547e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:46.042176 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2494/4959] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:46.046478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc69d9-bf03-4304-9291-0aba9966394d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:46.069040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc69d9-bf03-4304-9291-0aba9966394d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:46.076570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b941f-212b-41cb-8014-24e8cc8e25ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:46.077298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b941f-212b-41cb-8014-24e8cc8e25ac admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:46.077955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b941f-212b-41cb-8014-24e8cc8e25ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:46.078339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b941f-212b-41cb-8014-24e8cc8e25ac admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:46.079086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b941f-212b-41cb-8014-24e8cc8e25ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:40:46.079539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b941f-212b-41cb-8014-24e8cc8e25ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:46.081644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b941f-212b-41cb-8014-24e8cc8e25ac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:46.102753 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2466/4960] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:46.109181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f82f0c-ab31-4aa8-a9db-dc5b9d8547e7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:46.150743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f82f0c-ab31-4aa8-a9db-dc5b9d8547e7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:46.161387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7c8f1-6b78-4ad8-a705-b4929208646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:46.163253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c8f1-6b78-4ad8-a705-b4929208646a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:46.163606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c8f1-6b78-4ad8-a705-b4929208646a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:46.163888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7c8f1-6b78-4ad8-a705-b4929208646a admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:46.164562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7c8f1-6b78-4ad8-a705-b4929208646a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:46.171184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7c8f1-6b78-4ad8-a705-b4929208646a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:46.239948 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2495/4961] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:46 2022] POST /identity/v3/projects => generated 395 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:46.243895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b941f-212b-41cb-8014-24e8cc8e25ac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:46.261348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b941f-212b-41cb-8014-24e8cc8e25ac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:46.423108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb857fce-ac09-4099-b1a3-f369525e886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:46.423898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb857fce-ac09-4099-b1a3-f369525e886f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:46.424278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb857fce-ac09-4099-b1a3-f369525e886f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:46.424656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb857fce-ac09-4099-b1a3-f369525e886f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:46.425553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb857fce-ac09-4099-b1a3-f369525e886f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:46.427886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb857fce-ac09-4099-b1a3-f369525e886f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:46.463304 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2467/4962] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:40:46 2022] POST /identity/v3/users => generated 304 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:46.468375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7c8f1-6b78-4ad8-a705-b4929208646a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:46.499044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7c8f1-6b78-4ad8-a705-b4929208646a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:46.511809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980325d1-b870-42f2-86b4-34cdc7da16f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:46.513092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980325d1-b870-42f2-86b4-34cdc7da16f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:46.513678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980325d1-b870-42f2-86b4-34cdc7da16f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:46.514259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980325d1-b870-42f2-86b4-34cdc7da16f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:46.515879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980325d1-b870-42f2-86b4-34cdc7da16f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:46.518956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980325d1-b870-42f2-86b4-34cdc7da16f5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:46.540538 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2496/4963] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:46.545128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb857fce-ac09-4099-b1a3-f369525e886f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:46.555947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb857fce-ac09-4099-b1a3-f369525e886f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:46.562305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f8be-ff2c-4b07-afb3-bc18e5efb282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:46.562700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f8be-ff2c-4b07-afb3-bc18e5efb282 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:46.563124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f8be-ff2c-4b07-afb3-bc18e5efb282 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:46.563321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9f8be-ff2c-4b07-afb3-bc18e5efb282 admin admin] PATH_INFO: `/v3/projects/188e77f581fb4feda1a4d4595e84b62f/users/7dcb996e444744d5ba550f6246d74913/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:46.593917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9f8be-ff2c-4b07-afb3-bc18e5efb282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188e77f581fb4feda1a4d4595e84b62f, user_id=7dcb996e444744d5ba550f6246d74913, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:46.594774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9f8be-ff2c-4b07-afb3-bc18e5efb282 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:46.618526 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2468/4964] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:46 2022] PUT /identity/v3/projects/188e77f581fb4feda1a4d4595e84b62f/users/7dcb996e444744d5ba550f6246d74913/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:46.625170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980325d1-b870-42f2-86b4-34cdc7da16f5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:46.660445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980325d1-b870-42f2-86b4-34cdc7da16f5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:46.758589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2814703-687b-4527-927c-0738ae4a5b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:46.759380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2814703-687b-4527-927c-0738ae4a5b3a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:46.759724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2814703-687b-4527-927c-0738ae4a5b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:46.760111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2814703-687b-4527-927c-0738ae4a5b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:46.760866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2814703-687b-4527-927c-0738ae4a5b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:46.764223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2814703-687b-4527-927c-0738ae4a5b3a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:46.785525 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2497/4965] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:46.787203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f8be-ff2c-4b07-afb3-bc18e5efb282 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:46.802601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9f8be-ff2c-4b07-afb3-bc18e5efb282 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:46.812740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e4272-de4e-47f0-8134-3f7fdacce102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:46.813424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4272-de4e-47f0-8134-3f7fdacce102 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:46.813699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4272-de4e-47f0-8134-3f7fdacce102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:46.813995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4272-de4e-47f0-8134-3f7fdacce102 admin admin] PATH_INFO: `/v3/projects/188e77f581fb4feda1a4d4595e84b62f/users/7dcb996e444744d5ba550f6246d74913/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:46.815973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e4272-de4e-47f0-8134-3f7fdacce102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188e77f581fb4feda1a4d4595e84b62f, user_id=7dcb996e444744d5ba550f6246d74913, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:46.819905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e4272-de4e-47f0-8134-3f7fdacce102 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:46.842666 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2469/4966] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:46 2022] PUT /identity/v3/projects/188e77f581fb4feda1a4d4595e84b62f/users/7dcb996e444744d5ba550f6246d74913/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:46.848042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ae1cc-0cdd-408b-a258-59de8193a08c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:46.848524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ae1cc-0cdd-408b-a258-59de8193a08c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:46.849286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ae1cc-0cdd-408b-a258-59de8193a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:46.889058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ed2ae1cc-0cdd-408b-a258-59de8193a08c None None] MFA Rules not processed for user `7dcb996e444744d5ba550f6246d74913`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:46.891008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ed2ae1cc-0cdd-408b-a258-59de8193a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:46.977197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:47.067111 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2498/4967] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:47.067490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e4272-de4e-47f0-8134-3f7fdacce102 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:47.263407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e4272-de4e-47f0-8134-3f7fdacce102 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:47.275350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a1132-35a0-43ed-8cbf-840d2766e65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:47.275987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1132-35a0-43ed-8cbf-840d2766e65f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:47.276261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1132-35a0-43ed-8cbf-840d2766e65f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:47.276640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1132-35a0-43ed-8cbf-840d2766e65f admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:47.277191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a1132-35a0-43ed-8cbf-840d2766e65f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:47.280141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a1132-35a0-43ed-8cbf-840d2766e65f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:47.310125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:47.335704 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2470/4968] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:47 2022] POST /identity/v3/projects => generated 397 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:47.339642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ae1cc-0cdd-408b-a258-59de8193a08c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:47.361952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ae1cc-0cdd-408b-a258-59de8193a08c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:47.446741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46066-9358-4231-9c91-dc14b8112b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:47.447571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46066-9358-4231-9c91-dc14b8112b17 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:47.447802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46066-9358-4231-9c91-dc14b8112b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:47.448126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b46066-9358-4231-9c91-dc14b8112b17 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:47.448869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b46066-9358-4231-9c91-dc14b8112b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:47.451881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b46066-9358-4231-9c91-dc14b8112b17 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:47.504354 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2499/4969] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:40:47 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:40:47.505823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a1132-35a0-43ed-8cbf-840d2766e65f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:47.525236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a1132-35a0-43ed-8cbf-840d2766e65f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:47.536363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1143cf-074a-4ad6-9225-94eaef14167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:47.537200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1143cf-074a-4ad6-9225-94eaef14167a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:47.537476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1143cf-074a-4ad6-9225-94eaef14167a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:47.537745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1143cf-074a-4ad6-9225-94eaef14167a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:47.538431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1143cf-074a-4ad6-9225-94eaef14167a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:47.540164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1143cf-074a-4ad6-9225-94eaef14167a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:47.562721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46066-9358-4231-9c91-dc14b8112b17 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:47.578437 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2471/4970] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:40:47.581750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b46066-9358-4231-9c91-dc14b8112b17 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:47.593234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3510e1-32c7-414b-bfa5-8e012337c231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:47.593894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3510e1-32c7-414b-bfa5-8e012337c231 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:47.594303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3510e1-32c7-414b-bfa5-8e012337c231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:47.594572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3510e1-32c7-414b-bfa5-8e012337c231 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:47.595239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3510e1-32c7-414b-bfa5-8e012337c231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:47.598533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3510e1-32c7-414b-bfa5-8e012337c231 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:47.618869 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2500/4971] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:47.626767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1143cf-074a-4ad6-9225-94eaef14167a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:47.647422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1143cf-074a-4ad6-9225-94eaef14167a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:47.697948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ad2e1-005e-4a91-bef9-394aced490df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:47.697948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ad2e1-005e-4a91-bef9-394aced490df admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:47.697948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ad2e1-005e-4a91-bef9-394aced490df admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:47.706311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ad2e1-005e-4a91-bef9-394aced490df admin admin] PATH_INFO: `/v3/projects/34ceb7ed83df471db2a02cf0ac3e376e/users/5e72ec76c66d49b19ab31f08177adf7c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:47.735968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ad2e1-005e-4a91-bef9-394aced490df admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ceb7ed83df471db2a02cf0ac3e376e, user_id=5e72ec76c66d49b19ab31f08177adf7c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:47.741915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ad2e1-005e-4a91-bef9-394aced490df admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:47.785920 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2472/4972] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:47 2022] PUT /identity/v3/projects/34ceb7ed83df471db2a02cf0ac3e376e/users/5e72ec76c66d49b19ab31f08177adf7c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:47.806941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd52d-db3b-4850-8f68-a4b089cfc66d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:47.808419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd52d-db3b-4850-8f68-a4b089cfc66d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:47.809037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bd52d-db3b-4850-8f68-a4b089cfc66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:47.878121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b41bd52d-db3b-4850-8f68-a4b089cfc66d None None] MFA Rules not processed for user `5e72ec76c66d49b19ab31f08177adf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:47.879545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b41bd52d-db3b-4850-8f68-a4b089cfc66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:48.046933 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2501/4973] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:47 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:48.054714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ad2e1-005e-4a91-bef9-394aced490df admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:48.056509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-394ad2e1-005e-4a91-bef9-394aced490df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:48.144472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ad2e1-005e-4a91-bef9-394aced490df admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:48.149897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582a5ba-e135-4b09-8ba2-82dc003d6ee5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:48.151238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a5ba-e135-4b09-8ba2-82dc003d6ee5 service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:48.151630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a5ba-e135-4b09-8ba2-82dc003d6ee5 service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:48.152011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a5ba-e135-4b09-8ba2-82dc003d6ee5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:48.286773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582a5ba-e135-4b09-8ba2-82dc003d6ee5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:48.290767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582a5ba-e135-4b09-8ba2-82dc003d6ee5 service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:48.329980 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2473/4974] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:48 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:49.067331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd52d-db3b-4850-8f68-a4b089cfc66d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:49.157280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:49.213921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bd52d-db3b-4850-8f68-a4b089cfc66d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:49.221423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:49.222704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:49.223075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:49.223547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] PATH_INFO: `/v3/users/7dcb996e444744d5ba550f6246d74913` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:49.224908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dcb996e444744d5ba550f6246d74913)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:49.233156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:49.346334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dcb996e444744d5ba550f6246d74913'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:49.347117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dcb996e444744d5ba550f6246d74913'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:49.361634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dcb996e444744d5ba550f6246d74913'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:49.376592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dcb996e444744d5ba550f6246d74913'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:49.407832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dcb996e444744d5ba550f6246d74913'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:49.414607 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2502/4975] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:49 2022] DELETE /identity/v3/users/7dcb996e444744d5ba550f6246d74913 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:49.419357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3630a-67c6-4b17-a70d-c40e76b4bfc6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:49.419863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3630a-67c6-4b17-a70d-c40e76b4bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:49.419952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3630a-67c6-4b17-a70d-c40e76b4bfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:49.454857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-05c3630a-67c6-4b17-a70d-c40e76b4bfc6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:49.456114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-05c3630a-67c6-4b17-a70d-c40e76b4bfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:49.467817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:49.469629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:49.577842 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2474/4976] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:49.599345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3630a-67c6-4b17-a70d-c40e76b4bfc6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:49.604646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-05c3630a-67c6-4b17-a70d-c40e76b4bfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:49.612304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7df167-7134-4cf1-998f-ecdc98f31ecb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:49.626035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:49.627428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:49.627801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:49.628146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] PATH_INFO: `/v3/users/a01a7cc74e3e497188bec2d673d650aa` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:49.629477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01a7cc74e3e497188bec2d673d650aa)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:49.632168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:49.637927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:49.773393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01a7cc74e3e497188bec2d673d650aa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:49.774013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3630a-67c6-4b17-a70d-c40e76b4bfc6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:49.774141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01a7cc74e3e497188bec2d673d650aa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:49.782593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645413fa-4286-45af-9a4a-da3063a7e598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:49.783470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645413fa-4286-45af-9a4a-da3063a7e598 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:49.783470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645413fa-4286-45af-9a4a-da3063a7e598 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:49.783779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645413fa-4286-45af-9a4a-da3063a7e598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:49.786826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:49.791530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01a7cc74e3e497188bec2d673d650aa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:49.805669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645413fa-4286-45af-9a4a-da3063a7e598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:49.807491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645413fa-4286-45af-9a4a-da3063a7e598 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:49.812036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01a7cc74e3e497188bec2d673d650aa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:49.838660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01a7cc74e3e497188bec2d673d650aa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:49.844100 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2475/4977] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:49.856021 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2503/4978] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:49 2022] DELETE /identity/v3/users/a01a7cc74e3e497188bec2d673d650aa => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:40:50.937033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645413fa-4286-45af-9a4a-da3063a7e598 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:50.953867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645413fa-4286-45af-9a4a-da3063a7e598 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:51.122952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:51.127284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:51.127567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:51.127843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] PATH_INFO: `/v3/projects/a701939f871d411283d8b3c32c79fc3d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:51.132595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a701939f871d411283d8b3c32c79fc3d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:51.134877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:51.255000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a701939f871d411283d8b3c32c79fc3d', 'request_id': 'req-fa1805ba-68b4-4b21-934c-b13d7d886f6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.267265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a701939f871d411283d8b3c32c79fc3d', 'request_id': 'req-fa1805ba-68b4-4b21-934c-b13d7d886f6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.282821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a701939f871d411283d8b3c32c79fc3d', 'request_id': 'req-fa1805ba-68b4-4b21-934c-b13d7d886f6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.294819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] The token cache is being invalidate because project a701939f871d411283d8b3c32c79fc3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:51.295104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.295784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.298142 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2476/4979] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:50 2022] DELETE /identity/v3/projects/a701939f871d411283d8b3c32c79fc3d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:51.302219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:51.303808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:51.339338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6e9e1-fffb-43b1-947b-3f96bf1a1e05 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:51.493497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:51.507738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:51.509274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:51.509573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] PATH_INFO: `/v3/users/8374e9c25534494f90f41423230f5321` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:51.520656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8374e9c25534494f90f41423230f5321)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:51.526293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:51.608553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:51.610349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:51.645864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1805ba-68b4-4b21-934c-b13d7d886f6f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:51.669182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:51.670316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:51.670980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:51.672139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] PATH_INFO: `/v3/projects/188e77f581fb4feda1a4d4595e84b62f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:51.675422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=188e77f581fb4feda1a4d4595e84b62f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:51.684927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:51.707060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8374e9c25534494f90f41423230f5321'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.708782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8374e9c25534494f90f41423230f5321'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.729088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8374e9c25534494f90f41423230f5321'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.743548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8374e9c25534494f90f41423230f5321'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.780907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8374e9c25534494f90f41423230f5321'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.793119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:51.798422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2504/4980] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:51 2022] DELETE /identity/v3/users/8374e9c25534494f90f41423230f5321 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:51.820593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188e77f581fb4feda1a4d4595e84b62f', 'request_id': 'req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.834410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188e77f581fb4feda1a4d4595e84b62f', 'request_id': 'req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.854555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188e77f581fb4feda1a4d4595e84b62f', 'request_id': 'req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.894349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] The token cache is being invalidate because project 188e77f581fb4feda1a4d4595e84b62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:51.895042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.898273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f35b2d64-abdf-4b60-b0cf-1775ba66e8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:51.904571 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2477/4981] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:51 2022] DELETE /identity/v3/projects/188e77f581fb4feda1a4d4595e84b62f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:51.909330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:51.911325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:52.066818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:52.105096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4aaf-924d-4239-9f25-4c19469dd3e4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:52.130462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:52.132486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:52.132614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:52.133617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] PATH_INFO: `/v3/users/5e72ec76c66d49b19ab31f08177adf7c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:52.138514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e72ec76c66d49b19ab31f08177adf7c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:52.140733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:52.280392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e72ec76c66d49b19ab31f08177adf7c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:52.284021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e72ec76c66d49b19ab31f08177adf7c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:52.300237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e72ec76c66d49b19ab31f08177adf7c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:52.316462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e72ec76c66d49b19ab31f08177adf7c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:52.338240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e72ec76c66d49b19ab31f08177adf7c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:52.355525 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2505/4982] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:40:51 2022] DELETE /identity/v3/users/5e72ec76c66d49b19ab31f08177adf7c => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:53.679455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c2390-de91-4b48-9459-1ac283e2bb7b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:53.680350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c2390-de91-4b48-9459-1ac283e2bb7b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:53.680350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c2390-de91-4b48-9459-1ac283e2bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:53.760229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d72c2390-de91-4b48-9459-1ac283e2bb7b None None] MFA Rules not processed for user `5c888adb6034407987b3fd1ea544ee8d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:53.762479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d72c2390-de91-4b48-9459-1ac283e2bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:53.904882 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2478/4983] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:53.922003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:53.923485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:53.960521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c2390-de91-4b48-9459-1ac283e2bb7b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:53.961956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d72c2390-de91-4b48-9459-1ac283e2bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:54.070115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f161e-3a3a-4a35-b55d-21d24a21c00c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:54.097575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ff54c-b87f-4263-8f62-4bdfbeb3dbe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:54.098318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff54c-b87f-4263-8f62-4bdfbeb3dbe9 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:54.098593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff54c-b87f-4263-8f62-4bdfbeb3dbe9 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:54.100799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ff54c-b87f-4263-8f62-4bdfbeb3dbe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:54.102569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c2390-de91-4b48-9459-1ac283e2bb7b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:54.118430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:54.119093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:54.123662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ff54c-b87f-4263-8f62-4bdfbeb3dbe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:54.124062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:54.124400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] PATH_INFO: `/v3/projects/6d3f2aa46ad640739bb64bd4078c086c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:54.126662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ff54c-b87f-4263-8f62-4bdfbeb3dbe9 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:54.131214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3f2aa46ad640739bb64bd4078c086c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:54.139669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:54.166692 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2506/4984] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:54.256149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3f2aa46ad640739bb64bd4078c086c', 'request_id': 'req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:54.263731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:54.275064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3f2aa46ad640739bb64bd4078c086c', 'request_id': 'req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:54.283488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3f2aa46ad640739bb64bd4078c086c', 'request_id': 'req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:54.304760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] The token cache is being invalidate because project 6d3f2aa46ad640739bb64bd4078c086c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:54.305132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:54.305708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3ed6dd07-c9d9-4de3-9678-ed15ad33eb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:54.309098 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2479/4985] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:53 2022] DELETE /identity/v3/projects/6d3f2aa46ad640739bb64bd4078c086c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:54.314025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472428d-85c7-48b6-904f-1512c37b244a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:54.314578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472428d-85c7-48b6-904f-1512c37b244a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:54.314578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472428d-85c7-48b6-904f-1512c37b244a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:54.348795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a472428d-85c7-48b6-904f-1512c37b244a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:54.350123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a472428d-85c7-48b6-904f-1512c37b244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:54.460568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:54.490265 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2507/4986] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:54.499232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926896-a79b-4a15-86af-99efe7f14301 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:54.499973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926896-a79b-4a15-86af-99efe7f14301 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:54.500420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d926896-a79b-4a15-86af-99efe7f14301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:54.504644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472428d-85c7-48b6-904f-1512c37b244a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:54.507476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a472428d-85c7-48b6-904f-1512c37b244a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:54.548043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4d926896-a79b-4a15-86af-99efe7f14301 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:54.551735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4d926896-a79b-4a15-86af-99efe7f14301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:54.557163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472428d-85c7-48b6-904f-1512c37b244a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:54.566248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:54.567972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:54.568379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:54.568926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] PATH_INFO: `/v3/projects/34ceb7ed83df471db2a02cf0ac3e376e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:54.572062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ceb7ed83df471db2a02cf0ac3e376e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:54.576034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:54.580189 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2480/4987] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:54.584740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d926896-a79b-4a15-86af-99efe7f14301 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:54.621223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d926896-a79b-4a15-86af-99efe7f14301 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:54.643331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4010bf-9279-4672-b441-bdbcea0cafc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:54.644080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4010bf-9279-4672-b441-bdbcea0cafc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:54.644402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4010bf-9279-4672-b441-bdbcea0cafc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:54.644733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4010bf-9279-4672-b441-bdbcea0cafc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:54.645385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4010bf-9279-4672-b441-bdbcea0cafc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:40:54.645776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4010bf-9279-4672-b441-bdbcea0cafc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:54.648617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4010bf-9279-4672-b441-bdbcea0cafc3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:54.669557 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2481/4988] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:54.670470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4010bf-9279-4672-b441-bdbcea0cafc3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:54.687870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4010bf-9279-4672-b441-bdbcea0cafc3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:54.694501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ceb7ed83df471db2a02cf0ac3e376e', 'request_id': 'req-89facc1b-4190-430e-873e-6c7b691229b2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:54.711425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ceb7ed83df471db2a02cf0ac3e376e', 'request_id': 'req-89facc1b-4190-430e-873e-6c7b691229b2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:54.729406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ceb7ed83df471db2a02cf0ac3e376e', 'request_id': 'req-89facc1b-4190-430e-873e-6c7b691229b2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:54.757830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e58eae-8f9b-4fbd-844b-9ea9dbf1967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:54.758714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] The token cache is being invalidate because project 34ceb7ed83df471db2a02cf0ac3e376e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:40:54.758873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e58eae-8f9b-4fbd-844b-9ea9dbf1967a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:54.759288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e58eae-8f9b-4fbd-844b-9ea9dbf1967a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:54.759712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e58eae-8f9b-4fbd-844b-9ea9dbf1967a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:54.760112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:54.760681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e58eae-8f9b-4fbd-844b-9ea9dbf1967a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:54.761633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89facc1b-4190-430e-873e-6c7b691229b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:40:54.763462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e58eae-8f9b-4fbd-844b-9ea9dbf1967a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:54.770180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2508/4989] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:40:54 2022] DELETE /identity/v3/projects/34ceb7ed83df471db2a02cf0ac3e376e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:54.773777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4eb76-ae82-4c71-97e5-0a076cdcf2ab None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:54.774979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4eb76-ae82-4c71-97e5-0a076cdcf2ab None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:54.775363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4eb76-ae82-4c71-97e5-0a076cdcf2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:54.806921 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2482/4990] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:54 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:54.809079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e58eae-8f9b-4fbd-844b-9ea9dbf1967a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:54.811463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e6e58eae-8f9b-4fbd-844b-9ea9dbf1967a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:54.833042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-37d4eb76-ae82-4c71-97e5-0a076cdcf2ab None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:54.834498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-37d4eb76-ae82-4c71-97e5-0a076cdcf2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:54.948637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e58eae-8f9b-4fbd-844b-9ea9dbf1967a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:54.959620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da86b32-7b39-428a-b686-6807b35a9923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:54.960259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da86b32-7b39-428a-b686-6807b35a9923 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:54.960533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da86b32-7b39-428a-b686-6807b35a9923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:54.962362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da86b32-7b39-428a-b686-6807b35a9923 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:54.965784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da86b32-7b39-428a-b686-6807b35a9923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:54.970366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da86b32-7b39-428a-b686-6807b35a9923 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.017843 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2509/4991] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:55.020311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833c401-89f6-41e9-9b94-1b7a358be56c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.020808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833c401-89f6-41e9-9b94-1b7a358be56c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.021371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833c401-89f6-41e9-9b94-1b7a358be56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.033296 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2483/4992] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:40:54 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:55.035627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da86b32-7b39-428a-b686-6807b35a9923 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.060178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da86b32-7b39-428a-b686-6807b35a9923 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:55.066638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d833c401-89f6-41e9-9b94-1b7a358be56c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:55.067874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d833c401-89f6-41e9-9b94-1b7a358be56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:55.070355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8795c-7a81-4441-b1e0-86a1a6940bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:55.070987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8795c-7a81-4441-b1e0-86a1a6940bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.071262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8795c-7a81-4441-b1e0-86a1a6940bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.071528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8795c-7a81-4441-b1e0-86a1a6940bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.072183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8795c-7a81-4441-b1e0-86a1a6940bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:55.076812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8795c-7a81-4441-b1e0-86a1a6940bb5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.093254 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2510/4993] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:55.097090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833c401-89f6-41e9-9b94-1b7a358be56c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.101324 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2484/4994] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:55.106671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8795c-7a81-4441-b1e0-86a1a6940bb5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.123993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833c401-89f6-41e9-9b94-1b7a358be56c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:55.129079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8795c-7a81-4441-b1e0-86a1a6940bb5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:55.145015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17767a31-261d-4f5c-b738-5a74556761ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:55.145813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17767a31-261d-4f5c-b738-5a74556761ec admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.146137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17767a31-261d-4f5c-b738-5a74556761ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.146460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17767a31-261d-4f5c-b738-5a74556761ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.146777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4d78-2316-4280-82ec-e41b30977b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:55.148164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17767a31-261d-4f5c-b738-5a74556761ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:55.148403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4d78-2316-4280-82ec-e41b30977b1f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.148878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4d78-2316-4280-82ec-e41b30977b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.149397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4d78-2316-4280-82ec-e41b30977b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.150354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4d78-2316-4280-82ec-e41b30977b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:40:55.151027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17767a31-261d-4f5c-b738-5a74556761ec admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.151679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4d78-2316-4280-82ec-e41b30977b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:55.153752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4d78-2316-4280-82ec-e41b30977b1f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.180171 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2485/4995] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:55.182380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17767a31-261d-4f5c-b738-5a74556761ec admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.197257 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2511/4996] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:40:55.201032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4d78-2316-4280-82ec-e41b30977b1f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.206478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17767a31-261d-4f5c-b738-5a74556761ec admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:55.217922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669cc3e-0c71-4a17-bc0a-f4a0f242e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:55.218626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669cc3e-0c71-4a17-bc0a-f4a0f242e592 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.222215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669cc3e-0c71-4a17-bc0a-f4a0f242e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.222498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669cc3e-0c71-4a17-bc0a-f4a0f242e592 admin admin] PATH_INFO: `/v3/projects/39f07783e0174c76a47a119a4959aca9/users/3e02dab107224c678f83f485d7f9f17a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.228977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4d78-2316-4280-82ec-e41b30977b1f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:55.251229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa9e0-c8a0-4c57-a49f-7b1825fbf939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:55.251877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa9e0-c8a0-4c57-a49f-7b1825fbf939 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.252573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa9e0-c8a0-4c57-a49f-7b1825fbf939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.252573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaa9e0-c8a0-4c57-a49f-7b1825fbf939 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.253253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaa9e0-c8a0-4c57-a49f-7b1825fbf939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:55.253900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:55.258432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669cc3e-0c71-4a17-bc0a-f4a0f242e592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f07783e0174c76a47a119a4959aca9, user_id=3e02dab107224c678f83f485d7f9f17a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:55.263391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaa9e0-c8a0-4c57-a49f-7b1825fbf939 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.264099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669cc3e-0c71-4a17-bc0a-f4a0f242e592 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.294083 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2486/4997] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:55 2022] PUT /identity/v3/projects/39f07783e0174c76a47a119a4959aca9/users/3e02dab107224c678f83f485d7f9f17a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:40:55.297043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe1d1c-44b0-495f-b2f2-a9d434451c36 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.297329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe1d1c-44b0-495f-b2f2-a9d434451c36 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.297596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe1d1c-44b0-495f-b2f2-a9d434451c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.333729 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2512/4998] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:40:55 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:40:55.334932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa9e0-c8a0-4c57-a49f-7b1825fbf939 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.354524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5fbe1d1c-44b0-495f-b2f2-a9d434451c36 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:55.357619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5fbe1d1c-44b0-495f-b2f2-a9d434451c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:55.416218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:55.460791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaa9e0-c8a0-4c57-a49f-7b1825fbf939 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:55.470522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e279b4-095d-4bd7-9667-23f239ebd9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:55.471234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e279b4-095d-4bd7-9667-23f239ebd9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.471514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e279b4-095d-4bd7-9667-23f239ebd9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.471761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e279b4-095d-4bd7-9667-23f239ebd9b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.472424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e279b4-095d-4bd7-9667-23f239ebd9b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:55.479112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e279b4-095d-4bd7-9667-23f239ebd9b7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.487078 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2487/4999] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:55.488126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe1d1c-44b0-495f-b2f2-a9d434451c36 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.490178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5fbe1d1c-44b0-495f-b2f2-a9d434451c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:55.517867 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2513/5000] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:40:55 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:40:55.531314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e279b4-095d-4bd7-9667-23f239ebd9b7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.560007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e279b4-095d-4bd7-9667-23f239ebd9b7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:55.575168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9df577-5435-44f1-b2f6-6eac0cc03170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:55.575916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df577-5435-44f1-b2f6-6eac0cc03170 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.576202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df577-5435-44f1-b2f6-6eac0cc03170 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.576468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9df577-5435-44f1-b2f6-6eac0cc03170 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.577126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9df577-5435-44f1-b2f6-6eac0cc03170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:55.578779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9df577-5435-44f1-b2f6-6eac0cc03170 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.593249 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2514/5001] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:40:55.594799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9df577-5435-44f1-b2f6-6eac0cc03170 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.609800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9df577-5435-44f1-b2f6-6eac0cc03170 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:55.617303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d1800-d434-49e6-94d6-d975a30840bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:55.618114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d1800-d434-49e6-94d6-d975a30840bb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.618493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d1800-d434-49e6-94d6-d975a30840bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.618863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d1800-d434-49e6-94d6-d975a30840bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.620303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d1800-d434-49e6-94d6-d975a30840bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:55.621580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe1d1c-44b0-495f-b2f2-a9d434451c36 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:55.624345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d1800-d434-49e6-94d6-d975a30840bb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.631611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd41be-512a-4e8e-9fd7-861c757b7868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:55.632435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd41be-512a-4e8e-9fd7-861c757b7868 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.632880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd41be-512a-4e8e-9fd7-861c757b7868 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.633315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd41be-512a-4e8e-9fd7-861c757b7868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.638124 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2515/5002] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:40:55.642436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d1800-d434-49e6-94d6-d975a30840bb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.659989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d1800-d434-49e6-94d6-d975a30840bb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:55.662470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd41be-512a-4e8e-9fd7-861c757b7868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:55.664145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd41be-512a-4e8e-9fd7-861c757b7868 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.667653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3addcb-ad83-4b08-a1ed-55079854f646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:55.668648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3addcb-ad83-4b08-a1ed-55079854f646 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.669782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3addcb-ad83-4b08-a1ed-55079854f646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.669782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3addcb-ad83-4b08-a1ed-55079854f646 admin admin] PATH_INFO: `/v3/projects/2094741841cd4569b8f4679f682e43b4/users/c6e13f94f9b84f98a2227f6a29a058c2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.698623 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2488/5003] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:55.703286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3addcb-ad83-4b08-a1ed-55079854f646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2094741841cd4569b8f4679f682e43b4, user_id=c6e13f94f9b84f98a2227f6a29a058c2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:55.706566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3addcb-ad83-4b08-a1ed-55079854f646 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:55.748544 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2516/5004] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:40:55 2022] PUT /identity/v3/projects/2094741841cd4569b8f4679f682e43b4/users/c6e13f94f9b84f98a2227f6a29a058c2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:40:55.748816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e1706-7ade-4b31-83d7-aff21e9ada86 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:55.749178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e1706-7ade-4b31-83d7-aff21e9ada86 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:55.749481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e1706-7ade-4b31-83d7-aff21e9ada86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:55.794464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-606e1706-7ade-4b31-83d7-aff21e9ada86 None None] MFA Rules not processed for user `c6e13f94f9b84f98a2227f6a29a058c2`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:55.796133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-606e1706-7ade-4b31-83d7-aff21e9ada86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:55.915545 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2489/5005] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:40:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:55.921648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3addcb-ad83-4b08-a1ed-55079854f646 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:55.924017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6c3addcb-ad83-4b08-a1ed-55079854f646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:56.039403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3addcb-ad83-4b08-a1ed-55079854f646 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:56.045940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5488f-bbfa-44d0-a62a-93bbad0a3e68 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:56.046817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5488f-bbfa-44d0-a62a-93bbad0a3e68 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:56.047170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5488f-bbfa-44d0-a62a-93bbad0a3e68 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:56.047541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5488f-bbfa-44d0-a62a-93bbad0a3e68 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:56.062515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5488f-bbfa-44d0-a62a-93bbad0a3e68 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:56.064891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5488f-bbfa-44d0-a62a-93bbad0a3e68 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:56.080459 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2517/5006] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:40:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:56.343664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13369576-b856-40e4-8c98-c85d9f490816 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:56.343950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13369576-b856-40e4-8c98-c85d9f490816 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:56.344225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13369576-b856-40e4-8c98-c85d9f490816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:56.376974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-13369576-b856-40e4-8c98-c85d9f490816 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:56.378338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-13369576-b856-40e4-8c98-c85d9f490816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:56.460647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:56.525620 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2490/5007] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:40:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:56.575180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5488f-bbfa-44d0-a62a-93bbad0a3e68 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:56.575620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eaf5488f-bbfa-44d0-a62a-93bbad0a3e68 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:56.769231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5488f-bbfa-44d0-a62a-93bbad0a3e68 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:56.781440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45319a0-1aa2-4af3-ba11-1a31dafcc30b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:56.782111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45319a0-1aa2-4af3-ba11-1a31dafcc30b service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:56.782393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45319a0-1aa2-4af3-ba11-1a31dafcc30b service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:56.782643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45319a0-1aa2-4af3-ba11-1a31dafcc30b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:56.803579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45319a0-1aa2-4af3-ba11-1a31dafcc30b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:56.805202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45319a0-1aa2-4af3-ba11-1a31dafcc30b service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:56.822928 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2518/5008] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:40:57.297512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd79aa6-70fe-42cb-b48a-7a68e89dd97f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:57.298064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd79aa6-70fe-42cb-b48a-7a68e89dd97f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:57.298198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd79aa6-70fe-42cb-b48a-7a68e89dd97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:57.336740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0cd79aa6-70fe-42cb-b48a-7a68e89dd97f None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:57.338138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0cd79aa6-70fe-42cb-b48a-7a68e89dd97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:57.350186 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2491/5009] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:40:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:57.365324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45319a0-1aa2-4af3-ba11-1a31dafcc30b service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:57.390726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45319a0-1aa2-4af3-ba11-1a31dafcc30b service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:57.408510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc0801-7f9e-4f71-9782-ad195cfb11c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:57.409503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc0801-7f9e-4f71-9782-ad195cfb11c7 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:57.409902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc0801-7f9e-4f71-9782-ad195cfb11c7 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:57.410231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc0801-7f9e-4f71-9782-ad195cfb11c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:57.433403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc0801-7f9e-4f71-9782-ad195cfb11c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:57.435562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc0801-7f9e-4f71-9782-ad195cfb11c7 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:57.442629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:57.466973 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2519/5010] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:57.931776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664d82f-4d63-4ce0-9e41-c51efea00143 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:57.932040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664d82f-4d63-4ce0-9e41-c51efea00143 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:57.932306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664d82f-4d63-4ce0-9e41-c51efea00143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:58.003089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d664d82f-4d63-4ce0-9e41-c51efea00143 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:58.005549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d664d82f-4d63-4ce0-9e41-c51efea00143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:58.029426 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2492/5011] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:40:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:58.045815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc0801-7f9e-4f71-9782-ad195cfb11c7 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:58.060841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc0801-7f9e-4f71-9782-ad195cfb11c7 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:58.066769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9e400-42c6-44aa-9f57-5fec6311dfcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:58.067617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9e400-42c6-44aa-9f57-5fec6311dfcd service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:58.068045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9e400-42c6-44aa-9f57-5fec6311dfcd service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:58.068586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc9e400-42c6-44aa-9f57-5fec6311dfcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:58.085768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9e400-42c6-44aa-9f57-5fec6311dfcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:58.087674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc9e400-42c6-44aa-9f57-5fec6311dfcd service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:58.101100 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2520/5012] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:58.588980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd500-1965-4112-82c1-b6e4faefb2eb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:58.590082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd500-1965-4112-82c1-b6e4faefb2eb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:58.590999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccfd500-1965-4112-82c1-b6e4faefb2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:58.626748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6ccfd500-1965-4112-82c1-b6e4faefb2eb None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:58.628331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6ccfd500-1965-4112-82c1-b6e4faefb2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:58.649084 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2493/5013] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:40:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:58.663713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9e400-42c6-44aa-9f57-5fec6311dfcd service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:58.677283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc9e400-42c6-44aa-9f57-5fec6311dfcd service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:58.685223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66567b-a246-4a94-8870-82fbe4e13e4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:58.686097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66567b-a246-4a94-8870-82fbe4e13e4f service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:58.686625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66567b-a246-4a94-8870-82fbe4e13e4f service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:58.687121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66567b-a246-4a94-8870-82fbe4e13e4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:58.699925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66567b-a246-4a94-8870-82fbe4e13e4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:58.705427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66567b-a246-4a94-8870-82fbe4e13e4f service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:58.738125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2521/5014] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:59.145625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9bf28-fbf4-44e9-8c64-48ebf5c1b454 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:59.146720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9bf28-fbf4-44e9-8c64-48ebf5c1b454 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:59.148644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9bf28-fbf4-44e9-8c64-48ebf5c1b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:59.181318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-eac9bf28-fbf4-44e9-8c64-48ebf5c1b454 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:59.182720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eac9bf28-fbf4-44e9-8c64-48ebf5c1b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:59.198277 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2494/5015] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:40:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:40:59.207475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66567b-a246-4a94-8870-82fbe4e13e4f service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:59.220483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66567b-a246-4a94-8870-82fbe4e13e4f service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:59.229633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a15fea-1721-4ea6-8051-be9c9cfdfe62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:59.230987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a15fea-1721-4ea6-8051-be9c9cfdfe62 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:59.231758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a15fea-1721-4ea6-8051-be9c9cfdfe62 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:59.232602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a15fea-1721-4ea6-8051-be9c9cfdfe62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:59.257242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a15fea-1721-4ea6-8051-be9c9cfdfe62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:59.259683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a15fea-1721-4ea6-8051-be9c9cfdfe62 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:59.288535 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2522/5016] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:59.667408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8c8d0-883d-417f-acb7-6e071c489a9b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:59.669207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8c8d0-883d-417f-acb7-6e071c489a9b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:59.669493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8c8d0-883d-417f-acb7-6e071c489a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:59.691915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7cc8c8d0-883d-417f-acb7-6e071c489a9b None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:40:59.693220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7cc8c8d0-883d-417f-acb7-6e071c489a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:40:59.716948 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2495/5017] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:40:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:40:59.717826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a15fea-1721-4ea6-8051-be9c9cfdfe62 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:40:59.732862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a15fea-1721-4ea6-8051-be9c9cfdfe62 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:40:59.745345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e9215-1183-4b37-82a9-94f09625bcee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:40:59.746485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e9215-1183-4b37-82a9-94f09625bcee service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:40:59.747168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e9215-1183-4b37-82a9-94f09625bcee service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:40:59.748385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e9215-1183-4b37-82a9-94f09625bcee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:40:59.764555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e9215-1183-4b37-82a9-94f09625bcee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:40:59.766931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e9215-1183-4b37-82a9-94f09625bcee service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:40:59.782323 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2523/5018] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:40:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:41:01.643507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297de86-75ab-4bb2-b175-045c1223a616 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:01.644163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297de86-75ab-4bb2-b175-045c1223a616 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:01.644163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297de86-75ab-4bb2-b175-045c1223a616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:01.673895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0297de86-75ab-4bb2-b175-045c1223a616 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:01.675137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0297de86-75ab-4bb2-b175-045c1223a616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:01.692725 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2496/5019] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:41:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:01.708910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e9215-1183-4b37-82a9-94f09625bcee service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:01.722858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e9215-1183-4b37-82a9-94f09625bcee service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:01.729603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89d92a-7bf4-48ed-bf4d-2f260f465b93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:01.731048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89d92a-7bf4-48ed-bf4d-2f260f465b93 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:01.731703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89d92a-7bf4-48ed-bf4d-2f260f465b93 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:01.732301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89d92a-7bf4-48ed-bf4d-2f260f465b93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:01.745251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89d92a-7bf4-48ed-bf4d-2f260f465b93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:01.747659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89d92a-7bf4-48ed-bf4d-2f260f465b93 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:01.761245 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2524/5020] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:41:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:01.945302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69935ecd-20c0-499f-bfa2-3ae420f58b00 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:01.945705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69935ecd-20c0-499f-bfa2-3ae420f58b00 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:01.946264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69935ecd-20c0-499f-bfa2-3ae420f58b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:01.975222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-69935ecd-20c0-499f-bfa2-3ae420f58b00 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:01.977131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-69935ecd-20c0-499f-bfa2-3ae420f58b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:01.986707 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2497/5021] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:41:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:02.007053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89d92a-7bf4-48ed-bf4d-2f260f465b93 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:02.020729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89d92a-7bf4-48ed-bf4d-2f260f465b93 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:02.026699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b87b3-a2d8-4ad2-9d76-a1d8714d0af2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:02.027625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b87b3-a2d8-4ad2-9d76-a1d8714d0af2 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:02.028192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b87b3-a2d8-4ad2-9d76-a1d8714d0af2 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:02.028473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b87b3-a2d8-4ad2-9d76-a1d8714d0af2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:02.043493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b87b3-a2d8-4ad2-9d76-a1d8714d0af2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:02.045427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b87b3-a2d8-4ad2-9d76-a1d8714d0af2 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:02.055197 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2525/5022] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:41:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:02.282774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a835e7-094e-4c21-9a1e-2dc0eee0b831 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:02.283059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a835e7-094e-4c21-9a1e-2dc0eee0b831 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:02.283334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a835e7-094e-4c21-9a1e-2dc0eee0b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:02.307117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e7a835e7-094e-4c21-9a1e-2dc0eee0b831 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:02.308788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e7a835e7-094e-4c21-9a1e-2dc0eee0b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:02.318459 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2498/5023] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:41:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:41:02.338408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b87b3-a2d8-4ad2-9d76-a1d8714d0af2 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:02.356627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b87b3-a2d8-4ad2-9d76-a1d8714d0af2 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:02.363631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907103a3-76aa-4f13-9888-c6eeb982e4b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:02.365161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907103a3-76aa-4f13-9888-c6eeb982e4b1 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:02.366336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907103a3-76aa-4f13-9888-c6eeb982e4b1 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:02.367014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907103a3-76aa-4f13-9888-c6eeb982e4b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:02.403292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907103a3-76aa-4f13-9888-c6eeb982e4b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:02.405491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907103a3-76aa-4f13-9888-c6eeb982e4b1 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:02.416929 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2526/5024] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:41:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:02.658413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4829e8-95bf-40aa-93ba-fcba8cd1e7d6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:02.658942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4829e8-95bf-40aa-93ba-fcba8cd1e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:02.658942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4829e8-95bf-40aa-93ba-fcba8cd1e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:02.683534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ae4829e8-95bf-40aa-93ba-fcba8cd1e7d6 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:02.688605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ae4829e8-95bf-40aa-93ba-fcba8cd1e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:02.699613 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2499/5025] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:41:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:02.715179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907103a3-76aa-4f13-9888-c6eeb982e4b1 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:02.732822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907103a3-76aa-4f13-9888-c6eeb982e4b1 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:02.744715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb9be7-98c9-4141-8901-cc2f1899c71a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:02.746300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb9be7-98c9-4141-8901-cc2f1899c71a service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:02.746802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb9be7-98c9-4141-8901-cc2f1899c71a service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:02.747358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb9be7-98c9-4141-8901-cc2f1899c71a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:02.759210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb9be7-98c9-4141-8901-cc2f1899c71a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:02.765780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb9be7-98c9-4141-8901-cc2f1899c71a service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:02.806332 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2527/5026] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:41:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:03.035580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45627-600f-4110-848c-306195499a24 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:03.035867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45627-600f-4110-848c-306195499a24 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:03.036133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45627-600f-4110-848c-306195499a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:03.082638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d7b45627-600f-4110-848c-306195499a24 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:03.084513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d7b45627-600f-4110-848c-306195499a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:03.095019 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2500/5027] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:41:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:03.113136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb9be7-98c9-4141-8901-cc2f1899c71a service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:03.149769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb9be7-98c9-4141-8901-cc2f1899c71a service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:03.165181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11a8fd-e3b9-4237-92ff-60e4275657a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:03.166618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11a8fd-e3b9-4237-92ff-60e4275657a8 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:03.167304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11a8fd-e3b9-4237-92ff-60e4275657a8 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:03.168847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11a8fd-e3b9-4237-92ff-60e4275657a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:03.197256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11a8fd-e3b9-4237-92ff-60e4275657a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:03.200193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11a8fd-e3b9-4237-92ff-60e4275657a8 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:03.249131 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2528/5028] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:41:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:03.465714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dc17a-2d79-464d-8062-6d04fac410b2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:03.466321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dc17a-2d79-464d-8062-6d04fac410b2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:03.466774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dc17a-2d79-464d-8062-6d04fac410b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:03.513324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d51dc17a-2d79-464d-8062-6d04fac410b2 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:03.514845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d51dc17a-2d79-464d-8062-6d04fac410b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:03.523662 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2501/5029] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:41:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:03.539742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11a8fd-e3b9-4237-92ff-60e4275657a8 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:03.554652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11a8fd-e3b9-4237-92ff-60e4275657a8 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:03.562086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a93bea-d2b8-4a79-af53-3a67f74cfdea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:03.562727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93bea-d2b8-4a79-af53-3a67f74cfdea service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:03.563001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93bea-d2b8-4a79-af53-3a67f74cfdea service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:03.563317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a93bea-d2b8-4a79-af53-3a67f74cfdea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:03.577858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a93bea-d2b8-4a79-af53-3a67f74cfdea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:03.581816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a93bea-d2b8-4a79-af53-3a67f74cfdea service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:03.605668 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2529/5030] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:41:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:03.795357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dc17a-2d79-464d-8062-6d04fac410b2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:03.885458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dc17a-2d79-464d-8062-6d04fac410b2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:03.892819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:03.893585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:03.893995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:03.894459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] PATH_INFO: `/v3/users/c6e13f94f9b84f98a2227f6a29a058c2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:03.895660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6e13f94f9b84f98a2227f6a29a058c2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:03.897759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:03.961335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6e13f94f9b84f98a2227f6a29a058c2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:03.970603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6e13f94f9b84f98a2227f6a29a058c2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:03.973671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:03.989904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6e13f94f9b84f98a2227f6a29a058c2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:04.001021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6e13f94f9b84f98a2227f6a29a058c2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:04.002861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6e13f94f9b84f98a2227f6a29a058c2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:04.011425 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2502/5031] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:41:03 2022] DELETE /identity/v3/users/c6e13f94f9b84f98a2227f6a29a058c2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:04.016143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef732-ecd1-4050-b8c7-e126534204d3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:04.016689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef732-ecd1-4050-b8c7-e126534204d3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:04.016689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ef732-ecd1-4050-b8c7-e126534204d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:04.048183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e83ef732-ecd1-4050-b8c7-e126534204d3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:04.049609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e83ef732-ecd1-4050-b8c7-e126534204d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:04.125109 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2530/5032] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:04.166348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:04.173942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:04.268001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61530858-84cd-44bb-81de-e20745e3b644 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:04.272059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22db408-c623-44aa-bc1d-f0ce13c9c3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:04.272679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22db408-c623-44aa-bc1d-f0ce13c9c3fe service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:04.272956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22db408-c623-44aa-bc1d-f0ce13c9c3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:04.273394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22db408-c623-44aa-bc1d-f0ce13c9c3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:04.286905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22db408-c623-44aa-bc1d-f0ce13c9c3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:04.288398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22db408-c623-44aa-bc1d-f0ce13c9c3fe service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:04.299613 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2503/5033] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:06.253399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ef732-ecd1-4050-b8c7-e126534204d3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:06.255432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e83ef732-ecd1-4050-b8c7-e126534204d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:06.272188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ef732-ecd1-4050-b8c7-e126534204d3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:06.283459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:06.284903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:06.285102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:06.285547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] PATH_INFO: `/v3/projects/2094741841cd4569b8f4679f682e43b4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:06.287096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2094741841cd4569b8f4679f682e43b4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:06.289507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:06.320266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:06.365685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2094741841cd4569b8f4679f682e43b4', 'request_id': 'req-9f7ab243-28cd-44b9-b769-d7993230e419'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:06.377246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2094741841cd4569b8f4679f682e43b4', 'request_id': 'req-9f7ab243-28cd-44b9-b769-d7993230e419'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:06.397418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2094741841cd4569b8f4679f682e43b4', 'request_id': 'req-9f7ab243-28cd-44b9-b769-d7993230e419'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:06.417148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] The token cache is being invalidate because project 2094741841cd4569b8f4679f682e43b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:41:06.419284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:06.421626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f7ab243-28cd-44b9-b769-d7993230e419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:06.428941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290373e7-1ed5-49d3-9906-f1267a11747e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:06.430276 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2531/5034] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:41:06 2022] DELETE /identity/v3/projects/2094741841cd4569b8f4679f682e43b4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:06.430489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290373e7-1ed5-49d3-9906-f1267a11747e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:06.431063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290373e7-1ed5-49d3-9906-f1267a11747e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:06.456446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-290373e7-1ed5-49d3-9906-f1267a11747e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:06.458049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-290373e7-1ed5-49d3-9906-f1267a11747e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:06.626797 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2504/5035] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:41:06.629005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aada1-bf51-4f36-94e0-a3195f169a97 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:06.629588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aada1-bf51-4f36-94e0-a3195f169a97 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:06.630558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aada1-bf51-4f36-94e0-a3195f169a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:06.707978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-397aada1-bf51-4f36-94e0-a3195f169a97 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:06.710412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-397aada1-bf51-4f36-94e0-a3195f169a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:06.730195 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2532/5036] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:06.735159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290373e7-1ed5-49d3-9906-f1267a11747e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:06.751480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290373e7-1ed5-49d3-9906-f1267a11747e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:06.767261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f7a5b-4f40-4844-b8c5-052558ff572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:06.768431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f7a5b-4f40-4844-b8c5-052558ff572d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:06.768902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f7a5b-4f40-4844-b8c5-052558ff572d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:06.769350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f7a5b-4f40-4844-b8c5-052558ff572d admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:06.770223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f7a5b-4f40-4844-b8c5-052558ff572d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:41:06.770688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f7a5b-4f40-4844-b8c5-052558ff572d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:06.777338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f7a5b-4f40-4844-b8c5-052558ff572d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:06.810111 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2505/5037] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:41:06.814973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aada1-bf51-4f36-94e0-a3195f169a97 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:06.831582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aada1-bf51-4f36-94e0-a3195f169a97 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:06.844842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c713437-0949-4930-8bcb-ae4f94aaff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:06.846371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c713437-0949-4930-8bcb-ae4f94aaff6d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:06.846825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c713437-0949-4930-8bcb-ae4f94aaff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:06.847207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c713437-0949-4930-8bcb-ae4f94aaff6d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:06.848028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c713437-0949-4930-8bcb-ae4f94aaff6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:06.852395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c713437-0949-4930-8bcb-ae4f94aaff6d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:06.917983 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2533/5038] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:06 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:06.920930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f7a5b-4f40-4844-b8c5-052558ff572d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:06.936435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f7a5b-4f40-4844-b8c5-052558ff572d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:07.035385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e3cae-4d4b-4ad0-8835-d104d74cdc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:07.036512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3cae-4d4b-4ad0-8835-d104d74cdc18 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:07.037070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3cae-4d4b-4ad0-8835-d104d74cdc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:07.038293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3cae-4d4b-4ad0-8835-d104d74cdc18 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:07.040147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e3cae-4d4b-4ad0-8835-d104d74cdc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:07.045660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e3cae-4d4b-4ad0-8835-d104d74cdc18 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:07.072771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:07.087761 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2506/5039] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:41:06 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:07.092562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c713437-0949-4930-8bcb-ae4f94aaff6d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:07.105626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c713437-0949-4930-8bcb-ae4f94aaff6d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:07.111560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa050a-de4a-4256-951e-9701dabd42e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:07.112650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa050a-de4a-4256-951e-9701dabd42e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:07.113237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa050a-de4a-4256-951e-9701dabd42e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:07.113704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa050a-de4a-4256-951e-9701dabd42e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:07.115658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa050a-de4a-4256-951e-9701dabd42e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:07.118106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa050a-de4a-4256-951e-9701dabd42e8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:07.136602 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2534/5040] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:07.141398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e3cae-4d4b-4ad0-8835-d104d74cdc18 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:07.158372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e3cae-4d4b-4ad0-8835-d104d74cdc18 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:07.172970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e15cc-ade6-41d9-8937-44b95366026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:07.174243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e15cc-ade6-41d9-8937-44b95366026c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:07.174919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e15cc-ade6-41d9-8937-44b95366026c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:07.176746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e15cc-ade6-41d9-8937-44b95366026c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:07.177899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e15cc-ade6-41d9-8937-44b95366026c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:07.182770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e15cc-ade6-41d9-8937-44b95366026c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:07.211322 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2507/5041] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:07.216298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa050a-de4a-4256-951e-9701dabd42e8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:07.227768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa050a-de4a-4256-951e-9701dabd42e8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:07.234294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56af96d-9e84-4973-8f1c-90e70d26829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:07.235504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56af96d-9e84-4973-8f1c-90e70d26829d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:07.236090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56af96d-9e84-4973-8f1c-90e70d26829d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:07.236657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56af96d-9e84-4973-8f1c-90e70d26829d admin admin] PATH_INFO: `/v3/projects/f3a20829563d476e9cb71538d60a30ba/users/2583d1db69d640378497a26aeaa992c6/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:07.255827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56af96d-9e84-4973-8f1c-90e70d26829d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a20829563d476e9cb71538d60a30ba, user_id=2583d1db69d640378497a26aeaa992c6, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:07.259745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56af96d-9e84-4973-8f1c-90e70d26829d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:07.284315 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2535/5042] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:07 2022] PUT /identity/v3/projects/f3a20829563d476e9cb71538d60a30ba/users/2583d1db69d640378497a26aeaa992c6/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:07.295751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61270b2-dc82-4ba8-b25f-eeb41c7d6972 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:07.296253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61270b2-dc82-4ba8-b25f-eeb41c7d6972 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:07.296778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61270b2-dc82-4ba8-b25f-eeb41c7d6972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:07.361217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f61270b2-dc82-4ba8-b25f-eeb41c7d6972 None None] MFA Rules not processed for user `2583d1db69d640378497a26aeaa992c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:07.362960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f61270b2-dc82-4ba8-b25f-eeb41c7d6972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:07.498627 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2508/5043] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:07.499353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56af96d-9e84-4973-8f1c-90e70d26829d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:07.650470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56af96d-9e84-4973-8f1c-90e70d26829d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:07.673737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db2a5d-0f4f-4247-9433-5f5b89b7a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:07.674675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db2a5d-0f4f-4247-9433-5f5b89b7a2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:07.675048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db2a5d-0f4f-4247-9433-5f5b89b7a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:07.675413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db2a5d-0f4f-4247-9433-5f5b89b7a2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:07.676325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db2a5d-0f4f-4247-9433-5f5b89b7a2d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:07.678413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db2a5d-0f4f-4247-9433-5f5b89b7a2d2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:07.744391 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2536/5044] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:07 2022] POST /identity/v3/projects => generated 367 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:41:07.755192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61270b2-dc82-4ba8-b25f-eeb41c7d6972 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:07.783970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61270b2-dc82-4ba8-b25f-eeb41c7d6972 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:07.873949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226011e5-239d-4144-bdf1-ca3ae870f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:07.881014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226011e5-239d-4144-bdf1-ca3ae870f443 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:07.881354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226011e5-239d-4144-bdf1-ca3ae870f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:07.881566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226011e5-239d-4144-bdf1-ca3ae870f443 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:07.882318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226011e5-239d-4144-bdf1-ca3ae870f443 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:07.884313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226011e5-239d-4144-bdf1-ca3ae870f443 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:07.929772 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2509/5045] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:41:07 2022] POST /identity/v3/users => generated 284 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:07.934118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db2a5d-0f4f-4247-9433-5f5b89b7a2d2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:07.949080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db2a5d-0f4f-4247-9433-5f5b89b7a2d2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:07.955438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9bebf-3be8-4a14-acca-6ecbc88c3115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:07.956299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9bebf-3be8-4a14-acca-6ecbc88c3115 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:07.956671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9bebf-3be8-4a14-acca-6ecbc88c3115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:07.957592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9bebf-3be8-4a14-acca-6ecbc88c3115 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:07.958396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9bebf-3be8-4a14-acca-6ecbc88c3115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:07.960554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9bebf-3be8-4a14-acca-6ecbc88c3115 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:07.984557 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2537/5046] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:07.987778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226011e5-239d-4144-bdf1-ca3ae870f443 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:08.003128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226011e5-239d-4144-bdf1-ca3ae870f443 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:08.011768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e5e6d-742e-4749-934f-e79c3fc2d7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:08.012980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e5e6d-742e-4749-934f-e79c3fc2d7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:08.014393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e5e6d-742e-4749-934f-e79c3fc2d7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:08.015154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e5e6d-742e-4749-934f-e79c3fc2d7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:08.016319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e5e6d-742e-4749-934f-e79c3fc2d7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:08.018404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e5e6d-742e-4749-934f-e79c3fc2d7a8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:08.033702 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2510/5047] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:41:08.038411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9bebf-3be8-4a14-acca-6ecbc88c3115 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:08.058668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9bebf-3be8-4a14-acca-6ecbc88c3115 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:08.068829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2f501-4cf6-4a67-b7cf-9e7738a838c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:08.069581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f501-4cf6-4a67-b7cf-9e7738a838c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:08.069856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f501-4cf6-4a67-b7cf-9e7738a838c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:08.070378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f501-4cf6-4a67-b7cf-9e7738a838c1 admin admin] PATH_INFO: `/v3/projects/10f82a8ae9c541139bf1d8a670914880/users/25f65097c3864a4c9054ba1420837361/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:08.096730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2f501-4cf6-4a67-b7cf-9e7738a838c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f82a8ae9c541139bf1d8a670914880, user_id=25f65097c3864a4c9054ba1420837361, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:08.102086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2f501-4cf6-4a67-b7cf-9e7738a838c1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:08.123253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:08.137225 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2538/5048] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:08 2022] PUT /identity/v3/projects/10f82a8ae9c541139bf1d8a670914880/users/25f65097c3864a4c9054ba1420837361/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:08.150231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e1b1-febc-49c2-9269-e8595da8fa8e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:08.150841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e1b1-febc-49c2-9269-e8595da8fa8e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:08.151282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e1b1-febc-49c2-9269-e8595da8fa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:08.224009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1092e1b1-febc-49c2-9269-e8595da8fa8e None None] MFA Rules not processed for user `25f65097c3864a4c9054ba1420837361`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:08.225601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1092e1b1-febc-49c2-9269-e8595da8fa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:08.332914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:08.417856 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2511/5049] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:08.430469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2f501-4cf6-4a67-b7cf-9e7738a838c1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:08.432410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-82c2f501-4cf6-4a67-b7cf-9e7738a838c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:08.635549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2f501-4cf6-4a67-b7cf-9e7738a838c1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:08.656030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092e1b1-febc-49c2-9269-e8595da8fa8e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:08.656696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ca238-5190-4421-a6c9-6482d7197c97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:08.657342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ca238-5190-4421-a6c9-6482d7197c97 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:08.657805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1092e1b1-febc-49c2-9269-e8595da8fa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:08.658008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ca238-5190-4421-a6c9-6482d7197c97 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:08.658432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ca238-5190-4421-a6c9-6482d7197c97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:08.825740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092e1b1-febc-49c2-9269-e8595da8fa8e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:08.835293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e359f1-43f7-4873-9c63-8bf8c465b3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:08.836118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e359f1-43f7-4873-9c63-8bf8c465b3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:08.836493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e359f1-43f7-4873-9c63-8bf8c465b3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:08.836858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e359f1-43f7-4873-9c63-8bf8c465b3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:08.837944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ca238-5190-4421-a6c9-6482d7197c97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:08.839053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-06e359f1-43f7-4873-9c63-8bf8c465b3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:08.842139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ca238-5190-4421-a6c9-6482d7197c97 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:08.856275 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2539/5050] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:41:08.989764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e359f1-43f7-4873-9c63-8bf8c465b3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:08.992028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e359f1-43f7-4873-9c63-8bf8c465b3f8 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:09.013938 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2512/5051] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:09.111422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ca238-5190-4421-a6c9-6482d7197c97 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:09.122670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ca238-5190-4421-a6c9-6482d7197c97 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:09.139371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4320ed7-826b-40a6-b66c-d9a1a25be0f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:09.140285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4320ed7-826b-40a6-b66c-d9a1a25be0f8 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:09.140734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4320ed7-826b-40a6-b66c-d9a1a25be0f8 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:09.141846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4320ed7-826b-40a6-b66c-d9a1a25be0f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:09.174714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4320ed7-826b-40a6-b66c-d9a1a25be0f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:09.176437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4320ed7-826b-40a6-b66c-d9a1a25be0f8 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:09.191533 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2540/5052] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:11.732038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e359f1-43f7-4873-9c63-8bf8c465b3f8 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:11.746933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e359f1-43f7-4873-9c63-8bf8c465b3f8 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:11.759497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:11.760559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:11.761161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:11.762037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] PATH_INFO: `/v3/users/2583d1db69d640378497a26aeaa992c6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:11.763498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2583d1db69d640378497a26aeaa992c6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:11.766731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:11.856108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2583d1db69d640378497a26aeaa992c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:11.866087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2583d1db69d640378497a26aeaa992c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:11.888149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2583d1db69d640378497a26aeaa992c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:11.901790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2583d1db69d640378497a26aeaa992c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:11.903625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2583d1db69d640378497a26aeaa992c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:11.916085 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2513/5053] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:41:11 2022] DELETE /identity/v3/users/2583d1db69d640378497a26aeaa992c6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:11.921658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba95e2-453c-4750-92c5-906b379c3d07 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:11.922310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba95e2-453c-4750-92c5-906b379c3d07 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:11.922310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba95e2-453c-4750-92c5-906b379c3d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:11.958347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d7ba95e2-453c-4750-92c5-906b379c3d07 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:11.959568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d7ba95e2-453c-4750-92c5-906b379c3d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:12.055742 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2541/5054] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:12.100845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:12.102995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:12.112936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:12.188822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616befa6-b9aa-49f7-be75-e22c076a74b9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:12.193650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f8ffc-2ab6-413c-9708-8089631eecb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:12.194504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f8ffc-2ab6-413c-9708-8089631eecb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:12.194773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f8ffc-2ab6-413c-9708-8089631eecb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:12.195231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f8ffc-2ab6-413c-9708-8089631eecb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:12.206666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f8ffc-2ab6-413c-9708-8089631eecb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:12.209259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f8ffc-2ab6-413c-9708-8089631eecb7 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:12.245524 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2514/5055] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:13.596698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba95e2-453c-4750-92c5-906b379c3d07 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:13.598886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d7ba95e2-453c-4750-92c5-906b379c3d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:13.613313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba95e2-453c-4750-92c5-906b379c3d07 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:13.621510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:13.622915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:13.623421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:13.623951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] PATH_INFO: `/v3/projects/f3a20829563d476e9cb71538d60a30ba` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:13.625519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a20829563d476e9cb71538d60a30ba)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:13.627772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:13.695711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:13.713145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a20829563d476e9cb71538d60a30ba', 'request_id': 'req-0688ebe8-7ea7-4a51-8737-d524eb45117d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:13.723105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a20829563d476e9cb71538d60a30ba', 'request_id': 'req-0688ebe8-7ea7-4a51-8737-d524eb45117d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:13.734396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a20829563d476e9cb71538d60a30ba', 'request_id': 'req-0688ebe8-7ea7-4a51-8737-d524eb45117d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:13.751687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] The token cache is being invalidate because project f3a20829563d476e9cb71538d60a30ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:41:13.752400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:13.753544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0688ebe8-7ea7-4a51-8737-d524eb45117d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:13.755610 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2542/5056] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:41:13 2022] DELETE /identity/v3/projects/f3a20829563d476e9cb71538d60a30ba => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:13.759948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f8ffc-2ab6-413c-9708-8089631eecb7 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:13.770187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f8ffc-2ab6-413c-9708-8089631eecb7 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:13.881245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:13.882308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:13.883449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:13.886250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] PATH_INFO: `/v3/users/25f65097c3864a4c9054ba1420837361` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:13.888044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f65097c3864a4c9054ba1420837361)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:13.891797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:13.972414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f65097c3864a4c9054ba1420837361'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:13.995827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f65097c3864a4c9054ba1420837361'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:14.023981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f65097c3864a4c9054ba1420837361'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:14.040102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f65097c3864a4c9054ba1420837361'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:14.041101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f65097c3864a4c9054ba1420837361'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:14.050656 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2515/5057] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:41:13 2022] DELETE /identity/v3/users/25f65097c3864a4c9054ba1420837361 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:14.355643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c60270-17e4-49f9-8f94-6a9f4526aead None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:14.355923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c60270-17e4-49f9-8f94-6a9f4526aead None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:14.356405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c60270-17e4-49f9-8f94-6a9f4526aead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:14.420310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-12c60270-17e4-49f9-8f94-6a9f4526aead None None] MFA Rules not processed for user `3e02dab107224c678f83f485d7f9f17a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:14.421592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-12c60270-17e4-49f9-8f94-6a9f4526aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:14.506328 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2543/5058] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:14.520694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:14.522714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:14.625129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:14.754033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bbdd8-a210-4a83-9981-d6cf631c42d2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:14.762154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84885f-bf7c-4a2a-862b-10666be4c073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:14.764097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84885f-bf7c-4a2a-862b-10666be4c073 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:14.764535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84885f-bf7c-4a2a-862b-10666be4c073 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:14.764952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84885f-bf7c-4a2a-862b-10666be4c073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:14.776104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84885f-bf7c-4a2a-862b-10666be4c073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:14.778926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84885f-bf7c-4a2a-862b-10666be4c073 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:14.808632 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2516/5059] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:15.010928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84885f-bf7c-4a2a-862b-10666be4c073 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:15.011936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c60270-17e4-49f9-8f94-6a9f4526aead None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:15.013629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-12c60270-17e4-49f9-8f94-6a9f4526aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:15.014860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5a84885f-bf7c-4a2a-862b-10666be4c073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:15.197765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c60270-17e4-49f9-8f94-6a9f4526aead None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:15.210002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:15.211217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:15.211726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:15.212251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] PATH_INFO: `/v3/projects/10f82a8ae9c541139bf1d8a670914880` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:15.214250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f82a8ae9c541139bf1d8a670914880)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:15.219127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:15.225572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84885f-bf7c-4a2a-862b-10666be4c073 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:15.238217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58368b-94e2-47e0-a0d8-b4709b5a208c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:15.238848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58368b-94e2-47e0-a0d8-b4709b5a208c service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:15.239311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58368b-94e2-47e0-a0d8-b4709b5a208c service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:15.239785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58368b-94e2-47e0-a0d8-b4709b5a208c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:15.241737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8f58368b-94e2-47e0-a0d8-b4709b5a208c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:15.275885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58368b-94e2-47e0-a0d8-b4709b5a208c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:15.279007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58368b-94e2-47e0-a0d8-b4709b5a208c service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:15.327338 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2517/5060] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:15.356087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f82a8ae9c541139bf1d8a670914880', 'request_id': 'req-ec32105d-6e57-4b30-9f38-bc72a28e8c47'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:15.365045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58368b-94e2-47e0-a0d8-b4709b5a208c service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:15.366525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8f58368b-94e2-47e0-a0d8-b4709b5a208c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:15.394166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f82a8ae9c541139bf1d8a670914880', 'request_id': 'req-ec32105d-6e57-4b30-9f38-bc72a28e8c47'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:15.396624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:15.401769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58368b-94e2-47e0-a0d8-b4709b5a208c service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:15.415661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f82a8ae9c541139bf1d8a670914880', 'request_id': 'req-ec32105d-6e57-4b30-9f38-bc72a28e8c47'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:15.453423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] The token cache is being invalidate because project 10f82a8ae9c541139bf1d8a670914880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:41:15.453722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:15.455288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec32105d-6e57-4b30-9f38-bc72a28e8c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:15.466269 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2544/5061] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:41:15 2022] DELETE /identity/v3/projects/10f82a8ae9c541139bf1d8a670914880 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:15.467608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5c3b-bbda-4010-a591-decbfba20c82 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:15.468023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5c3b-bbda-4010-a591-decbfba20c82 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:15.468172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde5c3b-bbda-4010-a591-decbfba20c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:15.540165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ecde5c3b-bbda-4010-a591-decbfba20c82 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:15.542085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ecde5c3b-bbda-4010-a591-decbfba20c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:15.606126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:15.606797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:15.607060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:15.607334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] PATH_INFO: `/v3/users/c08bbaf86cc944dbaa12cc20224b0f50` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:15.614588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08bbaf86cc944dbaa12cc20224b0f50)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:15.616667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:15.758207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:15.761741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08bbaf86cc944dbaa12cc20224b0f50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:15.778516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08bbaf86cc944dbaa12cc20224b0f50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:15.790756 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2545/5062] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:15.800942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536dac0-0a67-438c-84ff-5d4fc3cf4bb6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:15.801684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536dac0-0a67-438c-84ff-5d4fc3cf4bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:15.802153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536dac0-0a67-438c-84ff-5d4fc3cf4bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:15.814948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08bbaf86cc944dbaa12cc20224b0f50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:15.835860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08bbaf86cc944dbaa12cc20224b0f50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:15.836850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08bbaf86cc944dbaa12cc20224b0f50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:15.845786 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2518/5063] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:41:15 2022] DELETE /identity/v3/users/c08bbaf86cc944dbaa12cc20224b0f50 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:15.855041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f536dac0-0a67-438c-84ff-5d4fc3cf4bb6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:15.857081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f536dac0-0a67-438c-84ff-5d4fc3cf4bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:16.087708 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2546/5064] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:16.092097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:16.110966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21eac1-7145-452c-87b6-ac14fa1367b8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:16.128178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bec0d6-3164-4c40-8c52-bd5c3bc6ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:16.128756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bec0d6-3164-4c40-8c52-bd5c3bc6ec13 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:16.129036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bec0d6-3164-4c40-8c52-bd5c3bc6ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:16.129307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bec0d6-3164-4c40-8c52-bd5c3bc6ec13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:16.129998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bec0d6-3164-4c40-8c52-bd5c3bc6ec13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:41:16.130299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bec0d6-3164-4c40-8c52-bd5c3bc6ec13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:16.131917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bec0d6-3164-4c40-8c52-bd5c3bc6ec13 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:16.175137 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2519/5065] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:41:16.180169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536dac0-0a67-438c-84ff-5d4fc3cf4bb6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:16.193010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536dac0-0a67-438c-84ff-5d4fc3cf4bb6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:16.205971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45402307-fb4d-47f1-b94a-1135a0869b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:16.207248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45402307-fb4d-47f1-b94a-1135a0869b3a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:16.208375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45402307-fb4d-47f1-b94a-1135a0869b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:16.208851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45402307-fb4d-47f1-b94a-1135a0869b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:16.209714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45402307-fb4d-47f1-b94a-1135a0869b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:16.214190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45402307-fb4d-47f1-b94a-1135a0869b3a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:16.287807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bec0d6-3164-4c40-8c52-bd5c3bc6ec13 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:16.300828 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2547/5066] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:16 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:16.303837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bec0d6-3164-4c40-8c52-bd5c3bc6ec13 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:16.479385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d5f6a-1cfc-4f5c-a797-08b793e2c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:16.481206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5f6a-1cfc-4f5c-a797-08b793e2c4ea admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:16.481761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5f6a-1cfc-4f5c-a797-08b793e2c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:16.482512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d5f6a-1cfc-4f5c-a797-08b793e2c4ea admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:16.483953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d5f6a-1cfc-4f5c-a797-08b793e2c4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:16.487894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56d5f6a-1cfc-4f5c-a797-08b793e2c4ea admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:16.533713 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2520/5067] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:41:16 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:41:16.535022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45402307-fb4d-47f1-b94a-1135a0869b3a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:16.553342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45402307-fb4d-47f1-b94a-1135a0869b3a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:16.561173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13255796-9fef-4c06-9e91-5fb021e50dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:16.562210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255796-9fef-4c06-9e91-5fb021e50dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:16.563010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255796-9fef-4c06-9e91-5fb021e50dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:16.563764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255796-9fef-4c06-9e91-5fb021e50dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:16.564629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13255796-9fef-4c06-9e91-5fb021e50dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:16.566735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13255796-9fef-4c06-9e91-5fb021e50dc7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:16.598199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d5f6a-1cfc-4f5c-a797-08b793e2c4ea admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:16.623882 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2548/5068] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:16.632567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56d5f6a-1cfc-4f5c-a797-08b793e2c4ea admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:16.642210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ee68a-00d6-435f-a54b-7d19baef8631 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:16.642496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ee68a-00d6-435f-a54b-7d19baef8631 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:16.642775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ee68a-00d6-435f-a54b-7d19baef8631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:16.661565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02d96a-63d7-42bc-a4da-6e4c52eb643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:16.662246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02d96a-63d7-42bc-a4da-6e4c52eb643a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:16.662529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02d96a-63d7-42bc-a4da-6e4c52eb643a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:16.662805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02d96a-63d7-42bc-a4da-6e4c52eb643a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:16.663470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02d96a-63d7-42bc-a4da-6e4c52eb643a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:16.666802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a02d96a-63d7-42bc-a4da-6e4c52eb643a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:16.676307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-dd5ee68a-00d6-435f-a54b-7d19baef8631 None None] MFA Rules not processed for user `3e02dab107224c678f83f485d7f9f17a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:16.685077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dd5ee68a-00d6-435f-a54b-7d19baef8631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:16.704545 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2521/5069] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:16.705595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02d96a-63d7-42bc-a4da-6e4c52eb643a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:16.733855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a02d96a-63d7-42bc-a4da-6e4c52eb643a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:16.749903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e32d4-09ff-4e27-a10b-5413abc5f38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:16.750709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e32d4-09ff-4e27-a10b-5413abc5f38c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:16.750994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e32d4-09ff-4e27-a10b-5413abc5f38c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:16.751265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e32d4-09ff-4e27-a10b-5413abc5f38c admin admin] PATH_INFO: `/v3/projects/7c5da3fce3314b298fcf1aded65630d1/users/f2a0d74b7b1a4658b6d3cc68c9e6da11/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:16.777142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:16.795256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e32d4-09ff-4e27-a10b-5413abc5f38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5da3fce3314b298fcf1aded65630d1, user_id=f2a0d74b7b1a4658b6d3cc68c9e6da11, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:16.797999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169e32d4-09ff-4e27-a10b-5413abc5f38c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:16.801603 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2549/5070] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:41:16.848376 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2522/5071] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:16 2022] PUT /identity/v3/projects/7c5da3fce3314b298fcf1aded65630d1/users/f2a0d74b7b1a4658b6d3cc68c9e6da11/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:16.849082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4d1e-2e65-4b5e-b244-003d18b74371 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:16.849375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4d1e-2e65-4b5e-b244-003d18b74371 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:16.849644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4d1e-2e65-4b5e-b244-003d18b74371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:16.941698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e01e4d1e-2e65-4b5e-b244-003d18b74371 None None] MFA Rules not processed for user `f2a0d74b7b1a4658b6d3cc68c9e6da11`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:16.943435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e01e4d1e-2e65-4b5e-b244-003d18b74371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:17.028403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e32d4-09ff-4e27-a10b-5413abc5f38c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:17.030725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-169e32d4-09ff-4e27-a10b-5413abc5f38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:17.038262 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2550/5072] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:41:17.052644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e4d1e-2e65-4b5e-b244-003d18b74371 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:17.057386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e01e4d1e-2e65-4b5e-b244-003d18b74371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:17.191433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e4d1e-2e65-4b5e-b244-003d18b74371 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:17.196520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb382da-6626-4876-a693-c8d4712cff48 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:17.197530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb382da-6626-4876-a693-c8d4712cff48 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:17.198221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb382da-6626-4876-a693-c8d4712cff48 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:17.198683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb382da-6626-4876-a693-c8d4712cff48 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:17.212176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb382da-6626-4876-a693-c8d4712cff48 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:17.213860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169e32d4-09ff-4e27-a10b-5413abc5f38c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:17.214268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb382da-6626-4876-a693-c8d4712cff48 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:17.221101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:17.221932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:17.222341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:17.222713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] PATH_INFO: `/v3/projects/f47e2092802f4e8b8b96d7adab2d4c33` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:17.224344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f47e2092802f4e8b8b96d7adab2d4c33)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:17.228408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:17.238371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:17.286091 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2551/5073] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:17.381527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f47e2092802f4e8b8b96d7adab2d4c33', 'request_id': 'req-df658c11-eb8f-4964-9271-6242ecf970d7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:17.392370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f47e2092802f4e8b8b96d7adab2d4c33', 'request_id': 'req-df658c11-eb8f-4964-9271-6242ecf970d7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:17.402047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f47e2092802f4e8b8b96d7adab2d4c33', 'request_id': 'req-df658c11-eb8f-4964-9271-6242ecf970d7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:17.415680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] The token cache is being invalidate because project f47e2092802f4e8b8b96d7adab2d4c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:41:17.415956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:17.416466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df658c11-eb8f-4964-9271-6242ecf970d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:17.418918 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2523/5074] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:41:17 2022] DELETE /identity/v3/projects/f47e2092802f4e8b8b96d7adab2d4c33 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:41:17.423555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fb710-669a-489c-a3a3-2c773f6ad9b4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:17.423838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fb710-669a-489c-a3a3-2c773f6ad9b4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:17.424109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fb710-669a-489c-a3a3-2c773f6ad9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:17.482707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f91fb710-669a-489c-a3a3-2c773f6ad9b4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:17.484075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f91fb710-669a-489c-a3a3-2c773f6ad9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:17.718671 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2552/5075] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:41:17.728751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b251-3ae1-40ec-82d7-1e38b3c7b6d1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:17.729060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b251-3ae1-40ec-82d7-1e38b3c7b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:17.729703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b251-3ae1-40ec-82d7-1e38b3c7b6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:17.754093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a9e9b251-3ae1-40ec-82d7-1e38b3c7b6d1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:17.755781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a9e9b251-3ae1-40ec-82d7-1e38b3c7b6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:17.765625 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2524/5076] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:17.769950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fb710-669a-489c-a3a3-2c773f6ad9b4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:17.783280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fb710-669a-489c-a3a3-2c773f6ad9b4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:17.800058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f3213-545b-4fed-aaf7-69286d7da00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:17.801744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f3213-545b-4fed-aaf7-69286d7da00d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:17.807013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f3213-545b-4fed-aaf7-69286d7da00d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:17.807584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f3213-545b-4fed-aaf7-69286d7da00d admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:17.808554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f3213-545b-4fed-aaf7-69286d7da00d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:41:17.809098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f3213-545b-4fed-aaf7-69286d7da00d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:17.812334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f3213-545b-4fed-aaf7-69286d7da00d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:17.832585 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2553/5077] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:41:17.836736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9b251-3ae1-40ec-82d7-1e38b3c7b6d1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:17.854603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9b251-3ae1-40ec-82d7-1e38b3c7b6d1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:17.869540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e157b5-218f-4713-9945-a288168418c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:17.870510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e157b5-218f-4713-9945-a288168418c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:17.870858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e157b5-218f-4713-9945-a288168418c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:17.871304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e157b5-218f-4713-9945-a288168418c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:17.872169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e157b5-218f-4713-9945-a288168418c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:17.875492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e157b5-218f-4713-9945-a288168418c2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:17.939547 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2525/5078] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:17 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:17.943358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f3213-545b-4fed-aaf7-69286d7da00d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:17.957922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f3213-545b-4fed-aaf7-69286d7da00d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:17.979718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:18.134838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd141371-7143-4dd3-b3d8-57355797d854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:18.135667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd141371-7143-4dd3-b3d8-57355797d854 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:18.137188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd141371-7143-4dd3-b3d8-57355797d854 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:18.138153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd141371-7143-4dd3-b3d8-57355797d854 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:18.139973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd141371-7143-4dd3-b3d8-57355797d854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:18.145954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd141371-7143-4dd3-b3d8-57355797d854 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:18.225708 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2554/5079] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:41:17 2022] POST /identity/v3/users => generated 303 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:41:18.228234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e157b5-218f-4713-9945-a288168418c2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:18.242799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e157b5-218f-4713-9945-a288168418c2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:18.264945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb55e4-6800-44e3-bed2-b7ad400cd983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:18.265853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb55e4-6800-44e3-bed2-b7ad400cd983 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:18.268705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb55e4-6800-44e3-bed2-b7ad400cd983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:18.269430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb55e4-6800-44e3-bed2-b7ad400cd983 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:18.270667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb55e4-6800-44e3-bed2-b7ad400cd983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:18.285466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb55e4-6800-44e3-bed2-b7ad400cd983 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:18.345491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd141371-7143-4dd3-b3d8-57355797d854 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:18.352323 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2526/5080] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:18.362998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd141371-7143-4dd3-b3d8-57355797d854 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:18.378137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c001b-38c8-4da1-99dc-df89f4d156ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:18.378914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c001b-38c8-4da1-99dc-df89f4d156ff admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:18.380213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c001b-38c8-4da1-99dc-df89f4d156ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:18.381608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c001b-38c8-4da1-99dc-df89f4d156ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:18.383027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c001b-38c8-4da1-99dc-df89f4d156ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:18.384677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c001b-38c8-4da1-99dc-df89f4d156ff admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:18.433837 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2555/5081] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:18.435951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb55e4-6800-44e3-bed2-b7ad400cd983 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:18.455253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb55e4-6800-44e3-bed2-b7ad400cd983 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:18.473745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9d960-3230-45ee-a1c7-954734be4db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:18.475700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9d960-3230-45ee-a1c7-954734be4db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:18.476048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9d960-3230-45ee-a1c7-954734be4db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:18.476416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9d960-3230-45ee-a1c7-954734be4db4 admin admin] PATH_INFO: `/v3/projects/8319481fb6f74c74b6a847e497d783ce/users/fb799d2ce6774b86bdcf0623d9bd4201/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:18.517997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9d960-3230-45ee-a1c7-954734be4db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8319481fb6f74c74b6a847e497d783ce, user_id=fb799d2ce6774b86bdcf0623d9bd4201, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:18.522698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9d960-3230-45ee-a1c7-954734be4db4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:18.559329 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2527/5082] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:18 2022] PUT /identity/v3/projects/8319481fb6f74c74b6a847e497d783ce/users/fb799d2ce6774b86bdcf0623d9bd4201/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:18.564653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a226a-7777-4585-92cd-68b5fe23cee1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:18.564978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a226a-7777-4585-92cd-68b5fe23cee1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:18.565192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a226a-7777-4585-92cd-68b5fe23cee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:18.627631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-116a226a-7777-4585-92cd-68b5fe23cee1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:18.630185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-116a226a-7777-4585-92cd-68b5fe23cee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:18.677571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9d960-3230-45ee-a1c7-954734be4db4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:18.682923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-67a9d960-3230-45ee-a1c7-954734be4db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:18.751284 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2556/5083] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:18.768049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a226a-7777-4585-92cd-68b5fe23cee1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:18.770023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-116a226a-7777-4585-92cd-68b5fe23cee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:18.935664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9d960-3230-45ee-a1c7-954734be4db4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:18.952117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:18.955485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:18.957302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:18.957746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] PATH_INFO: `/v3/users/f2a0d74b7b1a4658b6d3cc68c9e6da11` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:18.960221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a0d74b7b1a4658b6d3cc68c9e6da11)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:18.965707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:19.021378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a226a-7777-4585-92cd-68b5fe23cee1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:19.043298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa465f5-bb1f-444c-b052-e51dd42ecf81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:19.043962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa465f5-bb1f-444c-b052-e51dd42ecf81 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:19.044249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa465f5-bb1f-444c-b052-e51dd42ecf81 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:19.044517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa465f5-bb1f-444c-b052-e51dd42ecf81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:19.060613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:19.092978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa465f5-bb1f-444c-b052-e51dd42ecf81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:19.096837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a0d74b7b1a4658b6d3cc68c9e6da11'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:19.099121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa465f5-bb1f-444c-b052-e51dd42ecf81 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:19.131069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a0d74b7b1a4658b6d3cc68c9e6da11'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:19.141684 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2557/5084] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:19.153020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a0d74b7b1a4658b6d3cc68c9e6da11'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:19.164406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a0d74b7b1a4658b6d3cc68c9e6da11'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:19.165341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a0d74b7b1a4658b6d3cc68c9e6da11'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:19.175915 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2528/5085] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:41:18 2022] DELETE /identity/v3/users/f2a0d74b7b1a4658b6d3cc68c9e6da11 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:41:19.181348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0b0ce-f3c5-4d04-b206-5cf193e8fc8f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:19.181698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0b0ce-f3c5-4d04-b206-5cf193e8fc8f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:19.182685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0b0ce-f3c5-4d04-b206-5cf193e8fc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:19.209218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-afa0b0ce-f3c5-4d04-b206-5cf193e8fc8f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:19.210630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-afa0b0ce-f3c5-4d04-b206-5cf193e8fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:19.272661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:19.340067 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2558/5086] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:19.384481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:19.386252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:19.544506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1400df-d4a6-4437-b2d9-be6baa413052 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:19.550591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704489e9-05a8-44d2-bd93-8fdae3e75565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:19.551772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704489e9-05a8-44d2-bd93-8fdae3e75565 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:19.552053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704489e9-05a8-44d2-bd93-8fdae3e75565 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:19.552316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704489e9-05a8-44d2-bd93-8fdae3e75565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:19.563270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704489e9-05a8-44d2-bd93-8fdae3e75565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:19.565305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704489e9-05a8-44d2-bd93-8fdae3e75565 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:19.584867 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2529/5087] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:20.666033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0b0ce-f3c5-4d04-b206-5cf193e8fc8f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:20.670235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-afa0b0ce-f3c5-4d04-b206-5cf193e8fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:20.796661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0b0ce-f3c5-4d04-b206-5cf193e8fc8f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:20.803612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207d00-831c-4a3a-bb2e-15fcee66f5b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:20.804620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207d00-831c-4a3a-bb2e-15fcee66f5b1 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:20.805137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207d00-831c-4a3a-bb2e-15fcee66f5b1 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:20.805427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207d00-831c-4a3a-bb2e-15fcee66f5b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:20.807401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f0207d00-831c-4a3a-bb2e-15fcee66f5b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:20.825914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207d00-831c-4a3a-bb2e-15fcee66f5b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:20.828622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207d00-831c-4a3a-bb2e-15fcee66f5b1 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:20.845208 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2559/5088] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:21.033153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704489e9-05a8-44d2-bd93-8fdae3e75565 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:21.034628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-704489e9-05a8-44d2-bd93-8fdae3e75565 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:21.057591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704489e9-05a8-44d2-bd93-8fdae3e75565 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:21.078162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:21.079256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:21.079531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:21.079886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] PATH_INFO: `/v3/projects/7c5da3fce3314b298fcf1aded65630d1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:21.084118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5da3fce3314b298fcf1aded65630d1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:21.090999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:21.211548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5da3fce3314b298fcf1aded65630d1', 'request_id': 'req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:21.230955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5da3fce3314b298fcf1aded65630d1', 'request_id': 'req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:21.240705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5da3fce3314b298fcf1aded65630d1', 'request_id': 'req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:21.265420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] The token cache is being invalidate because project 7c5da3fce3314b298fcf1aded65630d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:41:21.265779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:21.270944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb4a2afa-ff59-4fbd-8a37-898f2abe727e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:21.277537 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2530/5089] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:41:21 2022] DELETE /identity/v3/projects/7c5da3fce3314b298fcf1aded65630d1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:21.279214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42622c54-a9de-4986-af42-17aa17632e52 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:21.279555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42622c54-a9de-4986-af42-17aa17632e52 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:21.280093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42622c54-a9de-4986-af42-17aa17632e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:21.333776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-42622c54-a9de-4986-af42-17aa17632e52 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:21.337887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-42622c54-a9de-4986-af42-17aa17632e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:21.474370 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2560/5090] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:41:21.484320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b790-97d4-4975-9bc9-68874176bf9f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:21.484935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b790-97d4-4975-9bc9-68874176bf9f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:21.484935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b790-97d4-4975-9bc9-68874176bf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:21.537480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8003b790-97d4-4975-9bc9-68874176bf9f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:21.542811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8003b790-97d4-4975-9bc9-68874176bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:21.564809 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2531/5091] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:21.566919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42622c54-a9de-4986-af42-17aa17632e52 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:21.593371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42622c54-a9de-4986-af42-17aa17632e52 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:21.608975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a3ad7-78f8-49f3-a644-0780e7a85bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:21.609633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a3ad7-78f8-49f3-a644-0780e7a85bed admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:21.609938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a3ad7-78f8-49f3-a644-0780e7a85bed admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:21.610215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a3ad7-78f8-49f3-a644-0780e7a85bed admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:21.610900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a3ad7-78f8-49f3-a644-0780e7a85bed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:41:21.611202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a3ad7-78f8-49f3-a644-0780e7a85bed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:21.616922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a3ad7-78f8-49f3-a644-0780e7a85bed admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:21.649520 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2561/5092] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:41:21.654201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003b790-97d4-4975-9bc9-68874176bf9f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:21.665789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003b790-97d4-4975-9bc9-68874176bf9f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:21.677319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef43965-fa2a-43e8-8f74-ed87c5cd2923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:21.678295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef43965-fa2a-43e8-8f74-ed87c5cd2923 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:21.679445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef43965-fa2a-43e8-8f74-ed87c5cd2923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:21.679801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef43965-fa2a-43e8-8f74-ed87c5cd2923 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:21.680483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef43965-fa2a-43e8-8f74-ed87c5cd2923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:21.683266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef43965-fa2a-43e8-8f74-ed87c5cd2923 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:21.741256 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2532/5093] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:21 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:41:21.742966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a3ad7-78f8-49f3-a644-0780e7a85bed admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:21.764770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a3ad7-78f8-49f3-a644-0780e7a85bed admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:21.888637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:21.904426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f39b5-d9fb-4ba7-bcea-f31282c7c91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:21.905101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f39b5-d9fb-4ba7-bcea-f31282c7c91b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:21.905382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f39b5-d9fb-4ba7-bcea-f31282c7c91b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:21.905655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f39b5-d9fb-4ba7-bcea-f31282c7c91b admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:21.910137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f39b5-d9fb-4ba7-bcea-f31282c7c91b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:21.912223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f39b5-d9fb-4ba7-bcea-f31282c7c91b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:21.962064 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2562/5094] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:41:21 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:41:21.963761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef43965-fa2a-43e8-8f74-ed87c5cd2923 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:21.972777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:21.977720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef43965-fa2a-43e8-8f74-ed87c5cd2923 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:21.991618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcba54d-a0bc-4958-9de1-2f448039929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:21.993591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcba54d-a0bc-4958-9de1-2f448039929e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:21.993957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcba54d-a0bc-4958-9de1-2f448039929e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:21.994189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcba54d-a0bc-4958-9de1-2f448039929e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:21.994955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcba54d-a0bc-4958-9de1-2f448039929e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:21.999130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcba54d-a0bc-4958-9de1-2f448039929e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:22.025507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f39b5-d9fb-4ba7-bcea-f31282c7c91b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:22.040334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f39b5-d9fb-4ba7-bcea-f31282c7c91b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:22.040963 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2533/5095] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:22.069157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf41ea3-970c-4f83-aa70-f567a6e27ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:22.070570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf41ea3-970c-4f83-aa70-f567a6e27ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:22.071626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf41ea3-970c-4f83-aa70-f567a6e27ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:22.073257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf41ea3-970c-4f83-aa70-f567a6e27ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:22.074315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf41ea3-970c-4f83-aa70-f567a6e27ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:22.077478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf41ea3-970c-4f83-aa70-f567a6e27ca7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:22.108243 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2563/5096] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:22.111907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcba54d-a0bc-4958-9de1-2f448039929e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:22.130984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcba54d-a0bc-4958-9de1-2f448039929e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:22.149262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a711f-a0a1-4623-8928-eab5d62f0794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:22.150189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a711f-a0a1-4623-8928-eab5d62f0794 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:22.150853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a711f-a0a1-4623-8928-eab5d62f0794 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:22.151220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a711f-a0a1-4623-8928-eab5d62f0794 admin admin] PATH_INFO: `/v3/projects/d5d7241ca00245a88bbae168c9245b3b/users/199ba857622e47cb82ba1ea0c203e98f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:22.219609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a711f-a0a1-4623-8928-eab5d62f0794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d7241ca00245a88bbae168c9245b3b, user_id=199ba857622e47cb82ba1ea0c203e98f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:22.223077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a711f-a0a1-4623-8928-eab5d62f0794 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:22.244780 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2534/5097] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:22 2022] PUT /identity/v3/projects/d5d7241ca00245a88bbae168c9245b3b/users/199ba857622e47cb82ba1ea0c203e98f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:22.255941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5ed6b-4e2e-45cb-9e9d-882c1f4f0cc5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:22.256502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5ed6b-4e2e-45cb-9e9d-882c1f4f0cc5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:22.256920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5ed6b-4e2e-45cb-9e9d-882c1f4f0cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:22.328288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cfa5ed6b-4e2e-45cb-9e9d-882c1f4f0cc5 None None] MFA Rules not processed for user `199ba857622e47cb82ba1ea0c203e98f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:22.329543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cfa5ed6b-4e2e-45cb-9e9d-882c1f4f0cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:22.538686 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2564/5098] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:22.540175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a711f-a0a1-4623-8928-eab5d62f0794 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:22.754762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a711f-a0a1-4623-8928-eab5d62f0794 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:22.767139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e985f9-683a-4021-bbb0-41b2a88607bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:22.778487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e985f9-683a-4021-bbb0-41b2a88607bb admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:22.782266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e985f9-683a-4021-bbb0-41b2a88607bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:22.786426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e985f9-683a-4021-bbb0-41b2a88607bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:22.799610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e985f9-683a-4021-bbb0-41b2a88607bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:22.802884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e985f9-683a-4021-bbb0-41b2a88607bb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:22.902730 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2535/5099] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:22 2022] POST /identity/v3/projects => generated 373 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:22.904328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5ed6b-4e2e-45cb-9e9d-882c1f4f0cc5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:22.922509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5ed6b-4e2e-45cb-9e9d-882c1f4f0cc5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:23.028314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba74d8-88c4-441e-b510-265ef77664de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:23.030255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba74d8-88c4-441e-b510-265ef77664de admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:23.030543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba74d8-88c4-441e-b510-265ef77664de admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:23.030869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba74d8-88c4-441e-b510-265ef77664de admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:23.031550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba74d8-88c4-441e-b510-265ef77664de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:23.033677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba74d8-88c4-441e-b510-265ef77664de admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:23.076192 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2565/5100] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:41:22 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:41:23.080521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e985f9-683a-4021-bbb0-41b2a88607bb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:23.098974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e985f9-683a-4021-bbb0-41b2a88607bb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:23.110249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e7104-fe71-4cf8-999b-f5d778efc268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:23.111509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7104-fe71-4cf8-999b-f5d778efc268 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:23.111890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7104-fe71-4cf8-999b-f5d778efc268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:23.112254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7104-fe71-4cf8-999b-f5d778efc268 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:23.113164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e7104-fe71-4cf8-999b-f5d778efc268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:23.115150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e7104-fe71-4cf8-999b-f5d778efc268 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:23.148377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba74d8-88c4-441e-b510-265ef77664de admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:23.150975 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2536/5101] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:23.181781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba74d8-88c4-441e-b510-265ef77664de admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:23.187777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9653f9e-8963-4428-a2d5-a6cfa77bca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:23.188958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9653f9e-8963-4428-a2d5-a6cfa77bca24 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:23.189393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9653f9e-8963-4428-a2d5-a6cfa77bca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:23.190050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9653f9e-8963-4428-a2d5-a6cfa77bca24 admin admin] PATH_INFO: `/v3/projects/b996e267ef6f4929b29cba32bb8c1f56/users/60f7e925849c461ba3eaa9c0dd7ecbac/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:23.216988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9653f9e-8963-4428-a2d5-a6cfa77bca24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b996e267ef6f4929b29cba32bb8c1f56, user_id=60f7e925849c461ba3eaa9c0dd7ecbac, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:23.221505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9653f9e-8963-4428-a2d5-a6cfa77bca24 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:23.254533 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2566/5102] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:23 2022] PUT /identity/v3/projects/b996e267ef6f4929b29cba32bb8c1f56/users/60f7e925849c461ba3eaa9c0dd7ecbac/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:23.256540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e7104-fe71-4cf8-999b-f5d778efc268 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:23.272343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e7104-fe71-4cf8-999b-f5d778efc268 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:23.395545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10412d6f-8ce0-4cd8-a101-e4b44623d311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:23.396558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10412d6f-8ce0-4cd8-a101-e4b44623d311 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:23.397188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10412d6f-8ce0-4cd8-a101-e4b44623d311 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:23.397668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10412d6f-8ce0-4cd8-a101-e4b44623d311 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:23.398573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10412d6f-8ce0-4cd8-a101-e4b44623d311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:23.401652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10412d6f-8ce0-4cd8-a101-e4b44623d311 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:23.460669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9653f9e-8963-4428-a2d5-a6cfa77bca24 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:23.476727 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2537/5103] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:23.505418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9653f9e-8963-4428-a2d5-a6cfa77bca24 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:23.528160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43766dcc-29fe-4321-b797-6a8afaccd67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:23.528970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766dcc-29fe-4321-b797-6a8afaccd67d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:23.529953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766dcc-29fe-4321-b797-6a8afaccd67d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:23.529953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43766dcc-29fe-4321-b797-6a8afaccd67d admin admin] PATH_INFO: `/v3/projects/b996e267ef6f4929b29cba32bb8c1f56/users/60f7e925849c461ba3eaa9c0dd7ecbac/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:23.534901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43766dcc-29fe-4321-b797-6a8afaccd67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b996e267ef6f4929b29cba32bb8c1f56, user_id=60f7e925849c461ba3eaa9c0dd7ecbac, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:23.537616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43766dcc-29fe-4321-b797-6a8afaccd67d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:23.567717 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2567/5104] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:23 2022] PUT /identity/v3/projects/b996e267ef6f4929b29cba32bb8c1f56/users/60f7e925849c461ba3eaa9c0dd7ecbac/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:23.585175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5c930-3309-47b2-b3aa-e81d68fc7230 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:23.585659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5c930-3309-47b2-b3aa-e81d68fc7230 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:23.586194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5c930-3309-47b2-b3aa-e81d68fc7230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:23.627942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b5e5c930-3309-47b2-b3aa-e81d68fc7230 None None] MFA Rules not processed for user `60f7e925849c461ba3eaa9c0dd7ecbac`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:23.629487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b5e5c930-3309-47b2-b3aa-e81d68fc7230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:23.715881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:23.820039 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2538/5105] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:23.821859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43766dcc-29fe-4321-b797-6a8afaccd67d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:23.837014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43766dcc-29fe-4321-b797-6a8afaccd67d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:23.843174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e62767-637b-4703-bf76-b4b84e6488b2 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f7e925849c461ba3eaa9c0dd7ecbac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b996e267ef6f4929b29cba32bb8c1f56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:23.843804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e62767-637b-4703-bf76-b4b84e6488b2 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:23.844877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e62767-637b-4703-bf76-b4b84e6488b2 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:23.844877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e62767-637b-4703-bf76-b4b84e6488b2 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:23.845251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e62767-637b-4703-bf76-b4b84e6488b2 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:41:23.845344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e62767-637b-4703-bf76-b4b84e6488b2 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:23.865017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e62767-637b-4703-bf76-b4b84e6488b2 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:23.898276 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2568/5106] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:41:23.903659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5c930-3309-47b2-b3aa-e81d68fc7230 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:23.918229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5c930-3309-47b2-b3aa-e81d68fc7230 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:23.924801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c61497-a5e4-4f11-bb6a-d1bbaeb3c74d tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f7e925849c461ba3eaa9c0dd7ecbac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b996e267ef6f4929b29cba32bb8c1f56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:23.925722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c61497-a5e4-4f11-bb6a-d1bbaeb3c74d tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:23.925722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c61497-a5e4-4f11-bb6a-d1bbaeb3c74d tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:23.926056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c61497-a5e4-4f11-bb6a-d1bbaeb3c74d tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:23.926956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c61497-a5e4-4f11-bb6a-d1bbaeb3c74d tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:23.929857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c61497-a5e4-4f11-bb6a-d1bbaeb3c74d tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:23.969056 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2539/5107] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:23 2022] POST /identity/v3/projects => generated 348 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:41:23.970600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e62767-637b-4703-bf76-b4b84e6488b2 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:23.976133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:23.983114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e62767-637b-4703-bf76-b4b84e6488b2 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:24.138227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5d01-807d-4769-9e10-b4cc38b315e0 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f7e925849c461ba3eaa9c0dd7ecbac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b996e267ef6f4929b29cba32bb8c1f56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:24.138548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5d01-807d-4769-9e10-b4cc38b315e0 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:24.138795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5d01-807d-4769-9e10-b4cc38b315e0 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:24.139552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a5d01-807d-4769-9e10-b4cc38b315e0 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:24.144104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a5d01-807d-4769-9e10-b4cc38b315e0 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:41:24.144305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a5d01-807d-4769-9e10-b4cc38b315e0 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:24.145947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a5d01-807d-4769-9e10-b4cc38b315e0 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:24.201649 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2569/5108] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:41:24.321672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c61497-a5e4-4f11-bb6a-d1bbaeb3c74d tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:24.324058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-42c61497-a5e4-4f11-bb6a-d1bbaeb3c74d tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:24.542291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c61497-a5e4-4f11-bb6a-d1bbaeb3c74d tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:24.560874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab025a-baea-40b1-b294-fd20ae015a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:24.564913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab025a-baea-40b1-b294-fd20ae015a77 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:24.565291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab025a-baea-40b1-b294-fd20ae015a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:24.566264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab025a-baea-40b1-b294-fd20ae015a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:24.593433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab025a-baea-40b1-b294-fd20ae015a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:24.597834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab025a-baea-40b1-b294-fd20ae015a77 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:24.631080 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2540/5109] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:32.887589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5d01-807d-4769-9e10-b4cc38b315e0 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:32.914675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a5d01-807d-4769-9e10-b4cc38b315e0 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:32.928213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60f7e925849c461ba3eaa9c0dd7ecbac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b996e267ef6f4929b29cba32bb8c1f56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:32.929142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:32.929583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:32.930044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] PATH_INFO: `/v3/projects/2a69c82b7b3648bfaefdb0d9ba6ad80c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:32.932340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2a69c82b7b3648bfaefdb0d9ba6ad80c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:32.934894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:33.064979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a69c82b7b3648bfaefdb0d9ba6ad80c', 'request_id': 'req-65eec218-6129-477f-a7f5-8591e69b1f53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.109117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a69c82b7b3648bfaefdb0d9ba6ad80c', 'request_id': 'req-65eec218-6129-477f-a7f5-8591e69b1f53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.143017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a69c82b7b3648bfaefdb0d9ba6ad80c', 'request_id': 'req-65eec218-6129-477f-a7f5-8591e69b1f53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.169631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] The token cache is being invalidate because project 2a69c82b7b3648bfaefdb0d9ba6ad80c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:41:33.170653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.173574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65eec218-6129-477f-a7f5-8591e69b1f53 tempest-QuotasNegativeTest-1382744106 tempest-QuotasNegativeTest-1382744106-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.177901 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2570/5110] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:41:32 2022] DELETE /identity/v3/projects/2a69c82b7b3648bfaefdb0d9ba6ad80c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:33.183777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab025a-baea-40b1-b294-fd20ae015a77 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:33.321157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab025a-baea-40b1-b294-fd20ae015a77 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:33.389070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:33.410526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:33.411178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:33.411458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:33.412312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] PATH_INFO: `/v3/users/199ba857622e47cb82ba1ea0c203e98f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:33.413735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=199ba857622e47cb82ba1ea0c203e98f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:33.416435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:33.509626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '199ba857622e47cb82ba1ea0c203e98f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.530726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '199ba857622e47cb82ba1ea0c203e98f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.552547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '199ba857622e47cb82ba1ea0c203e98f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.565826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '199ba857622e47cb82ba1ea0c203e98f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.567137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '199ba857622e47cb82ba1ea0c203e98f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.581608 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2541/5111] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:41:33 2022] DELETE /identity/v3/users/199ba857622e47cb82ba1ea0c203e98f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:33.586198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68181524-5067-4c06-a1e7-20e71558143b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:33.586620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68181524-5067-4c06-a1e7-20e71558143b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:33.587000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68181524-5067-4c06-a1e7-20e71558143b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:33.627040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:33.627972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-68181524-5067-4c06-a1e7-20e71558143b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:33.628780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:33.630146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-68181524-5067-4c06-a1e7-20e71558143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:33.790242 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2571/5112] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:33.826496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68181524-5067-4c06-a1e7-20e71558143b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:33.828334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-68181524-5067-4c06-a1e7-20e71558143b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:33.847610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b154bd-4e3b-4b37-9f3b-0220042c1cb0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:33.862819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:33.863707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:33.864369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:33.864649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:33.864918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] PATH_INFO: `/v3/users/5c888adb6034407987b3fd1ea544ee8d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:33.867844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c888adb6034407987b3fd1ea544ee8d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:33.871168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:33.961365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c888adb6034407987b3fd1ea544ee8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.976728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c888adb6034407987b3fd1ea544ee8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:33.988568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:34.000570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c888adb6034407987b3fd1ea544ee8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:34.012950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c888adb6034407987b3fd1ea544ee8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:34.013895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f67c9721-e1d9-444d-89b4-8f6fc80dcbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c888adb6034407987b3fd1ea544ee8d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:34.014482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68181524-5067-4c06-a1e7-20e71558143b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:34.023848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a2b0d-9c2a-4e93-be60-cd9c84086b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:34.024626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a2b0d-9c2a-4e93-be60-cd9c84086b16 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:34.025022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a2b0d-9c2a-4e93-be60-cd9c84086b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:34.028659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a2b0d-9c2a-4e93-be60-cd9c84086b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:34.030716 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2542/5113] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:41:33 2022] DELETE /identity/v3/users/5c888adb6034407987b3fd1ea544ee8d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:34.032488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-222a2b0d-9c2a-4e93-be60-cd9c84086b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:34.049456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a2b0d-9c2a-4e93-be60-cd9c84086b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:34.051771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a2b0d-9c2a-4e93-be60-cd9c84086b16 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:34.070543 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2572/5114] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:41:34.481193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe8b0c-b0e2-410b-bce6-61b62b23b8b1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:34.482250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe8b0c-b0e2-410b-bce6-61b62b23b8b1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:34.482763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe8b0c-b0e2-410b-bce6-61b62b23b8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:34.536869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0cfe8b0c-b0e2-410b-bce6-61b62b23b8b1 None None] MFA Rules not processed for user `fb799d2ce6774b86bdcf0623d9bd4201`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:34.538720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0cfe8b0c-b0e2-410b-bce6-61b62b23b8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:34.692266 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2543/5115] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:34 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:34.696507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a2b0d-9c2a-4e93-be60-cd9c84086b16 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:34.701370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-222a2b0d-9c2a-4e93-be60-cd9c84086b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:34.721178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a2b0d-9c2a-4e93-be60-cd9c84086b16 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:34.843467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe8b0c-b0e2-410b-bce6-61b62b23b8b1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:34.845086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0cfe8b0c-b0e2-410b-bce6-61b62b23b8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:34.856954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39f8ff-487e-4779-8296-9658bb4ddd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:34.857714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39f8ff-487e-4779-8296-9658bb4ddd7b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:34.858583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39f8ff-487e-4779-8296-9658bb4ddd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:34.858926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39f8ff-487e-4779-8296-9658bb4ddd7b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:34.859926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39f8ff-487e-4779-8296-9658bb4ddd7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:34.865386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39f8ff-487e-4779-8296-9658bb4ddd7b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:34.928961 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2573/5116] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:34 2022] POST /identity/v3/projects => generated 403 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:34.933285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39f8ff-487e-4779-8296-9658bb4ddd7b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:34.992546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe8b0c-b0e2-410b-bce6-61b62b23b8b1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:35.058872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39f8ff-487e-4779-8296-9658bb4ddd7b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:35.078257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f2e84-410b-422f-9c48-87b1379a7339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:35.078995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f2e84-410b-422f-9c48-87b1379a7339 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.079349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f2e84-410b-422f-9c48-87b1379a7339 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.079693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f2e84-410b-422f-9c48-87b1379a7339 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.080414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f2e84-410b-422f-9c48-87b1379a7339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:35.082464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f2e84-410b-422f-9c48-87b1379a7339 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:35.113495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:35.114420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.114602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.114917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] PATH_INFO: `/v3/projects/f3c06235117940439931972f680aed24` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.122810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c06235117940439931972f680aed24)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:35.124793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:35.134775 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2574/5117] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:41:34 2022] POST /identity/v3/users => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:41:35.139044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f2e84-410b-422f-9c48-87b1379a7339 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:35.168493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f2e84-410b-422f-9c48-87b1379a7339 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:35.179065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:35.184959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b4446-213f-4c90-870d-fe92182fb3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:35.185793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b4446-213f-4c90-870d-fe92182fb3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.185793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b4446-213f-4c90-870d-fe92182fb3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.186064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b4446-213f-4c90-870d-fe92182fb3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.186752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b4446-213f-4c90-870d-fe92182fb3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:35.188591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b4446-213f-4c90-870d-fe92182fb3e5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:35.219893 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2575/5118] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:41:35.221314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b4446-213f-4c90-870d-fe92182fb3e5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:35.232335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c06235117940439931972f680aed24', 'request_id': 'req-97025477-a6e8-4a04-9036-09350d7ec348'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.234396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:35.244073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b4446-213f-4c90-870d-fe92182fb3e5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:35.266205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c06235117940439931972f680aed24', 'request_id': 'req-97025477-a6e8-4a04-9036-09350d7ec348'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.279494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c06235117940439931972f680aed24', 'request_id': 'req-97025477-a6e8-4a04-9036-09350d7ec348'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.296189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] The token cache is being invalidate because project f3c06235117940439931972f680aed24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:41:35.296720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.297477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.305396 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2544/5119] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:41:34 2022] DELETE /identity/v3/projects/f3c06235117940439931972f680aed24 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:41:35.305396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:35.308787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:35.316425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681ccad-036b-424a-be0a-9fee3838eff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:35.317174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681ccad-036b-424a-be0a-9fee3838eff3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.317448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681ccad-036b-424a-be0a-9fee3838eff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.317924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681ccad-036b-424a-be0a-9fee3838eff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.318584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681ccad-036b-424a-be0a-9fee3838eff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:35.320817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681ccad-036b-424a-be0a-9fee3838eff3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:35.335757 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2576/5120] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:35.342316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef742-b023-4226-a6be-be5cf333e53c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.343029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef742-b023-4226-a6be-be5cf333e53c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.343370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ef742-b023-4226-a6be-be5cf333e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.355285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97025477-a6e8-4a04-9036-09350d7ec348 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:35.363894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:35.365112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.366242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.366534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] PATH_INFO: `/v3/projects/d5d7241ca00245a88bbae168c9245b3b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.367584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-383ef742-b023-4226-a6be-be5cf333e53c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:35.368376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d7241ca00245a88bbae168c9245b3b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:35.369630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-383ef742-b023-4226-a6be-be5cf333e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:35.372622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:35.380247 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2577/5121] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:35.381936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef742-b023-4226-a6be-be5cf333e53c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:35.391075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-383ef742-b023-4226-a6be-be5cf333e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:35.405061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ef742-b023-4226-a6be-be5cf333e53c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:35.412297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1918d-63c6-449a-95ed-b16af025fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:35.412297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1918d-63c6-449a-95ed-b16af025fbf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.412702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1918d-63c6-449a-95ed-b16af025fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.413104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1918d-63c6-449a-95ed-b16af025fbf0 admin admin] PATH_INFO: `/v3/projects/0c6e3a3e3d4d4e2dbd6993b4d64cac77/users/91926a53d7bf4954b85bc15a5fb16852/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.436015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1918d-63c6-449a-95ed-b16af025fbf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6e3a3e3d4d4e2dbd6993b4d64cac77, user_id=91926a53d7bf4954b85bc15a5fb16852, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:35.439380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1918d-63c6-449a-95ed-b16af025fbf0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:35.448496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d7241ca00245a88bbae168c9245b3b', 'request_id': 'req-875360ab-19f2-4e24-a863-620e994e2c2c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.459634 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2578/5122] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:35 2022] PUT /identity/v3/projects/0c6e3a3e3d4d4e2dbd6993b4d64cac77/users/91926a53d7bf4954b85bc15a5fb16852/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:35.461274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b5dce-ab4d-470b-9983-3ba2d612e795 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.461651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b5dce-ab4d-470b-9983-3ba2d612e795 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.462175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b5dce-ab4d-470b-9983-3ba2d612e795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.463944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d7241ca00245a88bbae168c9245b3b', 'request_id': 'req-875360ab-19f2-4e24-a863-620e994e2c2c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.475422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d7241ca00245a88bbae168c9245b3b', 'request_id': 'req-875360ab-19f2-4e24-a863-620e994e2c2c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.491690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-446b5dce-ab4d-470b-9983-3ba2d612e795 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:35.492384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] The token cache is being invalidate because project d5d7241ca00245a88bbae168c9245b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:41:35.493194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.493683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-446b5dce-ab4d-470b-9983-3ba2d612e795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:35.494217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.498585 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2545/5123] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:41:35 2022] DELETE /identity/v3/projects/d5d7241ca00245a88bbae168c9245b3b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:35.502490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:35.507593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:35.601911 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2579/5124] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:35.608548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b5dce-ab4d-470b-9983-3ba2d612e795 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:35.632074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875360ab-19f2-4e24-a863-620e994e2c2c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:35.633171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b5dce-ab4d-470b-9983-3ba2d612e795 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:35.645143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:35.646462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.646858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.647216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] PATH_INFO: `/v3/users/60f7e925849c461ba3eaa9c0dd7ecbac` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.650190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f7e925849c461ba3eaa9c0dd7ecbac)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:35.651291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194881fc-5547-4eaa-a263-9a8746f6e5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:35.652145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194881fc-5547-4eaa-a263-9a8746f6e5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.652595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194881fc-5547-4eaa-a263-9a8746f6e5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.653028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194881fc-5547-4eaa-a263-9a8746f6e5f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.653747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:35.654075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194881fc-5547-4eaa-a263-9a8746f6e5f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:41:35.654529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194881fc-5547-4eaa-a263-9a8746f6e5f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:35.659259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194881fc-5547-4eaa-a263-9a8746f6e5f9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:35.685196 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2580/5125] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:41:35.690291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194881fc-5547-4eaa-a263-9a8746f6e5f9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:35.709022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194881fc-5547-4eaa-a263-9a8746f6e5f9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:35.724518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792243b1-8bb9-43e2-9c88-a72f9c9f1a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:35.725139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792243b1-8bb9-43e2-9c88-a72f9c9f1a28 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:35.725459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792243b1-8bb9-43e2-9c88-a72f9c9f1a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:35.725720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792243b1-8bb9-43e2-9c88-a72f9c9f1a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:35.729455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792243b1-8bb9-43e2-9c88-a72f9c9f1a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:35.738085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792243b1-8bb9-43e2-9c88-a72f9c9f1a28 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:35.741076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:35.768152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f7e925849c461ba3eaa9c0dd7ecbac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.781589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f7e925849c461ba3eaa9c0dd7ecbac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.803736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f7e925849c461ba3eaa9c0dd7ecbac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.804243 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2581/5126] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:35 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:41:35.808507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792243b1-8bb9-43e2-9c88-a72f9c9f1a28 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:35.841200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f7e925849c461ba3eaa9c0dd7ecbac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.842203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f7e925849c461ba3eaa9c0dd7ecbac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:35.858433 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2546/5127] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:41:35 2022] DELETE /identity/v3/users/60f7e925849c461ba3eaa9c0dd7ecbac => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:41:35.892426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:35.933055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792243b1-8bb9-43e2-9c88-a72f9c9f1a28 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:36.030914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c8535-0d19-46bf-bd77-6243259784a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:36.033054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8535-0d19-46bf-bd77-6243259784a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:36.033493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8535-0d19-46bf-bd77-6243259784a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:36.034081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8535-0d19-46bf-bd77-6243259784a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:36.034845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c8535-0d19-46bf-bd77-6243259784a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:36.038056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994c8535-0d19-46bf-bd77-6243259784a6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:36.079497 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2582/5128] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:41:35 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:41:36.083639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:36.085106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:36.099841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281f56c-6070-45c3-bcdf-41607e789182 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:36.106824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb4a92-e871-44fd-845f-3bba33a67a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:36.107716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb4a92-e871-44fd-845f-3bba33a67a1e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:36.108148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb4a92-e871-44fd-845f-3bba33a67a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:36.108424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb4a92-e871-44fd-845f-3bba33a67a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:36.109097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb4a92-e871-44fd-845f-3bba33a67a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:36.110977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb4a92-e871-44fd-845f-3bba33a67a1e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:36.128994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c8535-0d19-46bf-bd77-6243259784a6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:36.137413 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2547/5129] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:36.147898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c8535-0d19-46bf-bd77-6243259784a6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:36.157940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8600766-0ed6-4fcf-a9f5-12b57a3128f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:36.158941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600766-0ed6-4fcf-a9f5-12b57a3128f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:36.160038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600766-0ed6-4fcf-a9f5-12b57a3128f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:36.160134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8600766-0ed6-4fcf-a9f5-12b57a3128f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:36.162239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8600766-0ed6-4fcf-a9f5-12b57a3128f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:36.166447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8600766-0ed6-4fcf-a9f5-12b57a3128f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:36.187537 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2583/5130] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:36.192337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb4a92-e871-44fd-845f-3bba33a67a1e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:36.209590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb4a92-e871-44fd-845f-3bba33a67a1e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:36.228992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e28a6-4719-4ef4-a2b1-c9593877191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:36.234557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e28a6-4719-4ef4-a2b1-c9593877191f admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:36.234882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e28a6-4719-4ef4-a2b1-c9593877191f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:36.235168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e28a6-4719-4ef4-a2b1-c9593877191f admin admin] PATH_INFO: `/v3/projects/66ea4c47a51940ccb83189f8e11cf15f/users/e2cdbb6d555b48e1985d21bf26792d12/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:36.314710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e28a6-4719-4ef4-a2b1-c9593877191f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ea4c47a51940ccb83189f8e11cf15f, user_id=e2cdbb6d555b48e1985d21bf26792d12, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:36.320357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e28a6-4719-4ef4-a2b1-c9593877191f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:36.346567 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2548/5131] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:36 2022] PUT /identity/v3/projects/66ea4c47a51940ccb83189f8e11cf15f/users/e2cdbb6d555b48e1985d21bf26792d12/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:41:36.352995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f725c95-f669-4268-9b74-68bb5036a5c5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:36.353499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f725c95-f669-4268-9b74-68bb5036a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:36.354598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f725c95-f669-4268-9b74-68bb5036a5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:36.411226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2f725c95-f669-4268-9b74-68bb5036a5c5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:36.415781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2f725c95-f669-4268-9b74-68bb5036a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:36.481189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e28a6-4719-4ef4-a2b1-c9593877191f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:36.485832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-710e28a6-4719-4ef4-a2b1-c9593877191f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:36.643899 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2584/5132] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:36.660880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e28a6-4719-4ef4-a2b1-c9593877191f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:36.667511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f725c95-f669-4268-9b74-68bb5036a5c5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:36.670009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2f725c95-f669-4268-9b74-68bb5036a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:36.679669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:36.680327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:36.680602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:36.681671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] PATH_INFO: `/v3/projects/b996e267ef6f4929b29cba32bb8c1f56` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:36.683197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b996e267ef6f4929b29cba32bb8c1f56)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:36.685190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:36.758787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b996e267ef6f4929b29cba32bb8c1f56', 'request_id': 'req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:36.777923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b996e267ef6f4929b29cba32bb8c1f56', 'request_id': 'req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:36.790247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b996e267ef6f4929b29cba32bb8c1f56', 'request_id': 'req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:36.806552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f725c95-f669-4268-9b74-68bb5036a5c5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:36.823287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] The token cache is being invalidate because project b996e267ef6f4929b29cba32bb8c1f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:41:36.823966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:36.828935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-869bd7e1-bb65-43da-aa2a-8ba02177f6f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:36.831624 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2549/5133] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:41:36 2022] DELETE /identity/v3/projects/b996e267ef6f4929b29cba32bb8c1f56 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:36.838449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3798f3b-6767-42cf-9ffb-e55eb9c97124 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:36.839969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3798f3b-6767-42cf-9ffb-e55eb9c97124 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:36.840272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3798f3b-6767-42cf-9ffb-e55eb9c97124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:36.846777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:36.886262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d3798f3b-6767-42cf-9ffb-e55eb9c97124 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:36.888352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d3798f3b-6767-42cf-9ffb-e55eb9c97124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:36.895079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:36.944017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcea1f-0398-4fbb-a30f-daad356310a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:36.944522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcea1f-0398-4fbb-a30f-daad356310a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:36.944803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcea1f-0398-4fbb-a30f-daad356310a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:36.945077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcea1f-0398-4fbb-a30f-daad356310a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:36.948735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-45bcea1f-0398-4fbb-a30f-daad356310a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:37.045649 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2550/5134] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:37.049721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcea1f-0398-4fbb-a30f-daad356310a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:37.051738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bcea1f-0398-4fbb-a30f-daad356310a2 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:37.052930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763cb1-c41c-450e-b2bd-a0d52dda4fc2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:37.053289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763cb1-c41c-450e-b2bd-a0d52dda4fc2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:37.053646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763cb1-c41c-450e-b2bd-a0d52dda4fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:37.074285 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2585/5135] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:37.088519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-57763cb1-c41c-450e-b2bd-a0d52dda4fc2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:37.090199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-57763cb1-c41c-450e-b2bd-a0d52dda4fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:37.113141 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2551/5136] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:37.119135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcea1f-0398-4fbb-a30f-daad356310a2 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:37.152434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcea1f-0398-4fbb-a30f-daad356310a2 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:37.163286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b87b7b-4d24-435e-8fe1-f070fb45e8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:37.165779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b87b7b-4d24-435e-8fe1-f070fb45e8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:37.167230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b87b7b-4d24-435e-8fe1-f070fb45e8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:37.167859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b87b7b-4d24-435e-8fe1-f070fb45e8d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:37.170206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b87b7b-4d24-435e-8fe1-f070fb45e8d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:41:37.171262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b87b7b-4d24-435e-8fe1-f070fb45e8d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:37.175903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b87b7b-4d24-435e-8fe1-f070fb45e8d5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:37.214761 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2586/5137] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:41:37.219372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57763cb1-c41c-450e-b2bd-a0d52dda4fc2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:37.237211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57763cb1-c41c-450e-b2bd-a0d52dda4fc2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:37.255740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2ac8b-f1ba-4056-8934-288194769089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:37.256577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2ac8b-f1ba-4056-8934-288194769089 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:37.256835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2ac8b-f1ba-4056-8934-288194769089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:37.257102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2ac8b-f1ba-4056-8934-288194769089 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:37.257918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2ac8b-f1ba-4056-8934-288194769089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:37.263053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2ac8b-f1ba-4056-8934-288194769089 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:37.363239 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2552/5138] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:37 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:37.367472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b87b7b-4d24-435e-8fe1-f070fb45e8d5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:37.392964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b87b7b-4d24-435e-8fe1-f070fb45e8d5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:37.549978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108834-006b-4127-afa0-519f8fd92c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:37.551106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108834-006b-4127-afa0-519f8fd92c85 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:37.551632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108834-006b-4127-afa0-519f8fd92c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:37.552110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c108834-006b-4127-afa0-519f8fd92c85 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:37.553047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c108834-006b-4127-afa0-519f8fd92c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:37.557139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c108834-006b-4127-afa0-519f8fd92c85 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:37.606875 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2587/5139] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:41:37 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:37.608512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2ac8b-f1ba-4056-8934-288194769089 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:37.624694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2ac8b-f1ba-4056-8934-288194769089 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:37.631797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6032-6529-4689-ac0f-25711c8f2ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:37.635447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6032-6529-4689-ac0f-25711c8f2ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:37.638969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6032-6529-4689-ac0f-25711c8f2ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:37.639311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f6032-6529-4689-ac0f-25711c8f2ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:37.640189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f6032-6529-4689-ac0f-25711c8f2ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:37.642748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f6032-6529-4689-ac0f-25711c8f2ed5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:37.663145 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2553/5140] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:37.667618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108834-006b-4127-afa0-519f8fd92c85 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:37.685004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c108834-006b-4127-afa0-519f8fd92c85 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:37.698982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730dc1c-2e0e-46ca-9c42-9801f71d8494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:37.699691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730dc1c-2e0e-46ca-9c42-9801f71d8494 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:37.700023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730dc1c-2e0e-46ca-9c42-9801f71d8494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:37.700298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730dc1c-2e0e-46ca-9c42-9801f71d8494 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:37.702225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730dc1c-2e0e-46ca-9c42-9801f71d8494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:37.706569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730dc1c-2e0e-46ca-9c42-9801f71d8494 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:37.739151 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2588/5141] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:37.740918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6032-6529-4689-ac0f-25711c8f2ed5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:37.755923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f6032-6529-4689-ac0f-25711c8f2ed5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:37.761838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efdd27-e2fe-4550-a068-45ff4944ca1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:37.762635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efdd27-e2fe-4550-a068-45ff4944ca1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:37.763031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efdd27-e2fe-4550-a068-45ff4944ca1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:37.763380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efdd27-e2fe-4550-a068-45ff4944ca1e admin admin] PATH_INFO: `/v3/projects/2018dce9a3d24b4c82f27f65fad4c7d4/users/2feff4789a924e5cb5499027b1f4d579/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:37.785981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efdd27-e2fe-4550-a068-45ff4944ca1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2018dce9a3d24b4c82f27f65fad4c7d4, user_id=2feff4789a924e5cb5499027b1f4d579, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:37.789424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efdd27-e2fe-4550-a068-45ff4944ca1e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:37.824960 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2554/5142] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:37 2022] PUT /identity/v3/projects/2018dce9a3d24b4c82f27f65fad4c7d4/users/2feff4789a924e5cb5499027b1f4d579/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:37.827389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc7ff-b8f3-4669-8379-861d71620935 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:37.827675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc7ff-b8f3-4669-8379-861d71620935 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:37.827946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fc7ff-b8f3-4669-8379-861d71620935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:37.909341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-374fc7ff-b8f3-4669-8379-861d71620935 None None] MFA Rules not processed for user `2feff4789a924e5cb5499027b1f4d579`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:37.910938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-374fc7ff-b8f3-4669-8379-861d71620935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:37.916978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e6ced-f837-45ba-9946-af5252760b69 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:37.917563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e6ced-f837-45ba-9946-af5252760b69 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:37.918143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e6ced-f837-45ba-9946-af5252760b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:37.952811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:37.971571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e10e6ced-f837-45ba-9946-af5252760b69 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:37.973761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e10e6ced-f837-45ba-9946-af5252760b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:38.055938 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2589/5143] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:38.074286 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2555/5144] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:41:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:41:38.093300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc7ff-b8f3-4669-8379-861d71620935 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:38.094854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-374fc7ff-b8f3-4669-8379-861d71620935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:38.114365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e6ced-f837-45ba-9946-af5252760b69 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:38.118076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e10e6ced-f837-45ba-9946-af5252760b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:38.230361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e6ced-f837-45ba-9946-af5252760b69 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:38.238787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c9f58-2d51-4daf-9ea9-e49ef84f9a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:38.240264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9f58-2d51-4daf-9ea9-e49ef84f9a26 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:38.240480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9f58-2d51-4daf-9ea9-e49ef84f9a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:38.240772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c9f58-2d51-4daf-9ea9-e49ef84f9a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:38.250676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fc7ff-b8f3-4669-8379-861d71620935 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:38.252758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:38.261978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c9f58-2d51-4daf-9ea9-e49ef84f9a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:38.262896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c74301-1da7-4d77-ac2b-35e1c842e1b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:38.263626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c74301-1da7-4d77-ac2b-35e1c842e1b1 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:38.263996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c74301-1da7-4d77-ac2b-35e1c842e1b1 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:38.264658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c74301-1da7-4d77-ac2b-35e1c842e1b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:38.266207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c9f58-2d51-4daf-9ea9-e49ef84f9a26 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:38.276614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c74301-1da7-4d77-ac2b-35e1c842e1b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:38.278134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c74301-1da7-4d77-ac2b-35e1c842e1b1 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:38.281644 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2556/5145] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:41:38.288591 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2590/5146] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:41:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:42.048283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b9352-68a6-4376-bfa6-e5f69242940f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:42.049260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b9352-68a6-4376-bfa6-e5f69242940f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:42.049834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b9352-68a6-4376-bfa6-e5f69242940f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:42.119065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-960b9352-68a6-4376-bfa6-e5f69242940f None None] MFA Rules not processed for user `e2cdbb6d555b48e1985d21bf26792d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:42.120756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-960b9352-68a6-4376-bfa6-e5f69242940f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:42.335277 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2557/5147] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:42.350798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713af52-9c90-448d-a823-8d5c409cfb31 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:42.351252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713af52-9c90-448d-a823-8d5c409cfb31 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:42.351252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713af52-9c90-448d-a823-8d5c409cfb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:42.402999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6713af52-9c90-448d-a823-8d5c409cfb31 None None] MFA Rules not processed for user `e2cdbb6d555b48e1985d21bf26792d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:42.404269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6713af52-9c90-448d-a823-8d5c409cfb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:42.463091 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2591/5148] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:42.466203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cc2b7-5df3-4c61-8035-e8fd9f227b41 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:42.466490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cc2b7-5df3-4c61-8035-e8fd9f227b41 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:42.466763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cc2b7-5df3-4c61-8035-e8fd9f227b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:42.514522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-623cc2b7-5df3-4c61-8035-e8fd9f227b41 None None] MFA Rules not processed for user `e2cdbb6d555b48e1985d21bf26792d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:42.515771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-623cc2b7-5df3-4c61-8035-e8fd9f227b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:42.542650 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2558/5149] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:43.148445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713af52-9c90-448d-a823-8d5c409cfb31 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:43.150196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6713af52-9c90-448d-a823-8d5c409cfb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:43.328151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713af52-9c90-448d-a823-8d5c409cfb31 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:43.357802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a56a8-7dfd-4086-9419-a9239c3d6f15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:43.359011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a56a8-7dfd-4086-9419-a9239c3d6f15 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:43.359300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a56a8-7dfd-4086-9419-a9239c3d6f15 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:43.359586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a56a8-7dfd-4086-9419-a9239c3d6f15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:43.381506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a56a8-7dfd-4086-9419-a9239c3d6f15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:43.383168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a56a8-7dfd-4086-9419-a9239c3d6f15 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:43.430619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2592/5150] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:46.187683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cc2b7-5df3-4c61-8035-e8fd9f227b41 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:46.196111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-623cc2b7-5df3-4c61-8035-e8fd9f227b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:46.275625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623cc2b7-5df3-4c61-8035-e8fd9f227b41 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:46.286601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a14ef7-5839-4494-ac3b-c7e618456f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:46.287671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a14ef7-5839-4494-ac3b-c7e618456f3f service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:46.290887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a14ef7-5839-4494-ac3b-c7e618456f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:46.291984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a14ef7-5839-4494-ac3b-c7e618456f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:46.295647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-36a14ef7-5839-4494-ac3b-c7e618456f3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:46.323350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a14ef7-5839-4494-ac3b-c7e618456f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:46.325320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a14ef7-5839-4494-ac3b-c7e618456f3f service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:46.356470 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2559/5151] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:48.244320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7c98-73e7-429f-bfd0-219bc4a844e6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:48.245755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7c98-73e7-429f-bfd0-219bc4a844e6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:48.246371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7c98-73e7-429f-bfd0-219bc4a844e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:48.335162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8a7b7c98-73e7-429f-bfd0-219bc4a844e6 None None] MFA Rules not processed for user `e2cdbb6d555b48e1985d21bf26792d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:48.346724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8a7b7c98-73e7-429f-bfd0-219bc4a844e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:48.422650 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2593/5152] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:49.950333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a14ef7-5839-4494-ac3b-c7e618456f3f service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:49.955770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-36a14ef7-5839-4494-ac3b-c7e618456f3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:50.211318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a14ef7-5839-4494-ac3b-c7e618456f3f service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:50.230878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e43da9-4f0b-49cd-8cf0-cae825250ba7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:50.231737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e43da9-4f0b-49cd-8cf0-cae825250ba7 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:50.232137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e43da9-4f0b-49cd-8cf0-cae825250ba7 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:50.232523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e43da9-4f0b-49cd-8cf0-cae825250ba7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:50.236570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-88e43da9-4f0b-49cd-8cf0-cae825250ba7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:50.327193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e43da9-4f0b-49cd-8cf0-cae825250ba7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:50.336395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e43da9-4f0b-49cd-8cf0-cae825250ba7 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:50.407426 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2560/5153] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:51.745053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023c206-13f3-4fa3-a16c-ae63d78cf323 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:51.746336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023c206-13f3-4fa3-a16c-ae63d78cf323 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:51.747097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023c206-13f3-4fa3-a16c-ae63d78cf323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:51.792609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5023c206-13f3-4fa3-a16c-ae63d78cf323 None None] MFA Rules not processed for user `e2cdbb6d555b48e1985d21bf26792d12`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:51.794203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5023c206-13f3-4fa3-a16c-ae63d78cf323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:51.811388 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2594/5154] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:53.113288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e43da9-4f0b-49cd-8cf0-cae825250ba7 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:53.115563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-88e43da9-4f0b-49cd-8cf0-cae825250ba7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:53.176936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:53.350844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e43da9-4f0b-49cd-8cf0-cae825250ba7 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:53.367582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:53.368590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:53.369374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:53.369998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] PATH_INFO: `/v3/users/c04d0e4c2aa842d6b878ffd39e04a7a8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:53.371438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c04d0e4c2aa842d6b878ffd39e04a7a8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:53.374031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:53.503421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c04d0e4c2aa842d6b878ffd39e04a7a8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:53.526553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c04d0e4c2aa842d6b878ffd39e04a7a8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:53.558950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c04d0e4c2aa842d6b878ffd39e04a7a8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:53.575853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c04d0e4c2aa842d6b878ffd39e04a7a8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:53.576654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c04d0e4c2aa842d6b878ffd39e04a7a8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:53.592927 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2561/5155] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:41:53 2022] DELETE /identity/v3/users/c04d0e4c2aa842d6b878ffd39e04a7a8 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:53.594501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90565d2-87d7-419a-8027-c51b897e76c3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:53.594965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90565d2-87d7-419a-8027-c51b897e76c3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:53.595102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90565d2-87d7-419a-8027-c51b897e76c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:53.610245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:53.655093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e90565d2-87d7-419a-8027-c51b897e76c3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:53.659348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e90565d2-87d7-419a-8027-c51b897e76c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:53.831852 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2595/5156] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:53.881777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:53.883989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:54.052601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45546910-db81-447d-83c7-40d2dc6d8599 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:54.064524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69a93-b285-4203-bced-f363f8792021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:54.065170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69a93-b285-4203-bced-f363f8792021 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:54.065443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69a93-b285-4203-bced-f363f8792021 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:54.065718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f69a93-b285-4203-bced-f363f8792021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:54.091906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f69a93-b285-4203-bced-f363f8792021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:54.093371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f69a93-b285-4203-bced-f363f8792021 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:54.134914 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2562/5157] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:54.345955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90565d2-87d7-419a-8027-c51b897e76c3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:54.347473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e90565d2-87d7-419a-8027-c51b897e76c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:54.364787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90565d2-87d7-419a-8027-c51b897e76c3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:54.369006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64615965-7dba-4754-8700-eb44ded1ad0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:54.369937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615965-7dba-4754-8700-eb44ded1ad0a service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:54.370422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615965-7dba-4754-8700-eb44ded1ad0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:54.370878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615965-7dba-4754-8700-eb44ded1ad0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:54.373466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-64615965-7dba-4754-8700-eb44ded1ad0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:54.390869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64615965-7dba-4754-8700-eb44ded1ad0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:54.393076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64615965-7dba-4754-8700-eb44ded1ad0a service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:54.407905 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2596/5158] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:41:54.906027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69a93-b285-4203-bced-f363f8792021 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:54.907780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-79f69a93-b285-4203-bced-f363f8792021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:54.934252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f69a93-b285-4203-bced-f363f8792021 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:54.948048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:54.948833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:54.949226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:54.949594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] PATH_INFO: `/v3/projects/798b37af0ba1447baf912866be1e3427` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:54.952653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] RBAC: Authorizing `identity:delete_project(project_id=798b37af0ba1447baf912866be1e3427)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:54.954797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:55.044753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:55.060468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798b37af0ba1447baf912866be1e3427', 'request_id': 'req-6f2766d9-2993-458d-aea6-77444ef8154b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:55.077332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798b37af0ba1447baf912866be1e3427', 'request_id': 'req-6f2766d9-2993-458d-aea6-77444ef8154b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:55.096250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798b37af0ba1447baf912866be1e3427', 'request_id': 'req-6f2766d9-2993-458d-aea6-77444ef8154b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:55.112938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] The token cache is being invalidate because project 798b37af0ba1447baf912866be1e3427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:41:55.113383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:55.114201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6f2766d9-2993-458d-aea6-77444ef8154b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:41:55.121168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0195-b878-4362-a4a3-32bf097ca0eb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:55.122605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0195-b878-4362-a4a3-32bf097ca0eb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:55.123133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca0195-b878-4362-a4a3-32bf097ca0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:55.126266 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2563/5159] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:41:54 2022] DELETE /identity/v3/projects/798b37af0ba1447baf912866be1e3427 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:55.160780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f1ca0195-b878-4362-a4a3-32bf097ca0eb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:55.162511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f1ca0195-b878-4362-a4a3-32bf097ca0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:55.269541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1c6f5-fa78-44df-9825-d1eed685fbee None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:55.270462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1c6f5-fa78-44df-9825-d1eed685fbee None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:55.270977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1c6f5-fa78-44df-9825-d1eed685fbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:55.279940 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2597/5160] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:55.317563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-14c1c6f5-fa78-44df-9825-d1eed685fbee None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:55.325611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-14c1c6f5-fa78-44df-9825-d1eed685fbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:55.357014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca0195-b878-4362-a4a3-32bf097ca0eb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:55.357681 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2564/5161] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:55.378784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca0195-b878-4362-a4a3-32bf097ca0eb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:55.390289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a790d1f-6204-43f4-bc90-44641a41ff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:55.391115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a790d1f-6204-43f4-bc90-44641a41ff07 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:55.393479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a790d1f-6204-43f4-bc90-44641a41ff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:55.394068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a790d1f-6204-43f4-bc90-44641a41ff07 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:55.394992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a790d1f-6204-43f4-bc90-44641a41ff07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:41:55.395516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a790d1f-6204-43f4-bc90-44641a41ff07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:55.400696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a790d1f-6204-43f4-bc90-44641a41ff07 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:55.423760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1c6f5-fa78-44df-9825-d1eed685fbee None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:55.437130 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2598/5162] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:41:55.438216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1c6f5-fa78-44df-9825-d1eed685fbee None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:55.444480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6514464-013f-4652-b7a9-652173f1ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:55.446001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6514464-013f-4652-b7a9-652173f1ce64 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:55.446541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6514464-013f-4652-b7a9-652173f1ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:55.447074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6514464-013f-4652-b7a9-652173f1ce64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:55.449418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6514464-013f-4652-b7a9-652173f1ce64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:55.451709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6514464-013f-4652-b7a9-652173f1ce64 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:55.520866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a790d1f-6204-43f4-bc90-44641a41ff07 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:55.541424 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2565/5163] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:41:55 2022] POST /identity/v3/projects => generated 359 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:55.543620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a790d1f-6204-43f4-bc90-44641a41ff07 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:55.764324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374e92e-b173-47dd-b6b0-d3e37c0cc6a6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:55.764602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374e92e-b173-47dd-b6b0-d3e37c0cc6a6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:55.765081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374e92e-b173-47dd-b6b0-d3e37c0cc6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:55.765214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94a4b7-6037-40e9-90d1-3b5266e02713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:55.765933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94a4b7-6037-40e9-90d1-3b5266e02713 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:55.766493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94a4b7-6037-40e9-90d1-3b5266e02713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:55.766979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94a4b7-6037-40e9-90d1-3b5266e02713 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:55.767882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94a4b7-6037-40e9-90d1-3b5266e02713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:55.771966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e94a4b7-6037-40e9-90d1-3b5266e02713 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:55.803705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:55.829784 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2599/5164] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:41:55 2022] POST /identity/v3/users => generated 280 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:41:55.833974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94a4b7-6037-40e9-90d1-3b5266e02713 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:55.864146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9374e92e-b173-47dd-b6b0-d3e37c0cc6a6 None None] MFA Rules not processed for user `91926a53d7bf4954b85bc15a5fb16852`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:55.865555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9374e92e-b173-47dd-b6b0-d3e37c0cc6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:55.873930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94a4b7-6037-40e9-90d1-3b5266e02713 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:55.887454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8bb3c-1e33-45fa-ace5-7f20989ab7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:55.888284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8bb3c-1e33-45fa-ace5-7f20989ab7ef admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:55.888659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8bb3c-1e33-45fa-ace5-7f20989ab7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:55.889030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8bb3c-1e33-45fa-ace5-7f20989ab7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:55.889785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8bb3c-1e33-45fa-ace5-7f20989ab7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:55.891744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8bb3c-1e33-45fa-ace5-7f20989ab7ef admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:55.905534 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2600/5165] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:55.909997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8bb3c-1e33-45fa-ace5-7f20989ab7ef admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:55.921219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8bb3c-1e33-45fa-ace5-7f20989ab7ef admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:55.926859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7bf4c-c6ee-4f7f-a85f-f566b97840c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:55.927620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7bf4c-c6ee-4f7f-a85f-f566b97840c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:55.928003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7bf4c-c6ee-4f7f-a85f-f566b97840c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:55.928373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7bf4c-c6ee-4f7f-a85f-f566b97840c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:55.929311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7bf4c-c6ee-4f7f-a85f-f566b97840c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:55.931738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7bf4c-c6ee-4f7f-a85f-f566b97840c1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:55.961007 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2601/5166] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:41:55.962469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7bf4c-c6ee-4f7f-a85f-f566b97840c1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:55.976196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7bf4c-c6ee-4f7f-a85f-f566b97840c1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:55.983596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925987e-9221-40e7-8460-6920e2197c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:55.985148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925987e-9221-40e7-8460-6920e2197c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:55.985623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925987e-9221-40e7-8460-6920e2197c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:55.986021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925987e-9221-40e7-8460-6920e2197c55 admin admin] PATH_INFO: `/v3/projects/4e173eefb8a84e8282420500571468d2/users/b068b4e2af4f44578cfeeaa7bccc8988/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:56.024694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925987e-9221-40e7-8460-6920e2197c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e173eefb8a84e8282420500571468d2, user_id=b068b4e2af4f44578cfeeaa7bccc8988, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:56.032781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925987e-9221-40e7-8460-6920e2197c55 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:56.070326 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2602/5167] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:41:55 2022] PUT /identity/v3/projects/4e173eefb8a84e8282420500571468d2/users/b068b4e2af4f44578cfeeaa7bccc8988/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:41:56.074975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046bad2-9494-4169-b638-3c02f38a5994 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:56.075391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046bad2-9494-4169-b638-3c02f38a5994 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:56.075808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046bad2-9494-4169-b638-3c02f38a5994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:56.119094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8046bad2-9494-4169-b638-3c02f38a5994 None None] MFA Rules not processed for user `b068b4e2af4f44578cfeeaa7bccc8988`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:56.120728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8046bad2-9494-4169-b638-3c02f38a5994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:56.308801 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2566/5168] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:56.317612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b9b5-dd7b-402b-9e73-2c2beeac4cbe None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:56.322650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b9b5-dd7b-402b-9e73-2c2beeac4cbe None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:56.326784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9b9b5-dd7b-402b-9e73-2c2beeac4cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:56.422075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1fe9b9b5-dd7b-402b-9e73-2c2beeac4cbe None None] MFA Rules not processed for user `fb799d2ce6774b86bdcf0623d9bd4201`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:41:56.424380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1fe9b9b5-dd7b-402b-9e73-2c2beeac4cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:56.435686 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2603/5169] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:56.481789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046bad2-9494-4169-b638-3c02f38a5994 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:56.483596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8046bad2-9494-4169-b638-3c02f38a5994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:56.506430 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2567/5170] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:41:56 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:41:56.517553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b9b5-dd7b-402b-9e73-2c2beeac4cbe None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:41:56.519423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1fe9b9b5-dd7b-402b-9e73-2c2beeac4cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:56.586555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:56.631404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046bad2-9494-4169-b638-3c02f38a5994 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:56.637677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d6cf6-1365-4823-abdb-278a3b42d36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:56.639527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6cf6-1365-4823-abdb-278a3b42d36e service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:56.639801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6cf6-1365-4823-abdb-278a3b42d36e service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:56.640071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d6cf6-1365-4823-abdb-278a3b42d36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:56.672577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d6cf6-1365-4823-abdb-278a3b42d36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:56.674281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d6cf6-1365-4823-abdb-278a3b42d36e service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:56.689400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9b9b5-dd7b-402b-9e73-2c2beeac4cbe None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:41:56.695860 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2604/5171] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:41:56.706243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9acaa-dc58-4927-86d4-a2740c393ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:41:56.708386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9acaa-dc58-4927-86d4-a2740c393ab7 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:41:56.708820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9acaa-dc58-4927-86d4-a2740c393ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:41:56.716096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9acaa-dc58-4927-86d4-a2740c393ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:41:56.726042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bdb9acaa-dc58-4927-86d4-a2740c393ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:41:56.737671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9acaa-dc58-4927-86d4-a2740c393ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:41:56.739729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9acaa-dc58-4927-86d4-a2740c393ab7 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:41:56.765034 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2568/5172] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:41:56 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:42:00.705079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d6cf6-1365-4823-abdb-278a3b42d36e service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:00.707481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6b8d6cf6-1365-4823-abdb-278a3b42d36e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:00.899807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:00.984597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d6cf6-1365-4823-abdb-278a3b42d36e service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:01.087506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857c1d-93d1-46d2-9f6c-76a4bc3c6078 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:01.091476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857c1d-93d1-46d2-9f6c-76a4bc3c6078 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:01.092829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857c1d-93d1-46d2-9f6c-76a4bc3c6078 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:01.093116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857c1d-93d1-46d2-9f6c-76a4bc3c6078 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:01.097594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1b857c1d-93d1-46d2-9f6c-76a4bc3c6078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:01.203964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857c1d-93d1-46d2-9f6c-76a4bc3c6078 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:01.213307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857c1d-93d1-46d2-9f6c-76a4bc3c6078 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:01.384166 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2605/5173] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:42:02.363861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9acaa-dc58-4927-86d4-a2740c393ab7 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:02.365347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bdb9acaa-dc58-4927-86d4-a2740c393ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:02.549473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9acaa-dc58-4927-86d4-a2740c393ab7 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:02.563753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b74082-4567-40fe-8614-2187f278d0f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:02.567198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74082-4567-40fe-8614-2187f278d0f0 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:02.567760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74082-4567-40fe-8614-2187f278d0f0 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:02.568456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74082-4567-40fe-8614-2187f278d0f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:02.574031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e0b74082-4567-40fe-8614-2187f278d0f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:02.610624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b74082-4567-40fe-8614-2187f278d0f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:02.615623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b74082-4567-40fe-8614-2187f278d0f0 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:02.637943 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2569/5174] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:42:11.299403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=11 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:12.626217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=38 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:21.449305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857c1d-93d1-46d2-9f6c-76a4bc3c6078 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:21.450986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1b857c1d-93d1-46d2-9f6c-76a4bc3c6078 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:21.690863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857c1d-93d1-46d2-9f6c-76a4bc3c6078 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:21.697740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:21.698697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:21.699164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:21.699601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] PATH_INFO: `/v3/users/2feff4789a924e5cb5499027b1f4d579` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:21.701115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2feff4789a924e5cb5499027b1f4d579)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:21.703705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:21.780002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2feff4789a924e5cb5499027b1f4d579'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:21.780688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2feff4789a924e5cb5499027b1f4d579'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:21.791369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2feff4789a924e5cb5499027b1f4d579'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:21.804055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2feff4789a924e5cb5499027b1f4d579'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:21.824023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2feff4789a924e5cb5499027b1f4d579'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:21.854306 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2606/5175] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:42:21 2022] DELETE /identity/v3/users/2feff4789a924e5cb5499027b1f4d579 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:21.858694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcd72a-2fe3-4dd9-b65e-a4a2654b66a9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:21.859554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcd72a-2fe3-4dd9-b65e-a4a2654b66a9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:21.860018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcd72a-2fe3-4dd9-b65e-a4a2654b66a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:21.938127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5bfcd72a-2fe3-4dd9-b65e-a4a2654b66a9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:21.939773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5bfcd72a-2fe3-4dd9-b65e-a4a2654b66a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:22.075057 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2570/5176] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:22.112592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:22.114085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:22.278451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:22.347175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5c653-62c1-4d11-83af-4904d38c5147 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:22.358573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db39904-0ff9-48bb-a714-cfb4b9c07bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:22.359862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db39904-0ff9-48bb-a714-cfb4b9c07bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:22.360141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db39904-0ff9-48bb-a714-cfb4b9c07bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:22.360424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db39904-0ff9-48bb-a714-cfb4b9c07bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:22.399631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db39904-0ff9-48bb-a714-cfb4b9c07bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:22.401249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db39904-0ff9-48bb-a714-cfb4b9c07bc3 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:22.447428 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2607/5177] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:42:23.667917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcd72a-2fe3-4dd9-b65e-a4a2654b66a9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:23.671800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5bfcd72a-2fe3-4dd9-b65e-a4a2654b66a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:23.705843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcd72a-2fe3-4dd9-b65e-a4a2654b66a9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:23.725022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:23.726284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:23.726727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:23.727196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] PATH_INFO: `/v3/projects/2018dce9a3d24b4c82f27f65fad4c7d4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:23.731825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2018dce9a3d24b4c82f27f65fad4c7d4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:23.735658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:23.822553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2018dce9a3d24b4c82f27f65fad4c7d4', 'request_id': 'req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:23.841322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2018dce9a3d24b4c82f27f65fad4c7d4', 'request_id': 'req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:23.861136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2018dce9a3d24b4c82f27f65fad4c7d4', 'request_id': 'req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:23.912042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] The token cache is being invalidate because project 2018dce9a3d24b4c82f27f65fad4c7d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:42:23.912548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:23.913459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ded555b9-f6a8-4c9f-9ba8-e5da8ed5c8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:23.920783 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2571/5178] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:42:23 2022] DELETE /identity/v3/projects/2018dce9a3d24b4c82f27f65fad4c7d4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:23.921034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1f3a-1e0b-4224-a356-0d7a4b3acaf7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:23.921491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1f3a-1e0b-4224-a356-0d7a4b3acaf7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:23.922006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1f3a-1e0b-4224-a356-0d7a4b3acaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:24.021863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d49d1f3a-1e0b-4224-a356-0d7a4b3acaf7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:24.026114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d49d1f3a-1e0b-4224-a356-0d7a4b3acaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:24.156348 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2608/5179] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:24.165413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a72446-024e-4a3c-8d2b-a1f408e27436 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:24.165684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a72446-024e-4a3c-8d2b-a1f408e27436 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:24.165857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a72446-024e-4a3c-8d2b-a1f408e27436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:24.206603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e2a72446-024e-4a3c-8d2b-a1f408e27436 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:24.210535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e2a72446-024e-4a3c-8d2b-a1f408e27436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:24.227412 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2572/5180] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:24.228605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d1f3a-1e0b-4224-a356-0d7a4b3acaf7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:24.240275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d1f3a-1e0b-4224-a356-0d7a4b3acaf7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:24.247267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b3990-ea4e-4775-9968-9c288fb9c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:24.248139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b3990-ea4e-4775-9968-9c288fb9c99c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:24.249163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b3990-ea4e-4775-9968-9c288fb9c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:24.249785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b3990-ea4e-4775-9968-9c288fb9c99c admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:24.250666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b3990-ea4e-4775-9968-9c288fb9c99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:42:24.251360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b3990-ea4e-4775-9968-9c288fb9c99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:24.253215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b3990-ea4e-4775-9968-9c288fb9c99c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:24.277665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a72446-024e-4a3c-8d2b-a1f408e27436 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:24.286364 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2609/5181] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:42:24.292890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a72446-024e-4a3c-8d2b-a1f408e27436 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:24.299252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d6c9-f2d1-44b3-92d5-aa0cc8d727a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:24.300344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d6c9-f2d1-44b3-92d5-aa0cc8d727a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:24.300853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d6c9-f2d1-44b3-92d5-aa0cc8d727a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:24.301318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c7d6c9-f2d1-44b3-92d5-aa0cc8d727a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:24.303141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7d6c9-f2d1-44b3-92d5-aa0cc8d727a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:24.306633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c7d6c9-f2d1-44b3-92d5-aa0cc8d727a8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:24.380627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b3990-ea4e-4775-9968-9c288fb9c99c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:24.388352 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2573/5182] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:42:24 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:42:24.392882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b3990-ea4e-4775-9968-9c288fb9c99c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:24.501026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dccda8-0e4b-4084-8cc2-29563711ae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:24.501796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dccda8-0e4b-4084-8cc2-29563711ae16 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:24.504331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dccda8-0e4b-4084-8cc2-29563711ae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:24.504331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dccda8-0e4b-4084-8cc2-29563711ae16 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:24.520106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dccda8-0e4b-4084-8cc2-29563711ae16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:24.527096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dccda8-0e4b-4084-8cc2-29563711ae16 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:24.589624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d6c9-f2d1-44b3-92d5-aa0cc8d727a8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:24.601210 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2610/5183] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:42:24 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:42:24.608247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c7d6c9-f2d1-44b3-92d5-aa0cc8d727a8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:24.630367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e9693-b478-4799-a1db-ccdb504774cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:24.631349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e9693-b478-4799-a1db-ccdb504774cd admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:24.633130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e9693-b478-4799-a1db-ccdb504774cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:24.640783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e9693-b478-4799-a1db-ccdb504774cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:24.644186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e9693-b478-4799-a1db-ccdb504774cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:24.647864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e9693-b478-4799-a1db-ccdb504774cd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:24.690933 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2574/5184] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:42:24.693544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dccda8-0e4b-4084-8cc2-29563711ae16 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:24.725248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dccda8-0e4b-4084-8cc2-29563711ae16 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:24.748148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16d559-de63-4dc2-9658-e4155d606ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:24.748817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16d559-de63-4dc2-9658-e4155d606ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:24.749114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16d559-de63-4dc2-9658-e4155d606ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:24.749380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16d559-de63-4dc2-9658-e4155d606ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:24.750072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16d559-de63-4dc2-9658-e4155d606ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:24.751686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16d559-de63-4dc2-9658-e4155d606ce9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:24.775531 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2611/5185] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:42:24.780163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e9693-b478-4799-a1db-ccdb504774cd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:24.794920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e9693-b478-4799-a1db-ccdb504774cd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:24.804598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b070d-ab65-4bb8-8b71-1ab79c174fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:24.806196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b070d-ab65-4bb8-8b71-1ab79c174fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:24.806196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b070d-ab65-4bb8-8b71-1ab79c174fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:24.806419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b070d-ab65-4bb8-8b71-1ab79c174fe0 admin admin] PATH_INFO: `/v3/projects/87ad1a938cbc4010a783fbe05a72a768/users/4235ea98225a4bb2aa5611b5d4487256/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:24.843201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b070d-ab65-4bb8-8b71-1ab79c174fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ad1a938cbc4010a783fbe05a72a768, user_id=4235ea98225a4bb2aa5611b5d4487256, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:24.850136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b070d-ab65-4bb8-8b71-1ab79c174fe0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:24.910631 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2575/5186] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:42:24 2022] PUT /identity/v3/projects/87ad1a938cbc4010a783fbe05a72a768/users/4235ea98225a4bb2aa5611b5d4487256/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:24.922150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b7c8-dac2-452c-b5f0-fe69ab659ee0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:24.922656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b7c8-dac2-452c-b5f0-fe69ab659ee0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:24.922656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99b7c8-dac2-452c-b5f0-fe69ab659ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:25.027521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5b99b7c8-dac2-452c-b5f0-fe69ab659ee0 None None] MFA Rules not processed for user `4235ea98225a4bb2aa5611b5d4487256`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:25.029704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5b99b7c8-dac2-452c-b5f0-fe69ab659ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:25.066981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:25.291914 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2612/5187] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:25.334468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b070d-ab65-4bb8-8b71-1ab79c174fe0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:25.337389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b67b070d-ab65-4bb8-8b71-1ab79c174fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:25.361980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:25.458439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b070d-ab65-4bb8-8b71-1ab79c174fe0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:25.466364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3d188-cea8-4668-8725-8ac28918f329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:25.467005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3d188-cea8-4668-8725-8ac28918f329 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:25.467499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3d188-cea8-4668-8725-8ac28918f329 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:25.467778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3d188-cea8-4668-8725-8ac28918f329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:25.480317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3d188-cea8-4668-8725-8ac28918f329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:25.482989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3d188-cea8-4668-8725-8ac28918f329 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:25.500515 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2576/5188] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:42:26.495999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99b7c8-dac2-452c-b5f0-fe69ab659ee0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:26.498831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5b99b7c8-dac2-452c-b5f0-fe69ab659ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:26.643092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99b7c8-dac2-452c-b5f0-fe69ab659ee0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:26.650073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:26.651042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:26.651501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:26.651878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] PATH_INFO: `/v3/users/3e02dab107224c678f83f485d7f9f17a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:26.653492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e02dab107224c678f83f485d7f9f17a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:26.656504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:26.774193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e02dab107224c678f83f485d7f9f17a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:26.775593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e02dab107224c678f83f485d7f9f17a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:26.786496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e02dab107224c678f83f485d7f9f17a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:26.801178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e02dab107224c678f83f485d7f9f17a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:26.820075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-918f4b8a-8954-4e85-bd1a-a2791c85ea16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e02dab107224c678f83f485d7f9f17a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:26.827583 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2613/5189] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:42:26 2022] DELETE /identity/v3/users/3e02dab107224c678f83f485d7f9f17a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:27.538455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3d188-cea8-4668-8725-8ac28918f329 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:27.555820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3d188-cea8-4668-8725-8ac28918f329 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:27.701370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:27.703047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:27.703455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:27.703794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] PATH_INFO: `/v3/projects/39f07783e0174c76a47a119a4959aca9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:27.709972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f07783e0174c76a47a119a4959aca9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:27.713572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:27.818029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f07783e0174c76a47a119a4959aca9', 'request_id': 'req-25987e23-44fc-4b31-914d-583ed344b0c3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:27.834787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f07783e0174c76a47a119a4959aca9', 'request_id': 'req-25987e23-44fc-4b31-914d-583ed344b0c3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:27.845161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f07783e0174c76a47a119a4959aca9', 'request_id': 'req-25987e23-44fc-4b31-914d-583ed344b0c3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:27.859884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] The token cache is being invalidate because project 39f07783e0174c76a47a119a4959aca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:42:27.860305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:27.861677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25987e23-44fc-4b31-914d-583ed344b0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:27.864332 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2577/5190] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:42:27 2022] DELETE /identity/v3/projects/39f07783e0174c76a47a119a4959aca9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:27.869296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a2117-ff43-4e2f-98be-ba9097f2962d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:27.873297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a2117-ff43-4e2f-98be-ba9097f2962d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:27.873719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a2117-ff43-4e2f-98be-ba9097f2962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:27.917217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b25a2117-ff43-4e2f-98be-ba9097f2962d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:27.918646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b25a2117-ff43-4e2f-98be-ba9097f2962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:27.960031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:27.997238 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2614/5191] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:42:28.005910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27654-cc46-48ef-ab15-f662a0871ff3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:28.006513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27654-cc46-48ef-ab15-f662a0871ff3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:28.006869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb27654-cc46-48ef-ab15-f662a0871ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:28.048342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-afb27654-cc46-48ef-ab15-f662a0871ff3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:28.049768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-afb27654-cc46-48ef-ab15-f662a0871ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:28.071277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a2117-ff43-4e2f-98be-ba9097f2962d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:28.074950 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2578/5192] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:28.082241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a2117-ff43-4e2f-98be-ba9097f2962d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:28.107412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add15ea1-b4ea-44d8-83b7-273f71bfdae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:28.110367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add15ea1-b4ea-44d8-83b7-273f71bfdae1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:28.110631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add15ea1-b4ea-44d8-83b7-273f71bfdae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:28.110909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add15ea1-b4ea-44d8-83b7-273f71bfdae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:28.111609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add15ea1-b4ea-44d8-83b7-273f71bfdae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:42:28.111907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add15ea1-b4ea-44d8-83b7-273f71bfdae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:28.113550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add15ea1-b4ea-44d8-83b7-273f71bfdae1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:28.137536 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2615/5193] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:42:28.141797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb27654-cc46-48ef-ab15-f662a0871ff3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:28.155162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb27654-cc46-48ef-ab15-f662a0871ff3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:28.164127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f471ee-c851-4adb-8052-f4703e31ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:28.164719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f471ee-c851-4adb-8052-f4703e31ac47 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:28.165125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f471ee-c851-4adb-8052-f4703e31ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:28.166211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f471ee-c851-4adb-8052-f4703e31ac47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:28.166415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f471ee-c851-4adb-8052-f4703e31ac47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:28.169129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f471ee-c851-4adb-8052-f4703e31ac47 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:28.216114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2579/5194] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:42:28 2022] POST /identity/v3/projects => generated 403 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:28.220268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add15ea1-b4ea-44d8-83b7-273f71bfdae1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:28.237280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add15ea1-b4ea-44d8-83b7-273f71bfdae1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:28.314822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ee82b-5ffd-4cbf-9fbb-6c5390e27255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:28.315452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ee82b-5ffd-4cbf-9fbb-6c5390e27255 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:28.315729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ee82b-5ffd-4cbf-9fbb-6c5390e27255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:28.315997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ee82b-5ffd-4cbf-9fbb-6c5390e27255 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:28.316638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ee82b-5ffd-4cbf-9fbb-6c5390e27255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:28.318645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ee82b-5ffd-4cbf-9fbb-6c5390e27255 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:28.353391 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2616/5195] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:42:28 2022] POST /identity/v3/users => generated 302 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:42:28.357366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f471ee-c851-4adb-8052-f4703e31ac47 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:28.369523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f471ee-c851-4adb-8052-f4703e31ac47 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:28.375256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead94633-3fde-406a-92ff-0ad6ed1cf696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:28.375904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead94633-3fde-406a-92ff-0ad6ed1cf696 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:28.376182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead94633-3fde-406a-92ff-0ad6ed1cf696 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:28.376514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead94633-3fde-406a-92ff-0ad6ed1cf696 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:28.377222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead94633-3fde-406a-92ff-0ad6ed1cf696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:28.378964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead94633-3fde-406a-92ff-0ad6ed1cf696 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:28.395699 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2580/5196] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:42:28.396635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ee82b-5ffd-4cbf-9fbb-6c5390e27255 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:28.408376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ee82b-5ffd-4cbf-9fbb-6c5390e27255 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:28.416991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71573136-5843-47b9-b62c-acffbf43725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:28.418093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573136-5843-47b9-b62c-acffbf43725c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:28.418617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573136-5843-47b9-b62c-acffbf43725c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:28.419104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71573136-5843-47b9-b62c-acffbf43725c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:28.419975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71573136-5843-47b9-b62c-acffbf43725c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:28.421881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71573136-5843-47b9-b62c-acffbf43725c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:28.437687 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2617/5197] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:42:28.441713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead94633-3fde-406a-92ff-0ad6ed1cf696 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:28.456072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead94633-3fde-406a-92ff-0ad6ed1cf696 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:28.463872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50d581-2330-474e-9225-11bce0457fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:28.465693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50d581-2330-474e-9225-11bce0457fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:28.467423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50d581-2330-474e-9225-11bce0457fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:28.468014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50d581-2330-474e-9225-11bce0457fb9 admin admin] PATH_INFO: `/v3/projects/d341494ec14c405e881248538cca66e1/users/6257a74b2fd44a9196914d776bc90635/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:28.475964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:28.517783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50d581-2330-474e-9225-11bce0457fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d341494ec14c405e881248538cca66e1, user_id=6257a74b2fd44a9196914d776bc90635, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:28.520667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50d581-2330-474e-9225-11bce0457fb9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:28.556093 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2581/5198] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:42:28 2022] PUT /identity/v3/projects/d341494ec14c405e881248538cca66e1/users/6257a74b2fd44a9196914d776bc90635/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:42:28.566905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256f60-9ca0-4d91-b955-c9e1223fad1f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:28.567228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256f60-9ca0-4d91-b955-c9e1223fad1f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:28.567456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79256f60-9ca0-4d91-b955-c9e1223fad1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:28.643238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-79256f60-9ca0-4d91-b955-c9e1223fad1f None None] MFA Rules not processed for user `6257a74b2fd44a9196914d776bc90635`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:28.644491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-79256f60-9ca0-4d91-b955-c9e1223fad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:28.820081 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2618/5199] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:29.198227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f7d9-0350-4581-ac88-b0d6229e6aff None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:29.198983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f7d9-0350-4581-ac88-b0d6229e6aff None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:29.199332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918f7d9-0350-4581-ac88-b0d6229e6aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:29.239975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c918f7d9-0350-4581-ac88-b0d6229e6aff None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:29.241631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c918f7d9-0350-4581-ac88-b0d6229e6aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:29.335179 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2582/5200] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:42:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:29.361923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256f60-9ca0-4d91-b955-c9e1223fad1f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:29.361923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-79256f60-9ca0-4d91-b955-c9e1223fad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:29.431889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:29.512859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79256f60-9ca0-4d91-b955-c9e1223fad1f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:29.519436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8b0e5-5459-4646-a8dc-c67af2da9a60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:29.520346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b0e5-5459-4646-a8dc-c67af2da9a60 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:29.520845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b0e5-5459-4646-a8dc-c67af2da9a60 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:29.521362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8b0e5-5459-4646-a8dc-c67af2da9a60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:29.531458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b0e5-5459-4646-a8dc-c67af2da9a60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:29.533899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8b0e5-5459-4646-a8dc-c67af2da9a60 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:29.559502 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2619/5201] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:42:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:29.754432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f7d9-0350-4581-ac88-b0d6229e6aff None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:29.998121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918f7d9-0350-4581-ac88-b0d6229e6aff None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:30.017572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:30.017572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:30.017572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:30.017572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] PATH_INFO: `/v3/users/6257a74b2fd44a9196914d776bc90635` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:30.023626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6257a74b2fd44a9196914d776bc90635)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:30.035930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:30.205089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6257a74b2fd44a9196914d776bc90635'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:30.231119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6257a74b2fd44a9196914d776bc90635'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:30.267056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6257a74b2fd44a9196914d776bc90635'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:30.291405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6257a74b2fd44a9196914d776bc90635'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:30.292253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6257a74b2fd44a9196914d776bc90635'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:30.294525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:30.318663 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2583/5202] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:42:29 2022] DELETE /identity/v3/users/6257a74b2fd44a9196914d776bc90635 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:30.323194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b3a55-d952-4fa1-95bc-83f89c17c0d0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:30.323855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b3a55-d952-4fa1-95bc-83f89c17c0d0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:30.324291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b3a55-d952-4fa1-95bc-83f89c17c0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:30.436266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ac8b3a55-d952-4fa1-95bc-83f89c17c0d0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:30.439621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ac8b3a55-d952-4fa1-95bc-83f89c17c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:30.698315 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2620/5203] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:30.730946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:30.735916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:30.853959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ce1c-8188-4841-83dd-525519d371b8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:30.866127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b3a55-d952-4fa1-95bc-83f89c17c0d0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:30.867892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03437129-fca4-4e7d-9084-56842fcac7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:30.869114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ac8b3a55-d952-4fa1-95bc-83f89c17c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:30.869784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03437129-fca4-4e7d-9084-56842fcac7fe service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:30.870112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03437129-fca4-4e7d-9084-56842fcac7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:30.870902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03437129-fca4-4e7d-9084-56842fcac7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:30.887361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03437129-fca4-4e7d-9084-56842fcac7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:30.888214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03437129-fca4-4e7d-9084-56842fcac7fe service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:30.950298 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2584/5204] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:42:31.019891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b3a55-d952-4fa1-95bc-83f89c17c0d0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:31.027867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792d75e-b43a-46e6-8154-00d4444e9fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:31.028937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792d75e-b43a-46e6-8154-00d4444e9fe2 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:31.029750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792d75e-b43a-46e6-8154-00d4444e9fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:31.030268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792d75e-b43a-46e6-8154-00d4444e9fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:31.032630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c792d75e-b43a-46e6-8154-00d4444e9fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:31.113324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:31.118349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792d75e-b43a-46e6-8154-00d4444e9fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:31.122581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792d75e-b43a-46e6-8154-00d4444e9fe2 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:31.143939 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2621/5205] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:30 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:42:33.228668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03437129-fca4-4e7d-9084-56842fcac7fe service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:33.230744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-03437129-fca4-4e7d-9084-56842fcac7fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:33.252878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03437129-fca4-4e7d-9084-56842fcac7fe service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:33.258319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:33.264558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:33.265160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:33.265978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] PATH_INFO: `/v3/projects/d341494ec14c405e881248538cca66e1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:33.270142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d341494ec14c405e881248538cca66e1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:33.276918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:33.579047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd341494ec14c405e881248538cca66e1', 'request_id': 'req-d4641043-5690-4802-8b6e-c97d9ad50ab1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:33.594250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd341494ec14c405e881248538cca66e1', 'request_id': 'req-d4641043-5690-4802-8b6e-c97d9ad50ab1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:33.608216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd341494ec14c405e881248538cca66e1', 'request_id': 'req-d4641043-5690-4802-8b6e-c97d9ad50ab1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:33.669161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] The token cache is being invalidate because project d341494ec14c405e881248538cca66e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:42:33.669449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:33.675370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d4641043-5690-4802-8b6e-c97d9ad50ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:33.692326 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2585/5206] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:42:33 2022] DELETE /identity/v3/projects/d341494ec14c405e881248538cca66e1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:33.694532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04669c3a-700b-4a4e-aecf-1fe0c212fe79 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:33.694995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04669c3a-700b-4a4e-aecf-1fe0c212fe79 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:33.695155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04669c3a-700b-4a4e-aecf-1fe0c212fe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:33.767246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-04669c3a-700b-4a4e-aecf-1fe0c212fe79 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:33.771382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-04669c3a-700b-4a4e-aecf-1fe0c212fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:33.929375 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2622/5207] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:33.931525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd75d1b-d2c6-474e-bcd3-be9ff9db9278 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:33.932217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd75d1b-d2c6-474e-bcd3-be9ff9db9278 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:33.933111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd75d1b-d2c6-474e-bcd3-be9ff9db9278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:33.979661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8fd75d1b-d2c6-474e-bcd3-be9ff9db9278 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:33.986410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8fd75d1b-d2c6-474e-bcd3-be9ff9db9278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:34.017650 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2586/5208] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:42:34.023020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04669c3a-700b-4a4e-aecf-1fe0c212fe79 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:34.037440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04669c3a-700b-4a4e-aecf-1fe0c212fe79 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:34.064066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740b1a-4ae5-4009-b375-8e001f21419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:34.065977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740b1a-4ae5-4009-b375-8e001f21419a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:34.066645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740b1a-4ae5-4009-b375-8e001f21419a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:34.067109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5740b1a-4ae5-4009-b375-8e001f21419a admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:34.069224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740b1a-4ae5-4009-b375-8e001f21419a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:42:34.069733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740b1a-4ae5-4009-b375-8e001f21419a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:34.071699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5740b1a-4ae5-4009-b375-8e001f21419a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:34.086954 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2623/5209] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:42:34.091153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd75d1b-d2c6-474e-bcd3-be9ff9db9278 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:34.102978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd75d1b-d2c6-474e-bcd3-be9ff9db9278 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:34.117366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce035610-4055-4a24-8531-fab47dd3c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:34.118151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce035610-4055-4a24-8531-fab47dd3c867 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:34.118487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce035610-4055-4a24-8531-fab47dd3c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:34.118695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce035610-4055-4a24-8531-fab47dd3c867 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:34.119511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce035610-4055-4a24-8531-fab47dd3c867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:34.121835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce035610-4055-4a24-8531-fab47dd3c867 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:34.198927 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2587/5210] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:42:34 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:34.203597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740b1a-4ae5-4009-b375-8e001f21419a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:34.217447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5740b1a-4ae5-4009-b375-8e001f21419a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:34.395848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa825cd7-cf5d-4de7-93c0-ae22ede1ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:34.396849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa825cd7-cf5d-4de7-93c0-ae22ede1ea84 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:34.397135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa825cd7-cf5d-4de7-93c0-ae22ede1ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:34.397408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa825cd7-cf5d-4de7-93c0-ae22ede1ea84 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:34.398680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa825cd7-cf5d-4de7-93c0-ae22ede1ea84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:34.402490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa825cd7-cf5d-4de7-93c0-ae22ede1ea84 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:34.453149 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2624/5211] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:42:34 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:42:34.457775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce035610-4055-4a24-8531-fab47dd3c867 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:34.474319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce035610-4055-4a24-8531-fab47dd3c867 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:34.485361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b3f8c-3695-4f43-b2b9-c5d693fd1f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:34.487452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3f8c-3695-4f43-b2b9-c5d693fd1f6a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:34.487944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3f8c-3695-4f43-b2b9-c5d693fd1f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:34.488811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b3f8c-3695-4f43-b2b9-c5d693fd1f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:34.491042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b3f8c-3695-4f43-b2b9-c5d693fd1f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:34.494474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b3f8c-3695-4f43-b2b9-c5d693fd1f6a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:34.525020 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2588/5212] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:42:34.527733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa825cd7-cf5d-4de7-93c0-ae22ede1ea84 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:34.544006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa825cd7-cf5d-4de7-93c0-ae22ede1ea84 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:34.562373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cacee65-41b4-441d-a05d-ecfe3eb8f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:34.563216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacee65-41b4-441d-a05d-ecfe3eb8f221 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:34.563557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacee65-41b4-441d-a05d-ecfe3eb8f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:34.563886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cacee65-41b4-441d-a05d-ecfe3eb8f221 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:34.564607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacee65-41b4-441d-a05d-ecfe3eb8f221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:34.567095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cacee65-41b4-441d-a05d-ecfe3eb8f221 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:34.626409 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2625/5213] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:42:34.630708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b3f8c-3695-4f43-b2b9-c5d693fd1f6a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:34.672910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b3f8c-3695-4f43-b2b9-c5d693fd1f6a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:34.688806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee28526-d0f9-4119-801e-ce4d31170163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:34.689497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee28526-d0f9-4119-801e-ce4d31170163 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:34.689774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee28526-d0f9-4119-801e-ce4d31170163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:34.690191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee28526-d0f9-4119-801e-ce4d31170163 admin admin] PATH_INFO: `/v3/projects/4c29b42cdce042e485ce6c3f647cd918/users/28bf59ac30a74bfc99ac083dc69055bb/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:34.722076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee28526-d0f9-4119-801e-ce4d31170163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c29b42cdce042e485ce6c3f647cd918, user_id=28bf59ac30a74bfc99ac083dc69055bb, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:34.724781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee28526-d0f9-4119-801e-ce4d31170163 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:34.765020 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2589/5214] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:42:34 2022] PUT /identity/v3/projects/4c29b42cdce042e485ce6c3f647cd918/users/28bf59ac30a74bfc99ac083dc69055bb/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:34.771449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e24ef0-2eb8-49d7-9e76-176bcdb2f80e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:34.772757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e24ef0-2eb8-49d7-9e76-176bcdb2f80e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:34.773400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e24ef0-2eb8-49d7-9e76-176bcdb2f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:34.882864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a9e24ef0-2eb8-49d7-9e76-176bcdb2f80e None None] MFA Rules not processed for user `28bf59ac30a74bfc99ac083dc69055bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:34.885234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a9e24ef0-2eb8-49d7-9e76-176bcdb2f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:35.100783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:35.145564 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2626/5215] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:35.160039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee28526-d0f9-4119-801e-ce4d31170163 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:35.162000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5ee28526-d0f9-4119-801e-ce4d31170163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:35.214414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:35.326826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee28526-d0f9-4119-801e-ce4d31170163 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:35.339636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc143331-bab6-4815-a3db-da09c12a2c88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:35.340279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc143331-bab6-4815-a3db-da09c12a2c88 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:35.340603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc143331-bab6-4815-a3db-da09c12a2c88 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:35.340862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc143331-bab6-4815-a3db-da09c12a2c88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:35.358363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc143331-bab6-4815-a3db-da09c12a2c88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:35.360017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc143331-bab6-4815-a3db-da09c12a2c88 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:35.382959 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2590/5216] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:42:45.139349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:45.378705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=25 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:52.341378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e24ef0-2eb8-49d7-9e76-176bcdb2f80e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:52.482129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e24ef0-2eb8-49d7-9e76-176bcdb2f80e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:52.495492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:52.496273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:52.496653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:52.497030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] PATH_INFO: `/v3/users/28bf59ac30a74bfc99ac083dc69055bb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:52.499943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=28bf59ac30a74bfc99ac083dc69055bb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:52.502047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:52.580131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28bf59ac30a74bfc99ac083dc69055bb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:52.583107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28bf59ac30a74bfc99ac083dc69055bb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:52.618437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28bf59ac30a74bfc99ac083dc69055bb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:52.657628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28bf59ac30a74bfc99ac083dc69055bb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:52.711242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28bf59ac30a74bfc99ac083dc69055bb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:52.735866 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2627/5217] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:42:52 2022] DELETE /identity/v3/users/28bf59ac30a74bfc99ac083dc69055bb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:52.739117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ac26a-b683-4b80-bb29-b6e5cbc84623 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:52.740566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ac26a-b683-4b80-bb29-b6e5cbc84623 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:52.741078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ac26a-b683-4b80-bb29-b6e5cbc84623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:52.802172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-184ac26a-b683-4b80-bb29-b6e5cbc84623 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:52.806326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-184ac26a-b683-4b80-bb29-b6e5cbc84623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:52.943411 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2591/5218] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:52.970495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:52.971954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:53.099219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de568af-0727-44b7-a61d-b2eab7a8e13a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:53.112509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73271a3b-918b-4c62-ae6a-9d4bbfc8bd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:53.114152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271a3b-918b-4c62-ae6a-9d4bbfc8bd9a service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:53.114152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271a3b-918b-4c62-ae6a-9d4bbfc8bd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:53.114459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73271a3b-918b-4c62-ae6a-9d4bbfc8bd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:53.139405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73271a3b-918b-4c62-ae6a-9d4bbfc8bd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:53.140514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73271a3b-918b-4c62-ae6a-9d4bbfc8bd9a service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:53.160835 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2628/5219] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:42:53.482236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49761819-b72b-4968-8d26-8738b04b1da3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:53.483352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49761819-b72b-4968-8d26-8738b04b1da3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:53.483930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49761819-b72b-4968-8d26-8738b04b1da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:53.536327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-49761819-b72b-4968-8d26-8738b04b1da3 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:53.539886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-49761819-b72b-4968-8d26-8738b04b1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:53.634710 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2592/5220] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:42:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:53.651932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73271a3b-918b-4c62-ae6a-9d4bbfc8bd9a service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:53.654478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-73271a3b-918b-4c62-ae6a-9d4bbfc8bd9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:53.692970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:53.763627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73271a3b-918b-4c62-ae6a-9d4bbfc8bd9a service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:53.770687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5f35d-abc3-4ca3-b2c3-958626af6c80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:53.772162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f35d-abc3-4ca3-b2c3-958626af6c80 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:53.772548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f35d-abc3-4ca3-b2c3-958626af6c80 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:53.772884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5f35d-abc3-4ca3-b2c3-958626af6c80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:53.799245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5f35d-abc3-4ca3-b2c3-958626af6c80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:53.801199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5f35d-abc3-4ca3-b2c3-958626af6c80 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:53.829250 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2629/5221] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:42:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:54.237772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49761819-b72b-4968-8d26-8738b04b1da3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:54.240087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-49761819-b72b-4968-8d26-8738b04b1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:54.278534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49761819-b72b-4968-8d26-8738b04b1da3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:54.288345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:54.290792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:54.291628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:54.292134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] PATH_INFO: `/v3/users/4235ea98225a4bb2aa5611b5d4487256` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:54.293760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4235ea98225a4bb2aa5611b5d4487256)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:54.296713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:54.401522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4235ea98225a4bb2aa5611b5d4487256'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:54.411499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4235ea98225a4bb2aa5611b5d4487256'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:54.429626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4235ea98225a4bb2aa5611b5d4487256'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:54.448332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4235ea98225a4bb2aa5611b5d4487256'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:54.449068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4235ea98225a4bb2aa5611b5d4487256'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:54.464935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2593/5222] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:42:54 2022] DELETE /identity/v3/users/4235ea98225a4bb2aa5611b5d4487256 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:54.466244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65cff7-4e18-478d-8608-dc5dc8a17f71 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:54.466539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65cff7-4e18-478d-8608-dc5dc8a17f71 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:54.466824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65cff7-4e18-478d-8608-dc5dc8a17f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:54.507953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:54.510776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:54.529272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2c65cff7-4e18-478d-8608-dc5dc8a17f71 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:54.533639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c65cff7-4e18-478d-8608-dc5dc8a17f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:54.578953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:54.689762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5af20-6102-45fe-8453-0520a44c13ab admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:54.697588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:54.698745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:54.698961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:54.699142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] PATH_INFO: `/v3/projects/4c29b42cdce042e485ce6c3f647cd918` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:54.700447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c29b42cdce042e485ce6c3f647cd918)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:54.703232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:54.747178 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2630/5223] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:54.800412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65cff7-4e18-478d-8608-dc5dc8a17f71 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:54.801836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c65cff7-4e18-478d-8608-dc5dc8a17f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:54.834438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c29b42cdce042e485ce6c3f647cd918', 'request_id': 'req-e99702f8-137d-416e-b696-e4a10ad8522e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:54.858369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c29b42cdce042e485ce6c3f647cd918', 'request_id': 'req-e99702f8-137d-416e-b696-e4a10ad8522e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:54.877695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c29b42cdce042e485ce6c3f647cd918', 'request_id': 'req-e99702f8-137d-416e-b696-e4a10ad8522e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:54.915452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] The token cache is being invalidate because project 4c29b42cdce042e485ce6c3f647cd918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:42:54.915799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:54.918328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e99702f8-137d-416e-b696-e4a10ad8522e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:54.925709 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2594/5224] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:42:54 2022] DELETE /identity/v3/projects/4c29b42cdce042e485ce6c3f647cd918 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:42:54.927239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da676-af08-4c78-a321-2e4eac098cf5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:54.927532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da676-af08-4c78-a321-2e4eac098cf5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:54.927788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da676-af08-4c78-a321-2e4eac098cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:54.945487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65cff7-4e18-478d-8608-dc5dc8a17f71 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:54.970946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-380da676-af08-4c78-a321-2e4eac098cf5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:54.972202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-380da676-af08-4c78-a321-2e4eac098cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:55.105068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e2a24-cb6a-4c5d-a5db-64f8d0438777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:55.105830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e2a24-cb6a-4c5d-a5db-64f8d0438777 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:55.106220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e2a24-cb6a-4c5d-a5db-64f8d0438777 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:55.106579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e2a24-cb6a-4c5d-a5db-64f8d0438777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:55.116530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-103e2a24-cb6a-4c5d-a5db-64f8d0438777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:55.122490 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2595/5225] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:55.123989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c643f-f56b-4867-99f1-1bbc480ccfaf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:55.124278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c643f-f56b-4867-99f1-1bbc480ccfaf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:55.124546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c643f-f56b-4867-99f1-1bbc480ccfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:55.150400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e2a24-cb6a-4c5d-a5db-64f8d0438777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:55.158233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e2a24-cb6a-4c5d-a5db-64f8d0438777 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:55.182427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3c6c643f-f56b-4867-99f1-1bbc480ccfaf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:55.183569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3c6c643f-f56b-4867-99f1-1bbc480ccfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:55.192351 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2631/5226] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:42:55.211568 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2596/5227] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:55.216469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e2a24-cb6a-4c5d-a5db-64f8d0438777 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:55.232845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e2a24-cb6a-4c5d-a5db-64f8d0438777 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:55.242532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70ab3-9641-4ead-b25c-085b94858217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:55.243499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70ab3-9641-4ead-b25c-085b94858217 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:55.244175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70ab3-9641-4ead-b25c-085b94858217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:55.244175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70ab3-9641-4ead-b25c-085b94858217 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:55.245252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70ab3-9641-4ead-b25c-085b94858217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:42:55.247707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70ab3-9641-4ead-b25c-085b94858217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:55.251319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70ab3-9641-4ead-b25c-085b94858217 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:55.262226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:55.269991 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2632/5228] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:42:55.276496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c643f-f56b-4867-99f1-1bbc480ccfaf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:55.290945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c643f-f56b-4867-99f1-1bbc480ccfaf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:55.302706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a701b2-2f3e-4417-a15c-c86a22a989bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:55.303484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a701b2-2f3e-4417-a15c-c86a22a989bc admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:55.303865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a701b2-2f3e-4417-a15c-c86a22a989bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:55.304234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a701b2-2f3e-4417-a15c-c86a22a989bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:55.305002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a701b2-2f3e-4417-a15c-c86a22a989bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:55.310061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a701b2-2f3e-4417-a15c-c86a22a989bc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:55.384526 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2597/5229] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:42:55 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:55.386108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70ab3-9641-4ead-b25c-085b94858217 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:55.403589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70ab3-9641-4ead-b25c-085b94858217 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:55.587240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a39e72-82b1-465e-9006-710c87c1f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:55.588803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39e72-82b1-465e-9006-710c87c1f784 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:55.589927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39e72-82b1-465e-9006-710c87c1f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:55.594090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a39e72-82b1-465e-9006-710c87c1f784 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:55.595712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39e72-82b1-465e-9006-710c87c1f784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:55.599166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a39e72-82b1-465e-9006-710c87c1f784 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:55.654305 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2633/5230] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:42:55 2022] POST /identity/v3/users => generated 286 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:55.656059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a701b2-2f3e-4417-a15c-c86a22a989bc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:55.681182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a701b2-2f3e-4417-a15c-c86a22a989bc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:55.702658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a441501-0575-4214-9f60-777537099633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:55.704011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a441501-0575-4214-9f60-777537099633 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:55.704518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a441501-0575-4214-9f60-777537099633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:55.704994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a441501-0575-4214-9f60-777537099633 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:55.705895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a441501-0575-4214-9f60-777537099633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:55.713213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a441501-0575-4214-9f60-777537099633 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:55.761839 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2598/5231] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:42:55.763010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a39e72-82b1-465e-9006-710c87c1f784 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:55.796791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a39e72-82b1-465e-9006-710c87c1f784 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:55.811036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce72e5-44b6-4f8f-b8ef-c2129adb693d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:55.812801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce72e5-44b6-4f8f-b8ef-c2129adb693d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:55.813081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce72e5-44b6-4f8f-b8ef-c2129adb693d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:55.813350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce72e5-44b6-4f8f-b8ef-c2129adb693d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:55.814085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce72e5-44b6-4f8f-b8ef-c2129adb693d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:55.815719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce72e5-44b6-4f8f-b8ef-c2129adb693d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:55.838426 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2634/5232] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:42:55.842703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a441501-0575-4214-9f60-777537099633 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:55.854345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a441501-0575-4214-9f60-777537099633 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:55.859366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a0f71-b67f-48b0-a151-6e749d20b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:55.860266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a0f71-b67f-48b0-a151-6e749d20b169 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:55.860548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a0f71-b67f-48b0-a151-6e749d20b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:55.860818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a0f71-b67f-48b0-a151-6e749d20b169 admin admin] PATH_INFO: `/v3/projects/6942248957b5434a9b7a5390907bad7f/users/30d51538460e4ddda97341ada99b30a0/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:55.866027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:55.890386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a0f71-b67f-48b0-a151-6e749d20b169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6942248957b5434a9b7a5390907bad7f, user_id=30d51538460e4ddda97341ada99b30a0, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:55.893724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a0f71-b67f-48b0-a151-6e749d20b169 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:55.911050 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2599/5233] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:42:55 2022] PUT /identity/v3/projects/6942248957b5434a9b7a5390907bad7f/users/30d51538460e4ddda97341ada99b30a0/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:55.931805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e100b-5266-4def-8d69-b75e3f9e5359 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:55.932830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e100b-5266-4def-8d69-b75e3f9e5359 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:55.936030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e100b-5266-4def-8d69-b75e3f9e5359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:55.995462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bb2e100b-5266-4def-8d69-b75e3f9e5359 None None] MFA Rules not processed for user `30d51538460e4ddda97341ada99b30a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:55.998556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bb2e100b-5266-4def-8d69-b75e3f9e5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:56.105268 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2635/5234] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:56.110771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a0f71-b67f-48b0-a151-6e749d20b169 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:56.230547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a0f71-b67f-48b0-a151-6e749d20b169 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:56.239905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5e005-b43c-47b1-84f9-ae76c3f8b66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:56.240562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5e005-b43c-47b1-84f9-ae76c3f8b66e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:56.240841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5e005-b43c-47b1-84f9-ae76c3f8b66e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:56.241106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5e005-b43c-47b1-84f9-ae76c3f8b66e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:56.241738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5e005-b43c-47b1-84f9-ae76c3f8b66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:56.246235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5e005-b43c-47b1-84f9-ae76c3f8b66e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:56.269746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e100b-5266-4def-8d69-b75e3f9e5359 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:56.273152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bb2e100b-5266-4def-8d69-b75e3f9e5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:56.290686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e100b-5266-4def-8d69-b75e3f9e5359 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:56.296045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:56.296959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:56.297499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:56.298065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] PATH_INFO: `/v3/projects/87ad1a938cbc4010a783fbe05a72a768` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:56.299557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ad1a938cbc4010a783fbe05a72a768)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:56.303184 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2600/5235] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:42:56 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:56.306469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:56.307857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5e005-b43c-47b1-84f9-ae76c3f8b66e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:56.400581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ad1a938cbc4010a783fbe05a72a768', 'request_id': 'req-255d7a73-60b5-4dfa-837a-ef144365b8f3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:56.411132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ad1a938cbc4010a783fbe05a72a768', 'request_id': 'req-255d7a73-60b5-4dfa-837a-ef144365b8f3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:56.423438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ad1a938cbc4010a783fbe05a72a768', 'request_id': 'req-255d7a73-60b5-4dfa-837a-ef144365b8f3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:56.425207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:56.452769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] The token cache is being invalidate because project 87ad1a938cbc4010a783fbe05a72a768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:42:56.453723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:56.455116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-255d7a73-60b5-4dfa-837a-ef144365b8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:56.458228 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2636/5236] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:42:56 2022] DELETE /identity/v3/projects/87ad1a938cbc4010a783fbe05a72a768 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:42:56.464639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56253351-2ba8-438c-bd05-61a73026dccd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:56.465252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56253351-2ba8-438c-bd05-61a73026dccd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:56.465690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56253351-2ba8-438c-bd05-61a73026dccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:56.482929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5e005-b43c-47b1-84f9-ae76c3f8b66e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:56.507946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-56253351-2ba8-438c-bd05-61a73026dccd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:56.512460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-56253351-2ba8-438c-bd05-61a73026dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:56.597983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b978c8-a980-464a-a4f6-63fabe429150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:56.598957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b978c8-a980-464a-a4f6-63fabe429150 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:56.599187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b978c8-a980-464a-a4f6-63fabe429150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:56.599456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b978c8-a980-464a-a4f6-63fabe429150 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:56.600365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b978c8-a980-464a-a4f6-63fabe429150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:56.602746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b978c8-a980-464a-a4f6-63fabe429150 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:56.635223 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2637/5237] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:56.635464 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2601/5238] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:42:56 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:56.635561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56253351-2ba8-438c-bd05-61a73026dccd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:56.637164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-56253351-2ba8-438c-bd05-61a73026dccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:56.644551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be83e6-a046-4d31-bf0f-600462813cec None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:56.644665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be83e6-a046-4d31-bf0f-600462813cec None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:56.645110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be83e6-a046-4d31-bf0f-600462813cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:56.651705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56253351-2ba8-438c-bd05-61a73026dccd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:56.657271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e41b99-cf4a-4ece-85c1-10aa8b853770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:56.657919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41b99-cf4a-4ece-85c1-10aa8b853770 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:56.658201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41b99-cf4a-4ece-85c1-10aa8b853770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:56.658469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e41b99-cf4a-4ece-85c1-10aa8b853770 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:56.659187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e41b99-cf4a-4ece-85c1-10aa8b853770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:56.661037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e41b99-cf4a-4ece-85c1-10aa8b853770 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:56.672009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:56.682905 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2638/5239] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:42:56.684294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e41b99-cf4a-4ece-85c1-10aa8b853770 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:56.694663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a4be83e6-a046-4d31-bf0f-600462813cec None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:56.696015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a4be83e6-a046-4d31-bf0f-600462813cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:56.700066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e41b99-cf4a-4ece-85c1-10aa8b853770 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:56.704891 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2602/5240] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:56.706324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c7313-cf85-4319-9415-d6d4ae8949a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:56.707462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c7313-cf85-4319-9415-d6d4ae8949a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:56.708851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c7313-cf85-4319-9415-d6d4ae8949a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:56.709581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c7313-cf85-4319-9415-d6d4ae8949a3 admin admin] PATH_INFO: `/v3/projects/32d2668ff54c4fa88405b619bd249074/users/a2cd398ec1f64589a98a4a476ff39b68/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:56.711173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be83e6-a046-4d31-bf0f-600462813cec None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:56.730032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be83e6-a046-4d31-bf0f-600462813cec None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:56.741343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dece547-1a3f-4d39-a1ae-9e740fbb25d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:56.742422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c7313-cf85-4319-9415-d6d4ae8949a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d2668ff54c4fa88405b619bd249074, user_id=a2cd398ec1f64589a98a4a476ff39b68, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:56.742907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dece547-1a3f-4d39-a1ae-9e740fbb25d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:56.744384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dece547-1a3f-4d39-a1ae-9e740fbb25d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:56.745583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dece547-1a3f-4d39-a1ae-9e740fbb25d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:56.747104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c7313-cf85-4319-9415-d6d4ae8949a3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:56.747893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dece547-1a3f-4d39-a1ae-9e740fbb25d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:42:56.749282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dece547-1a3f-4d39-a1ae-9e740fbb25d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:56.751467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dece547-1a3f-4d39-a1ae-9e740fbb25d9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:56.769984 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2639/5241] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:42:56 2022] PUT /identity/v3/projects/32d2668ff54c4fa88405b619bd249074/users/a2cd398ec1f64589a98a4a476ff39b68/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:56.772973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c7313-cf85-4319-9415-d6d4ae8949a3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:56.776339 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2603/5242] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:42:56.780700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dece547-1a3f-4d39-a1ae-9e740fbb25d9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:56.796501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dece547-1a3f-4d39-a1ae-9e740fbb25d9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:56.874494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea3ed9-7ff0-4177-a85f-e6deadff8136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:56.875519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea3ed9-7ff0-4177-a85f-e6deadff8136 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:56.875860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea3ed9-7ff0-4177-a85f-e6deadff8136 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:56.876195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea3ed9-7ff0-4177-a85f-e6deadff8136 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:56.877057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea3ed9-7ff0-4177-a85f-e6deadff8136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:56.879428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea3ed9-7ff0-4177-a85f-e6deadff8136 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:56.942278 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2604/5243] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:42:56 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:56.946749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c7313-cf85-4319-9415-d6d4ae8949a3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:56.948574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea3ed9-7ff0-4177-a85f-e6deadff8136 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:57.072408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260fd4c-20fa-4b63-9f0e-a7a4bc0e4c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:57.073091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260fd4c-20fa-4b63-9f0e-a7a4bc0e4c5b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.073396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260fd4c-20fa-4b63-9f0e-a7a4bc0e4c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.073686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260fd4c-20fa-4b63-9f0e-a7a4bc0e4c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:57.075189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260fd4c-20fa-4b63-9f0e-a7a4bc0e4c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:57.076993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260fd4c-20fa-4b63-9f0e-a7a4bc0e4c5b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:57.079727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:57.117382 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2640/5244] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:42:57.122809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260fd4c-20fa-4b63-9f0e-a7a4bc0e4c5b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:57.140790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea3ed9-7ff0-4177-a85f-e6deadff8136 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:57.145529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260fd4c-20fa-4b63-9f0e-a7a4bc0e4c5b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:57.175935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b88a-ae2f-477c-aeba-2694bc6d1fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:57.177201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b88a-ae2f-477c-aeba-2694bc6d1fac admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.177481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b88a-ae2f-477c-aeba-2694bc6d1fac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.179932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0b88a-ae2f-477c-aeba-2694bc6d1fac admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:57.180647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0b88a-ae2f-477c-aeba-2694bc6d1fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:57.182682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0b88a-ae2f-477c-aeba-2694bc6d1fac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:57.186083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2aa6dc-bf3e-477e-aa60-44b4489a746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:57.189607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aa6dc-bf3e-477e-aa60-44b4489a746e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.190096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aa6dc-bf3e-477e-aa60-44b4489a746e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.190368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2aa6dc-bf3e-477e-aa60-44b4489a746e admin admin] PATH_INFO: `/v3/projects/32d2668ff54c4fa88405b619bd249074/users/a2cd398ec1f64589a98a4a476ff39b68/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:57.197749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2aa6dc-bf3e-477e-aa60-44b4489a746e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d2668ff54c4fa88405b619bd249074, user_id=a2cd398ec1f64589a98a4a476ff39b68, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:57.209114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2aa6dc-bf3e-477e-aa60-44b4489a746e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:57.241776 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2605/5245] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:42:56 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:57.246192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b88a-ae2f-477c-aeba-2694bc6d1fac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:57.253909 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2641/5246] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:42:57 2022] PUT /identity/v3/projects/32d2668ff54c4fa88405b619bd249074/users/a2cd398ec1f64589a98a4a476ff39b68/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:57.268822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fc3ab-954e-4d73-9c73-d18f6dcdd95b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.270167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fc3ab-954e-4d73-9c73-d18f6dcdd95b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.270492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fc3ab-954e-4d73-9c73-d18f6dcdd95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:57.282613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0b88a-ae2f-477c-aeba-2694bc6d1fac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:57.312811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1f7fc3ab-954e-4d73-9c73-d18f6dcdd95b None None] MFA Rules not processed for user `a2cd398ec1f64589a98a4a476ff39b68`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:57.314138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1f7fc3ab-954e-4d73-9c73-d18f6dcdd95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:57.409017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741bc1-a1a0-43d8-ad15-09ac2a7d437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:57.409772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741bc1-a1a0-43d8-ad15-09ac2a7d437e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.409946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741bc1-a1a0-43d8-ad15-09ac2a7d437e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.410222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741bc1-a1a0-43d8-ad15-09ac2a7d437e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:57.410879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02741bc1-a1a0-43d8-ad15-09ac2a7d437e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:57.413091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02741bc1-a1a0-43d8-ad15-09ac2a7d437e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:57.417531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:57.437584 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2606/5247] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:42:57.439076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741bc1-a1a0-43d8-ad15-09ac2a7d437e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:57.448248 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2642/5248] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:42:57.453676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fc3ab-954e-4d73-9c73-d18f6dcdd95b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:57.469111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741bc1-a1a0-43d8-ad15-09ac2a7d437e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:57.477274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ef5dd-b25f-4a27-8b10-c4bd0b9e97b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:57.478012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ef5dd-b25f-4a27-8b10-c4bd0b9e97b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.478292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ef5dd-b25f-4a27-8b10-c4bd0b9e97b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.478565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ef5dd-b25f-4a27-8b10-c4bd0b9e97b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:57.479274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ef5dd-b25f-4a27-8b10-c4bd0b9e97b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:57.481631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ef5dd-b25f-4a27-8b10-c4bd0b9e97b9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:57.485382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fc3ab-954e-4d73-9c73-d18f6dcdd95b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:57.497052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b6a25-179b-4096-8a30-cdcdbf3eefce tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:57.497733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b6a25-179b-4096-8a30-cdcdbf3eefce tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.498048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b6a25-179b-4096-8a30-cdcdbf3eefce tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.498407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b6a25-179b-4096-8a30-cdcdbf3eefce tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:57.503781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b6a25-179b-4096-8a30-cdcdbf3eefce tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:57.506300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b6a25-179b-4096-8a30-cdcdbf3eefce tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:57.514647 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2607/5249] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:42:57.519232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ef5dd-b25f-4a27-8b10-c4bd0b9e97b9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:57.547899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ef5dd-b25f-4a27-8b10-c4bd0b9e97b9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:57.554748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f48e9-5045-4b76-810a-0bf5237046e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:57.555645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f48e9-5045-4b76-810a-0bf5237046e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.555926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f48e9-5045-4b76-810a-0bf5237046e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.556195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f48e9-5045-4b76-810a-0bf5237046e9 admin admin] PATH_INFO: `/v3/projects/09594194531c4575a42eedbe07da2f8a/users/b1a565919d144fd8acc1e1617af1f5ee/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:57.570114 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2643/5250] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:42:57 2022] POST /identity/v3/projects => generated 351 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:57.572242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b6a25-179b-4096-8a30-cdcdbf3eefce tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:57.579497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f48e9-5045-4b76-810a-0bf5237046e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09594194531c4575a42eedbe07da2f8a, user_id=b1a565919d144fd8acc1e1617af1f5ee, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:57.583308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f48e9-5045-4b76-810a-0bf5237046e9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:57.640380 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2608/5251] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:42:57 2022] PUT /identity/v3/projects/09594194531c4575a42eedbe07da2f8a/users/b1a565919d144fd8acc1e1617af1f5ee/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:57.652137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b3cd-e868-4353-b6b8-f9130785729d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.652137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b3cd-e868-4353-b6b8-f9130785729d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.652429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9b3cd-e868-4353-b6b8-f9130785729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:57.713577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-97c9b3cd-e868-4353-b6b8-f9130785729d None None] MFA Rules not processed for user `b1a565919d144fd8acc1e1617af1f5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:57.715928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-97c9b3cd-e868-4353-b6b8-f9130785729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:57.724784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b6a25-179b-4096-8a30-cdcdbf3eefce tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:57.795276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:57.809608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ce574-2320-40ce-965e-f56341e9c6a8 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:57.811034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ce574-2320-40ce-965e-f56341e9c6a8 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.812757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ce574-2320-40ce-965e-f56341e9c6a8 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.813309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ce574-2320-40ce-965e-f56341e9c6a8 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:57.814021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ce574-2320-40ce-965e-f56341e9c6a8 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:57.816178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ce574-2320-40ce-965e-f56341e9c6a8 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:57.816398 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2609/5252] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:42:57.852548 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2644/5253] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:42:57 2022] POST /identity/v3/projects => generated 350 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:57.856671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b3cd-e868-4353-b6b8-f9130785729d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:57.869142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9b3cd-e868-4353-b6b8-f9130785729d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:57.872524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ce574-2320-40ce-965e-f56341e9c6a8 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:57.874842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-546ce574-2320-40ce-965e-f56341e9c6a8 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:57.974652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ce574-2320-40ce-965e-f56341e9c6a8 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:57.980730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4a0c-7212-490c-9668-4fe8f2ece085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:57.982091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4a0c-7212-490c-9668-4fe8f2ece085 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:57.982405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4a0c-7212-490c-9668-4fe8f2ece085 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:57.982709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4a0c-7212-490c-9668-4fe8f2ece085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.011205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff5735-3158-4688-a922-de4265526d6d tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.012732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff5735-3158-4688-a922-de4265526d6d tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.012732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff5735-3158-4688-a922-de4265526d6d tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.022253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff5735-3158-4688-a922-de4265526d6d tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/users/30d51538460e4ddda97341ada99b30a0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.027504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff5735-3158-4688-a922-de4265526d6d tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:get_user(user_id=30d51538460e4ddda97341ada99b30a0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.029985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff5735-3158-4688-a922-de4265526d6d tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.034233 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2610/5254] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:42:57 2022] GET /identity/v3/users/30d51538460e4ddda97341ada99b30a0 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:42:58.039044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff5735-3158-4688-a922-de4265526d6d tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.057092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff5735-3158-4688-a922-de4265526d6d tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.062723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c485c1c-c457-4bd2-a49c-a9f962ceab3e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.064059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c485c1c-c457-4bd2-a49c-a9f962ceab3e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.064348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c485c1c-c457-4bd2-a49c-a9f962ceab3e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.064683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c485c1c-c457-4bd2-a49c-a9f962ceab3e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.066056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c485c1c-c457-4bd2-a49c-a9f962ceab3e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.068848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c485c1c-c457-4bd2-a49c-a9f962ceab3e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.158068 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2611/5255] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Aug 30 04:42:58 2022] POST /identity/v3/credentials => generated 429 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:58.159411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c485c1c-c457-4bd2-a49c-a9f962ceab3e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.184043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d4a0c-7212-490c-9668-4fe8f2ece085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.185840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d4a0c-7212-490c-9668-4fe8f2ece085 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.193423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c485c1c-c457-4bd2-a49c-a9f962ceab3e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.200545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89e598-7ead-48c6-8adc-df9af3e7d088 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.201706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89e598-7ead-48c6-8adc-df9af3e7d088 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.202410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89e598-7ead-48c6-8adc-df9af3e7d088 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.204379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89e598-7ead-48c6-8adc-df9af3e7d088 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/credentials/c5043a59d63b2a30932991e767fe3df2240a8b6bc0cb0d43fb16e55c74624593` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.207429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89e598-7ead-48c6-8adc-df9af3e7d088 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=c5043a59d63b2a30932991e767fe3df2240a8b6bc0cb0d43fb16e55c74624593)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.209886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89e598-7ead-48c6-8adc-df9af3e7d088 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.212912 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2645/5256] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:42:58.215128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89e598-7ead-48c6-8adc-df9af3e7d088 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=c5043a59d63b2a30932991e767fe3df2240a8b6bc0cb0d43fb16e55c74624593)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.218072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89e598-7ead-48c6-8adc-df9af3e7d088 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.245848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4a0c-7212-490c-9668-4fe8f2ece085 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.246372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2612/5257] 10.222.0.43 () {60 vars in 1358 bytes} [Tue Aug 30 04:42:58 2022] PATCH /identity/v3/credentials/c5043a59d63b2a30932991e767fe3df2240a8b6bc0cb0d43fb16e55c74624593 => generated 436 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:42:58.263746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4a0c-7212-490c-9668-4fe8f2ece085 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.274502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38db79-7692-443e-b165-8a6ed277bc9e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.277168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38db79-7692-443e-b165-8a6ed277bc9e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.277567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38db79-7692-443e-b165-8a6ed277bc9e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.277762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38db79-7692-443e-b165-8a6ed277bc9e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/credentials/c5043a59d63b2a30932991e767fe3df2240a8b6bc0cb0d43fb16e55c74624593` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.282816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38db79-7692-443e-b165-8a6ed277bc9e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=c5043a59d63b2a30932991e767fe3df2240a8b6bc0cb0d43fb16e55c74624593)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.292169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89e598-7ead-48c6-8adc-df9af3e7d088 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.294071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38db79-7692-443e-b165-8a6ed277bc9e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.307051 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2646/5258] 10.222.0.43 () {58 vars in 1335 bytes} [Tue Aug 30 04:42:58 2022] GET /identity/v3/credentials/c5043a59d63b2a30932991e767fe3df2240a8b6bc0cb0d43fb16e55c74624593 => generated 436 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:42:58.308024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38db79-7692-443e-b165-8a6ed277bc9e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.333313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38db79-7692-443e-b165-8a6ed277bc9e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.346827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0e37-39a1-46c2-826c-90814ba70889 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.347488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0e37-39a1-46c2-826c-90814ba70889 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.347767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0e37-39a1-46c2-826c-90814ba70889 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.348042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f0e37-39a1-46c2-826c-90814ba70889 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/credentials/c5043a59d63b2a30932991e767fe3df2240a8b6bc0cb0d43fb16e55c74624593` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.351383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f0e37-39a1-46c2-826c-90814ba70889 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=c5043a59d63b2a30932991e767fe3df2240a8b6bc0cb0d43fb16e55c74624593)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.353383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f0e37-39a1-46c2-826c-90814ba70889 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.366787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:58.394311 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2647/5259] 10.222.0.43 () {58 vars in 1338 bytes} [Tue Aug 30 04:42:58 2022] DELETE /identity/v3/credentials/c5043a59d63b2a30932991e767fe3df2240a8b6bc0cb0d43fb16e55c74624593 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:58.403182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0e37-39a1-46c2-826c-90814ba70889 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.422672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f0e37-39a1-46c2-826c-90814ba70889 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.424570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89e598-7ead-48c6-8adc-df9af3e7d088 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.431562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.432315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.433015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.433505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] PATH_INFO: `/v3/users/b1a565919d144fd8acc1e1617af1f5ee` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.434427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b333a-ec45-4e8e-8383-0faa6f8d0c3b tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.435117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b333a-ec45-4e8e-8383-0faa6f8d0c3b tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.435323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a565919d144fd8acc1e1617af1f5ee)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.435441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b333a-ec45-4e8e-8383-0faa6f8d0c3b tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.435661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b333a-ec45-4e8e-8383-0faa6f8d0c3b tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.436319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b333a-ec45-4e8e-8383-0faa6f8d0c3b tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.437575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.438135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b333a-ec45-4e8e-8383-0faa6f8d0c3b tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.481666 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2648/5260] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Aug 30 04:42:58 2022] POST /identity/v3/credentials => generated 429 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:58.486492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b333a-ec45-4e8e-8383-0faa6f8d0c3b tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.519612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b333a-ec45-4e8e-8383-0faa6f8d0c3b tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.535429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a565919d144fd8acc1e1617af1f5ee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:58.536786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e2c93-ed02-4ea0-8fb7-b1f87444c7a0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.538286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e2c93-ed02-4ea0-8fb7-b1f87444c7a0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.538286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e2c93-ed02-4ea0-8fb7-b1f87444c7a0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.538286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e2c93-ed02-4ea0-8fb7-b1f87444c7a0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.540137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e2c93-ed02-4ea0-8fb7-b1f87444c7a0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.542650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e2c93-ed02-4ea0-8fb7-b1f87444c7a0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.552092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a565919d144fd8acc1e1617af1f5ee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:58.580262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a565919d144fd8acc1e1617af1f5ee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:58.581401 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2649/5261] 10.222.0.43 () {60 vars in 1162 bytes} [Tue Aug 30 04:42:58 2022] POST /identity/v3/credentials => generated 430 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:42:58.582575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e2c93-ed02-4ea0-8fb7-b1f87444c7a0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.597015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a565919d144fd8acc1e1617af1f5ee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:58.598507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e2c93-ed02-4ea0-8fb7-b1f87444c7a0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.598967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c34ebb59-6ed7-495b-a62b-2ad8f2f3d050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a565919d144fd8acc1e1617af1f5ee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:58.611870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.613566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.613774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.619195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.619430 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2613/5262] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:42:58 2022] DELETE /identity/v3/users/b1a565919d144fd8acc1e1617af1f5ee => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:58.621170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.624283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e03784-ff77-41b4-8a26-58abfb0193a7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.624283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e03784-ff77-41b4-8a26-58abfb0193a7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.625427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e03784-ff77-41b4-8a26-58abfb0193a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.626171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.653438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.659120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.664794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.667115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.673732 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2650/5263] 10.222.0.43 () {58 vars in 1140 bytes} [Tue Aug 30 04:42:58 2022] GET /identity/v3/credentials => generated 944 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:42:58.680939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.683024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:58.703311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-75e03784-ff77-41b4-8a26-58abfb0193a7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:42:58.709048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c906060-aa6d-43cf-9cff-039e2a278b14 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.709512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-75e03784-ff77-41b4-8a26-58abfb0193a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:58.826286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:58.836376 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2614/5264] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:42:58.854166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e03784-ff77-41b4-8a26-58abfb0193a7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.856713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-75e03784-ff77-41b4-8a26-58abfb0193a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:58.877834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec113f-617f-4b98-93fa-51cd3371cb6e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.879497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec113f-617f-4b98-93fa-51cd3371cb6e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.880886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec113f-617f-4b98-93fa-51cd3371cb6e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.881163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec113f-617f-4b98-93fa-51cd3371cb6e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/credentials/54b010c8ea10a896ec956b777069b27dff46c79a85abd74b4ec4c6a4a1f10b32` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.889133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec113f-617f-4b98-93fa-51cd3371cb6e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=54b010c8ea10a896ec956b777069b27dff46c79a85abd74b4ec4c6a4a1f10b32)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.891563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec113f-617f-4b98-93fa-51cd3371cb6e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.937188 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2651/5265] 10.222.0.43 () {58 vars in 1338 bytes} [Tue Aug 30 04:42:58 2022] DELETE /identity/v3/credentials/54b010c8ea10a896ec956b777069b27dff46c79a85abd74b4ec4c6a4a1f10b32 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:58.938374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec113f-617f-4b98-93fa-51cd3371cb6e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:58.951435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec113f-617f-4b98-93fa-51cd3371cb6e tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.957143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04724e79-c90b-4d77-8d30-27d5ccfe7524 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.958059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04724e79-c90b-4d77-8d30-27d5ccfe7524 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.958337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04724e79-c90b-4d77-8d30-27d5ccfe7524 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.958608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04724e79-c90b-4d77-8d30-27d5ccfe7524 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/credentials/7b27fe1574996469032edf4ee638d14ee88cf8a21cea5191f5d8a416d6732339` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.965534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04724e79-c90b-4d77-8d30-27d5ccfe7524 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=7b27fe1574996469032edf4ee638d14ee88cf8a21cea5191f5d8a416d6732339)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:58.969677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04724e79-c90b-4d77-8d30-27d5ccfe7524 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:58.970955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e03784-ff77-41b4-8a26-58abfb0193a7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:58.975349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1002a0-c7c1-4e4e-ae19-81b5071cca72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:58.976513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1002a0-c7c1-4e4e-ae19-81b5071cca72 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:58.977062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1002a0-c7c1-4e4e-ae19-81b5071cca72 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:58.977600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1002a0-c7c1-4e4e-ae19-81b5071cca72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:58.985504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:58.997149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1002a0-c7c1-4e4e-ae19-81b5071cca72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:59.000650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1002a0-c7c1-4e4e-ae19-81b5071cca72 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:59.016589 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2615/5266] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:42:59.022069 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2652/5267] 10.222.0.43 () {58 vars in 1338 bytes} [Tue Aug 30 04:42:58 2022] DELETE /identity/v3/credentials/7b27fe1574996469032edf4ee638d14ee88cf8a21cea5191f5d8a416d6732339 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:59.022700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1002a0-c7c1-4e4e-ae19-81b5071cca72 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:59.040719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1002a0-c7c1-4e4e-ae19-81b5071cca72 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:59.050038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:59.051308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:59.052473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:59.052860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/projects/b7c4160991784a7db480b84a0738597a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:59.055240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7c4160991784a7db480b84a0738597a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:59.057247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:59.159069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c4160991784a7db480b84a0738597a', 'request_id': 'req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:59.174885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c4160991784a7db480b84a0738597a', 'request_id': 'req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:59.187675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c4160991784a7db480b84a0738597a', 'request_id': 'req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:59.221175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] The token cache is being invalidate because project b7c4160991784a7db480b84a0738597a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:42:59.221919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:59.229933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:59.232214 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2616/5268] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:42:59 2022] DELETE /identity/v3/projects/b7c4160991784a7db480b84a0738597a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:59.236584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04724e79-c90b-4d77-8d30-27d5ccfe7524 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:59.238585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-04724e79-c90b-4d77-8d30-27d5ccfe7524 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:59.270796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04724e79-c90b-4d77-8d30-27d5ccfe7524 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:59.406305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2cd398ec1f64589a98a4a476ff39b68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32d2668ff54c4fa88405b619bd249074', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:59.408399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:59.408868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:59.409388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] PATH_INFO: `/v3/projects/47e542564ffa470a8d4234d8a1d90b82` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:59.425755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorizing `identity:delete_project(project_id=47e542564ffa470a8d4234d8a1d90b82)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:59.430111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:42:59.570857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e542564ffa470a8d4234d8a1d90b82', 'request_id': 'req-967619c1-23aa-46af-9d0e-1198aedfbad2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:59.583931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e542564ffa470a8d4234d8a1d90b82', 'request_id': 'req-967619c1-23aa-46af-9d0e-1198aedfbad2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:59.601755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e542564ffa470a8d4234d8a1d90b82', 'request_id': 'req-967619c1-23aa-46af-9d0e-1198aedfbad2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:59.642708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] The token cache is being invalidate because project 47e542564ffa470a8d4234d8a1d90b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:42:59.643953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:59.645228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-967619c1-23aa-46af-9d0e-1198aedfbad2 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:42:59.650830 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2653/5269] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:42:59 2022] DELETE /identity/v3/projects/47e542564ffa470a8d4234d8a1d90b82 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:42:59.651573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:42:59.654913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:42:59.837418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400ccaf-23c6-40e1-9346-b243c6a2f2b0 tempest-CredentialsTestJSON-123936473 tempest-CredentialsTestJSON-123936473-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:42:59.960626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:42:59.961978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:42:59.962786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:42:59.962786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] PATH_INFO: `/v3/users/30d51538460e4ddda97341ada99b30a0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:42:59.964195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d51538460e4ddda97341ada99b30a0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:42:59.966780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:00.016404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:00.073760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d51538460e4ddda97341ada99b30a0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:00.114743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d51538460e4ddda97341ada99b30a0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:00.174007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d51538460e4ddda97341ada99b30a0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:00.204453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d51538460e4ddda97341ada99b30a0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:00.206140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d51538460e4ddda97341ada99b30a0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:00.221823 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2617/5270] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:42:59 2022] DELETE /identity/v3/users/30d51538460e4ddda97341ada99b30a0 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:00.227039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d714d-2704-433d-8ac4-49caac1dc45a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:00.227612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d714d-2704-433d-8ac4-49caac1dc45a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:00.227813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d714d-2704-433d-8ac4-49caac1dc45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:00.277815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b27d714d-2704-433d-8ac4-49caac1dc45a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:00.278634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b27d714d-2704-433d-8ac4-49caac1dc45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:00.299748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:00.302950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:00.432687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:00.460648 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2654/5271] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:00.513273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d714d-2704-433d-8ac4-49caac1dc45a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:00.516301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b27d714d-2704-433d-8ac4-49caac1dc45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:00.539526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33c33d-fc92-47d2-baad-7860271b024a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:00.553525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:00.554146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:00.554423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:00.554796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] PATH_INFO: `/v3/projects/09594194531c4575a42eedbe07da2f8a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:00.557763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=09594194531c4575a42eedbe07da2f8a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:00.560068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:00.725730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d714d-2704-433d-8ac4-49caac1dc45a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:00.739697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09594194531c4575a42eedbe07da2f8a', 'request_id': 'req-9580cac9-d918-4250-8733-d866efedf72e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:00.757393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09594194531c4575a42eedbe07da2f8a', 'request_id': 'req-9580cac9-d918-4250-8733-d866efedf72e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:00.772753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09594194531c4575a42eedbe07da2f8a', 'request_id': 'req-9580cac9-d918-4250-8733-d866efedf72e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:00.805704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] The token cache is being invalidate because project 09594194531c4575a42eedbe07da2f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:00.806063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:00.812738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9580cac9-d918-4250-8733-d866efedf72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:00.818237 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2618/5272] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:00 2022] DELETE /identity/v3/projects/09594194531c4575a42eedbe07da2f8a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:00.820989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef58c77-8b09-46cd-b37c-ebdf9de5b2fa None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:00.821312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef58c77-8b09-46cd-b37c-ebdf9de5b2fa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:00.821532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef58c77-8b09-46cd-b37c-ebdf9de5b2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:00.855157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bef58c77-8b09-46cd-b37c-ebdf9de5b2fa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:00.869147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bef58c77-8b09-46cd-b37c-ebdf9de5b2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:00.874715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d24bf-fc61-4264-b039-18c16b90a4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:00.875286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d24bf-fc61-4264-b039-18c16b90a4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:00.875567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d24bf-fc61-4264-b039-18c16b90a4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:00.875836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d24bf-fc61-4264-b039-18c16b90a4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:00.887985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ec6d24bf-fc61-4264-b039-18c16b90a4f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:00.927139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:00.997567 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2619/5273] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:00.999245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518456b-7ab5-4e42-8636-1ee7c9e2ca36 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:00.999537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518456b-7ab5-4e42-8636-1ee7c9e2ca36 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:00.999811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518456b-7ab5-4e42-8636-1ee7c9e2ca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:01.051667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9518456b-7ab5-4e42-8636-1ee7c9e2ca36 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:01.053152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9518456b-7ab5-4e42-8636-1ee7c9e2ca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:01.084218 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2620/5274] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:01.086520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d24bf-fc61-4264-b039-18c16b90a4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:01.088260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d24bf-fc61-4264-b039-18c16b90a4f6 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:01.089228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518456b-7ab5-4e42-8636-1ee7c9e2ca36 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:01.109612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518456b-7ab5-4e42-8636-1ee7c9e2ca36 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:01.111865 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2655/5275] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:43:01.126679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da282b8-c4ed-4831-b01c-3d3ad1c8ac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:01.127284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da282b8-c4ed-4831-b01c-3d3ad1c8ac2e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:01.127565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da282b8-c4ed-4831-b01c-3d3ad1c8ac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:01.127836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da282b8-c4ed-4831-b01c-3d3ad1c8ac2e admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:01.128506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da282b8-c4ed-4831-b01c-3d3ad1c8ac2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:01.128807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da282b8-c4ed-4831-b01c-3d3ad1c8ac2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:01.135201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da282b8-c4ed-4831-b01c-3d3ad1c8ac2e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:01.177073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d24bf-fc61-4264-b039-18c16b90a4f6 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:01.177437 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2621/5276] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:01.198308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d24bf-fc61-4264-b039-18c16b90a4f6 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:01.207818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f52f4-547e-464f-8fd7-8d9f04280a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:01.208461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f52f4-547e-464f-8fd7-8d9f04280a33 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:01.208729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f52f4-547e-464f-8fd7-8d9f04280a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:01.208994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f52f4-547e-464f-8fd7-8d9f04280a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:01.209640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f52f4-547e-464f-8fd7-8d9f04280a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:01.211942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f52f4-547e-464f-8fd7-8d9f04280a33 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:01.288304 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2656/5277] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:01 2022] POST /identity/v3/projects => generated 361 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:43:01.293568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da282b8-c4ed-4831-b01c-3d3ad1c8ac2e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:01.311869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da282b8-c4ed-4831-b01c-3d3ad1c8ac2e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:01.454377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187782-2766-4477-b6ec-299690ea5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:01.455097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187782-2766-4477-b6ec-299690ea5884 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:01.464446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187782-2766-4477-b6ec-299690ea5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:01.465696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd187782-2766-4477-b6ec-299690ea5884 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:01.466526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd187782-2766-4477-b6ec-299690ea5884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:01.468616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd187782-2766-4477-b6ec-299690ea5884 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:01.513273 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2622/5278] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:01 2022] POST /identity/v3/users => generated 281 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:01.514311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f52f4-547e-464f-8fd7-8d9f04280a33 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:01.527766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f52f4-547e-464f-8fd7-8d9f04280a33 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:01.548700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e89ac6-9b0d-4cb7-9921-4357e51a5379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:01.549157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e89ac6-9b0d-4cb7-9921-4357e51a5379 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:01.549430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e89ac6-9b0d-4cb7-9921-4357e51a5379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:01.549798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e89ac6-9b0d-4cb7-9921-4357e51a5379 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:01.550436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e89ac6-9b0d-4cb7-9921-4357e51a5379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:01.552090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e89ac6-9b0d-4cb7-9921-4357e51a5379 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:01.600498 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2657/5279] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:01.601982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187782-2766-4477-b6ec-299690ea5884 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:01.652628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd187782-2766-4477-b6ec-299690ea5884 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:01.674090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e7af-044c-41c1-82f5-048074502a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:01.674887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e7af-044c-41c1-82f5-048074502a46 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:01.684925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e7af-044c-41c1-82f5-048074502a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:01.685497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e7af-044c-41c1-82f5-048074502a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:01.686395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e7af-044c-41c1-82f5-048074502a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:01.689790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e7af-044c-41c1-82f5-048074502a46 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:01.743395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e89ac6-9b0d-4cb7-9921-4357e51a5379 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:01.744196 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2623/5280] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:01.764076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e89ac6-9b0d-4cb7-9921-4357e51a5379 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:01.775999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985367-f33f-4573-9439-b36399246c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:01.776691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985367-f33f-4573-9439-b36399246c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:01.776966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985367-f33f-4573-9439-b36399246c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:01.777233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7985367-f33f-4573-9439-b36399246c0c admin admin] PATH_INFO: `/v3/projects/3efc53ea7b4647c9b10504453c064683/users/98f67d6dc43346b886ab9ce97d017eb1/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:01.806078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7985367-f33f-4573-9439-b36399246c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efc53ea7b4647c9b10504453c064683, user_id=98f67d6dc43346b886ab9ce97d017eb1, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:01.808688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7985367-f33f-4573-9439-b36399246c0c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:01.815193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:01.857111 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2658/5281] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:01 2022] PUT /identity/v3/projects/3efc53ea7b4647c9b10504453c064683/users/98f67d6dc43346b886ab9ce97d017eb1/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:01.862640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e16f9-a635-4e34-93f5-8256efa52864 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:01.863581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e16f9-a635-4e34-93f5-8256efa52864 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:01.864143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e16f9-a635-4e34-93f5-8256efa52864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:01.905397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d46e16f9-a635-4e34-93f5-8256efa52864 None None] MFA Rules not processed for user `98f67d6dc43346b886ab9ce97d017eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:01.906839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d46e16f9-a635-4e34-93f5-8256efa52864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:02.039681 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2624/5282] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:02.091522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985367-f33f-4573-9439-b36399246c0c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:02.094549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a7985367-f33f-4573-9439-b36399246c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:02.246651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7985367-f33f-4573-9439-b36399246c0c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:02.252953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37954f87-70c3-481e-99bc-a525e41e30e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:02.253721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954f87-70c3-481e-99bc-a525e41e30e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:02.254332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954f87-70c3-481e-99bc-a525e41e30e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:02.254652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37954f87-70c3-481e-99bc-a525e41e30e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:02.267956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37954f87-70c3-481e-99bc-a525e41e30e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:02.270062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37954f87-70c3-481e-99bc-a525e41e30e2 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:02.285093 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2659/5283] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:02.916370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e16f9-a635-4e34-93f5-8256efa52864 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:02.918784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d46e16f9-a635-4e34-93f5-8256efa52864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:02.972214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:03.037770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e16f9-a635-4e34-93f5-8256efa52864 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:03.046331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:03.047271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:03.047571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:03.047987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] PATH_INFO: `/v3/projects/6942248957b5434a9b7a5390907bad7f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:03.049525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6942248957b5434a9b7a5390907bad7f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:03.052428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:03.096466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37954f87-70c3-481e-99bc-a525e41e30e2 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:03.097537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-37954f87-70c3-481e-99bc-a525e41e30e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:03.122892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37954f87-70c3-481e-99bc-a525e41e30e2 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:03.134360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:03.135021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:03.135294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:03.135562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] PATH_INFO: `/v3/users/fb799d2ce6774b86bdcf0623d9bd4201` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:03.140022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb799d2ce6774b86bdcf0623d9bd4201)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:03.146807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:03.167601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6942248957b5434a9b7a5390907bad7f', 'request_id': 'req-659e6b98-7ad7-464e-b829-f6d4d6712e68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.194398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6942248957b5434a9b7a5390907bad7f', 'request_id': 'req-659e6b98-7ad7-464e-b829-f6d4d6712e68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.204209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6942248957b5434a9b7a5390907bad7f', 'request_id': 'req-659e6b98-7ad7-464e-b829-f6d4d6712e68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.230716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] The token cache is being invalidate because project 6942248957b5434a9b7a5390907bad7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:03.231173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.236750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.245123 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2625/5284] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:02 2022] DELETE /identity/v3/projects/6942248957b5434a9b7a5390907bad7f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:03.248108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:03.250590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:03.270200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb799d2ce6774b86bdcf0623d9bd4201'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.273246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb799d2ce6774b86bdcf0623d9bd4201'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.291598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb799d2ce6774b86bdcf0623d9bd4201'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.307539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb799d2ce6774b86bdcf0623d9bd4201'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.339422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb799d2ce6774b86bdcf0623d9bd4201'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.360349 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2660/5285] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:03 2022] DELETE /identity/v3/users/fb799d2ce6774b86bdcf0623d9bd4201 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:03.406725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e6b98-7ad7-464e-b829-f6d4d6712e68 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:03.492991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:03.495218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:03.495842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:03.496430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] PATH_INFO: `/v3/users/a2cd398ec1f64589a98a4a476ff39b68` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:03.498045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2cd398ec1f64589a98a4a476ff39b68)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:03.501378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:03.510168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:03.618936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2cd398ec1f64589a98a4a476ff39b68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.629275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2cd398ec1f64589a98a4a476ff39b68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.666225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2cd398ec1f64589a98a4a476ff39b68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.683572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2cd398ec1f64589a98a4a476ff39b68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.687584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2cd398ec1f64589a98a4a476ff39b68'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:03.698615 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2626/5286] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:03 2022] DELETE /identity/v3/users/a2cd398ec1f64589a98a4a476ff39b68 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:03.946796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:03.948618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:04.004786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a92b7b-aec1-4730-bd9e-a71ac8b38c73 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:04.160796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:04.162098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:04.164765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:04.165324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] PATH_INFO: `/v3/projects/8319481fb6f74c74b6a847e497d783ce` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:04.166917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8319481fb6f74c74b6a847e497d783ce)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:04.170351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:04.196446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:04.260446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8319481fb6f74c74b6a847e497d783ce', 'request_id': 'req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:04.270767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8319481fb6f74c74b6a847e497d783ce', 'request_id': 'req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:04.285828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8319481fb6f74c74b6a847e497d783ce', 'request_id': 'req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:04.334776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] The token cache is being invalidate because project 8319481fb6f74c74b6a847e497d783ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:04.340198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:04.341387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:04.348073 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2661/5287] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:03 2022] DELETE /identity/v3/projects/8319481fb6f74c74b6a847e497d783ce => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:04.352373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:04.355184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:04.376635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf205f5-c1ad-44bb-8888-5413074f8e62 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:04.498179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:04.498853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:04.499130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:04.499399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] PATH_INFO: `/v3/users/91926a53d7bf4954b85bc15a5fb16852` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:04.500753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91926a53d7bf4954b85bc15a5fb16852)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:04.502765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:04.592865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91926a53d7bf4954b85bc15a5fb16852'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:04.615834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91926a53d7bf4954b85bc15a5fb16852'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:04.644254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91926a53d7bf4954b85bc15a5fb16852'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:04.659593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91926a53d7bf4954b85bc15a5fb16852'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:04.661233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f4b8ccb7-1df0-42b3-9dc7-ee55755fe275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91926a53d7bf4954b85bc15a5fb16852'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:04.665953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:04.680993 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2627/5288] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:04 2022] DELETE /identity/v3/users/91926a53d7bf4954b85bc15a5fb16852 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:05.050864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:05.052965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:05.078250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbbe77-2afb-4a7c-aab1-b94a85a64b28 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:05.189587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:05.189587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:05.190425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:05.190425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] PATH_INFO: `/v3/projects/0c6e3a3e3d4d4e2dbd6993b4d64cac77` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:05.202448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6e3a3e3d4d4e2dbd6993b4d64cac77)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:05.204483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:05.276998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6e3a3e3d4d4e2dbd6993b4d64cac77', 'request_id': 'req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:05.285382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6e3a3e3d4d4e2dbd6993b4d64cac77', 'request_id': 'req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:05.299223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6e3a3e3d4d4e2dbd6993b4d64cac77', 'request_id': 'req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:05.316581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] The token cache is being invalidate because project 0c6e3a3e3d4d4e2dbd6993b4d64cac77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:05.317487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:05.318527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:05.324075 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2662/5289] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:05 2022] DELETE /identity/v3/projects/0c6e3a3e3d4d4e2dbd6993b4d64cac77 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:05.325741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec20058-faa1-40ee-8beb-40a3b74816f7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:05.326058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec20058-faa1-40ee-8beb-40a3b74816f7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:05.326330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec20058-faa1-40ee-8beb-40a3b74816f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:05.364635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6ec20058-faa1-40ee-8beb-40a3b74816f7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:05.367494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6ec20058-faa1-40ee-8beb-40a3b74816f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:05.478260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:05.480449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:05.530123 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2628/5290] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:05.531744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae75855-4176-4d5d-a7ed-cf1fe5ecf92e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:05.532129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae75855-4176-4d5d-a7ed-cf1fe5ecf92e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:05.532495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae75855-4176-4d5d-a7ed-cf1fe5ecf92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:05.572645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4ae75855-4176-4d5d-a7ed-cf1fe5ecf92e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:05.575391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4ae75855-4176-4d5d-a7ed-cf1fe5ecf92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:05.576514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:05.596571 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2629/5291] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:05.602857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae75855-4176-4d5d-a7ed-cf1fe5ecf92e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:05.630684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae75855-4176-4d5d-a7ed-cf1fe5ecf92e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:05.650944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dbaeb-eeef-464f-a344-b060c7944025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:05.652674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dbaeb-eeef-464f-a344-b060c7944025 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:05.653614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dbaeb-eeef-464f-a344-b060c7944025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:05.653942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dbaeb-eeef-464f-a344-b060c7944025 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:05.655352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dbaeb-eeef-464f-a344-b060c7944025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:05.656121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dbaeb-eeef-464f-a344-b060c7944025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:05.658446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1dbaeb-eeef-464f-a344-b060c7944025 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:05.688605 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2630/5292] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:05.690961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58b0e9-aafe-492f-b2b6-e071b0eb6377 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:05.693094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dbaeb-eeef-464f-a344-b060c7944025 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:05.701111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:05.701859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:05.702173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:05.702445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] PATH_INFO: `/v3/projects/32d2668ff54c4fa88405b619bd249074` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:05.703496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dbaeb-eeef-464f-a344-b060c7944025 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:05.705455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d2668ff54c4fa88405b619bd249074)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:05.707480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:05.711685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3c273-4762-41fd-a812-49b337a07147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:05.712549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3c273-4762-41fd-a812-49b337a07147 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:05.712824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3c273-4762-41fd-a812-49b337a07147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:05.713091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3c273-4762-41fd-a812-49b337a07147 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:05.713737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3c273-4762-41fd-a812-49b337a07147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:05.718981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3c273-4762-41fd-a812-49b337a07147 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:05.779825 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2631/5293] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:05 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:05.779825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3c273-4762-41fd-a812-49b337a07147 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:05.785700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9ee3c273-4762-41fd-a812-49b337a07147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:05.817121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d2668ff54c4fa88405b619bd249074', 'request_id': 'req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:05.832909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d2668ff54c4fa88405b619bd249074', 'request_id': 'req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:05.851440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d2668ff54c4fa88405b619bd249074', 'request_id': 'req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:05.880186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] The token cache is being invalidate because project 32d2668ff54c4fa88405b619bd249074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:05.880665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:05.882340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:05.885347 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2663/5294] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:05 2022] DELETE /identity/v3/projects/32d2668ff54c4fa88405b619bd249074 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:05.886663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:05.894025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:05.960220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3c273-4762-41fd-a812-49b337a07147 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:05.973617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29bda4-97ee-4af7-9e2f-73692c5c90f1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:05.979453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a5860-8ca8-485e-b4d2-adf9b4a7a6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:05.980284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a5860-8ca8-485e-b4d2-adf9b4a7a6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:05.980838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a5860-8ca8-485e-b4d2-adf9b4a7a6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:05.981239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a5860-8ca8-485e-b4d2-adf9b4a7a6f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:05.982039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a5860-8ca8-485e-b4d2-adf9b4a7a6f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:05.984349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a5860-8ca8-485e-b4d2-adf9b4a7a6f6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.014796 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2664/5295] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:05 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:06.016816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13348-bc44-4338-b37c-a028c2f33bf5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.017189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13348-bc44-4338-b37c-a028c2f33bf5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.017558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae13348-bc44-4338-b37c-a028c2f33bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.045546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7ae13348-bc44-4338-b37c-a028c2f33bf5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:06.047331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7ae13348-bc44-4338-b37c-a028c2f33bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:06.057263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.064990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.065392 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2665/5296] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:06.065392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae13348-bc44-4338-b37c-a028c2f33bf5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.067114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.067556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] PATH_INFO: `/v3/users/110d3c39e91b4281a1fd5d881b8beeef` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.069441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=110d3c39e91b4281a1fd5d881b8beeef)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.073259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.075087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae13348-bc44-4338-b37c-a028c2f33bf5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.082784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:06.083011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9188d-db90-4751-8a05-9c5ea5737d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.084505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9188d-db90-4751-8a05-9c5ea5737d3c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.084855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9188d-db90-4751-8a05-9c5ea5737d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.085350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9188d-db90-4751-8a05-9c5ea5737d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.086847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9188d-db90-4751-8a05-9c5ea5737d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.091295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9188d-db90-4751-8a05-9c5ea5737d3c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.109564 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2666/5297] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:06.115171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e69d-b0e6-4441-9d1d-aecd6d29cef8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.115518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e69d-b0e6-4441-9d1d-aecd6d29cef8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.116007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff15e69d-b0e6-4441-9d1d-aecd6d29cef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.161626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ff15e69d-b0e6-4441-9d1d-aecd6d29cef8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:06.163149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ff15e69d-b0e6-4441-9d1d-aecd6d29cef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:06.178614 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2667/5298] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:06.180334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15e69d-b0e6-4441-9d1d-aecd6d29cef8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.186945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110d3c39e91b4281a1fd5d881b8beeef'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:06.205823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110d3c39e91b4281a1fd5d881b8beeef'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:06.207728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff15e69d-b0e6-4441-9d1d-aecd6d29cef8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.216266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb46c8-8112-4b2f-b0a9-6960876772b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.216843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb46c8-8112-4b2f-b0a9-6960876772b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.217119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb46c8-8112-4b2f-b0a9-6960876772b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.217393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb46c8-8112-4b2f-b0a9-6960876772b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.218848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb46c8-8112-4b2f-b0a9-6960876772b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.220515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb46c8-8112-4b2f-b0a9-6960876772b4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.225581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110d3c39e91b4281a1fd5d881b8beeef'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:06.235311 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2668/5299] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:06.239570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb46c8-8112-4b2f-b0a9-6960876772b4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.242926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110d3c39e91b4281a1fd5d881b8beeef'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:06.244105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110d3c39e91b4281a1fd5d881b8beeef'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:06.257487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb46c8-8112-4b2f-b0a9-6960876772b4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.262299 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2632/5300] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:05 2022] DELETE /identity/v3/users/110d3c39e91b4281a1fd5d881b8beeef => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:06.266834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.268661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:06.269544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d6540-b131-4db3-a5ac-d2aaa31024c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.270416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d6540-b131-4db3-a5ac-d2aaa31024c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.270908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d6540-b131-4db3-a5ac-d2aaa31024c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.271422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d6540-b131-4db3-a5ac-d2aaa31024c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.272689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d6540-b131-4db3-a5ac-d2aaa31024c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:06.274061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d6540-b131-4db3-a5ac-d2aaa31024c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.278335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d6540-b131-4db3-a5ac-d2aaa31024c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.305514 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2669/5301] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:06.305514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb216519-c759-417c-9869-f9092f4e0f10 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.305514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb216519-c759-417c-9869-f9092f4e0f10 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.305514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb216519-c759-417c-9869-f9092f4e0f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.311881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:06.332863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cb216519-c759-417c-9869-f9092f4e0f10 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:06.334134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cb216519-c759-417c-9869-f9092f4e0f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:06.382384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455164c-ecb1-4317-a615-7756a6367f55 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.392784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcafa96-d11d-4738-8815-05bfff53c96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.393559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcafa96-d11d-4738-8815-05bfff53c96d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.393838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcafa96-d11d-4738-8815-05bfff53c96d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.395231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcafa96-d11d-4738-8815-05bfff53c96d admin admin] PATH_INFO: `/v3/projects/af9a114cb126470a9fff3b2f6d3b16ba/users/59d8cb24df474f7784ba375e9688ec02/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.422346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcafa96-d11d-4738-8815-05bfff53c96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9a114cb126470a9fff3b2f6d3b16ba, user_id=59d8cb24df474f7784ba375e9688ec02, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.425213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcafa96-d11d-4738-8815-05bfff53c96d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.451106 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2633/5302] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:06 2022] PUT /identity/v3/projects/af9a114cb126470a9fff3b2f6d3b16ba/users/59d8cb24df474f7784ba375e9688ec02/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:06.451106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcafa96-d11d-4738-8815-05bfff53c96d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.451106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dfcafa96-d11d-4738-8815-05bfff53c96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:06.480012 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2670/5303] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:06.485683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c0fdb-a365-4e87-b321-3c8b0b34ba7a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.486058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c0fdb-a365-4e87-b321-3c8b0b34ba7a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.486398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c0fdb-a365-4e87-b321-3c8b0b34ba7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.518738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8e3c0fdb-a365-4e87-b321-3c8b0b34ba7a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:06.521067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8e3c0fdb-a365-4e87-b321-3c8b0b34ba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:06.553457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcafa96-d11d-4738-8815-05bfff53c96d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.563959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb0aed-101c-43b2-b139-7e9154d7318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.566210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb0aed-101c-43b2-b139-7e9154d7318c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.566588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb0aed-101c-43b2-b139-7e9154d7318c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.567292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb0aed-101c-43b2-b139-7e9154d7318c admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.567894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb0aed-101c-43b2-b139-7e9154d7318c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.570170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb0aed-101c-43b2-b139-7e9154d7318c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.590918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:06.613143 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2671/5304] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:06.614503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c0fdb-a365-4e87-b321-3c8b0b34ba7a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.616822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8e3c0fdb-a365-4e87-b321-3c8b0b34ba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:06.622398 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2634/5305] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:06 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:06.626505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb0aed-101c-43b2-b139-7e9154d7318c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.744081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb0aed-101c-43b2-b139-7e9154d7318c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.752017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937e87e-5379-41f3-9b2e-305843768863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.753190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937e87e-5379-41f3-9b2e-305843768863 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.753614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937e87e-5379-41f3-9b2e-305843768863 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.754513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937e87e-5379-41f3-9b2e-305843768863 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.756414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937e87e-5379-41f3-9b2e-305843768863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.759825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937e87e-5379-41f3-9b2e-305843768863 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.770476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c0fdb-a365-4e87-b321-3c8b0b34ba7a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.807454 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2635/5306] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:06 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:43:06.808780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937e87e-5379-41f3-9b2e-305843768863 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.810806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2937e87e-5379-41f3-9b2e-305843768863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:06.839229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8cf14-beb3-4876-a287-a4da78bf24f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.840044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8cf14-beb3-4876-a287-a4da78bf24f1 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.840994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8cf14-beb3-4876-a287-a4da78bf24f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.841361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea8cf14-beb3-4876-a287-a4da78bf24f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.854612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8cf14-beb3-4876-a287-a4da78bf24f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.856473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea8cf14-beb3-4876-a287-a4da78bf24f1 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.874268 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2672/5307] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:06.875575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8cf14-beb3-4876-a287-a4da78bf24f1 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.881122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:06.889955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937e87e-5379-41f3-9b2e-305843768863 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.890282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea8cf14-beb3-4876-a287-a4da78bf24f1 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.894492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d1b90-0a0b-492f-b7bb-e0b029417155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.895210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d1b90-0a0b-492f-b7bb-e0b029417155 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.895567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d1b90-0a0b-492f-b7bb-e0b029417155 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.895837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d1b90-0a0b-492f-b7bb-e0b029417155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.896228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f1468-ba9f-4846-97dc-2075594195c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.896927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f1468-ba9f-4846-97dc-2075594195c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.897297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f1468-ba9f-4846-97dc-2075594195c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.897658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f1468-ba9f-4846-97dc-2075594195c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.898670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f1468-ba9f-4846-97dc-2075594195c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.900622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f1468-ba9f-4846-97dc-2075594195c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.906948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d1b90-0a0b-492f-b7bb-e0b029417155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.909226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d1b90-0a0b-492f-b7bb-e0b029417155 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.924846 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2636/5308] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:06.925358 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2673/5309] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:06.934993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d1b90-0a0b-492f-b7bb-e0b029417155 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.947511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d1b90-0a0b-492f-b7bb-e0b029417155 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.954154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aee4d4-9873-4628-bd97-1320ae1c4ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.955282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aee4d4-9873-4628-bd97-1320ae1c4ead admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.955661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aee4d4-9873-4628-bd97-1320ae1c4ead admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.956029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aee4d4-9873-4628-bd97-1320ae1c4ead admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:06.956794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aee4d4-9873-4628-bd97-1320ae1c4ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:06.958563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aee4d4-9873-4628-bd97-1320ae1c4ead admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:06.971581 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2637/5310] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:06.975685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f1468-ba9f-4846-97dc-2075594195c9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:06.987665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f1468-ba9f-4846-97dc-2075594195c9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:06.995246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc5e8d-9469-4849-839a-d4dde860e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:06.996048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc5e8d-9469-4849-839a-d4dde860e884 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:06.996326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc5e8d-9469-4849-839a-d4dde860e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:06.996593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc5e8d-9469-4849-839a-d4dde860e884 admin admin] PATH_INFO: `/v3/projects/c2c9fd98f97243efae980ac230704881/users/7217d4a84f924517b892ead2fc22b46e/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:07.026276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc5e8d-9469-4849-839a-d4dde860e884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c9fd98f97243efae980ac230704881, user_id=7217d4a84f924517b892ead2fc22b46e, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:07.029419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc5e8d-9469-4849-839a-d4dde860e884 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:07.050737 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2674/5311] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:06 2022] PUT /identity/v3/projects/c2c9fd98f97243efae980ac230704881/users/7217d4a84f924517b892ead2fc22b46e/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:07.063098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae6d8-5f21-4c83-9264-84df34fd7ebc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:07.063600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae6d8-5f21-4c83-9264-84df34fd7ebc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:07.063816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae6d8-5f21-4c83-9264-84df34fd7ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:07.100969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fefae6d8-5f21-4c83-9264-84df34fd7ebc None None] MFA Rules not processed for user `7217d4a84f924517b892ead2fc22b46e`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:07.102685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fefae6d8-5f21-4c83-9264-84df34fd7ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:07.195563 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2638/5312] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:07.199075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc5e8d-9469-4849-839a-d4dde860e884 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:07.296625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc5e8d-9469-4849-839a-d4dde860e884 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:07.306725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352fc83-6c2f-42bf-aaab-6bd42f22040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:07.307371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352fc83-6c2f-42bf-aaab-6bd42f22040f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:07.307896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352fc83-6c2f-42bf-aaab-6bd42f22040f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:07.308680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352fc83-6c2f-42bf-aaab-6bd42f22040f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:07.309300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352fc83-6c2f-42bf-aaab-6bd42f22040f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:07.313014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c352fc83-6c2f-42bf-aaab-6bd42f22040f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:07.355108 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2675/5313] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:07 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:07.357314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefae6d8-5f21-4c83-9264-84df34fd7ebc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:07.363157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:07.376255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefae6d8-5f21-4c83-9264-84df34fd7ebc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:07.488310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca7e3-30b1-41b2-a409-6885e1064a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:07.490347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca7e3-30b1-41b2-a409-6885e1064a1c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:07.490805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca7e3-30b1-41b2-a409-6885e1064a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:07.491163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fca7e3-30b1-41b2-a409-6885e1064a1c admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:07.492016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca7e3-30b1-41b2-a409-6885e1064a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:07.497598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fca7e3-30b1-41b2-a409-6885e1064a1c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:07.510446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352fc83-6c2f-42bf-aaab-6bd42f22040f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:07.512225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c352fc83-6c2f-42bf-aaab-6bd42f22040f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:07.530101 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2639/5314] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:07 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:07.535108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca7e3-30b1-41b2-a409-6885e1064a1c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:07.536720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c352fc83-6c2f-42bf-aaab-6bd42f22040f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:07.544477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:07.545167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:07.545449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:07.545724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] PATH_INFO: `/v3/projects/55f0ca8088b34b88b39d3a8b94c46657` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:07.548374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f0ca8088b34b88b39d3a8b94c46657)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:07.562343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:07.567784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fca7e3-30b1-41b2-a409-6885e1064a1c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:07.593802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839ac33-f1de-4ee7-a39a-51e198f8551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:07.595526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839ac33-f1de-4ee7-a39a-51e198f8551e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:07.596424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839ac33-f1de-4ee7-a39a-51e198f8551e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:07.596939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839ac33-f1de-4ee7-a39a-51e198f8551e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:07.603515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839ac33-f1de-4ee7-a39a-51e198f8551e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:07.606886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839ac33-f1de-4ee7-a39a-51e198f8551e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:07.635757 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2640/5315] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:43:07.640927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bd7aa-4b4e-47a0-8a9f-dd5f90c8e1a1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:07.647255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bd7aa-4b4e-47a0-8a9f-dd5f90c8e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:07.652653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bd7aa-4b4e-47a0-8a9f-dd5f90c8e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:07.671250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f0ca8088b34b88b39d3a8b94c46657', 'request_id': 'req-215057ae-cbc9-434b-a629-285ee4a6f0c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:07.697766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f0ca8088b34b88b39d3a8b94c46657', 'request_id': 'req-215057ae-cbc9-434b-a629-285ee4a6f0c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:07.713070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-611bd7aa-4b4e-47a0-8a9f-dd5f90c8e1a1 None None] MFA Rules not processed for user `59d8cb24df474f7784ba375e9688ec02`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:07.715210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-611bd7aa-4b4e-47a0-8a9f-dd5f90c8e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:07.716923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f0ca8088b34b88b39d3a8b94c46657', 'request_id': 'req-215057ae-cbc9-434b-a629-285ee4a6f0c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:07.745182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] The token cache is being invalidate because project 55f0ca8088b34b88b39d3a8b94c46657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:07.745467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:07.746407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:07.748461 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2676/5316] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:07 2022] DELETE /identity/v3/projects/55f0ca8088b34b88b39d3a8b94c46657 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:07.748989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:07.762910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:07.855732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:07.864474 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2641/5317] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:07.866356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7747a-9293-459c-b291-0fc1a4d4dbc8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:07.866707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7747a-9293-459c-b291-0fc1a4d4dbc8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:07.867142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7747a-9293-459c-b291-0fc1a4d4dbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:07.891278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215057ae-cbc9-434b-a629-285ee4a6f0c5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:07.891771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ecf7747a-9293-459c-b291-0fc1a4d4dbc8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:07.893317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ecf7747a-9293-459c-b291-0fc1a4d4dbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:07.897571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c7f6e-81be-44b9-8091-05f4c199af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:07.898554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c7f6e-81be-44b9-8091-05f4c199af68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:07.902337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c7f6e-81be-44b9-8091-05f4c199af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:07.904075 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2642/5318] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:07.905977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93418-8373-4503-8c91-8022d2fbade6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:07.906489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c7f6e-81be-44b9-8091-05f4c199af68 admin admin] PATH_INFO: `/v3/projects/1bf8cfb77fd349a88fd229e1243080fe/users/e40487e8c7c04d369c7f84ba8ff26917/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:07.907166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93418-8373-4503-8c91-8022d2fbade6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:07.907166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93418-8373-4503-8c91-8022d2fbade6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:07.929512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c7f6e-81be-44b9-8091-05f4c199af68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf8cfb77fd349a88fd229e1243080fe, user_id=e40487e8c7c04d369c7f84ba8ff26917, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:07.934165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c7f6e-81be-44b9-8091-05f4c199af68 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:07.959005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b8a93418-8373-4503-8c91-8022d2fbade6 None None] MFA Rules not processed for user `59d8cb24df474f7784ba375e9688ec02`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:07.960530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8a93418-8373-4503-8c91-8022d2fbade6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:07.977238 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2677/5319] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:07 2022] PUT /identity/v3/projects/1bf8cfb77fd349a88fd229e1243080fe/users/e40487e8c7c04d369c7f84ba8ff26917/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:07.980059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc201540-4d12-4387-96f6-116c6f687c17 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:07.980630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc201540-4d12-4387-96f6-116c6f687c17 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:07.981178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc201540-4d12-4387-96f6-116c6f687c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.004770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bc201540-4d12-4387-96f6-116c6f687c17 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:08.006568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bc201540-4d12-4387-96f6-116c6f687c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:08.065041 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2643/5320] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:08.066065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93418-8373-4503-8c91-8022d2fbade6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.082980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:08.109310 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2678/5321] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:08.110382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc201540-4d12-4387-96f6-116c6f687c17 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.111832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bc201540-4d12-4387-96f6-116c6f687c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:08.213624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93418-8373-4503-8c91-8022d2fbade6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:08.223747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1006fa-63b4-4985-a161-b167da18f592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:08.227909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1006fa-63b4-4985-a161-b167da18f592 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.228194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1006fa-63b4-4985-a161-b167da18f592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.228474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1006fa-63b4-4985-a161-b167da18f592 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.229133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc201540-4d12-4387-96f6-116c6f687c17 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:08.229273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1006fa-63b4-4985-a161-b167da18f592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:08.232841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1006fa-63b4-4985-a161-b167da18f592 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:08.255380 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2644/5322] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:08.256638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1006fa-63b4-4985-a161-b167da18f592 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.256776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb580a-c950-4104-a6ae-327e85aab887 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:08.257729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb580a-c950-4104-a6ae-327e85aab887 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.258265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb580a-c950-4104-a6ae-327e85aab887 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.258542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb580a-c950-4104-a6ae-327e85aab887 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.274052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1006fa-63b4-4985-a161-b167da18f592 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:08.279888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb580a-c950-4104-a6ae-327e85aab887 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:08.280625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314a30f-ea56-46b7-b617-b1fdb0681f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:08.281253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314a30f-ea56-46b7-b617-b1fdb0681f8c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.281535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314a30f-ea56-46b7-b617-b1fdb0681f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.281662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb580a-c950-4104-a6ae-327e85aab887 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:08.281805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314a30f-ea56-46b7-b617-b1fdb0681f8c admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.282908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314a30f-ea56-46b7-b617-b1fdb0681f8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:08.283223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314a30f-ea56-46b7-b617-b1fdb0681f8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:08.284837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314a30f-ea56-46b7-b617-b1fdb0681f8c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:08.300550 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2679/5323] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:08.301548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb580a-c950-4104-a6ae-327e85aab887 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.317897 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2645/5324] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:08.323095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314a30f-ea56-46b7-b617-b1fdb0681f8c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.323358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb580a-c950-4104-a6ae-327e85aab887 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:08.337488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314a30f-ea56-46b7-b617-b1fdb0681f8c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:08.340787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb8d82-c7de-45d7-bde1-c43340cc434b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:08.341562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8d82-c7de-45d7-bde1-c43340cc434b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.341842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8d82-c7de-45d7-bde1-c43340cc434b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.342143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb8d82-c7de-45d7-bde1-c43340cc434b admin admin] PATH_INFO: `/v3/projects/1bf8cfb77fd349a88fd229e1243080fe/users/e40487e8c7c04d369c7f84ba8ff26917/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.344088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ad73c-a378-43f7-a858-4ed37343e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:08.344781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ad73c-a378-43f7-a858-4ed37343e03f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.345129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ad73c-a378-43f7-a858-4ed37343e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.345468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ad73c-a378-43f7-a858-4ed37343e03f admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.346853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ad73c-a378-43f7-a858-4ed37343e03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:08.347086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb8d82-c7de-45d7-bde1-c43340cc434b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf8cfb77fd349a88fd229e1243080fe, user_id=e40487e8c7c04d369c7f84ba8ff26917, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:08.349756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb8d82-c7de-45d7-bde1-c43340cc434b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:08.350301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ad73c-a378-43f7-a858-4ed37343e03f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:08.375017 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2680/5325] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:08 2022] PUT /identity/v3/projects/1bf8cfb77fd349a88fd229e1243080fe/users/e40487e8c7c04d369c7f84ba8ff26917/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:08.388278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868c48a-c809-4ec2-92bf-6b060d502ce3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.388593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868c48a-c809-4ec2-92bf-6b060d502ce3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.389006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868c48a-c809-4ec2-92bf-6b060d502ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.426956 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2646/5326] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:08 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:08.433117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ad73c-a378-43f7-a858-4ed37343e03f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.448841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5868c48a-c809-4ec2-92bf-6b060d502ce3 None None] MFA Rules not processed for user `e40487e8c7c04d369c7f84ba8ff26917`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:08.450157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5868c48a-c809-4ec2-92bf-6b060d502ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:08.485159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:08.567926 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2681/5327] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:08.568142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ad73c-a378-43f7-a858-4ed37343e03f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:08.572334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868c48a-c809-4ec2-92bf-6b060d502ce3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.577070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e70c1-49a1-4252-8c7a-93a6f5ca137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:08.578361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e70c1-49a1-4252-8c7a-93a6f5ca137f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.579427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e70c1-49a1-4252-8c7a-93a6f5ca137f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.580183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e70c1-49a1-4252-8c7a-93a6f5ca137f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.581068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e70c1-49a1-4252-8c7a-93a6f5ca137f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:08.584293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e70c1-49a1-4252-8c7a-93a6f5ca137f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:08.611260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868c48a-c809-4ec2-92bf-6b060d502ce3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:08.627440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119b481-74df-4b1b-b1ca-d943a0fe7576 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:08.628138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119b481-74df-4b1b-b1ca-d943a0fe7576 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.628479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119b481-74df-4b1b-b1ca-d943a0fe7576 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.628760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119b481-74df-4b1b-b1ca-d943a0fe7576 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.630041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119b481-74df-4b1b-b1ca-d943a0fe7576 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:08.632039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119b481-74df-4b1b-b1ca-d943a0fe7576 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:08.640681 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2647/5328] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:08 2022] POST /identity/v3/users => generated 291 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:08.645141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e70c1-49a1-4252-8c7a-93a6f5ca137f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.662219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e70c1-49a1-4252-8c7a-93a6f5ca137f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:08.670518 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2682/5329] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:43:08 2022] POST /identity/v3/domains => generated 276 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:08.673740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119b481-74df-4b1b-b1ca-d943a0fe7576 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.682180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cd3ea-6063-480d-ab51-4c3d9046640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:08.682180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cd3ea-6063-480d-ab51-4c3d9046640e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.682180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cd3ea-6063-480d-ab51-4c3d9046640e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.682180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cd3ea-6063-480d-ab51-4c3d9046640e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.687237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cd3ea-6063-480d-ab51-4c3d9046640e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:08.688887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cd3ea-6063-480d-ab51-4c3d9046640e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:08.739206 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2648/5330] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:08.741421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cd3ea-6063-480d-ab51-4c3d9046640e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.771846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cd3ea-6063-480d-ab51-4c3d9046640e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:08.870565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119b481-74df-4b1b-b1ca-d943a0fe7576 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:08.885554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0a337-24d7-4439-abd4-d77a7d8ebdfd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:08.886858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0a337-24d7-4439-abd4-d77a7d8ebdfd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.886994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0a337-24d7-4439-abd4-d77a7d8ebdfd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.887762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b0a337-24d7-4439-abd4-d77a7d8ebdfd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.888416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0a337-24d7-4439-abd4-d77a7d8ebdfd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:08.891432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b0a337-24d7-4439-abd4-d77a7d8ebdfd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:08.896916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:08.931995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1853a-c9ad-403a-896e-653dffa54d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:08.945078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1853a-c9ad-403a-896e-653dffa54d07 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:08.945523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1853a-c9ad-403a-896e-653dffa54d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:08.945805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1853a-c9ad-403a-896e-653dffa54d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:08.948607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1853a-c9ad-403a-896e-653dffa54d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:08.956709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1853a-c9ad-403a-896e-653dffa54d07 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:08.975730 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2683/5331] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:43:08 2022] POST /identity/v3/groups => generated 281 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:43:08.980694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0a337-24d7-4439-abd4-d77a7d8ebdfd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:08.987286 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2649/5332] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:08.991564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1853a-c9ad-403a-896e-653dffa54d07 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.005715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b0a337-24d7-4439-abd4-d77a7d8ebdfd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.013829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1853a-c9ad-403a-896e-653dffa54d07 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.017126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4824-acbb-46b3-aa6e-ee4376f7bfa8 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.017823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4824-acbb-46b3-aa6e-ee4376f7bfa8 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.018086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4824-acbb-46b3-aa6e-ee4376f7bfa8 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.018374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff4824-acbb-46b3-aa6e-ee4376f7bfa8 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/5ce792ef1e6546e18cdfccfb7c91dd63` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.029508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246e488-110f-461b-b77a-dc876c75ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.030219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246e488-110f-461b-b77a-dc876c75ca7b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.030494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246e488-110f-461b-b77a-dc876c75ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.030764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246e488-110f-461b-b77a-dc876c75ca7b admin admin] PATH_INFO: `/v3/projects/6af34c0b740847d09afde0c2bdf9dba2/users/53bcff91cd1745aa9a5f30daba7051cf/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.033329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff4824-acbb-46b3-aa6e-ee4376f7bfa8 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:update_group(group_id=5ce792ef1e6546e18cdfccfb7c91dd63)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.034010 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-04ff4824-acbb-46b3-aa6e-ee4376f7bfa8 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:09.034010 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:09.034010 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:09.037135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff4824-acbb-46b3-aa6e-ee4376f7bfa8 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.069499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246e488-110f-461b-b77a-dc876c75ca7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af34c0b740847d09afde0c2bdf9dba2, user_id=53bcff91cd1745aa9a5f30daba7051cf, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.072319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246e488-110f-461b-b77a-dc876c75ca7b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.075586 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2684/5333] 10.222.0.43 () {60 vars in 1247 bytes} [Tue Aug 30 04:43:08 2022] PATCH /identity/v3/groups/5ce792ef1e6546e18cdfccfb7c91dd63 => generated 293 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:09.079305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4824-acbb-46b3-aa6e-ee4376f7bfa8 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.094861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff4824-acbb-46b3-aa6e-ee4376f7bfa8 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.099013 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2650/5334] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:08 2022] PUT /identity/v3/projects/6af34c0b740847d09afde0c2bdf9dba2/users/53bcff91cd1745aa9a5f30daba7051cf/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:09.109398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af4fa6-852e-4f7e-8aa4-323597a6e042 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.110385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af4fa6-852e-4f7e-8aa4-323597a6e042 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.110385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af4fa6-852e-4f7e-8aa4-323597a6e042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.254407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b0cbe-ee26-4d64-afb8-8ae44ccf7049 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.255210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0cbe-ee26-4d64-afb8-8ae44ccf7049 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.255550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0cbe-ee26-4d64-afb8-8ae44ccf7049 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.255887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b0cbe-ee26-4d64-afb8-8ae44ccf7049 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/5ce792ef1e6546e18cdfccfb7c91dd63` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.269918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b0cbe-ee26-4d64-afb8-8ae44ccf7049 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:get_group(group_id=5ce792ef1e6546e18cdfccfb7c91dd63)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.271230 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-5a2b0cbe-ee26-4d64-afb8-8ae44ccf7049 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:09.271230 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:09.271230 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:09.274149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b0cbe-ee26-4d64-afb8-8ae44ccf7049 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.280153 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2685/5335] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:09 2022] GET /identity/v3/groups/5ce792ef1e6546e18cdfccfb7c91dd63 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:43:09.281142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b0cbe-ee26-4d64-afb8-8ae44ccf7049 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.302424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b0cbe-ee26-4d64-afb8-8ae44ccf7049 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.321644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71759a-3f85-437d-9611-9fd9d8a4d37a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.322260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71759a-3f85-437d-9611-9fd9d8a4d37a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.322535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71759a-3f85-437d-9611-9fd9d8a4d37a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.322806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71759a-3f85-437d-9611-9fd9d8a4d37a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/5ce792ef1e6546e18cdfccfb7c91dd63` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.324096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71759a-3f85-437d-9611-9fd9d8a4d37a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:update_group(group_id=5ce792ef1e6546e18cdfccfb7c91dd63)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.326147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71759a-3f85-437d-9611-9fd9d8a4d37a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.330236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:09.362439 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2686/5336] 10.222.0.43 () {60 vars in 1246 bytes} [Tue Aug 30 04:43:09 2022] PATCH /identity/v3/groups/5ce792ef1e6546e18cdfccfb7c91dd63 => generated 309 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:09.364089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-19af4fa6-852e-4f7e-8aa4-323597a6e042 None None] MFA Rules not processed for user `53bcff91cd1745aa9a5f30daba7051cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:09.366135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-19af4fa6-852e-4f7e-8aa4-323597a6e042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:09.366280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71759a-3f85-437d-9611-9fd9d8a4d37a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.379925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71759a-3f85-437d-9611-9fd9d8a4d37a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.386253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d2546-3ffd-4bf2-9495-0c5788f1c338 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.386965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d2546-3ffd-4bf2-9495-0c5788f1c338 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.387312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d2546-3ffd-4bf2-9495-0c5788f1c338 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.387646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d2546-3ffd-4bf2-9495-0c5788f1c338 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/5ce792ef1e6546e18cdfccfb7c91dd63` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.398080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d2546-3ffd-4bf2-9495-0c5788f1c338 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5ce792ef1e6546e18cdfccfb7c91dd63)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.399300 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-cc4d2546-3ffd-4bf2-9495-0c5788f1c338 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:09.399300 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:09.399300 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:09.400689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d2546-3ffd-4bf2-9495-0c5788f1c338 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.494362 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2687/5337] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:43:09 2022] DELETE /identity/v3/groups/5ce792ef1e6546e18cdfccfb7c91dd63 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:09.494362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d2546-3ffd-4bf2-9495-0c5788f1c338 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.517264 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2651/5338] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:09.518372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af4fa6-852e-4f7e-8aa4-323597a6e042 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.569055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d2546-3ffd-4bf2-9495-0c5788f1c338 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.575619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd200-5c1b-485d-8a3f-238f7fdcbdb1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.576269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd200-5c1b-485d-8a3f-238f7fdcbdb1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.576675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd200-5c1b-485d-8a3f-238f7fdcbdb1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.576966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd200-5c1b-485d-8a3f-238f7fdcbdb1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.578021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fd200-5c1b-485d-8a3f-238f7fdcbdb1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.580325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fd200-5c1b-485d-8a3f-238f7fdcbdb1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.598166 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2688/5339] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:43:09 2022] POST /identity/v3/groups => generated 325 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:09.602934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd200-5c1b-485d-8a3f-238f7fdcbdb1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.607778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af4fa6-852e-4f7e-8aa4-323597a6e042 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.613290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd200-5c1b-485d-8a3f-238f7fdcbdb1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.618529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bfc38-76cd-4a2f-9bad-2fc8d8b36623 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.619180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bfc38-76cd-4a2f-9bad-2fc8d8b36623 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.619463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bfc38-76cd-4a2f-9bad-2fc8d8b36623 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.620047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bfc38-76cd-4a2f-9bad-2fc8d8b36623 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.620691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bfc38-76cd-4a2f-9bad-2fc8d8b36623 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.622605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bfc38-76cd-4a2f-9bad-2fc8d8b36623 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.662785 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2689/5340] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:09 2022] POST /identity/v3/users => generated 321 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:09.666966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bfc38-76cd-4a2f-9bad-2fc8d8b36623 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.681940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bfc38-76cd-4a2f-9bad-2fc8d8b36623 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.694167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02eee-88d8-4896-8ff3-920599d21092 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.697212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02eee-88d8-4896-8ff3-920599d21092 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.698044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:09.698329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02eee-88d8-4896-8ff3-920599d21092 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.698696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d02eee-88d8-4896-8ff3-920599d21092 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/85f4ad883d584b298200f6413ea1d0e1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.714510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a60eb-9a15-4445-9b65-5e0165810f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.714984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a60eb-9a15-4445-9b65-5e0165810f65 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.715225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a60eb-9a15-4445-9b65-5e0165810f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.715644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a60eb-9a15-4445-9b65-5e0165810f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.716395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a60eb-9a15-4445-9b65-5e0165810f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.722617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a60eb-9a15-4445-9b65-5e0165810f65 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.736838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d02eee-88d8-4896-8ff3-920599d21092 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=93a2f8ef5ab340a887c3577c2494f810, user_id=85f4ad883d584b298200f6413ea1d0e1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.738317 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-c8d02eee-88d8-4896-8ff3-920599d21092 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:09.738317 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:09.738317 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:09.740284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d02eee-88d8-4896-8ff3-920599d21092 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.767530 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2652/5341] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:09 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:09.769269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a60eb-9a15-4445-9b65-5e0165810f65 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.784355 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2690/5342] 10.222.0.43 () {60 vars in 1360 bytes} [Tue Aug 30 04:43:09 2022] PUT /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/85f4ad883d584b298200f6413ea1d0e1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:09.785866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02eee-88d8-4896-8ff3-920599d21092 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.859696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:09.886609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a60eb-9a15-4445-9b65-5e0165810f65 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.888505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d02eee-88d8-4896-8ff3-920599d21092 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.893463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1189b-ae4b-4059-b295-c93cf0f4f915 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.894205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1189b-ae4b-4059-b295-c93cf0f4f915 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.894556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1189b-ae4b-4059-b295-c93cf0f4f915 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.895155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1189b-ae4b-4059-b295-c93cf0f4f915 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.895596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1189b-ae4b-4059-b295-c93cf0f4f915 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.897613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1189b-ae4b-4059-b295-c93cf0f4f915 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.928519 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2691/5343] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:09 2022] POST /identity/v3/users => generated 321 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:09.930714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1189b-ae4b-4059-b295-c93cf0f4f915 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:09.942518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1189b-ae4b-4059-b295-c93cf0f4f915 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:09.947750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6ffdf-10c1-421c-944e-ad510b2d0202 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.948414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6ffdf-10c1-421c-944e-ad510b2d0202 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.948728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6ffdf-10c1-421c-944e-ad510b2d0202 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.948984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6ffdf-10c1-421c-944e-ad510b2d0202 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/13e247c8af644065b8135ad1914bb5b5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.966501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853bc24-300e-47a0-a10f-900c9296f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:09.967753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853bc24-300e-47a0-a10f-900c9296f069 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:09.968095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853bc24-300e-47a0-a10f-900c9296f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:09.968368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853bc24-300e-47a0-a10f-900c9296f069 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:09.968952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6ffdf-10c1-421c-944e-ad510b2d0202 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=93a2f8ef5ab340a887c3577c2494f810, user_id=13e247c8af644065b8135ad1914bb5b5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.969095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853bc24-300e-47a0-a10f-900c9296f069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:09.971375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6ffdf-10c1-421c-944e-ad510b2d0202 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:09.971526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853bc24-300e-47a0-a10f-900c9296f069 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.003825 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2653/5344] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:09 2022] POST /identity/v3/users => generated 297 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:10.004947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853bc24-300e-47a0-a10f-900c9296f069 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.009546 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2692/5345] 10.222.0.43 () {60 vars in 1360 bytes} [Tue Aug 30 04:43:09 2022] PUT /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/13e247c8af644065b8135ad1914bb5b5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:10.011315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6ffdf-10c1-421c-944e-ad510b2d0202 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.017855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853bc24-300e-47a0-a10f-900c9296f069 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:10.110689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6ffdf-10c1-421c-944e-ad510b2d0202 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:10.111464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4317-0f21-4ae0-9541-86932482ee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:10.112037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4317-0f21-4ae0-9541-86932482ee46 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.112313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4317-0f21-4ae0-9541-86932482ee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.112581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b4317-0f21-4ae0-9541-86932482ee46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.113846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4317-0f21-4ae0-9541-86932482ee46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:10.116743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b4317-0f21-4ae0-9541-86932482ee46 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.120820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e616bc-7933-462f-9c79-078b972fb83f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:10.121613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e616bc-7933-462f-9c79-078b972fb83f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.122052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e616bc-7933-462f-9c79-078b972fb83f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.123305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e616bc-7933-462f-9c79-078b972fb83f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.125333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e616bc-7933-462f-9c79-078b972fb83f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:10.127871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e616bc-7933-462f-9c79-078b972fb83f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.132906 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2654/5346] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:10.133972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4317-0f21-4ae0-9541-86932482ee46 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.137952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-480b4317-0f21-4ae0-9541-86932482ee46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:10.156896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b4317-0f21-4ae0-9541-86932482ee46 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:10.172614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:10.173318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.173629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.173908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] PATH_INFO: `/v3/users/59d8cb24df474f7784ba375e9688ec02` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.175793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d8cb24df474f7784ba375e9688ec02)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:10.177770 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2693/5347] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:10 2022] POST /identity/v3/users => generated 321 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:43:10.180597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e616bc-7933-462f-9c79-078b972fb83f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.182209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.207356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e616bc-7933-462f-9c79-078b972fb83f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:10.223038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:10.228973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833e54-8f26-4c28-ba7e-84a982e5c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:10.231056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833e54-8f26-4c28-ba7e-84a982e5c436 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.231332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833e54-8f26-4c28-ba7e-84a982e5c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.231599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833e54-8f26-4c28-ba7e-84a982e5c436 admin admin] PATH_INFO: `/v3/projects/d4ad768e5def49f8a56479009e214c53/users/da4caca4c2834f079c49e90e53690b20/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.264502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89833e54-8f26-4c28-ba7e-84a982e5c436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ad768e5def49f8a56479009e214c53, user_id=da4caca4c2834f079c49e90e53690b20, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:10.268699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89833e54-8f26-4c28-ba7e-84a982e5c436 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.289200 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2694/5348] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:10 2022] PUT /identity/v3/projects/d4ad768e5def49f8a56479009e214c53/users/da4caca4c2834f079c49e90e53690b20/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:10.290528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833e54-8f26-4c28-ba7e-84a982e5c436 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.335311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d8cb24df474f7784ba375e9688ec02'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:10.366434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833e54-8f26-4c28-ba7e-84a982e5c436 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:10.367138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d8cb24df474f7784ba375e9688ec02'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:10.377975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9780f02-cd43-451f-8f7f-0fd2f146fb7c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:10.378734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780f02-cd43-451f-8f7f-0fd2f146fb7c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.379373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780f02-cd43-451f-8f7f-0fd2f146fb7c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.380606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9780f02-cd43-451f-8f7f-0fd2f146fb7c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/0f76ba72cf344f5cb67961887af42523` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.385201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:10.398800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d8cb24df474f7784ba375e9688ec02'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:10.409848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9780f02-cd43-451f-8f7f-0fd2f146fb7c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=93a2f8ef5ab340a887c3577c2494f810, user_id=0f76ba72cf344f5cb67961887af42523)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:10.412189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9780f02-cd43-451f-8f7f-0fd2f146fb7c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.415510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d8cb24df474f7784ba375e9688ec02'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:10.416382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d8cb24df474f7784ba375e9688ec02'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:10.442112 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2655/5349] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:10 2022] DELETE /identity/v3/users/59d8cb24df474f7784ba375e9688ec02 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:10.445846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.448482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:10.490267 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2695/5350] 10.222.0.43 () {60 vars in 1360 bytes} [Tue Aug 30 04:43:10 2022] PUT /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/0f76ba72cf344f5cb67961887af42523 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:10.495982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9780f02-cd43-451f-8f7f-0fd2f146fb7c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.499433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f9780f02-cd43-451f-8f7f-0fd2f146fb7c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:10.570026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907f51f-3721-4f1b-9068-81c141222f1b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:10.676438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9780f02-cd43-451f-8f7f-0fd2f146fb7c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:10.682452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2094ce-e83b-4858-aaac-0488edea75f1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:10.683287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2094ce-e83b-4858-aaac-0488edea75f1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.683571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2094ce-e83b-4858-aaac-0488edea75f1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.683897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2094ce-e83b-4858-aaac-0488edea75f1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.685165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2094ce-e83b-4858-aaac-0488edea75f1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=93a2f8ef5ab340a887c3577c2494f810)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:10.686246 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-ed2094ce-e83b-4858-aaac-0488edea75f1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:10.686246 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:10.686246 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:10.691323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2094ce-e83b-4858-aaac-0488edea75f1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.694306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d9cb2-be10-4da3-acc7-bae2273ba5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:10.695036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d9cb2-be10-4da3-acc7-bae2273ba5df admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.697929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d9cb2-be10-4da3-acc7-bae2273ba5df admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.698465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d9cb2-be10-4da3-acc7-bae2273ba5df admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.700010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d9cb2-be10-4da3-acc7-bae2273ba5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:10.702795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d9cb2-be10-4da3-acc7-bae2273ba5df admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.719074 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2656/5351] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:10.723110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d9cb2-be10-4da3-acc7-bae2273ba5df admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.725029 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2696/5352] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Aug 30 04:43:10 2022] GET /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users => generated 1079 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:10.726300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2094ce-e83b-4858-aaac-0488edea75f1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.745412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d9cb2-be10-4da3-acc7-bae2273ba5df admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:10.752911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2094ce-e83b-4858-aaac-0488edea75f1 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:10.755811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07e005-46d6-491e-a927-05e20be8c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:10.756504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07e005-46d6-491e-a927-05e20be8c7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.756776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07e005-46d6-491e-a927-05e20be8c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.757896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07e005-46d6-491e-a927-05e20be8c7e0 admin admin] PATH_INFO: `/v3/projects/d4ad768e5def49f8a56479009e214c53/users/da4caca4c2834f079c49e90e53690b20/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.760220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4abec0-ea39-4d10-b860-9a293848c228 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:10.760451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07e005-46d6-491e-a927-05e20be8c7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ad768e5def49f8a56479009e214c53, user_id=da4caca4c2834f079c49e90e53690b20, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:10.761276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4abec0-ea39-4d10-b860-9a293848c228 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.761719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4abec0-ea39-4d10-b860-9a293848c228 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.762385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4abec0-ea39-4d10-b860-9a293848c228 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/85f4ad883d584b298200f6413ea1d0e1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.763237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07e005-46d6-491e-a927-05e20be8c7e0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.764941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4abec0-ea39-4d10-b860-9a293848c228 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=93a2f8ef5ab340a887c3577c2494f810, user_id=85f4ad883d584b298200f6413ea1d0e1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:10.766271 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-9c4abec0-ea39-4d10-b860-9a293848c228 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:10.766271 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:10.766271 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:10.768632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4abec0-ea39-4d10-b860-9a293848c228 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.782282 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2657/5353] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:10 2022] PUT /identity/v3/projects/d4ad768e5def49f8a56479009e214c53/users/da4caca4c2834f079c49e90e53690b20/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:10.788962 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2697/5354] 10.222.0.43 () {58 vars in 1342 bytes} [Tue Aug 30 04:43:10 2022] HEAD /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/85f4ad883d584b298200f6413ea1d0e1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:10.794323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4abec0-ea39-4d10-b860-9a293848c228 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.794586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8364-7679-4a58-9cab-4f78b32f7ff6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.794981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8364-7679-4a58-9cab-4f78b32f7ff6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.795357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b8364-7679-4a58-9cab-4f78b32f7ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.810552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4abec0-ea39-4d10-b860-9a293848c228 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:10.833062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c78b8364-7679-4a58-9cab-4f78b32f7ff6 None None] MFA Rules not processed for user `da4caca4c2834f079c49e90e53690b20`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:10.834475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c78b8364-7679-4a58-9cab-4f78b32f7ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:10.842594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:10.930266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:10.930982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:10.931268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:10.931546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/85f4ad883d584b298200f6413ea1d0e1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:10.933789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=93a2f8ef5ab340a887c3577c2494f810, user_id=85f4ad883d584b298200f6413ea1d0e1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:10.935721 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:10.935721 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:10.935721 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:10.937171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:10.948229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '85f4ad883d584b298200f6413ea1d0e1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:10.963875 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2658/5355] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:10.972863 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2698/5356] 10.222.0.43 () {58 vars in 1344 bytes} [Tue Aug 30 04:43:10 2022] DELETE /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/85f4ad883d584b298200f6413ea1d0e1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:10.980747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b8364-7679-4a58-9cab-4f78b32f7ff6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.982270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:10.985454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:10.998283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b8364-7679-4a58-9cab-4f78b32f7ff6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.070491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:11.094042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8add97-f3ee-4ff4-93df-b23b1882175f tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.099333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0db17e-24d6-461e-995d-e13621684048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.099880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0db17e-24d6-461e-995d-e13621684048 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.100161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0db17e-24d6-461e-995d-e13621684048 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.100436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0db17e-24d6-461e-995d-e13621684048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.120303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381d0ef-819c-4e3b-aee3-7b685c5e4410 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.121292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381d0ef-819c-4e3b-aee3-7b685c5e4410 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.121815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381d0ef-819c-4e3b-aee3-7b685c5e4410 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.122320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381d0ef-819c-4e3b-aee3-7b685c5e4410 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/13e247c8af644065b8135ad1914bb5b5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.125508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381d0ef-819c-4e3b-aee3-7b685c5e4410 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=93a2f8ef5ab340a887c3577c2494f810, user_id=13e247c8af644065b8135ad1914bb5b5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.127350 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-5381d0ef-819c-4e3b-aee3-7b685c5e4410 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:11.127350 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:11.127350 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:11.129199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381d0ef-819c-4e3b-aee3-7b685c5e4410 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.149316 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2659/5357] 10.222.0.43 () {58 vars in 1342 bytes} [Tue Aug 30 04:43:10 2022] HEAD /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/13e247c8af644065b8135ad1914bb5b5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:11.149996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381d0ef-819c-4e3b-aee3-7b685c5e4410 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:11.154460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5381d0ef-819c-4e3b-aee3-7b685c5e4410 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:11.186004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0db17e-24d6-461e-995d-e13621684048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.188010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0db17e-24d6-461e-995d-e13621684048 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.201059 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2699/5358] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:11.202367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0db17e-24d6-461e-995d-e13621684048 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:11.223684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0db17e-24d6-461e-995d-e13621684048 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.235034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860251b-d937-4657-885f-4a811280ebd6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.236804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860251b-d937-4657-885f-4a811280ebd6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.237270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860251b-d937-4657-885f-4a811280ebd6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.238229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860251b-d937-4657-885f-4a811280ebd6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/13e247c8af644065b8135ad1914bb5b5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.240366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860251b-d937-4657-885f-4a811280ebd6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=93a2f8ef5ab340a887c3577c2494f810, user_id=13e247c8af644065b8135ad1914bb5b5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.242095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381d0ef-819c-4e3b-aee3-7b685c5e4410 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.242817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860251b-d937-4657-885f-4a811280ebd6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.252272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.252272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.252272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.252272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] PATH_INFO: `/v3/projects/af9a114cb126470a9fff3b2f6d3b16ba` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.252678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9a114cb126470a9fff3b2f6d3b16ba)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.253739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.258076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5860251b-d937-4657-885f-4a811280ebd6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '13e247c8af644065b8135ad1914bb5b5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:11.278480 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2700/5359] 10.222.0.43 () {58 vars in 1344 bytes} [Tue Aug 30 04:43:11 2022] DELETE /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/13e247c8af644065b8135ad1914bb5b5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:11.282418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860251b-d937-4657-885f-4a811280ebd6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:11.340876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:11.354925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9a114cb126470a9fff3b2f6d3b16ba', 'request_id': 'req-ea4b1b59-52ba-435d-aaaa-922d08b25a94'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:11.365297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9a114cb126470a9fff3b2f6d3b16ba', 'request_id': 'req-ea4b1b59-52ba-435d-aaaa-922d08b25a94'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:11.376025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9a114cb126470a9fff3b2f6d3b16ba', 'request_id': 'req-ea4b1b59-52ba-435d-aaaa-922d08b25a94'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:11.388905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] The token cache is being invalidate because project af9a114cb126470a9fff3b2f6d3b16ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:11.389567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:11.389706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860251b-d937-4657-885f-4a811280ebd6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.391217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:11.393098 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2660/5360] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:11 2022] DELETE /identity/v3/projects/af9a114cb126470a9fff3b2f6d3b16ba => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:11.397445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:11.399582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:11.469070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b1b59-52ba-435d-aaaa-922d08b25a94 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.471004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db8f70-ff31-45f5-8eaf-67c93ff96e91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.471899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8f70-ff31-45f5-8eaf-67c93ff96e91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.472346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8f70-ff31-45f5-8eaf-67c93ff96e91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.472778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db8f70-ff31-45f5-8eaf-67c93ff96e91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/0f76ba72cf344f5cb67961887af42523` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.472908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee2b0e-d1b7-4dc8-945a-50a8d7215854 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.473481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee2b0e-d1b7-4dc8-945a-50a8d7215854 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.473758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee2b0e-d1b7-4dc8-945a-50a8d7215854 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.474060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee2b0e-d1b7-4dc8-945a-50a8d7215854 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.474697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db8f70-ff31-45f5-8eaf-67c93ff96e91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=93a2f8ef5ab340a887c3577c2494f810, user_id=0f76ba72cf344f5cb67961887af42523)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.475919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ceee2b0e-d1b7-4dc8-945a-50a8d7215854 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:11.477045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db8f70-ff31-45f5-8eaf-67c93ff96e91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.498670 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2701/5361] 10.222.0.43 () {58 vars in 1342 bytes} [Tue Aug 30 04:43:11 2022] HEAD /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/0f76ba72cf344f5cb67961887af42523 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:11.500373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ddf39-dc0b-4cef-b9af-12fc66add95a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.500718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ddf39-dc0b-4cef-b9af-12fc66add95a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.501062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ddf39-dc0b-4cef-b9af-12fc66add95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.516102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:11.531273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e12ddf39-dc0b-4cef-b9af-12fc66add95a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:11.532999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e12ddf39-dc0b-4cef-b9af-12fc66add95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:11.550792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee2b0e-d1b7-4dc8-945a-50a8d7215854 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.552273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee2b0e-d1b7-4dc8-945a-50a8d7215854 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.561952 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2661/5362] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:11.562697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee2b0e-d1b7-4dc8-945a-50a8d7215854 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:11.564186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ceee2b0e-d1b7-4dc8-945a-50a8d7215854 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:11.599613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee2b0e-d1b7-4dc8-945a-50a8d7215854 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.612429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c1dc-e4d9-414d-bd76-4c7e808c89ab tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.613048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c1dc-e4d9-414d-bd76-4c7e808c89ab tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.613329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c1dc-e4d9-414d-bd76-4c7e808c89ab tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.613684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c1dc-e4d9-414d-bd76-4c7e808c89ab tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/0f76ba72cf344f5cb67961887af42523` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.615767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38c1dc-e4d9-414d-bd76-4c7e808c89ab tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=93a2f8ef5ab340a887c3577c2494f810, user_id=0f76ba72cf344f5cb67961887af42523)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.617291 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-ab38c1dc-e4d9-414d-bd76-4c7e808c89ab tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:11.617291 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:11.617291 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:11.622105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38c1dc-e4d9-414d-bd76-4c7e808c89ab tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.642229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab38c1dc-e4d9-414d-bd76-4c7e808c89ab tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0f76ba72cf344f5cb67961887af42523'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:11.642464 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2702/5363] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:11.644269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614ef7f-bcc7-4dde-8f2a-8a5b8f2a63c9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.644608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614ef7f-bcc7-4dde-8f2a-8a5b8f2a63c9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.645202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614ef7f-bcc7-4dde-8f2a-8a5b8f2a63c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.669134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8614ef7f-bcc7-4dde-8f2a-8a5b8f2a63c9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:11.670906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8614ef7f-bcc7-4dde-8f2a-8a5b8f2a63c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:11.672207 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2662/5364] 10.222.0.43 () {58 vars in 1344 bytes} [Tue Aug 30 04:43:11 2022] DELETE /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users/0f76ba72cf344f5cb67961887af42523 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:11.675724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c1dc-e4d9-414d-bd76-4c7e808c89ab tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:11.753547 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2703/5365] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:11.757381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614ef7f-bcc7-4dde-8f2a-8a5b8f2a63c9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:11.778285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:11.781210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614ef7f-bcc7-4dde-8f2a-8a5b8f2a63c9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.784324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c1dc-e4d9-414d-bd76-4c7e808c89ab tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.796559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460afb6b-688a-41ed-91b8-5ec642281156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.797498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460afb6b-688a-41ed-91b8-5ec642281156 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.797652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460afb6b-688a-41ed-91b8-5ec642281156 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.797793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460afb6b-688a-41ed-91b8-5ec642281156 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.801680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460afb6b-688a-41ed-91b8-5ec642281156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:11.802034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460afb6b-688a-41ed-91b8-5ec642281156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.803756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460afb6b-688a-41ed-91b8-5ec642281156 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.812599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31aee6-64ac-4336-86a6-c30938093d9c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.812977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31aee6-64ac-4336-86a6-c30938093d9c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.813259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31aee6-64ac-4336-86a6-c30938093d9c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.813530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31aee6-64ac-4336-86a6-c30938093d9c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.815068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31aee6-64ac-4336-86a6-c30938093d9c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=93a2f8ef5ab340a887c3577c2494f810)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.818666 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-ce31aee6-64ac-4336-86a6-c30938093d9c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:11.818666 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:11.818666 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:11.819960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31aee6-64ac-4336-86a6-c30938093d9c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.842272 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2663/5366] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Aug 30 04:43:11 2022] GET /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810/users => generated 145 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:43:11.844854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31aee6-64ac-4336-86a6-c30938093d9c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:11.845915 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2704/5367] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:11.849864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460afb6b-688a-41ed-91b8-5ec642281156 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:11.866694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460afb6b-688a-41ed-91b8-5ec642281156 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.872883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31aee6-64ac-4336-86a6-c30938093d9c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:11.879064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.880701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.880873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb22fca-ee88-458d-9256-a7fa1ebc3710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:11.881364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.881645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb22fca-ee88-458d-9256-a7fa1ebc3710 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:11.882074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/users/0f76ba72cf344f5cb67961887af42523` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.882230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb22fca-ee88-458d-9256-a7fa1ebc3710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:11.882801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb22fca-ee88-458d-9256-a7fa1ebc3710 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:11.884249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0f76ba72cf344f5cb67961887af42523)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.884595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb22fca-ee88-458d-9256-a7fa1ebc3710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:11.889277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb22fca-ee88-458d-9256-a7fa1ebc3710 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.891718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:11.957678 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2705/5368] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:11 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:11.962466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb22fca-ee88-458d-9256-a7fa1ebc3710 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:11.975435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f76ba72cf344f5cb67961887af42523'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:11.989302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f76ba72cf344f5cb67961887af42523'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.011825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f76ba72cf344f5cb67961887af42523'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.027677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f76ba72cf344f5cb67961887af42523'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.030203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f76ba72cf344f5cb67961887af42523'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.043383 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2664/5369] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:11 2022] DELETE /identity/v3/users/0f76ba72cf344f5cb67961887af42523 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:12.048111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:12.049898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:12.105049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb22fca-ee88-458d-9256-a7fa1ebc3710 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:12.124105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:12.190509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec91228-f3c2-41f5-a780-2839fe43573a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:12.192954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b6aee-7969-4d16-9024-48e31ee31277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:12.194040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6aee-7969-4d16-9024-48e31ee31277 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:12.194619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6aee-7969-4d16-9024-48e31ee31277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:12.196052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b6aee-7969-4d16-9024-48e31ee31277 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:12.196827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:12.197306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b6aee-7969-4d16-9024-48e31ee31277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:12.197702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:12.198263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:12.198674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/users/13e247c8af644065b8135ad1914bb5b5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:12.200703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b6aee-7969-4d16-9024-48e31ee31277 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:12.207760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_user(user_id=13e247c8af644065b8135ad1914bb5b5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:12.210314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:12.239814 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2706/5370] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:11 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:43:12.245631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b6aee-7969-4d16-9024-48e31ee31277 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:12.247497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fb5b6aee-7969-4d16-9024-48e31ee31277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:12.263251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b6aee-7969-4d16-9024-48e31ee31277 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:12.274860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d7423-a5fd-4fe1-91c1-e44eb9b815c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:12.276544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7423-a5fd-4fe1-91c1-e44eb9b815c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:12.277001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7423-a5fd-4fe1-91c1-e44eb9b815c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:12.277368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d7423-a5fd-4fe1-91c1-e44eb9b815c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:12.279232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d7423-a5fd-4fe1-91c1-e44eb9b815c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:12.282050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d7423-a5fd-4fe1-91c1-e44eb9b815c3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:12.292082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e247c8af644065b8135ad1914bb5b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.307986 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2707/5371] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:12.312254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d7423-a5fd-4fe1-91c1-e44eb9b815c3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:12.315697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e247c8af644065b8135ad1914bb5b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.328427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d7423-a5fd-4fe1-91c1-e44eb9b815c3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:12.338454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a1fe2-4eca-424f-9e9d-45a73081efe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:12.338753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:12.341192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a1fe2-4eca-424f-9e9d-45a73081efe5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:12.341918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a1fe2-4eca-424f-9e9d-45a73081efe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:12.342377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a1fe2-4eca-424f-9e9d-45a73081efe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:12.344441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a1fe2-4eca-424f-9e9d-45a73081efe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:12.350742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e247c8af644065b8135ad1914bb5b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.352917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a1fe2-4eca-424f-9e9d-45a73081efe5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:12.367855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e247c8af644065b8135ad1914bb5b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.368630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e247c8af644065b8135ad1914bb5b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.383093 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2665/5372] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:12 2022] DELETE /identity/v3/users/13e247c8af644065b8135ad1914bb5b5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:12.383896 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2708/5373] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:43:12.387492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a1fe2-4eca-424f-9e9d-45a73081efe5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:12.387695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:12.390375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ff3a1fe2-4eca-424f-9e9d-45a73081efe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:12.390941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:12.409677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a1fe2-4eca-424f-9e9d-45a73081efe5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:12.485627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cb46e-b374-409d-b5a7-c4956118c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:12.486743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cb46e-b374-409d-b5a7-c4956118c5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:12.487020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cb46e-b374-409d-b5a7-c4956118c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:12.487293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cb46e-b374-409d-b5a7-c4956118c5ed admin admin] PATH_INFO: `/v3/projects/f9a5b709f7e54e45aa67f7cccfa70c09/users/10c88fc94bee4a9395ad6bc3bffa4d45/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:12.513080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cb46e-b374-409d-b5a7-c4956118c5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9a5b709f7e54e45aa67f7cccfa70c09, user_id=10c88fc94bee4a9395ad6bc3bffa4d45, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:12.516192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cb46e-b374-409d-b5a7-c4956118c5ed admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:12.523901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bda1f6-c1ef-4ac5-bdcc-f3b09ebfc4e3 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:12.529630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:12.530520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:12.530801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:12.531210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/users/85f4ad883d584b298200f6413ea1d0e1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:12.532424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_user(user_id=85f4ad883d584b298200f6413ea1d0e1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:12.534927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:12.539248 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2709/5374] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:12 2022] PUT /identity/v3/projects/f9a5b709f7e54e45aa67f7cccfa70c09/users/10c88fc94bee4a9395ad6bc3bffa4d45/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:12.549229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce3008-8a03-43a0-9381-d2de04878aff None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:12.549508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce3008-8a03-43a0-9381-d2de04878aff None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:12.550114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce3008-8a03-43a0-9381-d2de04878aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:12.593772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1dce3008-8a03-43a0-9381-d2de04878aff None None] MFA Rules not processed for user `10c88fc94bee4a9395ad6bc3bffa4d45`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:12.596074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f4ad883d584b298200f6413ea1d0e1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.596639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1dce3008-8a03-43a0-9381-d2de04878aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:12.614240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f4ad883d584b298200f6413ea1d0e1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.635324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f4ad883d584b298200f6413ea1d0e1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.652323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f4ad883d584b298200f6413ea1d0e1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.653736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f4ad883d584b298200f6413ea1d0e1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:12.664592 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2666/5375] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:12 2022] DELETE /identity/v3/users/85f4ad883d584b298200f6413ea1d0e1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:12.672840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:12.678541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:12.700711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:12.704837 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2710/5376] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:12.719160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce3008-8a03-43a0-9381-d2de04878aff None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:12.721133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1dce3008-8a03-43a0-9381-d2de04878aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:12.789649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50609099-f544-4707-8208-9b72f4cd0109 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:12.795252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aeb85f-2b8d-46b4-a943-aea4d95479be tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:12.796112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeb85f-2b8d-46b4-a943-aea4d95479be tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:12.796445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeb85f-2b8d-46b4-a943-aea4d95479be tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:12.796775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aeb85f-2b8d-46b4-a943-aea4d95479be tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/93a2f8ef5ab340a887c3577c2494f810` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:12.798076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aeb85f-2b8d-46b4-a943-aea4d95479be tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_group(group_id=93a2f8ef5ab340a887c3577c2494f810)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:12.800278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aeb85f-2b8d-46b4-a943-aea4d95479be tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:12.807015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:12.829146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce3008-8a03-43a0-9381-d2de04878aff None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:12.855856 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2667/5377] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:43:12 2022] DELETE /identity/v3/groups/93a2f8ef5ab340a887c3577c2494f810 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:12.861523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aeb85f-2b8d-46b4-a943-aea4d95479be tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:12.942306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d258c0-f394-4404-a417-508863db66e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:12.943863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d258c0-f394-4404-a417-508863db66e6 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:12.945091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d258c0-f394-4404-a417-508863db66e6 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:12.945717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d258c0-f394-4404-a417-508863db66e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:12.989435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aeb85f-2b8d-46b4-a943-aea4d95479be tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:13.004463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327995c-b23a-4561-ad52-0be9f10743da tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:13.005692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327995c-b23a-4561-ad52-0be9f10743da tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:13.006286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327995c-b23a-4561-ad52-0be9f10743da tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:13.006823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327995c-b23a-4561-ad52-0be9f10743da tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:13.007812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327995c-b23a-4561-ad52-0be9f10743da tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:13.009619 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-c327995c-b23a-4561-ad52-0be9f10743da tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:13.009619 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:13.009619 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:13.011677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327995c-b23a-4561-ad52-0be9f10743da tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:13.041027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d258c0-f394-4404-a417-508863db66e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:13.042947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d258c0-f394-4404-a417-508863db66e6 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:13.046354 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2668/5378] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:43:12 2022] POST /identity/v3/groups => generated 325 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:13.050095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327995c-b23a-4561-ad52-0be9f10743da tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:13.065579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327995c-b23a-4561-ad52-0be9f10743da tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:13.067718 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2711/5379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:13.073167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e8040-3cd5-4933-885b-ce15fd1ae4d2 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:13.073982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8040-3cd5-4933-885b-ce15fd1ae4d2 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:13.074365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8040-3cd5-4933-885b-ce15fd1ae4d2 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:13.074740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e8040-3cd5-4933-885b-ce15fd1ae4d2 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:13.075479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e8040-3cd5-4933-885b-ce15fd1ae4d2 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:13.077630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e8040-3cd5-4933-885b-ce15fd1ae4d2 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:13.097657 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2669/5380] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:43:13 2022] POST /identity/v3/groups => generated 326 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:13.101522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d258c0-f394-4404-a417-508863db66e6 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:13.119243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d258c0-f394-4404-a417-508863db66e6 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:13.134630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ae8c6-3564-481a-965b-d538ec69385c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:13.135415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ae8c6-3564-481a-965b-d538ec69385c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:13.135948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ae8c6-3564-481a-965b-d538ec69385c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:13.137400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ae8c6-3564-481a-965b-d538ec69385c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:13.138533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ae8c6-3564-481a-965b-d538ec69385c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:13.141265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029ae8c6-3564-481a-965b-d538ec69385c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:13.178946 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2712/5381] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:43:13 2022] POST /identity/v3/groups => generated 325 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:43:13.183037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e8040-3cd5-4933-885b-ce15fd1ae4d2 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:13.195124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e8040-3cd5-4933-885b-ce15fd1ae4d2 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:13.201757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb7d14-79fc-4bd2-ad3e-026cfcdb9330 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:13.202557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb7d14-79fc-4bd2-ad3e-026cfcdb9330 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:13.203080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb7d14-79fc-4bd2-ad3e-026cfcdb9330 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:13.203379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb7d14-79fc-4bd2-ad3e-026cfcdb9330 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:13.204118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb7d14-79fc-4bd2-ad3e-026cfcdb9330 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:13.205448 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-2bcb7d14-79fc-4bd2-ad3e-026cfcdb9330 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:13.205448 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:13.205448 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:13.207107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb7d14-79fc-4bd2-ad3e-026cfcdb9330 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:13.216464 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2670/5382] 10.222.0.43 () {58 vars in 1125 bytes} [Tue Aug 30 04:43:13 2022] GET /identity/v3/groups => generated 1486 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:13.220880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ae8c6-3564-481a-965b-d538ec69385c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:13.239023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ae8c6-3564-481a-965b-d538ec69385c tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:13.252992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d78c3-e92d-4408-897a-360d3278f0c6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:13.252992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d78c3-e92d-4408-897a-360d3278f0c6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:13.252992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d78c3-e92d-4408-897a-360d3278f0c6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:13.253555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d78c3-e92d-4408-897a-360d3278f0c6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/9081987c10974eaaae7dbac84cd8ca74` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:13.269199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d78c3-e92d-4408-897a-360d3278f0c6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_group(group_id=9081987c10974eaaae7dbac84cd8ca74)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:13.275111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d78c3-e92d-4408-897a-360d3278f0c6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:13.302214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:13.385898 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2713/5383] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:43:13 2022] DELETE /identity/v3/groups/9081987c10974eaaae7dbac84cd8ca74 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:13.389771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb7d14-79fc-4bd2-ad3e-026cfcdb9330 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:13.408507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb7d14-79fc-4bd2-ad3e-026cfcdb9330 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:13.526700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34628d4e-cae2-4c73-bef6-812f7b33a145 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:13.527492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628d4e-cae2-4c73-bef6-812f7b33a145 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:13.527829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628d4e-cae2-4c73-bef6-812f7b33a145 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:13.528113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34628d4e-cae2-4c73-bef6-812f7b33a145 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/5484a63f1a904085a95ea930fc91c632` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:13.535017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34628d4e-cae2-4c73-bef6-812f7b33a145 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5484a63f1a904085a95ea930fc91c632)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:13.540157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34628d4e-cae2-4c73-bef6-812f7b33a145 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:13.595335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:13.616936 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2671/5384] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:43:13 2022] DELETE /identity/v3/groups/5484a63f1a904085a95ea930fc91c632 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:13.621922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d78c3-e92d-4408-897a-360d3278f0c6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:13.643886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d78c3-e92d-4408-897a-360d3278f0c6 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:13.798562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a19c1-03a0-4695-98e4-83c2101ffd7b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:13.799235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a19c1-03a0-4695-98e4-83c2101ffd7b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:13.799511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a19c1-03a0-4695-98e4-83c2101ffd7b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:13.799780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a19c1-03a0-4695-98e4-83c2101ffd7b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/ae3f7791743941749da9f3f42af64785` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:13.817379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a19c1-03a0-4695-98e4-83c2101ffd7b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ae3f7791743941749da9f3f42af64785)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:13.825865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a19c1-03a0-4695-98e4-83c2101ffd7b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:13.952547 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2714/5385] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:43:13 2022] DELETE /identity/v3/groups/ae3f7791743941749da9f3f42af64785 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:13.958078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34628d4e-cae2-4c73-bef6-812f7b33a145 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:13.997766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34628d4e-cae2-4c73-bef6-812f7b33a145 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:14.174182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76775-1aff-4189-8986-16af85d80acf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:14.174831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76775-1aff-4189-8986-16af85d80acf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:14.175107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76775-1aff-4189-8986-16af85d80acf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:14.175502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76775-1aff-4189-8986-16af85d80acf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:14.176020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d76775-1aff-4189-8986-16af85d80acf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:14.177925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d76775-1aff-4189-8986-16af85d80acf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:14.225123 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2672/5386] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:13 2022] POST /identity/v3/users => generated 321 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:14.225862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a19c1-03a0-4695-98e4-83c2101ffd7b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:14.254695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a19c1-03a0-4695-98e4-83c2101ffd7b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:14.265430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6290fc-c360-4db2-a3c7-c4b749b4183b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:14.266387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6290fc-c360-4db2-a3c7-c4b749b4183b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:14.266665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6290fc-c360-4db2-a3c7-c4b749b4183b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:14.266933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6290fc-c360-4db2-a3c7-c4b749b4183b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:14.267865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6290fc-c360-4db2-a3c7-c4b749b4183b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:14.271267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6290fc-c360-4db2-a3c7-c4b749b4183b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:14.304604 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2715/5387] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:43:14 2022] POST /identity/v3/groups => generated 325 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:43:14.306977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76775-1aff-4189-8986-16af85d80acf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:14.322439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d76775-1aff-4189-8986-16af85d80acf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:14.328395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c361c-9937-4311-aa1d-83c0e928ed01 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:14.329163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c361c-9937-4311-aa1d-83c0e928ed01 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:14.329556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c361c-9937-4311-aa1d-83c0e928ed01 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:14.329994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c361c-9937-4311-aa1d-83c0e928ed01 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/758d087ef4224748b560a847d623a7b4/users/26f77afa39394c31bcd21d3e83ed8610` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:14.368158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c361c-9937-4311-aa1d-83c0e928ed01 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=758d087ef4224748b560a847d623a7b4, user_id=26f77afa39394c31bcd21d3e83ed8610)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:14.370463 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-cb5c361c-9937-4311-aa1d-83c0e928ed01 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:14.370463 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:14.370463 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:14.371767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c361c-9937-4311-aa1d-83c0e928ed01 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:14.411244 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2673/5388] 10.222.0.43 () {60 vars in 1360 bytes} [Tue Aug 30 04:43:14 2022] PUT /identity/v3/groups/758d087ef4224748b560a847d623a7b4/users/26f77afa39394c31bcd21d3e83ed8610 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:14.412504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6290fc-c360-4db2-a3c7-c4b749b4183b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:14.423937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6290fc-c360-4db2-a3c7-c4b749b4183b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:14.503687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d295b-5d34-4d87-8350-f905af16ec8b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:14.504737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d295b-5d34-4d87-8350-f905af16ec8b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:14.505341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d295b-5d34-4d87-8350-f905af16ec8b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:14.505786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d295b-5d34-4d87-8350-f905af16ec8b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:14.506643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d295b-5d34-4d87-8350-f905af16ec8b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:14.509341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d295b-5d34-4d87-8350-f905af16ec8b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:14.534616 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2716/5389] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:43:14 2022] POST /identity/v3/groups => generated 326 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:14.535802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c361c-9937-4311-aa1d-83c0e928ed01 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:14.556532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c361c-9937-4311-aa1d-83c0e928ed01 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:14.566713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1119d-07e3-4af6-a40f-caaafb21193e tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:14.567391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1119d-07e3-4af6-a40f-caaafb21193e tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:14.567669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1119d-07e3-4af6-a40f-caaafb21193e tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:14.567937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1119d-07e3-4af6-a40f-caaafb21193e tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/259c88195d1243589e727e43ace38fea/users/26f77afa39394c31bcd21d3e83ed8610` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:14.585353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1119d-07e3-4af6-a40f-caaafb21193e tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=259c88195d1243589e727e43ace38fea, user_id=26f77afa39394c31bcd21d3e83ed8610)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:14.587911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1119d-07e3-4af6-a40f-caaafb21193e tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:14.647461 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2674/5390] 10.222.0.43 () {60 vars in 1360 bytes} [Tue Aug 30 04:43:14 2022] PUT /identity/v3/groups/259c88195d1243589e727e43ace38fea/users/26f77afa39394c31bcd21d3e83ed8610 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:14.648126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d295b-5d34-4d87-8350-f905af16ec8b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:14.657151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:14.674980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d295b-5d34-4d87-8350-f905af16ec8b tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:14.836039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f38d6-2afb-4a3e-9250-6ee0cef4732a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:14.836718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f38d6-2afb-4a3e-9250-6ee0cef4732a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:14.836997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f38d6-2afb-4a3e-9250-6ee0cef4732a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:14.837266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f38d6-2afb-4a3e-9250-6ee0cef4732a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/users/26f77afa39394c31bcd21d3e83ed8610/groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:14.839653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f38d6-2afb-4a3e-9250-6ee0cef4732a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=26f77afa39394c31bcd21d3e83ed8610)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:14.841800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f38d6-2afb-4a3e-9250-6ee0cef4732a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:14.884391 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2717/5391] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Aug 30 04:43:14 2022] GET /identity/v3/users/26f77afa39394c31bcd21d3e83ed8610/groups => generated 837 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:14.888565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1119d-07e3-4af6-a40f-caaafb21193e tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:14.910710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1119d-07e3-4af6-a40f-caaafb21193e tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:14.922112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787a3a-348d-4807-aff3-7d1fec59a538 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:14.922774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787a3a-348d-4807-aff3-7d1fec59a538 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:14.923047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787a3a-348d-4807-aff3-7d1fec59a538 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:14.923342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e787a3a-348d-4807-aff3-7d1fec59a538 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/259c88195d1243589e727e43ace38fea` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:14.925615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e787a3a-348d-4807-aff3-7d1fec59a538 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_group(group_id=259c88195d1243589e727e43ace38fea)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:14.927757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e787a3a-348d-4807-aff3-7d1fec59a538 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:15.058358 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2675/5392] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:43:14 2022] DELETE /identity/v3/groups/259c88195d1243589e727e43ace38fea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:15.059601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f38d6-2afb-4a3e-9250-6ee0cef4732a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:15.070047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f38d6-2afb-4a3e-9250-6ee0cef4732a tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:15.181563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e4d8f-a102-459d-b858-4fcad5740c91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:15.182261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e4d8f-a102-459d-b858-4fcad5740c91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:15.182541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e4d8f-a102-459d-b858-4fcad5740c91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:15.186803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e4d8f-a102-459d-b858-4fcad5740c91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/groups/758d087ef4224748b560a847d623a7b4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:15.188299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e4d8f-a102-459d-b858-4fcad5740c91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_group(group_id=758d087ef4224748b560a847d623a7b4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:15.191654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e4d8f-a102-459d-b858-4fcad5740c91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:15.333589 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2718/5393] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:43:15 2022] DELETE /identity/v3/groups/758d087ef4224748b560a847d623a7b4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:15.338139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787a3a-348d-4807-aff3-7d1fec59a538 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:15.361385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e787a3a-348d-4807-aff3-7d1fec59a538 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:15.469138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:15.543134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:15.544186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:15.544627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:15.545025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/users/26f77afa39394c31bcd21d3e83ed8610` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:15.546463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_user(user_id=26f77afa39394c31bcd21d3e83ed8610)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:15.548551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:15.613099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26f77afa39394c31bcd21d3e83ed8610'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:15.622834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26f77afa39394c31bcd21d3e83ed8610'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:15.644909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26f77afa39394c31bcd21d3e83ed8610'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:15.656979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26f77afa39394c31bcd21d3e83ed8610'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:15.657699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26f77afa39394c31bcd21d3e83ed8610'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:15.671043 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2676/5394] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:15 2022] DELETE /identity/v3/users/26f77afa39394c31bcd21d3e83ed8610 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:15.676490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e4d8f-a102-459d-b858-4fcad5740c91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:15.679744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-576e4d8f-a102-459d-b858-4fcad5740c91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:15.698989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e4d8f-a102-459d-b858-4fcad5740c91 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:15.759014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:15.774894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:15.775594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:15.776197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:15.776658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/domains/358dec6d601e48939d351d70985e2203` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:15.778342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=358dec6d601e48939d351d70985e2203)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:15.780441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:15.808363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '358dec6d601e48939d351d70985e2203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:15.809348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '358dec6d601e48939d351d70985e2203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:15.841653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '358dec6d601e48939d351d70985e2203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:15.842656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '358dec6d601e48939d351d70985e2203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:15.850367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:15.857205 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2719/5395] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:43:15 2022] PATCH /identity/v3/domains/358dec6d601e48939d351d70985e2203 => generated 277 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:43:15.862834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691cb746-4613-4aed-99f4-0c262a4514c7 tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:15.939009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e40487e8c7c04d369c7f84ba8ff26917', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1bf8cfb77fd349a88fd229e1243080fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:15.939655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:15.939928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:15.940194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] PATH_INFO: `/v3/domains/358dec6d601e48939d351d70985e2203` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:15.952048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=358dec6d601e48939d351d70985e2203)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:15.953727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:15.979588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '358dec6d601e48939d351d70985e2203'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:15.986436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '358dec6d601e48939d351d70985e2203'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.003960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:16.070225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358dec6d601e48939d351d70985e2203', 'request_id': 'req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.081289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358dec6d601e48939d351d70985e2203', 'request_id': 'req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.091953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358dec6d601e48939d351d70985e2203', 'request_id': 'req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.108279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] The token cache is being invalidate because project 358dec6d601e48939d351d70985e2203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:16.108562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.109290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.118951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '358dec6d601e48939d351d70985e2203', 'request_id': 'req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.120112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '358dec6d601e48939d351d70985e2203', 'request_id': 'req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.123946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '358dec6d601e48939d351d70985e2203', 'request_id': 'req-b44ffe75-c140-4b5f-86f1-5e5a9aef69bd'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.130648 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2677/5396] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:15 2022] DELETE /identity/v3/domains/358dec6d601e48939d351d70985e2203 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:16.136662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:16.138165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:16.291191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560e9a8-8dca-4b69-9e3a-0f5201f82cdf tempest-GroupsV3TestJSON-1023528897 tempest-GroupsV3TestJSON-1023528897-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:16.361755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:16.362436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:16.362710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:16.363047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] PATH_INFO: `/v3/users/7217d4a84f924517b892ead2fc22b46e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:16.364309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7217d4a84f924517b892ead2fc22b46e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:16.366432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:16.440162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7217d4a84f924517b892ead2fc22b46e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.441586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7217d4a84f924517b892ead2fc22b46e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.452660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7217d4a84f924517b892ead2fc22b46e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.470539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7217d4a84f924517b892ead2fc22b46e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.480383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:16.504923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7217d4a84f924517b892ead2fc22b46e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:16.519202 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2720/5397] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:16 2022] DELETE /identity/v3/users/7217d4a84f924517b892ead2fc22b46e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:16.523621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f00c0-a638-4dc1-ad0f-c8363bf52902 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:16.524509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f00c0-a638-4dc1-ad0f-c8363bf52902 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:16.524981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f00c0-a638-4dc1-ad0f-c8363bf52902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:16.575057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-571f00c0-a638-4dc1-ad0f-c8363bf52902 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:16.577495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-571f00c0-a638-4dc1-ad0f-c8363bf52902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:16.706364 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2678/5398] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:16.735910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:16.738128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:16.888458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab5f94-a49f-4312-b323-837c57db34d1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:16.903888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44871a4-6346-4f2e-b122-ba1f215efb35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:16.904658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44871a4-6346-4f2e-b122-ba1f215efb35 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:16.904929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44871a4-6346-4f2e-b122-ba1f215efb35 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:16.905203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44871a4-6346-4f2e-b122-ba1f215efb35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:16.927163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44871a4-6346-4f2e-b122-ba1f215efb35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:16.929079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44871a4-6346-4f2e-b122-ba1f215efb35 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:16.966506 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2721/5399] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:17.736004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f00c0-a638-4dc1-ad0f-c8363bf52902 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:17.738115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-571f00c0-a638-4dc1-ad0f-c8363bf52902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:17.763069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f00c0-a638-4dc1-ad0f-c8363bf52902 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:17.778650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:17.779473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:17.780451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:17.780792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] PATH_INFO: `/v3/projects/c2c9fd98f97243efae980ac230704881` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:17.782564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c9fd98f97243efae980ac230704881)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:17.784751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:17.865454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c9fd98f97243efae980ac230704881', 'request_id': 'req-0597c046-5e3f-43ee-ae76-667ac85d4929'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:17.883016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c9fd98f97243efae980ac230704881', 'request_id': 'req-0597c046-5e3f-43ee-ae76-667ac85d4929'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:17.894497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c9fd98f97243efae980ac230704881', 'request_id': 'req-0597c046-5e3f-43ee-ae76-667ac85d4929'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:17.944106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] The token cache is being invalidate because project c2c9fd98f97243efae980ac230704881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:17.944445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:17.947098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:17.953172 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2679/5400] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:17 2022] DELETE /identity/v3/projects/c2c9fd98f97243efae980ac230704881 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:17.954511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44871a4-6346-4f2e-b122-ba1f215efb35 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:17.978737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44871a4-6346-4f2e-b122-ba1f215efb35 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:18.108686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:18.109281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:18.109555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:18.109821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] PATH_INFO: `/v3/users/e40487e8c7c04d369c7f84ba8ff26917` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:18.111103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40487e8c7c04d369c7f84ba8ff26917)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:18.113057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:18.255115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40487e8c7c04d369c7f84ba8ff26917'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:18.258145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40487e8c7c04d369c7f84ba8ff26917'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:18.275943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40487e8c7c04d369c7f84ba8ff26917'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:18.293008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40487e8c7c04d369c7f84ba8ff26917'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:18.316958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ceb86990-ae8c-4a6f-87eb-fb5ee382a4f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40487e8c7c04d369c7f84ba8ff26917'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:18.328741 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2722/5401] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:17 2022] DELETE /identity/v3/users/e40487e8c7c04d369c7f84ba8ff26917 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:19.195755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:19.198643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:19.230485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:19.243084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597c046-5e3f-43ee-ae76-667ac85d4929 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:19.428737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:19.429662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:19.430719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:19.431431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] PATH_INFO: `/v3/projects/1bf8cfb77fd349a88fd229e1243080fe` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:19.433521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf8cfb77fd349a88fd229e1243080fe)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:19.435873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:19.525687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf8cfb77fd349a88fd229e1243080fe', 'request_id': 'req-409f0485-87fc-4f00-9d70-3bffe3f533e9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:19.543067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf8cfb77fd349a88fd229e1243080fe', 'request_id': 'req-409f0485-87fc-4f00-9d70-3bffe3f533e9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:19.556957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf8cfb77fd349a88fd229e1243080fe', 'request_id': 'req-409f0485-87fc-4f00-9d70-3bffe3f533e9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:19.578349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] The token cache is being invalidate because project 1bf8cfb77fd349a88fd229e1243080fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:19.578775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:19.579692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-409f0485-87fc-4f00-9d70-3bffe3f533e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:19.585797 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2680/5402] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:19 2022] DELETE /identity/v3/projects/1bf8cfb77fd349a88fd229e1243080fe => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:19.589292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a654e-63d6-4b33-b236-c044fbed7fe5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:19.589292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a654e-63d6-4b33-b236-c044fbed7fe5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:19.589292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a654e-63d6-4b33-b236-c044fbed7fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:19.599642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:19.619954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b36a654e-63d6-4b33-b236-c044fbed7fe5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:19.625041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b36a654e-63d6-4b33-b236-c044fbed7fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:19.734358 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2723/5403] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:19.744178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7056065-f98a-4990-b5c1-58d82bbce1e8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:19.745131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7056065-f98a-4990-b5c1-58d82bbce1e8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:19.745506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7056065-f98a-4990-b5c1-58d82bbce1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:19.788361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d7056065-f98a-4990-b5c1-58d82bbce1e8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:19.790099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d7056065-f98a-4990-b5c1-58d82bbce1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:19.806424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a654e-63d6-4b33-b236-c044fbed7fe5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:19.836847 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2681/5404] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:19.845422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a654e-63d6-4b33-b236-c044fbed7fe5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:19.859348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c33ea-d6ce-451c-8ea5-d0d782c5ebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:19.860571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c33ea-d6ce-451c-8ea5-d0d782c5ebff admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:19.860910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c33ea-d6ce-451c-8ea5-d0d782c5ebff admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:19.861361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c33ea-d6ce-451c-8ea5-d0d782c5ebff admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:19.871093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c33ea-d6ce-451c-8ea5-d0d782c5ebff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:19.873728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c33ea-d6ce-451c-8ea5-d0d782c5ebff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:19.881242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c33ea-d6ce-451c-8ea5-d0d782c5ebff admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:19.930841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7056065-f98a-4990-b5c1-58d82bbce1e8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:19.946356 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2724/5405] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:19.953071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7056065-f98a-4990-b5c1-58d82bbce1e8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:19.962009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff22dfe-1e50-4ca3-bd5c-48824eca7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:19.963026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff22dfe-1e50-4ca3-bd5c-48824eca7fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:19.963026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff22dfe-1e50-4ca3-bd5c-48824eca7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:19.964078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff22dfe-1e50-4ca3-bd5c-48824eca7fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:19.965271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff22dfe-1e50-4ca3-bd5c-48824eca7fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:19.967673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff22dfe-1e50-4ca3-bd5c-48824eca7fe2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:20.036802 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2682/5406] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:19 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:20.039294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c33ea-d6ce-451c-8ea5-d0d782c5ebff admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:20.109466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c33ea-d6ce-451c-8ea5-d0d782c5ebff admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:20.321961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3476b-ca73-4853-980a-85ec368b65a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:20.322625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3476b-ca73-4853-980a-85ec368b65a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:20.322905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3476b-ca73-4853-980a-85ec368b65a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:20.323178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3476b-ca73-4853-980a-85ec368b65a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:20.323845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3476b-ca73-4853-980a-85ec368b65a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:20.325822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3476b-ca73-4853-980a-85ec368b65a8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:20.386382 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2725/5407] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:20 2022] POST /identity/v3/users => generated 283 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:20.388355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff22dfe-1e50-4ca3-bd5c-48824eca7fe2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:20.411575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff22dfe-1e50-4ca3-bd5c-48824eca7fe2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:20.432507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff163d-ff50-4a25-9258-9aebd627f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:20.435879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff163d-ff50-4a25-9258-9aebd627f114 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:20.437638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff163d-ff50-4a25-9258-9aebd627f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:20.438004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff163d-ff50-4a25-9258-9aebd627f114 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:20.438838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff163d-ff50-4a25-9258-9aebd627f114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:20.440582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff163d-ff50-4a25-9258-9aebd627f114 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:20.471439 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2683/5408] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:20.474971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3476b-ca73-4853-980a-85ec368b65a8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:20.494121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3476b-ca73-4853-980a-85ec368b65a8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:20.505095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc9919-1927-4911-bd81-9d9cf7a08277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:20.506159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc9919-1927-4911-bd81-9d9cf7a08277 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:20.507100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc9919-1927-4911-bd81-9d9cf7a08277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:20.523831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc9919-1927-4911-bd81-9d9cf7a08277 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:20.524795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc9919-1927-4911-bd81-9d9cf7a08277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:20.528375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc9919-1927-4911-bd81-9d9cf7a08277 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:20.552347 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2726/5409] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:20.555660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff163d-ff50-4a25-9258-9aebd627f114 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:20.571932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff163d-ff50-4a25-9258-9aebd627f114 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:20.584102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49e58b-d75e-49e2-870d-e9fc4319e771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:20.585535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49e58b-d75e-49e2-870d-e9fc4319e771 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:20.588713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49e58b-d75e-49e2-870d-e9fc4319e771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:20.589217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49e58b-d75e-49e2-870d-e9fc4319e771 admin admin] PATH_INFO: `/v3/projects/8b8c1ec46f4b48ac96111059197ec958/users/87b34f6d15b3427087db3034358121ad/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:20.637208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49e58b-d75e-49e2-870d-e9fc4319e771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b8c1ec46f4b48ac96111059197ec958, user_id=87b34f6d15b3427087db3034358121ad, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:20.661381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49e58b-d75e-49e2-870d-e9fc4319e771 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:20.734492 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2684/5410] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:20 2022] PUT /identity/v3/projects/8b8c1ec46f4b48ac96111059197ec958/users/87b34f6d15b3427087db3034358121ad/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:20.749991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8bc54-c550-49ba-ae3a-dfd17b42f726 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:20.750476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8bc54-c550-49ba-ae3a-dfd17b42f726 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:20.750570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8bc54-c550-49ba-ae3a-dfd17b42f726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:20.898197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-52b8bc54-c550-49ba-ae3a-dfd17b42f726 None None] MFA Rules not processed for user `87b34f6d15b3427087db3034358121ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:20.904634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-52b8bc54-c550-49ba-ae3a-dfd17b42f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:20.970027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49e58b-d75e-49e2-870d-e9fc4319e771 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:20.972936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c49e58b-d75e-49e2-870d-e9fc4319e771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:21.086755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:21.090049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:21.111524 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2727/5411] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:21.112411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8bc54-c550-49ba-ae3a-dfd17b42f726 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:21.114757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-52b8bc54-c550-49ba-ae3a-dfd17b42f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:21.196565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49e58b-d75e-49e2-870d-e9fc4319e771 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:21.213187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:21.213853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:21.214156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:21.214451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] PATH_INFO: `/v3/users/10c88fc94bee4a9395ad6bc3bffa4d45` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:21.225554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c88fc94bee4a9395ad6bc3bffa4d45)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:21.225554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:21.295824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8bc54-c550-49ba-ae3a-dfd17b42f726 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:21.319860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:21.322926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:21.323210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:21.323466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] PATH_INFO: `/v3/users/98f67d6dc43346b886ab9ce97d017eb1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:21.325677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f67d6dc43346b886ab9ce97d017eb1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:21.327703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:21.366116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c88fc94bee4a9395ad6bc3bffa4d45'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:21.382820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c88fc94bee4a9395ad6bc3bffa4d45'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:21.403195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c88fc94bee4a9395ad6bc3bffa4d45'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:21.420874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c88fc94bee4a9395ad6bc3bffa4d45'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:21.422512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c88fc94bee4a9395ad6bc3bffa4d45'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:21.439407 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2685/5412] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:20 2022] DELETE /identity/v3/users/10c88fc94bee4a9395ad6bc3bffa4d45 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:21.440527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:21.445410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f67d6dc43346b886ab9ce97d017eb1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:21.445841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:21.449121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f67d6dc43346b886ab9ce97d017eb1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:21.467308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f67d6dc43346b886ab9ce97d017eb1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:21.490400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f67d6dc43346b886ab9ce97d017eb1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:21.522399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2914fb3-bf26-4ce8-8b5c-290044d87104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f67d6dc43346b886ab9ce97d017eb1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:21.556143 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2728/5413] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:21 2022] DELETE /identity/v3/users/98f67d6dc43346b886ab9ce97d017eb1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:21.566496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d25bd-5b78-4768-83ef-498ba09b6905 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:21.566824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d25bd-5b78-4768-83ef-498ba09b6905 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:21.567093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d25bd-5b78-4768-83ef-498ba09b6905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:21.657757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-669d25bd-5b78-4768-83ef-498ba09b6905 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:21.660062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-669d25bd-5b78-4768-83ef-498ba09b6905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:21.698905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28699b-a4e3-4b85-9b61-1c2b49d813d6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:21.898357 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2729/5414] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:21.898919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a737-f3fd-48d6-b82c-95c57abbc460 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:21.899188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a737-f3fd-48d6-b82c-95c57abbc460 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:21.907748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61a737-f3fd-48d6-b82c-95c57abbc460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:21.921205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:21.949661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6067-1c63-4a62-8ec2-fde3f7202ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:21.950483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6067-1c63-4a62-8ec2-fde3f7202ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:21.950757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6067-1c63-4a62-8ec2-fde3f7202ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:21.952040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac6067-1c63-4a62-8ec2-fde3f7202ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:21.953310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac6067-1c63-4a62-8ec2-fde3f7202ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:21.960824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac6067-1c63-4a62-8ec2-fde3f7202ae1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:21.979593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2f61a737-f3fd-48d6-b82c-95c57abbc460 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:21.987242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2f61a737-f3fd-48d6-b82c-95c57abbc460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:22.025350 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2730/5415] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:22.025350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61a737-f3fd-48d6-b82c-95c57abbc460 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:22.030609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2f61a737-f3fd-48d6-b82c-95c57abbc460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:22.060181 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2686/5416] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:21 2022] POST /identity/v3/projects => generated 367 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:22.067282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6067-1c63-4a62-8ec2-fde3f7202ae1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:22.070820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-89ac6067-1c63-4a62-8ec2-fde3f7202ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:22.093066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:22.232188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61a737-f3fd-48d6-b82c-95c57abbc460 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:22.274295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac6067-1c63-4a62-8ec2-fde3f7202ae1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:22.288762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f8dbc-c39f-491f-b91e-a675bc457333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:22.289670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f8dbc-c39f-491f-b91e-a675bc457333 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:22.289987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f8dbc-c39f-491f-b91e-a675bc457333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:22.290256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f8dbc-c39f-491f-b91e-a675bc457333 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:22.291082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f8dbc-c39f-491f-b91e-a675bc457333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:22.293050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f8dbc-c39f-491f-b91e-a675bc457333 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:22.347596 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2687/5417] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:22 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:22.352605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f8dbc-c39f-491f-b91e-a675bc457333 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:22.357453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca60053-2e5c-434e-ac32-dde86f828d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:22.358133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca60053-2e5c-434e-ac32-dde86f828d6f service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:22.358408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca60053-2e5c-434e-ac32-dde86f828d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:22.358673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca60053-2e5c-434e-ac32-dde86f828d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:22.359657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-940f8dbc-c39f-491f-b91e-a675bc457333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:22.396584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca60053-2e5c-434e-ac32-dde86f828d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:22.403416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f8dbc-c39f-491f-b91e-a675bc457333 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:22.404796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca60053-2e5c-434e-ac32-dde86f828d6f service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:22.418561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a6c3-3481-4b65-a4e4-847651aaf1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:22.419352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a6c3-3481-4b65-a4e4-847651aaf1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:22.419645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a6c3-3481-4b65-a4e4-847651aaf1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:22.419889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a6c3-3481-4b65-a4e4-847651aaf1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:22.432996 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2731/5418] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:22.433839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca60053-2e5c-434e-ac32-dde86f828d6f service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:22.447780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3a6c3-3481-4b65-a4e4-847651aaf1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:22.452342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3a6c3-3481-4b65-a4e4-847651aaf1f5 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:22.456228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca60053-2e5c-434e-ac32-dde86f828d6f service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:22.465904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010ef9-b17d-4a2f-acef-51726950b307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:22.469904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010ef9-b17d-4a2f-acef-51726950b307 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:22.470191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010ef9-b17d-4a2f-acef-51726950b307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:22.470507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f010ef9-b17d-4a2f-acef-51726950b307 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:22.471182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f010ef9-b17d-4a2f-acef-51726950b307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:22.472824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f010ef9-b17d-4a2f-acef-51726950b307 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:22.477511 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2688/5419] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:22.501373 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2732/5420] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:22.506209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a6c3-3481-4b65-a4e4-847651aaf1f5 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:22.518903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a6c3-3481-4b65-a4e4-847651aaf1f5 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:22.525817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475f6f-5315-4189-817b-7e39165bcad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:22.526505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475f6f-5315-4189-817b-7e39165bcad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:22.526779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475f6f-5315-4189-817b-7e39165bcad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:22.527042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475f6f-5315-4189-817b-7e39165bcad5 admin admin] PATH_INFO: `/v3/projects/b4b3473894584260aaa29db97b563f5e/users/a6644d2092bf440b92c3d3b7a4860292/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:22.546596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475f6f-5315-4189-817b-7e39165bcad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b3473894584260aaa29db97b563f5e, user_id=a6644d2092bf440b92c3d3b7a4860292, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:22.549526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475f6f-5315-4189-817b-7e39165bcad5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:22.581280 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2689/5421] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:22 2022] PUT /identity/v3/projects/b4b3473894584260aaa29db97b563f5e/users/a6644d2092bf440b92c3d3b7a4860292/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:22.582408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010ef9-b17d-4a2f-acef-51726950b307 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:22.601362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f010ef9-b17d-4a2f-acef-51726950b307 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:22.762955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87e54e-d28b-489c-b6ae-4bdfe7476ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:22.763908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e54e-d28b-489c-b6ae-4bdfe7476ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:22.764266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e54e-d28b-489c-b6ae-4bdfe7476ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:22.764545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e54e-d28b-489c-b6ae-4bdfe7476ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:22.765719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87e54e-d28b-489c-b6ae-4bdfe7476ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:22.767666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87e54e-d28b-489c-b6ae-4bdfe7476ca5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:22.784956 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2733/5422] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:43:22.789089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475f6f-5315-4189-817b-7e39165bcad5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:22.804403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475f6f-5315-4189-817b-7e39165bcad5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:22.813053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc727ef5-5d10-4412-9475-c91a12c02dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:22.813774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc727ef5-5d10-4412-9475-c91a12c02dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:22.814238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc727ef5-5d10-4412-9475-c91a12c02dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:22.814518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc727ef5-5d10-4412-9475-c91a12c02dc2 admin admin] PATH_INFO: `/v3/projects/b4b3473894584260aaa29db97b563f5e/users/a6644d2092bf440b92c3d3b7a4860292/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:22.817310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc727ef5-5d10-4412-9475-c91a12c02dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b3473894584260aaa29db97b563f5e, user_id=a6644d2092bf440b92c3d3b7a4860292, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:22.824479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc727ef5-5d10-4412-9475-c91a12c02dc2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:22.839708 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2690/5423] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:22 2022] PUT /identity/v3/projects/b4b3473894584260aaa29db97b563f5e/users/a6644d2092bf440b92c3d3b7a4860292/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:22.852267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77170d-08fd-4c01-ac69-764658242497 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:22.852508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77170d-08fd-4c01-ac69-764658242497 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:22.854096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77170d-08fd-4c01-ac69-764658242497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:22.912582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6c77170d-08fd-4c01-ac69-764658242497 None None] MFA Rules not processed for user `a6644d2092bf440b92c3d3b7a4860292`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:22.914712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6c77170d-08fd-4c01-ac69-764658242497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:23.068333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:23.154953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc727ef5-5d10-4412-9475-c91a12c02dc2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:23.155422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2734/5424] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:23.175118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc727ef5-5d10-4412-9475-c91a12c02dc2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:23.190109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec51dd-a610-42aa-9e78-6035888398ee tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:23.190755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec51dd-a610-42aa-9e78-6035888398ee tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:23.191037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec51dd-a610-42aa-9e78-6035888398ee tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:23.191302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec51dd-a610-42aa-9e78-6035888398ee tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:23.191993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec51dd-a610-42aa-9e78-6035888398ee tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:23.193725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec51dd-a610-42aa-9e78-6035888398ee tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:23.216051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77170d-08fd-4c01-ac69-764658242497 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:23.217613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6c77170d-08fd-4c01-ac69-764658242497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:23.236205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2691/5425] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:43:23 2022] POST /identity/v3/domains => generated 277 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:23.247117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec51dd-a610-42aa-9e78-6035888398ee tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:23.388859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec51dd-a610-42aa-9e78-6035888398ee tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:23.397833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77170d-08fd-4c01-ac69-764658242497 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:23.404928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9082d-4983-4e4e-93ea-f9d54b983de0 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:23.406762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9082d-4983-4e4e-93ea-f9d54b983de0 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:23.407270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9082d-4983-4e4e-93ea-f9d54b983de0 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:23.408131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9082d-4983-4e4e-93ea-f9d54b983de0 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:23.409150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9082d-4983-4e4e-93ea-f9d54b983de0 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:23.413844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9082d-4983-4e4e-93ea-f9d54b983de0 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:23.470381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:23.520249 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2692/5426] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:23 2022] POST /identity/v3/users => generated 348 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:23.522046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9082d-4983-4e4e-93ea-f9d54b983de0 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:23.550750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3df9082d-4983-4e4e-93ea-f9d54b983de0 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:23.566321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:23.568034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:23.568393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:23.568618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] PATH_INFO: `/v3/projects/3efc53ea7b4647c9b10504453c064683` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:23.571344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efc53ea7b4647c9b10504453c064683)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:23.576398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:23.580826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9082d-4983-4e4e-93ea-f9d54b983de0 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:23.590321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:23.591353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:23.592119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:23.592618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] PATH_INFO: `/v3/projects/f9a5b709f7e54e45aa67f7cccfa70c09` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:23.596559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9a5b709f7e54e45aa67f7cccfa70c09)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:23.600792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:23.686629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efc53ea7b4647c9b10504453c064683', 'request_id': 'req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:23.696746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9a5b709f7e54e45aa67f7cccfa70c09', 'request_id': 'req-f22065fb-4e13-400d-a420-68a90a199da1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:23.698977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efc53ea7b4647c9b10504453c064683', 'request_id': 'req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:23.716311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9a5b709f7e54e45aa67f7cccfa70c09', 'request_id': 'req-f22065fb-4e13-400d-a420-68a90a199da1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:23.721767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efc53ea7b4647c9b10504453c064683', 'request_id': 'req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:23.748673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9a5b709f7e54e45aa67f7cccfa70c09', 'request_id': 'req-f22065fb-4e13-400d-a420-68a90a199da1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:23.772292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] The token cache is being invalidate because project 3efc53ea7b4647c9b10504453c064683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:23.777313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:23.781498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:23.790771 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2735/5427] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:23 2022] DELETE /identity/v3/projects/3efc53ea7b4647c9b10504453c064683 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:23.792207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:23.795948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] The token cache is being invalidate because project f9a5b709f7e54e45aa67f7cccfa70c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:23.797106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:23.797652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:23.799101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:23.801758 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2693/5428] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:23 2022] DELETE /identity/v3/projects/f9a5b709f7e54e45aa67f7cccfa70c09 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:23.803203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:23.806968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:23.831305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:23.894085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7f63e4-c8c3-4309-ab8f-2277685f72ab admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:23.912049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22065fb-4e13-400d-a420-68a90a199da1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:23.919212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:23.919884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:23.920161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:23.920542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] PATH_INFO: `/v3/users/e2cdbb6d555b48e1985d21bf26792d12` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:23.922244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cdbb6d555b48e1985d21bf26792d12)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:23.924791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:23.975749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32af7d-d3c4-43e6-b5d6-8d380c18e28d tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:23.977402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32af7d-d3c4-43e6-b5d6-8d380c18e28d tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:23.978119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32af7d-d3c4-43e6-b5d6-8d380c18e28d tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:23.978652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32af7d-d3c4-43e6-b5d6-8d380c18e28d tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:23.980908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32af7d-d3c4-43e6-b5d6-8d380c18e28d tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:23.983933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32af7d-d3c4-43e6-b5d6-8d380c18e28d tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.002904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cdbb6d555b48e1985d21bf26792d12'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:24.010994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cdbb6d555b48e1985d21bf26792d12'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:24.030074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cdbb6d555b48e1985d21bf26792d12'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:24.032203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=4,keystone:SELECT=80,keystone:DELETE=16 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:24.041272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cdbb6d555b48e1985d21bf26792d12'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:24.042061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab7c22d1-4743-4931-a8dc-a7e40f3610b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cdbb6d555b48e1985d21bf26792d12'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:24.048292 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2736/5429] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:23 2022] POST /identity/v3/users => generated 323 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:24.052196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b51618-00f0-4b53-b452-88cc4706f135 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.053108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b51618-00f0-4b53-b452-88cc4706f135 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.053577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b51618-00f0-4b53-b452-88cc4706f135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.066441 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2694/5430] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:23 2022] DELETE /identity/v3/users/e2cdbb6d555b48e1985d21bf26792d12 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:24.073071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ca188-a1b6-4ac5-9e2f-3bee658eccd8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.073385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ca188-a1b6-4ac5-9e2f-3bee658eccd8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.073655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ca188-a1b6-4ac5-9e2f-3bee658eccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.078927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-70b51618-00f0-4b53-b452-88cc4706f135 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:24.080918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-70b51618-00f0-4b53-b452-88cc4706f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:24.129557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a26ca188-a1b6-4ac5-9e2f-3bee658eccd8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:24.133333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a26ca188-a1b6-4ac5-9e2f-3bee658eccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:24.215272 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2737/5431] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:24.217024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b51618-00f0-4b53-b452-88cc4706f135 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.218617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-70b51618-00f0-4b53-b452-88cc4706f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:24.231877 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2695/5432] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:24.231877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939d865-5bc0-4eef-9bff-06ba82e0b508 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.231877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939d865-5bc0-4eef-9bff-06ba82e0b508 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.231877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939d865-5bc0-4eef-9bff-06ba82e0b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.274588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4939d865-5bc0-4eef-9bff-06ba82e0b508 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:24.276253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4939d865-5bc0-4eef-9bff-06ba82e0b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:24.286730 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2696/5433] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:24.292402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b289ca-b756-43e1-92b7-cea1eafad105 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.292689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b289ca-b756-43e1-92b7-cea1eafad105 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.292959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b289ca-b756-43e1-92b7-cea1eafad105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.316436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:24.327275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f1b289ca-b756-43e1-92b7-cea1eafad105 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:24.328561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f1b289ca-b756-43e1-92b7-cea1eafad105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:24.337166 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2697/5434] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:24.338093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b289ca-b756-43e1-92b7-cea1eafad105 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.351057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b289ca-b756-43e1-92b7-cea1eafad105 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:24.351350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b51618-00f0-4b53-b452-88cc4706f135 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:24.357606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfabb68-0c09-4358-85ea-2b7e253e50be tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:24.357792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b400214-e1e1-4b6d-b700-93afc81ed2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:24.358302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b400214-e1e1-4b6d-b700-93afc81ed2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.358427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfabb68-0c09-4358-85ea-2b7e253e50be tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.358607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b400214-e1e1-4b6d-b700-93afc81ed2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.358745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfabb68-0c09-4358-85ea-2b7e253e50be tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.358851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b400214-e1e1-4b6d-b700-93afc81ed2b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.358963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfabb68-0c09-4358-85ea-2b7e253e50be tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/users/7acd419858084466896ae1be9351b376` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.359515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b400214-e1e1-4b6d-b700-93afc81ed2b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:24.359811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b400214-e1e1-4b6d-b700-93afc81ed2b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:24.362025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b400214-e1e1-4b6d-b700-93afc81ed2b4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.388109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfabb68-0c09-4358-85ea-2b7e253e50be tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:get_user(user_id=7acd419858084466896ae1be9351b376)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:24.390179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfabb68-0c09-4358-85ea-2b7e253e50be tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.398515 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2738/5435] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:43:24 2022] GET /identity/v3/users/7acd419858084466896ae1be9351b376 => generated 348 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:24.399975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfabb68-0c09-4358-85ea-2b7e253e50be tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.419346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfabb68-0c09-4358-85ea-2b7e253e50be tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:24.428456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b2640-1508-4ae3-b056-3cc669476627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:24.429322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b2640-1508-4ae3-b056-3cc669476627 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.429865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b2640-1508-4ae3-b056-3cc669476627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.430293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b2640-1508-4ae3-b056-3cc669476627 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.431269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b2640-1508-4ae3-b056-3cc669476627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:24.431529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b2640-1508-4ae3-b056-3cc669476627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:24.433713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b2640-1508-4ae3-b056-3cc669476627 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.453780 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2698/5436] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:24.455751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b400214-e1e1-4b6d-b700-93afc81ed2b4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.458264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2b400214-e1e1-4b6d-b700-93afc81ed2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:24.458729 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2739/5437] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:24.463396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b2640-1508-4ae3-b056-3cc669476627 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.476506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b2640-1508-4ae3-b056-3cc669476627 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:24.481388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b400214-e1e1-4b6d-b700-93afc81ed2b4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:24.482798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214970ec-0675-4c72-bf6c-880c751dc1ff tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:24.483829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214970ec-0675-4c72-bf6c-880c751dc1ff tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.484183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214970ec-0675-4c72-bf6c-880c751dc1ff tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.488462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:24.489152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214970ec-0675-4c72-bf6c-880c751dc1ff tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.489340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.489623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.490056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] PATH_INFO: `/v3/projects/66ea4c47a51940ccb83189f8e11cf15f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.491146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214970ec-0675-4c72-bf6c-880c751dc1ff tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Adding query filter params (domain_id=12eec091af5f4984b1f6c34a61a89cce) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:24.491356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ea4c47a51940ccb83189f8e11cf15f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:24.491703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214970ec-0675-4c72-bf6c-880c751dc1ff tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:24.492855 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-214970ec-0675-4c72-bf6c-880c751dc1ff tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:24.492855 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:24.492855 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:24.493646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.494092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214970ec-0675-4c72-bf6c-880c751dc1ff tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.509443 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2740/5438] 10.222.0.43 () {58 vars in 1207 bytes} [Tue Aug 30 04:43:24 2022] GET /identity/v3/users?domain_id=12eec091af5f4984b1f6c34a61a89cce => generated 485 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:24.510494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214970ec-0675-4c72-bf6c-880c751dc1ff tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.530203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214970ec-0675-4c72-bf6c-880c751dc1ff tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:24.535318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69b955-ba08-473f-a378-6975ca0e1285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:24.535941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69b955-ba08-473f-a378-6975ca0e1285 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.536329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69b955-ba08-473f-a378-6975ca0e1285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.536597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69b955-ba08-473f-a378-6975ca0e1285 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.537247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69b955-ba08-473f-a378-6975ca0e1285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:24.540933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69b955-ba08-473f-a378-6975ca0e1285 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.574179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ea4c47a51940ccb83189f8e11cf15f', 'request_id': 'req-04726cae-47bb-4739-8a24-84e7a9642936'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:24.580994 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2741/5439] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:24 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:24.582087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69b955-ba08-473f-a378-6975ca0e1285 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.586819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ea4c47a51940ccb83189f8e11cf15f', 'request_id': 'req-04726cae-47bb-4739-8a24-84e7a9642936'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:24.600668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ea4c47a51940ccb83189f8e11cf15f', 'request_id': 'req-04726cae-47bb-4739-8a24-84e7a9642936'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:24.617438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] The token cache is being invalidate because project 66ea4c47a51940ccb83189f8e11cf15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:24.617863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:24.620698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:24.626362 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2699/5440] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:24 2022] DELETE /identity/v3/projects/66ea4c47a51940ccb83189f8e11cf15f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:24.626362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.626868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:24.691594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69b955-ba08-473f-a378-6975ca0e1285 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:24.696607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:24.698908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0eeee-655b-425c-9467-db69aed59780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:24.699645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0eeee-655b-425c-9467-db69aed59780 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.700184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0eeee-655b-425c-9467-db69aed59780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.700550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0eeee-655b-425c-9467-db69aed59780 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.701489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0eeee-655b-425c-9467-db69aed59780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:24.704228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0eeee-655b-425c-9467-db69aed59780 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.723042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04726cae-47bb-4739-8a24-84e7a9642936 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:24.743795 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2742/5441] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:24 2022] POST /identity/v3/projects => generated 389 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:24.745364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0eeee-655b-425c-9467-db69aed59780 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.748947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fcd0eeee-655b-425c-9467-db69aed59780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:24.815670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b06afc-149a-4c8b-b5e9-26f4e78233e8 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:24.817127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06afc-149a-4c8b-b5e9-26f4e78233e8 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.818107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06afc-149a-4c8b-b5e9-26f4e78233e8 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.818531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b06afc-149a-4c8b-b5e9-26f4e78233e8 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.819544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b06afc-149a-4c8b-b5e9-26f4e78233e8 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:24.824728 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-60b06afc-149a-4c8b-b5e9-26f4e78233e8 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:24.824728 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:24.824728 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:24.827276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b06afc-149a-4c8b-b5e9-26f4e78233e8 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.858636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0eeee-655b-425c-9467-db69aed59780 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:24.864142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34452dbf-088f-4d23-8be1-569aee940f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:24.865079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452dbf-088f-4d23-8be1-569aee940f7d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.865544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452dbf-088f-4d23-8be1-569aee940f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.866012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34452dbf-088f-4d23-8be1-569aee940f7d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.867134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34452dbf-088f-4d23-8be1-569aee940f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:24.869818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34452dbf-088f-4d23-8be1-569aee940f7d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.873260 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2700/5442] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:24 2022] GET /identity/v3/users => generated 7731 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:24.874604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3a17-8b10-4a42-857f-2b1f05eceb37 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.874889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3a17-8b10-4a42-857f-2b1f05eceb37 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.875162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f3a17-8b10-4a42-857f-2b1f05eceb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.900513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0d2f3a17-8b10-4a42-857f-2b1f05eceb37 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:24.901784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0d2f3a17-8b10-4a42-857f-2b1f05eceb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:24.906155 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2743/5443] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:24 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:24.907427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34452dbf-088f-4d23-8be1-569aee940f7d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.909250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-34452dbf-088f-4d23-8be1-569aee940f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:24.916429 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2701/5444] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:24.917357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3a17-8b10-4a42-857f-2b1f05eceb37 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:24.934975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34452dbf-088f-4d23-8be1-569aee940f7d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:24.943481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b287a-adda-4244-94c2-ed1abcaac018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:24.944411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b287a-adda-4244-94c2-ed1abcaac018 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:24.944953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b287a-adda-4244-94c2-ed1abcaac018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:24.946128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b287a-adda-4244-94c2-ed1abcaac018 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:24.947105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b287a-adda-4244-94c2-ed1abcaac018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:24.951058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b287a-adda-4244-94c2-ed1abcaac018 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:24.977409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:24.991721 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2744/5445] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:24 2022] POST /identity/v3/users => generated 295 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:24.993445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b287a-adda-4244-94c2-ed1abcaac018 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.009058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b287a-adda-4244-94c2-ed1abcaac018 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.011595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f3a17-8b10-4a42-857f-2b1f05eceb37 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.015331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550456f-aa34-4799-870a-b5fe84d02e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.016297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550456f-aa34-4799-870a-b5fe84d02e09 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.016780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550456f-aa34-4799-870a-b5fe84d02e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.017234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7e116-f53a-4910-b916-3de1840a4fe7 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.017420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550456f-aa34-4799-870a-b5fe84d02e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.018211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7e116-f53a-4910-b916-3de1840a4fe7 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.018442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550456f-aa34-4799-870a-b5fe84d02e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.018670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7e116-f53a-4910-b916-3de1840a4fe7 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.019080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7e116-f53a-4910-b916-3de1840a4fe7 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.019897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7e116-f53a-4910-b916-3de1840a4fe7 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1617788665) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:25.020335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7e116-f53a-4910-b916-3de1840a4fe7 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.021629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550456f-aa34-4799-870a-b5fe84d02e09 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.024907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7e116-f53a-4910-b916-3de1840a4fe7 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.044724 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2745/5446] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:25.046482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839182a-1305-46ba-bb95-2e6adb59a295 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.046914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839182a-1305-46ba-bb95-2e6adb59a295 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.047331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839182a-1305-46ba-bb95-2e6adb59a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.054137 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2702/5447] 10.222.0.43 () {58 vars in 1189 bytes} [Tue Aug 30 04:43:24 2022] GET /identity/v3/users?name=tempest-test_user-1617788665 => generated 476 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:25.056003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7e116-f53a-4910-b916-3de1840a4fe7 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.068202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7e116-f53a-4910-b916-3de1840a4fe7 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.075074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d494632-2fdd-451f-ab37-e56814b426fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.075874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494632-2fdd-451f-ab37-e56814b426fa admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.076159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494632-2fdd-451f-ab37-e56814b426fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.076444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494632-2fdd-451f-ab37-e56814b426fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.077101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d494632-2fdd-451f-ab37-e56814b426fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.078899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d494632-2fdd-451f-ab37-e56814b426fa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.091108 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2703/5448] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:25.095395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d494632-2fdd-451f-ab37-e56814b426fa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.107119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d494632-2fdd-451f-ab37-e56814b426fa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.113026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3475018-7e9f-4d14-bbc0-8d57bc2481da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.113814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3475018-7e9f-4d14-bbc0-8d57bc2481da admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.114213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3475018-7e9f-4d14-bbc0-8d57bc2481da admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.114625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3475018-7e9f-4d14-bbc0-8d57bc2481da admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.115429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3475018-7e9f-4d14-bbc0-8d57bc2481da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.117411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3475018-7e9f-4d14-bbc0-8d57bc2481da admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.130253 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2704/5449] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:25.135343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3475018-7e9f-4d14-bbc0-8d57bc2481da admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.148134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3475018-7e9f-4d14-bbc0-8d57bc2481da admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.153675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09466ee0-e580-497c-a336-ea1047aac513 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.154613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09466ee0-e580-497c-a336-ea1047aac513 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.155046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09466ee0-e580-497c-a336-ea1047aac513 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.155413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09466ee0-e580-497c-a336-ea1047aac513 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.156493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09466ee0-e580-497c-a336-ea1047aac513 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:25.156950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09466ee0-e580-497c-a336-ea1047aac513 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.160185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09466ee0-e580-497c-a336-ea1047aac513 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.193213 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2705/5450] 10.222.0.43 () {58 vars in 1149 bytes} [Tue Aug 30 04:43:25 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:25.194599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09466ee0-e580-497c-a336-ea1047aac513 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.225335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09466ee0-e580-497c-a336-ea1047aac513 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.231609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ad921-72af-40ed-ac3c-cf5c3475e004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.232445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ad921-72af-40ed-ac3c-cf5c3475e004 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.232827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ad921-72af-40ed-ac3c-cf5c3475e004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.233198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ad921-72af-40ed-ac3c-cf5c3475e004 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.233989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ad921-72af-40ed-ac3c-cf5c3475e004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.235755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ad921-72af-40ed-ac3c-cf5c3475e004 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.253591 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2706/5451] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:25.253591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ad921-72af-40ed-ac3c-cf5c3475e004 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.254320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8839182a-1305-46ba-bb95-2e6adb59a295 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:25.255665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8839182a-1305-46ba-bb95-2e6adb59a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:25.266851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ad921-72af-40ed-ac3c-cf5c3475e004 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.270195 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2746/5452] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:25.270195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839182a-1305-46ba-bb95-2e6adb59a295 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.280398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825da358-20e8-48e8-b0e2-8460ca3a7f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.281509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825da358-20e8-48e8-b0e2-8460ca3a7f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.282216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825da358-20e8-48e8-b0e2-8460ca3a7f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.282364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839182a-1305-46ba-bb95-2e6adb59a295 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.283378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825da358-20e8-48e8-b0e2-8460ca3a7f82 admin admin] PATH_INFO: `/v3/projects/a5fc83ea4c7a4844b83a4c3e116724fb/users/602cfdfb91ae49769ce96169cdc72bbc/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.288729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.289543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.290023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.290293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/users/4670d8b8eee64cbda57e4a722c018eb8` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.304920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825da358-20e8-48e8-b0e2-8460ca3a7f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5fc83ea4c7a4844b83a4c3e116724fb, user_id=602cfdfb91ae49769ce96169cdc72bbc, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.307641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4670d8b8eee64cbda57e4a722c018eb8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.308447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825da358-20e8-48e8-b0e2-8460ca3a7f82 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.309782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.345913 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2707/5453] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:25 2022] PUT /identity/v3/projects/a5fc83ea4c7a4844b83a4c3e116724fb/users/602cfdfb91ae49769ce96169cdc72bbc/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:25.345913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825da358-20e8-48e8-b0e2-8460ca3a7f82 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.364368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:25.394268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4670d8b8eee64cbda57e4a722c018eb8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:25.395245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4670d8b8eee64cbda57e4a722c018eb8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:25.403954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4670d8b8eee64cbda57e4a722c018eb8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:25.420903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4670d8b8eee64cbda57e4a722c018eb8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:25.442968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4670d8b8eee64cbda57e4a722c018eb8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:25.452944 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2747/5454] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:25 2022] DELETE /identity/v3/users/4670d8b8eee64cbda57e4a722c018eb8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:25.454155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.457425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:25.461192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825da358-20e8-48e8-b0e2-8460ca3a7f82 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.564172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792378d-089a-4cdb-8bfc-95f3be5add5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.564891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792378d-089a-4cdb-8bfc-95f3be5add5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.565165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792378d-089a-4cdb-8bfc-95f3be5add5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.565436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792378d-089a-4cdb-8bfc-95f3be5add5e admin admin] PATH_INFO: `/v3/projects/b8272154f1c34ce7a67d271245835475/users/65df2bf2a0264a5aa445fa31a1a272f7/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.565797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565d87e-a3b6-40d6-b7f8-6f3c1cddddc5 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.578688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb6a1-a741-4a22-bc2b-e98fbbf3219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.579249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb6a1-a741-4a22-bc2b-e98fbbf3219c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.579524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb6a1-a741-4a22-bc2b-e98fbbf3219c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.579787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb6a1-a741-4a22-bc2b-e98fbbf3219c admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.580688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cb6a1-a741-4a22-bc2b-e98fbbf3219c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:25.580986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cb6a1-a741-4a22-bc2b-e98fbbf3219c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.582695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cb6a1-a741-4a22-bc2b-e98fbbf3219c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.591128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792378d-089a-4cdb-8bfc-95f3be5add5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8272154f1c34ce7a67d271245835475, user_id=65df2bf2a0264a5aa445fa31a1a272f7, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.594842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792378d-089a-4cdb-8bfc-95f3be5add5e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.612423 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2708/5455] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:25 2022] PUT /identity/v3/projects/b8272154f1c34ce7a67d271245835475/users/65df2bf2a0264a5aa445fa31a1a272f7/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:25.613241 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2748/5456] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:25.614135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb6a1-a741-4a22-bc2b-e98fbbf3219c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.619961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc28618-608e-422a-97ba-884fe4044094 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.620478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc28618-608e-422a-97ba-884fe4044094 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.621080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc28618-608e-422a-97ba-884fe4044094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.623371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4b4cb6a1-a741-4a22-bc2b-e98fbbf3219c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:25.704926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5bc28618-608e-422a-97ba-884fe4044094 None None] MFA Rules not processed for user `602cfdfb91ae49769ce96169cdc72bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:25.706763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5bc28618-608e-422a-97ba-884fe4044094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:25.743864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:25.781179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb6a1-a741-4a22-bc2b-e98fbbf3219c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.802091 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2709/5457] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:25.803026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc28618-608e-422a-97ba-884fe4044094 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.838794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:25.865113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.866319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.866995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.867577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/users/7acd419858084466896ae1be9351b376` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.868994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7acd419858084466896ae1be9351b376)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.871665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.880944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc28618-608e-422a-97ba-884fe4044094 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:25.886397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a723a-f349-4719-a460-ee9c88a672bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:25.887374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a723a-f349-4719-a460-ee9c88a672bd admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.887919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a723a-f349-4719-a460-ee9c88a672bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.888486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a723a-f349-4719-a460-ee9c88a672bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.889320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a723a-f349-4719-a460-ee9c88a672bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:25.892144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a723a-f349-4719-a460-ee9c88a672bd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:25.926481 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2710/5458] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:25 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:25.928179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64aa07-60fe-4c80-bcbe-8aa654490cfc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:25.928672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64aa07-60fe-4c80-bcbe-8aa654490cfc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:25.929228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64aa07-60fe-4c80-bcbe-8aa654490cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:25.940152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acd419858084466896ae1be9351b376'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:25.940810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acd419858084466896ae1be9351b376'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:25.952802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acd419858084466896ae1be9351b376'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:25.963435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ca64aa07-60fe-4c80-bcbe-8aa654490cfc None None] MFA Rules not processed for user `65df2bf2a0264a5aa445fa31a1a272f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:25.965210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ca64aa07-60fe-4c80-bcbe-8aa654490cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:25.965374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acd419858084466896ae1be9351b376'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:25.983569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acd419858084466896ae1be9351b376'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:25.991224 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2749/5459] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:25 2022] DELETE /identity/v3/users/7acd419858084466896ae1be9351b376 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:25.992176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:25.996355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:26.065867 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2711/5460] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:26.066729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64aa07-60fe-4c80-bcbe-8aa654490cfc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:26.070455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ca64aa07-60fe-4c80-bcbe-8aa654490cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:26.087211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2d359-cff0-4917-b729-79f72e996afc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:26.092482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795092-0f61-4f88-ba87-e0afac52ed3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:26.093356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795092-0f61-4f88-ba87-e0afac52ed3d service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:26.093811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795092-0f61-4f88-ba87-e0afac52ed3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:26.094271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795092-0f61-4f88-ba87-e0afac52ed3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:26.096395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-04795092-0f61-4f88-ba87-e0afac52ed3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:26.128289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:26.198991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04795092-0f61-4f88-ba87-e0afac52ed3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:26.200678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04795092-0f61-4f88-ba87-e0afac52ed3d service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:26.201627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64aa07-60fe-4c80-bcbe-8aa654490cfc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:26.214685 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2750/5461] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:26.215201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795092-0f61-4f88-ba87-e0afac52ed3d service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:26.216747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-04795092-0f61-4f88-ba87-e0afac52ed3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:26.296495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:26.313373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795092-0f61-4f88-ba87-e0afac52ed3d service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:26.316161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5e8a-907f-41d9-a522-2e7f2875cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:26.316161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5e8a-907f-41d9-a522-2e7f2875cd09 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:26.316161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5e8a-907f-41d9-a522-2e7f2875cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:26.316161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee5e8a-907f-41d9-a522-2e7f2875cd09 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:26.316588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee5e8a-907f-41d9-a522-2e7f2875cd09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:26.324591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:26.325280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:26.325622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:26.326008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/domains/12eec091af5f4984b1f6c34a61a89cce` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:26.327364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=12eec091af5f4984b1f6c34a61a89cce)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:26.329462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:26.334846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee5e8a-907f-41d9-a522-2e7f2875cd09 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:26.360429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:26.361557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:26.401646 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2712/5462] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:26 2022] POST /identity/v3/users => generated 290 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:26.406535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:26.408195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5e8a-907f-41d9-a522-2e7f2875cd09 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:26.409866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:26.417174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5cee5e8a-907f-41d9-a522-2e7f2875cd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:26.417655 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2751/5463] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:43:26 2022] PATCH /identity/v3/domains/12eec091af5f4984b1f6c34a61a89cce => generated 278 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:26.419062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:26.426268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:26.451265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee5e8a-907f-41d9-a522-2e7f2875cd09 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:26.544997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d4916-293d-4e61-85c1-0b3669592185 tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:26.558414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9d7da-1af3-4353-84db-5595381ea803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:26.559388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d7da-1af3-4353-84db-5595381ea803 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:26.559718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d7da-1af3-4353-84db-5595381ea803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:26.559992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d7da-1af3-4353-84db-5595381ea803 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:26.560659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9d7da-1af3-4353-84db-5595381ea803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:26.564105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9d7da-1af3-4353-84db-5595381ea803 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:26.583239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfd7ce-6715-4a1f-9158-26a1d3dd734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:26.585967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfd7ce-6715-4a1f-9158-26a1d3dd734c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:26.586310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfd7ce-6715-4a1f-9158-26a1d3dd734c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:26.586591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfd7ce-6715-4a1f-9158-26a1d3dd734c admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:26.593637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfd7ce-6715-4a1f-9158-26a1d3dd734c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:26.594020 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2752/5464] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:26.594937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9d7da-1af3-4353-84db-5595381ea803 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:26.595861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfd7ce-6715-4a1f-9158-26a1d3dd734c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:26.603953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-09b9d7da-1af3-4353-84db-5595381ea803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:26.662438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:26.664751 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2713/5465] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:26 2022] POST /identity/v3/projects => generated 389 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:26.666399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfd7ce-6715-4a1f-9158-26a1d3dd734c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:26.791334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9d7da-1af3-4353-84db-5595381ea803 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:26.810794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfd7ce-6715-4a1f-9158-26a1d3dd734c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:26.818227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0f281-e56f-4bfb-9396-65543608f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:26.820503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0f281-e56f-4bfb-9396-65543608f8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:26.820818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0f281-e56f-4bfb-9396-65543608f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:26.821118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0f281-e56f-4bfb-9396-65543608f8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:26.822343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0f281-e56f-4bfb-9396-65543608f8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:26.824786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0f281-e56f-4bfb-9396-65543608f8a4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:26.843158 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2714/5466] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:26.844216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0f281-e56f-4bfb-9396-65543608f8a4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:26.859280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0f281-e56f-4bfb-9396-65543608f8a4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:26.865481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1e783-9ce0-451f-9966-d1f111c6af38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:26.866199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1e783-9ce0-451f-9966-d1f111c6af38 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:26.866660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1e783-9ce0-451f-9966-d1f111c6af38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:26.867120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1e783-9ce0-451f-9966-d1f111c6af38 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:26.868019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1e783-9ce0-451f-9966-d1f111c6af38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:26.870905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1e783-9ce0-451f-9966-d1f111c6af38 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:26.888295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6644d2092bf440b92c3d3b7a4860292', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4b3473894584260aaa29db97b563f5e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:26.889000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:26.889275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:26.890305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] PATH_INFO: `/v3/domains/12eec091af5f4984b1f6c34a61a89cce` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:26.907126 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2715/5467] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:26 2022] POST /identity/v3/users => generated 301 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:26.907369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=12eec091af5f4984b1f6c34a61a89cce)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:26.908140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1e783-9ce0-451f-9966-d1f111c6af38 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:26.908997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:26.930027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1e783-9ce0-451f-9966-d1f111c6af38 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:26.936263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962455b-2ce3-414f-83d1-9a89050ca1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:26.937108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962455b-2ce3-414f-83d1-9a89050ca1e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:26.937396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962455b-2ce3-414f-83d1-9a89050ca1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:26.937672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962455b-2ce3-414f-83d1-9a89050ca1e1 admin admin] PATH_INFO: `/v3/projects/c09c18a3bbb441bbb44e4b80a655d1d9/users/e3227d0b90434ddeaa606647e92eb2eb/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:26.954479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:26.959907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962455b-2ce3-414f-83d1-9a89050ca1e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09c18a3bbb441bbb44e4b80a655d1d9, user_id=e3227d0b90434ddeaa606647e92eb2eb, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:26.962836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962455b-2ce3-414f-83d1-9a89050ca1e1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:26.971848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:26.988296 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2716/5468] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:26 2022] PUT /identity/v3/projects/c09c18a3bbb441bbb44e4b80a655d1d9/users/e3227d0b90434ddeaa606647e92eb2eb/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:26.989516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962455b-2ce3-414f-83d1-9a89050ca1e1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:27.016417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:27.047693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce', 'request_id': 'req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.057532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce', 'request_id': 'req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.068659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962455b-2ce3-414f-83d1-9a89050ca1e1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:27.070628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce', 'request_id': 'req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.088824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] The token cache is being invalidate because project 12eec091af5f4984b1f6c34a61a89cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:27.089000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.090034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.102824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce', 'request_id': 'req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.104269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce', 'request_id': 'req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.104520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc tempest-UsersV3TestJSON-2077893079 tempest-UsersV3TestJSON-2077893079-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '12eec091af5f4984b1f6c34a61a89cce', 'request_id': 'req-4109a942-c1a6-4c01-bfdc-6e4abf2d89dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.123060 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2753/5469] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:26 2022] DELETE /identity/v3/domains/12eec091af5f4984b1f6c34a61a89cce => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:27.123060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca991-ba02-45dc-a59d-6071e9b30b07 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.123060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca991-ba02-45dc-a59d-6071e9b30b07 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.123060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ca991-ba02-45dc-a59d-6071e9b30b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.134729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:27.146531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8dee6-5d09-48bb-8c0e-c808719eab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:27.147165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8dee6-5d09-48bb-8c0e-c808719eab70 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.147453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8dee6-5d09-48bb-8c0e-c808719eab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.148201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8dee6-5d09-48bb-8c0e-c808719eab70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.148874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8dee6-5d09-48bb-8c0e-c808719eab70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:27.150745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8dee6-5d09-48bb-8c0e-c808719eab70 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:27.151779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ee7ca991-ba02-45dc-a59d-6071e9b30b07 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:27.153751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ee7ca991-ba02-45dc-a59d-6071e9b30b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:27.161970 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2717/5470] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:27.162747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8dee6-5d09-48bb-8c0e-c808719eab70 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:27.164092 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2754/5471] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:27.165066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cee8dee6-5d09-48bb-8c0e-c808719eab70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:27.170522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ca991-ba02-45dc-a59d-6071e9b30b07 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:27.172238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ee7ca991-ba02-45dc-a59d-6071e9b30b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:27.187405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ca991-ba02-45dc-a59d-6071e9b30b07 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:27.194190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8dee6-5d09-48bb-8c0e-c808719eab70 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:27.198361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889b6f8-db7e-46c3-8f07-55ff0312591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:27.199749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889b6f8-db7e-46c3-8f07-55ff0312591a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.200490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889b6f8-db7e-46c3-8f07-55ff0312591a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.201006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889b6f8-db7e-46c3-8f07-55ff0312591a admin admin] PATH_INFO: `/v3/projects/bd68b8dc04f742d29010ae221a3d0ace/users/b81173eb94434fe89c59def358ba7006/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.203879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:27.205170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.205460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.205734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] PATH_INFO: `/v3/users/87b34f6d15b3427087db3034358121ad` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.207287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b34f6d15b3427087db3034358121ad)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:27.209630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:27.269717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889b6f8-db7e-46c3-8f07-55ff0312591a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd68b8dc04f742d29010ae221a3d0ace, user_id=b81173eb94434fe89c59def358ba7006, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:27.285253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889b6f8-db7e-46c3-8f07-55ff0312591a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:27.290116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b34f6d15b3427087db3034358121ad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.300217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b34f6d15b3427087db3034358121ad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.316490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b34f6d15b3427087db3034358121ad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.321393 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2755/5472] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:27 2022] PUT /identity/v3/projects/bd68b8dc04f742d29010ae221a3d0ace/users/b81173eb94434fe89c59def358ba7006/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:27.321393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889b6f8-db7e-46c3-8f07-55ff0312591a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:27.324764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0889b6f8-db7e-46c3-8f07-55ff0312591a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:27.326002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b34f6d15b3427087db3034358121ad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.326929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b34f6d15b3427087db3034358121ad'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:27.334948 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2718/5473] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:27 2022] DELETE /identity/v3/users/87b34f6d15b3427087db3034358121ad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:27.336231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:27.337710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:27.414176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:27.477270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889b6f8-db7e-46c3-8f07-55ff0312591a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:27.492143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a31d6-ffd1-4b29-8c6a-a615d9d97ce5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:27.503390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1e261-029a-4f82-996f-4a45acce24e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:27.505507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e261-029a-4f82-996f-4a45acce24e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.505827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e261-029a-4f82-996f-4a45acce24e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.507768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1e261-029a-4f82-996f-4a45acce24e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.508931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1e261-029a-4f82-996f-4a45acce24e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:27.514207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1e261-029a-4f82-996f-4a45acce24e8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:27.550492 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2719/5474] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:27.552310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c03d-cbc6-44ee-9305-d4c43853cf77 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.552819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c03d-cbc6-44ee-9305-d4c43853cf77 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.553598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c03d-cbc6-44ee-9305-d4c43853cf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.579980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0646c03d-cbc6-44ee-9305-d4c43853cf77 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:27.582405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0646c03d-cbc6-44ee-9305-d4c43853cf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:27.589536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b77d6-a78c-4a70-a636-2857a4c96381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:27.590633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b77d6-a78c-4a70-a636-2857a4c96381 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.590968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b77d6-a78c-4a70-a636-2857a4c96381 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.591336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b77d6-a78c-4a70-a636-2857a4c96381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.593275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-687b77d6-a78c-4a70-a636-2857a4c96381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:27.599138 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2720/5475] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:27.602351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646c03d-cbc6-44ee-9305-d4c43853cf77 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:27.618888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646c03d-cbc6-44ee-9305-d4c43853cf77 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:27.619515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b77d6-a78c-4a70-a636-2857a4c96381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:27.620998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b77d6-a78c-4a70-a636-2857a4c96381 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:27.627353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fa0d5-e4bd-48db-9c4b-8921ccb4ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:27.628527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa0d5-e4bd-48db-9c4b-8921ccb4ea4f admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.629048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa0d5-e4bd-48db-9c4b-8921ccb4ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.629644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fa0d5-e4bd-48db-9c4b-8921ccb4ea4f admin admin] PATH_INFO: `/v3/projects/bd68b8dc04f742d29010ae221a3d0ace/users/b81173eb94434fe89c59def358ba7006/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.633186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fa0d5-e4bd-48db-9c4b-8921ccb4ea4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd68b8dc04f742d29010ae221a3d0ace, user_id=b81173eb94434fe89c59def358ba7006, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:27.636757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43fa0d5-e4bd-48db-9c4b-8921ccb4ea4f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:27.644274 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2756/5476] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:27.645356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b77d6-a78c-4a70-a636-2857a4c96381 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:27.647111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-687b77d6-a78c-4a70-a636-2857a4c96381 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:27.653294 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2721/5477] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:27 2022] PUT /identity/v3/projects/bd68b8dc04f742d29010ae221a3d0ace/users/b81173eb94434fe89c59def358ba7006/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:27.661727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b77d6-a78c-4a70-a636-2857a4c96381 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:27.674076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0792-2e1c-4a15-a542-7375f7da1d4c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.675797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0792-2e1c-4a15-a542-7375f7da1d4c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.677010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0792-2e1c-4a15-a542-7375f7da1d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.746081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d13e0792-2e1c-4a15-a542-7375f7da1d4c None None] MFA Rules not processed for user `b81173eb94434fe89c59def358ba7006`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:27.747653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d13e0792-2e1c-4a15-a542-7375f7da1d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:27.759790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d2834-846d-420c-ae90-3b7cf9d825b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:27.761254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d2834-846d-420c-ae90-3b7cf9d825b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.761918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d2834-846d-420c-ae90-3b7cf9d825b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.762542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d2834-846d-420c-ae90-3b7cf9d825b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.880096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:27.887133 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2722/5478] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:27.888421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e0792-2e1c-4a15-a542-7375f7da1d4c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:27.903323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e0792-2e1c-4a15-a542-7375f7da1d4c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:27.910290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8350bd9-7c53-4874-bc00-785e0ce9612c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:27.912034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8350bd9-7c53-4874-bc00-785e0ce9612c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.912484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8350bd9-7c53-4874-bc00-785e0ce9612c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.913843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8350bd9-7c53-4874-bc00-785e0ce9612c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects/b8272154f1c34ce7a67d271245835475` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.916673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8350bd9-7c53-4874-bc00-785e0ce9612c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8272154f1c34ce7a67d271245835475)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:27.919481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8350bd9-7c53-4874-bc00-785e0ce9612c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:27.926283 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2723/5479] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:27 2022] GET /identity/v3/projects/b8272154f1c34ce7a67d271245835475 => generated 389 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:27.930997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8350bd9-7c53-4874-bc00-785e0ce9612c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:27.933392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d2834-846d-420c-ae90-3b7cf9d825b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:27.938656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d2834-846d-420c-ae90-3b7cf9d825b5 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:27.963678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8350bd9-7c53-4874-bc00-785e0ce9612c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:27.978351 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2757/5480] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:27.980848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0299c4-3ce3-471f-951f-d55bad9fc865 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:27.983841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0299c4-3ce3-471f-951f-d55bad9fc865 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:27.983841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0299c4-3ce3-471f-951f-d55bad9fc865 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:27.983841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0299c4-3ce3-471f-951f-d55bad9fc865 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:27.984369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0299c4-3ce3-471f-951f-d55bad9fc865 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:27.987112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0299c4-3ce3-471f-951f-d55bad9fc865 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.042706 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2724/5481] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:43:27 2022] POST /identity/v3/projects => generated 339 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:28.048038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d2834-846d-420c-ae90-3b7cf9d825b5 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.067403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d2834-846d-420c-ae90-3b7cf9d825b5 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:28.203878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dcd53-26b7-4aad-a349-281b67d280c2 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:28.204517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dcd53-26b7-4aad-a349-281b67d280c2 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:28.204796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dcd53-26b7-4aad-a349-281b67d280c2 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:28.205074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dcd53-26b7-4aad-a349-281b67d280c2 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:28.205733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dcd53-26b7-4aad-a349-281b67d280c2 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:28.207940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dcd53-26b7-4aad-a349-281b67d280c2 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.247441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0299c4-3ce3-471f-951f-d55bad9fc865 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.252723 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2758/5482] 10.222.0.43 () {58 vars in 1131 bytes} [Tue Aug 30 04:43:28 2022] GET /identity/v3/projects => generated 6899 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:28.269743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0299c4-3ce3-471f-951f-d55bad9fc865 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:28.276028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cab2a-8737-41ea-911b-0e6cda25a188 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:28.276446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cab2a-8737-41ea-911b-0e6cda25a188 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:28.276905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cab2a-8737-41ea-911b-0e6cda25a188 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:28.277177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cab2a-8737-41ea-911b-0e6cda25a188 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects/b8272154f1c34ce7a67d271245835475` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:28.279005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cab2a-8737-41ea-911b-0e6cda25a188 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:get_project(project_id=b8272154f1c34ce7a67d271245835475)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:28.281596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1cab2a-8737-41ea-911b-0e6cda25a188 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.288139 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2725/5483] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:28 2022] GET /identity/v3/projects/b8272154f1c34ce7a67d271245835475 => generated 389 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:28.290273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dcd53-26b7-4aad-a349-281b67d280c2 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.306485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dcd53-26b7-4aad-a349-281b67d280c2 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:28.316502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd991-d84d-4471-a144-3da80b808d13 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:28.317464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd991-d84d-4471-a144-3da80b808d13 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:28.318071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd991-d84d-4471-a144-3da80b808d13 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:28.318624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcd991-d84d-4471-a144-3da80b808d13 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects/565fd23c35bc43ba8f6466b3f425b252` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:28.320917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcd991-d84d-4471-a144-3da80b808d13 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:get_project(project_id=565fd23c35bc43ba8f6466b3f425b252)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:28.324836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcd991-d84d-4471-a144-3da80b808d13 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.332670 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2759/5484] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:28 2022] GET /identity/v3/projects/565fd23c35bc43ba8f6466b3f425b252 => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:28.333443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cab2a-8737-41ea-911b-0e6cda25a188 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.349137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1cab2a-8737-41ea-911b-0e6cda25a188 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:28.367595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e96897-abac-4bfa-9120-c76162d8a74e tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:28.368412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e96897-abac-4bfa-9120-c76162d8a74e tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:28.368672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e96897-abac-4bfa-9120-c76162d8a74e tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:28.369476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e96897-abac-4bfa-9120-c76162d8a74e tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:28.372848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e96897-abac-4bfa-9120-c76162d8a74e tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:28.375029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e96897-abac-4bfa-9120-c76162d8a74e tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.431187 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2726/5485] 10.222.0.43 () {58 vars in 1131 bytes} [Tue Aug 30 04:43:28 2022] GET /identity/v3/projects => generated 6899 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:28.432739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd991-d84d-4471-a144-3da80b808d13 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.446078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcd991-d84d-4471-a144-3da80b808d13 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:28.457798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76aaa1-a81b-405d-8838-eadadd341a6c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:28.459000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76aaa1-a81b-405d-8838-eadadd341a6c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:28.459292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76aaa1-a81b-405d-8838-eadadd341a6c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:28.459581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76aaa1-a81b-405d-8838-eadadd341a6c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:28.460349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76aaa1-a81b-405d-8838-eadadd341a6c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:28.460668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76aaa1-a81b-405d-8838-eadadd341a6c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:28.462941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76aaa1-a81b-405d-8838-eadadd341a6c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.539203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e96897-abac-4bfa-9120-c76162d8a74e tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.543791 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2760/5486] 10.222.0.43 () {58 vars in 1166 bytes} [Tue Aug 30 04:43:28 2022] GET /identity/v3/projects?domain_id=default => generated 6568 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:28.557511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e96897-abac-4bfa-9120-c76162d8a74e tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:28.565940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dde51-0ef2-470f-808e-5925cc39f38f tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:28.571768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dde51-0ef2-470f-808e-5925cc39f38f tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:28.574855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dde51-0ef2-470f-808e-5925cc39f38f tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:28.575369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1dde51-0ef2-470f-808e-5925cc39f38f tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:28.577814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dde51-0ef2-470f-808e-5925cc39f38f tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:28.581037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1dde51-0ef2-470f-808e-5925cc39f38f tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.615458 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2727/5487] 10.222.0.43 () {58 vars in 1131 bytes} [Tue Aug 30 04:43:28 2022] GET /identity/v3/projects => generated 6899 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:28.620488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76aaa1-a81b-405d-8838-eadadd341a6c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.633494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76aaa1-a81b-405d-8838-eadadd341a6c tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:28.640356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb4744-443b-466e-967e-5f10b1af0d16 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:28.641527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb4744-443b-466e-967e-5f10b1af0d16 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:28.641804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb4744-443b-466e-967e-5f10b1af0d16 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:28.642140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb4744-443b-466e-967e-5f10b1af0d16 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:28.643613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb4744-443b-466e-967e-5f10b1af0d16 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:28.643951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb4744-443b-466e-967e-5f10b1af0d16 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:28.646857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb4744-443b-466e-967e-5f10b1af0d16 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.680708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dde51-0ef2-470f-808e-5925cc39f38f tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.690717 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2761/5488] 10.222.0.43 () {58 vars in 1166 bytes} [Tue Aug 30 04:43:28 2022] GET /identity/v3/projects?domain_id=default => generated 6568 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:28.694215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1dde51-0ef2-470f-808e-5925cc39f38f tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:28.704527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95764e91-fb08-427e-b653-96bccf294b14 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:28.706256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95764e91-fb08-427e-b653-96bccf294b14 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:28.706717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95764e91-fb08-427e-b653-96bccf294b14 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:28.707179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95764e91-fb08-427e-b653-96bccf294b14 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:28.708046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95764e91-fb08-427e-b653-96bccf294b14 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:28.710999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95764e91-fb08-427e-b653-96bccf294b14 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.742553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb4744-443b-466e-967e-5f10b1af0d16 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.744935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2728/5489] 10.222.0.43 () {58 vars in 1131 bytes} [Tue Aug 30 04:43:28 2022] GET /identity/v3/projects => generated 6899 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:28.758141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb4744-443b-466e-967e-5f10b1af0d16 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:28.766298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05ab65-57f5-4328-bbc0-59851224be27 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:28.767290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05ab65-57f5-4328-bbc0-59851224be27 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:28.767856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05ab65-57f5-4328-bbc0-59851224be27 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:28.768562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05ab65-57f5-4328-bbc0-59851224be27 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:28.769634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05ab65-57f5-4328-bbc0-59851224be27 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1413052155) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:28.770178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05ab65-57f5-4328-bbc0-59851224be27 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:28.774062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad05ab65-57f5-4328-bbc0-59851224be27 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.805432 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2762/5490] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Aug 30 04:43:28 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1413052155 => generated 537 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:28.806157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95764e91-fb08-427e-b653-96bccf294b14 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.817094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95764e91-fb08-427e-b653-96bccf294b14 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:28.822643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b81173eb94434fe89c59def358ba7006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd68b8dc04f742d29010ae221a3d0ace', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:28.823228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:28.823507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:28.823780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] PATH_INFO: `/v3/projects/565fd23c35bc43ba8f6466b3f425b252` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:28.824994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorizing `identity:delete_project(project_id=565fd23c35bc43ba8f6466b3f425b252)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:28.827169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:28.857655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:28.889397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565fd23c35bc43ba8f6466b3f425b252', 'request_id': 'req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:28.906784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565fd23c35bc43ba8f6466b3f425b252', 'request_id': 'req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:28.918573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565fd23c35bc43ba8f6466b3f425b252', 'request_id': 'req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:28.935715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] The token cache is being invalidate because project 565fd23c35bc43ba8f6466b3f425b252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:28.936071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:28.936887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:28.939391 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2729/5491] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:28 2022] DELETE /identity/v3/projects/565fd23c35bc43ba8f6466b3f425b252 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:28.943085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05ab65-57f5-4328-bbc0-59851224be27 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:28.944953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ad05ab65-57f5-4328-bbc0-59851224be27 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:29.107662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad05ab65-57f5-4328-bbc0-59851224be27 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:29.202951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:29.248827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:29.249996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:29.250526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:29.250664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] PATH_INFO: `/v3/users/65df2bf2a0264a5aa445fa31a1a272f7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:29.259230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65df2bf2a0264a5aa445fa31a1a272f7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:29.267500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:29.368341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:29.370961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:29.386847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65df2bf2a0264a5aa445fa31a1a272f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.387609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65df2bf2a0264a5aa445fa31a1a272f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.402379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65df2bf2a0264a5aa445fa31a1a272f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.403257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3e8e7-5853-4e3e-a75e-1cc8fdbecf34 tempest-ListProjectsStaticTestJSON-1466081279 tempest-ListProjectsStaticTestJSON-1466081279-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:29.418004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:29.419484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65df2bf2a0264a5aa445fa31a1a272f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.419998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:29.420718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:29.422838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] PATH_INFO: `/v3/projects/8b8c1ec46f4b48ac96111059197ec958` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:29.427182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b8c1ec46f4b48ac96111059197ec958)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:29.433673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:29.446811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65df2bf2a0264a5aa445fa31a1a272f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.453631 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2763/5492] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:28 2022] DELETE /identity/v3/users/65df2bf2a0264a5aa445fa31a1a272f7 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:29.457684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:29.463518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:29.542308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b8c1ec46f4b48ac96111059197ec958', 'request_id': 'req-bd56855d-883b-4be0-913f-551f1222e6f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.554512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b8c1ec46f4b48ac96111059197ec958', 'request_id': 'req-bd56855d-883b-4be0-913f-551f1222e6f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.573238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b8c1ec46f4b48ac96111059197ec958', 'request_id': 'req-bd56855d-883b-4be0-913f-551f1222e6f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.599047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08b833-1010-4464-aac6-8fcf241eab83 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:29.600155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] The token cache is being invalidate because project 8b8c1ec46f4b48ac96111059197ec958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:29.601437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.603738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bd56855d-883b-4be0-913f-551f1222e6f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.609049 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2730/5493] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:29 2022] DELETE /identity/v3/projects/8b8c1ec46f4b48ac96111059197ec958 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:29.614606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4221d-658b-4c7b-8911-3904c29e1bf3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:29.615048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4221d-658b-4c7b-8911-3904c29e1bf3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:29.615430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4221d-658b-4c7b-8911-3904c29e1bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:29.661283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bda4221d-658b-4c7b-8911-3904c29e1bf3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:29.666027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bda4221d-658b-4c7b-8911-3904c29e1bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:29.670030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:29.670752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:29.671029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:29.671714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] PATH_INFO: `/v3/users/53bcff91cd1745aa9a5f30daba7051cf` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:29.672533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53bcff91cd1745aa9a5f30daba7051cf)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:29.674553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:29.681820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:29.691944 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2731/5494] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:29.693506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4221d-658b-4c7b-8911-3904c29e1bf3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:29.698887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bda4221d-658b-4c7b-8911-3904c29e1bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:29.730393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4221d-658b-4c7b-8911-3904c29e1bf3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:29.743147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:29.743898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:29.745580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:29.745991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] PATH_INFO: `/v3/users/a6644d2092bf440b92c3d3b7a4860292` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:29.749700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6644d2092bf440b92c3d3b7a4860292)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:29.755762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:29.787372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53bcff91cd1745aa9a5f30daba7051cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.788613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53bcff91cd1745aa9a5f30daba7051cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.807127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53bcff91cd1745aa9a5f30daba7051cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.839121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53bcff91cd1745aa9a5f30daba7051cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.884315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53bcff91cd1745aa9a5f30daba7051cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.888106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6644d2092bf440b92c3d3b7a4860292'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.904894 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2764/5495] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:29 2022] DELETE /identity/v3/users/53bcff91cd1745aa9a5f30daba7051cf => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:29.906695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:29.908700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6644d2092bf440b92c3d3b7a4860292'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.910597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:29.941787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6644d2092bf440b92c3d3b7a4860292'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.962974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6644d2092bf440b92c3d3b7a4860292'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.963765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c32b7ca-4599-405f-85e6-25b3b953cff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6644d2092bf440b92c3d3b7a4860292'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:29.965594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=24,keystone:SELECT=73,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:29.974352 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2732/5496] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:29 2022] DELETE /identity/v3/users/a6644d2092bf440b92c3d3b7a4860292 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:29.976190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f89efb-7e1e-4af7-970f-8bf306e0035c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:29.976478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f89efb-7e1e-4af7-970f-8bf306e0035c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:29.977442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f89efb-7e1e-4af7-970f-8bf306e0035c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:30.029139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e8f89efb-7e1e-4af7-970f-8bf306e0035c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:30.032876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e8f89efb-7e1e-4af7-970f-8bf306e0035c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:30.058713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f93672-a64b-40d0-a7f0-4e1078b1c694 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:30.186317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f9d1a-c762-4b30-a387-9bd918855d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:30.186976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9d1a-c762-4b30-a387-9bd918855d8f service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:30.187221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9d1a-c762-4b30-a387-9bd918855d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:30.187487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f9d1a-c762-4b30-a387-9bd918855d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:30.188505 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2733/5497] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:30.193581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-208f9d1a-c762-4b30-a387-9bd918855d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:30.219324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f9d1a-c762-4b30-a387-9bd918855d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:30.221977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f9d1a-c762-4b30-a387-9bd918855d8f service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:30.247751 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2765/5498] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:30.249804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f89efb-7e1e-4af7-970f-8bf306e0035c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:30.251646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e8f89efb-7e1e-4af7-970f-8bf306e0035c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:30.285517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f89efb-7e1e-4af7-970f-8bf306e0035c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:30.295795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73f7c-a7a2-49f2-91c0-72c3973463f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:30.298013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73f7c-a7a2-49f2-91c0-72c3973463f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:30.298013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73f7c-a7a2-49f2-91c0-72c3973463f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:30.298237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef73f7c-a7a2-49f2-91c0-72c3973463f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:30.324278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73f7c-a7a2-49f2-91c0-72c3973463f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:30.326859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef73f7c-a7a2-49f2-91c0-72c3973463f8 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:30.353003 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2734/5499] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:31.777902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f9d1a-c762-4b30-a387-9bd918855d8f service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:31.779459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-208f9d1a-c762-4b30-a387-9bd918855d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:31.804089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f9d1a-c762-4b30-a387-9bd918855d8f service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:31.809107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:31.809753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:31.810067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:31.810336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] PATH_INFO: `/v3/projects/6af34c0b740847d09afde0c2bdf9dba2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:31.814964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af34c0b740847d09afde0c2bdf9dba2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:31.816963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:31.842979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73f7c-a7a2-49f2-91c0-72c3973463f8 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:31.844656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aef73f7c-a7a2-49f2-91c0-72c3973463f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:31.870013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef73f7c-a7a2-49f2-91c0-72c3973463f8 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:31.897344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:31.902477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:31.902798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:31.906180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] PATH_INFO: `/v3/projects/b8272154f1c34ce7a67d271245835475` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:31.914310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:31.915397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8272154f1c34ce7a67d271245835475)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:31.919571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:31.930915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af34c0b740847d09afde0c2bdf9dba2', 'request_id': 'req-01141fec-40a1-4aec-ac45-56f10a4fb572'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:31.951985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af34c0b740847d09afde0c2bdf9dba2', 'request_id': 'req-01141fec-40a1-4aec-ac45-56f10a4fb572'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:31.966191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af34c0b740847d09afde0c2bdf9dba2', 'request_id': 'req-01141fec-40a1-4aec-ac45-56f10a4fb572'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:31.992861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] The token cache is being invalidate because project 6af34c0b740847d09afde0c2bdf9dba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:31.993153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.000665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.005257 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2766/5500] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:31 2022] DELETE /identity/v3/projects/6af34c0b740847d09afde0c2bdf9dba2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:32.010539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:32.013092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:32.034919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8272154f1c34ce7a67d271245835475', 'request_id': 'req-ab2a158b-b721-4bb8-a528-33e57dde1a15'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.058082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8272154f1c34ce7a67d271245835475', 'request_id': 'req-ab2a158b-b721-4bb8-a528-33e57dde1a15'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.074160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8272154f1c34ce7a67d271245835475', 'request_id': 'req-ab2a158b-b721-4bb8-a528-33e57dde1a15'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.105098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] The token cache is being invalidate because project b8272154f1c34ce7a67d271245835475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:32.105451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.107742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.112717 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2735/5501] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:31 2022] DELETE /identity/v3/projects/b8272154f1c34ce7a67d271245835475 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:32.114177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:32.117590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:32.169782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141fec-40a1-4aec-ac45-56f10a4fb572 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:32.245671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a158b-b721-4bb8-a528-33e57dde1a15 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:32.257050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:32.274361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:32.275523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:32.275523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:32.275523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] PATH_INFO: `/v3/users/da4caca4c2834f079c49e90e53690b20` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:32.281567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4caca4c2834f079c49e90e53690b20)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:32.283256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:32.287455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:32.287753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:32.288173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] PATH_INFO: `/v3/users/b81173eb94434fe89c59def358ba7006` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:32.296022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81173eb94434fe89c59def358ba7006)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:32.298110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:32.314075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:32.380990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4caca4c2834f079c49e90e53690b20'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.381820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4caca4c2834f079c49e90e53690b20'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.398890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4caca4c2834f079c49e90e53690b20'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.411290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4caca4c2834f079c49e90e53690b20'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.423686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81173eb94434fe89c59def358ba7006'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.433842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:32.439858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81173eb94434fe89c59def358ba7006'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.444188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4caca4c2834f079c49e90e53690b20'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.460162 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2767/5502] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:32 2022] DELETE /identity/v3/users/da4caca4c2834f079c49e90e53690b20 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:32.461238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:32.465759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:32.508572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81173eb94434fe89c59def358ba7006'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.524609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81173eb94434fe89c59def358ba7006'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.525608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3b668590-957d-4700-bfb6-ae3837dea2bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81173eb94434fe89c59def358ba7006'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.537318 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2736/5503] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:32 2022] DELETE /identity/v3/users/b81173eb94434fe89c59def358ba7006 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:32.651228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600407e-0dd9-4b14-b3b3-7cb87d84264b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:32.795516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:32.796974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:32.797407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:32.797858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] PATH_INFO: `/v3/projects/b4b3473894584260aaa29db97b563f5e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:32.799358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b3473894584260aaa29db97b563f5e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:32.801470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:32.887336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b3473894584260aaa29db97b563f5e', 'request_id': 'req-4481a283-25cc-4765-afea-934ac454c00b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.896493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b3473894584260aaa29db97b563f5e', 'request_id': 'req-4481a283-25cc-4765-afea-934ac454c00b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.907022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b3473894584260aaa29db97b563f5e', 'request_id': 'req-4481a283-25cc-4765-afea-934ac454c00b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.923404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] The token cache is being invalidate because project b4b3473894584260aaa29db97b563f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:32.924026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.924860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4481a283-25cc-4765-afea-934ac454c00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:32.927283 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2768/5504] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:32 2022] DELETE /identity/v3/projects/b4b3473894584260aaa29db97b563f5e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:32.932769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021ae8-1795-432c-85a6-ea22a565a2d9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:32.933639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021ae8-1795-432c-85a6-ea22a565a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:32.934162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021ae8-1795-432c-85a6-ea22a565a2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:33.001303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3c021ae8-1795-432c-85a6-ea22a565a2d9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:33.010016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3c021ae8-1795-432c-85a6-ea22a565a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:33.178332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae715-857d-4da3-8b70-d40cca4e6dce None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:33.178886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae715-857d-4da3-8b70-d40cca4e6dce None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:33.179059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae715-857d-4da3-8b70-d40cca4e6dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:33.186447 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2737/5505] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:33.227091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-641ae715-857d-4da3-8b70-d40cca4e6dce None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:33.228345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-641ae715-857d-4da3-8b70-d40cca4e6dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:33.237693 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2769/5506] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:43:33.242977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021ae8-1795-432c-85a6-ea22a565a2d9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:33.260273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021ae8-1795-432c-85a6-ea22a565a2d9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:33.268641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50cbf-ed66-4d91-893c-ba1c3b799bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:33.269490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50cbf-ed66-4d91-893c-ba1c3b799bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:33.271131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50cbf-ed66-4d91-893c-ba1c3b799bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:33.271560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb50cbf-ed66-4d91-893c-ba1c3b799bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:33.279489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb50cbf-ed66-4d91-893c-ba1c3b799bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:33.280098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb50cbf-ed66-4d91-893c-ba1c3b799bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:33.281927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb50cbf-ed66-4d91-893c-ba1c3b799bd4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:33.304937 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2738/5507] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:33.309376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae715-857d-4da3-8b70-d40cca4e6dce None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:33.319642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae715-857d-4da3-8b70-d40cca4e6dce None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:33.330275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d387452-06bd-4322-a665-792f9bc556a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:33.330912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d387452-06bd-4322-a665-792f9bc556a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:33.331186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d387452-06bd-4322-a665-792f9bc556a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:33.331526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d387452-06bd-4322-a665-792f9bc556a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:33.332166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d387452-06bd-4322-a665-792f9bc556a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:33.334143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d387452-06bd-4322-a665-792f9bc556a2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:33.401233 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2770/5508] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:33 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:33.405771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50cbf-ed66-4d91-893c-ba1c3b799bd4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:33.420586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb50cbf-ed66-4d91-893c-ba1c3b799bd4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:33.561679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d989b6-0ec6-4a9a-9d7c-fae70c7792dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:33.562630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d989b6-0ec6-4a9a-9d7c-fae70c7792dd admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:33.563089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d989b6-0ec6-4a9a-9d7c-fae70c7792dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:33.563899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d989b6-0ec6-4a9a-9d7c-fae70c7792dd admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:33.565059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d989b6-0ec6-4a9a-9d7c-fae70c7792dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:33.567716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d989b6-0ec6-4a9a-9d7c-fae70c7792dd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:33.602990 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2739/5509] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:33 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:33.607081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d387452-06bd-4322-a665-792f9bc556a2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:33.618169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:33.638199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d387452-06bd-4322-a665-792f9bc556a2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:33.668630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4ce6b-dd55-491d-87f7-f984ca26965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:33.669075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4ce6b-dd55-491d-87f7-f984ca26965c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:33.669352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4ce6b-dd55-491d-87f7-f984ca26965c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:33.669676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4ce6b-dd55-491d-87f7-f984ca26965c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:33.670727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4ce6b-dd55-491d-87f7-f984ca26965c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:33.685059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4ce6b-dd55-491d-87f7-f984ca26965c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:33.715071 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2771/5510] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:43:33.716685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d989b6-0ec6-4a9a-9d7c-fae70c7792dd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:33.724593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:33.739212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d989b6-0ec6-4a9a-9d7c-fae70c7792dd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:33.754274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32451c-8ad8-47ca-a75d-e171f3b0fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:33.755900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32451c-8ad8-47ca-a75d-e171f3b0fc29 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:33.756963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32451c-8ad8-47ca-a75d-e171f3b0fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:33.757428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32451c-8ad8-47ca-a75d-e171f3b0fc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:33.758516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32451c-8ad8-47ca-a75d-e171f3b0fc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:33.760892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32451c-8ad8-47ca-a75d-e171f3b0fc29 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:33.777047 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2740/5511] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:33.778521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4ce6b-dd55-491d-87f7-f984ca26965c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:33.796877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4ce6b-dd55-491d-87f7-f984ca26965c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:33.811268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e438d32-44b3-4b0b-8aca-ced043d72bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:33.814421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e438d32-44b3-4b0b-8aca-ced043d72bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:33.814733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e438d32-44b3-4b0b-8aca-ced043d72bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:33.815013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e438d32-44b3-4b0b-8aca-ced043d72bb3 admin admin] PATH_INFO: `/v3/projects/96a32570747d41538532f1771fac6690/users/03f2c03d22a54b8099908e47f438d0da/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:33.854628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e438d32-44b3-4b0b-8aca-ced043d72bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a32570747d41538532f1771fac6690, user_id=03f2c03d22a54b8099908e47f438d0da, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:33.858963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e438d32-44b3-4b0b-8aca-ced043d72bb3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:33.897083 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2772/5512] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:33 2022] PUT /identity/v3/projects/96a32570747d41538532f1771fac6690/users/03f2c03d22a54b8099908e47f438d0da/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:34.021736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20390bef-388d-4176-af0f-631e09477454 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:34.022558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20390bef-388d-4176-af0f-631e09477454 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:34.022558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20390bef-388d-4176-af0f-631e09477454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:34.056392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-20390bef-388d-4176-af0f-631e09477454 None None] MFA Rules not processed for user `03f2c03d22a54b8099908e47f438d0da`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:34.057698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-20390bef-388d-4176-af0f-631e09477454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:34.160168 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2741/5513] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:34.161544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e438d32-44b3-4b0b-8aca-ced043d72bb3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:34.282239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e438d32-44b3-4b0b-8aca-ced043d72bb3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:34.289531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d96b4c-c8e2-40b7-8b0c-53f2fcb992c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:34.290207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96b4c-c8e2-40b7-8b0c-53f2fcb992c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:34.290484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96b4c-c8e2-40b7-8b0c-53f2fcb992c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:34.291096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96b4c-c8e2-40b7-8b0c-53f2fcb992c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:34.291510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d96b4c-c8e2-40b7-8b0c-53f2fcb992c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:34.293909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d96b4c-c8e2-40b7-8b0c-53f2fcb992c2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:34.311003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20390bef-388d-4176-af0f-631e09477454 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:34.312534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-20390bef-388d-4176-af0f-631e09477454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:34.349690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20390bef-388d-4176-af0f-631e09477454 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:34.350463 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2773/5514] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:34 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:43:34.354100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d96b4c-c8e2-40b7-8b0c-53f2fcb992c2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:34.446119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d96b4c-c8e2-40b7-8b0c-53f2fcb992c2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:34.447175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:34.447852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:34.448202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:34.448496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] PATH_INFO: `/v3/projects/d4ad768e5def49f8a56479009e214c53` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:34.449779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ad768e5def49f8a56479009e214c53)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:34.452013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:34.453398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a4bae-1d39-42fd-8e29-d8168e8c910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:34.455487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a4bae-1d39-42fd-8e29-d8168e8c910f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:34.456120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a4bae-1d39-42fd-8e29-d8168e8c910f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:34.456653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a4bae-1d39-42fd-8e29-d8168e8c910f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:34.457489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a4bae-1d39-42fd-8e29-d8168e8c910f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:34.459954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a4bae-1d39-42fd-8e29-d8168e8c910f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:34.491618 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2774/5515] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:34 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:34.493144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a4bae-1d39-42fd-8e29-d8168e8c910f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:34.495821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aa5a4bae-1d39-42fd-8e29-d8168e8c910f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:34.510127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a4bae-1d39-42fd-8e29-d8168e8c910f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:34.553335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ad768e5def49f8a56479009e214c53', 'request_id': 'req-b58c4367-4d7e-4105-a6d7-d6e570e19639'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:34.562546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:34.576158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ad768e5def49f8a56479009e214c53', 'request_id': 'req-b58c4367-4d7e-4105-a6d7-d6e570e19639'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:34.586516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:34.587508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:34.588007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:34.588362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] PATH_INFO: `/v3/projects/bd68b8dc04f742d29010ae221a3d0ace` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:34.590316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd68b8dc04f742d29010ae221a3d0ace)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:34.592732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:34.605348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ad768e5def49f8a56479009e214c53', 'request_id': 'req-b58c4367-4d7e-4105-a6d7-d6e570e19639'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:34.632830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] The token cache is being invalidate because project d4ad768e5def49f8a56479009e214c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:34.633382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:34.634392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:34.649137 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2742/5516] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:34 2022] DELETE /identity/v3/projects/d4ad768e5def49f8a56479009e214c53 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:34.649137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:34.651460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:34.688540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd68b8dc04f742d29010ae221a3d0ace', 'request_id': 'req-8f7738ad-63b0-48f3-b222-2078b21b5721'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:34.695264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4367-4d7e-4105-a6d7-d6e570e19639 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:34.707359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd68b8dc04f742d29010ae221a3d0ace', 'request_id': 'req-8f7738ad-63b0-48f3-b222-2078b21b5721'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:34.716415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:34.725555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd68b8dc04f742d29010ae221a3d0ace', 'request_id': 'req-8f7738ad-63b0-48f3-b222-2078b21b5721'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:34.748287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] The token cache is being invalidate because project bd68b8dc04f742d29010ae221a3d0ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:34.748723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:34.751625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f7738ad-63b0-48f3-b222-2078b21b5721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:34.755167 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2775/5517] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:34 2022] DELETE /identity/v3/projects/bd68b8dc04f742d29010ae221a3d0ace => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:34.756632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6df72-bfa2-40d3-bfce-5e84a68c8058 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:34.756956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6df72-bfa2-40d3-bfce-5e84a68c8058 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:34.757391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6df72-bfa2-40d3-bfce-5e84a68c8058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:34.805109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c0b6df72-bfa2-40d3-bfce-5e84a68c8058 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:34.806401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c0b6df72-bfa2-40d3-bfce-5e84a68c8058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:34.836676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db3a79-d915-45e6-870a-e166597956b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:34.837286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db3a79-d915-45e6-870a-e166597956b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:34.837556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db3a79-d915-45e6-870a-e166597956b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:34.837820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db3a79-d915-45e6-870a-e166597956b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:34.838505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db3a79-d915-45e6-870a-e166597956b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:34.842484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db3a79-d915-45e6-870a-e166597956b0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:34.861864 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2743/5518] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:34.863231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d1399-7460-4f0c-8439-007b79665ccf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:34.863570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d1399-7460-4f0c-8439-007b79665ccf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:34.864113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d1399-7460-4f0c-8439-007b79665ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:34.904186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-aa2d1399-7460-4f0c-8439-007b79665ccf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:34.908123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aa2d1399-7460-4f0c-8439-007b79665ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:34.942333 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2744/5519] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:34.943715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d1399-7460-4f0c-8439-007b79665ccf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:34.954443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aa2d1399-7460-4f0c-8439-007b79665ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:34.979609 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2776/5520] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:34.981286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fbac9-76f8-4c40-8bc3-f0b8ae579bdb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:34.981983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fbac9-76f8-4c40-8bc3-f0b8ae579bdb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:34.982417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fbac9-76f8-4c40-8bc3-f0b8ae579bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:34.986903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d1399-7460-4f0c-8439-007b79665ccf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.003807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb34f9c-1bec-4325-8796-6c3ace3ac33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.004496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb34f9c-1bec-4325-8796-6c3ace3ac33f admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.004835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb34f9c-1bec-4325-8796-6c3ace3ac33f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.005028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb34f9c-1bec-4325-8796-6c3ace3ac33f admin admin] PATH_INFO: `/v3/projects/72ce9c88df0c44d7a196ee0e94ee8033/users/a8fb2d88192b4aa999fbebbddb20d2fe/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.010458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bb6fbac9-76f8-4c40-8bc3-f0b8ae579bdb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:35.012050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bb6fbac9-76f8-4c40-8bc3-f0b8ae579bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:35.024138 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2777/5521] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:35.030303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87061eb-98d8-47ab-add2-b36c3de2670e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.030686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87061eb-98d8-47ab-add2-b36c3de2670e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.031057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87061eb-98d8-47ab-add2-b36c3de2670e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.039186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb34f9c-1bec-4325-8796-6c3ace3ac33f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ce9c88df0c44d7a196ee0e94ee8033, user_id=a8fb2d88192b4aa999fbebbddb20d2fe, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.053414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb34f9c-1bec-4325-8796-6c3ace3ac33f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.056619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a87061eb-98d8-47ab-add2-b36c3de2670e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:35.058010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a87061eb-98d8-47ab-add2-b36c3de2670e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:35.070590 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2778/5522] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:35.071483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87061eb-98d8-47ab-add2-b36c3de2670e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.077013 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2745/5523] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:34 2022] PUT /identity/v3/projects/72ce9c88df0c44d7a196ee0e94ee8033/users/a8fb2d88192b4aa999fbebbddb20d2fe/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:35.080849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb34f9c-1bec-4325-8796-6c3ace3ac33f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.087789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87061eb-98d8-47ab-add2-b36c3de2670e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.205708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc3ef2-88de-4a0c-90a2-de3e3563302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.206596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc3ef2-88de-4a0c-90a2-de3e3563302d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.206961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb34f9c-1bec-4325-8796-6c3ace3ac33f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.207194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc3ef2-88de-4a0c-90a2-de3e3563302d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.207960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc3ef2-88de-4a0c-90a2-de3e3563302d admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.209386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc3ef2-88de-4a0c-90a2-de3e3563302d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:35.209386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc3ef2-88de-4a0c-90a2-de3e3563302d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.211262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc3ef2-88de-4a0c-90a2-de3e3563302d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.213336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:35.224047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65b5ed-6f38-415e-93e9-6af75cfd1942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.224693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65b5ed-6f38-415e-93e9-6af75cfd1942 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.224977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65b5ed-6f38-415e-93e9-6af75cfd1942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.225267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65b5ed-6f38-415e-93e9-6af75cfd1942 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.226243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65b5ed-6f38-415e-93e9-6af75cfd1942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:35.226548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65b5ed-6f38-415e-93e9-6af75cfd1942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.228197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65b5ed-6f38-415e-93e9-6af75cfd1942 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.245078 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2779/5524] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:35.248394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc3ef2-88de-4a0c-90a2-de3e3563302d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.264603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc3ef2-88de-4a0c-90a2-de3e3563302d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.264793 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2746/5525] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:35.265729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65b5ed-6f38-415e-93e9-6af75cfd1942 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.274663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbe320-f44e-4cc1-afd8-cb97e938b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.276345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbe320-f44e-4cc1-afd8-cb97e938b72e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.276750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbe320-f44e-4cc1-afd8-cb97e938b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.277714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbe320-f44e-4cc1-afd8-cb97e938b72e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.278527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbe320-f44e-4cc1-afd8-cb97e938b72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.282588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fbe320-f44e-4cc1-afd8-cb97e938b72e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.289463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65b5ed-6f38-415e-93e9-6af75cfd1942 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.301079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7a2c4-7146-4ff1-bddf-64cef02fa39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.301714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7a2c4-7146-4ff1-bddf-64cef02fa39a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.302026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7a2c4-7146-4ff1-bddf-64cef02fa39a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.302303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7a2c4-7146-4ff1-bddf-64cef02fa39a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.302949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7a2c4-7146-4ff1-bddf-64cef02fa39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.305240 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2780/5526] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:35.306218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbe320-f44e-4cc1-afd8-cb97e938b72e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.318169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7a2c4-7146-4ff1-bddf-64cef02fa39a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.321259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbe320-f44e-4cc1-afd8-cb97e938b72e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.334066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038ef86-57bb-4cef-ac26-cc2cf05fceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.334807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ef86-57bb-4cef-ac26-cc2cf05fceb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.335215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ef86-57bb-4cef-ac26-cc2cf05fceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.335642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038ef86-57bb-4cef-ac26-cc2cf05fceb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.336468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038ef86-57bb-4cef-ac26-cc2cf05fceb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.339471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038ef86-57bb-4cef-ac26-cc2cf05fceb8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.368334 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2747/5527] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:35 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:35.369505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7a2c4-7146-4ff1-bddf-64cef02fa39a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.388351 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2781/5528] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:35 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:35.389597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038ef86-57bb-4cef-ac26-cc2cf05fceb8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.486178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:35.512657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7a2c4-7146-4ff1-bddf-64cef02fa39a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.520547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945277f3-8563-44f1-8042-9f7e5b04c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.521177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038ef86-57bb-4cef-ac26-cc2cf05fceb8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.521296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945277f3-8563-44f1-8042-9f7e5b04c144 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.521570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945277f3-8563-44f1-8042-9f7e5b04c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.521769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945277f3-8563-44f1-8042-9f7e5b04c144 admin admin] PATH_INFO: `/v3/projects/72ce9c88df0c44d7a196ee0e94ee8033/users/a8fb2d88192b4aa999fbebbddb20d2fe/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.528501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029133c-85ac-4c1e-bfad-656bef775cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.528722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945277f3-8563-44f1-8042-9f7e5b04c144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ce9c88df0c44d7a196ee0e94ee8033, user_id=a8fb2d88192b4aa999fbebbddb20d2fe, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.529350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029133c-85ac-4c1e-bfad-656bef775cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.530646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029133c-85ac-4c1e-bfad-656bef775cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.531042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029133c-85ac-4c1e-bfad-656bef775cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.531858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029133c-85ac-4c1e-bfad-656bef775cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.533978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029133c-85ac-4c1e-bfad-656bef775cd8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.534413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945277f3-8563-44f1-8042-9f7e5b04c144 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.563818 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2748/5529] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:35 2022] PUT /identity/v3/projects/72ce9c88df0c44d7a196ee0e94ee8033/users/a8fb2d88192b4aa999fbebbddb20d2fe/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:35.574053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945277f3-8563-44f1-8042-9f7e5b04c144 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.577767 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2782/5530] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:35 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:35.581126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc1b15-84ed-40e6-9850-0f29bdddd8bf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.582172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc1b15-84ed-40e6-9850-0f29bdddd8bf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.584168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc1b15-84ed-40e6-9850-0f29bdddd8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.676789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bedc1b15-84ed-40e6-9850-0f29bdddd8bf None None] MFA Rules not processed for user `a8fb2d88192b4aa999fbebbddb20d2fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:35.693677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bedc1b15-84ed-40e6-9850-0f29bdddd8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:35.719854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945277f3-8563-44f1-8042-9f7e5b04c144 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.726428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dea834-7446-4e4e-9094-e601b4fe3c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.727246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea834-7446-4e4e-9094-e601b4fe3c61 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.727703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea834-7446-4e4e-9094-e601b4fe3c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.728107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dea834-7446-4e4e-9094-e601b4fe3c61 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.728872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dea834-7446-4e4e-9094-e601b4fe3c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.731028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dea834-7446-4e4e-9094-e601b4fe3c61 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.766023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2749/5531] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:35 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:35.767261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dea834-7446-4e4e-9094-e601b4fe3c61 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.791539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dea834-7446-4e4e-9094-e601b4fe3c61 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.804476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9b14-a97d-4165-be1c-dda21a808c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.805792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9b14-a97d-4165-be1c-dda21a808c9c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.816623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9b14-a97d-4165-be1c-dda21a808c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.817159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9b14-a97d-4165-be1c-dda21a808c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.818586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d9b14-a97d-4165-be1c-dda21a808c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.828488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d9b14-a97d-4165-be1c-dda21a808c9c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.850019 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2750/5532] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:35.853218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9b14-a97d-4165-be1c-dda21a808c9c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.863146 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2783/5533] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:35.864182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc1b15-84ed-40e6-9850-0f29bdddd8bf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.882815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc1b15-84ed-40e6-9850-0f29bdddd8bf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.883566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9b14-a97d-4165-be1c-dda21a808c9c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.893315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbcabc-510c-4e3b-a1c7-58d6edfa80ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.894183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbcabc-510c-4e3b-a1c7-58d6edfa80ad admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.895305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbcabc-510c-4e3b-a1c7-58d6edfa80ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.895591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbcabc-510c-4e3b-a1c7-58d6edfa80ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.896279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbcabc-510c-4e3b-a1c7-58d6edfa80ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.899970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33818738-0ccb-434d-954e-30948292bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.901048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33818738-0ccb-434d-954e-30948292bbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.901574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33818738-0ccb-434d-954e-30948292bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.902117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33818738-0ccb-434d-954e-30948292bbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.903195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33818738-0ccb-434d-954e-30948292bbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.905472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33818738-0ccb-434d-954e-30948292bbf6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.906752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbcabc-510c-4e3b-a1c7-58d6edfa80ad admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.925800 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2751/5534] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:35.926721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbcabc-510c-4e3b-a1c7-58d6edfa80ad admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.932978 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2784/5535] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:35.939592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33818738-0ccb-434d-954e-30948292bbf6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:35.951406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbcabc-510c-4e3b-a1c7-58d6edfa80ad admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.958294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33818738-0ccb-434d-954e-30948292bbf6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:35.960343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dadd84-a390-4d90-acba-162044b76f49 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.960343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dadd84-a390-4d90-acba-162044b76f49 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.960641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dadd84-a390-4d90-acba-162044b76f49 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.960804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dadd84-a390-4d90-acba-162044b76f49 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.961752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dadd84-a390-4d90-acba-162044b76f49 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.965571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dadd84-a390-4d90-acba-162044b76f49 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:35.981783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1180fa-bb5f-487a-9cbe-b043a038f867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:35.982601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1180fa-bb5f-487a-9cbe-b043a038f867 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:35.982982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1180fa-bb5f-487a-9cbe-b043a038f867 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:35.983362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1180fa-bb5f-487a-9cbe-b043a038f867 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:35.985234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1180fa-bb5f-487a-9cbe-b043a038f867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:35.985863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1180fa-bb5f-487a-9cbe-b043a038f867 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:36.027499 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2785/5536] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:36.028731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1180fa-bb5f-487a-9cbe-b043a038f867 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:36.034140 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2752/5537] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:35 2022] POST /identity/v3/projects => generated 360 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:36.034140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dadd84-a390-4d90-acba-162044b76f49 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:36.050755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1180fa-bb5f-487a-9cbe-b043a038f867 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:36.067311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:36.181419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722fd4-e4e5-4cc4-a59f-bf3344f935ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:36.182929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722fd4-e4e5-4cc4-a59f-bf3344f935ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:36.183589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722fd4-e4e5-4cc4-a59f-bf3344f935ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:36.184189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69722fd4-e4e5-4cc4-a59f-bf3344f935ec admin admin] PATH_INFO: `/v3/projects/4d85d72ef4714160b8965d5befa5aee5/users/0b3baad46d2d43ab85affd37c75154be/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:36.190683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dadd84-a390-4d90-acba-162044b76f49 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:36.196301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c650b-4327-497f-85cd-4265b24a03dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:36.197112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c650b-4327-497f-85cd-4265b24a03dc admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:36.197454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c650b-4327-497f-85cd-4265b24a03dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:36.197971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c650b-4327-497f-85cd-4265b24a03dc admin admin] PATH_INFO: `/v3/projects/03ef999771a4498cac3194e761b4391f/users/c80f10e567ee49ad8ade13d3c95b431d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:36.212313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69722fd4-e4e5-4cc4-a59f-bf3344f935ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d85d72ef4714160b8965d5befa5aee5, user_id=0b3baad46d2d43ab85affd37c75154be, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:36.216514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69722fd4-e4e5-4cc4-a59f-bf3344f935ec admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:36.224475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c650b-4327-497f-85cd-4265b24a03dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ef999771a4498cac3194e761b4391f, user_id=c80f10e567ee49ad8ade13d3c95b431d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:36.228346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c650b-4327-497f-85cd-4265b24a03dc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:36.245937 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2786/5538] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:36 2022] PUT /identity/v3/projects/4d85d72ef4714160b8965d5befa5aee5/users/0b3baad46d2d43ab85affd37c75154be/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:36.245937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722fd4-e4e5-4cc4-a59f-bf3344f935ec admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:36.258537 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2753/5539] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:36 2022] PUT /identity/v3/projects/03ef999771a4498cac3194e761b4391f/users/c80f10e567ee49ad8ade13d3c95b431d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:36.260508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412933ea-93f6-4b62-a820-63889db7b27c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:36.260670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412933ea-93f6-4b62-a820-63889db7b27c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:36.260877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412933ea-93f6-4b62-a820-63889db7b27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:36.298458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:36.304071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-412933ea-93f6-4b62-a820-63889db7b27c None None] MFA Rules not processed for user `0b3baad46d2d43ab85affd37c75154be`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:36.306497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-412933ea-93f6-4b62-a820-63889db7b27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:36.398739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69722fd4-e4e5-4cc4-a59f-bf3344f935ec admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:36.442442 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2754/5540] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:36.448827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898bde-36cf-4fef-8213-aecd798b56de None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:36.449224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898bde-36cf-4fef-8213-aecd798b56de None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:36.449621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82898bde-36cf-4fef-8213-aecd798b56de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:36.491178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-82898bde-36cf-4fef-8213-aecd798b56de None None] MFA Rules not processed for user `c80f10e567ee49ad8ade13d3c95b431d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:36.493516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-82898bde-36cf-4fef-8213-aecd798b56de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:36.519088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0cfe-fbbe-45f4-a641-e869908749c2 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:36.519820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0cfe-fbbe-45f4-a641-e869908749c2 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:36.520099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0cfe-fbbe-45f4-a641-e869908749c2 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:36.520369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ea0cfe-fbbe-45f4-a641-e869908749c2 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:36.521166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea0cfe-fbbe-45f4-a641-e869908749c2 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:36.523452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ea0cfe-fbbe-45f4-a641-e869908749c2 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:36.568166 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2787/5541] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:36 2022] POST /identity/v3/users => generated 416 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:36.568166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0cfe-fbbe-45f4-a641-e869908749c2 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:36.611426 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2755/5542] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:36.613056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82898bde-36cf-4fef-8213-aecd798b56de None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:36.632469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82898bde-36cf-4fef-8213-aecd798b56de None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:36.639967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc8458-b465-4a2a-bf77-5b15cdf510ea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:36.641817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8458-b465-4a2a-bf77-5b15cdf510ea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:36.641817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8458-b465-4a2a-bf77-5b15cdf510ea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:36.642837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc8458-b465-4a2a-bf77-5b15cdf510ea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/users/dc98a1980d5c4338aab2b4b9a5d5b8e2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:36.652055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:36.673918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc8458-b465-4a2a-bf77-5b15cdf510ea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:get_user(user_id=dc98a1980d5c4338aab2b4b9a5d5b8e2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:36.681599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc8458-b465-4a2a-bf77-5b15cdf510ea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:36.684183 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2756/5543] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:43:36 2022] GET /identity/v3/users/dc98a1980d5c4338aab2b4b9a5d5b8e2 => generated 416 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:36.686210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc8458-b465-4a2a-bf77-5b15cdf510ea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:36.688562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a9dc8458-b465-4a2a-bf77-5b15cdf510ea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:36.718168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ea0cfe-fbbe-45f4-a641-e869908749c2 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:36.731793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa367737-f8f4-4d39-a375-d6eaaf3159c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:36.732422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367737-f8f4-4d39-a375-d6eaaf3159c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:36.732696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367737-f8f4-4d39-a375-d6eaaf3159c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:36.733087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa367737-f8f4-4d39-a375-d6eaaf3159c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:36.733713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa367737-f8f4-4d39-a375-d6eaaf3159c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:36.735853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa367737-f8f4-4d39-a375-d6eaaf3159c5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:36.797949 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2788/5544] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:36 2022] POST /identity/v3/projects => generated 369 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:36.797949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa367737-f8f4-4d39-a375-d6eaaf3159c5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:36.878348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc8458-b465-4a2a-bf77-5b15cdf510ea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:36.922325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:36.991749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa367737-f8f4-4d39-a375-d6eaaf3159c5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:37.013199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5389b-d428-4402-8765-87adffa51289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:37.023000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5389b-d428-4402-8765-87adffa51289 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:37.023240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5389b-d428-4402-8765-87adffa51289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:37.023474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5389b-d428-4402-8765-87adffa51289 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:37.024142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5389b-d428-4402-8765-87adffa51289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:37.026169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5389b-d428-4402-8765-87adffa51289 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:37.075592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b67372-d8f4-4136-9571-9c4f5f796071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:37.077968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b67372-d8f4-4136-9571-9c4f5f796071 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:37.081521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b67372-d8f4-4136-9571-9c4f5f796071 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:37.084434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b67372-d8f4-4136-9571-9c4f5f796071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:37.094628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b0b67372-d8f4-4136-9571-9c4f5f796071 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:37.157923 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2789/5545] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:36 2022] POST /identity/v3/projects => generated 373 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:37.172385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5389b-d428-4402-8765-87adffa51289 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:37.195138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b67372-d8f4-4136-9571-9c4f5f796071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:37.196983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b67372-d8f4-4136-9571-9c4f5f796071 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:37.223100 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2757/5546] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:37.224964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b67372-d8f4-4136-9571-9c4f5f796071 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:37.253847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b67372-d8f4-4136-9571-9c4f5f796071 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:37.416099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64ee7d-1c7a-4dd1-a677-e18f5e10fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:37.416998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64ee7d-1c7a-4dd1-a677-e18f5e10fa6d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:37.418885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64ee7d-1c7a-4dd1-a677-e18f5e10fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:37.419314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64ee7d-1c7a-4dd1-a677-e18f5e10fa6d admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:37.431888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64ee7d-1c7a-4dd1-a677-e18f5e10fa6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:37.438040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5389b-d428-4402-8765-87adffa51289 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:37.439696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64ee7d-1c7a-4dd1-a677-e18f5e10fa6d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:37.459622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:37.467484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:37.467484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:37.467484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/users/dc98a1980d5c4338aab2b4b9a5d5b8e2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:37.470576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_user(user_id=dc98a1980d5c4338aab2b4b9a5d5b8e2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:37.471843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:37.514207 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2758/5547] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:37 2022] POST /identity/v3/users => generated 291 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:37.514207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64ee7d-1c7a-4dd1-a677-e18f5e10fa6d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:37.546709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64ee7d-1c7a-4dd1-a677-e18f5e10fa6d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:37.552586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:37.570918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3c26e-894e-448d-b684-c30676197702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:37.571684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c26e-894e-448d-b684-c30676197702 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:37.572359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c26e-894e-448d-b684-c30676197702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:37.572851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c26e-894e-448d-b684-c30676197702 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:37.573574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3c26e-894e-448d-b684-c30676197702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:37.576785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3c26e-894e-448d-b684-c30676197702 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:37.577247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc98a1980d5c4338aab2b4b9a5d5b8e2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:37.578389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc98a1980d5c4338aab2b4b9a5d5b8e2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:37.599028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc98a1980d5c4338aab2b4b9a5d5b8e2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:37.624316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc98a1980d5c4338aab2b4b9a5d5b8e2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:37.630750 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2759/5548] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:37 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:37.639223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3c26e-894e-448d-b684-c30676197702 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:37.658148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc98a1980d5c4338aab2b4b9a5d5b8e2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:37.669196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3c26e-894e-448d-b684-c30676197702 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:37.675689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54bc70-5dd2-40d9-8d79-ba38e398635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:37.676323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54bc70-5dd2-40d9-8d79-ba38e398635c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:37.676599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54bc70-5dd2-40d9-8d79-ba38e398635c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:37.676867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54bc70-5dd2-40d9-8d79-ba38e398635c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:37.677518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54bc70-5dd2-40d9-8d79-ba38e398635c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:37.679439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54bc70-5dd2-40d9-8d79-ba38e398635c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:37.684289 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2790/5549] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:37 2022] DELETE /identity/v3/users/dc98a1980d5c4338aab2b4b9a5d5b8e2 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:37.688151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:37.692300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:37.724156 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2760/5550] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:37.725231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54bc70-5dd2-40d9-8d79-ba38e398635c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:37.729184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fb54bc70-5dd2-40d9-8d79-ba38e398635c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:37.762032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54bc70-5dd2-40d9-8d79-ba38e398635c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:37.829965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:37.880751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:37.881450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:37.881939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:37.882306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/f608b5ad94984aff90d34657934c8de8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:37.883759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f608b5ad94984aff90d34657934c8de8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:37.886892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:37.891556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059c6bc-ec13-4ded-a614-72495bb66433 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:37.920264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2671-31ba-409a-9cd8-1b9cfd0b5bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:37.922142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2671-31ba-409a-9cd8-1b9cfd0b5bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:37.923233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2671-31ba-409a-9cd8-1b9cfd0b5bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:37.923864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2671-31ba-409a-9cd8-1b9cfd0b5bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:37.924999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2671-31ba-409a-9cd8-1b9cfd0b5bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:37.932242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2671-31ba-409a-9cd8-1b9cfd0b5bd6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:37.958104 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2791/5551] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:37.961471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2671-31ba-409a-9cd8-1b9cfd0b5bd6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:37.965608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e31d2671-31ba-409a-9cd8-1b9cfd0b5bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:37.986764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2671-31ba-409a-9cd8-1b9cfd0b5bd6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:38.002932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f608b5ad94984aff90d34657934c8de8', 'request_id': 'req-28a064a6-0d82-4150-9240-7338908b68fe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:38.014733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f608b5ad94984aff90d34657934c8de8', 'request_id': 'req-28a064a6-0d82-4150-9240-7338908b68fe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:38.023972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f608b5ad94984aff90d34657934c8de8', 'request_id': 'req-28a064a6-0d82-4150-9240-7338908b68fe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:38.039771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project f608b5ad94984aff90d34657934c8de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:38.040060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:38.040733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:38.051270 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2761/5552] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:37 2022] DELETE /identity/v3/projects/f608b5ad94984aff90d34657934c8de8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:38.052433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:38.054599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:38.074361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af3725-59dc-4972-81b1-95eab0158214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:38.075367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af3725-59dc-4972-81b1-95eab0158214 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:38.075859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af3725-59dc-4972-81b1-95eab0158214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:38.076298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af3725-59dc-4972-81b1-95eab0158214 admin admin] PATH_INFO: `/v3/projects/1eed29cdb37b44daab6a76d85dcbc234/users/13312950f7e04e7980aa96d86a61a88b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:38.097021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af3725-59dc-4972-81b1-95eab0158214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eed29cdb37b44daab6a76d85dcbc234, user_id=13312950f7e04e7980aa96d86a61a88b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:38.103221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af3725-59dc-4972-81b1-95eab0158214 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:38.135858 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2792/5553] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:37 2022] PUT /identity/v3/projects/1eed29cdb37b44daab6a76d85dcbc234/users/13312950f7e04e7980aa96d86a61a88b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:38.137449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af3725-59dc-4972-81b1-95eab0158214 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:38.144675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d9af3725-59dc-4972-81b1-95eab0158214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:38.167483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a064a6-0d82-4150-9240-7338908b68fe tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:38.250755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:38.261093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b310564-4fca-4ca1-a5ab-bf93b424737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:38.262964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b310564-4fca-4ca1-a5ab-bf93b424737d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:38.263390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b310564-4fca-4ca1-a5ab-bf93b424737d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:38.263664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b310564-4fca-4ca1-a5ab-bf93b424737d admin admin] PATH_INFO: `/v3/projects/dae34b3272c84b7bba5f351acd3498da/users/70a8dd51989a47bdb4daba6a26f8f7b2/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:38.295810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:38.300101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af3725-59dc-4972-81b1-95eab0158214 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:38.305645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b310564-4fca-4ca1-a5ab-bf93b424737d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae34b3272c84b7bba5f351acd3498da, user_id=70a8dd51989a47bdb4daba6a26f8f7b2, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:38.306861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357ae35-c91d-4152-ac9f-e3983ef29b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:38.307667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357ae35-c91d-4152-ac9f-e3983ef29b4a service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:38.308217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357ae35-c91d-4152-ac9f-e3983ef29b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:38.308580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357ae35-c91d-4152-ac9f-e3983ef29b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:38.311426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8357ae35-c91d-4152-ac9f-e3983ef29b4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:38.316611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b310564-4fca-4ca1-a5ab-bf93b424737d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:38.350609 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2762/5554] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:38 2022] PUT /identity/v3/projects/dae34b3272c84b7bba5f351acd3498da/users/70a8dd51989a47bdb4daba6a26f8f7b2/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:38.351654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b310564-4fca-4ca1-a5ab-bf93b424737d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:38.355994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6b310564-4fca-4ca1-a5ab-bf93b424737d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:38.426436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357ae35-c91d-4152-ac9f-e3983ef29b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:38.430954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357ae35-c91d-4152-ac9f-e3983ef29b4a service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:38.470241 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2793/5555] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:38.474196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357ae35-c91d-4152-ac9f-e3983ef29b4a service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:38.478039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8357ae35-c91d-4152-ac9f-e3983ef29b4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:38.520407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357ae35-c91d-4152-ac9f-e3983ef29b4a service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:38.575034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b310564-4fca-4ca1-a5ab-bf93b424737d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:38.594424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cff97-5605-46df-873e-67ef34805420 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:38.595090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cff97-5605-46df-873e-67ef34805420 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:38.595426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cff97-5605-46df-873e-67ef34805420 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:38.595697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cff97-5605-46df-873e-67ef34805420 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:38.606162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cff97-5605-46df-873e-67ef34805420 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:38.610259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cff97-5605-46df-873e-67ef34805420 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:38.654986 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2763/5556] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:38 2022] POST /identity/v3/projects => generated 348 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:38.662154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cff97-5605-46df-873e-67ef34805420 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:38.733785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868018f-1f82-4607-9203-a9c0bd233303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:38.734984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868018f-1f82-4607-9203-a9c0bd233303 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:38.737310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868018f-1f82-4607-9203-a9c0bd233303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:38.737608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868018f-1f82-4607-9203-a9c0bd233303 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:38.738315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868018f-1f82-4607-9203-a9c0bd233303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:38.745843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868018f-1f82-4607-9203-a9c0bd233303 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:38.773966 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2794/5557] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:38.777566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868018f-1f82-4607-9203-a9c0bd233303 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:38.798871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868018f-1f82-4607-9203-a9c0bd233303 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:38.846588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cff97-5605-46df-873e-67ef34805420 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:38.864035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb73b4d-4225-42b2-b0cc-73fc4ab068b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:38.864916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb73b4d-4225-42b2-b0cc-73fc4ab068b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:38.865418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb73b4d-4225-42b2-b0cc-73fc4ab068b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:38.865891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb73b4d-4225-42b2-b0cc-73fc4ab068b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:38.866782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb73b4d-4225-42b2-b0cc-73fc4ab068b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:38.869397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb73b4d-4225-42b2-b0cc-73fc4ab068b2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:38.896258 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2764/5558] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:38.899539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb73b4d-4225-42b2-b0cc-73fc4ab068b2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:38.924447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb73b4d-4225-42b2-b0cc-73fc4ab068b2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:38.943253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25174559-f8d4-4bff-840a-8a5e43b79eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:38.944565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25174559-f8d4-4bff-840a-8a5e43b79eef admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:38.945069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25174559-f8d4-4bff-840a-8a5e43b79eef admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:38.945780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25174559-f8d4-4bff-840a-8a5e43b79eef admin admin] PATH_INFO: `/v3/projects/1eed29cdb37b44daab6a76d85dcbc234/users/13312950f7e04e7980aa96d86a61a88b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:38.951148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25174559-f8d4-4bff-840a-8a5e43b79eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eed29cdb37b44daab6a76d85dcbc234, user_id=13312950f7e04e7980aa96d86a61a88b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:38.953249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25174559-f8d4-4bff-840a-8a5e43b79eef admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:39.020378 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2765/5559] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:38 2022] PUT /identity/v3/projects/1eed29cdb37b44daab6a76d85dcbc234/users/13312950f7e04e7980aa96d86a61a88b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:39.023892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25174559-f8d4-4bff-840a-8a5e43b79eef admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:39.026328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8978e4f-aed4-4762-9358-f3db4cf5acd5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:39.026978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8978e4f-aed4-4762-9358-f3db4cf5acd5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:39.027261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8978e4f-aed4-4762-9358-f3db4cf5acd5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:39.027539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8978e4f-aed4-4762-9358-f3db4cf5acd5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:39.028368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8978e4f-aed4-4762-9358-f3db4cf5acd5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:39.028679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8978e4f-aed4-4762-9358-f3db4cf5acd5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:39.032926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8978e4f-aed4-4762-9358-f3db4cf5acd5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:39.101950 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2795/5560] 10.222.0.43 () {58 vars in 1160 bytes} [Tue Aug 30 04:43:38 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:39.104668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f474-3e49-430a-82a8-a78bf7e17d34 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:39.104958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f474-3e49-430a-82a8-a78bf7e17d34 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:39.105227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f474-3e49-430a-82a8-a78bf7e17d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:39.126080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25174559-f8d4-4bff-840a-8a5e43b79eef admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:39.132894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:39.142677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989c6fc-e443-4bc2-8deb-f6b63df702a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:39.145722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989c6fc-e443-4bc2-8deb-f6b63df702a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:39.145722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989c6fc-e443-4bc2-8deb-f6b63df702a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:39.145722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989c6fc-e443-4bc2-8deb-f6b63df702a7 admin admin] PATH_INFO: `/v3/projects/dae34b3272c84b7bba5f351acd3498da/users/70a8dd51989a47bdb4daba6a26f8f7b2/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:39.150891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989c6fc-e443-4bc2-8deb-f6b63df702a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae34b3272c84b7bba5f351acd3498da, user_id=70a8dd51989a47bdb4daba6a26f8f7b2, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:39.153820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989c6fc-e443-4bc2-8deb-f6b63df702a7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:39.165636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8197f474-3e49-430a-82a8-a78bf7e17d34 None None] MFA Rules not processed for user `13312950f7e04e7980aa96d86a61a88b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:39.167247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8197f474-3e49-430a-82a8-a78bf7e17d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:39.177470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:39.185512 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2766/5561] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:39 2022] PUT /identity/v3/projects/dae34b3272c84b7bba5f351acd3498da/users/70a8dd51989a47bdb4daba6a26f8f7b2/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:39.186645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989c6fc-e443-4bc2-8deb-f6b63df702a7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:39.259281 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2796/5562] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:39.261799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e491db-b45f-478b-aa84-72d25b22cdc6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:39.262449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e491db-b45f-478b-aa84-72d25b22cdc6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:39.263238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e491db-b45f-478b-aa84-72d25b22cdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:39.297209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-28e491db-b45f-478b-aa84-72d25b22cdc6 None None] MFA Rules not processed for user `70a8dd51989a47bdb4daba6a26f8f7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:39.299514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-28e491db-b45f-478b-aa84-72d25b22cdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:39.373637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989c6fc-e443-4bc2-8deb-f6b63df702a7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:39.380748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93c0a5-aa9f-4db4-a79e-56a3be736d2e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:39.381441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93c0a5-aa9f-4db4-a79e-56a3be736d2e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:39.381788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93c0a5-aa9f-4db4-a79e-56a3be736d2e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:39.382201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93c0a5-aa9f-4db4-a79e-56a3be736d2e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:39.382737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93c0a5-aa9f-4db4-a79e-56a3be736d2e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:39.384983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93c0a5-aa9f-4db4-a79e-56a3be736d2e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:39.410675 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2797/5563] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:39.411437 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2767/5564] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Aug 30 04:43:39 2022] GET /identity/v3/domains => generated 829 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:39.412499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e491db-b45f-478b-aa84-72d25b22cdc6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:39.415688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93c0a5-aa9f-4db4-a79e-56a3be736d2e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:39.425289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e491db-b45f-478b-aa84-72d25b22cdc6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:39.431053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305bb2c-39cd-49ff-9f8b-e89820b8ed9c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:39.431729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93c0a5-aa9f-4db4-a79e-56a3be736d2e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:39.431866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305bb2c-39cd-49ff-9f8b-e89820b8ed9c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:39.432050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305bb2c-39cd-49ff-9f8b-e89820b8ed9c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:39.432278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305bb2c-39cd-49ff-9f8b-e89820b8ed9c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:39.432950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305bb2c-39cd-49ff-9f8b-e89820b8ed9c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:39.434027 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-6305bb2c-39cd-49ff-9f8b-e89820b8ed9c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:39.434027 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:39.434027 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:39.435324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305bb2c-39cd-49ff-9f8b-e89820b8ed9c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:39.441737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:39.443715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:39.444319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:39.444939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/30b364699a1b4b788892c27644d60185` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:39.446693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:update_project(project_id=30b364699a1b4b788892c27644d60185)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:39.447953 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:39.447953 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:39.447953 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:39.449322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:39.467737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '30b364699a1b4b788892c27644d60185'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:39.468450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '30b364699a1b4b788892c27644d60185'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:39.469982 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2798/5565] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:43:39 2022] POST /identity/v3/services => generated 240 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:39.471368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305bb2c-39cd-49ff-9f8b-e89820b8ed9c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:39.473669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6305bb2c-39cd-49ff-9f8b-e89820b8ed9c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:39.538144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '30b364699a1b4b788892c27644d60185'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:39.540302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '30b364699a1b4b788892c27644d60185'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:39.546521 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2768/5566] 10.222.0.43 () {60 vars in 1252 bytes} [Tue Aug 30 04:43:39 2022] PATCH /identity/v3/projects/30b364699a1b4b788892c27644d60185 => generated 362 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:39.547483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:39.549257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:39.630123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305bb2c-39cd-49ff-9f8b-e89820b8ed9c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:39.642934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:39.660135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689b453-6205-4c31-bcbc-8b60eed1e099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:39.685480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089671-ba99-489a-81c9-78681ea3e604 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:39.686328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089671-ba99-489a-81c9-78681ea3e604 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:39.687204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089671-ba99-489a-81c9-78681ea3e604 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:39.687204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a089671-ba99-489a-81c9-78681ea3e604 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services/5d7fd7dd94da4753a4f0c35c3d690666` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:39.687752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a089671-ba99-489a-81c9-78681ea3e604 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5d7fd7dd94da4753a4f0c35c3d690666)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:39.688996 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-9a089671-ba99-489a-81c9-78681ea3e604 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:39.688996 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:39.688996 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:39.690156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a089671-ba99-489a-81c9-78681ea3e604 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:39.720368 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2769/5567] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:39 2022] DELETE /identity/v3/services/5d7fd7dd94da4753a4f0c35c3d690666 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:39.721458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089671-ba99-489a-81c9-78681ea3e604 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:39.726505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9a089671-ba99-489a-81c9-78681ea3e604 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:39.788338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:39.806928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40750fc6-6ab3-46a5-b752-21db981ce47b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:39.807349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750fc6-6ab3-46a5-b752-21db981ce47b service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:39.807803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750fc6-6ab3-46a5-b752-21db981ce47b service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:39.808066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40750fc6-6ab3-46a5-b752-21db981ce47b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:39.810101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-40750fc6-6ab3-46a5-b752-21db981ce47b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:39.864978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a089671-ba99-489a-81c9-78681ea3e604 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:39.877296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:39.878190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:39.878577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:39.879016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/30b364699a1b4b788892c27644d60185` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:39.900564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40750fc6-6ab3-46a5-b752-21db981ce47b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:39.902454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40750fc6-6ab3-46a5-b752-21db981ce47b service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:39.907886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=30b364699a1b4b788892c27644d60185)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:39.910028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:39.953145 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2799/5568] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:39.959140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40750fc6-6ab3-46a5-b752-21db981ce47b service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:39.983131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '30b364699a1b4b788892c27644d60185'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:39.988578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '30b364699a1b4b788892c27644d60185'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:40.070899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40750fc6-6ab3-46a5-b752-21db981ce47b service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:40.092937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b364699a1b4b788892c27644d60185', 'request_id': 'req-da6bd4ff-a7fa-486e-8656-163f23be29f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:40.118398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b364699a1b4b788892c27644d60185', 'request_id': 'req-da6bd4ff-a7fa-486e-8656-163f23be29f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:40.135958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b364699a1b4b788892c27644d60185', 'request_id': 'req-da6bd4ff-a7fa-486e-8656-163f23be29f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:40.163442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project 30b364699a1b4b788892c27644d60185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:40.164140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:40.166386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:40.189510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '30b364699a1b4b788892c27644d60185', 'request_id': 'req-da6bd4ff-a7fa-486e-8656-163f23be29f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:40.190682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '30b364699a1b4b788892c27644d60185', 'request_id': 'req-da6bd4ff-a7fa-486e-8656-163f23be29f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:40.196142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '30b364699a1b4b788892c27644d60185', 'request_id': 'req-da6bd4ff-a7fa-486e-8656-163f23be29f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:40.213906 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2770/5569] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:39 2022] DELETE /identity/v3/projects/30b364699a1b4b788892c27644d60185 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:40.215174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:40.216666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:40.237442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86802-49b4-41a0-b150-4b72aa269bce tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:40.238145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86802-49b4-41a0-b150-4b72aa269bce tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:40.238547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86802-49b4-41a0-b150-4b72aa269bce tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:40.240006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86802-49b4-41a0-b150-4b72aa269bce tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:40.240716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86802-49b4-41a0-b150-4b72aa269bce tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:40.244260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86802-49b4-41a0-b150-4b72aa269bce tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:40.288619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2800/5570] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:39 2022] POST /identity/v3/services => generated 288 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:40.289704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86802-49b4-41a0-b150-4b72aa269bce tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:40.291748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-29b86802-49b4-41a0-b150-4b72aa269bce tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:40.320377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86802-49b4-41a0-b150-4b72aa269bce tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:40.343306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52b4dd-24b5-45b5-8949-e73e1c56c3db tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:40.343306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52b4dd-24b5-45b5-8949-e73e1c56c3db tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:40.343306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52b4dd-24b5-45b5-8949-e73e1c56c3db tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:40.344565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52b4dd-24b5-45b5-8949-e73e1c56c3db tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services/8cac4c14e62d48b5bddc803c63a5b141` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:40.345388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52b4dd-24b5-45b5-8949-e73e1c56c3db tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:update_service(service_id=8cac4c14e62d48b5bddc803c63a5b141)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:40.346827 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-8c52b4dd-24b5-45b5-8949-e73e1c56c3db tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:40.346827 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:40.346827 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:40.349567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52b4dd-24b5-45b5-8949-e73e1c56c3db tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:40.405178 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2801/5571] 10.222.0.43 () {60 vars in 1252 bytes} [Tue Aug 30 04:43:40 2022] PATCH /identity/v3/services/8cac4c14e62d48b5bddc803c63a5b141 => generated 283 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:40.412177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52b4dd-24b5-45b5-8949-e73e1c56c3db tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:40.429158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:40.445331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bd4ff-a7fa-486e-8656-163f23be29f6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:40.457656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52b4dd-24b5-45b5-8949-e73e1c56c3db tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:40.462865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d005db2-33af-4f9f-be45-b87d0274f1fc tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:40.463523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d005db2-33af-4f9f-be45-b87d0274f1fc tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:40.463842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d005db2-33af-4f9f-be45-b87d0274f1fc tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:40.464114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d005db2-33af-4f9f-be45-b87d0274f1fc tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services/8cac4c14e62d48b5bddc803c63a5b141` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:40.464788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d005db2-33af-4f9f-be45-b87d0274f1fc tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:get_service(service_id=8cac4c14e62d48b5bddc803c63a5b141)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:40.466576 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-0d005db2-33af-4f9f-be45-b87d0274f1fc tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:40.466576 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:40.466576 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:40.467474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d005db2-33af-4f9f-be45-b87d0274f1fc tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:40.473790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:40.492581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddeade-d19e-4f51-8a7d-40a78544a121 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:40.493219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddeade-d19e-4f51-8a7d-40a78544a121 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:40.493683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddeade-d19e-4f51-8a7d-40a78544a121 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:40.494188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddeade-d19e-4f51-8a7d-40a78544a121 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:40.497166 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2802/5572] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:40 2022] GET /identity/v3/services/8cac4c14e62d48b5bddc803c63a5b141 => generated 283 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:40.500916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddeade-d19e-4f51-8a7d-40a78544a121 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:40.502654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d005db2-33af-4f9f-be45-b87d0274f1fc tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:40.503049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddeade-d19e-4f51-8a7d-40a78544a121 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:40.528591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d005db2-33af-4f9f-be45-b87d0274f1fc tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:40.551415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cd525-638f-4e2f-b562-d4b0051482d3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:40.552718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cd525-638f-4e2f-b562-d4b0051482d3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:40.553072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cd525-638f-4e2f-b562-d4b0051482d3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:40.553263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cd525-638f-4e2f-b562-d4b0051482d3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services/8cac4c14e62d48b5bddc803c63a5b141` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:40.555423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cd525-638f-4e2f-b562-d4b0051482d3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:delete_service(service_id=8cac4c14e62d48b5bddc803c63a5b141)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:40.558833 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-518cd525-638f-4e2f-b562-d4b0051482d3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:40.558833 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:40.558833 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:40.560151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cd525-638f-4e2f-b562-d4b0051482d3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:40.585639 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2771/5573] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:40 2022] POST /identity/v3/projects => generated 359 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:40.586871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddeade-d19e-4f51-8a7d-40a78544a121 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:40.632606 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2803/5574] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:40 2022] DELETE /identity/v3/services/8cac4c14e62d48b5bddc803c63a5b141 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:40.641347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cd525-638f-4e2f-b562-d4b0051482d3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:40.696524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cd525-638f-4e2f-b562-d4b0051482d3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:40.782805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddeade-d19e-4f51-8a7d-40a78544a121 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:40.841079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dc387-1375-44e1-bac6-daa904303dd8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:40.841733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dc387-1375-44e1-bac6-daa904303dd8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:40.841994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dc387-1375-44e1-bac6-daa904303dd8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:40.842270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dc387-1375-44e1-bac6-daa904303dd8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/906009411e5146ad9b55d2f7929d1892` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:40.850347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dc387-1375-44e1-bac6-daa904303dd8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:get_project(project_id=906009411e5146ad9b55d2f7929d1892)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:40.852807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dc387-1375-44e1-bac6-daa904303dd8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:40.854606 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2772/5575] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:40 2022] GET /identity/v3/projects/906009411e5146ad9b55d2f7929d1892 => generated 359 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:40.861859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dc387-1375-44e1-bac6-daa904303dd8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:40.903171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c06c5-ea20-43b2-a5a4-e40ff3243a3c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:40.905755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c06c5-ea20-43b2-a5a4-e40ff3243a3c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:40.906102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c06c5-ea20-43b2-a5a4-e40ff3243a3c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:40.906403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c06c5-ea20-43b2-a5a4-e40ff3243a3c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services/8cac4c14e62d48b5bddc803c63a5b141` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:40.911102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c06c5-ea20-43b2-a5a4-e40ff3243a3c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:get_service(service_id=8cac4c14e62d48b5bddc803c63a5b141)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:40.913979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c06c5-ea20-43b2-a5a4-e40ff3243a3c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:40.914132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dc387-1375-44e1-bac6-daa904303dd8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:40.927830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:40.929161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:40.929318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:40.929759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/906009411e5146ad9b55d2f7929d1892` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:40.939283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=906009411e5146ad9b55d2f7929d1892)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:40.942593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-e91c06c5-ea20-43b2-a5a4-e40ff3243a3c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Could not find service: 8cac4c14e62d48b5bddc803c63a5b141.: keystone.exception.ServiceNotFound: Could not find service: 8cac4c14e62d48b5bddc803c63a5b141. Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 8cac4c14e62d48b5bddc803c63a5b141. Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:43:40.943101 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:43:40.944675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 8cac4c14e62d48b5bddc803c63a5b141. Aug 30 04:43:40.947980 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:43:40.956121 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2804/5576] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:40 2022] GET /identity/v3/services/8cac4c14e62d48b5bddc803c63a5b141 => generated 113 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:43:40.958253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c06c5-ea20-43b2-a5a4-e40ff3243a3c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:40.964082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e91c06c5-ea20-43b2-a5a4-e40ff3243a3c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:41.144116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906009411e5146ad9b55d2f7929d1892', 'request_id': 'req-9386a70b-b3bb-4c8e-a6e5-23265db352cb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:41.173683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906009411e5146ad9b55d2f7929d1892', 'request_id': 'req-9386a70b-b3bb-4c8e-a6e5-23265db352cb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:41.198890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906009411e5146ad9b55d2f7929d1892', 'request_id': 'req-9386a70b-b3bb-4c8e-a6e5-23265db352cb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:41.238894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project 906009411e5146ad9b55d2f7929d1892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:41.239613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:41.242369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:41.248262 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2773/5577] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:40 2022] DELETE /identity/v3/projects/906009411e5146ad9b55d2f7929d1892 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:41.249927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:41.256215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:41.298267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c06c5-ea20-43b2-a5a4-e40ff3243a3c tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:41.341566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:41.351605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386a70b-b3bb-4c8e-a6e5-23265db352cb tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:41.384725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93c85f-456c-47d2-92a3-53392d200460 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:41.386637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93c85f-456c-47d2-92a3-53392d200460 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:41.387743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93c85f-456c-47d2-92a3-53392d200460 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:41.388278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93c85f-456c-47d2-92a3-53392d200460 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:41.389277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93c85f-456c-47d2-92a3-53392d200460 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:41.391028 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-7a93c85f-456c-47d2-92a3-53392d200460 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:41.391028 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:41.391028 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:41.402333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93c85f-456c-47d2-92a3-53392d200460 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:41.455266 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2774/5578] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:41 2022] POST /identity/v3/services => generated 274 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:41.457954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93c85f-456c-47d2-92a3-53392d200460 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:41.462956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7a93c85f-456c-47d2-92a3-53392d200460 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:41.474166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:41.536347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:41.536904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:41.537176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:41.540148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] PATH_INFO: `/v3/users/c80f10e567ee49ad8ade13d3c95b431d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:41.542652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80f10e567ee49ad8ade13d3c95b431d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:41.551153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:41.718195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93c85f-456c-47d2-92a3-53392d200460 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:41.735254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ebe6-3886-4b4a-b890-c7db461fee51 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:41.736249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ebe6-3886-4b4a-b890-c7db461fee51 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:41.736642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ebe6-3886-4b4a-b890-c7db461fee51 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:41.737066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7ebe6-3886-4b4a-b890-c7db461fee51 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:41.737861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ebe6-3886-4b4a-b890-c7db461fee51 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:41.748444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7ebe6-3886-4b4a-b890-c7db461fee51 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:41.767222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80f10e567ee49ad8ade13d3c95b431d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:41.770137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80f10e567ee49ad8ade13d3c95b431d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:41.822816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80f10e567ee49ad8ade13d3c95b431d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:41.827477 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2775/5579] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:41 2022] POST /identity/v3/projects => generated 359 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:41.860963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ebe6-3886-4b4a-b890-c7db461fee51 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:41.863929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80f10e567ee49ad8ade13d3c95b431d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:41.897858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80f10e567ee49ad8ade13d3c95b431d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:41.917477 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2805/5580] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:40 2022] DELETE /identity/v3/users/c80f10e567ee49ad8ade13d3c95b431d => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:41.918699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:41.924862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:42.095662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7ebe6-3886-4b4a-b890-c7db461fee51 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:42.115635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7deb45-cb0c-4d78-a9c2-c1a0d63ccdd2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:42.127740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b163d9-19d0-47f4-adde-5af7347663ed tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:42.128775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b163d9-19d0-47f4-adde-5af7347663ed tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:42.130158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b163d9-19d0-47f4-adde-5af7347663ed tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:42.130829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b163d9-19d0-47f4-adde-5af7347663ed tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/dd36ac54d6814baa852cb325700f52c4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:42.135101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b163d9-19d0-47f4-adde-5af7347663ed tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:get_project(project_id=dd36ac54d6814baa852cb325700f52c4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:42.137947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b163d9-19d0-47f4-adde-5af7347663ed tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:42.139922 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2806/5581] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:41 2022] GET /identity/v3/projects/dd36ac54d6814baa852cb325700f52c4 => generated 359 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:42.146358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206e205-5415-4de1-9311-f69dc06e2e60 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:42.146673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206e205-5415-4de1-9311-f69dc06e2e60 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:42.146889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3206e205-5415-4de1-9311-f69dc06e2e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:42.212215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3206e205-5415-4de1-9311-f69dc06e2e60 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:42.213769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3206e205-5415-4de1-9311-f69dc06e2e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:42.250949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fd86c-e1f3-4b9a-bddf-699463c38562 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:42.251171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fd86c-e1f3-4b9a-bddf-699463c38562 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:42.251555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fd86c-e1f3-4b9a-bddf-699463c38562 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:42.251889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fd86c-e1f3-4b9a-bddf-699463c38562 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:42.252696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fd86c-e1f3-4b9a-bddf-699463c38562 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:42.260270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fd86c-e1f3-4b9a-bddf-699463c38562 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:42.285556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:42.298985 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2776/5582] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:41 2022] POST /identity/v3/services => generated 274 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:42.300225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fd86c-e1f3-4b9a-bddf-699463c38562 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:42.353772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fd86c-e1f3-4b9a-bddf-699463c38562 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:42.364304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:42.368566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:42.373044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:42.374099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:42.374622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/dd36ac54d6814baa852cb325700f52c4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:42.376578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd36ac54d6814baa852cb325700f52c4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:42.380549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:42.415220 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2807/5583] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:42 2022] POST /identity/v3/auth/tokens => generated 3573 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:42.416637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206e205-5415-4de1-9311-f69dc06e2e60 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:42.419089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3206e205-5415-4de1-9311-f69dc06e2e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:42.482358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3206e205-5415-4de1-9311-f69dc06e2e60 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:42.503092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd36ac54d6814baa852cb325700f52c4', 'request_id': 'req-c4576f87-8393-43f0-b82d-84cc686932b6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:42.517245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd36ac54d6814baa852cb325700f52c4', 'request_id': 'req-c4576f87-8393-43f0-b82d-84cc686932b6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:42.527070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd36ac54d6814baa852cb325700f52c4', 'request_id': 'req-c4576f87-8393-43f0-b82d-84cc686932b6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:42.543593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project dd36ac54d6814baa852cb325700f52c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:42.544382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:42.545457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:42.553044 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2777/5584] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:42 2022] DELETE /identity/v3/projects/dd36ac54d6814baa852cb325700f52c4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:42.554747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:42.557566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:42.623446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c091b-1895-4587-9965-61006fbad53a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:42.624094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c091b-1895-4587-9965-61006fbad53a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:42.624794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c091b-1895-4587-9965-61006fbad53a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:42.625071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c091b-1895-4587-9965-61006fbad53a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:42.626015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c091b-1895-4587-9965-61006fbad53a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:42.627855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c091b-1895-4587-9965-61006fbad53a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:42.661729 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2808/5585] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:42 2022] POST /identity/v3/services => generated 274 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:42.666442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c091b-1895-4587-9965-61006fbad53a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:42.675672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-770c091b-1895-4587-9965-61006fbad53a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:42.716986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4576f87-8393-43f0-b82d-84cc686932b6 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:42.738823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc9c2f-fedc-4fa5-823d-5d26a9b0ff6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:42.739552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc9c2f-fedc-4fa5-823d-5d26a9b0ff6f service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:42.739835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc9c2f-fedc-4fa5-823d-5d26a9b0ff6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:42.740105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc9c2f-fedc-4fa5-823d-5d26a9b0ff6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:42.742678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aecc9c2f-fedc-4fa5-823d-5d26a9b0ff6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:42.853317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc9c2f-fedc-4fa5-823d-5d26a9b0ff6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:42.859550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc9c2f-fedc-4fa5-823d-5d26a9b0ff6f service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:42.875302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c091b-1895-4587-9965-61006fbad53a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:42.888426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:42.889918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a8ea5-9447-48f2-86ba-6adbf131f698 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:42.890713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a8ea5-9447-48f2-86ba-6adbf131f698 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:42.891087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a8ea5-9447-48f2-86ba-6adbf131f698 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:42.891452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a8ea5-9447-48f2-86ba-6adbf131f698 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:42.892190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a8ea5-9447-48f2-86ba-6adbf131f698 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:42.894390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a8ea5-9447-48f2-86ba-6adbf131f698 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:42.907006 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2778/5586] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:42 2022] GET /identity/v3/auth/tokens => generated 3740 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:42.907936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc9c2f-fedc-4fa5-823d-5d26a9b0ff6f service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:42.910790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aecc9c2f-fedc-4fa5-823d-5d26a9b0ff6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:42.973401 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2809/5587] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:43:42 2022] POST /identity/v3/projects => generated 347 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:42.975963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc9c2f-fedc-4fa5-823d-5d26a9b0ff6f service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:42.976460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a8ea5-9447-48f2-86ba-6adbf131f698 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:43.135848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:43.142958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eafa9a-50cf-4da5-87ad-a3b174e042bf tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:43.143962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eafa9a-50cf-4da5-87ad-a3b174e042bf tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:43.145973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eafa9a-50cf-4da5-87ad-a3b174e042bf tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:43.146382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eafa9a-50cf-4da5-87ad-a3b174e042bf tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:43.148376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eafa9a-50cf-4da5-87ad-a3b174e042bf tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:43.149823 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-d2eafa9a-50cf-4da5-87ad-a3b174e042bf tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:43.149823 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:43:43.149823 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:43:43.152799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a8ea5-9447-48f2-86ba-6adbf131f698 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:43.155221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eafa9a-50cf-4da5-87ad-a3b174e042bf tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:43.161716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117432c-8fdb-4f01-b4da-c92f7aa7a682 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:43.162537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117432c-8fdb-4f01-b4da-c92f7aa7a682 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:43.162916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117432c-8fdb-4f01-b4da-c92f7aa7a682 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:43.164403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117432c-8fdb-4f01-b4da-c92f7aa7a682 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/6d4fc4a486024e62a9a1fb069cd9393f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:43.168190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117432c-8fdb-4f01-b4da-c92f7aa7a682 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d4fc4a486024e62a9a1fb069cd9393f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:43.171651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117432c-8fdb-4f01-b4da-c92f7aa7a682 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:43.174550 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2810/5588] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:42 2022] GET /identity/v3/projects/6d4fc4a486024e62a9a1fb069cd9393f => generated 347 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:43.178465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117432c-8fdb-4f01-b4da-c92f7aa7a682 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:43.186159 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2779/5589] 10.222.0.43 () {58 vars in 1131 bytes} [Tue Aug 30 04:43:42 2022] GET /identity/v3/services => generated 2977 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:43.190816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eafa9a-50cf-4da5-87ad-a3b174e042bf tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:43.193861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117432c-8fdb-4f01-b4da-c92f7aa7a682 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:43.200582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:43.203697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:43.203978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:43.204259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/6d4fc4a486024e62a9a1fb069cd9393f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:43.205974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d4fc4a486024e62a9a1fb069cd9393f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:43.214910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:43.217783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eafa9a-50cf-4da5-87ad-a3b174e042bf tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:43.235467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b42cc9-2aa9-45bf-bc23-edc429c17175 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:43.236479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42cc9-2aa9-45bf-bc23-edc429c17175 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:43.236973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42cc9-2aa9-45bf-bc23-edc429c17175 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:43.237468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b42cc9-2aa9-45bf-bc23-edc429c17175 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:43.239460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b42cc9-2aa9-45bf-bc23-edc429c17175 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1918314036) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:43.242060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b42cc9-2aa9-45bf-bc23-edc429c17175 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:43.244372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b42cc9-2aa9-45bf-bc23-edc429c17175 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:43.262671 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2780/5590] 10.222.0.43 () {58 vars in 1222 bytes} [Tue Aug 30 04:43:43 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1918314036 => generated 417 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:43.266772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b42cc9-2aa9-45bf-bc23-edc429c17175 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:43.295351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b42cc9-2aa9-45bf-bc23-edc429c17175 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:43.313713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b9950-3248-4912-bf85-754fc8470526 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:43.315611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b9950-3248-4912-bf85-754fc8470526 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:43.316642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b9950-3248-4912-bf85-754fc8470526 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:43.317504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b9950-3248-4912-bf85-754fc8470526 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:43.321718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b9950-3248-4912-bf85-754fc8470526 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-113355812) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:43.324729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b9950-3248-4912-bf85-754fc8470526 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:43.326903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b9950-3248-4912-bf85-754fc8470526 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:43.352492 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2781/5591] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Aug 30 04:43:43 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-113355812 => generated 416 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:43.356158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b9950-3248-4912-bf85-754fc8470526 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:43.386633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4fc4a486024e62a9a1fb069cd9393f', 'request_id': 'req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:43.389770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b9950-3248-4912-bf85-754fc8470526 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:43.422868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4fc4a486024e62a9a1fb069cd9393f', 'request_id': 'req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:43.446135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4fc4a486024e62a9a1fb069cd9393f', 'request_id': 'req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:43.468438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project 6d4fc4a486024e62a9a1fb069cd9393f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:43.469310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:43.473652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:43.480826 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2811/5592] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:43 2022] DELETE /identity/v3/projects/6d4fc4a486024e62a9a1fb069cd9393f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:43.486132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:43.489323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:43.561180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c33c8-9d0d-48c3-adc0-f9e4566382f3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:43.563886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c33c8-9d0d-48c3-adc0-f9e4566382f3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:43.565147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c33c8-9d0d-48c3-adc0-f9e4566382f3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:43.565628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c33c8-9d0d-48c3-adc0-f9e4566382f3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:43.566567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c33c8-9d0d-48c3-adc0-f9e4566382f3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1444288910) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:43.569674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c33c8-9d0d-48c3-adc0-f9e4566382f3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:43.574015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c33c8-9d0d-48c3-adc0-f9e4566382f3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:43.588530 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2782/5593] 10.222.0.43 () {58 vars in 1222 bytes} [Tue Aug 30 04:43:43 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1444288910 => generated 417 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:43.590633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c33c8-9d0d-48c3-adc0-f9e4566382f3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:43.598308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0d1c33c8-9d0d-48c3-adc0-f9e4566382f3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:43.632789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c33c8-9d0d-48c3-adc0-f9e4566382f3 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:43.655878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd701b1b-b52b-49a3-9e07-c24352e14257 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:43.656542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701b1b-b52b-49a3-9e07-c24352e14257 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:43.656823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701b1b-b52b-49a3-9e07-c24352e14257 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:43.657094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701b1b-b52b-49a3-9e07-c24352e14257 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services/5c83499577634073ba7b5d23c6634537` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:43.657698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd701b1b-b52b-49a3-9e07-c24352e14257 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5c83499577634073ba7b5d23c6634537)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:43.665210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd701b1b-b52b-49a3-9e07-c24352e14257 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:43.693196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bc40e-aa20-4a5e-ac45-65c82fa92dc5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:43.706539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94f86-713c-4fda-9dc2-67cb0af96048 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:43.707355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94f86-713c-4fda-9dc2-67cb0af96048 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:43.707730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94f86-713c-4fda-9dc2-67cb0af96048 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:43.708104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94f86-713c-4fda-9dc2-67cb0af96048 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:43.709024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d94f86-713c-4fda-9dc2-67cb0af96048 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:43.710958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d94f86-713c-4fda-9dc2-67cb0af96048 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:43.720727 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2783/5594] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:43 2022] DELETE /identity/v3/services/5c83499577634073ba7b5d23c6634537 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:43:43.725162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd701b1b-b52b-49a3-9e07-c24352e14257 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:43.763958 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2812/5595] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:43:43 2022] POST /identity/v3/domains => generated 275 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:43.768179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94f86-713c-4fda-9dc2-67cb0af96048 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:43.803179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd701b1b-b52b-49a3-9e07-c24352e14257 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:43.925792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:43.930189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94f86-713c-4fda-9dc2-67cb0af96048 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:43.969784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c150f2-2a8a-4894-b194-a7ed382bfe4c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:43.970478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c150f2-2a8a-4894-b194-a7ed382bfe4c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:43.970760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c150f2-2a8a-4894-b194-a7ed382bfe4c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:43.971032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c150f2-2a8a-4894-b194-a7ed382bfe4c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:43.971686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c150f2-2a8a-4894-b194-a7ed382bfe4c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:43.980182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c150f2-2a8a-4894-b194-a7ed382bfe4c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:44.018215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:44.044134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23021cc-1c4e-42bd-b2f9-d8140873f96a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:44.045378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23021cc-1c4e-42bd-b2f9-d8140873f96a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:44.045378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23021cc-1c4e-42bd-b2f9-d8140873f96a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:44.045639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23021cc-1c4e-42bd-b2f9-d8140873f96a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services/0ccea5dc488f4831a14d1e7431996402` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:44.048039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23021cc-1c4e-42bd-b2f9-d8140873f96a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0ccea5dc488f4831a14d1e7431996402)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:44.049732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23021cc-1c4e-42bd-b2f9-d8140873f96a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:44.081078 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2813/5596] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:43 2022] POST /identity/v3/projects => generated 404 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:43:44.082660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428940b-e489-401d-89a8-3a584cbc4689 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:44.082943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428940b-e489-401d-89a8-3a584cbc4689 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:44.083216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428940b-e489-401d-89a8-3a584cbc4689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:44.159148 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2784/5597] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:43 2022] DELETE /identity/v3/services/0ccea5dc488f4831a14d1e7431996402 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:44.162111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23021cc-1c4e-42bd-b2f9-d8140873f96a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:44.190194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5428940b-e489-401d-89a8-3a584cbc4689 None None] MFA Rules not processed for user `e3227d0b90434ddeaa606647e92eb2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:44.193683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5428940b-e489-401d-89a8-3a584cbc4689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:44.258669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23021cc-1c4e-42bd-b2f9-d8140873f96a tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:44.431536 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2814/5598] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:44 2022] POST /identity/v3/auth/tokens => generated 3423 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:44.432557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428940b-e489-401d-89a8-3a584cbc4689 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:44.482224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518807-d076-4bcb-9972-f28e54be7635 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:44.483178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518807-d076-4bcb-9972-f28e54be7635 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:44.483464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518807-d076-4bcb-9972-f28e54be7635 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:44.483809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518807-d076-4bcb-9972-f28e54be7635 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/4c4f297e4dc34c8b87a975b35c4aa7c5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:44.487898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518807-d076-4bcb-9972-f28e54be7635 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:get_project(project_id=4c4f297e4dc34c8b87a975b35c4aa7c5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:44.495004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518807-d076-4bcb-9972-f28e54be7635 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:44.497453 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2785/5599] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:44 2022] GET /identity/v3/projects/4c4f297e4dc34c8b87a975b35c4aa7c5 => generated 404 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:44.501187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518807-d076-4bcb-9972-f28e54be7635 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:44.535245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518807-d076-4bcb-9972-f28e54be7635 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:44.561302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:44.565018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:44.565539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:44.566043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/4c4f297e4dc34c8b87a975b35c4aa7c5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:44.570916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4c4f297e4dc34c8b87a975b35c4aa7c5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:44.576218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:44.708550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4f297e4dc34c8b87a975b35c4aa7c5', 'request_id': 'req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:44.726293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4f297e4dc34c8b87a975b35c4aa7c5', 'request_id': 'req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:44.741259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4f297e4dc34c8b87a975b35c4aa7c5', 'request_id': 'req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:44.767677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project 4c4f297e4dc34c8b87a975b35c4aa7c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:44.767677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:44.768262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:44.770938 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2786/5600] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:44 2022] DELETE /identity/v3/projects/4c4f297e4dc34c8b87a975b35c4aa7c5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:44.771806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:44.777621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:44.793673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428940b-e489-401d-89a8-3a584cbc4689 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:44.873334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:44.964543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79489e-5512-434d-b97b-e4155520a050 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13312950f7e04e7980aa96d86a61a88b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1eed29cdb37b44daab6a76d85dcbc234', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:44.965206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79489e-5512-434d-b97b-e4155520a050 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:44.965690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79489e-5512-434d-b97b-e4155520a050 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:44.966166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79489e-5512-434d-b97b-e4155520a050 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] PATH_INFO: `/v3/services/d010aab9a4fd49088e84fb93d71f7513` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:44.966924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79489e-5512-434d-b97b-e4155520a050 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d010aab9a4fd49088e84fb93d71f7513)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:44.968763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca79489e-5512-434d-b97b-e4155520a050 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:44.993543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:45.002626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae2fff-60ff-42f7-af0a-4d34598f59f9 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:45.014422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2815/5601] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:44 2022] DELETE /identity/v3/services/d010aab9a4fd49088e84fb93d71f7513 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:45.019819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79489e-5512-434d-b97b-e4155520a050 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:45.024288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ca79489e-5512-434d-b97b-e4155520a050 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:45.056241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbb43e-bca0-4f13-87c8-e5376fbf2a52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:45.060410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbb43e-bca0-4f13-87c8-e5376fbf2a52 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:45.060944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbb43e-bca0-4f13-87c8-e5376fbf2a52 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:45.061322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbb43e-bca0-4f13-87c8-e5376fbf2a52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:45.068444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-56cbb43e-bca0-4f13-87c8-e5376fbf2a52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:45.217941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79489e-5512-434d-b97b-e4155520a050 tempest-ServicesTestJSON-1550069718 tempest-ServicesTestJSON-1550069718-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:45.248827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:45.252727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:45.254454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:45.254921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] PATH_INFO: `/v3/users/602cfdfb91ae49769ce96169cdc72bbc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:45.258524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbb43e-bca0-4f13-87c8-e5376fbf2a52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:45.260576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbb43e-bca0-4f13-87c8-e5376fbf2a52 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:45.262376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=602cfdfb91ae49769ce96169cdc72bbc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:45.267062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:45.310903 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2787/5602] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:45.312990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbb43e-bca0-4f13-87c8-e5376fbf2a52 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:45.317979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-56cbb43e-bca0-4f13-87c8-e5376fbf2a52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:45.363275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbb43e-bca0-4f13-87c8-e5376fbf2a52 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:45.378211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:45.379864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:45.383399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:45.384653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] PATH_INFO: `/v3/projects/03ef999771a4498cac3194e761b4391f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:45.388165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ef999771a4498cac3194e761b4391f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:45.391593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:45.400484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602cfdfb91ae49769ce96169cdc72bbc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.402560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602cfdfb91ae49769ce96169cdc72bbc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.419886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602cfdfb91ae49769ce96169cdc72bbc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.430528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602cfdfb91ae49769ce96169cdc72bbc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.463177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602cfdfb91ae49769ce96169cdc72bbc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.470813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ef999771a4498cac3194e761b4391f', 'request_id': 'req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.481957 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2816/5603] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:45 2022] DELETE /identity/v3/users/602cfdfb91ae49769ce96169cdc72bbc => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:45.482237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ef999771a4498cac3194e761b4391f', 'request_id': 'req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.482369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:45.485056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:45.502015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ef999771a4498cac3194e761b4391f', 'request_id': 'req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.526758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] The token cache is being invalidate because project 03ef999771a4498cac3194e761b4391f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:45.529457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.537052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.538954 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2788/5604] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:45 2022] DELETE /identity/v3/projects/03ef999771a4498cac3194e761b4391f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:45.540016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:45.548265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:45.630130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:45.694845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1307aa-a338-4cb6-83b5-733fc2c6c7e2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:45.749620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:45.767737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9855c-c1f0-4a2b-ae2d-aefe18c3c25a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:45.782555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7e542-7593-4396-be4c-808d497213c1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:45.783232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e542-7593-4396-be4c-808d497213c1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:45.783508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e542-7593-4396-be4c-808d497213c1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:45.783787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e542-7593-4396-be4c-808d497213c1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/domains/8555bd94e504459dbea7bd192e6a3529` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:45.788348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7e542-7593-4396-be4c-808d497213c1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8555bd94e504459dbea7bd192e6a3529)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:45.793071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7e542-7593-4396-be4c-808d497213c1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:45.875699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-caf7e542-7593-4396-be4c-808d497213c1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8555bd94e504459dbea7bd192e6a3529'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.878297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-caf7e542-7593-4396-be4c-808d497213c1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8555bd94e504459dbea7bd192e6a3529'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.899226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561e884-6af8-4285-adba-709612276044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:45.901135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561e884-6af8-4285-adba-709612276044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:45.901670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561e884-6af8-4285-adba-709612276044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:45.902200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561e884-6af8-4285-adba-709612276044 admin admin] PATH_INFO: `/v3/users/0b3baad46d2d43ab85affd37c75154be` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:45.903747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561e884-6af8-4285-adba-709612276044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3baad46d2d43ab85affd37c75154be)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:45.906078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561e884-6af8-4285-adba-709612276044 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:45.951944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-caf7e542-7593-4396-be4c-808d497213c1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8555bd94e504459dbea7bd192e6a3529'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.953978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-caf7e542-7593-4396-be4c-808d497213c1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8555bd94e504459dbea7bd192e6a3529'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.959477 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2817/5605] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:43:45 2022] PATCH /identity/v3/domains/8555bd94e504459dbea7bd192e6a3529 => generated 276 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:45.961186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9ce9-39aa-420c-8c81-5f1d731eb9d2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:45.961663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9ce9-39aa-420c-8c81-5f1d731eb9d2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:45.962141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9ce9-39aa-420c-8c81-5f1d731eb9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:45.992094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f561e884-6af8-4285-adba-709612276044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3baad46d2d43ab85affd37c75154be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:45.995170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e19f9ce9-39aa-420c-8c81-5f1d731eb9d2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:45.996419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e19f9ce9-39aa-420c-8c81-5f1d731eb9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:46.009391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f561e884-6af8-4285-adba-709612276044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3baad46d2d43ab85affd37c75154be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.051508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f561e884-6af8-4285-adba-709612276044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3baad46d2d43ab85affd37c75154be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.068763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f561e884-6af8-4285-adba-709612276044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3baad46d2d43ab85affd37c75154be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.069508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f561e884-6af8-4285-adba-709612276044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3baad46d2d43ab85affd37c75154be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.081950 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2789/5606] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:45 2022] DELETE /identity/v3/users/0b3baad46d2d43ab85affd37c75154be => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:46.082936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561e884-6af8-4285-adba-709612276044 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:46.084724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f561e884-6af8-4285-adba-709612276044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:46.191921 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2818/5607] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:46.192965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f9ce9-39aa-420c-8c81-5f1d731eb9d2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:46.196296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e19f9ce9-39aa-420c-8c81-5f1d731eb9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:46.253999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:46.267688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561e884-6af8-4285-adba-709612276044 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:46.285712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:46.286317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:46.286631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:46.286900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] PATH_INFO: `/v3/users/70a8dd51989a47bdb4daba6a26f8f7b2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:46.289734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a8dd51989a47bdb4daba6a26f8f7b2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:46.291847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:46.321266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f9ce9-39aa-420c-8c81-5f1d731eb9d2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:46.408983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a8dd51989a47bdb4daba6a26f8f7b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.432851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a8dd51989a47bdb4daba6a26f8f7b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.460409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:46.461248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:46.461633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:46.462087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/domains/8555bd94e504459dbea7bd192e6a3529` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:46.483648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8555bd94e504459dbea7bd192e6a3529)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:46.485460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:46.487587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:46.493510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a8dd51989a47bdb4daba6a26f8f7b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.525001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a8dd51989a47bdb4daba6a26f8f7b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.526161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14dbc3fa-1619-4356-a893-fcd795d43f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a8dd51989a47bdb4daba6a26f8f7b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.539694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8555bd94e504459dbea7bd192e6a3529'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.540222 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2790/5608] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:46 2022] DELETE /identity/v3/users/70a8dd51989a47bdb4daba6a26f8f7b2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:46.542319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba5edf-c3c3-4fbb-bd29-9274f977bd85 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:46.542794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba5edf-c3c3-4fbb-bd29-9274f977bd85 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:46.543228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba5edf-c3c3-4fbb-bd29-9274f977bd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:46.550825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8555bd94e504459dbea7bd192e6a3529'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.594976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5bba5edf-c3c3-4fbb-bd29-9274f977bd85 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:46.598559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5bba5edf-c3c3-4fbb-bd29-9274f977bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:46.661117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8555bd94e504459dbea7bd192e6a3529', 'request_id': 'req-f3bccbf9-5abf-457f-92f6-7abb2caeb185'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.686775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8555bd94e504459dbea7bd192e6a3529', 'request_id': 'req-f3bccbf9-5abf-457f-92f6-7abb2caeb185'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.708666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8555bd94e504459dbea7bd192e6a3529', 'request_id': 'req-f3bccbf9-5abf-457f-92f6-7abb2caeb185'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.782342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project 8555bd94e504459dbea7bd192e6a3529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:46.782638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.783514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.808594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8555bd94e504459dbea7bd192e6a3529', 'request_id': 'req-f3bccbf9-5abf-457f-92f6-7abb2caeb185'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.809685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8555bd94e504459dbea7bd192e6a3529', 'request_id': 'req-f3bccbf9-5abf-457f-92f6-7abb2caeb185'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.811412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8555bd94e504459dbea7bd192e6a3529', 'request_id': 'req-f3bccbf9-5abf-457f-92f6-7abb2caeb185'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:46.813275 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2791/5609] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:46.816827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba5edf-c3c3-4fbb-bd29-9274f977bd85 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:46.821311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5bba5edf-c3c3-4fbb-bd29-9274f977bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:46.825980 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2819/5610] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:46 2022] DELETE /identity/v3/domains/8555bd94e504459dbea7bd192e6a3529 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:46.831398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:46.835016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:47.037198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bccbf9-5abf-457f-92f6-7abb2caeb185 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:47.049722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943836d3-1cbd-41e4-b3bd-f06463c5df8e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:47.051754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943836d3-1cbd-41e4-b3bd-f06463c5df8e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:47.052304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943836d3-1cbd-41e4-b3bd-f06463c5df8e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:47.053024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943836d3-1cbd-41e4-b3bd-f06463c5df8e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:47.054171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943836d3-1cbd-41e4-b3bd-f06463c5df8e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:47.056143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943836d3-1cbd-41e4-b3bd-f06463c5df8e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:47.056528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba5edf-c3c3-4fbb-bd29-9274f977bd85 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:47.069645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff0e1c-3928-421a-8636-69ac0b4628f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:47.072723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff0e1c-3928-421a-8636-69ac0b4628f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:47.073983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff0e1c-3928-421a-8636-69ac0b4628f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:47.074609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff0e1c-3928-421a-8636-69ac0b4628f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:47.082859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-53ff0e1c-3928-421a-8636-69ac0b4628f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:47.091494 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2820/5611] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:43:46 2022] POST /identity/v3/domains => generated 275 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:43:47.093612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943836d3-1cbd-41e4-b3bd-f06463c5df8e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:47.099173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-943836d3-1cbd-41e4-b3bd-f06463c5df8e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:47.123117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff0e1c-3928-421a-8636-69ac0b4628f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:47.130018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff0e1c-3928-421a-8636-69ac0b4628f3 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:47.173696 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2792/5612] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:47.177673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff0e1c-3928-421a-8636-69ac0b4628f3 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:47.210740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff0e1c-3928-421a-8636-69ac0b4628f3 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:47.227235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:47.262052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:47.319789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943836d3-1cbd-41e4-b3bd-f06463c5df8e tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:47.335235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a2507-6706-4dea-a24b-a011962f5286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:47.335501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2507-6706-4dea-a24b-a011962f5286 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:47.335738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2507-6706-4dea-a24b-a011962f5286 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:47.335999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a2507-6706-4dea-a24b-a011962f5286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:47.337894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-971a2507-6706-4dea-a24b-a011962f5286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:47.411210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3c0d3-1762-4fc2-a177-5798b515ca0a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:47.414124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3c0d3-1762-4fc2-a177-5798b515ca0a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:47.414421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3c0d3-1762-4fc2-a177-5798b515ca0a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:47.417150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3c0d3-1762-4fc2-a177-5798b515ca0a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:47.417924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3c0d3-1762-4fc2-a177-5798b515ca0a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:47.420860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3c0d3-1762-4fc2-a177-5798b515ca0a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:47.476085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a2507-6706-4dea-a24b-a011962f5286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:47.478778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a2507-6706-4dea-a24b-a011962f5286 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:47.511584 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2821/5613] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:47.580761 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2793/5614] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:47 2022] POST /identity/v3/projects => generated 410 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:47.585011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a2507-6706-4dea-a24b-a011962f5286 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:47.607367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a2507-6706-4dea-a24b-a011962f5286 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:47.763281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303a8a-c0e3-448b-9ad9-2d982d66bb29 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:47.764297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303a8a-c0e3-448b-9ad9-2d982d66bb29 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:47.764757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303a8a-c0e3-448b-9ad9-2d982d66bb29 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:47.765195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82303a8a-c0e3-448b-9ad9-2d982d66bb29 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:47.766057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82303a8a-c0e3-448b-9ad9-2d982d66bb29 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:47.772193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82303a8a-c0e3-448b-9ad9-2d982d66bb29 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:47.845667 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2822/5615] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:47 2022] POST /identity/v3/projects => generated 404 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:47.850141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3c0d3-1762-4fc2-a177-5798b515ca0a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:47.870670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3c0d3-1762-4fc2-a177-5798b515ca0a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:48.040752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:48.041437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:48.041724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:48.042023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/544c24cf75d042068a662615912eb05f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:48.049994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=544c24cf75d042068a662615912eb05f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:48.051965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:48.205172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '544c24cf75d042068a662615912eb05f', 'request_id': 'req-318769e3-4c23-4874-b5fe-2291500b7a5f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:48.223367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '544c24cf75d042068a662615912eb05f', 'request_id': 'req-318769e3-4c23-4874-b5fe-2291500b7a5f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:48.233915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '544c24cf75d042068a662615912eb05f', 'request_id': 'req-318769e3-4c23-4874-b5fe-2291500b7a5f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:48.260317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project 544c24cf75d042068a662615912eb05f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:48.260771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:48.261677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:48.266893 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2794/5616] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:47 2022] DELETE /identity/v3/projects/544c24cf75d042068a662615912eb05f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:48.270897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303a8a-c0e3-448b-9ad9-2d982d66bb29 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:48.273423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-82303a8a-c0e3-448b-9ad9-2d982d66bb29 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:48.298911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82303a8a-c0e3-448b-9ad9-2d982d66bb29 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:48.446453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:48.447171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:48.447453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:48.447796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/9dc9c2097b694ed49416c29ac387f002` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:48.449276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9dc9c2097b694ed49416c29ac387f002)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:48.451312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:48.468848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:48.577523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc9c2097b694ed49416c29ac387f002', 'request_id': 'req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:48.623278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc9c2097b694ed49416c29ac387f002', 'request_id': 'req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:48.644312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc9c2097b694ed49416c29ac387f002', 'request_id': 'req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:48.666957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project 9dc9c2097b694ed49416c29ac387f002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:48.667259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:48.675639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:48.695925 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2823/5617] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:48 2022] DELETE /identity/v3/projects/9dc9c2097b694ed49416c29ac387f002 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:48.697572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:48.716289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318769e3-4c23-4874-b5fe-2291500b7a5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:48.783580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:48.976243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:48.976986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:48.977190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:48.977646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/domains/da1547491d364a63b3ab4b14fad288a7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:48.982264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=da1547491d364a63b3ab4b14fad288a7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:48.984725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:49.005903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:49.008101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:49.072753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.075226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.164471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.166244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.174144 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2795/5618] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:43:48 2022] PATCH /identity/v3/domains/da1547491d364a63b3ab4b14fad288a7 => generated 276 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:49.176421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:49.179246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:49.304548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb05bf5-72c3-4fc4-92d9-412c2b2eaa5f tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:49.401004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e994746-1386-4a49-8ca9-9749cd5afb70 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:49.420383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:49.424245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:49.424851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:49.425135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/domains/da1547491d364a63b3ab4b14fad288a7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:49.462547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=da1547491d364a63b3ab4b14fad288a7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:49.470351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:49.505123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:49.509277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:49.509694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:49.510171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] PATH_INFO: `/v3/projects/a5fc83ea4c7a4844b83a4c3e116724fb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:49.513123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5fc83ea4c7a4844b83a4c3e116724fb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:49.515428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:49.536295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.544360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.661457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:49.664796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5fc83ea4c7a4844b83a4c3e116724fb', 'request_id': 'req-f5cbcefb-1aaf-42e3-8751-932527209792'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.673792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7', 'request_id': 'req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.676162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:49.696012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5fc83ea4c7a4844b83a4c3e116724fb', 'request_id': 'req-f5cbcefb-1aaf-42e3-8751-932527209792'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.697251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7', 'request_id': 'req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.713856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5fc83ea4c7a4844b83a4c3e116724fb', 'request_id': 'req-f5cbcefb-1aaf-42e3-8751-932527209792'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.714965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7', 'request_id': 'req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.735717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project da1547491d364a63b3ab4b14fad288a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:49.735717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.740962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.761306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] The token cache is being invalidate because project a5fc83ea4c7a4844b83a4c3e116724fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:49.761306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.761306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.761689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7', 'request_id': 'req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.761689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7', 'request_id': 'req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.763626 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2824/5619] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:49 2022] DELETE /identity/v3/projects/a5fc83ea4c7a4844b83a4c3e116724fb => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:49.765668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'da1547491d364a63b3ab4b14fad288a7', 'request_id': 'req-f6514fa2-d08f-4a8d-89d1-057c9a5f5f8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:49.766144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:49.770441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:49.780259 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2796/5620] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:49 2022] DELETE /identity/v3/domains/da1547491d364a63b3ab4b14fad288a7 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:49.781783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b182-0845-4d5e-afa3-4440406d956c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:49.782092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b182-0845-4d5e-afa3-4440406d956c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:49.782359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7b182-0845-4d5e-afa3-4440406d956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:49.843767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b2b7b182-0845-4d5e-afa3-4440406d956c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:49.845015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b2b7b182-0845-4d5e-afa3-4440406d956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:49.951617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cbcefb-1aaf-42e3-8751-932527209792 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:49.976431 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2797/5621] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:49.977475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7b182-0845-4d5e-afa3-4440406d956c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:49.978801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b2b7b182-0845-4d5e-afa3-4440406d956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:50.129936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7b182-0845-4d5e-afa3-4440406d956c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:50.147219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f1e92-8f89-430a-8a3d-b0144b20cd4a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:50.147875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f1e92-8f89-430a-8a3d-b0144b20cd4a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:50.148156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f1e92-8f89-430a-8a3d-b0144b20cd4a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:50.148428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f1e92-8f89-430a-8a3d-b0144b20cd4a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:50.149087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f1e92-8f89-430a-8a3d-b0144b20cd4a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:50.149323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:50.150056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:50.150339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:50.150610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] PATH_INFO: `/v3/projects/dae34b3272c84b7bba5f351acd3498da` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:50.152159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae34b3272c84b7bba5f351acd3498da)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:50.154122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:50.154401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f1e92-8f89-430a-8a3d-b0144b20cd4a tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:50.244766 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2798/5622] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:49 2022] POST /identity/v3/projects => generated 376 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:50.245666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce99626-f70b-419a-ab33-e1e1e15afb90 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:50.245997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce99626-f70b-419a-ab33-e1e1e15afb90 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:50.246175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce99626-f70b-419a-ab33-e1e1e15afb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:50.259662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae34b3272c84b7bba5f351acd3498da', 'request_id': 'req-ac797406-476b-416f-b99a-55ecba08f4b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:50.277424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae34b3272c84b7bba5f351acd3498da', 'request_id': 'req-ac797406-476b-416f-b99a-55ecba08f4b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:50.289312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae34b3272c84b7bba5f351acd3498da', 'request_id': 'req-ac797406-476b-416f-b99a-55ecba08f4b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:50.297771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7ce99626-f70b-419a-ab33-e1e1e15afb90 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:50.299377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ce99626-f70b-419a-ab33-e1e1e15afb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:50.302886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] The token cache is being invalidate because project dae34b3272c84b7bba5f351acd3498da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:50.303145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:50.303983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:50.309145 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2825/5623] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:49 2022] DELETE /identity/v3/projects/dae34b3272c84b7bba5f351acd3498da => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:50.309145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:50.309145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:50.329399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:50.387600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=3,keystone:DELETE=7,keystone:SELECT=90 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:50.441259 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2799/5624] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:50.442188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce99626-f70b-419a-ab33-e1e1e15afb90 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:50.443636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ce99626-f70b-419a-ab33-e1e1e15afb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:50.480213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce99626-f70b-419a-ab33-e1e1e15afb90 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:50.505022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:50.509203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:50.509499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:50.509774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] PATH_INFO: `/v3/projects/4d85d72ef4714160b8965d5befa5aee5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:50.513229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d85d72ef4714160b8965d5befa5aee5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:50.516674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac797406-476b-416f-b99a-55ecba08f4b7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:50.518649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:50.624750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d85d72ef4714160b8965d5befa5aee5', 'request_id': 'req-1060a8fd-35fb-4651-93b9-1408fd14ad7b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:50.646222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d85d72ef4714160b8965d5befa5aee5', 'request_id': 'req-1060a8fd-35fb-4651-93b9-1408fd14ad7b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:50.653110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abde53-dbe3-46c7-a3a8-a983267386e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:50.655012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abde53-dbe3-46c7-a3a8-a983267386e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:50.656872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abde53-dbe3-46c7-a3a8-a983267386e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:50.657368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abde53-dbe3-46c7-a3a8-a983267386e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/501bc42b08ae474a8c76c08d787835b1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:50.659114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d85d72ef4714160b8965d5befa5aee5', 'request_id': 'req-1060a8fd-35fb-4651-93b9-1408fd14ad7b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:50.660062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abde53-dbe3-46c7-a3a8-a983267386e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:get_project(project_id=501bc42b08ae474a8c76c08d787835b1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:50.666503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abde53-dbe3-46c7-a3a8-a983267386e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:50.673829 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2826/5625] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:50 2022] GET /identity/v3/projects/501bc42b08ae474a8c76c08d787835b1 => generated 376 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:50.675969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7b70-379a-49a7-993d-28a962249afe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:50.677888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7b70-379a-49a7-993d-28a962249afe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:50.678678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d7b70-379a-49a7-993d-28a962249afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:50.688911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] The token cache is being invalidate because project 4d85d72ef4714160b8965d5befa5aee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:50.690251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:50.692684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:50.698129 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2800/5626] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:50 2022] DELETE /identity/v3/projects/4d85d72ef4714160b8965d5befa5aee5 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:50.699340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:50.701138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:50.727929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-220d7b70-379a-49a7-993d-28a962249afe None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:50.730537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-220d7b70-379a-49a7-993d-28a962249afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:50.906460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060a8fd-35fb-4651-93b9-1408fd14ad7b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:50.906707 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2827/5627] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:50.908011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d7b70-379a-49a7-993d-28a962249afe None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:50.909526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-220d7b70-379a-49a7-993d-28a962249afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:50.920797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5129b-6c53-4fbb-8e53-9e4bd9d0681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:50.921828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5129b-6c53-4fbb-8e53-9e4bd9d0681a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:50.922575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5129b-6c53-4fbb-8e53-9e4bd9d0681a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:50.923125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5129b-6c53-4fbb-8e53-9e4bd9d0681a admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:50.924025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5129b-6c53-4fbb-8e53-9e4bd9d0681a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:50.924536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5129b-6c53-4fbb-8e53-9e4bd9d0681a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:50.930052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5129b-6c53-4fbb-8e53-9e4bd9d0681a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:50.965617 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2801/5628] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:50.966387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5129b-6c53-4fbb-8e53-9e4bd9d0681a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:50.972436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0cc5129b-6c53-4fbb-8e53-9e4bd9d0681a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:51.011865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5129b-6c53-4fbb-8e53-9e4bd9d0681a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:51.024368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:51.027015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:51.027309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:51.027632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] PATH_INFO: `/v3/users/13312950f7e04e7980aa96d86a61a88b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:51.028830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d7b70-379a-49a7-993d-28a962249afe None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:51.034755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13312950f7e04e7980aa96d86a61a88b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:51.037409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:51.042829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b06da-df86-4e58-a9ff-8f04f9b02a21 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:51.043479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b06da-df86-4e58-a9ff-8f04f9b02a21 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:51.043758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b06da-df86-4e58-a9ff-8f04f9b02a21 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:51.044027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b06da-df86-4e58-a9ff-8f04f9b02a21 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:51.044685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b06da-df86-4e58-a9ff-8f04f9b02a21 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:51.049781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b06da-df86-4e58-a9ff-8f04f9b02a21 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:51.079745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:51.114203 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2828/5629] 10.222.0.43 () {58 vars in 1131 bytes} [Tue Aug 30 04:43:50 2022] GET /identity/v3/projects => generated 5442 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:51.116242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894040-d05a-4c04-b089-23c03b26e0ae None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:51.117684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894040-d05a-4c04-b089-23c03b26e0ae None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:51.118015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a894040-d05a-4c04-b089-23c03b26e0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:51.177342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5a894040-d05a-4c04-b089-23c03b26e0ae None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:51.182520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5a894040-d05a-4c04-b089-23c03b26e0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:51.200295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13312950f7e04e7980aa96d86a61a88b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:51.207141 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2829/5630] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:51.210022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894040-d05a-4c04-b089-23c03b26e0ae None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:51.218719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:51.229470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13312950f7e04e7980aa96d86a61a88b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:51.238117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a894040-d05a-4c04-b089-23c03b26e0ae None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:51.256000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6d83-1ae9-48d1-82da-cfe1e934b755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:51.256682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6d83-1ae9-48d1-82da-cfe1e934b755 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:51.257012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6d83-1ae9-48d1-82da-cfe1e934b755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:51.257288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e6d83-1ae9-48d1-82da-cfe1e934b755 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:51.258049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e6d83-1ae9-48d1-82da-cfe1e934b755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:51.262916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e6d83-1ae9-48d1-82da-cfe1e934b755 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:51.265819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13312950f7e04e7980aa96d86a61a88b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:51.291143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13312950f7e04e7980aa96d86a61a88b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:51.292356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13312950f7e04e7980aa96d86a61a88b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:51.306262 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2802/5631] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:50 2022] DELETE /identity/v3/users/13312950f7e04e7980aa96d86a61a88b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:51.309552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:51.312369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:51.374717 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2830/5632] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:51 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:51.380755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6d83-1ae9-48d1-82da-cfe1e934b755 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:51.387084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f31e6d83-1ae9-48d1-82da-cfe1e934b755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:51.487541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864ce39-42e4-4fb9-b875-1f52849d7092 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:51.599169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:51.601346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:51.601808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:51.602269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/501bc42b08ae474a8c76c08d787835b1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:51.605370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=501bc42b08ae474a8c76c08d787835b1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:51.610048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e6d83-1ae9-48d1-82da-cfe1e934b755 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:51.610505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:51.624717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c3187-31f1-4bd0-94f2-6d212811290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:51.627226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c3187-31f1-4bd0-94f2-6d212811290f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:51.645683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c3187-31f1-4bd0-94f2-6d212811290f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:51.647382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c3187-31f1-4bd0-94f2-6d212811290f admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:51.648339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c3187-31f1-4bd0-94f2-6d212811290f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:51.648650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c3187-31f1-4bd0-94f2-6d212811290f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:51.653186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c3187-31f1-4bd0-94f2-6d212811290f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:51.696171 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2831/5633] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:51.696171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c3187-31f1-4bd0-94f2-6d212811290f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:51.698610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d35c3187-31f1-4bd0-94f2-6d212811290f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:51.717679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c3187-31f1-4bd0-94f2-6d212811290f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:51.724747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f8f5-d3a0-4e11-959d-d30b5df4122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:51.726386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f8f5-d3a0-4e11-959d-d30b5df4122d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:51.726896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f8f5-d3a0-4e11-959d-d30b5df4122d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:51.727319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3f8f5-d3a0-4e11-959d-d30b5df4122d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:51.728265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3f8f5-d3a0-4e11-959d-d30b5df4122d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:51.730978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3f8f5-d3a0-4e11-959d-d30b5df4122d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:51.758753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501bc42b08ae474a8c76c08d787835b1', 'request_id': 'req-e3367006-6a74-45ef-8fd1-162d1eede89b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:51.766571 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2832/5634] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:51 2022] POST /identity/v3/users => generated 289 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:51.768206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f8f5-d3a0-4e11-959d-d30b5df4122d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:51.775412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501bc42b08ae474a8c76c08d787835b1', 'request_id': 'req-e3367006-6a74-45ef-8fd1-162d1eede89b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:51.785643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3f8f5-d3a0-4e11-959d-d30b5df4122d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:51.789930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501bc42b08ae474a8c76c08d787835b1', 'request_id': 'req-e3367006-6a74-45ef-8fd1-162d1eede89b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:51.818070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project 501bc42b08ae474a8c76c08d787835b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:51.819724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:51.821717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:51.826837 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2803/5635] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:51 2022] DELETE /identity/v3/projects/501bc42b08ae474a8c76c08d787835b1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:51.831037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:51.837866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:51.858278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:51.866002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3b421-52b9-49a9-979c-f31ce5dc2870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:51.866904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3b421-52b9-49a9-979c-f31ce5dc2870 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:51.867250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3b421-52b9-49a9-979c-f31ce5dc2870 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:51.867528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3b421-52b9-49a9-979c-f31ce5dc2870 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:51.868939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3b421-52b9-49a9-979c-f31ce5dc2870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:51.871844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3b421-52b9-49a9-979c-f31ce5dc2870 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:51.918610 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2833/5636] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:51 2022] POST /identity/v3/projects => generated 357 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:51.919161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3b421-52b9-49a9-979c-f31ce5dc2870 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:51.922155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-efa3b421-52b9-49a9-979c-f31ce5dc2870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:52.034395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:52.102418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3367006-6a74-45ef-8fd1-162d1eede89b tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:52.104026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3b421-52b9-49a9-979c-f31ce5dc2870 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:52.110515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b49a7-4ab6-439c-9c45-31f5b3631230 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:52.111776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b49a7-4ab6-439c-9c45-31f5b3631230 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:52.112368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b49a7-4ab6-439c-9c45-31f5b3631230 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:52.113114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b49a7-4ab6-439c-9c45-31f5b3631230 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:52.114307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b49a7-4ab6-439c-9c45-31f5b3631230 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:52.116453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b49a7-4ab6-439c-9c45-31f5b3631230 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:52.185126 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2834/5637] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:43:51 2022] POST /identity/v3/projects => generated 347 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:52.188581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b49a7-4ab6-439c-9c45-31f5b3631230 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:52.201382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1f7b49a7-4ab6-439c-9c45-31f5b3631230 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:52.357408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74652895-a321-46bb-af44-7b627b0dabe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:52.361604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74652895-a321-46bb-af44-7b627b0dabe8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:52.363449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74652895-a321-46bb-af44-7b627b0dabe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:52.365296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74652895-a321-46bb-af44-7b627b0dabe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:52.366732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74652895-a321-46bb-af44-7b627b0dabe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:52.375115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74652895-a321-46bb-af44-7b627b0dabe8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:52.422649 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2804/5638] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 591 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:52.425000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74652895-a321-46bb-af44-7b627b0dabe8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:52.440867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74652895-a321-46bb-af44-7b627b0dabe8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:52.463537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b49a7-4ab6-439c-9c45-31f5b3631230 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:52.479841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10befa-8b1f-4790-8f06-0960f11dd59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:52.480517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10befa-8b1f-4790-8f06-0960f11dd59f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:52.480793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10befa-8b1f-4790-8f06-0960f11dd59f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:52.481065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f10befa-8b1f-4790-8f06-0960f11dd59f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:52.481709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10befa-8b1f-4790-8f06-0960f11dd59f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:52.483957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f10befa-8b1f-4790-8f06-0960f11dd59f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:52.534548 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2835/5639] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:52 2022] POST /identity/v3/users => generated 279 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:52.538654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10befa-8b1f-4790-8f06-0960f11dd59f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:52.539922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc62c2f-47a2-4012-9358-1df9fa030975 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:52.540718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc62c2f-47a2-4012-9358-1df9fa030975 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:52.541099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc62c2f-47a2-4012-9358-1df9fa030975 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:52.542078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc62c2f-47a2-4012-9358-1df9fa030975 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/1825c3df15db439186fc60b5ec920796` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:52.542976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc62c2f-47a2-4012-9358-1df9fa030975 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:update_project(project_id=1825c3df15db439186fc60b5ec920796)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:52.545171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc62c2f-47a2-4012-9358-1df9fa030975 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:52.571740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f10befa-8b1f-4790-8f06-0960f11dd59f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:52.584874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f48296-1ac8-4bfb-81a1-52346e11297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:52.585517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48296-1ac8-4bfb-81a1-52346e11297f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:52.585815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48296-1ac8-4bfb-81a1-52346e11297f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:52.586114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f48296-1ac8-4bfb-81a1-52346e11297f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:52.586783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f48296-1ac8-4bfb-81a1-52346e11297f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:52.588431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f48296-1ac8-4bfb-81a1-52346e11297f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:52.626979 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2805/5640] 10.222.0.43 () {60 vars in 1252 bytes} [Tue Aug 30 04:43:52 2022] PATCH /identity/v3/projects/1825c3df15db439186fc60b5ec920796 => generated 361 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:52.629094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc62c2f-47a2-4012-9358-1df9fa030975 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:52.632438 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2836/5641] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:52.633170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f48296-1ac8-4bfb-81a1-52346e11297f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:52.657993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f48296-1ac8-4bfb-81a1-52346e11297f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:52.663022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc62c2f-47a2-4012-9358-1df9fa030975 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:52.670723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d96ec-919b-4dd9-a371-31eeb50a4744 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:52.671638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d96ec-919b-4dd9-a371-31eeb50a4744 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:52.672266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d96ec-919b-4dd9-a371-31eeb50a4744 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:52.672266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d96ec-919b-4dd9-a371-31eeb50a4744 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/1825c3df15db439186fc60b5ec920796` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:52.673098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ea7a6-7cf0-468c-a9eb-185bd434836a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:52.674389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea7a6-7cf0-468c-a9eb-185bd434836a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:52.675027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea7a6-7cf0-468c-a9eb-185bd434836a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:52.675529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ea7a6-7cf0-468c-a9eb-185bd434836a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:52.677267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ea7a6-7cf0-468c-a9eb-185bd434836a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:52.702120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d96ec-919b-4dd9-a371-31eeb50a4744 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:get_project(project_id=1825c3df15db439186fc60b5ec920796)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:52.706929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d96ec-919b-4dd9-a371-31eeb50a4744 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:52.712187 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2837/5642] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:52 2022] GET /identity/v3/projects/1825c3df15db439186fc60b5ec920796 => generated 348 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:52.717749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d96ec-919b-4dd9-a371-31eeb50a4744 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:52.721132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ea7a6-7cf0-468c-a9eb-185bd434836a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:52.752211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d96ec-919b-4dd9-a371-31eeb50a4744 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:52.779000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c265bb0-80f0-4915-8e30-b1413d8163fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:52.779968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c265bb0-80f0-4915-8e30-b1413d8163fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:52.781617 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2806/5643] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:52.782085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c265bb0-80f0-4915-8e30-b1413d8163fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:52.782364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c265bb0-80f0-4915-8e30-b1413d8163fd admin admin] PATH_INFO: `/v3/projects/c173c43f374c4e95befd2113616f6eec/users/9322653eaeb547c386d7585aecb717c4/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:52.783277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ea7a6-7cf0-468c-a9eb-185bd434836a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:52.837427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ea7a6-7cf0-468c-a9eb-185bd434836a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:52.847082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c265bb0-80f0-4915-8e30-b1413d8163fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c173c43f374c4e95befd2113616f6eec, user_id=9322653eaeb547c386d7585aecb717c4, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:52.853945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:52.854620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:52.854899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:52.855171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/1825c3df15db439186fc60b5ec920796` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:52.857494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1825c3df15db439186fc60b5ec920796)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:52.859563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c265bb0-80f0-4915-8e30-b1413d8163fd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:52.861961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:52.888733 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2838/5644] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:52 2022] PUT /identity/v3/projects/c173c43f374c4e95befd2113616f6eec/users/9322653eaeb547c386d7585aecb717c4/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:52.889714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c265bb0-80f0-4915-8e30-b1413d8163fd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:52.920674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:53.059927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1825c3df15db439186fc60b5ec920796', 'request_id': 'req-0183de57-797c-4c65-bac9-8112f0ef92b7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:53.080050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:53.094942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c265bb0-80f0-4915-8e30-b1413d8163fd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:53.095654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1825c3df15db439186fc60b5ec920796', 'request_id': 'req-0183de57-797c-4c65-bac9-8112f0ef92b7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:53.127413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1825c3df15db439186fc60b5ec920796', 'request_id': 'req-0183de57-797c-4c65-bac9-8112f0ef92b7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:53.201160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project 1825c3df15db439186fc60b5ec920796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:53.202044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:53.202973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0183de57-797c-4c65-bac9-8112f0ef92b7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:53.205191 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2807/5645] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:52 2022] DELETE /identity/v3/projects/1825c3df15db439186fc60b5ec920796 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:53.215139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b12280-6016-4790-9d8c-3e73d9b326e7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:53.215705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b12280-6016-4790-9d8c-3e73d9b326e7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:53.216111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b12280-6016-4790-9d8c-3e73d9b326e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:53.245973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688fc53-29f6-4dc8-be0a-d8f15b022655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:53.246778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688fc53-29f6-4dc8-be0a-d8f15b022655 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:53.247164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688fc53-29f6-4dc8-be0a-d8f15b022655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:53.247968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688fc53-29f6-4dc8-be0a-d8f15b022655 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:53.248289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688fc53-29f6-4dc8-be0a-d8f15b022655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:53.250083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688fc53-29f6-4dc8-be0a-d8f15b022655 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:53.274696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c1b12280-6016-4790-9d8c-3e73d9b326e7 None None] MFA Rules not processed for user `9322653eaeb547c386d7585aecb717c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:53.276177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c1b12280-6016-4790-9d8c-3e73d9b326e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:53.276772 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2839/5646] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:53.277888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688fc53-29f6-4dc8-be0a-d8f15b022655 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:53.284083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a688fc53-29f6-4dc8-be0a-d8f15b022655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:53.468888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688fc53-29f6-4dc8-be0a-d8f15b022655 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:53.478929 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2808/5647] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:53.480033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b12280-6016-4790-9d8c-3e73d9b326e7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:53.482901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c1b12280-6016-4790-9d8c-3e73d9b326e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:53.485589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b182d-5a0a-47d3-80a9-6b63b9a69ace tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:53.486436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b182d-5a0a-47d3-80a9-6b63b9a69ace tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:53.487742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b182d-5a0a-47d3-80a9-6b63b9a69ace tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:53.488205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b182d-5a0a-47d3-80a9-6b63b9a69ace tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:53.489850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b182d-5a0a-47d3-80a9-6b63b9a69ace tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:53.494523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b182d-5a0a-47d3-80a9-6b63b9a69ace tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:53.519305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b12280-6016-4790-9d8c-3e73d9b326e7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:53.535031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a20aa-2451-45d3-ab0e-ab598ce4945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:53.535881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a20aa-2451-45d3-ab0e-ab598ce4945c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:53.536264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a20aa-2451-45d3-ab0e-ab598ce4945c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:53.536657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a20aa-2451-45d3-ab0e-ab598ce4945c admin admin] PATH_INFO: `/v3/projects/7c1f73a12eda43cfa10a2f6a3d1aa14b/users/b7e84a21f10145f0aeed3ab41ecdfca2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:53.567726 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2840/5648] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:53 2022] POST /identity/v3/projects => generated 359 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:53.572343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b182d-5a0a-47d3-80a9-6b63b9a69ace tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:53.573636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a20aa-2451-45d3-ab0e-ab598ce4945c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1f73a12eda43cfa10a2f6a3d1aa14b, user_id=b7e84a21f10145f0aeed3ab41ecdfca2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:53.577146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a20aa-2451-45d3-ab0e-ab598ce4945c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:53.634842 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2809/5649] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:53 2022] PUT /identity/v3/projects/7c1f73a12eda43cfa10a2f6a3d1aa14b/users/b7e84a21f10145f0aeed3ab41ecdfca2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:53.637404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a20aa-2451-45d3-ab0e-ab598ce4945c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:53.644867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b81a20aa-2451-45d3-ab0e-ab598ce4945c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:53.794480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b182d-5a0a-47d3-80a9-6b63b9a69ace tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:53.836236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a20aa-2451-45d3-ab0e-ab598ce4945c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:53.844408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149a813-9d24-4341-8b45-1212d77b4a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:53.845196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149a813-9d24-4341-8b45-1212d77b4a92 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:53.845579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149a813-9d24-4341-8b45-1212d77b4a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:53.846014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149a813-9d24-4341-8b45-1212d77b4a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:53.884581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:53.889669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:53.969930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb50c8d-988b-4f26-a6cf-cd369c2aa9e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:53.970665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb50c8d-988b-4f26-a6cf-cd369c2aa9e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:53.970942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb50c8d-988b-4f26-a6cf-cd369c2aa9e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:53.971209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb50c8d-988b-4f26-a6cf-cd369c2aa9e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/a0868fbeb0454b859b91f59971bf2135` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:53.973824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb50c8d-988b-4f26-a6cf-cd369c2aa9e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:update_project(project_id=a0868fbeb0454b859b91f59971bf2135)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:53.978439 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-6eb50c8d-988b-4f26-a6cf-cd369c2aa9e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:43:53.978439 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:43:53.978439 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:43:53.980835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb50c8d-988b-4f26-a6cf-cd369c2aa9e1 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:53.996605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149a813-9d24-4341-8b45-1212d77b4a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:53.998697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149a813-9d24-4341-8b45-1212d77b4a92 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:54.018450 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2810/5650] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:54.019965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afedeb-84ef-48ae-9170-e5d385b37035 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:54.020294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afedeb-84ef-48ae-9170-e5d385b37035 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:54.020591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afedeb-84ef-48ae-9170-e5d385b37035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:54.078053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-24afedeb-84ef-48ae-9170-e5d385b37035 None None] MFA Rules not processed for user `b7e84a21f10145f0aeed3ab41ecdfca2`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:54.079518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24afedeb-84ef-48ae-9170-e5d385b37035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:54.173975 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2841/5651] 10.222.0.43 () {60 vars in 1252 bytes} [Tue Aug 30 04:43:53 2022] PATCH /identity/v3/projects/a0868fbeb0454b859b91f59971bf2135 => generated 371 bytes in 602 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:54.176908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d559cc-58c4-40ee-b8b8-94a98bc59435 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:54.177397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d559cc-58c4-40ee-b8b8-94a98bc59435 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:54.177685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d559cc-58c4-40ee-b8b8-94a98bc59435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:54.223098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-20d559cc-58c4-40ee-b8b8-94a98bc59435 None None] MFA Rules not processed for user `17fc1309afe74c32a5cd1c242ea5afaf`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:54.224851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-20d559cc-58c4-40ee-b8b8-94a98bc59435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:54.258355 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2811/5652] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:54.258355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afedeb-84ef-48ae-9170-e5d385b37035 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:54.258355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24afedeb-84ef-48ae-9170-e5d385b37035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:54.383784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afedeb-84ef-48ae-9170-e5d385b37035 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:54.395345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:54.397206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:54.398095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:54.399178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] PATH_INFO: `/v3/projects/1eed29cdb37b44daab6a76d85dcbc234` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:54.403714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eed29cdb37b44daab6a76d85dcbc234)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:54.405843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:54.432328 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2842/5653] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:54.432328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d559cc-58c4-40ee-b8b8-94a98bc59435 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:54.432328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-20d559cc-58c4-40ee-b8b8-94a98bc59435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:54.464112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d559cc-58c4-40ee-b8b8-94a98bc59435 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:54.478960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:54.479993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:54.480659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:54.480935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] PATH_INFO: `/v3/users/9322653eaeb547c386d7585aecb717c4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:54.485445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9322653eaeb547c386d7585aecb717c4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:54.488189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:54.508178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eed29cdb37b44daab6a76d85dcbc234', 'request_id': 'req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:54.514350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:54.524224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eed29cdb37b44daab6a76d85dcbc234', 'request_id': 'req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:54.533047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eed29cdb37b44daab6a76d85dcbc234', 'request_id': 'req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:54.560794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] The token cache is being invalidate because project 1eed29cdb37b44daab6a76d85dcbc234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:54.561408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:54.562552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:54.564805 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2812/5654] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:54 2022] DELETE /identity/v3/projects/1eed29cdb37b44daab6a76d85dcbc234 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:54.565986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:54.567810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:54.614890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9322653eaeb547c386d7585aecb717c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:54.615790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9322653eaeb547c386d7585aecb717c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:54.625301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9322653eaeb547c386d7585aecb717c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:54.636907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9322653eaeb547c386d7585aecb717c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:54.658166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9322653eaeb547c386d7585aecb717c4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:54.669232 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2843/5655] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:54 2022] DELETE /identity/v3/users/9322653eaeb547c386d7585aecb717c4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:54.670416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:54.672252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:54.676936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f74cc9-7e8b-44a5-a379-f2c410ff2073 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:54.681516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:54.779845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66cd3f-3a9f-465a-8e82-1a7a0745f76f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:54.786161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5d552-780f-453e-b026-ba760fa8ecca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:54.786954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5d552-780f-453e-b026-ba760fa8ecca admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:54.787228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5d552-780f-453e-b026-ba760fa8ecca admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:54.787869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5d552-780f-453e-b026-ba760fa8ecca admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:54.789341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5d552-780f-453e-b026-ba760fa8ecca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:54.791455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5d552-780f-453e-b026-ba760fa8ecca admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:54.833183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f3fc7-12c4-416d-b857-e72ed3433917 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:54.834149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f3fc7-12c4-416d-b857-e72ed3433917 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:54.834718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f3fc7-12c4-416d-b857-e72ed3433917 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:54.835720 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2844/5656] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:54 2022] POST /identity/v3/projects => generated 357 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:54.836599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f3fc7-12c4-416d-b857-e72ed3433917 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/a0868fbeb0454b859b91f59971bf2135` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:54.837197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16468-4a26-4998-87a0-3300fbe265e5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:54.837575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16468-4a26-4998-87a0-3300fbe265e5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:54.837758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca16468-4a26-4998-87a0-3300fbe265e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:54.862556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0ca16468-4a26-4998-87a0-3300fbe265e5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:54.864552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0ca16468-4a26-4998-87a0-3300fbe265e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:54.866295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f3fc7-12c4-416d-b857-e72ed3433917 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:get_project(project_id=a0868fbeb0454b859b91f59971bf2135)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:54.869068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f3fc7-12c4-416d-b857-e72ed3433917 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:54.883127 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2813/5657] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:54 2022] GET /identity/v3/projects/a0868fbeb0454b859b91f59971bf2135 => generated 358 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:54.886833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe728e4a-0b2d-4101-9a37-d352a22cf01d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:54.887711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe728e4a-0b2d-4101-9a37-d352a22cf01d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:54.888185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe728e4a-0b2d-4101-9a37-d352a22cf01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:54.932128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fe728e4a-0b2d-4101-9a37-d352a22cf01d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:54.936164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fe728e4a-0b2d-4101-9a37-d352a22cf01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:54.954334 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2845/5658] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:54.955261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca16468-4a26-4998-87a0-3300fbe265e5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:54.968230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca16468-4a26-4998-87a0-3300fbe265e5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:54.974382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee6aff-349b-47aa-87fb-4ecc652da73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:54.975364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee6aff-349b-47aa-87fb-4ecc652da73e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:54.975884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee6aff-349b-47aa-87fb-4ecc652da73e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:54.976483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee6aff-349b-47aa-87fb-4ecc652da73e admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:54.977443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee6aff-349b-47aa-87fb-4ecc652da73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:54.980069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee6aff-349b-47aa-87fb-4ecc652da73e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:55.022367 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2846/5659] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:54 2022] POST /identity/v3/users => generated 285 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:55.024681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee6aff-349b-47aa-87fb-4ecc652da73e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:55.031092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ceee6aff-349b-47aa-87fb-4ecc652da73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:55.083166 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2814/5660] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:55.083166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e00fba-0a3c-42e6-a962-871f88447b72 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:55.083583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e00fba-0a3c-42e6-a962-871f88447b72 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:55.084003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e00fba-0a3c-42e6-a962-871f88447b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:55.130691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f5e00fba-0a3c-42e6-a962-871f88447b72 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:55.132143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f5e00fba-0a3c-42e6-a962-871f88447b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:55.151790 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2815/5661] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:55.152594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e00fba-0a3c-42e6-a962-871f88447b72 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:55.186517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e00fba-0a3c-42e6-a962-871f88447b72 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:55.205852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14332281-f1c2-4797-a149-daae6b940a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:55.207234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332281-f1c2-4797-a149-daae6b940a21 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:55.207694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332281-f1c2-4797-a149-daae6b940a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:55.208148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14332281-f1c2-4797-a149-daae6b940a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:55.212296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14332281-f1c2-4797-a149-daae6b940a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:55.214617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14332281-f1c2-4797-a149-daae6b940a21 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:55.225116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee6aff-349b-47aa-87fb-4ecc652da73e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:55.239765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:55.240597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:55.241119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:55.241462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/a0868fbeb0454b859b91f59971bf2135` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:55.252724 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2816/5662] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:55.252724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14332281-f1c2-4797-a149-daae6b940a21 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:55.257406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a0868fbeb0454b859b91f59971bf2135)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:55.260035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-14332281-f1c2-4797-a149-daae6b940a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:55.269376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:55.269857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:55.343721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:55.378089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14332281-f1c2-4797-a149-daae6b940a21 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:55.388951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8539a-5de3-45f0-a245-f25f557955e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:55.389991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8539a-5de3-45f0-a245-f25f557955e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:55.390470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8539a-5de3-45f0-a245-f25f557955e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:55.391101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8539a-5de3-45f0-a245-f25f557955e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:55.423778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0868fbeb0454b859b91f59971bf2135', 'request_id': 'req-cde7c724-f2e5-45dc-9e74-b05e46749099'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:55.436469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8539a-5de3-45f0-a245-f25f557955e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:55.438318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8539a-5de3-45f0-a245-f25f557955e6 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:55.443461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0868fbeb0454b859b91f59971bf2135', 'request_id': 'req-cde7c724-f2e5-45dc-9e74-b05e46749099'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:55.467381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0868fbeb0454b859b91f59971bf2135', 'request_id': 'req-cde7c724-f2e5-45dc-9e74-b05e46749099'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:55.488341 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2817/5663] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:55.489729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8539a-5de3-45f0-a245-f25f557955e6 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:55.495852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project a0868fbeb0454b859b91f59971bf2135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:55.496486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:55.498707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:55.504205 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2847/5664] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:55 2022] DELETE /identity/v3/projects/a0868fbeb0454b859b91f59971bf2135 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:55.506678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:55.511706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:55.522705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8539a-5de3-45f0-a245-f25f557955e6 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:55.726238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea7c3e-e0d5-4554-9785-4f4bf21da2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:55.729623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7c3e-e0d5-4554-9785-4f4bf21da2de admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:55.730949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7c3e-e0d5-4554-9785-4f4bf21da2de admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:55.731895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea7c3e-e0d5-4554-9785-4f4bf21da2de admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:55.736690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea7c3e-e0d5-4554-9785-4f4bf21da2de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:55.737891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea7c3e-e0d5-4554-9785-4f4bf21da2de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:55.742506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea7c3e-e0d5-4554-9785-4f4bf21da2de admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:55.806248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7c724-f2e5-45dc-9e74-b05e46749099 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:55.811776 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2818/5665] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:55.812728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea7c3e-e0d5-4554-9785-4f4bf21da2de admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:55.817541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b1ea7c3e-e0d5-4554-9785-4f4bf21da2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:55.825969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8675d8d-cfe5-45f2-b25e-27198429f19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:55.826824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675d8d-cfe5-45f2-b25e-27198429f19c admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:55.827105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675d8d-cfe5-45f2-b25e-27198429f19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:55.827376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675d8d-cfe5-45f2-b25e-27198429f19c admin admin] PATH_INFO: `/v3/projects/541ee7c8510a4ffc825af5f5248b8df7/users/a06ece18e42446d1b57499a49319f085/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:55.883034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8675d8d-cfe5-45f2-b25e-27198429f19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=541ee7c8510a4ffc825af5f5248b8df7, user_id=a06ece18e42446d1b57499a49319f085, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:55.885895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8675d8d-cfe5-45f2-b25e-27198429f19c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:55.936694 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2848/5666] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:55 2022] PUT /identity/v3/projects/541ee7c8510a4ffc825af5f5248b8df7/users/a06ece18e42446d1b57499a49319f085/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:55.937351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8675d8d-cfe5-45f2-b25e-27198429f19c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:55.953096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d8675d8d-cfe5-45f2-b25e-27198429f19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:56.017780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea7c3e-e0d5-4554-9785-4f4bf21da2de admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:56.165049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:56.180042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8675d8d-cfe5-45f2-b25e-27198429f19c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:56.198043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94fa6a-67c7-4638-b111-11ae6b0cdc1c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:56.198793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94fa6a-67c7-4638-b111-11ae6b0cdc1c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:56.199163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94fa6a-67c7-4638-b111-11ae6b0cdc1c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:56.199530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94fa6a-67c7-4638-b111-11ae6b0cdc1c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:56.200240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc2fc2-24a0-4b24-8977-3e20c0c76ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:56.200357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94fa6a-67c7-4638-b111-11ae6b0cdc1c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:56.201090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc2fc2-24a0-4b24-8977-3e20c0c76ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:56.201460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc2fc2-24a0-4b24-8977-3e20c0c76ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:56.201930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc2fc2-24a0-4b24-8977-3e20c0c76ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:56.205111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94fa6a-67c7-4638-b111-11ae6b0cdc1c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:56.210270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9fbc2fc2-24a0-4b24-8977-3e20c0c76ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:56.313326 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2819/5667] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:55 2022] POST /identity/v3/projects => generated 353 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:56.314924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94fa6a-67c7-4638-b111-11ae6b0cdc1c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:56.322861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6c94fa6a-67c7-4638-b111-11ae6b0cdc1c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:56.360632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:56.451297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc2fc2-24a0-4b24-8977-3e20c0c76ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:56.458904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc2fc2-24a0-4b24-8977-3e20c0c76ad8 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:56.483827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2849/5668] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:56.485031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc2fc2-24a0-4b24-8977-3e20c0c76ad8 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:56.507969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc2fc2-24a0-4b24-8977-3e20c0c76ad8 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:56.547041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94fa6a-67c7-4638-b111-11ae6b0cdc1c tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:56.564917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67866918-3cf6-4735-9455-42d03241f32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:56.565759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67866918-3cf6-4735-9455-42d03241f32b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:56.566068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67866918-3cf6-4735-9455-42d03241f32b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:56.566342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67866918-3cf6-4735-9455-42d03241f32b admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:56.566986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67866918-3cf6-4735-9455-42d03241f32b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:56.576396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67866918-3cf6-4735-9455-42d03241f32b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:56.632241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8adf5-78ef-4aaf-afcd-8ce50ac2127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:56.633219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8adf5-78ef-4aaf-afcd-8ce50ac2127e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:56.636356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8adf5-78ef-4aaf-afcd-8ce50ac2127e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:56.636356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8adf5-78ef-4aaf-afcd-8ce50ac2127e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:56.636981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8adf5-78ef-4aaf-afcd-8ce50ac2127e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:56.643434 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2820/5669] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:56 2022] POST /identity/v3/projects => generated 367 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:56.643719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d8adf5-78ef-4aaf-afcd-8ce50ac2127e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:56.644377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67866918-3cf6-4735-9455-42d03241f32b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:56.671220 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2850/5670] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:56.672217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8adf5-78ef-4aaf-afcd-8ce50ac2127e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:56.701169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d8adf5-78ef-4aaf-afcd-8ce50ac2127e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:56.770796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67866918-3cf6-4735-9455-42d03241f32b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:56.777056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664b22-3754-4cd2-ba71-7de3b31ed0f5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:56.779584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664b22-3754-4cd2-ba71-7de3b31ed0f5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:56.779887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664b22-3754-4cd2-ba71-7de3b31ed0f5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:56.780625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19664b22-3754-4cd2-ba71-7de3b31ed0f5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/06355357715f43519be6e1bd9224cf44` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:56.783100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19664b22-3754-4cd2-ba71-7de3b31ed0f5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:update_project(project_id=06355357715f43519be6e1bd9224cf44)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:56.807405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be6bcc-638e-4f32-aead-eb8dbce66f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:56.807878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19664b22-3754-4cd2-ba71-7de3b31ed0f5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:56.808499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be6bcc-638e-4f32-aead-eb8dbce66f35 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:56.808907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be6bcc-638e-4f32-aead-eb8dbce66f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:56.809337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be6bcc-638e-4f32-aead-eb8dbce66f35 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:56.811371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be6bcc-638e-4f32-aead-eb8dbce66f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:56.813623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be6bcc-638e-4f32-aead-eb8dbce66f35 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:56.854626 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2851/5671] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:56 2022] POST /identity/v3/users => generated 284 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:56.857598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be6bcc-638e-4f32-aead-eb8dbce66f35 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:56.891234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be6bcc-638e-4f32-aead-eb8dbce66f35 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:56.905427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c93e6-e763-4080-9bbf-24ade2100fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:56.905427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c93e6-e763-4080-9bbf-24ade2100fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:56.905427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c93e6-e763-4080-9bbf-24ade2100fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:56.905427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c93e6-e763-4080-9bbf-24ade2100fbf admin admin] PATH_INFO: `/v3/projects/541ee7c8510a4ffc825af5f5248b8df7/users/a06ece18e42446d1b57499a49319f085/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:56.906632 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2821/5672] 10.222.0.43 () {60 vars in 1252 bytes} [Tue Aug 30 04:43:56 2022] PATCH /identity/v3/projects/06355357715f43519be6e1bd9224cf44 => generated 367 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:56.907854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664b22-3754-4cd2-ba71-7de3b31ed0f5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:56.909801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c93e6-e763-4080-9bbf-24ade2100fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=541ee7c8510a4ffc825af5f5248b8df7, user_id=a06ece18e42446d1b57499a49319f085, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:56.913490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c93e6-e763-4080-9bbf-24ade2100fbf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:56.923672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19664b22-3754-4cd2-ba71-7de3b31ed0f5 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:56.929943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9710a92-2668-4fed-a17c-e366e8ee3af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:56.931016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9710a92-2668-4fed-a17c-e366e8ee3af6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:56.931495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9710a92-2668-4fed-a17c-e366e8ee3af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:56.931979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9710a92-2668-4fed-a17c-e366e8ee3af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:56.933186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9710a92-2668-4fed-a17c-e366e8ee3af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:56.935754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9710a92-2668-4fed-a17c-e366e8ee3af6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:56.944316 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2852/5673] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:56 2022] PUT /identity/v3/projects/541ee7c8510a4ffc825af5f5248b8df7/users/a06ece18e42446d1b57499a49319f085/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:56.945239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c93e6-e763-4080-9bbf-24ade2100fbf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:56.954826 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2822/5674] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:56.957089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33da970-45f8-4a41-9665-4163878a7615 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:56.957603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33da970-45f8-4a41-9665-4163878a7615 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:56.959044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33da970-45f8-4a41-9665-4163878a7615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:57.077125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e33da970-45f8-4a41-9665-4163878a7615 None None] MFA Rules not processed for user `a06ece18e42446d1b57499a49319f085`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:57.081236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e33da970-45f8-4a41-9665-4163878a7615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:57.085857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:57.129287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:57.140669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c93e6-e763-4080-9bbf-24ade2100fbf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:57.164102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6b63a-4910-46c6-9bd5-d34388bcaeea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:57.164771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6b63a-4910-46c6-9bd5-d34388bcaeea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:57.165053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6b63a-4910-46c6-9bd5-d34388bcaeea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:57.165325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6b63a-4910-46c6-9bd5-d34388bcaeea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/06355357715f43519be6e1bd9224cf44` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:57.217748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6b63a-4910-46c6-9bd5-d34388bcaeea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:get_project(project_id=06355357715f43519be6e1bd9224cf44)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:57.220672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6b63a-4910-46c6-9bd5-d34388bcaeea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:57.223602 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2853/5675] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:43:56 2022] GET /identity/v3/projects/06355357715f43519be6e1bd9224cf44 => generated 354 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:43:57.224439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6b63a-4910-46c6-9bd5-d34388bcaeea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:57.344672 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2823/5676] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:57.347726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33da970-45f8-4a41-9665-4163878a7615 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:57.371684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33da970-45f8-4a41-9665-4163878a7615 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:57.382014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:57.382754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:57.383095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:57.383376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/projects/06355357715f43519be6e1bd9224cf44` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:57.388707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorizing `identity:delete_project(project_id=06355357715f43519be6e1bd9224cf44)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:57.392273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:57.435309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6b63a-4910-46c6-9bd5-d34388bcaeea tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:57.449004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2773f88-a151-43b4-859d-770ba5162502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:57.449699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773f88-a151-43b4-859d-770ba5162502 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:57.450031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773f88-a151-43b4-859d-770ba5162502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:57.450305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773f88-a151-43b4-859d-770ba5162502 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:57.451073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2773f88-a151-43b4-859d-770ba5162502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:57.452878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2773f88-a151-43b4-859d-770ba5162502 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:57.483558 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2854/5677] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:43:57.485776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2773f88-a151-43b4-859d-770ba5162502 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:57.490594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a2773f88-a151-43b4-859d-770ba5162502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:57.586819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2773f88-a151-43b4-859d-770ba5162502 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:57.613931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06355357715f43519be6e1bd9224cf44', 'request_id': 'req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:57.644626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06355357715f43519be6e1bd9224cf44', 'request_id': 'req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:57.664197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06355357715f43519be6e1bd9224cf44', 'request_id': 'req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:57.701620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3361f3-6511-40b9-8d95-a52287af86ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:57.702453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3361f3-6511-40b9-8d95-a52287af86ca service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:57.702801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3361f3-6511-40b9-8d95-a52287af86ca service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:57.702976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3361f3-6511-40b9-8d95-a52287af86ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:57.706211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] The token cache is being invalidate because project 06355357715f43519be6e1bd9224cf44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:57.706511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:57.709070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:57.718892 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2824/5678] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:57 2022] DELETE /identity/v3/projects/06355357715f43519be6e1bd9224cf44 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:57.719897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:57.724222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:57.806758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:57.861993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3361f3-6511-40b9-8d95-a52287af86ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:57.864562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3361f3-6511-40b9-8d95-a52287af86ca service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:57.915221 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2855/5679] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:57.925548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3361f3-6511-40b9-8d95-a52287af86ca service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:57.933508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2ae24-f4bf-4e90-9129-c71ebfef71d8 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:57.947465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed800c2-72a9-4730-ac91-60a1752a79ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:57.948691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed800c2-72a9-4730-ac91-60a1752a79ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:57.951247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed800c2-72a9-4730-ac91-60a1752a79ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:57.951523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed800c2-72a9-4730-ac91-60a1752a79ae admin admin] PATH_INFO: `/v3/projects/388b252f311d4a47addfc34920973d91/users/6a67f2a1c5a048d3be7fbb3400c9b192/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:57.988050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed800c2-72a9-4730-ac91-60a1752a79ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=388b252f311d4a47addfc34920973d91, user_id=6a67f2a1c5a048d3be7fbb3400c9b192, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:57.991214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed800c2-72a9-4730-ac91-60a1752a79ae admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:58.052892 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2825/5680] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:43:57 2022] PUT /identity/v3/projects/388b252f311d4a47addfc34920973d91/users/6a67f2a1c5a048d3be7fbb3400c9b192/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:58.054922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed800c2-72a9-4730-ac91-60a1752a79ae admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:58.060001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2ed800c2-72a9-4730-ac91-60a1752a79ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:58.114912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:58.166633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3361f3-6511-40b9-8d95-a52287af86ca service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:58.265549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed800c2-72a9-4730-ac91-60a1752a79ae admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:58.282314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55d44-c292-42b6-8fb8-6ee280e009a7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:58.282512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55d44-c292-42b6-8fb8-6ee280e009a7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:58.282772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55d44-c292-42b6-8fb8-6ee280e009a7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:58.284456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55d44-c292-42b6-8fb8-6ee280e009a7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/domains/da1547491d364a63b3ab4b14fad288a7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:58.302698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f55d44-c292-42b6-8fb8-6ee280e009a7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-f5f55d44-c292-42b6-8fb8-6ee280e009a7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Could not find domain: da1547491d364a63b3ab4b14fad288a7.: keystone.exception.DomainNotFound: Could not find domain: da1547491d364a63b3ab4b14fad288a7. Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: da1547491d364a63b3ab4b14fad288a7. Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:43:58.316610 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:43:58.317564 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: da1547491d364a63b3ab4b14fad288a7. Aug 30 04:43:58.318943 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:43:58.323621 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2826/5681] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:43:58 2022] PATCH /identity/v3/domains/da1547491d364a63b3ab4b14fad288a7 => generated 112 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:43:58.324133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55d44-c292-42b6-8fb8-6ee280e009a7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:58.329708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f5f55d44-c292-42b6-8fb8-6ee280e009a7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:58.354762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5b1f-be51-4a36-a716-f74bc86449d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:58.355285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5b1f-be51-4a36-a716-f74bc86449d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:58.355558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5b1f-be51-4a36-a716-f74bc86449d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:58.355825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5b1f-be51-4a36-a716-f74bc86449d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:58.363120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-afda5b1f-be51-4a36-a716-f74bc86449d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:58.495268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55d44-c292-42b6-8fb8-6ee280e009a7 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:58.518546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:58.522231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:58.522697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:58.523050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] PATH_INFO: `/v3/projects/c173c43f374c4e95befd2113616f6eec` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:58.526990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c173c43f374c4e95befd2113616f6eec)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:58.532336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:58.616482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5b1f-be51-4a36-a716-f74bc86449d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:58.617917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5b1f-be51-4a36-a716-f74bc86449d0 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:58.647472 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2856/5682] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:58.648886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9fe3a-41b6-4f76-bf1a-dc786c39af34 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:58.649175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9fe3a-41b6-4f76-bf1a-dc786c39af34 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:58.649450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9fe3a-41b6-4f76-bf1a-dc786c39af34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:58.652215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c173c43f374c4e95befd2113616f6eec', 'request_id': 'req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:58.666525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c173c43f374c4e95befd2113616f6eec', 'request_id': 'req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:58.677213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c173c43f374c4e95befd2113616f6eec', 'request_id': 'req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:58.700971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] The token cache is being invalidate because project c173c43f374c4e95befd2113616f6eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:43:58.701423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:58.705049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:58.707418 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2827/5683] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:43:58 2022] DELETE /identity/v3/projects/c173c43f374c4e95befd2113616f6eec => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:58.712402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:58.713955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:58.725625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-75b9fe3a-41b6-4f76-bf1a-dc786c39af34 None None] MFA Rules not processed for user `6a67f2a1c5a048d3be7fbb3400c9b192`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:58.733017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-75b9fe3a-41b6-4f76-bf1a-dc786c39af34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:58.780457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:58.842371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:58.870282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e9ef77-4b82-48b2-8140-e7a9bc05de81 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:58.880661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a063a-3199-4db1-8246-f97580eaa14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:58.883466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a063a-3199-4db1-8246-f97580eaa14a service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:58.883751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a063a-3199-4db1-8246-f97580eaa14a service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:58.884025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a063a-3199-4db1-8246-f97580eaa14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:58.890877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-758a063a-3199-4db1-8246-f97580eaa14a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:58.929724 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2857/5684] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:58.931043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9fe3a-41b6-4f76-bf1a-dc786c39af34 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:58.932685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-75b9fe3a-41b6-4f76-bf1a-dc786c39af34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:59.078957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a063a-3199-4db1-8246-f97580eaa14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:59.088539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a063a-3199-4db1-8246-f97580eaa14a service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:59.130939 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2828/5685] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:43:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:43:59.132645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a063a-3199-4db1-8246-f97580eaa14a service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:59.136566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-758a063a-3199-4db1-8246-f97580eaa14a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:59.142970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9fe3a-41b6-4f76-bf1a-dc786c39af34 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:59.152337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b99ee-0b7c-4e65-8b04-ba0f933a7553 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8fb2d88192b4aa999fbebbddb20d2fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72ce9c88df0c44d7a196ee0e94ee8033', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:59.154432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b99ee-0b7c-4e65-8b04-ba0f933a7553 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:59.154432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b99ee-0b7c-4e65-8b04-ba0f933a7553 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:59.154731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b99ee-0b7c-4e65-8b04-ba0f933a7553 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] PATH_INFO: `/v3/domains/8555bd94e504459dbea7bd192e6a3529` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:59.176536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b99ee-0b7c-4e65-8b04-ba0f933a7553 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-4e2b99ee-0b7c-4e65-8b04-ba0f933a7553 tempest-ProjectsTestJSON-1662659821 tempest-ProjectsTestJSON-1662659821-project-admin] Could not find domain: 8555bd94e504459dbea7bd192e6a3529.: keystone.exception.DomainNotFound: Could not find domain: 8555bd94e504459dbea7bd192e6a3529. Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8555bd94e504459dbea7bd192e6a3529. Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:43:59.182919 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:43:59.183820 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8555bd94e504459dbea7bd192e6a3529. Aug 30 04:43:59.184579 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:43:59.186453 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2858/5686] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:43:58 2022] PATCH /identity/v3/domains/8555bd94e504459dbea7bd192e6a3529 => generated 112 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:43:59.195106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5331f-5f0e-46ce-907b-f17f099ae335 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:59.196201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5331f-5f0e-46ce-907b-f17f099ae335 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:59.196489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5331f-5f0e-46ce-907b-f17f099ae335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:59.237111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2da5331f-5f0e-46ce-907b-f17f099ae335 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:59.240054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2da5331f-5f0e-46ce-907b-f17f099ae335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:59.280281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a063a-3199-4db1-8246-f97580eaa14a service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:59.293957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:59.294984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:59.294984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:59.295192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] PATH_INFO: `/v3/users/e3227d0b90434ddeaa606647e92eb2eb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:59.297863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3227d0b90434ddeaa606647e92eb2eb)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:59.299856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:59.381321 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2859/5687] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:59.384431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5331f-5f0e-46ce-907b-f17f099ae335 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:59.415206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2da5331f-5f0e-46ce-907b-f17f099ae335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:59.449391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3227d0b90434ddeaa606647e92eb2eb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:59.466165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5331f-5f0e-46ce-907b-f17f099ae335 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:59.483529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3227d0b90434ddeaa606647e92eb2eb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:59.493829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1eeea-b01f-4219-b369-5b6c67ae987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:59.499210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1eeea-b01f-4219-b369-5b6c67ae987f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:59.500548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1eeea-b01f-4219-b369-5b6c67ae987f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:59.502871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1eeea-b01f-4219-b369-5b6c67ae987f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:59.509966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1eeea-b01f-4219-b369-5b6c67ae987f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:59.519330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d1eeea-b01f-4219-b369-5b6c67ae987f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:59.541419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3227d0b90434ddeaa606647e92eb2eb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:59.558922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3227d0b90434ddeaa606647e92eb2eb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:59.559748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3227d0b90434ddeaa606647e92eb2eb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:43:59.572502 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2829/5688] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:59 2022] DELETE /identity/v3/users/e3227d0b90434ddeaa606647e92eb2eb => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:43:59.576082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:59.583035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:59.595037 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2860/5689] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:43:59 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:59.596617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3056fdf-cfee-49e4-a13f-89ce36d26afc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:59.597158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3056fdf-cfee-49e4-a13f-89ce36d26afc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:59.599332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3056fdf-cfee-49e4-a13f-89ce36d26afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:59.646583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e3056fdf-cfee-49e4-a13f-89ce36d26afc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:43:59.647493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:59.650326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e3056fdf-cfee-49e4-a13f-89ce36d26afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:59.756360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565121-4dca-4aea-9158-fd620ae07cef admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:59.787557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:59.859368 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2861/5690] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:43:59.860439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3056fdf-cfee-49e4-a13f-89ce36d26afc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:59.863180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e3056fdf-cfee-49e4-a13f-89ce36d26afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:43:59.903176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3056fdf-cfee-49e4-a13f-89ce36d26afc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:59.910087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ef3ba-eee8-4260-9a32-79747ee5b0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:59.910759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ef3ba-eee8-4260-9a32-79747ee5b0fb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:59.911042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ef3ba-eee8-4260-9a32-79747ee5b0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:59.911310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ef3ba-eee8-4260-9a32-79747ee5b0fb admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:59.911980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ef3ba-eee8-4260-9a32-79747ee5b0fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:59.921205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ef3ba-eee8-4260-9a32-79747ee5b0fb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:59.934621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:59.935290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:59.935571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:59.935846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] PATH_INFO: `/v3/users/03f2c03d22a54b8099908e47f438d0da` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:59.939365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f2c03d22a54b8099908e47f438d0da)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:59.941429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:43:59.956783 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2862/5691] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:43:59 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:43:59.959041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ef3ba-eee8-4260-9a32-79747ee5b0fb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:43:59.978544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ef3ba-eee8-4260-9a32-79747ee5b0fb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:43:59.985392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516732-c57a-407f-ad56-646fb0234946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:43:59.986656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516732-c57a-407f-ad56-646fb0234946 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:43:59.987188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516732-c57a-407f-ad56-646fb0234946 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:43:59.987794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37516732-c57a-407f-ad56-646fb0234946 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:43:59.988448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37516732-c57a-407f-ad56-646fb0234946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:43:59.988753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37516732-c57a-407f-ad56-646fb0234946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:43:59.990762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37516732-c57a-407f-ad56-646fb0234946 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:00.019004 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2863/5692] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:00.019918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516732-c57a-407f-ad56-646fb0234946 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:00.033606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37516732-c57a-407f-ad56-646fb0234946 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:00.040127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badde793-2f8f-4a26-b914-9706ab5b6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:00.040794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badde793-2f8f-4a26-b914-9706ab5b6fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:00.041067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badde793-2f8f-4a26-b914-9706ab5b6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:00.041335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badde793-2f8f-4a26-b914-9706ab5b6fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:00.042904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badde793-2f8f-4a26-b914-9706ab5b6fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:00.044989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badde793-2f8f-4a26-b914-9706ab5b6fa8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:00.057808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f2c03d22a54b8099908e47f438d0da'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:00.064964 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2864/5693] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:00.069794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badde793-2f8f-4a26-b914-9706ab5b6fa8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:00.074491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f2c03d22a54b8099908e47f438d0da'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:00.106750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badde793-2f8f-4a26-b914-9706ab5b6fa8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:00.108895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f2c03d22a54b8099908e47f438d0da'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:00.119386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a2a39-20fd-49e3-b92c-2fcac899d269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:00.120500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f2c03d22a54b8099908e47f438d0da'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:00.121220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f2c03d22a54b8099908e47f438d0da'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:00.123378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a2a39-20fd-49e3-b92c-2fcac899d269 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:00.123786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a2a39-20fd-49e3-b92c-2fcac899d269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:00.124062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a2a39-20fd-49e3-b92c-2fcac899d269 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:00.129502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a2a39-20fd-49e3-b92c-2fcac899d269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:00.131962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a2a39-20fd-49e3-b92c-2fcac899d269 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:00.133973 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2830/5694] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:43:59 2022] DELETE /identity/v3/users/03f2c03d22a54b8099908e47f438d0da => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:00.138842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:00.142697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:00.243906 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2865/5695] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:00 2022] POST /identity/v3/projects => generated 403 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:00.245306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109fd6e-713a-4e50-ad0f-3a39b4b2555b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:00.245617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109fd6e-713a-4e50-ad0f-3a39b4b2555b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:00.245901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0109fd6e-713a-4e50-ad0f-3a39b4b2555b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:00.288657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:00.297855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0109fd6e-713a-4e50-ad0f-3a39b4b2555b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:00.307743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0109fd6e-713a-4e50-ad0f-3a39b4b2555b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:00.332906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ea4de-6797-4485-85e5-f1abc7412f43 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:00.468555 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2866/5696] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:00.469509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109fd6e-713a-4e50-ad0f-3a39b4b2555b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:00.472058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0109fd6e-713a-4e50-ad0f-3a39b4b2555b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:00.480251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1c38e-1abb-47da-9f37-3fe73f0191a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:00.481128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1c38e-1abb-47da-9f37-3fe73f0191a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:00.481456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1c38e-1abb-47da-9f37-3fe73f0191a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:00.482546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1c38e-1abb-47da-9f37-3fe73f0191a4 admin admin] PATH_INFO: `/v3/projects/6b3df7cd84174283a9b080eb9e91e820/users/b8b87a223dec4c40aa33c77ff8719e3e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:00.502159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0109fd6e-713a-4e50-ad0f-3a39b4b2555b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:00.518321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda859a-62c7-47d5-aa6b-4a4da05b23e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:00.519057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda859a-62c7-47d5-aa6b-4a4da05b23e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:00.519561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda859a-62c7-47d5-aa6b-4a4da05b23e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:00.519561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda859a-62c7-47d5-aa6b-4a4da05b23e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:00.520254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda859a-62c7-47d5-aa6b-4a4da05b23e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:00.532518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda859a-62c7-47d5-aa6b-4a4da05b23e2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:00.545662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1c38e-1abb-47da-9f37-3fe73f0191a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3df7cd84174283a9b080eb9e91e820, user_id=b8b87a223dec4c40aa33c77ff8719e3e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:00.548902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1c38e-1abb-47da-9f37-3fe73f0191a4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:00.583990 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2831/5697] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:00 2022] PUT /identity/v3/projects/6b3df7cd84174283a9b080eb9e91e820/users/b8b87a223dec4c40aa33c77ff8719e3e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:00.586756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1c38e-1abb-47da-9f37-3fe73f0191a4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:00.591543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-32f1c38e-1abb-47da-9f37-3fe73f0191a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:00.603263 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2867/5698] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:00 2022] POST /identity/v3/users => generated 302 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:00.604115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda859a-62c7-47d5-aa6b-4a4da05b23e2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:00.605889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cbda859a-62c7-47d5-aa6b-4a4da05b23e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:00.620774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda859a-62c7-47d5-aa6b-4a4da05b23e2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:00.778079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1c38e-1abb-47da-9f37-3fe73f0191a4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:00.788804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91ece4-e8fc-444c-a042-f73aabbca2e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:00.789446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91ece4-e8fc-444c-a042-f73aabbca2e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:00.789741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91ece4-e8fc-444c-a042-f73aabbca2e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:00.790041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91ece4-e8fc-444c-a042-f73aabbca2e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:00.812302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:00.813531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:00.813821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:00.815631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] PATH_INFO: `/v3/projects/c09c18a3bbb441bbb44e4b80a655d1d9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:00.820496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09c18a3bbb441bbb44e4b80a655d1d9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:00.827718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:00.831887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:00.958735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09c18a3bbb441bbb44e4b80a655d1d9', 'request_id': 'req-08eb3d81-6d85-43d1-a26a-3352daf3c59a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:00.969641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09c18a3bbb441bbb44e4b80a655d1d9', 'request_id': 'req-08eb3d81-6d85-43d1-a26a-3352daf3c59a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:00.990096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09c18a3bbb441bbb44e4b80a655d1d9', 'request_id': 'req-08eb3d81-6d85-43d1-a26a-3352daf3c59a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:01.015118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] The token cache is being invalidate because project c09c18a3bbb441bbb44e4b80a655d1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:01.015583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:01.019670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:01.028657 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2868/5699] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:00 2022] DELETE /identity/v3/projects/c09c18a3bbb441bbb44e4b80a655d1d9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:01.028657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:01.029421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:01.032490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91ece4-e8fc-444c-a042-f73aabbca2e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:01.035074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91ece4-e8fc-444c-a042-f73aabbca2e9 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:01.102096 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2832/5700] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:01.117079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91ece4-e8fc-444c-a042-f73aabbca2e9 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:01.144054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91ece4-e8fc-444c-a042-f73aabbca2e9 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:01.213148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:01.234828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb3d81-6d85-43d1-a26a-3352daf3c59a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:01.256792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357c103-60d9-4466-beb7-624d01d985b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:01.257485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357c103-60d9-4466-beb7-624d01d985b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.257757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357c103-60d9-4466-beb7-624d01d985b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.261179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357c103-60d9-4466-beb7-624d01d985b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.263495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357c103-60d9-4466-beb7-624d01d985b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:01.264705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357c103-60d9-4466-beb7-624d01d985b9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:01.304364 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2869/5701] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:01.305774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740d5f-1b14-4bc4-858f-dba15fc82f30 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.306095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740d5f-1b14-4bc4-858f-dba15fc82f30 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.307794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a740d5f-1b14-4bc4-858f-dba15fc82f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.322628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f0fc6-4bfe-4de0-acec-c53983b0a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:01.325300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f0fc6-4bfe-4de0-acec-c53983b0a106 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.325581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f0fc6-4bfe-4de0-acec-c53983b0a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.325852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f0fc6-4bfe-4de0-acec-c53983b0a106 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.327197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f0fc6-4bfe-4de0-acec-c53983b0a106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:01.328196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f0fc6-4bfe-4de0-acec-c53983b0a106 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:01.352889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6a740d5f-1b14-4bc4-858f-dba15fc82f30 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:01.357438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6a740d5f-1b14-4bc4-858f-dba15fc82f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:01.360875 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2833/5702] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:01.362124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f0fc6-4bfe-4de0-acec-c53983b0a106 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:01.377460 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2870/5703] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:01.378503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f0fc6-4bfe-4de0-acec-c53983b0a106 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:01.379977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740d5f-1b14-4bc4-858f-dba15fc82f30 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:01.385379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6a740d5f-1b14-4bc4-858f-dba15fc82f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:01.386587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639d5ba-5482-44eb-a8a1-be7978281cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:01.387501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639d5ba-5482-44eb-a8a1-be7978281cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.387967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639d5ba-5482-44eb-a8a1-be7978281cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.388423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639d5ba-5482-44eb-a8a1-be7978281cd1 admin admin] PATH_INFO: `/v3/projects/6b3df7cd84174283a9b080eb9e91e820/users/b8b87a223dec4c40aa33c77ff8719e3e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.391573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639d5ba-5482-44eb-a8a1-be7978281cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b3df7cd84174283a9b080eb9e91e820, user_id=b8b87a223dec4c40aa33c77ff8719e3e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:01.396262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639d5ba-5482-44eb-a8a1-be7978281cd1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:01.409891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a740d5f-1b14-4bc4-858f-dba15fc82f30 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:01.421729 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2834/5704] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:01 2022] PUT /identity/v3/projects/6b3df7cd84174283a9b080eb9e91e820/users/b8b87a223dec4c40aa33c77ff8719e3e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:01.433772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2cf1b-61af-44f1-9c77-f78f32b699b8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.434100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2cf1b-61af-44f1-9c77-f78f32b699b8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.434356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2cf1b-61af-44f1-9c77-f78f32b699b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.456689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-19f2cf1b-61af-44f1-9c77-f78f32b699b8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:01.457882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-19f2cf1b-61af-44f1-9c77-f78f32b699b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:01.509374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc8bcc-7894-4ba5-b541-8a9449c3ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:01.511361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc8bcc-7894-4ba5-b541-8a9449c3ebce admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.511800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc8bcc-7894-4ba5-b541-8a9449c3ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.512222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc8bcc-7894-4ba5-b541-8a9449c3ebce admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.513329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc8bcc-7894-4ba5-b541-8a9449c3ebce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:01.519054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc8bcc-7894-4ba5-b541-8a9449c3ebce admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:01.543759 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2871/5705] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:01.546698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf8c42-27d0-4fe1-95c2-731889ac54dd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.547988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf8c42-27d0-4fe1-95c2-731889ac54dd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.548418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf8c42-27d0-4fe1-95c2-731889ac54dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.550614 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2835/5706] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:01.551335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2cf1b-61af-44f1-9c77-f78f32b699b8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:01.568426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2cf1b-61af-44f1-9c77-f78f32b699b8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:01.583530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ded9c6-04ee-4b7c-be9e-5ad338b37240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:01.584660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ded9c6-04ee-4b7c-be9e-5ad338b37240 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.585307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ded9c6-04ee-4b7c-be9e-5ad338b37240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.587148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ded9c6-04ee-4b7c-be9e-5ad338b37240 admin admin] PATH_INFO: `/v3/projects/ab0216627ccf4864a7d88b7118960c68/users/36ccc71c9fc14400893827000275adf4/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.616178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5daf8c42-27d0-4fe1-95c2-731889ac54dd None None] MFA Rules not processed for user `b8b87a223dec4c40aa33c77ff8719e3e`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:01.618701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5daf8c42-27d0-4fe1-95c2-731889ac54dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:01.624320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:01.626139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ded9c6-04ee-4b7c-be9e-5ad338b37240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0216627ccf4864a7d88b7118960c68, user_id=36ccc71c9fc14400893827000275adf4, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:01.632400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ded9c6-04ee-4b7c-be9e-5ad338b37240 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:01.668285 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2836/5707] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:01 2022] PUT /identity/v3/projects/ab0216627ccf4864a7d88b7118960c68/users/36ccc71c9fc14400893827000275adf4/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:01.669404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ded9c6-04ee-4b7c-be9e-5ad338b37240 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:01.744031 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2872/5708] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:01.747962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc498d-f43f-4fc7-973e-dc493306c6b1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.748354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc498d-f43f-4fc7-973e-dc493306c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.748785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc498d-f43f-4fc7-973e-dc493306c6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.781330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ded9c6-04ee-4b7c-be9e-5ad338b37240 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:01.785497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-94dc498d-f43f-4fc7-973e-dc493306c6b1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:01.787186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-94dc498d-f43f-4fc7-973e-dc493306c6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:01.787517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad856-9531-4f74-84c1-0d35f8305df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:01.788491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad856-9531-4f74-84c1-0d35f8305df9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.788808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad856-9531-4f74-84c1-0d35f8305df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.789125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3ad856-9531-4f74-84c1-0d35f8305df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.790150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ad856-9531-4f74-84c1-0d35f8305df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:01.790452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ad856-9531-4f74-84c1-0d35f8305df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:01.792477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3ad856-9531-4f74-84c1-0d35f8305df9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:01.808912 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2873/5709] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:01.810099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc498d-f43f-4fc7-973e-dc493306c6b1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:01.816131 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2837/5710] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:01.820588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad856-9531-4f74-84c1-0d35f8305df9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:01.847676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3ad856-9531-4f74-84c1-0d35f8305df9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:01.855937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d7d1-c367-4692-bf6f-5d624e0d915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:01.856588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d7d1-c367-4692-bf6f-5d624e0d915c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:01.856873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d7d1-c367-4692-bf6f-5d624e0d915c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:01.857149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849d7d1-c367-4692-bf6f-5d624e0d915c admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:01.857816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849d7d1-c367-4692-bf6f-5d624e0d915c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:01.861582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849d7d1-c367-4692-bf6f-5d624e0d915c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:01.899403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:01.921203 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2838/5711] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:01 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:44:01.921203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d7d1-c367-4692-bf6f-5d624e0d915c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:01.924715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6849d7d1-c367-4692-bf6f-5d624e0d915c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:01.958741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc498d-f43f-4fc7-973e-dc493306c6b1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:02.088014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209f203-f7e8-4e02-b7e5-08a8bace7226 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b87a223dec4c40aa33c77ff8719e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b3df7cd84174283a9b080eb9e91e820', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:02.088014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f203-f7e8-4e02-b7e5-08a8bace7226 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:02.088014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f203-f7e8-4e02-b7e5-08a8bace7226 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:02.088942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f203-f7e8-4e02-b7e5-08a8bace7226 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:02.088942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209f203-f7e8-4e02-b7e5-08a8bace7226 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:02.091426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c209f203-f7e8-4e02-b7e5-08a8bace7226 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:02.119686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849d7d1-c367-4692-bf6f-5d624e0d915c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:02.139256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cbea3-c7aa-4fd5-9a6a-88f2da4742ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:02.140352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cbea3-c7aa-4fd5-9a6a-88f2da4742ba service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:02.145580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cbea3-c7aa-4fd5-9a6a-88f2da4742ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:02.146192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cbea3-c7aa-4fd5-9a6a-88f2da4742ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:02.197909 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2874/5712] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:01 2022] POST /identity/v3/projects => generated 359 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:02.199485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209f203-f7e8-4e02-b7e5-08a8bace7226 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:02.245897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:02.329138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209f203-f7e8-4e02-b7e5-08a8bace7226 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:02.345843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443983c-d40d-40a6-8c36-aa1b83ed6233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:02.347527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443983c-d40d-40a6-8c36-aa1b83ed6233 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:02.348867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443983c-d40d-40a6-8c36-aa1b83ed6233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:02.352576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443983c-d40d-40a6-8c36-aa1b83ed6233 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:02.353601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443983c-d40d-40a6-8c36-aa1b83ed6233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:02.358219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443983c-d40d-40a6-8c36-aa1b83ed6233 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:02.363256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cbea3-c7aa-4fd5-9a6a-88f2da4742ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:02.368709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cbea3-c7aa-4fd5-9a6a-88f2da4742ba service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:02.387539 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2839/5713] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:02.398752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cbea3-c7aa-4fd5-9a6a-88f2da4742ba service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:02.431032 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2875/5714] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:02 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:02.432822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443983c-d40d-40a6-8c36-aa1b83ed6233 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:02.440715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cbea3-c7aa-4fd5-9a6a-88f2da4742ba service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:02.455925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443983c-d40d-40a6-8c36-aa1b83ed6233 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:02.465432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f3157-1b5b-4a51-be04-39ac7a45a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:02.469070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3157-1b5b-4a51-be04-39ac7a45a7ef admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:02.469592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3157-1b5b-4a51-be04-39ac7a45a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:02.470523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3157-1b5b-4a51-be04-39ac7a45a7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:02.478514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f3157-1b5b-4a51-be04-39ac7a45a7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:02.486153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f3157-1b5b-4a51-be04-39ac7a45a7ef admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:02.533670 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2876/5715] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:02.534628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f3157-1b5b-4a51-be04-39ac7a45a7ef admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:02.560606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f3157-1b5b-4a51-be04-39ac7a45a7ef admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:02.575935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d492b5-13e4-47cf-bea8-fe43d51cedc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:02.577119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d492b5-13e4-47cf-bea8-fe43d51cedc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:02.577119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d492b5-13e4-47cf-bea8-fe43d51cedc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:02.577119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d492b5-13e4-47cf-bea8-fe43d51cedc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:02.577796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d492b5-13e4-47cf-bea8-fe43d51cedc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:02.579548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d492b5-13e4-47cf-bea8-fe43d51cedc6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:02.648673 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2877/5716] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:02.648908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb534b6-2348-41b3-ba59-ecac765a8af2 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b87a223dec4c40aa33c77ff8719e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b3df7cd84174283a9b080eb9e91e820', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:02.648908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb534b6-2348-41b3-ba59-ecac765a8af2 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:02.648908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb534b6-2348-41b3-ba59-ecac765a8af2 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:02.650090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb534b6-2348-41b3-ba59-ecac765a8af2 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:02.650090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb534b6-2348-41b3-ba59-ecac765a8af2 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:02.650366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d492b5-13e4-47cf-bea8-fe43d51cedc6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:02.651072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb534b6-2348-41b3-ba59-ecac765a8af2 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:02.671688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d492b5-13e4-47cf-bea8-fe43d51cedc6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:02.686004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc6d17-0bf4-44de-a5df-212e4cc806e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:02.687087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc6d17-0bf4-44de-a5df-212e4cc806e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:02.687612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc6d17-0bf4-44de-a5df-212e4cc806e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:02.688342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc6d17-0bf4-44de-a5df-212e4cc806e8 admin admin] PATH_INFO: `/v3/projects/0a010ef424e0473a9acc2f8ab1fee794/users/35d960c681484a5780bdc6be3e7cdfb7/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:02.716404 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2840/5717] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:02 2022] POST /identity/v3/users => generated 373 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:02.720382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb534b6-2348-41b3-ba59-ecac765a8af2 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:02.734349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb534b6-2348-41b3-ba59-ecac765a8af2 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:02.739233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc6d17-0bf4-44de-a5df-212e4cc806e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a010ef424e0473a9acc2f8ab1fee794, user_id=35d960c681484a5780bdc6be3e7cdfb7, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:02.740268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685b92d-9571-463d-acc8-10252f9c635f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b87a223dec4c40aa33c77ff8719e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b3df7cd84174283a9b080eb9e91e820', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:02.741514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685b92d-9571-463d-acc8-10252f9c635f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:02.741786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685b92d-9571-463d-acc8-10252f9c635f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:02.742169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685b92d-9571-463d-acc8-10252f9c635f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:02.742569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc6d17-0bf4-44de-a5df-212e4cc806e8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:02.743033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685b92d-9571-463d-acc8-10252f9c635f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:02.744001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685b92d-9571-463d-acc8-10252f9c635f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:02.746560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685b92d-9571-463d-acc8-10252f9c635f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:02.792862 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2878/5718] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:02 2022] PUT /identity/v3/projects/0a010ef424e0473a9acc2f8ab1fee794/users/35d960c681484a5780bdc6be3e7cdfb7/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:02.796994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14247525-c94a-48e5-be03-e2c04fa7cca7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:02.797378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14247525-c94a-48e5-be03-e2c04fa7cca7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:02.797816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14247525-c94a-48e5-be03-e2c04fa7cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:02.848987 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2841/5719] 10.222.0.43 () {58 vars in 1157 bytes} [Tue Aug 30 04:44:02 2022] GET /identity/v3/users?domain_id=default => generated 7990 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:44:02.855577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685b92d-9571-463d-acc8-10252f9c635f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:02.878240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-14247525-c94a-48e5-be03-e2c04fa7cca7 None None] MFA Rules not processed for user `35d960c681484a5780bdc6be3e7cdfb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:02.880020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-14247525-c94a-48e5-be03-e2c04fa7cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:02.886507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685b92d-9571-463d-acc8-10252f9c635f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:02.957206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:03.050555 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2879/5720] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:03.059341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14247525-c94a-48e5-be03-e2c04fa7cca7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:03.061687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-14247525-c94a-48e5-be03-e2c04fa7cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:03.078569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19cf59-bff7-48a6-baa1-c89506158b42 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b87a223dec4c40aa33c77ff8719e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b3df7cd84174283a9b080eb9e91e820', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:03.090493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19cf59-bff7-48a6-baa1-c89506158b42 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:03.090789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19cf59-bff7-48a6-baa1-c89506158b42 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:03.091073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19cf59-bff7-48a6-baa1-c89506158b42 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] PATH_INFO: `/v3/users/4bcebd1216b44d34b1be88b55eb72a50` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:03.122581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19cf59-bff7-48a6-baa1-c89506158b42 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorizing `identity:update_user(user_id=4bcebd1216b44d34b1be88b55eb72a50)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:03.125424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19cf59-bff7-48a6-baa1-c89506158b42 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:03.193192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ef19cf59-bff7-48a6-baa1-c89506158b42 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '4bcebd1216b44d34b1be88b55eb72a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:03.218123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ef19cf59-bff7-48a6-baa1-c89506158b42 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invalidating the token cache because user 4bcebd1216b44d34b1be88b55eb72a50 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:03.218874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ef19cf59-bff7-48a6-baa1-c89506158b42 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:03.219820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ef19cf59-bff7-48a6-baa1-c89506158b42 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:03.226381 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2842/5721] 10.222.0.43 () {60 vars in 1244 bytes} [Tue Aug 30 04:44:02 2022] PATCH /identity/v3/users/4bcebd1216b44d34b1be88b55eb72a50 => generated 488 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:03.228480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8e48e-4717-4fe0-9915-a992af6ad8c6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:03.228771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8e48e-4717-4fe0-9915-a992af6ad8c6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:03.231450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8e48e-4717-4fe0-9915-a992af6ad8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:03.262043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:03.270416 n-d-820368-36 devstack@keystone.service[82099]: WARNING keystone.auth.plugins.core [None req-fbf8e48e-4717-4fe0-9915-a992af6ad8c6 None None] User is disabled: 4bcebd1216b44d34b1be88b55eb72a50: AssertionError: User is disabled: 4bcebd1216b44d34b1be88b55eb72a50 Aug 30 04:44:03.291910 n-d-820368-36 devstack@keystone.service[82099]: WARNING keystone.server.flask.application [None req-fbf8e48e-4717-4fe0-9915-a992af6ad8c6 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 30 04:44:03.293974 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2843/5722] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:03 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 66 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 30 04:44:03.299218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8e48e-4717-4fe0-9915-a992af6ad8c6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:03.310223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fbf8e48e-4717-4fe0-9915-a992af6ad8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:03.326933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14247525-c94a-48e5-be03-e2c04fa7cca7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:03.342958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85690c-3235-4a53-af60-e95367877854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:03.343840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85690c-3235-4a53-af60-e95367877854 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:03.345337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85690c-3235-4a53-af60-e95367877854 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:03.345733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85690c-3235-4a53-af60-e95367877854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:03.352316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ed85690c-3235-4a53-af60-e95367877854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:03.360875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8e48e-4717-4fe0-9915-a992af6ad8c6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:03.383327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b87a223dec4c40aa33c77ff8719e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b3df7cd84174283a9b080eb9e91e820', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:03.384283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:03.384675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:03.385032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] PATH_INFO: `/v3/users/4bcebd1216b44d34b1be88b55eb72a50` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:03.394062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85690c-3235-4a53-af60-e95367877854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:03.401150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85690c-3235-4a53-af60-e95367877854 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:03.423841 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2880/5723] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:03.424653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4bcebd1216b44d34b1be88b55eb72a50)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:03.426768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:03.559569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bcebd1216b44d34b1be88b55eb72a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:03.595544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bcebd1216b44d34b1be88b55eb72a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:03.675885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bcebd1216b44d34b1be88b55eb72a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:03.684095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85690c-3235-4a53-af60-e95367877854 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:03.690895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ed85690c-3235-4a53-af60-e95367877854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:03.722729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bcebd1216b44d34b1be88b55eb72a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:03.724167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bcebd1216b44d34b1be88b55eb72a50'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:03.752777 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2844/5724] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:03 2022] DELETE /identity/v3/users/4bcebd1216b44d34b1be88b55eb72a50 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:03.758992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:03.761678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:03.917575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85690c-3235-4a53-af60-e95367877854 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:03.924866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:03.975281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632b5c8-bcd6-4f75-8db9-eb231923c111 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:03.995482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b87a223dec4c40aa33c77ff8719e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b3df7cd84174283a9b080eb9e91e820', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:03.996158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:03.996439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:03.996707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] PATH_INFO: `/v3/projects/82b24713a2e54746bbe22f73cfde2dff` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:04.000527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82b24713a2e54746bbe22f73cfde2dff)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:04.003313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:04.080688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:04.081444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:04.082517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:04.082517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] PATH_INFO: `/v3/projects/96a32570747d41538532f1771fac6690` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:04.084513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a32570747d41538532f1771fac6690)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:04.087202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:04.126706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b24713a2e54746bbe22f73cfde2dff', 'request_id': 'req-a619a1d6-ac9b-4342-8190-cbf68115859f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.148977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b24713a2e54746bbe22f73cfde2dff', 'request_id': 'req-a619a1d6-ac9b-4342-8190-cbf68115859f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.164598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b24713a2e54746bbe22f73cfde2dff', 'request_id': 'req-a619a1d6-ac9b-4342-8190-cbf68115859f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.197513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] The token cache is being invalidate because project 82b24713a2e54746bbe22f73cfde2dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:04.197825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.199795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.204123 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2845/5725] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:03 2022] DELETE /identity/v3/projects/82b24713a2e54746bbe22f73cfde2dff => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:04.208710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:04.212277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:04.213240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a32570747d41538532f1771fac6690', 'request_id': 'req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.222656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a32570747d41538532f1771fac6690', 'request_id': 'req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.243531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a32570747d41538532f1771fac6690', 'request_id': 'req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.265637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] The token cache is being invalidate because project 96a32570747d41538532f1771fac6690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:04.267369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.268910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.275598 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2881/5726] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:03 2022] DELETE /identity/v3/projects/96a32570747d41538532f1771fac6690 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:04.277079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:04.278549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:04.340739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:04.482950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8da69-bbec-4dc0-a99f-c05fe56cf931 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:04.512558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70996f93-0f28-4370-9e68-245b683ccf70 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8b87a223dec4c40aa33c77ff8719e3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b3df7cd84174283a9b080eb9e91e820', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:04.515136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619a1d6-ac9b-4342-8190-cbf68115859f tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:04.516429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70996f93-0f28-4370-9e68-245b683ccf70 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:04.516429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70996f93-0f28-4370-9e68-245b683ccf70 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:04.518163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70996f93-0f28-4370-9e68-245b683ccf70 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:04.520753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70996f93-0f28-4370-9e68-245b683ccf70 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:04.524201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70996f93-0f28-4370-9e68-245b683ccf70 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-70996f93-0f28-4370-9e68-245b683ccf70 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Could not find domain: e453ad85689d42c68e5393db49b1a54e.: keystone.exception.DomainNotFound: Could not find domain: e453ad85689d42c68e5393db49b1a54e. Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e453ad85689d42c68e5393db49b1a54e. Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:04.605911 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 30 04:44:04.606923 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:44:04.607790 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:44:04.608648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:44:04.608648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e453ad85689d42c68e5393db49b1a54e. Aug 30 04:44:04.608648 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:04.615047 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2882/5727] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:04 2022] POST /identity/v3/users => generated 112 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:04.615047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70996f93-0f28-4370-9e68-245b683ccf70 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:04.621828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-70996f93-0f28-4370-9e68-245b683ccf70 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:04.740843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:04.741602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:04.741921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:04.742171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] PATH_INFO: `/v3/users/35d960c681484a5780bdc6be3e7cdfb7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:04.747342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d960c681484a5780bdc6be3e7cdfb7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:04.749360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:04.830135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:04.868907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70996f93-0f28-4370-9e68-245b683ccf70 tempest-UsersNegativeTest-716705805 tempest-UsersNegativeTest-716705805-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:04.885632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:04.886655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:04.886932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:04.887209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] PATH_INFO: `/v3/users/a8fb2d88192b4aa999fbebbddb20d2fe` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:04.891111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d960c681484a5780bdc6be3e7cdfb7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.891470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8fb2d88192b4aa999fbebbddb20d2fe)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:04.899103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:04.911710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d960c681484a5780bdc6be3e7cdfb7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.942057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d960c681484a5780bdc6be3e7cdfb7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.965532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d960c681484a5780bdc6be3e7cdfb7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.966217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d960c681484a5780bdc6be3e7cdfb7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:04.973859 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2846/5728] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:04 2022] DELETE /identity/v3/users/35d960c681484a5780bdc6be3e7cdfb7 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:04.974772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:04.976295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:05.051353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8fb2d88192b4aa999fbebbddb20d2fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:05.055292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8fb2d88192b4aa999fbebbddb20d2fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:05.081958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8fb2d88192b4aa999fbebbddb20d2fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:05.101581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8fb2d88192b4aa999fbebbddb20d2fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:05.135965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-75394a40-1250-4a6d-bcc6-bd51f17a207b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8fb2d88192b4aa999fbebbddb20d2fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:05.152623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba8676-b1dc-4b05-ba62-9833d28f45fa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:05.160145 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2883/5729] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:04 2022] DELETE /identity/v3/users/a8fb2d88192b4aa999fbebbddb20d2fe => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:05.165355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb886ae0-abfd-48f5-88e3-9187691e193f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:05.165630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb886ae0-abfd-48f5-88e3-9187691e193f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:05.170755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb886ae0-abfd-48f5-88e3-9187691e193f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:05.231268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bb886ae0-abfd-48f5-88e3-9187691e193f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:05.232412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bb886ae0-abfd-48f5-88e3-9187691e193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:05.361075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:05.362827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:05.367795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:05.368444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:05.368678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] PATH_INFO: `/v3/users/6a67f2a1c5a048d3be7fbb3400c9b192` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:05.376304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a67f2a1c5a048d3be7fbb3400c9b192)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:05.385222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:05.470636 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2884/5730] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:05.539015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a67f2a1c5a048d3be7fbb3400c9b192'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:05.553522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:05.560011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a67f2a1c5a048d3be7fbb3400c9b192'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:05.562486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb886ae0-abfd-48f5-88e3-9187691e193f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:05.565199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bb886ae0-abfd-48f5-88e3-9187691e193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:05.606297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a67f2a1c5a048d3be7fbb3400c9b192'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:05.624007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a67f2a1c5a048d3be7fbb3400c9b192'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:05.625010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c09256e-74ab-4490-9870-be9a7659fc63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a67f2a1c5a048d3be7fbb3400c9b192'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:05.640361 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2847/5731] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:04 2022] DELETE /identity/v3/users/6a67f2a1c5a048d3be7fbb3400c9b192 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:05.646016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446e04-8f3c-483c-a6d5-d361f0d60e9b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:05.646548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446e04-8f3c-483c-a6d5-d361f0d60e9b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:05.647086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446e04-8f3c-483c-a6d5-d361f0d60e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:05.674643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f4446e04-8f3c-483c-a6d5-d361f0d60e9b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:05.676231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f4446e04-8f3c-483c-a6d5-d361f0d60e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:05.713726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb886ae0-abfd-48f5-88e3-9187691e193f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:05.784976 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2848/5732] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:05.840689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0707c-a65e-4389-ac08-e9f916e4a76b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:05.841553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0707c-a65e-4389-ac08-e9f916e4a76b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:05.841925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0707c-a65e-4389-ac08-e9f916e4a76b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:05.842358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0707c-a65e-4389-ac08-e9f916e4a76b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:05.845251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1eb0707c-a65e-4389-ac08-e9f916e4a76b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:05.870069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0707c-a65e-4389-ac08-e9f916e4a76b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:05.872711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0707c-a65e-4389-ac08-e9f916e4a76b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:05.878025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446e04-8f3c-483c-a6d5-d361f0d60e9b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:05.879709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f4446e04-8f3c-483c-a6d5-d361f0d60e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:05.888004 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2885/5733] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:44:05.904255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446e04-8f3c-483c-a6d5-d361f0d60e9b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:05.914464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302845b-13e4-4218-a1a7-15419bb0fd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:05.915267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302845b-13e4-4218-a1a7-15419bb0fd40 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:05.915647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302845b-13e4-4218-a1a7-15419bb0fd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:05.916013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302845b-13e4-4218-a1a7-15419bb0fd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:05.937384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302845b-13e4-4218-a1a7-15419bb0fd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:05.939318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302845b-13e4-4218-a1a7-15419bb0fd40 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:05.968203 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2849/5734] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:44:06.959380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0707c-a65e-4389-ac08-e9f916e4a76b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:06.961931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1eb0707c-a65e-4389-ac08-e9f916e4a76b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:06.999646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0707c-a65e-4389-ac08-e9f916e4a76b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:07.015244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:07.015939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:07.016223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:07.017861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] PATH_INFO: `/v3/projects/0a010ef424e0473a9acc2f8ab1fee794` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:07.021533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a010ef424e0473a9acc2f8ab1fee794)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:07.026229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:07.036034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b89c7-156c-4dbf-9b78-c809623eaf8f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:07.036476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b89c7-156c-4dbf-9b78-c809623eaf8f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:07.036694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b89c7-156c-4dbf-9b78-c809623eaf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:07.094145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-470b89c7-156c-4dbf-9b78-c809623eaf8f None None] MFA Rules not processed for user `36ccc71c9fc14400893827000275adf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:07.095307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-470b89c7-156c-4dbf-9b78-c809623eaf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:07.173275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a010ef424e0473a9acc2f8ab1fee794', 'request_id': 'req-cc2afe15-e878-4732-8a73-faf3c0470f82'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:07.199956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a010ef424e0473a9acc2f8ab1fee794', 'request_id': 'req-cc2afe15-e878-4732-8a73-faf3c0470f82'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:07.215523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a010ef424e0473a9acc2f8ab1fee794', 'request_id': 'req-cc2afe15-e878-4732-8a73-faf3c0470f82'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:07.233635 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2850/5735] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:07.238726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b89c7-156c-4dbf-9b78-c809623eaf8f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:07.240740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-470b89c7-156c-4dbf-9b78-c809623eaf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:07.268931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] The token cache is being invalidate because project 0a010ef424e0473a9acc2f8ab1fee794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:07.274304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:07.275420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc2afe15-e878-4732-8a73-faf3c0470f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:07.280888 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2886/5736] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:06 2022] DELETE /identity/v3/projects/0a010ef424e0473a9acc2f8ab1fee794 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:07.284100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4d5ba-0b60-4e85-9be6-40ada9f59542 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:07.285327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4d5ba-0b60-4e85-9be6-40ada9f59542 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:07.287226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4d5ba-0b60-4e85-9be6-40ada9f59542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:07.300194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b89c7-156c-4dbf-9b78-c809623eaf8f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:07.344343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f5c4d5ba-0b60-4e85-9be6-40ada9f59542 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:07.351444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f5c4d5ba-0b60-4e85-9be6-40ada9f59542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:07.378595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:07.397431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd48b24-3b9c-4165-9160-363d24c7e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:07.398808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd48b24-3b9c-4165-9160-363d24c7e5ba admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:07.399200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd48b24-3b9c-4165-9160-363d24c7e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:07.399938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd48b24-3b9c-4165-9160-363d24c7e5ba admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:07.400829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd48b24-3b9c-4165-9160-363d24c7e5ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:07.404760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd48b24-3b9c-4165-9160-363d24c7e5ba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:07.430498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:07.510582 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2851/5737] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:07 2022] POST /identity/v3/projects => generated 401 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:44:07.515099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd48b24-3b9c-4165-9160-363d24c7e5ba admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:07.518816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2fd48b24-3b9c-4165-9160-363d24c7e5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:07.637986 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2887/5738] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:07.639655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583c0d-a5cb-46bd-bcc4-90ad52c49777 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:07.642173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583c0d-a5cb-46bd-bcc4-90ad52c49777 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:07.642554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583c0d-a5cb-46bd-bcc4-90ad52c49777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:07.660961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd48b24-3b9c-4165-9160-363d24c7e5ba admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:07.688624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65282f9c-4307-443d-9087-1a53f8ccb093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:07.690555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282f9c-4307-443d-9087-1a53f8ccb093 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:07.691365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282f9c-4307-443d-9087-1a53f8ccb093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:07.691655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65282f9c-4307-443d-9087-1a53f8ccb093 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:07.695238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65282f9c-4307-443d-9087-1a53f8ccb093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:07.697295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65282f9c-4307-443d-9087-1a53f8ccb093 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:07.716342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ad583c0d-a5cb-46bd-bcc4-90ad52c49777 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:07.719020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ad583c0d-a5cb-46bd-bcc4-90ad52c49777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:07.753426 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2888/5739] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:07.757255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583c0d-a5cb-46bd-bcc4-90ad52c49777 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:07.769649 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2852/5740] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:07 2022] POST /identity/v3/users => generated 307 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:07.774412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65282f9c-4307-443d-9087-1a53f8ccb093 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:07.792777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583c0d-a5cb-46bd-bcc4-90ad52c49777 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:07.799369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65282f9c-4307-443d-9087-1a53f8ccb093 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:07.812903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37f797-2f32-4222-8157-7cefb96a2db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:07.814247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37f797-2f32-4222-8157-7cefb96a2db1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:07.814635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37f797-2f32-4222-8157-7cefb96a2db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:07.815166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37f797-2f32-4222-8157-7cefb96a2db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:07.816013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54865-21cb-48a7-b313-086a5a1b2c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:07.816669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54865-21cb-48a7-b313-086a5a1b2c21 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:07.816950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54865-21cb-48a7-b313-086a5a1b2c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:07.817220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd54865-21cb-48a7-b313-086a5a1b2c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:07.817403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37f797-2f32-4222-8157-7cefb96a2db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:07.817989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd54865-21cb-48a7-b313-086a5a1b2c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:07.821249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd54865-21cb-48a7-b313-086a5a1b2c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:07.822429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37f797-2f32-4222-8157-7cefb96a2db1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:07.823287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd54865-21cb-48a7-b313-086a5a1b2c21 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:07.840859 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2889/5741] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:07.840859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54865-21cb-48a7-b313-086a5a1b2c21 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:07.843650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5bd54865-21cb-48a7-b313-086a5a1b2c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:07.850801 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2853/5742] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:07.851856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37f797-2f32-4222-8157-7cefb96a2db1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:07.867084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd54865-21cb-48a7-b313-086a5a1b2c21 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:07.873530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:07.874896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:07.875360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:07.875815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] PATH_INFO: `/v3/projects/388b252f311d4a47addfc34920973d91` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:07.875915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37f797-2f32-4222-8157-7cefb96a2db1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:07.877286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=388b252f311d4a47addfc34920973d91)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:07.881298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:07.890561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ceec8-f8c2-43b8-96f7-4fe2b43385cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:07.891281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ceec8-f8c2-43b8-96f7-4fe2b43385cb admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:07.891623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ceec8-f8c2-43b8-96f7-4fe2b43385cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:07.891962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ceec8-f8c2-43b8-96f7-4fe2b43385cb admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:07.892672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ceec8-f8c2-43b8-96f7-4fe2b43385cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:07.895431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ceec8-f8c2-43b8-96f7-4fe2b43385cb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:07.975107 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2854/5743] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:07 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:07.976042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ceec8-f8c2-43b8-96f7-4fe2b43385cb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:08.014716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388b252f311d4a47addfc34920973d91', 'request_id': 'req-195f2563-e1f0-4d70-9b09-c7b8d5406782'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.040229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388b252f311d4a47addfc34920973d91', 'request_id': 'req-195f2563-e1f0-4d70-9b09-c7b8d5406782'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.057993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388b252f311d4a47addfc34920973d91', 'request_id': 'req-195f2563-e1f0-4d70-9b09-c7b8d5406782'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.096635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] The token cache is being invalidate because project 388b252f311d4a47addfc34920973d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:08.097320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.099460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.103653 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2890/5744] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:07 2022] DELETE /identity/v3/projects/388b252f311d4a47addfc34920973d91 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:08.113175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:08.116042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:08.127581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ceec8-f8c2-43b8-96f7-4fe2b43385cb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:08.214326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:08.255023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f2563-e1f0-4d70-9b09-c7b8d5406782 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:08.263233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4853cc-9a0c-46b5-bd7d-bb15d23637f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:08.263919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4853cc-9a0c-46b5-bd7d-bb15d23637f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:08.266322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4853cc-9a0c-46b5-bd7d-bb15d23637f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:08.266640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4853cc-9a0c-46b5-bd7d-bb15d23637f5 admin admin] PATH_INFO: `/v3/projects/87af8592a88442fe884dd458a55e41b7/users/41838f2cb6894eaab49c0db844952367/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:08.268960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af7cb5-dd5a-4548-8891-72d2da7db8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:08.269924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af7cb5-dd5a-4548-8891-72d2da7db8dc admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:08.270199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af7cb5-dd5a-4548-8891-72d2da7db8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:08.270758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af7cb5-dd5a-4548-8891-72d2da7db8dc admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:08.271456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af7cb5-dd5a-4548-8891-72d2da7db8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:08.276268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af7cb5-dd5a-4548-8891-72d2da7db8dc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:08.302684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4853cc-9a0c-46b5-bd7d-bb15d23637f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87af8592a88442fe884dd458a55e41b7, user_id=41838f2cb6894eaab49c0db844952367, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:08.305816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4853cc-9a0c-46b5-bd7d-bb15d23637f5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:08.323250 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2891/5745] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:08 2022] POST /identity/v3/users => generated 294 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:08.324763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af7cb5-dd5a-4548-8891-72d2da7db8dc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:08.326524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-63af7cb5-dd5a-4548-8891-72d2da7db8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:08.334395 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2855/5746] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:07 2022] PUT /identity/v3/projects/87af8592a88442fe884dd458a55e41b7/users/41838f2cb6894eaab49c0db844952367/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:08.343853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4853cc-9a0c-46b5-bd7d-bb15d23637f5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:08.345694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4c4853cc-9a0c-46b5-bd7d-bb15d23637f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:08.349516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:08.436390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af7cb5-dd5a-4548-8891-72d2da7db8dc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:08.457904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4853cc-9a0c-46b5-bd7d-bb15d23637f5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:08.473425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:08.474173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:08.474504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:08.475608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] PATH_INFO: `/v3/users/b8b87a223dec4c40aa33c77ff8719e3e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:08.477665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b87a223dec4c40aa33c77ff8719e3e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:08.479726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:08.549981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecded7c-4c1f-42d2-a893-47b41630a214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:08.551869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecded7c-4c1f-42d2-a893-47b41630a214 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:08.552154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecded7c-4c1f-42d2-a893-47b41630a214 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:08.552428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecded7c-4c1f-42d2-a893-47b41630a214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:08.558250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6ecded7c-4c1f-42d2-a893-47b41630a214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:08.575464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b87a223dec4c40aa33c77ff8719e3e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.587673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecded7c-4c1f-42d2-a893-47b41630a214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:08.590162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecded7c-4c1f-42d2-a893-47b41630a214 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:08.595296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b87a223dec4c40aa33c77ff8719e3e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.622844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b87a223dec4c40aa33c77ff8719e3e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.626770 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2892/5747] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:08.628918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecded7c-4c1f-42d2-a893-47b41630a214 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:08.638425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b87a223dec4c40aa33c77ff8719e3e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.640289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b87a223dec4c40aa33c77ff8719e3e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.653561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecded7c-4c1f-42d2-a893-47b41630a214 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:08.664465 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2856/5748] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:08 2022] DELETE /identity/v3/users/b8b87a223dec4c40aa33c77ff8719e3e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:08.678142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d0eba-d573-425a-bc9e-0c84a7f40f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:08.678851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d0eba-d573-425a-bc9e-0c84a7f40f24 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:08.679200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d0eba-d573-425a-bc9e-0c84a7f40f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:08.679485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d0eba-d573-425a-bc9e-0c84a7f40f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:08.679896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:08.680284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d0eba-d573-425a-bc9e-0c84a7f40f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:08.681934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d0eba-d573-425a-bc9e-0c84a7f40f24 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:08.682655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:08.705345 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2893/5749] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:08.705345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d0eba-d573-425a-bc9e-0c84a7f40f24 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:08.707559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0b2d0eba-d573-425a-bc9e-0c84a7f40f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:08.732812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d0eba-d573-425a-bc9e-0c84a7f40f24 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:08.794981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:08.849894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2389449-1b38-402f-a115-ec3ea04c49b0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:08.855475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fcb24-fae7-4075-81f1-436278dbbc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:08.856215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fcb24-fae7-4075-81f1-436278dbbc41 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:08.856373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fcb24-fae7-4075-81f1-436278dbbc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:08.856644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fcb24-fae7-4075-81f1-436278dbbc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:08.857380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fcb24-fae7-4075-81f1-436278dbbc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:08.857611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:08.858685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:08.859051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fcb24-fae7-4075-81f1-436278dbbc41 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:08.859159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:08.859656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] PATH_INFO: `/v3/projects/72ce9c88df0c44d7a196ee0e94ee8033` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:08.861801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ce9c88df0c44d7a196ee0e94ee8033)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:08.864184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:08.875366 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2857/5750] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:08.876727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fcb24-fae7-4075-81f1-436278dbbc41 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:08.878185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b21fcb24-fae7-4075-81f1-436278dbbc41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:08.893774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fcb24-fae7-4075-81f1-436278dbbc41 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:08.900135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ebea8-7cde-489b-a93d-03b34c85d81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:08.902020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ebea8-7cde-489b-a93d-03b34c85d81a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:08.902505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ebea8-7cde-489b-a93d-03b34c85d81a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:08.902992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ebea8-7cde-489b-a93d-03b34c85d81a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:08.903961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ebea8-7cde-489b-a93d-03b34c85d81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:08.907016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ebea8-7cde-489b-a93d-03b34c85d81a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:08.920743 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2858/5751] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:08.923023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ebea8-7cde-489b-a93d-03b34c85d81a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:08.938722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ebea8-7cde-489b-a93d-03b34c85d81a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:08.948411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ce9c88df0c44d7a196ee0e94ee8033', 'request_id': 'req-53000c69-7b7b-42d5-b31f-a287ed6ac17a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.967510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ce9c88df0c44d7a196ee0e94ee8033', 'request_id': 'req-53000c69-7b7b-42d5-b31f-a287ed6ac17a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.978676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ce9c88df0c44d7a196ee0e94ee8033', 'request_id': 'req-53000c69-7b7b-42d5-b31f-a287ed6ac17a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.983597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:08.993577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] The token cache is being invalidate because project 72ce9c88df0c44d7a196ee0e94ee8033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:08.994021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.995046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:08.998013 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2894/5752] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:08 2022] DELETE /identity/v3/projects/72ce9c88df0c44d7a196ee0e94ee8033 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:08.998894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:09.000364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:09.051288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303ac39-2d77-4c69-b3fa-533008166bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:09.052657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303ac39-2d77-4c69-b3fa-533008166bab admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:09.053014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303ac39-2d77-4c69-b3fa-533008166bab admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:09.053364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303ac39-2d77-4c69-b3fa-533008166bab admin admin] PATH_INFO: `/v3/projects/87af8592a88442fe884dd458a55e41b7/users/41838f2cb6894eaab49c0db844952367/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:09.055906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303ac39-2d77-4c69-b3fa-533008166bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=87af8592a88442fe884dd458a55e41b7, user_id=41838f2cb6894eaab49c0db844952367, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:09.059778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303ac39-2d77-4c69-b3fa-533008166bab admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:09.092385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53000c69-7b7b-42d5-b31f-a287ed6ac17a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:09.102586 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2859/5753] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:08 2022] PUT /identity/v3/projects/87af8592a88442fe884dd458a55e41b7/users/41838f2cb6894eaab49c0db844952367/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:09.104485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c4d82-cfd6-4e42-a61d-b93bd3701a40 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:09.104992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c4d82-cfd6-4e42-a61d-b93bd3701a40 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:09.105670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c4d82-cfd6-4e42-a61d-b93bd3701a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:09.174224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-304c4d82-cfd6-4e42-a61d-b93bd3701a40 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:09.176782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-304c4d82-cfd6-4e42-a61d-b93bd3701a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:09.201623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66394a-eeea-42ea-877a-27361bbba947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:09.204704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66394a-eeea-42ea-877a-27361bbba947 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:09.204999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66394a-eeea-42ea-877a-27361bbba947 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:09.205278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66394a-eeea-42ea-877a-27361bbba947 admin admin] PATH_INFO: `/v3/projects/d969c6e015bd4163b0d6a846f4f45def/users/ded6b941967c4f9683a79efb8c6daaea/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:09.255120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66394a-eeea-42ea-877a-27361bbba947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d969c6e015bd4163b0d6a846f4f45def, user_id=ded6b941967c4f9683a79efb8c6daaea, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:09.263387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66394a-eeea-42ea-877a-27361bbba947 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:09.304910 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2895/5754] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:08 2022] PUT /identity/v3/projects/d969c6e015bd4163b0d6a846f4f45def/users/ded6b941967c4f9683a79efb8c6daaea/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:09.307264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125df576-1a16-4e6f-b082-90fbbb3c0319 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:09.307560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125df576-1a16-4e6f-b082-90fbbb3c0319 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:09.307829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125df576-1a16-4e6f-b082-90fbbb3c0319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:09.325450 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2860/5755] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:09.333509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40422cd-fb70-4d4c-b7fb-f69625b06bc1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:09.333509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40422cd-fb70-4d4c-b7fb-f69625b06bc1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:09.333509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40422cd-fb70-4d4c-b7fb-f69625b06bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:09.356779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b40422cd-fb70-4d4c-b7fb-f69625b06bc1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:09.358120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b40422cd-fb70-4d4c-b7fb-f69625b06bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:09.391676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-125df576-1a16-4e6f-b082-90fbbb3c0319 None None] MFA Rules not processed for user `ded6b941967c4f9683a79efb8c6daaea`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:09.399058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-125df576-1a16-4e6f-b082-90fbbb3c0319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:09.422775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:09.439618 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2861/5756] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:44:09.440628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40422cd-fb70-4d4c-b7fb-f69625b06bc1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:09.454487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40422cd-fb70-4d4c-b7fb-f69625b06bc1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:09.460039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0183fc6-ce94-4bf0-9560-7b40aec4445c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:09.461106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0183fc6-ce94-4bf0-9560-7b40aec4445c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:09.461106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0183fc6-ce94-4bf0-9560-7b40aec4445c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:09.461474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0183fc6-ce94-4bf0-9560-7b40aec4445c admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:09.462408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0183fc6-ce94-4bf0-9560-7b40aec4445c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:09.462839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0183fc6-ce94-4bf0-9560-7b40aec4445c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:09.464546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0183fc6-ce94-4bf0-9560-7b40aec4445c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:09.482555 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2862/5757] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:09.484198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0183fc6-ce94-4bf0-9560-7b40aec4445c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:09.508700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0183fc6-ce94-4bf0-9560-7b40aec4445c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:09.514922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43a7c-caa9-4794-a2f6-90ff17f6b28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:09.516057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43a7c-caa9-4794-a2f6-90ff17f6b28e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:09.516694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43a7c-caa9-4794-a2f6-90ff17f6b28e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:09.517157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43a7c-caa9-4794-a2f6-90ff17f6b28e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:09.518053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43a7c-caa9-4794-a2f6-90ff17f6b28e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:09.520555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43a7c-caa9-4794-a2f6-90ff17f6b28e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:09.585205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2863/5758] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:09 2022] POST /identity/v3/projects => generated 395 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:09.586384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43a7c-caa9-4794-a2f6-90ff17f6b28e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:09.621475 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2896/5759] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:09.626450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125df576-1a16-4e6f-b082-90fbbb3c0319 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:09.646056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125df576-1a16-4e6f-b082-90fbbb3c0319 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:09.660351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:09.753014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43a7c-caa9-4794-a2f6-90ff17f6b28e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:09.758210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2ec3d-879e-462d-bd3e-a7ddfcf45063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:09.758871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2ec3d-879e-462d-bd3e-a7ddfcf45063 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:09.759150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2ec3d-879e-462d-bd3e-a7ddfcf45063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:09.759426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2ec3d-879e-462d-bd3e-a7ddfcf45063 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:09.760073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2ec3d-879e-462d-bd3e-a7ddfcf45063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:09.762141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2ec3d-879e-462d-bd3e-a7ddfcf45063 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:09.810860 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2864/5760] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:09 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:09.814146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2ec3d-879e-462d-bd3e-a7ddfcf45063 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:09.827154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d7061-31e4-41eb-9b90-0b0c30b5bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:09.828306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d7061-31e4-41eb-9b90-0b0c30b5bf31 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:09.828779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d7061-31e4-41eb-9b90-0b0c30b5bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:09.830332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d7061-31e4-41eb-9b90-0b0c30b5bf31 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:09.831361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d7061-31e4-41eb-9b90-0b0c30b5bf31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:09.832882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2ec3d-879e-462d-bd3e-a7ddfcf45063 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:09.839323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d7061-31e4-41eb-9b90-0b0c30b5bf31 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:09.843049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241d7b7-6f7b-49a7-89ca-dfcc0190c6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:09.844538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241d7b7-6f7b-49a7-89ca-dfcc0190c6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:09.844824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241d7b7-6f7b-49a7-89ca-dfcc0190c6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:09.845095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241d7b7-6f7b-49a7-89ca-dfcc0190c6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:09.845762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241d7b7-6f7b-49a7-89ca-dfcc0190c6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:09.850842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241d7b7-6f7b-49a7-89ca-dfcc0190c6f1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:09.885703 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2865/5761] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:09.887386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241d7b7-6f7b-49a7-89ca-dfcc0190c6f1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:09.893064 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2897/5762] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:09 2022] POST /identity/v3/projects => generated 385 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:44:09.897579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d7061-31e4-41eb-9b90-0b0c30b5bf31 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:09.905577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241d7b7-6f7b-49a7-89ca-dfcc0190c6f1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:10.049440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d7061-31e4-41eb-9b90-0b0c30b5bf31 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:10.058335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7099c7-f1fd-4e10-bfce-6f207f7a3aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:10.059390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7099c7-f1fd-4e10-bfce-6f207f7a3aae admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:10.059740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7099c7-f1fd-4e10-bfce-6f207f7a3aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:10.060082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7099c7-f1fd-4e10-bfce-6f207f7a3aae admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:10.061100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7099c7-f1fd-4e10-bfce-6f207f7a3aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:10.063131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7099c7-f1fd-4e10-bfce-6f207f7a3aae admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:10.088168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0f66e-fc84-458a-9ec9-f4370da9d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:10.090882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0f66e-fc84-458a-9ec9-f4370da9d07d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:10.091370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0f66e-fc84-458a-9ec9-f4370da9d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:10.091850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0f66e-fc84-458a-9ec9-f4370da9d07d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:10.093009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0f66e-fc84-458a-9ec9-f4370da9d07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:10.097138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0f66e-fc84-458a-9ec9-f4370da9d07d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:10.124519 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2898/5763] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:09 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:10.128451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7099c7-f1fd-4e10-bfce-6f207f7a3aae admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:10.142350 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2866/5764] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:10.143629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0f66e-fc84-458a-9ec9-f4370da9d07d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:10.164753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7099c7-f1fd-4e10-bfce-6f207f7a3aae admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:10.169175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0f66e-fc84-458a-9ec9-f4370da9d07d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:10.184074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a4f3a-819e-4237-896b-3e4dde47bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:10.184957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d8ba2-25ea-4b1b-9bf7-3ecf3dfc1552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:10.187074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8ba2-25ea-4b1b-9bf7-3ecf3dfc1552 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:10.188218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8ba2-25ea-4b1b-9bf7-3ecf3dfc1552 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:10.188874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a4f3a-819e-4237-896b-3e4dde47bfa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:10.189167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a4f3a-819e-4237-896b-3e4dde47bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:10.189522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a4f3a-819e-4237-896b-3e4dde47bfa9 admin admin] PATH_INFO: `/v3/projects/cf14c8ed4ab242f4a1d2731e09b11f20/users/d4321426143f4680a3f010a943892d39/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:10.189905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8ba2-25ea-4b1b-9bf7-3ecf3dfc1552 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:10.193710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8ba2-25ea-4b1b-9bf7-3ecf3dfc1552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:10.214146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8ba2-25ea-4b1b-9bf7-3ecf3dfc1552 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:10.220262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a4f3a-819e-4237-896b-3e4dde47bfa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf14c8ed4ab242f4a1d2731e09b11f20, user_id=d4321426143f4680a3f010a943892d39, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:10.223750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a4f3a-819e-4237-896b-3e4dde47bfa9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:10.267408 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2867/5765] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:10 2022] PUT /identity/v3/projects/cf14c8ed4ab242f4a1d2731e09b11f20/users/d4321426143f4680a3f010a943892d39/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:10.268332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a4f3a-819e-4237-896b-3e4dde47bfa9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:10.271855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c05a4f3a-819e-4237-896b-3e4dde47bfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:10.285383 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2899/5766] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:10.291520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae44f2-fb58-4227-847a-de235d3f9e20 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:10.292955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae44f2-fb58-4227-847a-de235d3f9e20 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:10.293234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae44f2-fb58-4227-847a-de235d3f9e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:10.303513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:10.371566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1fae44f2-fb58-4227-847a-de235d3f9e20 None None] MFA Rules not processed for user `d4321426143f4680a3f010a943892d39`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:10.372810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1fae44f2-fb58-4227-847a-de235d3f9e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:10.400388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a4f3a-819e-4237-896b-3e4dde47bfa9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:10.415985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbdd78-31fe-4bfc-9602-b4f1c14cd467 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:10.421941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbdd78-31fe-4bfc-9602-b4f1c14cd467 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:10.422372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbdd78-31fe-4bfc-9602-b4f1c14cd467 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:10.422775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbdd78-31fe-4bfc-9602-b4f1c14cd467 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:10.430717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dccbdd78-31fe-4bfc-9602-b4f1c14cd467 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:10.466391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbdd78-31fe-4bfc-9602-b4f1c14cd467 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:10.476918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbdd78-31fe-4bfc-9602-b4f1c14cd467 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:10.513268 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2868/5767] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:10.515441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbdd78-31fe-4bfc-9602-b4f1c14cd467 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:10.557202 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2900/5768] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:10 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:10.558398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae44f2-fb58-4227-847a-de235d3f9e20 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:10.561378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1fae44f2-fb58-4227-847a-de235d3f9e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:10.581937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:10.675609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbdd78-31fe-4bfc-9602-b4f1c14cd467 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:10.693704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad498-7bed-453f-a879-14932af4d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:10.695070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad498-7bed-453f-a879-14932af4d181 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:10.697293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad498-7bed-453f-a879-14932af4d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:10.697616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ad498-7bed-453f-a879-14932af4d181 admin admin] PATH_INFO: `/v3/projects/c21182f2c09f4bc49cdfe1a907413189/users/71cd90d3aac44eacaab5350dbf998fce/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:10.730243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ad498-7bed-453f-a879-14932af4d181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21182f2c09f4bc49cdfe1a907413189, user_id=71cd90d3aac44eacaab5350dbf998fce, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:10.735533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae44f2-fb58-4227-847a-de235d3f9e20 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:10.736972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ad498-7bed-453f-a879-14932af4d181 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:10.747153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:10.748105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:10.748687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:10.748929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] PATH_INFO: `/v3/users/95df76be403a478aa03361450ea1b130` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:10.750333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95df76be403a478aa03361450ea1b130)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:10.754676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:10.764812 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2869/5769] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:10 2022] PUT /identity/v3/projects/c21182f2c09f4bc49cdfe1a907413189/users/71cd90d3aac44eacaab5350dbf998fce/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:10.764812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad498-7bed-453f-a879-14932af4d181 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:10.768754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-693ad498-7bed-453f-a879-14932af4d181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:10.857749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95df76be403a478aa03361450ea1b130'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:10.859412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95df76be403a478aa03361450ea1b130'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:10.878281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95df76be403a478aa03361450ea1b130'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:10.896156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95df76be403a478aa03361450ea1b130'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:10.925339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95df76be403a478aa03361450ea1b130'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:10.930048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ad498-7bed-453f-a879-14932af4d181 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:10.943450 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2901/5770] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:10 2022] DELETE /identity/v3/users/95df76be403a478aa03361450ea1b130 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:10.944878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:10.946502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:10.947888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:10.949338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:10.949818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:10.950275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] PATH_INFO: `/v3/projects/6b3df7cd84174283a9b080eb9e91e820` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:10.953098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b3df7cd84174283a9b080eb9e91e820)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:10.956426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:11.017108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:11.067513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b3df7cd84174283a9b080eb9e91e820', 'request_id': 'req-0d444b50-518c-412c-b885-35a10939c4a6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:11.085940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b3df7cd84174283a9b080eb9e91e820', 'request_id': 'req-0d444b50-518c-412c-b885-35a10939c4a6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:11.097827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b3df7cd84174283a9b080eb9e91e820', 'request_id': 'req-0d444b50-518c-412c-b885-35a10939c4a6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:11.116304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f91225-52a5-461d-916d-b875e4a42221 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:11.130298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] The token cache is being invalidate because project 6b3df7cd84174283a9b080eb9e91e820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:11.132142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:11.134865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:11.146320 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2870/5771] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:10 2022] DELETE /identity/v3/projects/6b3df7cd84174283a9b080eb9e91e820 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:11.146320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:11.146320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:11.248471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:11.312379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b939f5-29dc-47e5-b785-94436504f080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:11.313072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b939f5-29dc-47e5-b785-94436504f080 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:11.313358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b939f5-29dc-47e5-b785-94436504f080 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:11.313632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b939f5-29dc-47e5-b785-94436504f080 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:11.314328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b939f5-29dc-47e5-b785-94436504f080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:11.316853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d444b50-518c-412c-b885-35a10939c4a6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:11.318152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b939f5-29dc-47e5-b785-94436504f080 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:11.324686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c8b8b-b70f-456b-9c91-c6570ae12f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:11.325460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c8b8b-b70f-456b-9c91-c6570ae12f60 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:11.325962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c8b8b-b70f-456b-9c91-c6570ae12f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:11.326633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c8b8b-b70f-456b-9c91-c6570ae12f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:11.327553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c8b8b-b70f-456b-9c91-c6570ae12f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:11.329364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c8b8b-b70f-456b-9c91-c6570ae12f60 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:11.346225 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2871/5772] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:11.346225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57331eb-7dec-43e1-94c0-e79a094e7fd2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:11.346225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57331eb-7dec-43e1-94c0-e79a094e7fd2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:11.346225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57331eb-7dec-43e1-94c0-e79a094e7fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:11.373974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c57331eb-7dec-43e1-94c0-e79a094e7fd2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:11.375755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c57331eb-7dec-43e1-94c0-e79a094e7fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:11.382722 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2902/5773] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:10 2022] POST /identity/v3/projects => generated 397 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:11.386445 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2872/5774] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:11.387626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b939f5-29dc-47e5-b785-94436504f080 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:11.387843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57331eb-7dec-43e1-94c0-e79a094e7fd2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:11.389585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c57331eb-7dec-43e1-94c0-e79a094e7fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:11.406972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57331eb-7dec-43e1-94c0-e79a094e7fd2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:11.538784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dbfb96-2eb1-40b5-b17c-04025a17b5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:11.539868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbfb96-2eb1-40b5-b17c-04025a17b5bb admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:11.540372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbfb96-2eb1-40b5-b17c-04025a17b5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:11.540873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbfb96-2eb1-40b5-b17c-04025a17b5bb admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:11.541794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbfb96-2eb1-40b5-b17c-04025a17b5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:11.547234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dbfb96-2eb1-40b5-b17c-04025a17b5bb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:11.615388 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2873/5775] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:11 2022] POST /identity/v3/users => generated 305 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:11.617802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b939f5-29dc-47e5-b785-94436504f080 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:11.619554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b4b37-654a-4adb-a9ae-53d94c1b1126 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:11.620048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b4b37-654a-4adb-a9ae-53d94c1b1126 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:11.621472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b4b37-654a-4adb-a9ae-53d94c1b1126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:11.631322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2430dc8-ef89-4721-8a11-71dc7392249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:11.633323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2430dc8-ef89-4721-8a11-71dc7392249f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:11.640304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2430dc8-ef89-4721-8a11-71dc7392249f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:11.642332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2430dc8-ef89-4721-8a11-71dc7392249f admin admin] PATH_INFO: `/v3/projects/c21182f2c09f4bc49cdfe1a907413189/users/71cd90d3aac44eacaab5350dbf998fce/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:11.646823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2430dc8-ef89-4721-8a11-71dc7392249f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21182f2c09f4bc49cdfe1a907413189, user_id=71cd90d3aac44eacaab5350dbf998fce, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:11.652239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2430dc8-ef89-4721-8a11-71dc7392249f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:11.668834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-929b4b37-654a-4adb-a9ae-53d94c1b1126 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:11.670532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-929b4b37-654a-4adb-a9ae-53d94c1b1126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:11.677266 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2903/5776] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:11 2022] PUT /identity/v3/projects/c21182f2c09f4bc49cdfe1a907413189/users/71cd90d3aac44eacaab5350dbf998fce/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:11.678917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2430dc8-ef89-4721-8a11-71dc7392249f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:11.695126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a2430dc8-ef89-4721-8a11-71dc7392249f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:11.718179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:11.782245 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2874/5777] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:11.783656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b4b37-654a-4adb-a9ae-53d94c1b1126 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:11.796136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b4b37-654a-4adb-a9ae-53d94c1b1126 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:11.803274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f3ae6-031a-4aac-8868-fcb0050edf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:11.804668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f3ae6-031a-4aac-8868-fcb0050edf75 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:11.805104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f3ae6-031a-4aac-8868-fcb0050edf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:11.805518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f3ae6-031a-4aac-8868-fcb0050edf75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:11.806410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f3ae6-031a-4aac-8868-fcb0050edf75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:11.807044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2430dc8-ef89-4721-8a11-71dc7392249f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:11.809474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f3ae6-031a-4aac-8868-fcb0050edf75 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:11.814728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:11.815571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:11.816591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:11.816591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] PATH_INFO: `/v3/projects/b27172c71ec04eaf8f6362422cab72a1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:11.817954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b27172c71ec04eaf8f6362422cab72a1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:11.821921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:11.828061 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2875/5778] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:11.829911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d680f7b-c0f5-4181-8ff0-d170a75c9da4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:11.830405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d680f7b-c0f5-4181-8ff0-d170a75c9da4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:11.831422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d680f7b-c0f5-4181-8ff0-d170a75c9da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:11.909729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4d680f7b-c0f5-4181-8ff0-d170a75c9da4 None None] MFA Rules not processed for user `71cd90d3aac44eacaab5350dbf998fce`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:11.911665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4d680f7b-c0f5-4181-8ff0-d170a75c9da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:11.928046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b27172c71ec04eaf8f6362422cab72a1', 'request_id': 'req-dac9b684-b66b-40de-a1a7-a739a9feae6a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:11.958645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b27172c71ec04eaf8f6362422cab72a1', 'request_id': 'req-dac9b684-b66b-40de-a1a7-a739a9feae6a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:11.961042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:11.976025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b27172c71ec04eaf8f6362422cab72a1', 'request_id': 'req-dac9b684-b66b-40de-a1a7-a739a9feae6a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:12.007617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] The token cache is being invalidate because project b27172c71ec04eaf8f6362422cab72a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:12.007881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:12.008585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:12.010820 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2904/5779] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:11 2022] DELETE /identity/v3/projects/b27172c71ec04eaf8f6362422cab72a1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:12.010947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:12.012353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:12.030982 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2876/5780] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:12.035371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d680f7b-c0f5-4181-8ff0-d170a75c9da4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:12.036850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4d680f7b-c0f5-4181-8ff0-d170a75c9da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:12.112126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d680f7b-c0f5-4181-8ff0-d170a75c9da4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:12.117465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2cbc16-0d92-4a7e-8262-e822e390fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:12.118651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cbc16-0d92-4a7e-8262-e822e390fe66 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:12.119035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cbc16-0d92-4a7e-8262-e822e390fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:12.119408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2cbc16-0d92-4a7e-8262-e822e390fe66 admin admin] PATH_INFO: `/v3/projects/aabf056637524659b64cf751e75d6fd7/users/795b17750c65472db6ba7b879c59069f/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:12.143250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cbc16-0d92-4a7e-8262-e822e390fe66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabf056637524659b64cf751e75d6fd7, user_id=795b17750c65472db6ba7b879c59069f, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:12.152084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2cbc16-0d92-4a7e-8262-e822e390fe66 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:12.186469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9b684-b66b-40de-a1a7-a739a9feae6a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:12.194102 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2877/5781] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:12 2022] PUT /identity/v3/projects/aabf056637524659b64cf751e75d6fd7/users/795b17750c65472db6ba7b879c59069f/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:12.196292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aea001-7063-44d8-8979-ea7288fb451a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:12.197619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aea001-7063-44d8-8979-ea7288fb451a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:12.197619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aea001-7063-44d8-8979-ea7288fb451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:12.271486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795bf09-0f53-4a6d-8863-726cd4ad8144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:12.272276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795bf09-0f53-4a6d-8863-726cd4ad8144 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:12.272633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795bf09-0f53-4a6d-8863-726cd4ad8144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:12.272931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795bf09-0f53-4a6d-8863-726cd4ad8144 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:12.273351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c6aea001-7063-44d8-8979-ea7288fb451a None None] MFA Rules not processed for user `41838f2cb6894eaab49c0db844952367`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:12.273588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795bf09-0f53-4a6d-8863-726cd4ad8144 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:12.273911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795bf09-0f53-4a6d-8863-726cd4ad8144 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:12.275155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c6aea001-7063-44d8-8979-ea7288fb451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:12.275590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795bf09-0f53-4a6d-8863-726cd4ad8144 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:12.292122 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2905/5782] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:12.292122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263423d-f9de-4c30-9d10-1aca2df41a49 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:12.292122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263423d-f9de-4c30-9d10-1aca2df41a49 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:12.292122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263423d-f9de-4c30-9d10-1aca2df41a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:12.299346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:12.317145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e263423d-f9de-4c30-9d10-1aca2df41a49 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:12.317617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e263423d-f9de-4c30-9d10-1aca2df41a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:12.342667 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2906/5783] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:12.345217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263423d-f9de-4c30-9d10-1aca2df41a49 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:12.414345 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2878/5784] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:12 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:12.416044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aea001-7063-44d8-8979-ea7288fb451a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:12.451414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aea001-7063-44d8-8979-ea7288fb451a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:12.456978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c855dfb-34ec-4faf-b498-4cf605947977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:12.457993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855dfb-34ec-4faf-b498-4cf605947977 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:12.459340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855dfb-34ec-4faf-b498-4cf605947977 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:12.460311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c855dfb-34ec-4faf-b498-4cf605947977 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:12.461225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c855dfb-34ec-4faf-b498-4cf605947977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:12.463128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c855dfb-34ec-4faf-b498-4cf605947977 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:12.476865 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2879/5785] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:12.478144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c855dfb-34ec-4faf-b498-4cf605947977 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:12.506327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c855dfb-34ec-4faf-b498-4cf605947977 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:12.513618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f90f0f-730f-4491-92db-d975f845247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:12.515204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90f0f-730f-4491-92db-d975f845247f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:12.515917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90f0f-730f-4491-92db-d975f845247f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:12.516412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90f0f-730f-4491-92db-d975f845247f admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:12.517594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f90f0f-730f-4491-92db-d975f845247f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:12.521026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f90f0f-730f-4491-92db-d975f845247f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:12.557654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263423d-f9de-4c30-9d10-1aca2df41a49 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:12.575320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109011b-438e-49c8-b39e-bbc8cde8b6ec tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:12.582933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109011b-438e-49c8-b39e-bbc8cde8b6ec tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:12.590178 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2880/5786] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:12 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:12.590178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a372f7-e9fa-4675-bccb-dfa282f904dc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:12.590846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a372f7-e9fa-4675-bccb-dfa282f904dc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:12.591290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a372f7-e9fa-4675-bccb-dfa282f904dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:12.591985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109011b-438e-49c8-b39e-bbc8cde8b6ec tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:12.592912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109011b-438e-49c8-b39e-bbc8cde8b6ec tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:12.594924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109011b-438e-49c8-b39e-bbc8cde8b6ec tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:12.603064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5109011b-438e-49c8-b39e-bbc8cde8b6ec tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:12.641329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-05a372f7-e9fa-4675-bccb-dfa282f904dc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:12.644436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-05a372f7-e9fa-4675-bccb-dfa282f904dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:12.646104 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2907/5787] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:12 2022] POST /identity/v3/services => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:12.647599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109011b-438e-49c8-b39e-bbc8cde8b6ec tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:12.692698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:12.711231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109011b-438e-49c8-b39e-bbc8cde8b6ec tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:12.765671 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2881/5788] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:12 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:12.768516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a372f7-e9fa-4675-bccb-dfa282f904dc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:12.795494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a372f7-e9fa-4675-bccb-dfa282f904dc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:12.803927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d4dd4-30b8-42c1-8d95-7e4c80d45f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:12.804680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d4dd4-30b8-42c1-8d95-7e4c80d45f0e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:12.805317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d4dd4-30b8-42c1-8d95-7e4c80d45f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:12.805601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3d4dd4-30b8-42c1-8d95-7e4c80d45f0e admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:12.807906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d4dd4-30b8-42c1-8d95-7e4c80d45f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:12.814483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3d4dd4-30b8-42c1-8d95-7e4c80d45f0e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:12.873854 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2882/5789] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:12 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:12.888360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d4dd4-30b8-42c1-8d95-7e4c80d45f0e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:12.906369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cea8a-0249-4d39-8855-c4463bc2fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:12.907220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cea8a-0249-4d39-8855-c4463bc2fdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:12.908202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cea8a-0249-4d39-8855-c4463bc2fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:12.909380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cea8a-0249-4d39-8855-c4463bc2fdd8 admin admin] PATH_INFO: `/v3/projects/aabf056637524659b64cf751e75d6fd7/users/795b17750c65472db6ba7b879c59069f/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:12.918069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cea8a-0249-4d39-8855-c4463bc2fdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabf056637524659b64cf751e75d6fd7, user_id=795b17750c65472db6ba7b879c59069f, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:12.922963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cea8a-0249-4d39-8855-c4463bc2fdd8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:12.997195 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2908/5790] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:12 2022] PUT /identity/v3/projects/aabf056637524659b64cf751e75d6fd7/users/795b17750c65472db6ba7b879c59069f/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:13.004839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cea8a-0249-4d39-8855-c4463bc2fdd8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:13.153830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:13.190618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3d4dd4-30b8-42c1-8d95-7e4c80d45f0e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:13.239926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cea8a-0249-4d39-8855-c4463bc2fdd8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:13.261405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83507fe2-53b2-41ed-9aa6-231d77d0dce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:13.262548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83507fe2-53b2-41ed-9aa6-231d77d0dce0 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:13.264256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83507fe2-53b2-41ed-9aa6-231d77d0dce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:13.265099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83507fe2-53b2-41ed-9aa6-231d77d0dce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:13.266194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83507fe2-53b2-41ed-9aa6-231d77d0dce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:13.266782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83507fe2-53b2-41ed-9aa6-231d77d0dce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:13.268881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83507fe2-53b2-41ed-9aa6-231d77d0dce0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:13.314103 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2909/5791] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:13.315851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83507fe2-53b2-41ed-9aa6-231d77d0dce0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:13.329651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83507fe2-53b2-41ed-9aa6-231d77d0dce0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:13.336572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533a5e4-23d2-462d-8c11-1ee4e81201f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:13.337553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a5e4-23d2-462d-8c11-1ee4e81201f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:13.338203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a5e4-23d2-462d-8c11-1ee4e81201f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:13.338686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a5e4-23d2-462d-8c11-1ee4e81201f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:13.339576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533a5e4-23d2-462d-8c11-1ee4e81201f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:13.341471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2533a5e4-23d2-462d-8c11-1ee4e81201f7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:13.355446 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2910/5792] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:13.357294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023ecca-ec0c-4e24-a05d-0dfa937cd710 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:13.357857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023ecca-ec0c-4e24-a05d-0dfa937cd710 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:13.358581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023ecca-ec0c-4e24-a05d-0dfa937cd710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:13.397409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357b92-65df-43a2-8bc1-e1866c40cfe3 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:13.398027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357b92-65df-43a2-8bc1-e1866c40cfe3 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:13.398514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357b92-65df-43a2-8bc1-e1866c40cfe3 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:13.398824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357b92-65df-43a2-8bc1-e1866c40cfe3 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:13.399594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64357b92-65df-43a2-8bc1-e1866c40cfe3 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:13.400655 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-64357b92-65df-43a2-8bc1-e1866c40cfe3 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:13.400655 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:44:13.400655 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:44:13.402606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64357b92-65df-43a2-8bc1-e1866c40cfe3 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:13.423806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d023ecca-ec0c-4e24-a05d-0dfa937cd710 None None] MFA Rules not processed for user `795b17750c65472db6ba7b879c59069f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:13.426647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d023ecca-ec0c-4e24-a05d-0dfa937cd710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-64357b92-65df-43a2-8bc1-e1866c40cfe3 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: On instance['enabled']: Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: On instance['enabled']: Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: 'False' Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise error Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application On instance['enabled']: Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application 'False' Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:13.435816 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 30 04:44:13.437630 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application On instance['enabled']: Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application 'False' Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2883/5793] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Aug 30 04:44:12 2022] POST /identity/v3/endpoints => generated 283 bytes in 563 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 30 04:44:13.438508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357b92-65df-43a2-8bc1-e1866c40cfe3 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:13.477342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357b92-65df-43a2-8bc1-e1866c40cfe3 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:13.494491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a34b-5a6b-4e04-ba22-d6d1357fef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:13.495175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a34b-5a6b-4e04-ba22-d6d1357fef86 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:13.495556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a34b-5a6b-4e04-ba22-d6d1357fef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:13.495913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a34b-5a6b-4e04-ba22-d6d1357fef86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:13.496830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5a34b-5a6b-4e04-ba22-d6d1357fef86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:13.500874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5a34b-5a6b-4e04-ba22-d6d1357fef86 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:13.570233 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2884/5794] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:13 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:13.571082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a34b-5a6b-4e04-ba22-d6d1357fef86 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:13.662617 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2911/5795] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:13 2022] POST /identity/v3/auth/tokens => generated 3475 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:13.664256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023ecca-ec0c-4e24-a05d-0dfa937cd710 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:13.673325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:13.690060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023ecca-ec0c-4e24-a05d-0dfa937cd710 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:13.721742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a34b-5a6b-4e04-ba22-d6d1357fef86 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:13.736934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0223-68f2-4a97-83a4-f1013f7d5f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:13.737734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0223-68f2-4a97-83a4-f1013f7d5f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:13.738276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0223-68f2-4a97-83a4-f1013f7d5f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:13.738618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b0223-68f2-4a97-83a4-f1013f7d5f17 admin admin] PATH_INFO: `/v3/projects/6e39832696bb43df8dc8edc93cf7c7c0/users/f10ec6796fd94fdf99ab6fc4660ca1b4/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:13.769129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b0223-68f2-4a97-83a4-f1013f7d5f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e39832696bb43df8dc8edc93cf7c7c0, user_id=f10ec6796fd94fdf99ab6fc4660ca1b4, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:13.774557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b0223-68f2-4a97-83a4-f1013f7d5f17 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:13.800918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:13.802869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:13.804720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:13.805025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:13.807991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:13.810028 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:13.810028 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:44:13.810028 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:13.811582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: On instance['enabled']: Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: On instance['enabled']: Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: 'True' Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise error Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application On instance['enabled']: Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application 'True' Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:13.823261 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 30 04:44:13.824668 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 30 04:44:13.827153 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 30 04:44:13.827153 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 30 04:44:13.827153 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:13.827153 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:13.827153 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:13.827153 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:13.827153 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application On instance['enabled']: Aug 30 04:44:13.827153 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application 'True' Aug 30 04:44:13.827153 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:13.829987 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2885/5796] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:13 2022] PUT /identity/v3/projects/6e39832696bb43df8dc8edc93cf7c7c0/users/f10ec6796fd94fdf99ab6fc4660ca1b4/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:13.831469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0223-68f2-4a97-83a4-f1013f7d5f17 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:13.836679 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2912/5797] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Aug 30 04:44:13 2022] POST /identity/v3/endpoints => generated 281 bytes in 169 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 30 04:44:13.836679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:13.842512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:14.013176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b0223-68f2-4a97-83a4-f1013f7d5f17 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.026773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52511039-92c2-4484-8dfe-d9eece9ff825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.028451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52511039-92c2-4484-8dfe-d9eece9ff825 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.029469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee594f-2ca2-4424-948c-780e22bd8f6f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.029959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52511039-92c2-4484-8dfe-d9eece9ff825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.031061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52511039-92c2-4484-8dfe-d9eece9ff825 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.033158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52511039-92c2-4484-8dfe-d9eece9ff825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:14.040659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52511039-92c2-4484-8dfe-d9eece9ff825 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:14.082382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:14.110725 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2886/5798] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:13 2022] POST /identity/v3/users => generated 302 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:14.115800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52511039-92c2-4484-8dfe-d9eece9ff825 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:14.148050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52511039-92c2-4484-8dfe-d9eece9ff825 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.182064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f3956-6e70-41cc-97b8-8aa621a0a9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.182710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f3956-6e70-41cc-97b8-8aa621a0a9da admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.182992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f3956-6e70-41cc-97b8-8aa621a0a9da admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.183273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f3956-6e70-41cc-97b8-8aa621a0a9da admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.190524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f3956-6e70-41cc-97b8-8aa621a0a9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:14.192389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f3956-6e70-41cc-97b8-8aa621a0a9da admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:14.212988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44fcc0-d3eb-4896-8229-dcd029c3bff5 tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4321426143f4680a3f010a943892d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14c8ed4ab242f4a1d2731e09b11f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.213984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44fcc0-d3eb-4896-8229-dcd029c3bff5 tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.214371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44fcc0-d3eb-4896-8229-dcd029c3bff5 tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.214789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44fcc0-d3eb-4896-8229-dcd029c3bff5 tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.215599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a44fcc0-d3eb-4896-8229-dcd029c3bff5 tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-1a44fcc0-d3eb-4896-8229-dcd029c3bff5 tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 30 04:44:14.232852 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 30 04:44:14.233821 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 30 04:44:14.233821 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 30 04:44:14.233821 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 30 04:44:14.233821 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 30 04:44:14.233821 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:44:14.233821 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 30 04:44:14.233821 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 30 04:44:14.233821 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:14.242173 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2913/5799] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:44:13 2022] POST /identity/v3/projects => generated 136 bytes in 409 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:14.243600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44fcc0-d3eb-4896-8229-dcd029c3bff5 tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:14.244818 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2887/5800] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:14.247336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f3956-6e70-41cc-97b8-8aa621a0a9da admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:14.267560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f3956-6e70-41cc-97b8-8aa621a0a9da admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.284146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c18599-6057-4da8-b2bc-e3a7d4e478e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.285008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18599-6057-4da8-b2bc-e3a7d4e478e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.285417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18599-6057-4da8-b2bc-e3a7d4e478e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.285809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c18599-6057-4da8-b2bc-e3a7d4e478e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.286645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c18599-6057-4da8-b2bc-e3a7d4e478e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:14.288549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c18599-6057-4da8-b2bc-e3a7d4e478e9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:14.309309 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2888/5801] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:14.323433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c18599-6057-4da8-b2bc-e3a7d4e478e9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:14.343575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c18599-6057-4da8-b2bc-e3a7d4e478e9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.354764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dadd9d-9f7d-4124-bfd2-723494623897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.355756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadd9d-9f7d-4124-bfd2-723494623897 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.356039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadd9d-9f7d-4124-bfd2-723494623897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.356316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadd9d-9f7d-4124-bfd2-723494623897 admin admin] PATH_INFO: `/v3/projects/6e39832696bb43df8dc8edc93cf7c7c0/users/f10ec6796fd94fdf99ab6fc4660ca1b4/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.361298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dadd9d-9f7d-4124-bfd2-723494623897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e39832696bb43df8dc8edc93cf7c7c0, user_id=f10ec6796fd94fdf99ab6fc4660ca1b4, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:14.366406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dadd9d-9f7d-4124-bfd2-723494623897 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:14.404127 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2889/5802] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:14 2022] PUT /identity/v3/projects/6e39832696bb43df8dc8edc93cf7c7c0/users/f10ec6796fd94fdf99ab6fc4660ca1b4/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:14.414435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dadd9d-9f7d-4124-bfd2-723494623897 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:14.421806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:14.431005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a44fcc0-d3eb-4896-8229-dcd029c3bff5 tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.558744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dadd9d-9f7d-4124-bfd2-723494623897 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.564701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c9103-5295-4d47-9178-a89111f1d5cd tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.565758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9103-5295-4d47-9178-a89111f1d5cd tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.566186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9103-5295-4d47-9178-a89111f1d5cd tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.566568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9103-5295-4d47-9178-a89111f1d5cd tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.567537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c9103-5295-4d47-9178-a89111f1d5cd tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:14.571941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae599eb-c452-443a-8c59-daed55bd262d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795b17750c65472db6ba7b879c59069f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aabf056637524659b64cf751e75d6fd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.573270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae599eb-c452-443a-8c59-daed55bd262d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.573911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c9103-5295-4d47-9178-a89111f1d5cd tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:14.578348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae599eb-c452-443a-8c59-daed55bd262d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.578858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae599eb-c452-443a-8c59-daed55bd262d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.588986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae599eb-c452-443a-8c59-daed55bd262d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:14.596607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae599eb-c452-443a-8c59-daed55bd262d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6ae599eb-c452-443a-8c59-daed55bd262d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Invalid input for field 'name': '' is too short Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: Failed validating 'minLength' in schema['properties']['name']: Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: On instance['name']: Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: Failed validating 'minLength' in schema['properties']['name']: Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: On instance['name']: Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: '' Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise error Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application On instance['name']: Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application '' Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.630573 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 30 04:44:14.632429 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 30 04:44:14.633378 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 30 04:44:14.633378 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 30 04:44:14.633378 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.633378 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 30 04:44:14.633378 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:44:14.633378 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.633378 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application On instance['name']: Aug 30 04:44:14.633378 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application '' Aug 30 04:44:14.633378 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.633826 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2890/5803] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:44:14 2022] POST /identity/v3/projects => generated 283 bytes in 229 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 30 04:44:14.637146 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-c96c9103-5295-4d47-9178-a89111f1d5cd tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2038877915. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:14.637146 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:14.637146 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:14.638963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae599eb-c452-443a-8c59-daed55bd262d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:14.714904 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2914/5804] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Aug 30 04:44:14 2022] POST /identity/v3/endpoints => generated 361 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:14.716339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc3f41-4209-4109-9210-43c3c675ab71 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.718848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc3f41-4209-4109-9210-43c3c675ab71 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.719492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc3f41-4209-4109-9210-43c3c675ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.782854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-68fc3f41-4209-4109-9210-43c3c675ab71 None None] MFA Rules not processed for user `f10ec6796fd94fdf99ab6fc4660ca1b4`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:14.783668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae599eb-c452-443a-8c59-daed55bd262d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.784288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-68fc3f41-4209-4109-9210-43c3c675ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:14.807627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8df91-5ebe-4762-97c4-4f6f6b39382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.808254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8df91-5ebe-4762-97c4-4f6f6b39382e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.808533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8df91-5ebe-4762-97c4-4f6f6b39382e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.809108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8df91-5ebe-4762-97c4-4f6f6b39382e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.809597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8df91-5ebe-4762-97c4-4f6f6b39382e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:14.811777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8df91-5ebe-4762-97c4-4f6f6b39382e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:14.847408 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2891/5805] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:14.850544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8df91-5ebe-4762-97c4-4f6f6b39382e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:14.899418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8df91-5ebe-4762-97c4-4f6f6b39382e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.907601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbe7ee-7fdb-44ab-9021-1eb573842252 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795b17750c65472db6ba7b879c59069f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aabf056637524659b64cf751e75d6fd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.908346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbe7ee-7fdb-44ab-9021-1eb573842252 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.908630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbe7ee-7fdb-44ab-9021-1eb573842252 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.908904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbe7ee-7fdb-44ab-9021-1eb573842252 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.909538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbe7ee-7fdb-44ab-9021-1eb573842252 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:14.911812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbe7ee-7fdb-44ab-9021-1eb573842252 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-d8cbe7ee-7fdb-44ab-9021-1eb573842252 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: Failed validating 'maxLength' in schema['properties']['name']: Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: On instance['name']: Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: Failed validating 'maxLength' in schema['properties']['name']: Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: On instance['name']: Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise error Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 30 04:44:14.920150 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application On instance['name']: Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:14.921261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application On instance['name']: Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:14.922195 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2892/5806] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:44:14 2022] POST /identity/v3/projects => generated 412 bytes in 71 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 30 04:44:14.922899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbe7ee-7fdb-44ab-9021-1eb573842252 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:14.936488 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2915/5807] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:14 2022] POST /identity/v3/auth/tokens => generated 3654 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:14.936488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc3f41-4209-4109-9210-43c3c675ab71 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:14.962375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc3f41-4209-4109-9210-43c3c675ab71 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.970142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1369538-3e5b-4506-be27-3881b79e369b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.970142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1369538-3e5b-4506-be27-3881b79e369b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.970142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1369538-3e5b-4506-be27-3881b79e369b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.970498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1369538-3e5b-4506-be27-3881b79e369b admin admin] PATH_INFO: `/v3/projects/6b5c02e4bc204e8e87907146849ede5d/users/90adb21c6d414c8da657da46b5a663cf/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.971288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbe7ee-7fdb-44ab-9021-1eb573842252 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:14.978237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c07f53-5218-4df1-acda-749951c7d82f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:14.978956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c07f53-5218-4df1-acda-749951c7d82f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:14.979232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c07f53-5218-4df1-acda-749951c7d82f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:14.979509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c07f53-5218-4df1-acda-749951c7d82f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/regions/tempest-region-2038877915` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:14.980146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c07f53-5218-4df1-acda-749951c7d82f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2038877915)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:14.981409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c07f53-5218-4df1-acda-749951c7d82f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:14.983630 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2893/5808] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Aug 30 04:44:14 2022] GET /identity/v3/regions/tempest-region-2038877915 => generated 180 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:14.984510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c07f53-5218-4df1-acda-749951c7d82f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:14.988448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c0c07f53-5218-4df1-acda-749951c7d82f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:15.000411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1369538-3e5b-4506-be27-3881b79e369b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5c02e4bc204e8e87907146849ede5d, user_id=90adb21c6d414c8da657da46b5a663cf, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:15.004809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1369538-3e5b-4506-be27-3881b79e369b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:15.008656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c07f53-5218-4df1-acda-749951c7d82f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:15.014667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:15.015158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:15.015466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:15.015707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] PATH_INFO: `/v3/users/36ccc71c9fc14400893827000275adf4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:15.018590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ccc71c9fc14400893827000275adf4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:15.020923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:15.050243 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2916/5809] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:14 2022] PUT /identity/v3/projects/6b5c02e4bc204e8e87907146849ede5d/users/90adb21c6d414c8da657da46b5a663cf/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:15.050243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1369538-3e5b-4506-be27-3881b79e369b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:15.050509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:15.112647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ccc71c9fc14400893827000275adf4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:15.123649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ccc71c9fc14400893827000275adf4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:15.157675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:15.163031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ccc71c9fc14400893827000275adf4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:15.180790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ccc71c9fc14400893827000275adf4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:15.181470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ccc71c9fc14400893827000275adf4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:15.197736 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2894/5810] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:14 2022] DELETE /identity/v3/users/36ccc71c9fc14400893827000275adf4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:15.198123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:15.208402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:15.209491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1369538-3e5b-4506-be27-3881b79e369b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:15.374243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2295b-e4fa-4ac7-a07d-fe10cf75c60d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795b17750c65472db6ba7b879c59069f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aabf056637524659b64cf751e75d6fd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:15.376786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2295b-e4fa-4ac7-a07d-fe10cf75c60d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:15.378571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2295b-e4fa-4ac7-a07d-fe10cf75c60d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:15.380573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2295b-e4fa-4ac7-a07d-fe10cf75c60d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] PATH_INFO: `/v3/projects/a88cd29a17024cdb813aa6cf04cda032` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:15.394223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2295b-e4fa-4ac7-a07d-fe10cf75c60d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a88cd29a17024cdb813aa6cf04cda032)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:15.397096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2295b-e4fa-4ac7-a07d-fe10cf75c60d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-4ca2295b-e4fa-4ac7-a07d-fe10cf75c60d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Could not find project: a88cd29a17024cdb813aa6cf04cda032.: keystone.exception.ProjectNotFound: Could not find project: a88cd29a17024cdb813aa6cf04cda032. Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 30 04:44:15.427690 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 30 04:44:15.429162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:15.429162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:15.429162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 30 04:44:15.429162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 30 04:44:15.429162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:44:15.429162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:44:15.429162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:44:15.429162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:44:15.429162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a88cd29a17024cdb813aa6cf04cda032. Aug 30 04:44:15.429162 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:15.434297 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2917/5811] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:15 2022] DELETE /identity/v3/projects/a88cd29a17024cdb813aa6cf04cda032 => generated 113 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:15.435395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2295b-e4fa-4ac7-a07d-fe10cf75c60d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:15.437538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ca2295b-e4fa-4ac7-a07d-fe10cf75c60d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:15.449971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29357-f20a-41c1-ba43-d6118615391d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:15.470306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc0dfe-e9c4-4f0e-9402-f568e1ba4e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:15.470952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc0dfe-e9c4-4f0e-9402-f568e1ba4e28 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:15.471375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc0dfe-e9c4-4f0e-9402-f568e1ba4e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:15.472440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc0dfe-e9c4-4f0e-9402-f568e1ba4e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:15.473133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc0dfe-e9c4-4f0e-9402-f568e1ba4e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:15.475963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc0dfe-e9c4-4f0e-9402-f568e1ba4e28 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:15.546825 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2895/5812] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:15 2022] POST /identity/v3/projects => generated 393 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:15.548516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db2df-0dc4-4d32-87f4-508b3fe9466b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:15.548976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db2df-0dc4-4d32-87f4-508b3fe9466b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:15.549419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db2df-0dc4-4d32-87f4-508b3fe9466b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:15.582750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2295b-e4fa-4ac7-a07d-fe10cf75c60d tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:15.601222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ed4db2df-0dc4-4d32-87f4-508b3fe9466b None None] MFA Rules not processed for user `90adb21c6d414c8da657da46b5a663cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:15.602580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ed4db2df-0dc4-4d32-87f4-508b3fe9466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:15.662182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:15.662947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:15.663343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:15.663621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/endpoints/0fed1fd8e8be4f39a339a6f1e5855353` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:15.672080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=0fed1fd8e8be4f39a339a6f1e5855353)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:15.673132 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:15.673132 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:44:15.673132 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:15.674080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: On instance['enabled']: Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: On instance['enabled']: Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: 'False' Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise error Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application On instance['enabled']: Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application 'False' Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:15.682686 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 30 04:44:15.684249 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 30 04:44:15.685373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 30 04:44:15.685373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 30 04:44:15.685373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:15.685373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:15.685373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:15.685373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:15.685373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application On instance['enabled']: Aug 30 04:44:15.685373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application 'False' Aug 30 04:44:15.685373 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:15.689370 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2918/5813] 10.222.0.43 () {60 vars in 1255 bytes} [Tue Aug 30 04:44:15 2022] PATCH /identity/v3/endpoints/0fed1fd8e8be4f39a339a6f1e5855353 => generated 283 bytes in 253 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 30 04:44:15.689370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:15.690499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:15.716433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:15.768643 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2896/5814] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:15 2022] POST /identity/v3/auth/tokens => generated 3597 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:15.768643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4db2df-0dc4-4d32-87f4-508b3fe9466b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:15.769816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ed4db2df-0dc4-4d32-87f4-508b3fe9466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:15.777865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97410810-20e8-4776-85d7-db8e3c83537f tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:15.783058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555d16f-6fc9-487c-9a2d-4e97a487550d tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4321426143f4680a3f010a943892d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf14c8ed4ab242f4a1d2731e09b11f20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:15.783700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555d16f-6fc9-487c-9a2d-4e97a487550d tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:15.783978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555d16f-6fc9-487c-9a2d-4e97a487550d tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:15.784250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555d16f-6fc9-487c-9a2d-4e97a487550d tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:15.784906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555d16f-6fc9-487c-9a2d-4e97a487550d tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:15.786473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-c555d16f-6fc9-487c-9a2d-4e97a487550d tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 30 04:44:15.791456 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._list_projects() Aug 30 04:44:15.792324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 30 04:44:15.792324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 30 04:44:15.792324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 30 04:44:15.792324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 30 04:44:15.792324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 30 04:44:15.792324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 30 04:44:15.792324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:44:15.792324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 30 04:44:15.792324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 30 04:44:15.792324 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:15.792836 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2919/5815] 10.222.0.43 () {58 vars in 1131 bytes} [Tue Aug 30 04:44:15 2022] GET /identity/v3/projects => generated 135 bytes in 104 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:15.793786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555d16f-6fc9-487c-9a2d-4e97a487550d tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:15.898345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4db2df-0dc4-4d32-87f4-508b3fe9466b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:15.905350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:15.905599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555d16f-6fc9-487c-9a2d-4e97a487550d tempest-ProjectsNegativeStaticTestJSON-568943693 tempest-ProjectsNegativeStaticTestJSON-568943693-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:15.906615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:15.907036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:15.907472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] PATH_INFO: `/v3/projects/ab0216627ccf4864a7d88b7118960c68` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:15.908812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0216627ccf4864a7d88b7118960c68)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:15.910488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba56d5-1f62-4e70-9f5f-0efda2c5b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:15.911175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba56d5-1f62-4e70-9f5f-0efda2c5b680 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:15.911811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:15.912038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba56d5-1f62-4e70-9f5f-0efda2c5b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:15.912450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba56d5-1f62-4e70-9f5f-0efda2c5b680 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:15.913315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba56d5-1f62-4e70-9f5f-0efda2c5b680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:15.915661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba56d5-1f62-4e70-9f5f-0efda2c5b680 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:15.947987 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2920/5816] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:15 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:15.947987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba56d5-1f62-4e70-9f5f-0efda2c5b680 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:15.963070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba56d5-1f62-4e70-9f5f-0efda2c5b680 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:15.973710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0216627ccf4864a7d88b7118960c68', 'request_id': 'req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:15.986061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0216627ccf4864a7d88b7118960c68', 'request_id': 'req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:15.995723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0216627ccf4864a7d88b7118960c68', 'request_id': 'req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:16.010576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] The token cache is being invalidate because project ab0216627ccf4864a7d88b7118960c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:16.011349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:16.012396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:16.014596 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2897/5817] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:15 2022] DELETE /identity/v3/projects/ab0216627ccf4864a7d88b7118960c68 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:16.015784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:16.017491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:16.041292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:16.042144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:16.042428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:16.042702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/endpoints/0fed1fd8e8be4f39a339a6f1e5855353` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:16.044078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=0fed1fd8e8be4f39a339a6f1e5855353)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:16.045651 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:16.045651 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:44:16.045651 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:16.046618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:16.060688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '0fed1fd8e8be4f39a339a6f1e5855353', 'request_id': 'req-98fb7338-c8bf-42e4-807a-033f39316d74'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:16.087119 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2921/5818] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:15 2022] DELETE /identity/v3/endpoints/0fed1fd8e8be4f39a339a6f1e5855353 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:16.087119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:16.091404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:16.104542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e27679-e29e-44cd-9d72-5178f2ff0ee1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:16.129198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc141a5d-0f17-4e0b-ba5f-9934c53669a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:16.130037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc141a5d-0f17-4e0b-ba5f-9934c53669a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:16.130429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc141a5d-0f17-4e0b-ba5f-9934c53669a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:16.130987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc141a5d-0f17-4e0b-ba5f-9934c53669a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:16.131666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc141a5d-0f17-4e0b-ba5f-9934c53669a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:16.133846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc141a5d-0f17-4e0b-ba5f-9934c53669a7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:16.151673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:16.182593 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2898/5819] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:16 2022] POST /identity/v3/projects => generated 401 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:16.191034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc141a5d-0f17-4e0b-ba5f-9934c53669a7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:16.198862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cc141a5d-0f17-4e0b-ba5f-9934c53669a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:16.234917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb7338-c8bf-42e4-807a-033f39316d74 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:16.245278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:16.324402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4747a2-7102-4cd8-8da7-e9a77cd3d0ab tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795b17750c65472db6ba7b879c59069f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aabf056637524659b64cf751e75d6fd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:16.325106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4747a2-7102-4cd8-8da7-e9a77cd3d0ab tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:16.325639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4747a2-7102-4cd8-8da7-e9a77cd3d0ab tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:16.325964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4747a2-7102-4cd8-8da7-e9a77cd3d0ab tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:16.327401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4747a2-7102-4cd8-8da7-e9a77cd3d0ab tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:16.330023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4747a2-7102-4cd8-8da7-e9a77cd3d0ab tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:16.331719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc141a5d-0f17-4e0b-ba5f-9934c53669a7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:16.336726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed02b-482d-4bbc-83fb-6045ecf642c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:16.337069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed02b-482d-4bbc-83fb-6045ecf642c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:16.337403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed02b-482d-4bbc-83fb-6045ecf642c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:16.337610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ed02b-482d-4bbc-83fb-6045ecf642c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:16.338306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed02b-482d-4bbc-83fb-6045ecf642c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:16.340210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ed02b-482d-4bbc-83fb-6045ecf642c7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:16.356792 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2899/5820] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:16.357776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed02b-482d-4bbc-83fb-6045ecf642c7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:16.366411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a06ed02b-482d-4bbc-83fb-6045ecf642c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:16.379135 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2922/5821] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:16 2022] POST /identity/v3/projects => generated 357 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:16.382579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4747a2-7102-4cd8-8da7-e9a77cd3d0ab tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:16.387299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9f4747a2-7102-4cd8-8da7-e9a77cd3d0ab tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:16.388837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ed02b-482d-4bbc-83fb-6045ecf642c7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:16.480259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:16.481292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:16.482345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:16.482850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] PATH_INFO: `/v3/users/41838f2cb6894eaab49c0db844952367` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:16.484161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=41838f2cb6894eaab49c0db844952367)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:16.486353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:16.574424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41838f2cb6894eaab49c0db844952367'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:16.591136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41838f2cb6894eaab49c0db844952367'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:16.593399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4747a2-7102-4cd8-8da7-e9a77cd3d0ab tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:16.601720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b8894-6799-48e9-a55e-778f43a78b55 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:16.603297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b8894-6799-48e9-a55e-778f43a78b55 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:16.603914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b8894-6799-48e9-a55e-778f43a78b55 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:16.604685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b8894-6799-48e9-a55e-778f43a78b55 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/regions/tempest-region-2038877915` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:16.605794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b8894-6799-48e9-a55e-778f43a78b55 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2038877915)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:16.612694 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-1c5b8894-6799-48e9-a55e-778f43a78b55 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:16.612694 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:44:16.612694 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:16.614571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b8894-6799-48e9-a55e-778f43a78b55 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:16.624468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41838f2cb6894eaab49c0db844952367'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:16.640289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41838f2cb6894eaab49c0db844952367'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:16.642251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41838f2cb6894eaab49c0db844952367'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:16.655740 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2923/5822] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Aug 30 04:44:16 2022] DELETE /identity/v3/regions/tempest-region-2038877915 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:16.656887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b8894-6799-48e9-a55e-778f43a78b55 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:16.659190 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2900/5823] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:16 2022] DELETE /identity/v3/users/41838f2cb6894eaab49c0db844952367 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:16.659340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1c5b8894-6799-48e9-a55e-778f43a78b55 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:16.664962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:16.672158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:16.708421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b8894-6799-48e9-a55e-778f43a78b55 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:16.720857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:16.761310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:16.805663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb347f-21ba-44a0-81b2-f6b15718b0cb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:16.819064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a24fb-1ae7-4502-9ab0-1363dfc0b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:16.819815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a24fb-1ae7-4502-9ab0-1363dfc0b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:16.820942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a24fb-1ae7-4502-9ab0-1363dfc0b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:16.820942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a24fb-1ae7-4502-9ab0-1363dfc0b4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:16.821164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a24fb-1ae7-4502-9ab0-1363dfc0b4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:16.823996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a24fb-1ae7-4502-9ab0-1363dfc0b4e4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:16.831366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79b486-0565-477c-b163-036affec0553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:16.832109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b486-0565-477c-b163-036affec0553 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:16.832457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b486-0565-477c-b163-036affec0553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:16.832846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b486-0565-477c-b163-036affec0553 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:16.833609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79b486-0565-477c-b163-036affec0553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:16.837352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79b486-0565-477c-b163-036affec0553 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:16.850155 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2901/5824] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:16.850841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a24fb-1ae7-4502-9ab0-1363dfc0b4e4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:16.853475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3c9a24fb-1ae7-4502-9ab0-1363dfc0b4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:16.889462 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2924/5825] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:16 2022] POST /identity/v3/users => generated 307 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:16.893333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79b486-0565-477c-b163-036affec0553 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:16.897988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ee79b486-0565-477c-b163-036affec0553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:17.035653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a24fb-1ae7-4502-9ab0-1363dfc0b4e4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:17.046282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8b692-97fb-423c-9f10-a8aff2b61f10 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795b17750c65472db6ba7b879c59069f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aabf056637524659b64cf751e75d6fd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:17.047182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8b692-97fb-423c-9f10-a8aff2b61f10 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:17.048688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8b692-97fb-423c-9f10-a8aff2b61f10 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:17.049140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8b692-97fb-423c-9f10-a8aff2b61f10 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:17.050573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8b692-97fb-423c-9f10-a8aff2b61f10 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:17.053299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8b692-97fb-423c-9f10-a8aff2b61f10 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:17.079007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.sql.core [None req-66f8b692-97fb-423c-9f10-a8aff2b61f10 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-793528953' for key 'project.ixu_project_name_domain_id'") Aug 30 04:44:17.079007 n-d-820368-36 devstack@keystone.service[82099]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 04:44:17.079007 n-d-820368-36 devstack@keystone.service[82099]: [parameters: {'id': '0b6d179178104f71815e74d9877752b0', 'name': 'tempest-project-dup-793528953', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 04:44:17.079007 n-d-820368-36 devstack@keystone.service[82099]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82099) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:44:17.101212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79b486-0565-477c-b163-036affec0553 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-66f8b692-97fb-423c-9f10-a8aff2b61f10 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-793528953, project id 0b6d179178104f71815e74d9877752b0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-793528953, project id 0b6d179178104f71815e74d9877752b0. Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:44:17.107793 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application result.read() Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-793528953' for key 'project.ixu_project_name_domain_id'") Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:44:17.108732 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application yield resource Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise self.value Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:44:17.110047 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application session.commit() Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:44:17.111153 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:44:17.112383 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application result.read() Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:44:17.113346 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-793528953' for key 'project.ixu_project_name_domain_id'") Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [parameters: {'id': '0b6d179178104f71815e74d9877752b0', 'name': 'tempest-project-dup-793528953', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:17.114478 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-793528953 at domain ID default. Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:17.115504 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:17.116528 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:17.116528 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 04:44:17.116528 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 04:44:17.116528 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:17.116528 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:17.116528 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 04:44:17.116528 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 04:44:17.116528 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-793528953, project id 0b6d179178104f71815e74d9877752b0. Aug 30 04:44:17.116528 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:17.116528 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2902/5826] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:44:16 2022] POST /identity/v3/projects => generated 284 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:44:17.119409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8b692-97fb-423c-9f10-a8aff2b61f10 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:17.119854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ecbe-4e97-478a-953a-0bad6509ad59 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:17.120733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ecbe-4e97-478a-953a-0bad6509ad59 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:17.121170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ecbe-4e97-478a-953a-0bad6509ad59 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:17.121574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044ecbe-4e97-478a-953a-0bad6509ad59 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:17.123274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044ecbe-4e97-478a-953a-0bad6509ad59 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:17.126007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044ecbe-4e97-478a-953a-0bad6509ad59 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:17.141778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8b692-97fb-423c-9f10-a8aff2b61f10 tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:17.152926 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-0044ecbe-4e97-478a-953a-0bad6509ad59 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1057964765. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:17.152926 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:17.152926 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:17.153313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730a83f-593b-4f6a-a4f9-7d9af839b3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:17.154104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730a83f-593b-4f6a-a4f9-7d9af839b3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:17.154538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730a83f-593b-4f6a-a4f9-7d9af839b3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:17.154908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730a83f-593b-4f6a-a4f9-7d9af839b3c6 admin admin] PATH_INFO: `/v3/projects/9466bc630896416bab28cb1c6deb1e63/users/0238f5d61b6d4349a22e76092243ce97/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:17.205634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730a83f-593b-4f6a-a4f9-7d9af839b3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9466bc630896416bab28cb1c6deb1e63, user_id=0238f5d61b6d4349a22e76092243ce97, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:17.215353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730a83f-593b-4f6a-a4f9-7d9af839b3c6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:17.218850 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2925/5827] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Aug 30 04:44:16 2022] POST /identity/v3/endpoints => generated 361 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:17.219868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ecbe-4e97-478a-953a-0bad6509ad59 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:17.278885 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2903/5828] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:17 2022] PUT /identity/v3/projects/9466bc630896416bab28cb1c6deb1e63/users/0238f5d61b6d4349a22e76092243ce97/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:17.280067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730a83f-593b-4f6a-a4f9-7d9af839b3c6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:17.283536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f730a83f-593b-4f6a-a4f9-7d9af839b3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:17.289029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044ecbe-4e97-478a-953a-0bad6509ad59 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:17.397934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730a83f-593b-4f6a-a4f9-7d9af839b3c6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:17.410605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:17.411264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:17.412143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:17.412427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] PATH_INFO: `/v3/projects/87af8592a88442fe884dd458a55e41b7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:17.413719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87af8592a88442fe884dd458a55e41b7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:17.415930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:17.425907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4f43c-e6a8-451b-8c6b-9c609735dad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:17.426715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4f43c-e6a8-451b-8c6b-9c609735dad7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:17.427101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4f43c-e6a8-451b-8c6b-9c609735dad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:17.427525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4f43c-e6a8-451b-8c6b-9c609735dad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:17.428302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4f43c-e6a8-451b-8c6b-9c609735dad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:17.430326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4f43c-e6a8-451b-8c6b-9c609735dad7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:17.470330 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2926/5829] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:17.472231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4f43c-e6a8-451b-8c6b-9c609735dad7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:17.492427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:17.494537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:17.549187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87af8592a88442fe884dd458a55e41b7', 'request_id': 'req-3f0f6def-c0ae-413b-92d2-b6937dfa7615'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:17.569578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87af8592a88442fe884dd458a55e41b7', 'request_id': 'req-3f0f6def-c0ae-413b-92d2-b6937dfa7615'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:17.587402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87af8592a88442fe884dd458a55e41b7', 'request_id': 'req-3f0f6def-c0ae-413b-92d2-b6937dfa7615'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:17.610009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] The token cache is being invalidate because project 87af8592a88442fe884dd458a55e41b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:17.610401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:17.611426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:17.620265 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2904/5830] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:17 2022] DELETE /identity/v3/projects/87af8592a88442fe884dd458a55e41b7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:17.622665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:17.624570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:17.633282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4f43c-e6a8-451b-8c6b-9c609735dad7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:17.754775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '795b17750c65472db6ba7b879c59069f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aabf056637524659b64cf751e75d6fd7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:17.760198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:17.761082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:17.761775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] PATH_INFO: `/v3/projects/9c33f1e1afbb4f2ba0e313dd3f17f72d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:17.771629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c33f1e1afbb4f2ba0e313dd3f17f72d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:17.771629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:17.828390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f6def-c0ae-413b-92d2-b6937dfa7615 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:17.835954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81401bc6-02f3-4f61-ace1-6bef03eb1d2e tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:17.837037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401bc6-02f3-4f61-ace1-6bef03eb1d2e tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:17.837455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401bc6-02f3-4f61-ace1-6bef03eb1d2e tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:17.837777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81401bc6-02f3-4f61-ace1-6bef03eb1d2e tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/regions/tempest-region-1057964765` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:17.838725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81401bc6-02f3-4f61-ace1-6bef03eb1d2e tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1057964765)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:17.840639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81401bc6-02f3-4f61-ace1-6bef03eb1d2e tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:17.849196 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2905/5831] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Aug 30 04:44:17 2022] GET /identity/v3/regions/tempest-region-1057964765 => generated 180 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:17.859797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10667191-5ff1-4fbc-9ac7-efba281caf3c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:17.859982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10667191-5ff1-4fbc-9ac7-efba281caf3c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:17.865388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10667191-5ff1-4fbc-9ac7-efba281caf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:17.901981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c33f1e1afbb4f2ba0e313dd3f17f72d', 'request_id': 'req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:17.914892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c33f1e1afbb4f2ba0e313dd3f17f72d', 'request_id': 'req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:17.934225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c33f1e1afbb4f2ba0e313dd3f17f72d', 'request_id': 'req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:17.944197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-10667191-5ff1-4fbc-9ac7-efba281caf3c None None] MFA Rules not processed for user `0238f5d61b6d4349a22e76092243ce97`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:17.950173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-10667191-5ff1-4fbc-9ac7-efba281caf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:17.976008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] The token cache is being invalidate because project 9c33f1e1afbb4f2ba0e313dd3f17f72d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:17.976512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:17.978283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:17.985947 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2927/5832] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:17 2022] DELETE /identity/v3/projects/9c33f1e1afbb4f2ba0e313dd3f17f72d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:17.987061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:17.988660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.063618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:18.078073 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2906/5833] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3587 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:18.079472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b67e8-cf11-47c0-a102-ed031a8dc27e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.079831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b67e8-cf11-47c0-a102-ed031a8dc27e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.080087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b67e8-cf11-47c0-a102-ed031a8dc27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.111522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ef2b67e8-cf11-47c0-a102-ed031a8dc27e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:18.112744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ef2b67e8-cf11-47c0-a102-ed031a8dc27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.122903 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2907/5834] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:18 2022] POST /identity/v3/auth/tokens => generated 3556 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:18.123906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b67e8-cf11-47c0-a102-ed031a8dc27e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:18.125473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ef2b67e8-cf11-47c0-a102-ed031a8dc27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.140105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea64b8-3e1d-49e8-9451-8cacc6dd8d3b tempest-ProjectsNegativeStaticTestJSON-2142143526 tempest-ProjectsNegativeStaticTestJSON-2142143526-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:18.147130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824461a4-c726-436b-9dae-8f306b4612c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:18.147877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824461a4-c726-436b-9dae-8f306b4612c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.148202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824461a4-c726-436b-9dae-8f306b4612c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.148530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824461a4-c726-436b-9dae-8f306b4612c7 admin admin] PATH_INFO: `/v3/projects/9a872e7af0b64c1bae98c0f8c496f7e5/users/4d07999367784cba8e5ca224b8ea17f4/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.183480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824461a4-c726-436b-9dae-8f306b4612c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a872e7af0b64c1bae98c0f8c496f7e5, user_id=4d07999367784cba8e5ca224b8ea17f4, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:18.187901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824461a4-c726-436b-9dae-8f306b4612c7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:18.198171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:18.216408 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2928/5835] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:17 2022] PUT /identity/v3/projects/9a872e7af0b64c1bae98c0f8c496f7e5/users/4d07999367784cba8e5ca224b8ea17f4/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:18.217510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824461a4-c726-436b-9dae-8f306b4612c7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:18.233596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-824461a4-c726-436b-9dae-8f306b4612c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.283302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b67e8-cf11-47c0-a102-ed031a8dc27e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:18.370718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:18.371404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.371685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.371958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/endpoints/164c6663afce4a8d935982c18eeaa075` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.378845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824461a4-c726-436b-9dae-8f306b4612c7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:18.380949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=164c6663afce4a8d935982c18eeaa075)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:18.382276 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:18.382276 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:44:18.382276 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:44:18.383567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:18.385328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:18.386645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.386922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.387195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] PATH_INFO: `/v3/users/d4321426143f4680a3f010a943892d39` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.388709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4321426143f4680a3f010a943892d39)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:18.391184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: On instance['enabled']: Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: On instance['enabled']: Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: 'True' Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise error Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application On instance['enabled']: Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application 'True' Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:18.391719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 30 04:44:18.393015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application On instance['enabled']: Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application 'True' Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2908/5836] 10.222.0.43 () {60 vars in 1255 bytes} [Tue Aug 30 04:44:18 2022] PATCH /identity/v3/endpoints/164c6663afce4a8d935982c18eeaa075 => generated 281 bytes in 270 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 30 04:44:18.394443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:18.398396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.478656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4321426143f4680a3f010a943892d39'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:18.479994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4321426143f4680a3f010a943892d39'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:18.492147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4321426143f4680a3f010a943892d39'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:18.510354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4321426143f4680a3f010a943892d39'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:18.531415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-039c5cf8-b112-42ab-9162-caed43525f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4321426143f4680a3f010a943892d39'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:18.543407 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2929/5837] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:18 2022] DELETE /identity/v3/users/d4321426143f4680a3f010a943892d39 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:18.543579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be1fcd-95bd-453a-9abd-2f808624c6ff tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:18.544901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959ec8-fb62-40f3-8995-fad59f32152b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.545311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959ec8-fb62-40f3-8995-fad59f32152b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.545651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb959ec8-fb62-40f3-8995-fad59f32152b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.571649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-eb959ec8-fb62-40f3-8995-fad59f32152b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:18.573018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eb959ec8-fb62-40f3-8995-fad59f32152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.604858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79974dc0-2dd4-4bd6-9fc7-6a2d05d26a89 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:18.605492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79974dc0-2dd4-4bd6-9fc7-6a2d05d26a89 service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.605772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79974dc0-2dd4-4bd6-9fc7-6a2d05d26a89 service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.606070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79974dc0-2dd4-4bd6-9fc7-6a2d05d26a89 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.608505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-79974dc0-2dd4-4bd6-9fc7-6a2d05d26a89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.630622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:18.650398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:18.694089 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2930/5838] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:18 2022] POST /identity/v3/auth/tokens => generated 3556 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:18.695126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb959ec8-fb62-40f3-8995-fad59f32152b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:18.696477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eb959ec8-fb62-40f3-8995-fad59f32152b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.703368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79974dc0-2dd4-4bd6-9fc7-6a2d05d26a89 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:18.705324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79974dc0-2dd4-4bd6-9fc7-6a2d05d26a89 service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:18.716005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb959ec8-fb62-40f3-8995-fad59f32152b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:18.723599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0653b-afef-4ec3-9918-57f02d2bdbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:18.725111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0653b-afef-4ec3-9918-57f02d2bdbef admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.725926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0653b-afef-4ec3-9918-57f02d2bdbef admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.725926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0653b-afef-4ec3-9918-57f02d2bdbef admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.726349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0653b-afef-4ec3-9918-57f02d2bdbef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:18.728728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0653b-afef-4ec3-9918-57f02d2bdbef admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:18.734106 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2909/5839] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:18 2022] GET /identity/v3/auth/tokens => generated 3654 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:18.735206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79974dc0-2dd4-4bd6-9fc7-6a2d05d26a89 service glance] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:18.737536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-79974dc0-2dd4-4bd6-9fc7-6a2d05d26a89 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.742281 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2931/5840] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:18.744166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e52be-7bea-49fe-95b5-733cd041051b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.744532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e52be-7bea-49fe-95b5-733cd041051b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.744810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e52be-7bea-49fe-95b5-733cd041051b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.772972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-577e52be-7bea-49fe-95b5-733cd041051b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:18.776266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-577e52be-7bea-49fe-95b5-733cd041051b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.794099 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2932/5841] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:18 2022] POST /identity/v3/auth/tokens => generated 3556 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:18.795097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e52be-7bea-49fe-95b5-733cd041051b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:18.817055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e52be-7bea-49fe-95b5-733cd041051b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:18.830589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ff21c-ba1b-4efc-89e3-be75d4ccc6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:18.832666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ff21c-ba1b-4efc-89e3-be75d4ccc6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.833551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ff21c-ba1b-4efc-89e3-be75d4ccc6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.836516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ff21c-ba1b-4efc-89e3-be75d4ccc6b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.836516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ff21c-ba1b-4efc-89e3-be75d4ccc6b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:18.836516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ff21c-ba1b-4efc-89e3-be75d4ccc6b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:18.838366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ff21c-ba1b-4efc-89e3-be75d4ccc6b5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:18.867402 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2933/5842] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:18.868906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ff21c-ba1b-4efc-89e3-be75d4ccc6b5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:18.871216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79974dc0-2dd4-4bd6-9fc7-6a2d05d26a89 service glance] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:18.886278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:18.887082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.887368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.887642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/endpoints/164c6663afce4a8d935982c18eeaa075` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.888960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=164c6663afce4a8d935982c18eeaa075)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:18.890045 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:18.890045 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:44:18.890045 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:44:18.890918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:18.894774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ff21c-ba1b-4efc-89e3-be75d4ccc6b5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:18.903113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0c866-afdf-4ad4-b6c5-ae05fc2fdfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:18.903812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0c866-afdf-4ad4-b6c5-ae05fc2fdfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:18.904076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0c866-afdf-4ad4-b6c5-ae05fc2fdfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:18.904386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0c866-afdf-4ad4-b6c5-ae05fc2fdfc1 admin admin] PATH_INFO: `/v3/projects/9a872e7af0b64c1bae98c0f8c496f7e5/users/4d07999367784cba8e5ca224b8ea17f4/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:18.906748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0c866-afdf-4ad4-b6c5-ae05fc2fdfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a872e7af0b64c1bae98c0f8c496f7e5, user_id=4d07999367784cba8e5ca224b8ea17f4, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:18.909619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '164c6663afce4a8d935982c18eeaa075', 'request_id': 'req-b8478280-68e7-408b-8126-9cc76131fb00'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:18.918361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0c866-afdf-4ad4-b6c5-ae05fc2fdfc1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:18.925841 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2910/5843] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:18 2022] DELETE /identity/v3/endpoints/164c6663afce4a8d935982c18eeaa075 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:18.926827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:18.931878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:18.945173 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2934/5844] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:18 2022] PUT /identity/v3/projects/9a872e7af0b64c1bae98c0f8c496f7e5/users/4d07999367784cba8e5ca224b8ea17f4/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:18.955779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0c866-afdf-4ad4-b6c5-ae05fc2fdfc1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:19.081889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478280-68e7-408b-8126-9cc76131fb00 tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:19.082503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0c866-afdf-4ad4-b6c5-ae05fc2fdfc1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:19.107601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60cddd-1459-4c7b-8376-8b25761ac2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:19.108255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60cddd-1459-4c7b-8376-8b25761ac2fe admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:19.108608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60cddd-1459-4c7b-8376-8b25761ac2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:19.108947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60cddd-1459-4c7b-8376-8b25761ac2fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:19.109813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60cddd-1459-4c7b-8376-8b25761ac2fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:19.112971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60cddd-1459-4c7b-8376-8b25761ac2fe admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:19.141821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:19.154633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af246d6-d8d1-4823-9afb-3a3e90d932eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:19.155613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af246d6-d8d1-4823-9afb-3a3e90d932eb service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:19.156580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af246d6-d8d1-4823-9afb-3a3e90d932eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:19.157037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af246d6-d8d1-4823-9afb-3a3e90d932eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:19.163619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2935/5845] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:18 2022] POST /identity/v3/projects => generated 371 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:19.165340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60cddd-1459-4c7b-8376-8b25761ac2fe admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:19.189325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af246d6-d8d1-4823-9afb-3a3e90d932eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:19.194575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af246d6-d8d1-4823-9afb-3a3e90d932eb service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:19.219404 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2911/5846] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:18 2022] GET /identity/v3/auth/tokens => generated 3373 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:19.220789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456292d-c680-4c80-a5d6-da9a814f5479 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:19.221251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456292d-c680-4c80-a5d6-da9a814f5479 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:19.221624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456292d-c680-4c80-a5d6-da9a814f5479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:19.270882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a456292d-c680-4c80-a5d6-da9a814f5479 None None] MFA Rules not processed for user `4d07999367784cba8e5ca224b8ea17f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:19.273964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a456292d-c680-4c80-a5d6-da9a814f5479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:19.364263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60cddd-1459-4c7b-8376-8b25761ac2fe admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:19.378374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597b193-bcd1-4abd-842c-0ba7e242eaae tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:19.378374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b193-bcd1-4abd-842c-0ba7e242eaae tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:19.378374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b193-bcd1-4abd-842c-0ba7e242eaae tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:19.378787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597b193-bcd1-4abd-842c-0ba7e242eaae tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/regions/tempest-region-1057964765` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:19.379267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597b193-bcd1-4abd-842c-0ba7e242eaae tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1057964765)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:19.386034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597b193-bcd1-4abd-842c-0ba7e242eaae tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:19.389535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:19.422338 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2936/5847] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Aug 30 04:44:19 2022] DELETE /identity/v3/regions/tempest-region-1057964765 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:19.426724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597b193-bcd1-4abd-842c-0ba7e242eaae tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:19.478492 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2912/5848] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:19 2022] POST /identity/v3/auth/tokens => generated 3479 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:19.481738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456292d-c680-4c80-a5d6-da9a814f5479 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:19.522565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456292d-c680-4c80-a5d6-da9a814f5479 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:19.539241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e59e8-8e92-4e97-85f8-be4a518bdc9b tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71cd90d3aac44eacaab5350dbf998fce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c21182f2c09f4bc49cdfe1a907413189', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:19.541339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e59e8-8e92-4e97-85f8-be4a518bdc9b tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:19.544276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e59e8-8e92-4e97-85f8-be4a518bdc9b tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:19.544756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e59e8-8e92-4e97-85f8-be4a518bdc9b tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] PATH_INFO: `/v3/services/7b505c4b80e74d5992c368a4afe769dc` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:19.546298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e59e8-8e92-4e97-85f8-be4a518bdc9b tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorizing `identity:delete_service(service_id=7b505c4b80e74d5992c368a4afe769dc)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:19.548641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e59e8-8e92-4e97-85f8-be4a518bdc9b tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:19.606358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597b193-bcd1-4abd-842c-0ba7e242eaae tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:19.613175 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2913/5849] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:19 2022] DELETE /identity/v3/services/7b505c4b80e74d5992c368a4afe769dc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:19.614149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e59e8-8e92-4e97-85f8-be4a518bdc9b tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:19.651171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e59e8-8e92-4e97-85f8-be4a518bdc9b tempest-EndpointsNegativeTestJSON-921233649 tempest-EndpointsNegativeTestJSON-921233649-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:19.657695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81531442-10c0-432b-8499-e29a54038425 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d07999367784cba8e5ca224b8ea17f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a872e7af0b64c1bae98c0f8c496f7e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:19.658697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81531442-10c0-432b-8499-e29a54038425 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:19.659217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81531442-10c0-432b-8499-e29a54038425 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:19.659712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81531442-10c0-432b-8499-e29a54038425 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:19.661157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81531442-10c0-432b-8499-e29a54038425 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:19.663432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81531442-10c0-432b-8499-e29a54038425 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:19.671152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13556585-3273-47ee-a75f-12993943ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:19.672115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13556585-3273-47ee-a75f-12993943ff24 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:19.672643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13556585-3273-47ee-a75f-12993943ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:19.673162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13556585-3273-47ee-a75f-12993943ff24 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:19.674368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13556585-3273-47ee-a75f-12993943ff24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:19.676756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13556585-3273-47ee-a75f-12993943ff24 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:19.705580 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2914/5850] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:44:19 2022] POST /identity/v3/roles => generated 239 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:19.708406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81531442-10c0-432b-8499-e29a54038425 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:19.713095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-81531442-10c0-432b-8499-e29a54038425 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:19.713447 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2937/5851] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:19 2022] POST /identity/v3/users => generated 286 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:19.715350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13556585-3273-47ee-a75f-12993943ff24 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:19.734717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13556585-3273-47ee-a75f-12993943ff24 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:19.738265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81531442-10c0-432b-8499-e29a54038425 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:19.745643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:19.746832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:19.746981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:19.747310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] PATH_INFO: `/v3/users/ded6b941967c4f9683a79efb8c6daaea` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:19.747580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43912825-59b6-4adb-9789-12f33f65edef tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d07999367784cba8e5ca224b8ea17f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a872e7af0b64c1bae98c0f8c496f7e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:19.748363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43912825-59b6-4adb-9789-12f33f65edef tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:19.748751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43912825-59b6-4adb-9789-12f33f65edef tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:19.748872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded6b941967c4f9683a79efb8c6daaea)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:19.749138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43912825-59b6-4adb-9789-12f33f65edef tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] PATH_INFO: `/v3/projects/6b5c02e4bc204e8e87907146849ede5d/users/90adb21c6d414c8da657da46b5a663cf/roles/bf3693e244074e209e10f7daf684c2d3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:19.751610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:19.752372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43912825-59b6-4adb-9789-12f33f65edef tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6b5c02e4bc204e8e87907146849ede5d, user_id=90adb21c6d414c8da657da46b5a663cf, role_id=bf3693e244074e209e10f7daf684c2d3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:19.756925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43912825-59b6-4adb-9789-12f33f65edef tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:19.788270 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2938/5852] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:19 2022] PUT /identity/v3/projects/6b5c02e4bc204e8e87907146849ede5d/users/90adb21c6d414c8da657da46b5a663cf/roles/bf3693e244074e209e10f7daf684c2d3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:19.788270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43912825-59b6-4adb-9789-12f33f65edef tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:19.853463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded6b941967c4f9683a79efb8c6daaea'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:19.875606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded6b941967c4f9683a79efb8c6daaea'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:19.937729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded6b941967c4f9683a79efb8c6daaea'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:19.943215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:19.953650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded6b941967c4f9683a79efb8c6daaea'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:19.955882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded6b941967c4f9683a79efb8c6daaea'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:19.967149 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2915/5853] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:19 2022] DELETE /identity/v3/users/ded6b941967c4f9683a79efb8c6daaea => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:19.971801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:19.975298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:19.983559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43912825-59b6-4adb-9789-12f33f65edef tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:20.106332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:20.147577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cd782-4209-4f45-bd09-beca6fe9285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:20.149008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cd782-4209-4f45-bd09-beca6fe9285e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:20.149343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cd782-4209-4f45-bd09-beca6fe9285e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:20.149634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cd782-4209-4f45-bd09-beca6fe9285e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:20.150333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cd782-4209-4f45-bd09-beca6fe9285e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:20.152935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cd782-4209-4f45-bd09-beca6fe9285e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:20.182031 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2939/5854] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:19 2022] GET /identity/v3/roles => generated 1650 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:20.186009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02865b8-6351-4304-b65d-18d6f0c495e4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:20.188246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cd782-4209-4f45-bd09-beca6fe9285e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:20.194284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822314e-2424-4f2d-8725-5253549161eb tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90adb21c6d414c8da657da46b5a663cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b5c02e4bc204e8e87907146849ede5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-366279109'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:20.194765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3a2cd782-4209-4f45-bd09-beca6fe9285e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:20.195214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822314e-2424-4f2d-8725-5253549161eb tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:20.195588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822314e-2424-4f2d-8725-5253549161eb tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:20.195957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822314e-2424-4f2d-8725-5253549161eb tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] PATH_INFO: `/v3/users/90adb21c6d414c8da657da46b5a663cf/application_credentials` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:20.196747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822314e-2424-4f2d-8725-5253549161eb tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] RBAC: Authorizing `identity:create_application_credential(user_id=90adb21c6d414c8da657da46b5a663cf)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:20.198054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822314e-2424-4f2d-8725-5253549161eb tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:20.213709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cd782-4209-4f45-bd09-beca6fe9285e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:20.228274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:20.228938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:20.229218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:20.229486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] PATH_INFO: `/v3/projects/cf14c8ed4ab242f4a1d2731e09b11f20` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:20.233479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf14c8ed4ab242f4a1d2731e09b11f20)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:20.238282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:20.337194 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2916/5855] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Aug 30 04:44:19 2022] POST /identity/v3/users/90adb21c6d414c8da657da46b5a663cf/application_credentials => generated 658 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:20.338737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d9c6-0649-4b44-b0c6-c6582a8d3452 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:20.339024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d9c6-0649-4b44-b0c6-c6582a8d3452 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:20.339365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147d9c6-0649-4b44-b0c6-c6582a8d3452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:20.370130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a147d9c6-0649-4b44-b0c6-c6582a8d3452 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:20.371679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a147d9c6-0649-4b44-b0c6-c6582a8d3452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:20.403518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf14c8ed4ab242f4a1d2731e09b11f20', 'request_id': 'req-e497b56f-32df-4a7d-857f-6be6c6861924'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:20.414829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf14c8ed4ab242f4a1d2731e09b11f20', 'request_id': 'req-e497b56f-32df-4a7d-857f-6be6c6861924'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:20.438699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf14c8ed4ab242f4a1d2731e09b11f20', 'request_id': 'req-e497b56f-32df-4a7d-857f-6be6c6861924'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:20.484417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] The token cache is being invalidate because project cf14c8ed4ab242f4a1d2731e09b11f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:20.484760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:20.485572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:20.493073 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2940/5856] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:20 2022] DELETE /identity/v3/projects/cf14c8ed4ab242f4a1d2731e09b11f20 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:20.496065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:20.500091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:20.508125 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2917/5857] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:20.509643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a68d51-81af-43fe-9426-e8c43648bd51 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:20.509943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a68d51-81af-43fe-9426-e8c43648bd51 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:20.510210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a68d51-81af-43fe-9426-e8c43648bd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:20.557254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b56f-32df-4a7d-857f-6be6c6861924 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:20.572128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-31a68d51-81af-43fe-9426-e8c43648bd51 None None] MFA Rules not processed for user `90adb21c6d414c8da657da46b5a663cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:20.573494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-31a68d51-81af-43fe-9426-e8c43648bd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:20.586417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d960a5-e603-4528-ba03-64d911943c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:20.587628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d960a5-e603-4528-ba03-64d911943c7d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:20.588035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d960a5-e603-4528-ba03-64d911943c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:20.588562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d960a5-e603-4528-ba03-64d911943c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:20.589300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d960a5-e603-4528-ba03-64d911943c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:20.590983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d960a5-e603-4528-ba03-64d911943c7d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:20.603681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:20.632044 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2941/5858] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:20 2022] GET /identity/v3/roles => generated 1650 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:20.645269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d960a5-e603-4528-ba03-64d911943c7d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:20.658918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b0d960a5-e603-4528-ba03-64d911943c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:20.709847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d960a5-e603-4528-ba03-64d911943c7d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:20.725461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:20.728237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:20.728802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:20.731560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] PATH_INFO: `/v3/users/795b17750c65472db6ba7b879c59069f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:20.735833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=795b17750c65472db6ba7b879c59069f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:20.743237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:20.867622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795b17750c65472db6ba7b879c59069f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:20.869976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795b17750c65472db6ba7b879c59069f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:20.898756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795b17750c65472db6ba7b879c59069f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:20.910114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2918/5859] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:20 2022] POST /identity/v3/auth/tokens => generated 3395 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 30 04:44:20.915736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a68d51-81af-43fe-9426-e8c43648bd51 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:20.919412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-31a68d51-81af-43fe-9426-e8c43648bd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:20.928259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795b17750c65472db6ba7b879c59069f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:20.951027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795b17750c65472db6ba7b879c59069f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:20.971045 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2942/5860] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:20 2022] DELETE /identity/v3/users/795b17750c65472db6ba7b879c59069f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:20.972751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:20.979913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:21.076416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:21.087924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a68d51-81af-43fe-9426-e8c43648bd51 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:21.148561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4fcfe3-51b2-40d6-baa4-7c268eabbfa9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:21.167734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e98e-0c47-4e0e-bb6e-31b5988d4787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:21.171726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e98e-0c47-4e0e-bb6e-31b5988d4787 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:21.172192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e98e-0c47-4e0e-bb6e-31b5988d4787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:21.172873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e98e-0c47-4e0e-bb6e-31b5988d4787 admin admin] PATH_INFO: `/v3/projects/2fb24eb03c754cb6b7cfa6486c7c403f/users/6bdc957ddc1c4418a400179e6a6688ce/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:21.185309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce4004-04a4-49f4-8fb3-a0dac2ca7281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:21.186018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce4004-04a4-49f4-8fb3-a0dac2ca7281 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:21.186523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce4004-04a4-49f4-8fb3-a0dac2ca7281 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:21.186802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce4004-04a4-49f4-8fb3-a0dac2ca7281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:21.195213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-42ce4004-04a4-49f4-8fb3-a0dac2ca7281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:21.196838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6e98e-0c47-4e0e-bb6e-31b5988d4787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb24eb03c754cb6b7cfa6486c7c403f, user_id=6bdc957ddc1c4418a400179e6a6688ce, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:21.199817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6e98e-0c47-4e0e-bb6e-31b5988d4787 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:21.221964 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2943/5861] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:20 2022] PUT /identity/v3/projects/2fb24eb03c754cb6b7cfa6486c7c403f/users/6bdc957ddc1c4418a400179e6a6688ce/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:21.224859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e98e-0c47-4e0e-bb6e-31b5988d4787 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:21.226670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce4004-04a4-49f4-8fb3-a0dac2ca7281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:21.229042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce4004-04a4-49f4-8fb3-a0dac2ca7281 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:21.231634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a4c6e98e-0c47-4e0e-bb6e-31b5988d4787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:21.257516 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2919/5862] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:21.260283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce4004-04a4-49f4-8fb3-a0dac2ca7281 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:21.265570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-42ce4004-04a4-49f4-8fb3-a0dac2ca7281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:21.309451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:21.415064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e98e-0c47-4e0e-bb6e-31b5988d4787 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:21.423881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:21.424557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:21.425033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:21.425439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] PATH_INFO: `/v3/users/f10ec6796fd94fdf99ab6fc4660ca1b4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:21.428355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10ec6796fd94fdf99ab6fc4660ca1b4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:21.431810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:21.453691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce4004-04a4-49f4-8fb3-a0dac2ca7281 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:21.525672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10ec6796fd94fdf99ab6fc4660ca1b4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:21.526394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10ec6796fd94fdf99ab6fc4660ca1b4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:21.545756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10ec6796fd94fdf99ab6fc4660ca1b4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:21.564242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10ec6796fd94fdf99ab6fc4660ca1b4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:21.584692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-af0355fd-6347-472e-a210-ec340a71f0a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10ec6796fd94fdf99ab6fc4660ca1b4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:21.605918 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2944/5863] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:21 2022] DELETE /identity/v3/users/f10ec6796fd94fdf99ab6fc4660ca1b4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:21.605918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5b0d3-0849-493f-a51b-4c2972f8b630 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:21.605918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5b0d3-0849-493f-a51b-4c2972f8b630 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:21.605918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5b0d3-0849-493f-a51b-4c2972f8b630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:21.622375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b90e1b-eea0-4b8e-866d-faff5b2c1042 tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90adb21c6d414c8da657da46b5a663cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6b5c02e4bc204e8e87907146849ede5d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-366279109'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:21.623411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b90e1b-eea0-4b8e-866d-faff5b2c1042 tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:21.623926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b90e1b-eea0-4b8e-866d-faff5b2c1042 tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:21.624443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b90e1b-eea0-4b8e-866d-faff5b2c1042 tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] PATH_INFO: `/v3/users/90adb21c6d414c8da657da46b5a663cf/application_credentials/d35c70ea5716471289b4e21f14869644` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:21.625972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b90e1b-eea0-4b8e-866d-faff5b2c1042 tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] RBAC: Authorizing `identity:delete_application_credential(user_id=90adb21c6d414c8da657da46b5a663cf, application_credential_id=d35c70ea5716471289b4e21f14869644)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:21.629386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b90e1b-eea0-4b8e-866d-faff5b2c1042 tempest-ApplicationCredentialsV3AdminTest-1901989370 tempest-ApplicationCredentialsV3AdminTest-1901989370-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:21.669758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0ba5b0d3-0849-493f-a51b-4c2972f8b630 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:21.670951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0ba5b0d3-0849-493f-a51b-4c2972f8b630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:21.695511 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2920/5864] 10.222.0.43 () {58 vars in 1395 bytes} [Tue Aug 30 04:44:21 2022] DELETE /identity/v3/users/90adb21c6d414c8da657da46b5a663cf/application_credentials/d35c70ea5716471289b4e21f14869644 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:21.698018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab6252-9cb2-4291-8ee7-4b92fc31e832 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:21.698314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab6252-9cb2-4291-8ee7-4b92fc31e832 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:21.698591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab6252-9cb2-4291-8ee7-4b92fc31e832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:21.743584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-42ab6252-9cb2-4291-8ee7-4b92fc31e832 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:21.745112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-42ab6252-9cb2-4291-8ee7-4b92fc31e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:21.769784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:21.838418 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2945/5865] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:21.839309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5b0d3-0849-493f-a51b-4c2972f8b630 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:21.842229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0ba5b0d3-0849-493f-a51b-4c2972f8b630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:21.869998 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2921/5866] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:21.886112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab6252-9cb2-4291-8ee7-4b92fc31e832 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:21.887877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-42ab6252-9cb2-4291-8ee7-4b92fc31e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:22.001078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:22.031027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab6252-9cb2-4291-8ee7-4b92fc31e832 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:22.034991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5b0d3-0849-493f-a51b-4c2972f8b630 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:22.039056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a8aa8-48ed-44f8-a6d7-aef803e25e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:22.039560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a8aa8-48ed-44f8-a6d7-aef803e25e37 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:22.039839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a8aa8-48ed-44f8-a6d7-aef803e25e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:22.040106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a8aa8-48ed-44f8-a6d7-aef803e25e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:22.051199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d07999367784cba8e5ca224b8ea17f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9a872e7af0b64c1bae98c0f8c496f7e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:22.053741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:22.055885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:22.056360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] PATH_INFO: `/v3/roles/bf3693e244074e209e10f7daf684c2d3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:22.060461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bf3693e244074e209e10f7daf684c2d3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:22.062352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:22.073970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a8aa8-48ed-44f8-a6d7-aef803e25e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:22.075577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a8aa8-48ed-44f8-a6d7-aef803e25e37 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:22.110328 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2922/5867] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:44:22.111619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a8aa8-48ed-44f8-a6d7-aef803e25e37 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:22.138268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a8aa8-48ed-44f8-a6d7-aef803e25e37 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:22.148611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd75773-a42b-4f63-ab47-2824ef817d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:22.149310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd75773-a42b-4f63-ab47-2824ef817d99 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:22.149569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd75773-a42b-4f63-ab47-2824ef817d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:22.150646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd75773-a42b-4f63-ab47-2824ef817d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:22.175650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Invalidating the token cache because role bf3693e244074e209e10f7daf684c2d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:22.176116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.176962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.180733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd75773-a42b-4f63-ab47-2824ef817d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:22.180733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd75773-a42b-4f63-ab47-2824ef817d99 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:22.190399 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2946/5868] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:21 2022] DELETE /identity/v3/roles/bf3693e244074e209e10f7daf684c2d3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:22.191661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:22.196469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:22.200711 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2923/5869] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:22.201310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd75773-a42b-4f63-ab47-2824ef817d99 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:22.202775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-edd75773-a42b-4f63-ab47-2824ef817d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:22.223865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd75773-a42b-4f63-ab47-2824ef817d99 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:22.348046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:22.348749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:22.349026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:22.349461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] PATH_INFO: `/v3/users/90adb21c6d414c8da657da46b5a663cf` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:22.351019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=90adb21c6d414c8da657da46b5a663cf)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:22.352976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:22.369006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8353f-749f-406d-81fd-dd0b4fd34a17 tempest-ApplicationCredentialsV3AdminTest-540393704 tempest-ApplicationCredentialsV3AdminTest-540393704-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:22.383124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:22.384149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:22.385181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:22.385685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] PATH_INFO: `/v3/projects/d969c6e015bd4163b0d6a846f4f45def` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:22.387969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d969c6e015bd4163b0d6a846f4f45def)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:22.392255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:22.498845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:22.507872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd969c6e015bd4163b0d6a846f4f45def', 'request_id': 'req-b4a49e66-848d-4f69-8be1-210d9906daf8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.527177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90adb21c6d414c8da657da46b5a663cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.528290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd969c6e015bd4163b0d6a846f4f45def', 'request_id': 'req-b4a49e66-848d-4f69-8be1-210d9906daf8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.544036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd969c6e015bd4163b0d6a846f4f45def', 'request_id': 'req-b4a49e66-848d-4f69-8be1-210d9906daf8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.545733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90adb21c6d414c8da657da46b5a663cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.573339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] The token cache is being invalidate because project d969c6e015bd4163b0d6a846f4f45def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:22.573695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.578124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.583631 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2947/5870] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:22 2022] DELETE /identity/v3/projects/d969c6e015bd4163b0d6a846f4f45def => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:22.584689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:22.589009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:22.636885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90adb21c6d414c8da657da46b5a663cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.679399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90adb21c6d414c8da657da46b5a663cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.680073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90adb21c6d414c8da657da46b5a663cf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:22.691494 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2924/5871] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:22 2022] DELETE /identity/v3/users/90adb21c6d414c8da657da46b5a663cf => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:22.692635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:22.707803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:22.780174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a49e66-848d-4f69-8be1-210d9906daf8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:22.867005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:22.898165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:22.898846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:22.899123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:22.899397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] PATH_INFO: `/v3/projects/aabf056637524659b64cf751e75d6fd7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:22.902735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aabf056637524659b64cf751e75d6fd7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:22.904706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:22.913656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647cdda-c4fe-4d85-9c1c-3d21b6d1b13f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:22.924749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:22.927009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:22.927473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:22.928994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] PATH_INFO: `/v3/users/71cd90d3aac44eacaab5350dbf998fce` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:22.932485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71cd90d3aac44eacaab5350dbf998fce)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:22.939895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:23.000991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aabf056637524659b64cf751e75d6fd7', 'request_id': 'req-4b203ce2-9a6d-4c67-9869-115941d85a04'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:23.012864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aabf056637524659b64cf751e75d6fd7', 'request_id': 'req-4b203ce2-9a6d-4c67-9869-115941d85a04'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:23.030608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aabf056637524659b64cf751e75d6fd7', 'request_id': 'req-4b203ce2-9a6d-4c67-9869-115941d85a04'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:23.053676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] The token cache is being invalidate because project aabf056637524659b64cf751e75d6fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:23.054022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:23.062424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4b203ce2-9a6d-4c67-9869-115941d85a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:23.064500 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2948/5872] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:22 2022] DELETE /identity/v3/projects/aabf056637524659b64cf751e75d6fd7 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:23.065468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c3c1b-f781-4a09-b97f-402d572eff53 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:23.065719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c3c1b-f781-4a09-b97f-402d572eff53 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:23.066014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c3c1b-f781-4a09-b97f-402d572eff53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:23.088749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71cd90d3aac44eacaab5350dbf998fce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:23.106895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71cd90d3aac44eacaab5350dbf998fce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:23.111077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1b3c3c1b-f781-4a09-b97f-402d572eff53 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:23.112319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1b3c3c1b-f781-4a09-b97f-402d572eff53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:23.116916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:23.146296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71cd90d3aac44eacaab5350dbf998fce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:23.161352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71cd90d3aac44eacaab5350dbf998fce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:23.162285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71cd90d3aac44eacaab5350dbf998fce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:23.184662 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2949/5873] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:23.184883 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2925/5874] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:22 2022] DELETE /identity/v3/users/71cd90d3aac44eacaab5350dbf998fce => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:23.186273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf84932-a96d-4010-b903-03a91f9e4fd4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:23.186565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf84932-a96d-4010-b903-03a91f9e4fd4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:23.186836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf84932-a96d-4010-b903-03a91f9e4fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:23.209114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5cf84932-a96d-4010-b903-03a91f9e4fd4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:23.210526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5cf84932-a96d-4010-b903-03a91f9e4fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:23.225561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:23.227197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:23.308014 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2950/5875] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:23.318177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03111dea-0daa-4b26-bd65-bba67dd531f8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:23.318735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03111dea-0daa-4b26-bd65-bba67dd531f8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:23.319110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03111dea-0daa-4b26-bd65-bba67dd531f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:23.356528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-03111dea-0daa-4b26-bd65-bba67dd531f8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:23.357114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-03111dea-0daa-4b26-bd65-bba67dd531f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:23.369016 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2951/5876] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:23.373272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03111dea-0daa-4b26-bd65-bba67dd531f8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:23.395037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8f450-042b-4c1f-9430-7d7e27ff45a9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:23.402462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03111dea-0daa-4b26-bd65-bba67dd531f8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:23.407254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64ed8b-f656-42db-8036-fb32fff62485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:23.407602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e5c8-1831-42a3-b571-92732fdd8d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:23.407975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64ed8b-f656-42db-8036-fb32fff62485 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:23.408245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e5c8-1831-42a3-b571-92732fdd8d5f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:23.408372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64ed8b-f656-42db-8036-fb32fff62485 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:23.408524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e5c8-1831-42a3-b571-92732fdd8d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:23.408860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b4e5c8-1831-42a3-b571-92732fdd8d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:23.409460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4e5c8-1831-42a3-b571-92732fdd8d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:23.409656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64ed8b-f656-42db-8036-fb32fff62485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:23.409776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4e5c8-1831-42a3-b571-92732fdd8d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:23.411441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b4e5c8-1831-42a3-b571-92732fdd8d5f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:23.433825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64ed8b-f656-42db-8036-fb32fff62485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:23.440837 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2952/5877] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:44:23.441040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64ed8b-f656-42db-8036-fb32fff62485 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:23.442447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e5c8-1831-42a3-b571-92732fdd8d5f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:23.459793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b4e5c8-1831-42a3-b571-92732fdd8d5f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:23.468899 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2926/5878] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:23.481355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db60ca-6c52-49c7-80ef-75fb084d8063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:23.482023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db60ca-6c52-49c7-80ef-75fb084d8063 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:23.482306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db60ca-6c52-49c7-80ef-75fb084d8063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:23.482577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db60ca-6c52-49c7-80ef-75fb084d8063 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:23.483237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db60ca-6c52-49c7-80ef-75fb084d8063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:23.485180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db60ca-6c52-49c7-80ef-75fb084d8063 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:23.548700 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2953/5879] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:23 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:44:23.550284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64ed8b-f656-42db-8036-fb32fff62485 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:23.564761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64ed8b-f656-42db-8036-fb32fff62485 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:23.719805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea1f64-1f38-4bd1-ac63-9ca4d5a93932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:23.720431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea1f64-1f38-4bd1-ac63-9ca4d5a93932 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:23.720701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea1f64-1f38-4bd1-ac63-9ca4d5a93932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:23.720970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea1f64-1f38-4bd1-ac63-9ca4d5a93932 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:23.725340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea1f64-1f38-4bd1-ac63-9ca4d5a93932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:23.726858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea1f64-1f38-4bd1-ac63-9ca4d5a93932 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:23.767937 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2927/5880] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:23 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:44:23.772457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db60ca-6c52-49c7-80ef-75fb084d8063 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:23.792086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db60ca-6c52-49c7-80ef-75fb084d8063 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:23.803523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93f176-8596-4f3c-a2ed-77650e559490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:23.804175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93f176-8596-4f3c-a2ed-77650e559490 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:23.804448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93f176-8596-4f3c-a2ed-77650e559490 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:23.804715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93f176-8596-4f3c-a2ed-77650e559490 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:23.805371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93f176-8596-4f3c-a2ed-77650e559490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:23.807072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93f176-8596-4f3c-a2ed-77650e559490 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:23.846941 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2954/5881] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:44:23.848367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea1f64-1f38-4bd1-ac63-9ca4d5a93932 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:23.857498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:23.864390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea1f64-1f38-4bd1-ac63-9ca4d5a93932 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:23.879594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34416f5d-b26b-4832-a9cb-487ec134e764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:23.880555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34416f5d-b26b-4832-a9cb-487ec134e764 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:23.882751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34416f5d-b26b-4832-a9cb-487ec134e764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:23.883551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34416f5d-b26b-4832-a9cb-487ec134e764 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:23.884496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34416f5d-b26b-4832-a9cb-487ec134e764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:23.887855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34416f5d-b26b-4832-a9cb-487ec134e764 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:23.917589 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2928/5882] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:23.922444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93f176-8596-4f3c-a2ed-77650e559490 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:23.948638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93f176-8596-4f3c-a2ed-77650e559490 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:23.954550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056569b-ae4e-47e1-ad3d-5bc4e91fe30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:23.955251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056569b-ae4e-47e1-ad3d-5bc4e91fe30a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:23.955528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056569b-ae4e-47e1-ad3d-5bc4e91fe30a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:23.955823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056569b-ae4e-47e1-ad3d-5bc4e91fe30a admin admin] PATH_INFO: `/v3/projects/a0ec6d643ba24012ae788cf7c81891f3/users/3badaedfb11147668d510d848a8ceac1/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:23.978418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056569b-ae4e-47e1-ad3d-5bc4e91fe30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ec6d643ba24012ae788cf7c81891f3, user_id=3badaedfb11147668d510d848a8ceac1, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:23.981255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056569b-ae4e-47e1-ad3d-5bc4e91fe30a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:24.009945 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2955/5883] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:23 2022] PUT /identity/v3/projects/a0ec6d643ba24012ae788cf7c81891f3/users/3badaedfb11147668d510d848a8ceac1/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:24.010336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34416f5d-b26b-4832-a9cb-487ec134e764 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:24.010336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-34416f5d-b26b-4832-a9cb-487ec134e764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:24.019877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa704c-c62c-4313-bd82-3f4ba4f60051 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:24.020166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa704c-c62c-4313-bd82-3f4ba4f60051 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:24.020434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa704c-c62c-4313-bd82-3f4ba4f60051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:24.029001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34416f5d-b26b-4832-a9cb-487ec134e764 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:24.092920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ddfa704c-c62c-4313-bd82-3f4ba4f60051 None None] MFA Rules not processed for user `3badaedfb11147668d510d848a8ceac1`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:24.094121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ddfa704c-c62c-4313-bd82-3f4ba4f60051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:24.159860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:24.164795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:24.166034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:24.167280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:24.167722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] PATH_INFO: `/v3/projects/c21182f2c09f4bc49cdfe1a907413189` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:24.170194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21182f2c09f4bc49cdfe1a907413189)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:24.172842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:24.269754 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2956/5884] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:24.273150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa704c-c62c-4313-bd82-3f4ba4f60051 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:24.275057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ddfa704c-c62c-4313-bd82-3f4ba4f60051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:24.280189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21182f2c09f4bc49cdfe1a907413189', 'request_id': 'req-176ba2f0-db87-441d-9765-d0741700f6ec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:24.312587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21182f2c09f4bc49cdfe1a907413189', 'request_id': 'req-176ba2f0-db87-441d-9765-d0741700f6ec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:24.321050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa704c-c62c-4313-bd82-3f4ba4f60051 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:24.335268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21182f2c09f4bc49cdfe1a907413189', 'request_id': 'req-176ba2f0-db87-441d-9765-d0741700f6ec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:24.354264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] The token cache is being invalidate because project c21182f2c09f4bc49cdfe1a907413189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:24.355508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:24.357250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:24.363637 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2929/5885] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:24 2022] DELETE /identity/v3/projects/c21182f2c09f4bc49cdfe1a907413189 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:24.363637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:24.363637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:24.531246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:24.532599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ba2f0-db87-441d-9765-d0741700f6ec admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:24.538234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:24.541335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:24.542570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] PATH_INFO: `/v3/projects/6e39832696bb43df8dc8edc93cf7c7c0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:24.544223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a11c8b-4099-43ea-8fbd-4408161a4d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:24.544878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a11c8b-4099-43ea-8fbd-4408161a4d38 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:24.545151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a11c8b-4099-43ea-8fbd-4408161a4d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:24.545849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e39832696bb43df8dc8edc93cf7c7c0)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:24.546134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a11c8b-4099-43ea-8fbd-4408161a4d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:24.546757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a11c8b-4099-43ea-8fbd-4408161a4d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:24.549636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a11c8b-4099-43ea-8fbd-4408161a4d38 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:24.551300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:24.597509 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2930/5886] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:24 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:24.600252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dc7e4-c3b4-47f2-afe5-33342128dabd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:24.600566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dc7e4-c3b4-47f2-afe5-33342128dabd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:24.601975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dc7e4-c3b4-47f2-afe5-33342128dabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:24.646348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5a1dc7e4-c3b4-47f2-afe5-33342128dabd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:24.650934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5a1dc7e4-c3b4-47f2-afe5-33342128dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:24.655584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e39832696bb43df8dc8edc93cf7c7c0', 'request_id': 'req-8e5173f8-f7ac-495a-a80a-ea84d0867627'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:24.662145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:24.673688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e39832696bb43df8dc8edc93cf7c7c0', 'request_id': 'req-8e5173f8-f7ac-495a-a80a-ea84d0867627'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:24.691077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e39832696bb43df8dc8edc93cf7c7c0', 'request_id': 'req-8e5173f8-f7ac-495a-a80a-ea84d0867627'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:24.716152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] The token cache is being invalidate because project 6e39832696bb43df8dc8edc93cf7c7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:24.716537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:24.717655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:24.722457 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2957/5887] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:24 2022] DELETE /identity/v3/projects/6e39832696bb43df8dc8edc93cf7c7c0 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:24.724100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:24.726813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:24.768862 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2931/5888] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:24.769996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dc7e4-c3b4-47f2-afe5-33342128dabd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:24.771557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5a1dc7e4-c3b4-47f2-afe5-33342128dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:24.794006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dc7e4-c3b4-47f2-afe5-33342128dabd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:24.815794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24399dd0-4dc4-438a-a0e3-2f46055c43c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:24.819352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24399dd0-4dc4-438a-a0e3-2f46055c43c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:24.819352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24399dd0-4dc4-438a-a0e3-2f46055c43c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:24.819352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24399dd0-4dc4-438a-a0e3-2f46055c43c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:24.822331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24399dd0-4dc4-438a-a0e3-2f46055c43c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:24.827159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24399dd0-4dc4-438a-a0e3-2f46055c43c7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:24.827922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:24.854581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5173f8-f7ac-495a-a80a-ea84d0867627 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:24.868746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:24.877191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:24.877191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:24.877191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] PATH_INFO: `/v3/projects/6b5c02e4bc204e8e87907146849ede5d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:24.877900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5c02e4bc204e8e87907146849ede5d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:24.880609 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2932/5889] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:24 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:24.881412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24399dd0-4dc4-438a-a0e3-2f46055c43c7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:24.884501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:24.884661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24399dd0-4dc4-438a-a0e3-2f46055c43c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:24.915020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24399dd0-4dc4-438a-a0e3-2f46055c43c7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:24.923548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:24.924338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:24.924680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:24.925018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] PATH_INFO: `/v3/users/0238f5d61b6d4349a22e76092243ce97` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:24.926635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0238f5d61b6d4349a22e76092243ce97)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:24.932111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:24.998936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5c02e4bc204e8e87907146849ede5d', 'request_id': 'req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.008753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5c02e4bc204e8e87907146849ede5d', 'request_id': 'req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.020875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5c02e4bc204e8e87907146849ede5d', 'request_id': 'req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.047883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] The token cache is being invalidate because project 6b5c02e4bc204e8e87907146849ede5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:25.048171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.052997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8949e3e1-8dfb-4d80-b0e2-4e1242e17fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.055237 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2958/5890] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:24 2022] DELETE /identity/v3/projects/6b5c02e4bc204e8e87907146849ede5d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:25.059344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a7356-538c-46dc-9ab9-fc52acfac9fd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:25.059703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a7356-538c-46dc-9ab9-fc52acfac9fd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:25.059890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a7356-538c-46dc-9ab9-fc52acfac9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:25.060219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0238f5d61b6d4349a22e76092243ce97'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.071902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0238f5d61b6d4349a22e76092243ce97'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.093706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0238f5d61b6d4349a22e76092243ce97'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.103358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bc3a7356-538c-46dc-9ab9-fc52acfac9fd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:25.105009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bc3a7356-538c-46dc-9ab9-fc52acfac9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:25.109718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0238f5d61b6d4349a22e76092243ce97'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.110737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15c9651b-127c-4b8f-a366-b0f4c6ae6bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0238f5d61b6d4349a22e76092243ce97'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.123371 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2933/5891] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:24 2022] DELETE /identity/v3/users/0238f5d61b6d4349a22e76092243ce97 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:25.126555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360af75b-ce71-4680-b7a7-8584b6ea8924 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:25.127811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360af75b-ce71-4680-b7a7-8584b6ea8924 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:25.128277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360af75b-ce71-4680-b7a7-8584b6ea8924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:25.174882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-360af75b-ce71-4680-b7a7-8584b6ea8924 None None] MFA Rules not processed for user `6bdc957ddc1c4418a400179e6a6688ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:25.177267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-360af75b-ce71-4680-b7a7-8584b6ea8924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:25.234480 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2959/5892] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:25.237747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a7356-538c-46dc-9ab9-fc52acfac9fd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:25.243880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bc3a7356-538c-46dc-9ab9-fc52acfac9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:25.277245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a7356-538c-46dc-9ab9-fc52acfac9fd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:25.281699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:25.307347 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2934/5893] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:25.308254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360af75b-ce71-4680-b7a7-8584b6ea8924 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:25.319849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-360af75b-ce71-4680-b7a7-8584b6ea8924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:25.377157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4945a-f06a-4f3c-a859-3e64a72ebabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:25.379025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4945a-f06a-4f3c-a859-3e64a72ebabf admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:25.379025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4945a-f06a-4f3c-a859-3e64a72ebabf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:25.379262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4945a-f06a-4f3c-a859-3e64a72ebabf admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:25.379928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4945a-f06a-4f3c-a859-3e64a72ebabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:25.384308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4945a-f06a-4f3c-a859-3e64a72ebabf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:25.409703 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2960/5894] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:25.410690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4945a-f06a-4f3c-a859-3e64a72ebabf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:25.436767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4945a-f06a-4f3c-a859-3e64a72ebabf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:25.452133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf362d32-e710-4eec-addb-b7df6ee4c277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:25.452763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362d32-e710-4eec-addb-b7df6ee4c277 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:25.453041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362d32-e710-4eec-addb-b7df6ee4c277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:25.453313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf362d32-e710-4eec-addb-b7df6ee4c277 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:25.453996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362d32-e710-4eec-addb-b7df6ee4c277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:25.454298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362d32-e710-4eec-addb-b7df6ee4c277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:25.455195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360af75b-ce71-4680-b7a7-8584b6ea8924 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:25.455926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf362d32-e710-4eec-addb-b7df6ee4c277 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:25.463325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:25.463990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:25.464474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:25.464744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] PATH_INFO: `/v3/users/4d07999367784cba8e5ca224b8ea17f4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:25.469290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d07999367784cba8e5ca224b8ea17f4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:25.471491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:25.483617 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2961/5895] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:25.484510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf362d32-e710-4eec-addb-b7df6ee4c277 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:25.489075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bf362d32-e710-4eec-addb-b7df6ee4c277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:25.516881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf362d32-e710-4eec-addb-b7df6ee4c277 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:25.531871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb943c5-b6a3-4d9a-ba21-efd2caf0284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:25.532505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb943c5-b6a3-4d9a-ba21-efd2caf0284f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:25.532783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb943c5-b6a3-4d9a-ba21-efd2caf0284f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:25.533051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb943c5-b6a3-4d9a-ba21-efd2caf0284f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:25.533702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb943c5-b6a3-4d9a-ba21-efd2caf0284f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:25.535800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb943c5-b6a3-4d9a-ba21-efd2caf0284f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:25.544679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:25.593205 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2962/5896] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:25 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:25.596068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb943c5-b6a3-4d9a-ba21-efd2caf0284f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:25.623876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d07999367784cba8e5ca224b8ea17f4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.644322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d07999367784cba8e5ca224b8ea17f4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.663746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d07999367784cba8e5ca224b8ea17f4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.684382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d07999367784cba8e5ca224b8ea17f4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.684382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d07999367784cba8e5ca224b8ea17f4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:25.706226 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2935/5897] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:25 2022] DELETE /identity/v3/users/4d07999367784cba8e5ca224b8ea17f4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:25.708434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:25.712797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:25.753669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb943c5-b6a3-4d9a-ba21-efd2caf0284f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:25.831260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be198e-d3bf-4913-81e6-0eb5ca319ab6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:25.838596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752e8d3-5c0b-48cb-bdb0-993df00daa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:25.839249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752e8d3-5c0b-48cb-bdb0-993df00daa14 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:25.839516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752e8d3-5c0b-48cb-bdb0-993df00daa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:25.839850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752e8d3-5c0b-48cb-bdb0-993df00daa14 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:25.840550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752e8d3-5c0b-48cb-bdb0-993df00daa14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:25.844085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752e8d3-5c0b-48cb-bdb0-993df00daa14 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:25.864876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5c42a-36d5-4bf3-9db1-5f64a8c199fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:25.867430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5c42a-36d5-4bf3-9db1-5f64a8c199fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:25.868258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5c42a-36d5-4bf3-9db1-5f64a8c199fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:25.868939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5c42a-36d5-4bf3-9db1-5f64a8c199fa admin admin] PATH_INFO: `/v3/projects/5a9478c5c75a448392bc880b339ff144/users/02abbf08db7a433faa7929f7340bb578/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:25.890060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:25.902367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5c42a-36d5-4bf3-9db1-5f64a8c199fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9478c5c75a448392bc880b339ff144, user_id=02abbf08db7a433faa7929f7340bb578, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:25.907946 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2936/5898] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:25 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:25.907946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752e8d3-5c0b-48cb-bdb0-993df00daa14 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:25.908237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5c42a-36d5-4bf3-9db1-5f64a8c199fa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:25.908646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7752e8d3-5c0b-48cb-bdb0-993df00daa14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:25.931067 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2963/5899] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:25 2022] PUT /identity/v3/projects/5a9478c5c75a448392bc880b339ff144/users/02abbf08db7a433faa7929f7340bb578/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:25.931067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5c42a-36d5-4bf3-9db1-5f64a8c199fa admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:25.932116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-61a5c42a-36d5-4bf3-9db1-5f64a8c199fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:26.035306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5c42a-36d5-4bf3-9db1-5f64a8c199fa admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:26.045502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:26.046444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.052014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.053349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] PATH_INFO: `/v3/projects/9466bc630896416bab28cb1c6deb1e63` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.057246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752e8d3-5c0b-48cb-bdb0-993df00daa14 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:26.057491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9466bc630896416bab28cb1c6deb1e63)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:26.060516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:26.073230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc1d6-5263-43e2-8ca8-a3f4d917e26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:26.074015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc1d6-5263-43e2-8ca8-a3f4d917e26d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.074402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc1d6-5263-43e2-8ca8-a3f4d917e26d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.074784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc1d6-5263-43e2-8ca8-a3f4d917e26d admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.075566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc1d6-5263-43e2-8ca8-a3f4d917e26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:26.077720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc1d6-5263-43e2-8ca8-a3f4d917e26d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:26.108740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:26.125796 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2937/5900] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:25 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:26.128221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc1d6-5263-43e2-8ca8-a3f4d917e26d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:26.149212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc1d6-5263-43e2-8ca8-a3f4d917e26d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:26.168567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9466bc630896416bab28cb1c6deb1e63', 'request_id': 'req-bf789210-5dcf-421e-a2c7-133bb8bf1c35'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:26.181779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9466bc630896416bab28cb1c6deb1e63', 'request_id': 'req-bf789210-5dcf-421e-a2c7-133bb8bf1c35'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:26.198845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9466bc630896416bab28cb1c6deb1e63', 'request_id': 'req-bf789210-5dcf-421e-a2c7-133bb8bf1c35'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:26.219217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] The token cache is being invalidate because project 9466bc630896416bab28cb1c6deb1e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:26.219480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:26.220366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:26.230044 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2964/5901] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:25 2022] DELETE /identity/v3/projects/9466bc630896416bab28cb1c6deb1e63 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:26.231055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:26.233584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:26.294408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339dfb4-b7a7-4bfe-8a4f-73175bb5bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:26.295040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339dfb4-b7a7-4bfe-8a4f-73175bb5bdd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.295315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339dfb4-b7a7-4bfe-8a4f-73175bb5bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.295582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339dfb4-b7a7-4bfe-8a4f-73175bb5bdd5 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.296322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339dfb4-b7a7-4bfe-8a4f-73175bb5bdd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:26.298322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339dfb4-b7a7-4bfe-8a4f-73175bb5bdd5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:26.344664 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2938/5902] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:26 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:26.345609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339dfb4-b7a7-4bfe-8a4f-73175bb5bdd5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:26.350163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e339dfb4-b7a7-4bfe-8a4f-73175bb5bdd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:26.370436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339dfb4-b7a7-4bfe-8a4f-73175bb5bdd5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:26.372447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf789210-5dcf-421e-a2c7-133bb8bf1c35 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:26.377443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24206f-4705-40c9-8c1c-e27165454803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:26.378126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24206f-4705-40c9-8c1c-e27165454803 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.378400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24206f-4705-40c9-8c1c-e27165454803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.378668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24206f-4705-40c9-8c1c-e27165454803 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.378960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753faa9-527a-4d42-bb21-de247a2db60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:26.379315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24206f-4705-40c9-8c1c-e27165454803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:26.379608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753faa9-527a-4d42-bb21-de247a2db60c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.379885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753faa9-527a-4d42-bb21-de247a2db60c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.380150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753faa9-527a-4d42-bb21-de247a2db60c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.381132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753faa9-527a-4d42-bb21-de247a2db60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:26.381250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24206f-4705-40c9-8c1c-e27165454803 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:26.383301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753faa9-527a-4d42-bb21-de247a2db60c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:26.392352 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2965/5903] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:26.393780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b9688-1916-42f3-b9e8-3c3f1146b765 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.394090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b9688-1916-42f3-b9e8-3c3f1146b765 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.394367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b9688-1916-42f3-b9e8-3c3f1146b765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.400473 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2939/5904] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:26.404752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753faa9-527a-4d42-bb21-de247a2db60c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:26.407648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1753faa9-527a-4d42-bb21-de247a2db60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:26.415343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c27b9688-1916-42f3-b9e8-3c3f1146b765 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:26.416551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c27b9688-1916-42f3-b9e8-3c3f1146b765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:26.425176 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2966/5905] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:26.432610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b9688-1916-42f3-b9e8-3c3f1146b765 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:26.432796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753faa9-527a-4d42-bb21-de247a2db60c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:26.434085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c27b9688-1916-42f3-b9e8-3c3f1146b765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:26.438200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:26.438972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.439252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.439523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] PATH_INFO: `/v3/projects/9a872e7af0b64c1bae98c0f8c496f7e5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.440791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a872e7af0b64c1bae98c0f8c496f7e5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:26.443188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:26.446447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b9688-1916-42f3-b9e8-3c3f1146b765 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:26.451225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82431dda-5953-4145-bd11-e1300175d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:26.451839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82431dda-5953-4145-bd11-e1300175d6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.452533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82431dda-5953-4145-bd11-e1300175d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.452533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82431dda-5953-4145-bd11-e1300175d6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.453018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82431dda-5953-4145-bd11-e1300175d6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:26.454657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82431dda-5953-4145-bd11-e1300175d6b3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:26.466024 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2967/5906] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:26.466972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82431dda-5953-4145-bd11-e1300175d6b3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:26.477600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82431dda-5953-4145-bd11-e1300175d6b3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:26.482573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad021137-a31e-46a4-bdf0-46f385a221ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:26.483295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad021137-a31e-46a4-bdf0-46f385a221ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.483504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad021137-a31e-46a4-bdf0-46f385a221ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.483771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad021137-a31e-46a4-bdf0-46f385a221ee admin admin] PATH_INFO: `/v3/projects/5a9478c5c75a448392bc880b339ff144/users/02abbf08db7a433faa7929f7340bb578/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.485758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad021137-a31e-46a4-bdf0-46f385a221ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9478c5c75a448392bc880b339ff144, user_id=02abbf08db7a433faa7929f7340bb578, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:26.488453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad021137-a31e-46a4-bdf0-46f385a221ee admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:26.501438 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2968/5907] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:26 2022] PUT /identity/v3/projects/5a9478c5c75a448392bc880b339ff144/users/02abbf08db7a433faa7929f7340bb578/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:26.502420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad021137-a31e-46a4-bdf0-46f385a221ee admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:26.521051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a872e7af0b64c1bae98c0f8c496f7e5', 'request_id': 'req-dc628f9e-e1da-4449-a1f9-63195c23feed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:26.533418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a872e7af0b64c1bae98c0f8c496f7e5', 'request_id': 'req-dc628f9e-e1da-4449-a1f9-63195c23feed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:26.543619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a872e7af0b64c1bae98c0f8c496f7e5', 'request_id': 'req-dc628f9e-e1da-4449-a1f9-63195c23feed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:26.545015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=7,keystone:DELETE=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:26.560233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] The token cache is being invalidate because project 9a872e7af0b64c1bae98c0f8c496f7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:26.560598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:26.561206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc628f9e-e1da-4449-a1f9-63195c23feed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:26.562892 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2940/5908] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:26 2022] DELETE /identity/v3/projects/9a872e7af0b64c1bae98c0f8c496f7e5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:26.567611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4145951-ddf2-40bd-9b54-974ac1aa5ece None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.567870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4145951-ddf2-40bd-9b54-974ac1aa5ece None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.568140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4145951-ddf2-40bd-9b54-974ac1aa5ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.591098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad021137-a31e-46a4-bdf0-46f385a221ee admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:26.592761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c4145951-ddf2-40bd-9b54-974ac1aa5ece None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:26.594137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c4145951-ddf2-40bd-9b54-974ac1aa5ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:26.615011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:26.692571 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2941/5909] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:26.696371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4145951-ddf2-40bd-9b54-974ac1aa5ece None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:26.700682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c4145951-ddf2-40bd-9b54-974ac1aa5ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:26.713345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5384382-3ae2-46dd-b3d2-64f10f6e2c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:26.714090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5384382-3ae2-46dd-b3d2-64f10f6e2c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.714372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5384382-3ae2-46dd-b3d2-64f10f6e2c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.714643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5384382-3ae2-46dd-b3d2-64f10f6e2c95 admin admin] PATH_INFO: `/v3/projects/fbe28799f0a647dfaf12a93fc95de927/users/e486e2c0fb304519aeb698052c26e933/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.729395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4145951-ddf2-40bd-9b54-974ac1aa5ece None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:26.743617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5384382-3ae2-46dd-b3d2-64f10f6e2c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe28799f0a647dfaf12a93fc95de927, user_id=e486e2c0fb304519aeb698052c26e933, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:26.744286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c86f9a-de22-4055-9507-8e6ba2fac5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:26.744925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c86f9a-de22-4055-9507-8e6ba2fac5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.745205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c86f9a-de22-4055-9507-8e6ba2fac5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.745533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c86f9a-de22-4055-9507-8e6ba2fac5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.746244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c86f9a-de22-4055-9507-8e6ba2fac5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:26.746488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5384382-3ae2-46dd-b3d2-64f10f6e2c95 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:26.748024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c86f9a-de22-4055-9507-8e6ba2fac5c6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:26.772819 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2969/5910] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:26 2022] PUT /identity/v3/projects/fbe28799f0a647dfaf12a93fc95de927/users/e486e2c0fb304519aeb698052c26e933/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:26.774921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0dec5-3a7e-4de0-91f7-1ce9b042f387 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.775206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0dec5-3a7e-4de0-91f7-1ce9b042f387 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.778172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0dec5-3a7e-4de0-91f7-1ce9b042f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.785734 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2942/5911] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:26.788184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0f23-4ab2-4290-bee2-15fab2b9bc4a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:26.788482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0f23-4ab2-4290-bee2-15fab2b9bc4a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:26.788765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac0f23-4ab2-4290-bee2-15fab2b9bc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:26.846808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0bac0f23-4ab2-4290-bee2-15fab2b9bc4a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:26.848050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0bac0f23-4ab2-4290-bee2-15fab2b9bc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:26.851012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-edd0dec5-3a7e-4de0-91f7-1ce9b042f387 None None] MFA Rules not processed for user `02abbf08db7a433faa7929f7340bb578`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:26.852831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-edd0dec5-3a7e-4de0-91f7-1ce9b042f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:26.981685 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2943/5912] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:26.983189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac0f23-4ab2-4290-bee2-15fab2b9bc4a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.001270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac0f23-4ab2-4290-bee2-15fab2b9bc4a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.007113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7cdc7-6cc8-48b7-84e7-680d0a554db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.007894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7cdc7-6cc8-48b7-84e7-680d0a554db4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.008273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7cdc7-6cc8-48b7-84e7-680d0a554db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.008794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7cdc7-6cc8-48b7-84e7-680d0a554db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.009566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7cdc7-6cc8-48b7-84e7-680d0a554db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:27.010064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7cdc7-6cc8-48b7-84e7-680d0a554db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.010167 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2970/5913] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:27.010949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0dec5-3a7e-4de0-91f7-1ce9b042f387 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.012124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7cdc7-6cc8-48b7-84e7-680d0a554db4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:27.012481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-edd0dec5-3a7e-4de0-91f7-1ce9b042f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:27.028614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0dec5-3a7e-4de0-91f7-1ce9b042f387 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.034852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa3a71-1199-4e7a-ad40-08240c0e9a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.035502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa3a71-1199-4e7a-ad40-08240c0e9a82 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.035782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa3a71-1199-4e7a-ad40-08240c0e9a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.036069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa3a71-1199-4e7a-ad40-08240c0e9a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.037053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa3a71-1199-4e7a-ad40-08240c0e9a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.037838 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2944/5914] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:27.039229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa3a71-1199-4e7a-ad40-08240c0e9a82 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:27.042710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7cdc7-6cc8-48b7-84e7-680d0a554db4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.055773 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2971/5915] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:27.056091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7cdc7-6cc8-48b7-84e7-680d0a554db4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.056639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531d79-41aa-4e5f-8ca2-eb5d053dd9a9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.058005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531d79-41aa-4e5f-8ca2-eb5d053dd9a9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.058338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95531d79-41aa-4e5f-8ca2-eb5d053dd9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.061039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb351-7422-4845-8faf-251a4420146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.062027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb351-7422-4845-8faf-251a4420146d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.062419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb351-7422-4845-8faf-251a4420146d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.062795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb351-7422-4845-8faf-251a4420146d admin admin] PATH_INFO: `/v3/projects/9f047d73623a41bbaf0d5d1bf046993b/users/aa1e2e48f06a4b40a62cda376c27b203/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.085637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fb351-7422-4845-8faf-251a4420146d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f047d73623a41bbaf0d5d1bf046993b, user_id=aa1e2e48f06a4b40a62cda376c27b203, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.092530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fb351-7422-4845-8faf-251a4420146d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:27.103769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-95531d79-41aa-4e5f-8ca2-eb5d053dd9a9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:27.105436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-95531d79-41aa-4e5f-8ca2-eb5d053dd9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:27.122311 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2945/5916] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:27 2022] PUT /identity/v3/projects/9f047d73623a41bbaf0d5d1bf046993b/users/aa1e2e48f06a4b40a62cda376c27b203/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:27.123387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb351-7422-4845-8faf-251a4420146d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.125571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c58fb351-7422-4845-8faf-251a4420146d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:27.208843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:27.256922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb351-7422-4845-8faf-251a4420146d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.266961 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2972/5917] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:27.268000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95531d79-41aa-4e5f-8ca2-eb5d053dd9a9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.274011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c1d1-b5f2-483a-a840-57d9df129928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.274769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c1d1-b5f2-483a-a840-57d9df129928 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.275119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c1d1-b5f2-483a-a840-57d9df129928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.275391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c1d1-b5f2-483a-a840-57d9df129928 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.276174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3c1d1-b5f2-483a-a840-57d9df129928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.278984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3c1d1-b5f2-483a-a840-57d9df129928 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:27.291014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95531d79-41aa-4e5f-8ca2-eb5d053dd9a9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.307698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e1506-f5ce-4b0b-98ff-ab789af46f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.309309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e1506-f5ce-4b0b-98ff-ab789af46f98 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.309613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e1506-f5ce-4b0b-98ff-ab789af46f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.309943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e1506-f5ce-4b0b-98ff-ab789af46f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.310572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e1506-f5ce-4b0b-98ff-ab789af46f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.318254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e1506-f5ce-4b0b-98ff-ab789af46f98 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:27.322493 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2946/5918] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:27 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:27.322493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c1d1-b5f2-483a-a840-57d9df129928 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.355580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:27.397579 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2973/5919] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:27 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:27.402613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dbd83-f330-43fa-a8c2-bc73105ad26f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.403081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dbd83-f330-43fa-a8c2-bc73105ad26f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.403450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9dbd83-f330-43fa-a8c2-bc73105ad26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.430454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c1d1-b5f2-483a-a840-57d9df129928 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.460162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5f9dbd83-f330-43fa-a8c2-bc73105ad26f None None] MFA Rules not processed for user `aa1e2e48f06a4b40a62cda376c27b203`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:27.463349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5f9dbd83-f330-43fa-a8c2-bc73105ad26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:27.578657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce18a93-44c6-475f-b4d2-43b418f91e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.581713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce18a93-44c6-475f-b4d2-43b418f91e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.582182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce18a93-44c6-475f-b4d2-43b418f91e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.582608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce18a93-44c6-475f-b4d2-43b418f91e50 admin admin] PATH_INFO: `/v3/projects/fbe28799f0a647dfaf12a93fc95de927/users/e486e2c0fb304519aeb698052c26e933/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.588382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce18a93-44c6-475f-b4d2-43b418f91e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe28799f0a647dfaf12a93fc95de927, user_id=e486e2c0fb304519aeb698052c26e933, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.592436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce18a93-44c6-475f-b4d2-43b418f91e50 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:27.627236 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2974/5920] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:27.628699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dbd83-f330-43fa-a8c2-bc73105ad26f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.647557 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2947/5921] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:27 2022] PUT /identity/v3/projects/fbe28799f0a647dfaf12a93fc95de927/users/e486e2c0fb304519aeb698052c26e933/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:27.650065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce18a93-44c6-475f-b4d2-43b418f91e50 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.669605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9dbd83-f330-43fa-a8c2-bc73105ad26f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.808716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce18a93-44c6-475f-b4d2-43b418f91e50 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.827906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6efe8-380b-4e80-ad7e-69711ec62ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.829280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6efe8-380b-4e80-ad7e-69711ec62ade admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.829579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6efe8-380b-4e80-ad7e-69711ec62ade admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.829854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6efe8-380b-4e80-ad7e-69711ec62ade admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.830626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6efe8-380b-4e80-ad7e-69711ec62ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.835140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de6efe8-380b-4e80-ad7e-69711ec62ade admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:27.837642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e5cfc-c888-4a66-9f47-42f6175acbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.839921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e5cfc-c888-4a66-9f47-42f6175acbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.840336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e5cfc-c888-4a66-9f47-42f6175acbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.842820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e5cfc-c888-4a66-9f47-42f6175acbf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.843968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e5cfc-c888-4a66-9f47-42f6175acbf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:27.844389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e5cfc-c888-4a66-9f47-42f6175acbf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.848611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e5cfc-c888-4a66-9f47-42f6175acbf6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:27.858395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:27.871186 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2948/5922] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:27 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:27.872188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6efe8-380b-4e80-ad7e-69711ec62ade admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.886132 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2975/5923] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:27.888573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e5cfc-c888-4a66-9f47-42f6175acbf6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.889998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6efe8-380b-4e80-ad7e-69711ec62ade admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.901503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef9365-71b1-4fdf-9ce8-80a2a07fa2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.902700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef9365-71b1-4fdf-9ce8-80a2a07fa2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.903102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef9365-71b1-4fdf-9ce8-80a2a07fa2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.903509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef9365-71b1-4fdf-9ce8-80a2a07fa2b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.904502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef9365-71b1-4fdf-9ce8-80a2a07fa2b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.907295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef9365-71b1-4fdf-9ce8-80a2a07fa2b5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:27.910891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e5cfc-c888-4a66-9f47-42f6175acbf6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.924915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e146d-39f9-477a-ad6e-f548b57b401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.925545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e146d-39f9-477a-ad6e-f548b57b401f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.925817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e146d-39f9-477a-ad6e-f548b57b401f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.926621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e146d-39f9-477a-ad6e-f548b57b401f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.926928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e146d-39f9-477a-ad6e-f548b57b401f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.933912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e146d-39f9-477a-ad6e-f548b57b401f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:27.944835 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2949/5924] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:27 2022] POST /identity/v3/users => generated 292 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:27.946162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef9365-71b1-4fdf-9ce8-80a2a07fa2b5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:27.971526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef9365-71b1-4fdf-9ce8-80a2a07fa2b5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:27.983345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf513e-18d9-4e52-9d59-889df0c04330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:27.984312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf513e-18d9-4e52-9d59-889df0c04330 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:27.984834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf513e-18d9-4e52-9d59-889df0c04330 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:27.985929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf513e-18d9-4e52-9d59-889df0c04330 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:27.986678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf513e-18d9-4e52-9d59-889df0c04330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:27.988915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf513e-18d9-4e52-9d59-889df0c04330 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.005752 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2950/5925] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:28.007188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf513e-18d9-4e52-9d59-889df0c04330 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.009985 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2976/5926] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:27 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:28.011043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e146d-39f9-477a-ad6e-f548b57b401f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.044606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf513e-18d9-4e52-9d59-889df0c04330 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.133400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c232ce-722c-4351-87a8-4d89cd421f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.134739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c232ce-722c-4351-87a8-4d89cd421f4a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.135239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c232ce-722c-4351-87a8-4d89cd421f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.135838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c232ce-722c-4351-87a8-4d89cd421f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.136962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c232ce-722c-4351-87a8-4d89cd421f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.140527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c232ce-722c-4351-87a8-4d89cd421f4a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.146302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:28.151899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e146d-39f9-477a-ad6e-f548b57b401f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.164554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1cd37-76cf-4d83-ab6c-976c202efc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.165574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1cd37-76cf-4d83-ab6c-976c202efc32 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.165574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1cd37-76cf-4d83-ab6c-976c202efc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.165865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1cd37-76cf-4d83-ab6c-976c202efc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.166636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1cd37-76cf-4d83-ab6c-976c202efc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.170086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1cd37-76cf-4d83-ab6c-976c202efc32 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.188507 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2951/5927] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:28 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:28.190111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c232ce-722c-4351-87a8-4d89cd421f4a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.198093 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2977/5928] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:28.198789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1cd37-76cf-4d83-ab6c-976c202efc32 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.227339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1cd37-76cf-4d83-ab6c-976c202efc32 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.300388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c232ce-722c-4351-87a8-4d89cd421f4a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.309196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbee2c-52a6-4313-82fd-a2684d7e721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.309977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbee2c-52a6-4313-82fd-a2684d7e721f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.310322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbee2c-52a6-4313-82fd-a2684d7e721f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.310661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbee2c-52a6-4313-82fd-a2684d7e721f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.311381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbee2c-52a6-4313-82fd-a2684d7e721f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.313725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbee2c-52a6-4313-82fd-a2684d7e721f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.332416 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2952/5929] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:28.332416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbee2c-52a6-4313-82fd-a2684d7e721f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.345858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbee2c-52a6-4313-82fd-a2684d7e721f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.356880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de0d1f-d291-42ff-8301-96544ebfa25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.361504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0d1f-d291-42ff-8301-96544ebfa25f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.361858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0d1f-d291-42ff-8301-96544ebfa25f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.362225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de0d1f-d291-42ff-8301-96544ebfa25f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.368875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0d1f-d291-42ff-8301-96544ebfa25f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.382223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fbce9-08c6-4eda-9e9f-869c133cce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.383116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fbce9-08c6-4eda-9e9f-869c133cce29 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.383564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fbce9-08c6-4eda-9e9f-869c133cce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.383925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fbce9-08c6-4eda-9e9f-869c133cce29 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.384669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fbce9-08c6-4eda-9e9f-869c133cce29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.384897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de0d1f-d291-42ff-8301-96544ebfa25f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.394035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fbce9-08c6-4eda-9e9f-869c133cce29 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.429962 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2953/5930] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:28 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:28.429962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de0d1f-d291-42ff-8301-96544ebfa25f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.448118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de0d1f-d291-42ff-8301-96544ebfa25f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.453612 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2978/5931] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:28 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:28.454765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fbce9-08c6-4eda-9e9f-869c133cce29 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.457492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44ace2-3194-4fe6-b6c3-1f353c5320bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.458429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44ace2-3194-4fe6-b6c3-1f353c5320bf admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.458716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44ace2-3194-4fe6-b6c3-1f353c5320bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.459066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44ace2-3194-4fe6-b6c3-1f353c5320bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.460249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44ace2-3194-4fe6-b6c3-1f353c5320bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.462484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44ace2-3194-4fe6-b6c3-1f353c5320bf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.468575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fbce9-08c6-4eda-9e9f-869c133cce29 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.475482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac244bf-00f6-4f44-b39f-6371961ba091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.477257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac244bf-00f6-4f44-b39f-6371961ba091 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.477541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac244bf-00f6-4f44-b39f-6371961ba091 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.477816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac244bf-00f6-4f44-b39f-6371961ba091 admin admin] PATH_INFO: `/v3/projects/af9fc6171bd6402b858ce0eb35eb3a0b/users/ae10deaf7b58448b9393e0233d45f5fa/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.479245 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2954/5932] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:28.480460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44ace2-3194-4fe6-b6c3-1f353c5320bf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.493354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44ace2-3194-4fe6-b6c3-1f353c5320bf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.508107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250df0c-ac45-4236-9240-15745b959778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.508750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250df0c-ac45-4236-9240-15745b959778 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.509140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250df0c-ac45-4236-9240-15745b959778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.509414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250df0c-ac45-4236-9240-15745b959778 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.510638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250df0c-ac45-4236-9240-15745b959778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.512939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250df0c-ac45-4236-9240-15745b959778 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.514858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac244bf-00f6-4f44-b39f-6371961ba091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9fc6171bd6402b858ce0eb35eb3a0b, user_id=ae10deaf7b58448b9393e0233d45f5fa, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.519670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac244bf-00f6-4f44-b39f-6371961ba091 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.531641 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2955/5933] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:28.531641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250df0c-ac45-4236-9240-15745b959778 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.543397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250df0c-ac45-4236-9240-15745b959778 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.553811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:28.566318 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2979/5934] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:28 2022] PUT /identity/v3/projects/af9fc6171bd6402b858ce0eb35eb3a0b/users/ae10deaf7b58448b9393e0233d45f5fa/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:28.567263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac244bf-00f6-4f44-b39f-6371961ba091 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.634455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a496927-44b6-41a2-b23b-1643a5a7baf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.635586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a496927-44b6-41a2-b23b-1643a5a7baf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.637033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a496927-44b6-41a2-b23b-1643a5a7baf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.637524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a496927-44b6-41a2-b23b-1643a5a7baf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.639889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a496927-44b6-41a2-b23b-1643a5a7baf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.641761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a496927-44b6-41a2-b23b-1643a5a7baf8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.670527 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2956/5935] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:28.672000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a496927-44b6-41a2-b23b-1643a5a7baf8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.688012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac244bf-00f6-4f44-b39f-6371961ba091 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.695831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f31846-342b-4297-95d5-13071646a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.696540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f31846-342b-4297-95d5-13071646a0ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.696875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f31846-342b-4297-95d5-13071646a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.697149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f31846-342b-4297-95d5-13071646a0ab admin admin] PATH_INFO: `/v3/projects/27d3b0718baf46b5a475337001ca7457/users/18ec86bd7e1c4a1cafcc195a6a16787b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.698621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a496927-44b6-41a2-b23b-1643a5a7baf8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.711090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea54f6-67ed-42a0-810b-f1b0b7956df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.713098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea54f6-67ed-42a0-810b-f1b0b7956df1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.714334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea54f6-67ed-42a0-810b-f1b0b7956df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.714848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea54f6-67ed-42a0-810b-f1b0b7956df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.717535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea54f6-67ed-42a0-810b-f1b0b7956df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.719739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f31846-342b-4297-95d5-13071646a0ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d3b0718baf46b5a475337001ca7457, user_id=18ec86bd7e1c4a1cafcc195a6a16787b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.722971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f31846-342b-4297-95d5-13071646a0ab admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.728825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea54f6-67ed-42a0-810b-f1b0b7956df1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.751117 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2957/5936] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:28.754787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7f5a3-5c14-4da8-ad73-5cdd3810c2e2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.757552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7f5a3-5c14-4da8-ad73-5cdd3810c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.758172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7f5a3-5c14-4da8-ad73-5cdd3810c2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.761328 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2980/5937] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:28 2022] PUT /identity/v3/projects/27d3b0718baf46b5a475337001ca7457/users/18ec86bd7e1c4a1cafcc195a6a16787b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:28.762651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f31846-342b-4297-95d5-13071646a0ab admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.808229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4ef7f5a3-5c14-4da8-ad73-5cdd3810c2e2 None None] MFA Rules not processed for user `ae10deaf7b58448b9393e0233d45f5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:28.810089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4ef7f5a3-5c14-4da8-ad73-5cdd3810c2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:28.844452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:28.896121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f31846-342b-4297-95d5-13071646a0ab admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.901757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b0f61-a4e2-4407-9bd4-c8b1fc6506c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.902544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b0f61-a4e2-4407-9bd4-c8b1fc6506c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.904436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b0f61-a4e2-4407-9bd4-c8b1fc6506c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.904727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b0f61-a4e2-4407-9bd4-c8b1fc6506c0 admin admin] PATH_INFO: `/v3/projects/dcf8b92cfd1f4a5d926c4d00d466b971/users/e6fcfde09e8a41f081047c2d824a22ad/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.910709 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2958/5938] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:28.912292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7f5a3-5c14-4da8-ad73-5cdd3810c2e2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.924507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b0f61-a4e2-4407-9bd4-c8b1fc6506c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf8b92cfd1f4a5d926c4d00d466b971, user_id=e6fcfde09e8a41f081047c2d824a22ad, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.925967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7f5a3-5c14-4da8-ad73-5cdd3810c2e2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:28.928257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b0f61-a4e2-4407-9bd4-c8b1fc6506c0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.933319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d0aa-93f3-4e24-82f7-b263112bee1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:28.934499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d0aa-93f3-4e24-82f7-b263112bee1a admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.935294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d0aa-93f3-4e24-82f7-b263112bee1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.935531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d0aa-93f3-4e24-82f7-b263112bee1a admin admin] PATH_INFO: `/v3/projects/7474543b5a054c7c8eea96c348cb8355/users/1a3d8bdceb0844e5ac66bbabf6c2d9a4/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.949337 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2981/5939] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:28 2022] PUT /identity/v3/projects/dcf8b92cfd1f4a5d926c4d00d466b971/users/e6fcfde09e8a41f081047c2d824a22ad/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:28.951604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41ec01-f34e-4e04-912d-48dee42bacc6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:28.952359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41ec01-f34e-4e04-912d-48dee42bacc6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:28.952824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41ec01-f34e-4e04-912d-48dee42bacc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:28.956301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7d0aa-93f3-4e24-82f7-b263112bee1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7474543b5a054c7c8eea96c348cb8355, user_id=1a3d8bdceb0844e5ac66bbabf6c2d9a4, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:28.959996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7d0aa-93f3-4e24-82f7-b263112bee1a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:28.984538 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2959/5940] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:28 2022] PUT /identity/v3/projects/7474543b5a054c7c8eea96c348cb8355/users/1a3d8bdceb0844e5ac66bbabf6c2d9a4/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:28.986017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d0aa-93f3-4e24-82f7-b263112bee1a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:28.993454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ce41ec01-f34e-4e04-912d-48dee42bacc6 None None] MFA Rules not processed for user `18ec86bd7e1c4a1cafcc195a6a16787b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:28.995229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ce41ec01-f34e-4e04-912d-48dee42bacc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:29.096323 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2982/5941] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:29.096323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41ec01-f34e-4e04-912d-48dee42bacc6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:29.130704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d0aa-93f3-4e24-82f7-b263112bee1a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:29.142647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb00e3f-a4ed-428e-bf71-310b01c66a5c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:29.143913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00e3f-a4ed-428e-bf71-310b01c66a5c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:29.144129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00e3f-a4ed-428e-bf71-310b01c66a5c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:29.144405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00e3f-a4ed-428e-bf71-310b01c66a5c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:29.145717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb00e3f-a4ed-428e-bf71-310b01c66a5c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:29.149208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb00e3f-a4ed-428e-bf71-310b01c66a5c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:29.162999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:29.188892 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2960/5942] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:44:28 2022] POST /identity/v3/domains => generated 276 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:29.190586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d07ef-21bb-46a3-94cc-261c95a4dcce None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:29.190735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d07ef-21bb-46a3-94cc-261c95a4dcce None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:29.191456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d07ef-21bb-46a3-94cc-261c95a4dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:29.212142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41ec01-f34e-4e04-912d-48dee42bacc6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:29.239042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-813d07ef-21bb-46a3-94cc-261c95a4dcce None None] MFA Rules not processed for user `1a3d8bdceb0844e5ac66bbabf6c2d9a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:29.241857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-813d07ef-21bb-46a3-94cc-261c95a4dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:29.321186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469a989-f69e-4a96-a404-e86687ca07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:29.322369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469a989-f69e-4a96-a404-e86687ca07d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:29.322861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469a989-f69e-4a96-a404-e86687ca07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:29.323335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469a989-f69e-4a96-a404-e86687ca07d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:29.324128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469a989-f69e-4a96-a404-e86687ca07d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:29.326173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469a989-f69e-4a96-a404-e86687ca07d3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:29.328599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:29.348630 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2983/5943] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:29.351307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469a989-f69e-4a96-a404-e86687ca07d3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:29.363184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469a989-f69e-4a96-a404-e86687ca07d3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:29.369565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ac89f-373f-417b-ac1e-327db5eabb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:29.370000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac89f-373f-417b-ac1e-327db5eabb45 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:29.370282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac89f-373f-417b-ac1e-327db5eabb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:29.370547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ac89f-373f-417b-ac1e-327db5eabb45 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:29.371192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ac89f-373f-417b-ac1e-327db5eabb45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:29.373895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9ac89f-373f-417b-ac1e-327db5eabb45 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:29.414996 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2984/5944] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:29 2022] POST /identity/v3/projects => generated 381 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:29.414996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ac89f-373f-417b-ac1e-327db5eabb45 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:29.460371 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2961/5945] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:29.461826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d07ef-21bb-46a3-94cc-261c95a4dcce None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:29.498940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d07ef-21bb-46a3-94cc-261c95a4dcce None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:29.560111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ac89f-373f-417b-ac1e-327db5eabb45 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:29.565750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acfbfe-10e4-4843-9646-57cf2b4b12fd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:29.566533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acfbfe-10e4-4843-9646-57cf2b4b12fd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:29.566880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acfbfe-10e4-4843-9646-57cf2b4b12fd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:29.567222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0acfbfe-10e4-4843-9646-57cf2b4b12fd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:29.568024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acfbfe-10e4-4843-9646-57cf2b4b12fd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:29.570360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0acfbfe-10e4-4843-9646-57cf2b4b12fd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:29.612032 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2985/5946] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:44:29 2022] POST /identity/v3/roles => generated 239 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:29.612032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acfbfe-10e4-4843-9646-57cf2b4b12fd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:29.679399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbafbf-148b-4fa9-bdc0-7264b7001642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:29.680082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbafbf-148b-4fa9-bdc0-7264b7001642 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:29.680356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbafbf-148b-4fa9-bdc0-7264b7001642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:29.680622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbafbf-148b-4fa9-bdc0-7264b7001642 admin admin] PATH_INFO: `/v3/projects/dcf8b92cfd1f4a5d926c4d00d466b971/users/e6fcfde09e8a41f081047c2d824a22ad/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:29.685587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbafbf-148b-4fa9-bdc0-7264b7001642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf8b92cfd1f4a5d926c4d00d466b971, user_id=e6fcfde09e8a41f081047c2d824a22ad, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:29.689773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbafbf-148b-4fa9-bdc0-7264b7001642 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:29.728244 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2962/5947] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:29 2022] PUT /identity/v3/projects/dcf8b92cfd1f4a5d926c4d00d466b971/users/e6fcfde09e8a41f081047c2d824a22ad/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:29.728244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbafbf-148b-4fa9-bdc0-7264b7001642 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:29.749014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0acfbfe-10e4-4843-9646-57cf2b4b12fd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:29.851931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbafbf-148b-4fa9-bdc0-7264b7001642 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:29.862696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21e4ad-14a8-414a-8e97-211a5a462c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:29.864573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21e4ad-14a8-414a-8e97-211a5a462c99 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:29.865110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21e4ad-14a8-414a-8e97-211a5a462c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:29.865577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21e4ad-14a8-414a-8e97-211a5a462c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:29.866666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21e4ad-14a8-414a-8e97-211a5a462c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:29.870355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21e4ad-14a8-414a-8e97-211a5a462c99 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:29.881408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2e4e8-56ea-4355-9801-973c9882be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:29.882548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e4e8-56ea-4355-9801-973c9882be2d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:29.883071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e4e8-56ea-4355-9801-973c9882be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:29.883500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2e4e8-56ea-4355-9801-973c9882be2d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:29.884166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2e4e8-56ea-4355-9801-973c9882be2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:29.886245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2e4e8-56ea-4355-9801-973c9882be2d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:29.914909 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2986/5948] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:29 2022] POST /identity/v3/users => generated 291 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:29.915108 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2963/5949] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:29 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:29.915190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2e4e8-56ea-4355-9801-973c9882be2d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:29.915292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896fc18-5a8d-4b7c-83b3-96e57d99e802 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:29.915292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896fc18-5a8d-4b7c-83b3-96e57d99e802 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:29.915292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896fc18-5a8d-4b7c-83b3-96e57d99e802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:29.922654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:29.929043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:29.951675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2896fc18-5a8d-4b7c-83b3-96e57d99e802 None None] MFA Rules not processed for user `e6fcfde09e8a41f081047c2d824a22ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:29.952686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2896fc18-5a8d-4b7c-83b3-96e57d99e802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:30.040204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2e4e8-56ea-4355-9801-973c9882be2d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:30.058779 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2964/5950] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:30.060214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615c39b-4d38-44fd-9643-83f4c88273b9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:30.060485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615c39b-4d38-44fd-9643-83f4c88273b9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:30.060753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615c39b-4d38-44fd-9643-83f4c88273b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:30.105110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6615c39b-4d38-44fd-9643-83f4c88273b9 None None] MFA Rules not processed for user `e486e2c0fb304519aeb698052c26e933`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:30.106225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6615c39b-4d38-44fd-9643-83f4c88273b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:30.182732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ba9b5-2cec-4f75-8dd0-5cebe16d5aca tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:30.183387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ba9b5-2cec-4f75-8dd0-5cebe16d5aca tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:30.186165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ba9b5-2cec-4f75-8dd0-5cebe16d5aca tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:30.189386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ba9b5-2cec-4f75-8dd0-5cebe16d5aca tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/3f55ebb47ccc4eae9e1e5d009cf648fb/users/ae10deaf7b58448b9393e0233d45f5fa/roles/c3f2bd7676574e77969fee948d365700` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:30.230450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ba9b5-2cec-4f75-8dd0-5cebe16d5aca tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=3f55ebb47ccc4eae9e1e5d009cf648fb, user_id=ae10deaf7b58448b9393e0233d45f5fa, role_id=c3f2bd7676574e77969fee948d365700)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:30.238268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ba9b5-2cec-4f75-8dd0-5cebe16d5aca tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:30.276783 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2987/5951] 10.222.0.43 () {60 vars in 1480 bytes} [Tue Aug 30 04:44:29 2022] PUT /identity/v3/domains/3f55ebb47ccc4eae9e1e5d009cf648fb/users/ae10deaf7b58448b9393e0233d45f5fa/roles/c3f2bd7676574e77969fee948d365700 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:30.281809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ba9b5-2cec-4f75-8dd0-5cebe16d5aca tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:30.332464 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2965/5952] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:30.335313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615c39b-4d38-44fd-9643-83f4c88273b9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:30.384450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ba9b5-2cec-4f75-8dd0-5cebe16d5aca tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:30.394686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86a451-20fc-4ade-b54c-c79dd7720a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:30.395333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86a451-20fc-4ade-b54c-c79dd7720a0f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:30.395629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86a451-20fc-4ade-b54c-c79dd7720a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:30.396073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86a451-20fc-4ade-b54c-c79dd7720a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:30.396741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86a451-20fc-4ade-b54c-c79dd7720a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:30.400254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86a451-20fc-4ade-b54c-c79dd7720a0f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:30.440626 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2988/5953] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:30 2022] GET /identity/v3/roles => generated 1650 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:30.444071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86a451-20fc-4ade-b54c-c79dd7720a0f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:30.456716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615c39b-4d38-44fd-9643-83f4c88273b9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:30.463302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14882ec-e368-4585-a65e-32b12ff4367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:30.464882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14882ec-e368-4585-a65e-32b12ff4367a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:30.465552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14882ec-e368-4585-a65e-32b12ff4367a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:30.466060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14882ec-e368-4585-a65e-32b12ff4367a admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:30.466859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14882ec-e368-4585-a65e-32b12ff4367a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:30.469739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14882ec-e368-4585-a65e-32b12ff4367a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:30.500765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:30.508884 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2966/5954] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:30 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:30.510109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14882ec-e368-4585-a65e-32b12ff4367a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:30.519427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:30.543703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86a451-20fc-4ade-b54c-c79dd7720a0f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:30.549435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62273870-cdd2-45c8-a144-f4f8095097f9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:30.550320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273870-cdd2-45c8-a144-f4f8095097f9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:30.550666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273870-cdd2-45c8-a144-f4f8095097f9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:30.551141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62273870-cdd2-45c8-a144-f4f8095097f9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:30.552058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62273870-cdd2-45c8-a144-f4f8095097f9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:30.553296 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-62273870-cdd2-45c8-a144-f4f8095097f9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:30.553296 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:44:30.553296 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:30.554397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62273870-cdd2-45c8-a144-f4f8095097f9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:30.585978 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2989/5955] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:44:30 2022] POST /identity/v3/regions => generated 224 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:30.587717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a8421-4682-43a7-949a-0c213a027f2e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:30.588000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a8421-4682-43a7-949a-0c213a027f2e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:30.588356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a8421-4682-43a7-949a-0c213a027f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:30.598213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14882ec-e368-4585-a65e-32b12ff4367a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:30.614837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f73a8421-4682-43a7-949a-0c213a027f2e None None] MFA Rules not processed for user `6bdc957ddc1c4418a400179e6a6688ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:30.616319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f73a8421-4682-43a7-949a-0c213a027f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:30.616698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a95f-dd4e-4da4-9784-fc4e0049a30c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:30.617385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a95f-dd4e-4da4-9784-fc4e0049a30c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:30.618009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a95f-dd4e-4da4-9784-fc4e0049a30c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:30.618282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54a95f-dd4e-4da4-9784-fc4e0049a30c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:30.618991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a95f-dd4e-4da4-9784-fc4e0049a30c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:30.621090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54a95f-dd4e-4da4-9784-fc4e0049a30c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:30.669913 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2967/5956] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:44:30 2022] POST /identity/v3/domains => generated 276 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:30.670873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a95f-dd4e-4da4-9784-fc4e0049a30c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:30.721184 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2990/5957] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:30.722384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a8421-4682-43a7-949a-0c213a027f2e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:30.751584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a8421-4682-43a7-949a-0c213a027f2e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:30.776922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54a95f-dd4e-4da4-9784-fc4e0049a30c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:30.782718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e434a-e303-432a-8417-e43bd5f40f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:30.783481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e434a-e303-432a-8417-e43bd5f40f43 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:30.783865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e434a-e303-432a-8417-e43bd5f40f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:30.784409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e434a-e303-432a-8417-e43bd5f40f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:30.785213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e434a-e303-432a-8417-e43bd5f40f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:30.787196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e434a-e303-432a-8417-e43bd5f40f43 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:30.808532 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2968/5958] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:30 2022] GET /identity/v3/roles => generated 1650 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:30.811316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e434a-e303-432a-8417-e43bd5f40f43 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:30.859081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e32f4d-70cc-4579-8c03-6a93856dffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:30.859991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e32f4d-70cc-4579-8c03-6a93856dffc8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:30.860517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e32f4d-70cc-4579-8c03-6a93856dffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:30.860915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e32f4d-70cc-4579-8c03-6a93856dffc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:30.861829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e32f4d-70cc-4579-8c03-6a93856dffc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:30.863828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e32f4d-70cc-4579-8c03-6a93856dffc8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:30.882619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2991/5959] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:30 2022] GET /identity/v3/roles => generated 1650 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:30.882619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e32f4d-70cc-4579-8c03-6a93856dffc8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:30.954310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e434a-e303-432a-8417-e43bd5f40f43 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:30.957783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:30.959937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7d128-2428-4347-842f-76ca74ef0698 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:30.960646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7d128-2428-4347-842f-76ca74ef0698 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:30.966299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7d128-2428-4347-842f-76ca74ef0698 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:30.966599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7d128-2428-4347-842f-76ca74ef0698 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:30.967482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7d128-2428-4347-842f-76ca74ef0698 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:30.968544 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-b0f7d128-2428-4347-842f-76ca74ef0698 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:30.968544 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:44:30.968544 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:44:30.969458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f7d128-2428-4347-842f-76ca74ef0698 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:30.996239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e32f4d-70cc-4579-8c03-6a93856dffc8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:31.008335 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2969/5960] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:44:30 2022] POST /identity/v3/regions => generated 224 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:31.009661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7d128-2428-4347-842f-76ca74ef0698 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:31.012515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b0f7d128-2428-4347-842f-76ca74ef0698 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:31.030741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:31.031855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d75c9-c5b7-43cc-8a71-e154d9c4be70 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:31.032538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d75c9-c5b7-43cc-8a71-e154d9c4be70 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:31.033034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d75c9-c5b7-43cc-8a71-e154d9c4be70 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:31.033176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d75c9-c5b7-43cc-8a71-e154d9c4be70 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:31.034112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d75c9-c5b7-43cc-8a71-e154d9c4be70 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:31.035834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d75c9-c5b7-43cc-8a71-e154d9c4be70 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:31.064556 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2992/5961] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:44:30 2022] POST /identity/v3/roles => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:31.065702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d75c9-c5b7-43cc-8a71-e154d9c4be70 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:31.095005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d75c9-c5b7-43cc-8a71-e154d9c4be70 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:31.108075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ad37-f60c-45d7-8f72-7b68d805e225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:31.108771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ad37-f60c-45d7-8f72-7b68d805e225 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:31.109047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ad37-f60c-45d7-8f72-7b68d805e225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:31.109320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28ad37-f60c-45d7-8f72-7b68d805e225 admin admin] PATH_INFO: `/v3/projects/210ea363af0e43f9957b724cda272a0d/users/42dcc29830b948e09d429716dac362db/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:31.139054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28ad37-f60c-45d7-8f72-7b68d805e225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210ea363af0e43f9957b724cda272a0d, user_id=42dcc29830b948e09d429716dac362db, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:31.142037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28ad37-f60c-45d7-8f72-7b68d805e225 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:31.164119 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2993/5962] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:31 2022] PUT /identity/v3/projects/210ea363af0e43f9957b724cda272a0d/users/42dcc29830b948e09d429716dac362db/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:31.165119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ad37-f60c-45d7-8f72-7b68d805e225 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:31.197747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7d128-2428-4347-842f-76ca74ef0698 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:31.287737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e701b1-8dcd-4ed7-aeb6-4a231bfcc668 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:31.288640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e701b1-8dcd-4ed7-aeb6-4a231bfcc668 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:31.288990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e701b1-8dcd-4ed7-aeb6-4a231bfcc668 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:31.289422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e701b1-8dcd-4ed7-aeb6-4a231bfcc668 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:31.301635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e2e701b1-8dcd-4ed7-aeb6-4a231bfcc668 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:31.337735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28ad37-f60c-45d7-8f72-7b68d805e225 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:31.350825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57409bdd-c877-4ec7-83b0-ef2ae5457aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:31.351223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57409bdd-c877-4ec7-83b0-ef2ae5457aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:31.351501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57409bdd-c877-4ec7-83b0-ef2ae5457aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:31.351774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57409bdd-c877-4ec7-83b0-ef2ae5457aeb admin admin] PATH_INFO: `/v3/projects/e5656e30f7844813a26e087462541e37/users/7acb4ee8aa46430a96e62e76e8e7118b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:31.379838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57409bdd-c877-4ec7-83b0-ef2ae5457aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5656e30f7844813a26e087462541e37, user_id=7acb4ee8aa46430a96e62e76e8e7118b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:31.382861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57409bdd-c877-4ec7-83b0-ef2ae5457aeb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:31.406916 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2994/5963] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:31 2022] PUT /identity/v3/projects/e5656e30f7844813a26e087462541e37/users/7acb4ee8aa46430a96e62e76e8e7118b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:31.408053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57409bdd-c877-4ec7-83b0-ef2ae5457aeb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:31.486361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e701b1-8dcd-4ed7-aeb6-4a231bfcc668 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:31.488035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e701b1-8dcd-4ed7-aeb6-4a231bfcc668 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:31.535256 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2970/5964] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:31.536220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e701b1-8dcd-4ed7-aeb6-4a231bfcc668 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:31.666313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57409bdd-c877-4ec7-83b0-ef2ae5457aeb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:31.711440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:31.720763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893653b-2762-4fbb-96d3-a31064b80148 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:31.721647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893653b-2762-4fbb-96d3-a31064b80148 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:31.722160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893653b-2762-4fbb-96d3-a31064b80148 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:31.722520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893653b-2762-4fbb-96d3-a31064b80148 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions/f045892d-0eb6-4586-9f2b-0b85867857e8` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:31.723342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893653b-2762-4fbb-96d3-a31064b80148 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:create_region(region_id=f045892d-0eb6-4586-9f2b-0b85867857e8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:31.725324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893653b-2762-4fbb-96d3-a31064b80148 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:31.779287 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2995/5965] 10.222.0.43 () {60 vars in 1259 bytes} [Tue Aug 30 04:44:31 2022] PUT /identity/v3/regions/f045892d-0eb6-4586-9f2b-0b85867857e8 => generated 232 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:31.783716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491f914-2ec2-47f8-b84f-fad42b63cab4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:31.785968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491f914-2ec2-47f8-b84f-fad42b63cab4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:31.786344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491f914-2ec2-47f8-b84f-fad42b63cab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:31.809505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:31.858473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e701b1-8dcd-4ed7-aeb6-4a231bfcc668 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:31.872514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5491f914-2ec2-47f8-b84f-fad42b63cab4 None None] MFA Rules not processed for user `42dcc29830b948e09d429716dac362db`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:31.873902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5491f914-2ec2-47f8-b84f-fad42b63cab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:32.049141 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2996/5966] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:32.052361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491f914-2ec2-47f8-b84f-fad42b63cab4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:32.063879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98784bb4-3cf6-4e19-bda1-063058a25de5 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:32.066956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98784bb4-3cf6-4e19-bda1-063058a25de5 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.067582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98784bb4-3cf6-4e19-bda1-063058a25de5 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.069201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98784bb4-3cf6-4e19-bda1-063058a25de5 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/groups` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:32.070270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98784bb4-3cf6-4e19-bda1-063058a25de5 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:32.076395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98784bb4-3cf6-4e19-bda1-063058a25de5 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:32.155956 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2971/5967] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:44:31 2022] POST /identity/v3/groups => generated 326 bytes in 617 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:32.155956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98784bb4-3cf6-4e19-bda1-063058a25de5 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:32.227472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98784bb4-3cf6-4e19-bda1-063058a25de5 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:32.239860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b850a-1370-4129-90f0-6f1502f8da7f tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:32.243438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b850a-1370-4129-90f0-6f1502f8da7f tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.245073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b850a-1370-4129-90f0-6f1502f8da7f tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.245463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b850a-1370-4129-90f0-6f1502f8da7f tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions/f045892d-0eb6-4586-9f2b-0b85867857e8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:32.246129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b850a-1370-4129-90f0-6f1502f8da7f tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f045892d-0eb6-4586-9f2b-0b85867857e8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:32.249025 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-ea5b850a-1370-4129-90f0-6f1502f8da7f tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:32.249025 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:44:32.249025 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:44:32.250951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b850a-1370-4129-90f0-6f1502f8da7f tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:32.270375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491f914-2ec2-47f8-b84f-fad42b63cab4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:32.276638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a914b7-f71e-4ce3-8cc1-e6c0cf59bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:32.277775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a914b7-f71e-4ce3-8cc1-e6c0cf59bf96 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.278284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a914b7-f71e-4ce3-8cc1-e6c0cf59bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.278754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a914b7-f71e-4ce3-8cc1-e6c0cf59bf96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:32.279583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a914b7-f71e-4ce3-8cc1-e6c0cf59bf96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:32.281620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a914b7-f71e-4ce3-8cc1-e6c0cf59bf96 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:32.298111 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2997/5968] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:32 2022] GET /identity/v3/roles => generated 1881 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:32.299415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a914b7-f71e-4ce3-8cc1-e6c0cf59bf96 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:32.301575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-07a914b7-f71e-4ce3-8cc1-e6c0cf59bf96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:32.306744 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2972/5969] 10.222.0.43 () {58 vars in 1242 bytes} [Tue Aug 30 04:44:32 2022] DELETE /identity/v3/regions/f045892d-0eb6-4586-9f2b-0b85867857e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:32.308377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b850a-1370-4129-90f0-6f1502f8da7f tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:32.318133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a914b7-f71e-4ce3-8cc1-e6c0cf59bf96 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:32.346576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:32.347552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.347552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.347885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] PATH_INFO: `/v3/users/b7e84a21f10145f0aeed3ab41ecdfca2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:32.351313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e84a21f10145f0aeed3ab41ecdfca2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:32.354319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:32.358970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b850a-1370-4129-90f0-6f1502f8da7f tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:32.370849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43957a65-c85a-4d88-a98a-76a1d60061af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:32.371485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43957a65-c85a-4d88-a98a-76a1d60061af admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.371938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43957a65-c85a-4d88-a98a-76a1d60061af admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.372831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43957a65-c85a-4d88-a98a-76a1d60061af admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:32.373557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43957a65-c85a-4d88-a98a-76a1d60061af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:32.375702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43957a65-c85a-4d88-a98a-76a1d60061af admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:32.431589 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2973/5970] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:32 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:32.432753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43957a65-c85a-4d88-a98a-76a1d60061af admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:32.483105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e84a21f10145f0aeed3ab41ecdfca2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:32.483787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e84a21f10145f0aeed3ab41ecdfca2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:32.497725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e84a21f10145f0aeed3ab41ecdfca2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:32.502773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:32.518664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e84a21f10145f0aeed3ab41ecdfca2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:32.521678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:32.545904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e84a21f10145f0aeed3ab41ecdfca2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:32.554065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43957a65-c85a-4d88-a98a-76a1d60061af admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:32.556982 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2998/5971] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:32 2022] DELETE /identity/v3/users/b7e84a21f10145f0aeed3ab41ecdfca2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:32.559726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:32.564435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:32.667990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0745c01-aac1-463d-9255-057251d80111 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:32.669210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0745c01-aac1-463d-9255-057251d80111 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.669718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0745c01-aac1-463d-9255-057251d80111 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.670179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0745c01-aac1-463d-9255-057251d80111 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/groups/21f181e1d90f4b04bb5313dda48b04bf/users/ae10deaf7b58448b9393e0233d45f5fa` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:32.685437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0745c01-aac1-463d-9255-057251d80111 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=21f181e1d90f4b04bb5313dda48b04bf, user_id=ae10deaf7b58448b9393e0233d45f5fa)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:32.685748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8935f-a2cc-4fbb-9016-cf0834ac6ea9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:32.688036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0745c01-aac1-463d-9255-057251d80111 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:32.702590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3280f-21e7-4d46-ba90-d44682c7fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:32.704072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3280f-21e7-4d46-ba90-d44682c7fd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.704707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3280f-21e7-4d46-ba90-d44682c7fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.705567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3280f-21e7-4d46-ba90-d44682c7fd96 admin admin] PATH_INFO: `/v3/projects/e5656e30f7844813a26e087462541e37/users/7acb4ee8aa46430a96e62e76e8e7118b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:32.708263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3280f-21e7-4d46-ba90-d44682c7fd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5656e30f7844813a26e087462541e37, user_id=7acb4ee8aa46430a96e62e76e8e7118b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:32.711566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3280f-21e7-4d46-ba90-d44682c7fd96 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:32.721216 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2974/5972] 10.222.0.43 () {60 vars in 1360 bytes} [Tue Aug 30 04:44:32 2022] PUT /identity/v3/groups/21f181e1d90f4b04bb5313dda48b04bf/users/ae10deaf7b58448b9393e0233d45f5fa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:32.722495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0745c01-aac1-463d-9255-057251d80111 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:32.724375 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 2999/5973] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:32 2022] PUT /identity/v3/projects/e5656e30f7844813a26e087462541e37/users/7acb4ee8aa46430a96e62e76e8e7118b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:32.724601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c0745c01-aac1-463d-9255-057251d80111 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:32.725386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3280f-21e7-4d46-ba90-d44682c7fd96 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:32.735538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-11e3280f-21e7-4d46-ba90-d44682c7fd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:32.831061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3280f-21e7-4d46-ba90-d44682c7fd96 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:32.838771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e724776-2a9f-461e-bdfc-8e1ae43aa4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:32.840472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724776-2a9f-461e-bdfc-8e1ae43aa4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.841674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0745c01-aac1-463d-9255-057251d80111 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:32.842733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724776-2a9f-461e-bdfc-8e1ae43aa4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.843107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e724776-2a9f-461e-bdfc-8e1ae43aa4e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:32.844511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e724776-2a9f-461e-bdfc-8e1ae43aa4e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:32.847433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e724776-2a9f-461e-bdfc-8e1ae43aa4e9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:32.886336 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3000/5974] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:32 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:32.889381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4cbd6-0fc2-4ed8-b3a3-5b649de27a2a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.889867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4cbd6-0fc2-4ed8-b3a3-5b649de27a2a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.890306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4cbd6-0fc2-4ed8-b3a3-5b649de27a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:32.923103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6ee4cbd6-0fc2-4ed8-b3a3-5b649de27a2a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:32.925064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6ee4cbd6-0fc2-4ed8-b3a3-5b649de27a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:32.938792 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3001/5975] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:32.939889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4cbd6-0fc2-4ed8-b3a3-5b649de27a2a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:32.941511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6ee4cbd6-0fc2-4ed8-b3a3-5b649de27a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:32.943568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ce31f-c49c-4215-8acc-ec89b81cc187 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:32.945580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ce31f-c49c-4215-8acc-ec89b81cc187 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.945859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ce31f-c49c-4215-8acc-ec89b81cc187 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.946161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ce31f-c49c-4215-8acc-ec89b81cc187 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:32.946823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ce31f-c49c-4215-8acc-ec89b81cc187 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:32.952696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ce31f-c49c-4215-8acc-ec89b81cc187 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:32.968993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:32.991592 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2975/5976] 10.222.0.43 () {60 vars in 1150 bytes} [Tue Aug 30 04:44:32 2022] POST /identity/v3/regions => generated 254 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:32.993525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a762e4-26b4-4d55-9001-59b654ed5100 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:32.993966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a762e4-26b4-4d55-9001-59b654ed5100 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:32.994460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a762e4-26b4-4d55-9001-59b654ed5100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:33.033462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-17a762e4-26b4-4d55-9001-59b654ed5100 None None] MFA Rules not processed for user `7acb4ee8aa46430a96e62e76e8e7118b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:33.034740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-17a762e4-26b4-4d55-9001-59b654ed5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:33.064654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4cbd6-0fc2-4ed8-b3a3-5b649de27a2a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:33.073159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:33.088703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287b16a-033b-4931-83aa-42fca61add5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:33.090541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287b16a-033b-4931-83aa-42fca61add5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:33.090985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287b16a-033b-4931-83aa-42fca61add5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:33.091526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287b16a-033b-4931-83aa-42fca61add5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/4b2e570d86f74ee9a3e4b6841a83fee0/groups/21f181e1d90f4b04bb5313dda48b04bf/roles/bc1454faf05e44bfbb10ab20f1af111c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:33.095322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287b16a-033b-4931-83aa-42fca61add5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=4b2e570d86f74ee9a3e4b6841a83fee0, group_id=21f181e1d90f4b04bb5313dda48b04bf, role_id=bc1454faf05e44bfbb10ab20f1af111c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:33.098524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287b16a-033b-4931-83aa-42fca61add5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:33.119783 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3002/5977] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:32 2022] PUT /identity/v3/domains/4b2e570d86f74ee9a3e4b6841a83fee0/groups/21f181e1d90f4b04bb5313dda48b04bf/roles/bc1454faf05e44bfbb10ab20f1af111c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:33.120893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287b16a-033b-4931-83aa-42fca61add5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:33.138691 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2976/5978] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:33.138691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a762e4-26b4-4d55-9001-59b654ed5100 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:33.138691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-17a762e4-26b4-4d55-9001-59b654ed5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:33.225689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287b16a-033b-4931-83aa-42fca61add5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:33.231644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c425c-d408-44f4-9f66-6ad43186f005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:33.232482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c425c-d408-44f4-9f66-6ad43186f005 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:33.232651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c425c-d408-44f4-9f66-6ad43186f005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:33.232920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c425c-d408-44f4-9f66-6ad43186f005 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:33.233570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c425c-d408-44f4-9f66-6ad43186f005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:33.235616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c425c-d408-44f4-9f66-6ad43186f005 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:33.250030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a762e4-26b4-4d55-9001-59b654ed5100 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:33.250847 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3003/5979] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:33 2022] GET /identity/v3/roles => generated 1881 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:33.251928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c425c-d408-44f4-9f66-6ad43186f005 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:33.337329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5fdd1-943c-4dc9-afa4-33fc6dcdb72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:33.338747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5fdd1-943c-4dc9-afa4-33fc6dcdb72f service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:33.339027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5fdd1-943c-4dc9-afa4-33fc6dcdb72f service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:33.339305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5fdd1-943c-4dc9-afa4-33fc6dcdb72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:33.352193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5fdd1-943c-4dc9-afa4-33fc6dcdb72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:33.354816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5fdd1-943c-4dc9-afa4-33fc6dcdb72f service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:33.359220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c425c-d408-44f4-9f66-6ad43186f005 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:33.366976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec880c1d-dd3d-4352-b1a6-77726fb3bcf5 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:33.368603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880c1d-dd3d-4352-b1a6-77726fb3bcf5 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:33.369146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880c1d-dd3d-4352-b1a6-77726fb3bcf5 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:33.369589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec880c1d-dd3d-4352-b1a6-77726fb3bcf5 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions/562ab52da24a4dafb6dfb0f6cec491f5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:33.370379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec880c1d-dd3d-4352-b1a6-77726fb3bcf5 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:update_region(region_id=562ab52da24a4dafb6dfb0f6cec491f5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:33.371125 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2977/5980] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:33.371627 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-ec880c1d-dd3d-4352-b1a6-77726fb3bcf5 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:33.371627 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:44:33.371627 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:33.372014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5fdd1-943c-4dc9-afa4-33fc6dcdb72f service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:33.372957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec880c1d-dd3d-4352-b1a6-77726fb3bcf5 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:33.412990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:33.413251 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3004/5981] 10.222.0.43 () {60 vars in 1250 bytes} [Tue Aug 30 04:44:33 2022] PATCH /identity/v3/regions/562ab52da24a4dafb6dfb0f6cec491f5 => generated 254 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:33.414124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec880c1d-dd3d-4352-b1a6-77726fb3bcf5 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:33.515583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5fdd1-943c-4dc9-afa4-33fc6dcdb72f service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:33.554022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cf702-5813-4ca0-a460-f48b5793fc86 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:33.555676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cf702-5813-4ca0-a460-f48b5793fc86 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:33.555676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cf702-5813-4ca0-a460-f48b5793fc86 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:33.555676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cf702-5813-4ca0-a460-f48b5793fc86 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:33.559049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cf702-5813-4ca0-a460-f48b5793fc86 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:33.563129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2cf702-5813-4ca0-a460-f48b5793fc86 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:33.568117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:33.625784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec880c1d-dd3d-4352-b1a6-77726fb3bcf5 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:33.628325 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2978/5982] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:44:33 2022] POST /identity/v3/domains => generated 276 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:33.629321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cf702-5813-4ca0-a460-f48b5793fc86 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:33.710559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413799a-8974-46c2-a8fa-4d8a625752e8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:33.713168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413799a-8974-46c2-a8fa-4d8a625752e8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:33.713589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413799a-8974-46c2-a8fa-4d8a625752e8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:33.714922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413799a-8974-46c2-a8fa-4d8a625752e8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:33.716057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413799a-8974-46c2-a8fa-4d8a625752e8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:33.718008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413799a-8974-46c2-a8fa-4d8a625752e8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:33.768645 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3005/5983] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:33 2022] POST /identity/v3/services => generated 287 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:33.769695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413799a-8974-46c2-a8fa-4d8a625752e8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:33.807358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cf702-5813-4ca0-a460-f48b5793fc86 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:33.829633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c0908-6697-443a-a3a7-e438a0f86b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:33.830476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c0908-6697-443a-a3a7-e438a0f86b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:33.830931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c0908-6697-443a-a3a7-e438a0f86b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:33.831299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c0908-6697-443a-a3a7-e438a0f86b81 admin admin] PATH_INFO: `/v3/projects/1d349f9666934347a9153fa11e7808fd/users/5a757a1b4af04798a1a067abfb1e6a83/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:33.863322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c0908-6697-443a-a3a7-e438a0f86b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d349f9666934347a9153fa11e7808fd, user_id=5a757a1b4af04798a1a067abfb1e6a83, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:33.871359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c0908-6697-443a-a3a7-e438a0f86b81 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:33.900880 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2979/5984] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:33 2022] PUT /identity/v3/projects/1d349f9666934347a9153fa11e7808fd/users/5a757a1b4af04798a1a067abfb1e6a83/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:33.908292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c0908-6697-443a-a3a7-e438a0f86b81 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:33.927214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413799a-8974-46c2-a8fa-4d8a625752e8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.016104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c0908-6697-443a-a3a7-e438a0f86b81 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.023126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e509e2-3e02-42c7-b579-bf431f003d03 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.023646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e509e2-3e02-42c7-b579-bf431f003d03 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.023930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e509e2-3e02-42c7-b579-bf431f003d03 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.024199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e509e2-3e02-42c7-b579-bf431f003d03 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.024882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e509e2-3e02-42c7-b579-bf431f003d03 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.026628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e509e2-3e02-42c7-b579-bf431f003d03 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.038961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247064c4-2dbf-49d0-a087-54962649246a tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.040089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247064c4-2dbf-49d0-a087-54962649246a tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.040578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247064c4-2dbf-49d0-a087-54962649246a tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.041259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247064c4-2dbf-49d0-a087-54962649246a tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions/562ab52da24a4dafb6dfb0f6cec491f5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.043598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247064c4-2dbf-49d0-a087-54962649246a tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:get_region(region_id=562ab52da24a4dafb6dfb0f6cec491f5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.045017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247064c4-2dbf-49d0-a087-54962649246a tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.046177 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2980/5985] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:44:33 2022] POST /identity/v3/roles => generated 240 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:34.047752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e509e2-3e02-42c7-b579-bf431f003d03 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:34.053736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:34.055234 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3006/5986] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:44:33 2022] GET /identity/v3/regions/562ab52da24a4dafb6dfb0f6cec491f5 => generated 254 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:34.057099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247064c4-2dbf-49d0-a087-54962649246a tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:34.086532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:34.157842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247064c4-2dbf-49d0-a087-54962649246a tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.164306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de26f-14ce-47c6-a2ae-07f393bf5538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.165991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de26f-14ce-47c6-a2ae-07f393bf5538 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.166773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de26f-14ce-47c6-a2ae-07f393bf5538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.167180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de26f-14ce-47c6-a2ae-07f393bf5538 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.168649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142de26f-14ce-47c6-a2ae-07f393bf5538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.170537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142de26f-14ce-47c6-a2ae-07f393bf5538 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.176287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e509e2-3e02-42c7-b579-bf431f003d03 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.187374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcf62b-222c-477b-8f52-ae08deeea9d2 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.188335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcf62b-222c-477b-8f52-ae08deeea9d2 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.188632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcf62b-222c-477b-8f52-ae08deeea9d2 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.188983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcf62b-222c-477b-8f52-ae08deeea9d2 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.189802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcf62b-222c-477b-8f52-ae08deeea9d2 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.192420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcf62b-222c-477b-8f52-ae08deeea9d2 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.197069 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3007/5987] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:34 2022] GET /identity/v3/roles => generated 2112 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:34.197069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de26f-14ce-47c6-a2ae-07f393bf5538 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:34.210159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-142de26f-14ce-47c6-a2ae-07f393bf5538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:34.232945 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-d3bcf62b-222c-477b-8f52-ae08deeea9d2 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-136156497. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:34.232945 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:34.232945 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:44:34.241244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de26f-14ce-47c6-a2ae-07f393bf5538 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.263357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.264270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.264634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.265017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] PATH_INFO: `/v3/projects/7c1f73a12eda43cfa10a2f6a3d1aa14b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.266431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1f73a12eda43cfa10a2f6a3d1aa14b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.272858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.287490 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2981/5988] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Aug 30 04:44:34 2022] POST /identity/v3/endpoints => generated 359 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:34.288485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcf62b-222c-477b-8f52-ae08deeea9d2 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:34.326593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcf62b-222c-477b-8f52-ae08deeea9d2 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.335460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3d0fb-d1cd-4f9f-98b4-d3432eb2a96b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.336546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d0fb-d1cd-4f9f-98b4-d3432eb2a96b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.337043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d0fb-d1cd-4f9f-98b4-d3432eb2a96b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.337538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3d0fb-d1cd-4f9f-98b4-d3432eb2a96b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/a0353903cad941a08963bf66848a2ea4/users/ae10deaf7b58448b9393e0233d45f5fa/roles/7e6db311900c4a02a7ef03f0966dc194` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.360976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3d0fb-d1cd-4f9f-98b4-d3432eb2a96b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=a0353903cad941a08963bf66848a2ea4, user_id=ae10deaf7b58448b9393e0233d45f5fa, role_id=7e6db311900c4a02a7ef03f0966dc194)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.365406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3d0fb-d1cd-4f9f-98b4-d3432eb2a96b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.370394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1f73a12eda43cfa10a2f6a3d1aa14b', 'request_id': 'req-1b69243e-c9cd-4411-8a0c-1480627852e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:34.381377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1f73a12eda43cfa10a2f6a3d1aa14b', 'request_id': 'req-1b69243e-c9cd-4411-8a0c-1480627852e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:34.393995 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2982/5989] 10.222.0.43 () {60 vars in 1480 bytes} [Tue Aug 30 04:44:34 2022] PUT /identity/v3/domains/a0353903cad941a08963bf66848a2ea4/users/ae10deaf7b58448b9393e0233d45f5fa/roles/7e6db311900c4a02a7ef03f0966dc194 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:34.396029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1f73a12eda43cfa10a2f6a3d1aa14b', 'request_id': 'req-1b69243e-c9cd-4411-8a0c-1480627852e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:34.396593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3d0fb-d1cd-4f9f-98b4-d3432eb2a96b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:34.419049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] The token cache is being invalidate because project 7c1f73a12eda43cfa10a2f6a3d1aa14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:34.419739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:34.420605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:34.423118 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3008/5990] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:34 2022] DELETE /identity/v3/projects/7c1f73a12eda43cfa10a2f6a3d1aa14b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:34.424229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:34.426674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:34.508114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3d0fb-d1cd-4f9f-98b4-d3432eb2a96b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.514167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e8769-4fb7-4e93-9e0a-2d6f3047b887 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.514806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e8769-4fb7-4e93-9e0a-2d6f3047b887 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.515089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e8769-4fb7-4e93-9e0a-2d6f3047b887 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.515359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e8769-4fb7-4e93-9e0a-2d6f3047b887 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions/562ab52da24a4dafb6dfb0f6cec491f5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.516142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e8769-4fb7-4e93-9e0a-2d6f3047b887 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:delete_region(region_id=562ab52da24a4dafb6dfb0f6cec491f5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.518027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e8769-4fb7-4e93-9e0a-2d6f3047b887 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.523456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69243e-c9cd-4411-8a0c-1480627852e6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.543150 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2983/5991] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:44:34 2022] DELETE /identity/v3/regions/562ab52da24a4dafb6dfb0f6cec491f5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:34.543758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e8769-4fb7-4e93-9e0a-2d6f3047b887 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:34.545509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-234e8769-4fb7-4e93-9e0a-2d6f3047b887 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:34.558146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:34.590118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:34.664842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac1bf7-01de-4564-a942-707511fecdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.665625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac1bf7-01de-4564-a942-707511fecdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.666009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac1bf7-01de-4564-a942-707511fecdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.666402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac1bf7-01de-4564-a942-707511fecdcc admin admin] PATH_INFO: `/v3/projects/1d349f9666934347a9153fa11e7808fd/users/5a757a1b4af04798a1a067abfb1e6a83/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.670324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac1bf7-01de-4564-a942-707511fecdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d349f9666934347a9153fa11e7808fd, user_id=5a757a1b4af04798a1a067abfb1e6a83, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.675236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac1bf7-01de-4564-a942-707511fecdcc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.682096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e8769-4fb7-4e93-9e0a-2d6f3047b887 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.695746 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3009/5992] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:34 2022] PUT /identity/v3/projects/1d349f9666934347a9153fa11e7808fd/users/5a757a1b4af04798a1a067abfb1e6a83/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:34.696711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac1bf7-01de-4564-a942-707511fecdcc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:34.698522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e0ac1bf7-01de-4564-a942-707511fecdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:34.804859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe8ea0-4d69-40aa-b631-930c4db45db9 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.805533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe8ea0-4d69-40aa-b631-930c4db45db9 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.805811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe8ea0-4d69-40aa-b631-930c4db45db9 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.806151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe8ea0-4d69-40aa-b631-930c4db45db9 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/regions/tempest-region-136156497` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.806878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe8ea0-4d69-40aa-b631-930c4db45db9 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-136156497)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.807998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe8ea0-4d69-40aa-b631-930c4db45db9 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.809516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac1bf7-01de-4564-a942-707511fecdcc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.811352 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2984/5993] 10.222.0.43 () {58 vars in 1203 bytes} [Tue Aug 30 04:44:34 2022] GET /identity/v3/regions/tempest-region-136156497 => generated 178 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:34.812642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe8ea0-4d69-40aa-b631-930c4db45db9 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:34.814479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eefe8ea0-4d69-40aa-b631-930c4db45db9 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:34.819914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb473be2-d9d5-48b4-9582-5a2fa04582a8 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.821976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb473be2-d9d5-48b4-9582-5a2fa04582a8 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.822261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb473be2-d9d5-48b4-9582-5a2fa04582a8 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.822708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb473be2-d9d5-48b4-9582-5a2fa04582a8 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.823612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb473be2-d9d5-48b4-9582-5a2fa04582a8 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.827894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb473be2-d9d5-48b4-9582-5a2fa04582a8 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.857258 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3010/5994] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:44:34 2022] POST /identity/v3/domains => generated 277 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:34.861531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb473be2-d9d5-48b4-9582-5a2fa04582a8 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:34.863389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cb473be2-d9d5-48b4-9582-5a2fa04582a8 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:34.902120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe8ea0-4d69-40aa-b631-930c4db45db9 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.960257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:34.967672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.968713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.968995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.969270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] PATH_INFO: `/v3/users/a06ece18e42446d1b57499a49319f085` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.970467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06ece18e42446d1b57499a49319f085)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.972424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.972750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb473be2-d9d5-48b4-9582-5a2fa04582a8 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:34.979501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06c7d9-f5be-4fd6-a622-0ea006139ba8 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:34.980321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06c7d9-f5be-4fd6-a622-0ea006139ba8 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.980808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06c7d9-f5be-4fd6-a622-0ea006139ba8 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.981230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06c7d9-f5be-4fd6-a622-0ea006139ba8 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:34.982625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06c7d9-f5be-4fd6-a622-0ea006139ba8 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:34.983232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06c7d9-f5be-4fd6-a622-0ea006139ba8 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:34.993956 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3011/5995] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Aug 30 04:44:34 2022] GET /identity/v3/regions => generated 837 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:34.995289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4dbba-78b4-43f4-8262-9ae8cc2a9e2b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:34.995588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4dbba-78b4-43f4-8262-9ae8cc2a9e2b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:34.996013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4dbba-78b4-43f4-8262-9ae8cc2a9e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.034217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-71b4dbba-78b4-43f4-8262-9ae8cc2a9e2b None None] MFA Rules not processed for user `5a757a1b4af04798a1a067abfb1e6a83`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:35.034849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06ece18e42446d1b57499a49319f085'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:35.035441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-71b4dbba-78b4-43f4-8262-9ae8cc2a9e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:35.044535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06ece18e42446d1b57499a49319f085'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:35.060568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06ece18e42446d1b57499a49319f085'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:35.070716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:35.071648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06ece18e42446d1b57499a49319f085'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:35.072595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06ece18e42446d1b57499a49319f085'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:35.081294 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2985/5996] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:34 2022] DELETE /identity/v3/users/a06ece18e42446d1b57499a49319f085 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:35.082505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.084297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:35.164811 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3012/5997] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:34 2022] POST /identity/v3/auth/tokens => generated 3640 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:35.166079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4dbba-78b4-43f4-8262-9ae8cc2a9e2b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.171139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-71b4dbba-78b4-43f4-8262-9ae8cc2a9e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:35.188222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571a1ad-81c9-4165-bc28-f3a7975e964a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:35.198962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2460b-9569-41af-872f-fb31407e56ff tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:35.200303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2460b-9569-41af-872f-fb31407e56ff tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:35.200935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2460b-9569-41af-872f-fb31407e56ff tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:35.201427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2460b-9569-41af-872f-fb31407e56ff tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.202531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2460b-9569-41af-872f-fb31407e56ff tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:35.205327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2460b-9569-41af-872f-fb31407e56ff tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:35.231262 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2986/5998] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:35 2022] POST /identity/v3/services => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:35.231262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2460b-9569-41af-872f-fb31407e56ff tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.231262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a7d2460b-9569-41af-872f-fb31407e56ff tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:35.317951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4dbba-78b4-43f4-8262-9ae8cc2a9e2b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:35.340113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2460b-9569-41af-872f-fb31407e56ff tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:35.349665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bed56-3937-40d4-b1d7-e118583f2be9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:35.351123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bed56-3937-40d4-b1d7-e118583f2be9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:35.351406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bed56-3937-40d4-b1d7-e118583f2be9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:35.351981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bed56-3937-40d4-b1d7-e118583f2be9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions/562ab52da24a4dafb6dfb0f6cec491f5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.352277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bed56-3937-40d4-b1d7-e118583f2be9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:delete_region(region_id=562ab52da24a4dafb6dfb0f6cec491f5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:35.355142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bed56-3937-40d4-b1d7-e118583f2be9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:35.357813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6f9bed56-3937-40d4-b1d7-e118583f2be9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Could not find region: 562ab52da24a4dafb6dfb0f6cec491f5.: keystone.exception.RegionNotFound: Could not find region: 562ab52da24a4dafb6dfb0f6cec491f5. Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 562ab52da24a4dafb6dfb0f6cec491f5. Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:35.375381 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 562ab52da24a4dafb6dfb0f6cec491f5. Aug 30 04:44:35.376509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:35.377918 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2987/5999] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:44:35 2022] DELETE /identity/v3/regions/562ab52da24a4dafb6dfb0f6cec491f5 => generated 112 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:35.378299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bed56-3937-40d4-b1d7-e118583f2be9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.394459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f9bed56-3937-40d4-b1d7-e118583f2be9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:35.461663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645f677-a3d9-4ea8-8e8e-2842fb99b897 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:35.462751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f677-a3d9-4ea8-8e8e-2842fb99b897 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:35.463091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f677-a3d9-4ea8-8e8e-2842fb99b897 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:35.463468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645f677-a3d9-4ea8-8e8e-2842fb99b897 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.464430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645f677-a3d9-4ea8-8e8e-2842fb99b897 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:35.466561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645f677-a3d9-4ea8-8e8e-2842fb99b897 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:35.493666 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3013/6000] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:44:35 2022] POST /identity/v3/roles => generated 240 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:35.495491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645f677-a3d9-4ea8-8e8e-2842fb99b897 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.531341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645f677-a3d9-4ea8-8e8e-2842fb99b897 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:35.539295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d92291-322e-4bee-b771-ca04ae82a033 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:35.540596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d92291-322e-4bee-b771-ca04ae82a033 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:35.541029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d92291-322e-4bee-b771-ca04ae82a033 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:35.541402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d92291-322e-4bee-b771-ca04ae82a033 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.542451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d92291-322e-4bee-b771-ca04ae82a033 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:35.544648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d92291-322e-4bee-b771-ca04ae82a033 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:35.559650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bed56-3937-40d4-b1d7-e118583f2be9 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:35.578842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7d400-81a7-4961-8e97-e91c7d79dbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:35.579631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d400-81a7-4961-8e97-e91c7d79dbbb service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:35.579915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d400-81a7-4961-8e97-e91c7d79dbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:35.580189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7d400-81a7-4961-8e97-e91c7d79dbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.580459 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-88d92291-322e-4bee-b771-ca04ae82a033 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1034098324. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:35.580459 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:35.580459 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:35.589364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cbe7d400-81a7-4961-8e97-e91c7d79dbbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:35.637657 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3014/6001] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Aug 30 04:44:35 2022] POST /identity/v3/endpoints => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:35.638998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d92291-322e-4bee-b771-ca04ae82a033 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.657850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:35.676235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d92291-322e-4bee-b771-ca04ae82a033 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:35.684439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6cb3-f811-4d47-b944-144c6cd7cffd tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:35.685191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6cb3-f811-4d47-b944-144c6cd7cffd tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:35.685540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6cb3-f811-4d47-b944-144c6cd7cffd tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:35.685892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d6cb3-f811-4d47-b944-144c6cd7cffd tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.686836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d6cb3-f811-4d47-b944-144c6cd7cffd tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:35.688377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d6cb3-f811-4d47-b944-144c6cd7cffd tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:35.701621 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3015/6002] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Aug 30 04:44:35 2022] GET /identity/v3/regions => generated 1006 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:35.701621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6cb3-f811-4d47-b944-144c6cd7cffd tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.718756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7d400-81a7-4961-8e97-e91c7d79dbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:35.721263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7d400-81a7-4961-8e97-e91c7d79dbbb service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:35.744438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d6cb3-f811-4d47-b944-144c6cd7cffd tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:35.759850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7c502-8b76-4548-bf49-3607b34f515f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:35.760454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7c502-8b76-4548-bf49-3607b34f515f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:35.760862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7c502-8b76-4548-bf49-3607b34f515f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:35.761143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7c502-8b76-4548-bf49-3607b34f515f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.765035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7c502-8b76-4548-bf49-3607b34f515f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:35.770055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7c502-8b76-4548-bf49-3607b34f515f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:35.776105 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2988/6003] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:35 2022] GET /identity/v3/auth/tokens => generated 3892 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:35.776970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7d400-81a7-4961-8e97-e91c7d79dbbb service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.782053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cbe7d400-81a7-4961-8e97-e91c7d79dbbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:35.836768 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3016/6004] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:44:35 2022] POST /identity/v3/groups => generated 327 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:35.838141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7c502-8b76-4548-bf49-3607b34f515f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.864930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7c502-8b76-4548-bf49-3607b34f515f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:35.870422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850495aa-0233-4cad-9247-b42527087bc1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:35.871191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850495aa-0233-4cad-9247-b42527087bc1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:35.871570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850495aa-0233-4cad-9247-b42527087bc1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:35.871936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850495aa-0233-4cad-9247-b42527087bc1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/regions/tempest-region-1034098324` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.872870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850495aa-0233-4cad-9247-b42527087bc1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1034098324)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:35.874183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850495aa-0233-4cad-9247-b42527087bc1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:35.879537 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3017/6005] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Aug 30 04:44:35 2022] GET /identity/v3/regions/tempest-region-1034098324 => generated 180 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:35.879537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850495aa-0233-4cad-9247-b42527087bc1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.893558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850495aa-0233-4cad-9247-b42527087bc1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:35.902493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495587e1-84ca-40a7-bb6a-06788423e30b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:35.903773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495587e1-84ca-40a7-bb6a-06788423e30b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:35.904149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495587e1-84ca-40a7-bb6a-06788423e30b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:35.904514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495587e1-84ca-40a7-bb6a-06788423e30b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.905273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495587e1-84ca-40a7-bb6a-06788423e30b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:35.907491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495587e1-84ca-40a7-bb6a-06788423e30b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:35.911992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7d400-81a7-4961-8e97-e91c7d79dbbb service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:35.937790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:35.938566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:35.938939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:35.939220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] PATH_INFO: `/v3/projects/541ee7c8510a4ffc825af5f5248b8df7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:35.940553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=541ee7c8510a4ffc825af5f5248b8df7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:35.943513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:35.950587 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3018/6006] 10.222.0.43 () {60 vars in 1150 bytes} [Tue Aug 30 04:44:35 2022] POST /identity/v3/regions => generated 253 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:35.951290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495587e1-84ca-40a7-bb6a-06788423e30b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:35.970195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:36.002300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495587e1-84ca-40a7-bb6a-06788423e30b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:36.026974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '541ee7c8510a4ffc825af5f5248b8df7', 'request_id': 'req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:36.049354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '541ee7c8510a4ffc825af5f5248b8df7', 'request_id': 'req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:36.060947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '541ee7c8510a4ffc825af5f5248b8df7', 'request_id': 'req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:36.081518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] The token cache is being invalidate because project 541ee7c8510a4ffc825af5f5248b8df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:36.082081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:36.082990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:36.085631 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2989/6007] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:35 2022] DELETE /identity/v3/projects/541ee7c8510a4ffc825af5f5248b8df7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:36.086917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:36.088910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:36.118304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066e657-17b4-4f9d-b32b-2571342922ba tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:36.119002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066e657-17b4-4f9d-b32b-2571342922ba tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:36.119292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066e657-17b4-4f9d-b32b-2571342922ba tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:36.119571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066e657-17b4-4f9d-b32b-2571342922ba tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/groups/785362a99bd74b8eb2ac6464ea23e303/users/ae10deaf7b58448b9393e0233d45f5fa` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:36.127702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066e657-17b4-4f9d-b32b-2571342922ba tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=785362a99bd74b8eb2ac6464ea23e303, user_id=ae10deaf7b58448b9393e0233d45f5fa)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:36.130520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066e657-17b4-4f9d-b32b-2571342922ba tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:36.166558 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3019/6008] 10.222.0.43 () {60 vars in 1360 bytes} [Tue Aug 30 04:44:35 2022] PUT /identity/v3/groups/785362a99bd74b8eb2ac6464ea23e303/users/ae10deaf7b58448b9393e0233d45f5fa => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:36.169755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066e657-17b4-4f9d-b32b-2571342922ba tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:36.171835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9066e657-17b4-4f9d-b32b-2571342922ba tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:36.257967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11f941-fd56-4e1b-b5f5-9d42d7f34587 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:36.269326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:36.289829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066e657-17b4-4f9d-b32b-2571342922ba tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:36.295394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde4548-b4a6-46bb-8e3b-6e308b6e97e0 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:36.296212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4548-b4a6-46bb-8e3b-6e308b6e97e0 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:36.296552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4548-b4a6-46bb-8e3b-6e308b6e97e0 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:36.297018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde4548-b4a6-46bb-8e3b-6e308b6e97e0 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:36.298082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4548-b4a6-46bb-8e3b-6e308b6e97e0 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Adding query filter params (parent_region_id=b29dbba9ee8844a39fd71fbede27944a) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:36.298637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4548-b4a6-46bb-8e3b-6e308b6e97e0 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:36.299954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde4548-b4a6-46bb-8e3b-6e308b6e97e0 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:36.306766 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3020/6009] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:44:36 2022] GET /identity/v3/regions?parent_region_id=b29dbba9ee8844a39fd71fbede27944a => generated 399 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:36.308936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f4b8a-92cd-4d5c-809c-8df9197573f0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:36.309211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f4b8a-92cd-4d5c-809c-8df9197573f0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:36.309546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f4b8a-92cd-4d5c-809c-8df9197573f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:36.337077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-165f4b8a-92cd-4d5c-809c-8df9197573f0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:36.339798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-165f4b8a-92cd-4d5c-809c-8df9197573f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:36.386358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485f62b-9ece-4359-ad66-ef75c94a7471 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:36.386732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f62b-9ece-4359-ad66-ef75c94a7471 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:36.387010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f62b-9ece-4359-ad66-ef75c94a7471 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:36.387277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485f62b-9ece-4359-ad66-ef75c94a7471 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:36.387946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485f62b-9ece-4359-ad66-ef75c94a7471 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:36.389594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485f62b-9ece-4359-ad66-ef75c94a7471 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:36.414401 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-1485f62b-9ece-4359-ad66-ef75c94a7471 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1933966554. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:36.414401 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:36.414401 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:44:36.500812 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2990/6010] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Aug 30 04:44:36 2022] POST /identity/v3/endpoints => generated 361 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:36.510612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485f62b-9ece-4359-ad66-ef75c94a7471 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:36.519559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1485f62b-9ece-4359-ad66-ef75c94a7471 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:36.527941 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3021/6011] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:36 2022] POST /identity/v3/auth/tokens => generated 4056 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:36.529138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f4b8a-92cd-4d5c-809c-8df9197573f0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:36.565930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:36.576993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f4b8a-92cd-4d5c-809c-8df9197573f0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:36.586329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34dcee-6430-4341-a2c1-f3da221c671b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:36.587066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34dcee-6430-4341-a2c1-f3da221c671b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:36.587920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34dcee-6430-4341-a2c1-f3da221c671b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:36.588474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34dcee-6430-4341-a2c1-f3da221c671b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions/15c948546bb147e99cd3cb026c707694` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:36.589815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34dcee-6430-4341-a2c1-f3da221c671b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:delete_region(region_id=15c948546bb147e99cd3cb026c707694)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:36.593546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34dcee-6430-4341-a2c1-f3da221c671b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:36.626991 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3022/6012] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:44:36 2022] DELETE /identity/v3/regions/15c948546bb147e99cd3cb026c707694 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:36.628144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34dcee-6430-4341-a2c1-f3da221c671b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:36.655047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485f62b-9ece-4359-ad66-ef75c94a7471 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:36.667464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34dcee-6430-4341-a2c1-f3da221c671b tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:36.675750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394e2e5-616b-43a2-9b28-5d2e38ef222f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:36.677273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e2e5-616b-43a2-9b28-5d2e38ef222f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:36.677638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e2e5-616b-43a2-9b28-5d2e38ef222f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:36.683373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e2e5-616b-43a2-9b28-5d2e38ef222f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/regions/tempest-region-1933966554` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:36.683373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394e2e5-616b-43a2-9b28-5d2e38ef222f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1933966554)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:36.683373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394e2e5-616b-43a2-9b28-5d2e38ef222f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:36.683373 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3023/6013] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Aug 30 04:44:36 2022] GET /identity/v3/regions/tempest-region-1933966554 => generated 180 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:36.684734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d771-4d91-4aee-9acb-edc71690d486 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:36.685023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d771-4d91-4aee-9acb-edc71690d486 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:36.685285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d771-4d91-4aee-9acb-edc71690d486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:36.691335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c409ad4-a2d5-44e3-a410-c844bf4dff7a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:36.692343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c409ad4-a2d5-44e3-a410-c844bf4dff7a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:36.692990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c409ad4-a2d5-44e3-a410-c844bf4dff7a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:36.693541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c409ad4-a2d5-44e3-a410-c844bf4dff7a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/b503738069f3491dabe2a8b1e91ef249/groups/785362a99bd74b8eb2ac6464ea23e303/roles/99ef5322d1854b8e90eae968d8f72d04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:36.697658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c409ad4-a2d5-44e3-a410-c844bf4dff7a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b503738069f3491dabe2a8b1e91ef249, group_id=785362a99bd74b8eb2ac6464ea23e303, role_id=99ef5322d1854b8e90eae968d8f72d04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:36.700899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c409ad4-a2d5-44e3-a410-c844bf4dff7a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:36.717367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2127d771-4d91-4aee-9acb-edc71690d486 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:36.717367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2127d771-4d91-4aee-9acb-edc71690d486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:36.727001 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2991/6014] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:36 2022] PUT /identity/v3/domains/b503738069f3491dabe2a8b1e91ef249/groups/785362a99bd74b8eb2ac6464ea23e303/roles/99ef5322d1854b8e90eae968d8f72d04 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:36.728240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c409ad4-a2d5-44e3-a410-c844bf4dff7a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:36.820993 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3024/6015] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:36 2022] POST /identity/v3/auth/tokens => generated 4056 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:36.825291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d771-4d91-4aee-9acb-edc71690d486 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:36.860119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c409ad4-a2d5-44e3-a410-c844bf4dff7a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:36.866270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e463df-df71-4fc5-891c-30cdbd074d12 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:36.867022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e463df-df71-4fc5-891c-30cdbd074d12 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:36.867680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e463df-df71-4fc5-891c-30cdbd074d12 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:36.868026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e463df-df71-4fc5-891c-30cdbd074d12 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions/4fa45480cab14724bd3849869278f871` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:36.869312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e463df-df71-4fc5-891c-30cdbd074d12 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:delete_region(region_id=4fa45480cab14724bd3849869278f871)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:36.871483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e463df-df71-4fc5-891c-30cdbd074d12 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:36.881302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:36.917726 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2992/6016] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:44:36 2022] DELETE /identity/v3/regions/4fa45480cab14724bd3849869278f871 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:36.918873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e463df-df71-4fc5-891c-30cdbd074d12 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:36.924563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-47e463df-df71-4fc5-891c-30cdbd074d12 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:36.955873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127d771-4d91-4aee-9acb-edc71690d486 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:36.999449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f425-9843-43ab-b3ef-24d41f7c4357 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.000691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f425-9843-43ab-b3ef-24d41f7c4357 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.000979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f425-9843-43ab-b3ef-24d41f7c4357 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.001663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f425-9843-43ab-b3ef-24d41f7c4357 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.002341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18f425-9843-43ab-b3ef-24d41f7c4357 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.003926 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-3e18f425-9843-43ab-b3ef-24d41f7c4357 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:37.003926 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:44:37.003926 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:37.006085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18f425-9843-43ab-b3ef-24d41f7c4357 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:37.023769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3025/6017] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Aug 30 04:44:36 2022] GET /identity/v3/endpoints => generated 4397 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:37.025182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f425-9843-43ab-b3ef-24d41f7c4357 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:37.064063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f425-9843-43ab-b3ef-24d41f7c4357 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:37.071323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e24f-cf85-4a86-b6c2-1e3c659d153a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.071952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e24f-cf85-4a86-b6c2-1e3c659d153a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.072224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e24f-cf85-4a86-b6c2-1e3c659d153a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.072991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e24f-cf85-4a86-b6c2-1e3c659d153a admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.073707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e24f-cf85-4a86-b6c2-1e3c659d153a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:37.074107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e24f-cf85-4a86-b6c2-1e3c659d153a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.077624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e24f-cf85-4a86-b6c2-1e3c659d153a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:37.102411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:37.103076 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3026/6018] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:37.104253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e24f-cf85-4a86-b6c2-1e3c659d153a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:37.147471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e24f-cf85-4a86-b6c2-1e3c659d153a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:37.158959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf34290-82b2-4c1f-a14a-e07190be19f1 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6fcfde09e8a41f081047c2d824a22ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.159720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf34290-82b2-4c1f-a14a-e07190be19f1 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.159977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf34290-82b2-4c1f-a14a-e07190be19f1 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.160248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf34290-82b2-4c1f-a14a-e07190be19f1 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] PATH_INFO: `/v3/regions/b29dbba9ee8844a39fd71fbede27944a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.160894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf34290-82b2-4c1f-a14a-e07190be19f1 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorizing `identity:delete_region(region_id=b29dbba9ee8844a39fd71fbede27944a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.167066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf34290-82b2-4c1f-a14a-e07190be19f1 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:37.200240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e463df-df71-4fc5-891c-30cdbd074d12 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:37.218013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39d30-d7c9-4e77-b653-9002541ccb7d tempest-TokensV3TestJSON-1915290940 tempest-TokensV3TestJSON-1915290940-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10deaf7b58448b9393e0233d45f5fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'af9fc6171bd6402b858ce0eb35eb3a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.218841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39d30-d7c9-4e77-b653-9002541ccb7d tempest-TokensV3TestJSON-1915290940 tempest-TokensV3TestJSON-1915290940-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.220514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39d30-d7c9-4e77-b653-9002541ccb7d tempest-TokensV3TestJSON-1915290940 tempest-TokensV3TestJSON-1915290940-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.220884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e39d30-d7c9-4e77-b653-9002541ccb7d tempest-TokensV3TestJSON-1915290940 tempest-TokensV3TestJSON-1915290940-project] PATH_INFO: `/v3/auth/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.222591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e39d30-d7c9-4e77-b653-9002541ccb7d tempest-TokensV3TestJSON-1915290940 tempest-TokensV3TestJSON-1915290940-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.226215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e39d30-d7c9-4e77-b653-9002541ccb7d tempest-TokensV3TestJSON-1915290940 tempest-TokensV3TestJSON-1915290940-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:37.229095 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3027/6019] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:44:37 2022] DELETE /identity/v3/regions/b29dbba9ee8844a39fd71fbede27944a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:37.230643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf34290-82b2-4c1f-a14a-e07190be19f1 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:37.275302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf34290-82b2-4c1f-a14a-e07190be19f1 tempest-RegionsTestJSON-1497067914 tempest-RegionsTestJSON-1497067914-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:37.281286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45960e07-5598-49ec-a0fc-6de336c229a5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.282908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45960e07-5598-49ec-a0fc-6de336c229a5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.283210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45960e07-5598-49ec-a0fc-6de336c229a5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.283920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45960e07-5598-49ec-a0fc-6de336c229a5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints/632bdba5d55741d0a8283c8ff0090a59` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.295781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45960e07-5598-49ec-a0fc-6de336c229a5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=632bdba5d55741d0a8283c8ff0090a59)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.297431 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-45960e07-5598-49ec-a0fc-6de336c229a5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:37.297431 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:44:37.297431 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:37.299348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45960e07-5598-49ec-a0fc-6de336c229a5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:37.310738 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3028/6020] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:37 2022] GET /identity/v3/endpoints/632bdba5d55741d0a8283c8ff0090a59 => generated 361 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:37.311713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45960e07-5598-49ec-a0fc-6de336c229a5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:37.352473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45960e07-5598-49ec-a0fc-6de336c229a5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:37.362785 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2993/6021] 10.222.0.43 () {58 vars in 1143 bytes} [Tue Aug 30 04:44:36 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:37.363381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39d30-d7c9-4e77-b653-9002541ccb7d tempest-TokensV3TestJSON-1915290940 tempest-TokensV3TestJSON-1915290940-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:37.364239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42487e8e-bdd2-42c5-a424-5e08de6acfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.365167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42487e8e-bdd2-42c5-a424-5e08de6acfdf admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.365961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42487e8e-bdd2-42c5-a424-5e08de6acfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.366752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42487e8e-bdd2-42c5-a424-5e08de6acfdf admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.367984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42487e8e-bdd2-42c5-a424-5e08de6acfdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.368888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-92e39d30-d7c9-4e77-b653-9002541ccb7d tempest-TokensV3TestJSON-1915290940 tempest-TokensV3TestJSON-1915290940-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:37.372138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42487e8e-bdd2-42c5-a424-5e08de6acfdf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:37.390271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e39d30-d7c9-4e77-b653-9002541ccb7d tempest-TokensV3TestJSON-1915290940 tempest-TokensV3TestJSON-1915290940-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:37.396916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.397902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.398086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.398402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] PATH_INFO: `/v3/users/aa1e2e48f06a4b40a62cda376c27b203` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.400617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa1e2e48f06a4b40a62cda376c27b203)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.408481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:37.419966 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3029/6022] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:37 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:37.422241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42487e8e-bdd2-42c5-a424-5e08de6acfdf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:37.498652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa1e2e48f06a4b40a62cda376c27b203'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:37.514168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa1e2e48f06a4b40a62cda376c27b203'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:37.543478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa1e2e48f06a4b40a62cda376c27b203'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:37.544989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42487e8e-bdd2-42c5-a424-5e08de6acfdf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:37.554727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.555454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.555779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.556175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints/632bdba5d55741d0a8283c8ff0090a59` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.557828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=632bdba5d55741d0a8283c8ff0090a59)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.561369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa1e2e48f06a4b40a62cda376c27b203'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:37.562206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa1e2e48f06a4b40a62cda376c27b203'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:37.567060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:37.576738 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2994/6023] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:37 2022] DELETE /identity/v3/users/aa1e2e48f06a4b40a62cda376c27b203 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:37.577912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:37.580869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:37.591162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '632bdba5d55741d0a8283c8ff0090a59', 'request_id': 'req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:37.609797 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3030/6024] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:37 2022] DELETE /identity/v3/endpoints/632bdba5d55741d0a8283c8ff0090a59 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:37.610852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:37.615294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:37.624346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:37.702537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:37.755624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ccc92-a8c9-4112-81c9-0e161886f102 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:37.776008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084e8f3-715c-473b-b3a1-77e2cac60ccd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.776732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084e8f3-715c-473b-b3a1-77e2cac60ccd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.777016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084e8f3-715c-473b-b3a1-77e2cac60ccd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.777292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084e8f3-715c-473b-b3a1-77e2cac60ccd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/b503738069f3491dabe2a8b1e91ef249/groups/785362a99bd74b8eb2ac6464ea23e303/roles/99ef5322d1854b8e90eae968d8f72d04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.778578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e134f-5fdb-4e9f-9119-d3dde3e5988e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:37.779772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084e8f3-715c-473b-b3a1-77e2cac60ccd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b503738069f3491dabe2a8b1e91ef249, group_id=785362a99bd74b8eb2ac6464ea23e303, role_id=99ef5322d1854b8e90eae968d8f72d04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.782727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084e8f3-715c-473b-b3a1-77e2cac60ccd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:37.792459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c084e8f3-715c-473b-b3a1-77e2cac60ccd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invalidating the token cache because role 99ef5322d1854b8e90eae968d8f72d04 was removed from group 785362a99bd74b8eb2ac6464ea23e303 on domain b503738069f3491dabe2a8b1e91ef249. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:37.792915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c084e8f3-715c-473b-b3a1-77e2cac60ccd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:37.794185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c084e8f3-715c-473b-b3a1-77e2cac60ccd tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:37.822860 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2995/6025] 10.222.0.43 () {58 vars in 1467 bytes} [Tue Aug 30 04:44:37 2022] DELETE /identity/v3/domains/b503738069f3491dabe2a8b1e91ef249/groups/785362a99bd74b8eb2ac6464ea23e303/roles/99ef5322d1854b8e90eae968d8f72d04 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:37.822860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9581-03c6-41a7-ae18-f1f72095952b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.823103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9581-03c6-41a7-ae18-f1f72095952b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.823366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd9581-03c6-41a7-ae18-f1f72095952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.848750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-54cd9581-03c6-41a7-ae18-f1f72095952b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:37.850224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-54cd9581-03c6-41a7-ae18-f1f72095952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:37.867005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdadbc-c549-49c8-b4a8-2518c476c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.868226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdadbc-c549-49c8-b4a8-2518c476c3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.868824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdadbc-c549-49c8-b4a8-2518c476c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.869240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdadbc-c549-49c8-b4a8-2518c476c3c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.870059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdadbc-c549-49c8-b4a8-2518c476c3c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.872660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdadbc-c549-49c8-b4a8-2518c476c3c4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:37.905910 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3031/6026] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:37 2022] POST /identity/v3/users => generated 292 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:37.907064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdadbc-c549-49c8-b4a8-2518c476c3c4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:37.909251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1efdadbc-c549-49c8-b4a8-2518c476c3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:37.928041 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2996/6027] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:37 2022] POST /identity/v3/auth/tokens => generated 3871 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:37.931363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9581-03c6-41a7-ae18-f1f72095952b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:37.931363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-54cd9581-03c6-41a7-ae18-f1f72095952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:37.953791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd9581-03c6-41a7-ae18-f1f72095952b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:37.962119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:37.964920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:37.965865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:37.966533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] PATH_INFO: `/v3/users/b068b4e2af4f44578cfeeaa7bccc8988` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:37.968953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b068b4e2af4f44578cfeeaa7bccc8988)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:37.973864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.038936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdadbc-c549-49c8-b4a8-2518c476c3c4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.054880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b068b4e2af4f44578cfeeaa7bccc8988'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:38.063236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b068b4e2af4f44578cfeeaa7bccc8988'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:38.090496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:38.090959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b068b4e2af4f44578cfeeaa7bccc8988'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:38.103061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b068b4e2af4f44578cfeeaa7bccc8988'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:38.103698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b068b4e2af4f44578cfeeaa7bccc8988'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:38.111177 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2997/6028] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:37 2022] DELETE /identity/v3/users/b068b4e2af4f44578cfeeaa7bccc8988 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:38.112188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.117549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:38.158287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495ac03-e3a3-4ac6-b88e-e5d88e7a8feb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.159132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ac03-e3a3-4ac6-b88e-e5d88e7a8feb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.159418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ac03-e3a3-4ac6-b88e-e5d88e7a8feb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.160177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495ac03-e3a3-4ac6-b88e-e5d88e7a8feb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.161079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495ac03-e3a3-4ac6-b88e-e5d88e7a8feb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:38.163458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495ac03-e3a3-4ac6-b88e-e5d88e7a8feb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.174866 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3032/6029] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Aug 30 04:44:37 2022] GET /identity/v3/endpoints => generated 4049 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:38.174866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495ac03-e3a3-4ac6-b88e-e5d88e7a8feb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.178929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a495ac03-e3a3-4ac6-b88e-e5d88e7a8feb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:38.185414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:38.196068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495ac03-e3a3-4ac6-b88e-e5d88e7a8feb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.227077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137839d-fb27-48df-802f-92f1003cd8f6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.233498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601f866-dc6b-4d22-a904-8b70b08f7ddb tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.246907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601f866-dc6b-4d22-a904-8b70b08f7ddb tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.247938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601f866-dc6b-4d22-a904-8b70b08f7ddb tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.248377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601f866-dc6b-4d22-a904-8b70b08f7ddb tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/groups/785362a99bd74b8eb2ac6464ea23e303/users/ae10deaf7b58448b9393e0233d45f5fa` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.251035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601f866-dc6b-4d22-a904-8b70b08f7ddb tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=785362a99bd74b8eb2ac6464ea23e303, user_id=ae10deaf7b58448b9393e0233d45f5fa)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:38.254304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601f866-dc6b-4d22-a904-8b70b08f7ddb tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.268101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c601f866-dc6b-4d22-a904-8b70b08f7ddb tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ae10deaf7b58448b9393e0233d45f5fa'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:38.277999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b417f0-7332-4196-8fe5-85d8350b5af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.278778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b417f0-7332-4196-8fe5-85d8350b5af2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.279361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b417f0-7332-4196-8fe5-85d8350b5af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.279740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b417f0-7332-4196-8fe5-85d8350b5af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.280583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b417f0-7332-4196-8fe5-85d8350b5af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:38.283157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b417f0-7332-4196-8fe5-85d8350b5af2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.290365 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2998/6030] 10.222.0.43 () {58 vars in 1344 bytes} [Tue Aug 30 04:44:38 2022] DELETE /identity/v3/groups/785362a99bd74b8eb2ac6464ea23e303/users/ae10deaf7b58448b9393e0233d45f5fa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:38.291632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601f866-dc6b-4d22-a904-8b70b08f7ddb tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.294088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c601f866-dc6b-4d22-a904-8b70b08f7ddb tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:38.309380 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3033/6031] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:38 2022] GET /identity/v3/roles => generated 2343 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:38.309380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856d241-1e20-4594-9279-36245a3bacf0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.309380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856d241-1e20-4594-9279-36245a3bacf0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.309380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856d241-1e20-4594-9279-36245a3bacf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.346670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d856d241-1e20-4594-9279-36245a3bacf0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:38.348124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d856d241-1e20-4594-9279-36245a3bacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:38.395466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601f866-dc6b-4d22-a904-8b70b08f7ddb tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.401366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b4c07-13d6-4536-8607-2657afb1c3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.402151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4c07-13d6-4536-8607-2657afb1c3cd service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.402494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4c07-13d6-4536-8607-2657afb1c3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.402917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b4c07-13d6-4536-8607-2657afb1c3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.405318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2c8b4c07-13d6-4536-8607-2657afb1c3cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:38.422468 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3034/6032] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:38 2022] POST /identity/v3/auth/tokens => generated 3871 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:38.423392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856d241-1e20-4594-9279-36245a3bacf0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.424774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d856d241-1e20-4594-9279-36245a3bacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:38.487742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b4c07-13d6-4536-8607-2657afb1c3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:38.489247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b4c07-13d6-4536-8607-2657afb1c3cd service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.504049 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 2999/6033] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:38 2022] GET /identity/v3/auth/tokens => generated 3871 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:38.504711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b4c07-13d6-4536-8607-2657afb1c3cd service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.530094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856d241-1e20-4594-9279-36245a3bacf0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.538879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7806adf-9fcf-46ca-b723-6a27a89fd815 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.539612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7806adf-9fcf-46ca-b723-6a27a89fd815 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.539893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7806adf-9fcf-46ca-b723-6a27a89fd815 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.540162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7806adf-9fcf-46ca-b723-6a27a89fd815 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints/632bdba5d55741d0a8283c8ff0090a59` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.545602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7806adf-9fcf-46ca-b723-6a27a89fd815 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-a7806adf-9fcf-46ca-b723-6a27a89fd815 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Could not find endpoint: 632bdba5d55741d0a8283c8ff0090a59.: keystone.exception.EndpointNotFound: Could not find endpoint: 632bdba5d55741d0a8283c8ff0090a59. Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._iter().one() Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._only_one_row( Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:38.554870 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 632bdba5d55741d0a8283c8ff0090a59. Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:38.556533 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:44:38.557722 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 632bdba5d55741d0a8283c8ff0090a59. Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:38.559069 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3035/6034] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:38 2022] DELETE /identity/v3/endpoints/632bdba5d55741d0a8283c8ff0090a59 => generated 114 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:38.561249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7806adf-9fcf-46ca-b723-6a27a89fd815 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.566326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:38.575278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7806adf-9fcf-46ca-b723-6a27a89fd815 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.580237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19be930-a5ea-42e9-95df-6d74097de46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.580852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be930-a5ea-42e9-95df-6d74097de46a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.581123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be930-a5ea-42e9-95df-6d74097de46a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.581388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19be930-a5ea-42e9-95df-6d74097de46a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.582305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19be930-a5ea-42e9-95df-6d74097de46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:38.583885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19be930-a5ea-42e9-95df-6d74097de46a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.601136 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3036/6035] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:38 2022] GET /identity/v3/roles => generated 2343 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:38.601136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19be930-a5ea-42e9-95df-6d74097de46a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.601411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b4c07-13d6-4536-8607-2657afb1c3cd service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.603721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c19be930-a5ea-42e9-95df-6d74097de46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:38.606215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdcc70-7f3a-48d7-80f8-8ae6cce4ea78 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.606986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdcc70-7f3a-48d7-80f8-8ae6cce4ea78 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.607409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdcc70-7f3a-48d7-80f8-8ae6cce4ea78 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.607684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdcc70-7f3a-48d7-80f8-8ae6cce4ea78 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/groups/785362a99bd74b8eb2ac6464ea23e303` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.612726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdcc70-7f3a-48d7-80f8-8ae6cce4ea78 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_group(group_id=785362a99bd74b8eb2ac6464ea23e303)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:38.612726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdcc70-7f3a-48d7-80f8-8ae6cce4ea78 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.616414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:38.621116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19be930-a5ea-42e9-95df-6d74097de46a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.627969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479f713-ac59-42ca-9740-b0e07c5fde58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.628756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479f713-ac59-42ca-9740-b0e07c5fde58 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.629171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479f713-ac59-42ca-9740-b0e07c5fde58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.629537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479f713-ac59-42ca-9740-b0e07c5fde58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.642080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479f713-ac59-42ca-9740-b0e07c5fde58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:38.644434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479f713-ac59-42ca-9740-b0e07c5fde58 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.656265 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3037/6036] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:38 2022] GET /identity/v3/auth/tokens => generated 3871 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:38.657416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479f713-ac59-42ca-9740-b0e07c5fde58 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.668836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479f713-ac59-42ca-9740-b0e07c5fde58 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.674824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b903f-5f9a-4c88-b574-6b68990e74ad tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.675619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b903f-5f9a-4c88-b574-6b68990e74ad tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.676020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b903f-5f9a-4c88-b574-6b68990e74ad tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.676424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b903f-5f9a-4c88-b574-6b68990e74ad tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/regions/tempest-region-1933966554` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.677330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b903f-5f9a-4c88-b574-6b68990e74ad tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1933966554)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:38.679313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b903f-5f9a-4c88-b574-6b68990e74ad tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.692167 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3000/6037] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:44:38 2022] DELETE /identity/v3/groups/785362a99bd74b8eb2ac6464ea23e303 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:38.693442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdcc70-7f3a-48d7-80f8-8ae6cce4ea78 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.697344 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-ba7b903f-5f9a-4c88-b574-6b68990e74ad tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1933966554. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:38.697344 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:38.697344 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:38.708135 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3038/6038] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Aug 30 04:44:38 2022] DELETE /identity/v3/regions/tempest-region-1933966554 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:38.709586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b903f-5f9a-4c88-b574-6b68990e74ad tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.739365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b903f-5f9a-4c88-b574-6b68990e74ad tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.812700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdcc70-7f3a-48d7-80f8-8ae6cce4ea78 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:38.826392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.827517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.828011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.828566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles/99ef5322d1854b8e90eae968d8f72d04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.831995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=99ef5322d1854b8e90eae968d8f72d04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:38.834689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.835810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ea7ca-7e66-4ab8-af3f-8d6edfc7d6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:38.836517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ea7ca-7e66-4ab8-af3f-8d6edfc7d6af admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:38.836790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ea7ca-7e66-4ab8-af3f-8d6edfc7d6af admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:38.837116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ea7ca-7e66-4ab8-af3f-8d6edfc7d6af admin admin] PATH_INFO: `/v3/projects/fc4697fa56ed4cd89d609284e75d088f/users/e474e2c89eaa4b31b6eac8a1adb4dd58/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:38.859309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ea7ca-7e66-4ab8-af3f-8d6edfc7d6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4697fa56ed4cd89d609284e75d088f, user_id=e474e2c89eaa4b31b6eac8a1adb4dd58, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:38.862813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ea7ca-7e66-4ab8-af3f-8d6edfc7d6af admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:38.886192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invalidating the token cache because role 99ef5322d1854b8e90eae968d8f72d04 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:38.886812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:38.887787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:38.890172 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3039/6039] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:38 2022] DELETE /identity/v3/roles/99ef5322d1854b8e90eae968d8f72d04 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:38.899609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.899823 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3001/6040] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:38 2022] PUT /identity/v3/projects/fc4697fa56ed4cd89d609284e75d088f/users/e474e2c89eaa4b31b6eac8a1adb4dd58/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:38.899823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ea7ca-7e66-4ab8-af3f-8d6edfc7d6af admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:38.902071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:38.905331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0f1ea7ca-7e66-4ab8-af3f-8d6edfc7d6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:39.018197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ea7ca-7e66-4ab8-af3f-8d6edfc7d6af admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:39.067885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:39.093611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e0eeb-f931-4c54-88d9-47b1895c1601 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:39.094537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e0eeb-f931-4c54-88d9-47b1895c1601 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:39.094885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e0eeb-f931-4c54-88d9-47b1895c1601 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:39.095266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e0eeb-f931-4c54-88d9-47b1895c1601 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/b503738069f3491dabe2a8b1e91ef249` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:39.097024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e0eeb-f931-4c54-88d9-47b1895c1601 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b503738069f3491dabe2a8b1e91ef249)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:39.101175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e0eeb-f931-4c54-88d9-47b1895c1601 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:39.134814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae2e0eeb-f931-4c54-88d9-47b1895c1601 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.135760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae2e0eeb-f931-4c54-88d9-47b1895c1601 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.175949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42f9e2-5845-4b8d-9f81-709232978947 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:39.184254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae2e0eeb-f931-4c54-88d9-47b1895c1601 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.185573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ae2e0eeb-f931-4c54-88d9-47b1895c1601 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.189044 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3002/6041] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:44:38 2022] PATCH /identity/v3/domains/b503738069f3491dabe2a8b1e91ef249 => generated 278 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:39.191306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112fef0-cf19-458c-b93b-61bf7d622ba3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:39.191945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112fef0-cf19-458c-b93b-61bf7d622ba3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:39.192563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112fef0-cf19-458c-b93b-61bf7d622ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:39.205702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:39.235558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c112fef0-cf19-458c-b93b-61bf7d622ba3 None None] MFA Rules not processed for user `e474e2c89eaa4b31b6eac8a1adb4dd58`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:39.238185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c112fef0-cf19-458c-b93b-61bf7d622ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:39.318747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586779c-abd8-4e5b-b0dc-26234ba66001 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:39.320308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586779c-abd8-4e5b-b0dc-26234ba66001 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:39.320908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586779c-abd8-4e5b-b0dc-26234ba66001 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:39.321319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586779c-abd8-4e5b-b0dc-26234ba66001 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:39.322411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586779c-abd8-4e5b-b0dc-26234ba66001 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:39.325547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586779c-abd8-4e5b-b0dc-26234ba66001 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:39.336944 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3040/6042] 10.222.0.43 () {58 vars in 1134 bytes} [Tue Aug 30 04:44:38 2022] GET /identity/v3/endpoints => generated 4049 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:39.338252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586779c-abd8-4e5b-b0dc-26234ba66001 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:39.342356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4586779c-abd8-4e5b-b0dc-26234ba66001 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:39.358688 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3003/6043] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:39 2022] POST /identity/v3/auth/tokens => generated 3892 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:39.359841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112fef0-cf19-458c-b93b-61bf7d622ba3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:39.361568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c112fef0-cf19-458c-b93b-61bf7d622ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:39.449800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112fef0-cf19-458c-b93b-61bf7d622ba3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:39.451921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586779c-abd8-4e5b-b0dc-26234ba66001 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:39.455869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:39.456668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:39.457344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:39.457805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:39.458025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:39.458361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:39.458665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/b503738069f3491dabe2a8b1e91ef249` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:39.458812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] PATH_INFO: `/v3/projects/9f047d73623a41bbaf0d5d1bf046993b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:39.471574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f047d73623a41bbaf0d5d1bf046993b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:39.476432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:39.479788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b503738069f3491dabe2a8b1e91ef249)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:39.482082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:39.531713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.536779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.539776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:39.568022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f047d73623a41bbaf0d5d1bf046993b', 'request_id': 'req-71e56a51-efd4-4d47-b764-a6b3bab7694e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.583703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f047d73623a41bbaf0d5d1bf046993b', 'request_id': 'req-71e56a51-efd4-4d47-b764-a6b3bab7694e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.610060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f047d73623a41bbaf0d5d1bf046993b', 'request_id': 'req-71e56a51-efd4-4d47-b764-a6b3bab7694e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.640395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] The token cache is being invalidate because project 9f047d73623a41bbaf0d5d1bf046993b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:39.641169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.643533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249', 'request_id': 'req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.646470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.650208 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3041/6044] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:39 2022] DELETE /identity/v3/projects/9f047d73623a41bbaf0d5d1bf046993b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:39.652252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:39.655861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:39.660920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249', 'request_id': 'req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.674648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249', 'request_id': 'req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.699257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] The token cache is being invalidate because project b503738069f3491dabe2a8b1e91ef249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:39.700114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.700912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.712655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249', 'request_id': 'req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.712655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249', 'request_id': 'req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.717766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b503738069f3491dabe2a8b1e91ef249', 'request_id': 'req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.727662 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3004/6045] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:44:39 2022] DELETE /identity/v3/domains/b503738069f3491dabe2a8b1e91ef249 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:39.728736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:39.730389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:39.739475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:39.779010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e56a51-efd4-4d47-b764-a6b3bab7694e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:39.825553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc8e54-b18d-4ad7-b9d1-4e1f37bc933f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:39.832703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:39.834131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:39.834524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:39.834900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:39.835695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Adding query filter params (service_id=6eaa58f125ac4e448275f7bd38c063d7) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:39.836589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:39.837761 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:44:39.837761 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:44:39.837761 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:44:39.838946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:39.852625 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3005/6046] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:44:39 2022] GET /identity/v3/endpoints?service_id=6eaa58f125ac4e448275f7bd38c063d7 => generated 501 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:39.854179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:39.856494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:39.878651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:39.879415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:39.879792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:39.880279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] PATH_INFO: `/v3/projects/4e173eefb8a84e8282420500571468d2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:39.881690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e173eefb8a84e8282420500571468d2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:39.883850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:39.973536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9f53f-637b-4522-9f6e-64aaa72abcb7 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:39.973946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e173eefb8a84e8282420500571468d2', 'request_id': 'req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.981226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e173eefb8a84e8282420500571468d2', 'request_id': 'req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:39.990246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:39.993516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e173eefb8a84e8282420500571468d2', 'request_id': 'req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.015073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] The token cache is being invalidate because project 4e173eefb8a84e8282420500571468d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:40.015611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.016430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.018143 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3042/6047] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:39 2022] DELETE /identity/v3/projects/4e173eefb8a84e8282420500571468d2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:40.019150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:40.020818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:40.060005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ef92d-8c72-4852-a8ef-817555409a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:40.060676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ef92d-8c72-4852-a8ef-817555409a70 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.061547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ef92d-8c72-4852-a8ef-817555409a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.061824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ef92d-8c72-4852-a8ef-817555409a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.062801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ef92d-8c72-4852-a8ef-817555409a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:40.066379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ef92d-8c72-4852-a8ef-817555409a70 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:40.109340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c91b7-1edb-4bed-82a5-434e9a5776e2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:40.112740 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3006/6048] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:39 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:40.114025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ef92d-8c72-4852-a8ef-817555409a70 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:40.117709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-736ef92d-8c72-4852-a8ef-817555409a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:40.181182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:40.237486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:40.238319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.238666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.239005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] PATH_INFO: `/v3/users/e6fcfde09e8a41f081047c2d824a22ad` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.240595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6fcfde09e8a41f081047c2d824a22ad)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:40.243050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:40.258658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ef92d-8c72-4852-a8ef-817555409a70 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:40.272617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:40.273477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.273822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.274188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/a0353903cad941a08963bf66848a2ea4/users/ae10deaf7b58448b9393e0233d45f5fa/roles/7e6db311900c4a02a7ef03f0966dc194` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.282506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=a0353903cad941a08963bf66848a2ea4, user_id=ae10deaf7b58448b9393e0233d45f5fa, role_id=7e6db311900c4a02a7ef03f0966dc194)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:40.285255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:40.292112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invalidating the token cache because role 7e6db311900c4a02a7ef03f0966dc194 was removed from user ae10deaf7b58448b9393e0233d45f5fa on domain a0353903cad941a08963bf66848a2ea4. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:40.292516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.293399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.315723 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3007/6049] 10.222.0.43 () {58 vars in 1464 bytes} [Tue Aug 30 04:44:40 2022] DELETE /identity/v3/domains/a0353903cad941a08963bf66848a2ea4/users/ae10deaf7b58448b9393e0233d45f5fa/roles/7e6db311900c4a02a7ef03f0966dc194 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:40.316951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:40.319102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:40.321752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6fcfde09e8a41f081047c2d824a22ad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.322813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6fcfde09e8a41f081047c2d824a22ad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.333607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6fcfde09e8a41f081047c2d824a22ad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.349128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6fcfde09e8a41f081047c2d824a22ad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.369429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ddca28e9-0faa-4cb6-99a3-d5f7dc479cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6fcfde09e8a41f081047c2d824a22ad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.378461 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3043/6050] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:40 2022] DELETE /identity/v3/users/e6fcfde09e8a41f081047c2d824a22ad => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:40.380372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36eb3-055d-4a37-abf3-7d540a1321b7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.380688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36eb3-055d-4a37-abf3-7d540a1321b7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.380994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df36eb3-055d-4a37-abf3-7d540a1321b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.415481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d766c47-32ef-4a9b-85ed-846563feb485 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:40.422579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5df36eb3-055d-4a37-abf3-7d540a1321b7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:40.424855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5df36eb3-055d-4a37-abf3-7d540a1321b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:40.487795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:40.518383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832bca2-d3f7-49a0-bb03-a3d27c7b80e1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:40.519058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832bca2-d3f7-49a0-bb03-a3d27c7b80e1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.519329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832bca2-d3f7-49a0-bb03-a3d27c7b80e1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.519602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832bca2-d3f7-49a0-bb03-a3d27c7b80e1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.520329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832bca2-d3f7-49a0-bb03-a3d27c7b80e1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Adding query filter params (service_id=95d0291c42a4406ebe1e7d4e0115ac53) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:40.521089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832bca2-d3f7-49a0-bb03-a3d27c7b80e1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:40.523025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832bca2-d3f7-49a0-bb03-a3d27c7b80e1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:40.541982 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3044/6051] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:40 2022] POST /identity/v3/auth/tokens => generated 3871 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:40.541982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df36eb3-055d-4a37-abf3-7d540a1321b7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:40.542482 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3008/6052] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:44:40 2022] GET /identity/v3/endpoints?service_id=95d0291c42a4406ebe1e7d4e0115ac53 => generated 505 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:40.542482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832bca2-d3f7-49a0-bb03-a3d27c7b80e1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:40.546525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2832bca2-d3f7-49a0-bb03-a3d27c7b80e1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:40.554571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5df36eb3-055d-4a37-abf3-7d540a1321b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:40.596747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df36eb3-055d-4a37-abf3-7d540a1321b7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:40.610738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698290-972b-4b37-8808-747a4fb65d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:40.611498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698290-972b-4b37-8808-747a4fb65d1e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.611782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698290-972b-4b37-8808-747a4fb65d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.612054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698290-972b-4b37-8808-747a4fb65d1e admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.612715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698290-972b-4b37-8808-747a4fb65d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:40.614899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698290-972b-4b37-8808-747a4fb65d1e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:40.668928 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3045/6053] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:40 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:40.668928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698290-972b-4b37-8808-747a4fb65d1e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:40.670850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cd698290-972b-4b37-8808-747a4fb65d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:40.695978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832bca2-d3f7-49a0-bb03-a3d27c7b80e1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:40.700728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698290-972b-4b37-8808-747a4fb65d1e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:40.706153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70432e-86e6-41b0-9f89-97fd213ed3bb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:40.706773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70432e-86e6-41b0-9f89-97fd213ed3bb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.707501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70432e-86e6-41b0-9f89-97fd213ed3bb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.707501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70432e-86e6-41b0-9f89-97fd213ed3bb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.708052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70432e-86e6-41b0-9f89-97fd213ed3bb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:40.708559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70432e-86e6-41b0-9f89-97fd213ed3bb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:40.709436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:40.710250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70432e-86e6-41b0-9f89-97fd213ed3bb tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:40.710866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.711350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.711825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles/7e6db311900c4a02a7ef03f0966dc194` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.713901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7e6db311900c4a02a7ef03f0966dc194)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:40.716164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:40.724946 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3046/6054] 10.222.0.43 () {58 vars in 1167 bytes} [Tue Aug 30 04:44:40 2022] GET /identity/v3/endpoints?interface=public => generated 3404 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:40.724946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f893da-ae1e-47a5-be40-d0154b305924 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.724946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f893da-ae1e-47a5-be40-d0154b305924 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.724946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f893da-ae1e-47a5-be40-d0154b305924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.765823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a3f893da-ae1e-47a5-be40-d0154b305924 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:40.767338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a3f893da-ae1e-47a5-be40-d0154b305924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:40.774173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invalidating the token cache because role 7e6db311900c4a02a7ef03f0966dc194 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:40.774761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.775730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:40.778838 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3009/6055] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:40 2022] DELETE /identity/v3/roles/7e6db311900c4a02a7ef03f0966dc194 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:40.779994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:40.781700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:40.794535 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3047/6056] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:40 2022] POST /identity/v3/auth/tokens => generated 3871 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:40.796228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f893da-ae1e-47a5-be40-d0154b305924 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:40.819898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f893da-ae1e-47a5-be40-d0154b305924 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:40.837374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:40.895502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f424cf-20de-441f-a4a0-10c25fa79dcf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:40.901977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84948309-359c-4df7-bafd-c2d6d6afeff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:40.902793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84948309-359c-4df7-bafd-c2d6d6afeff3 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.903139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84948309-359c-4df7-bafd-c2d6d6afeff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.903524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84948309-359c-4df7-bafd-c2d6d6afeff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.904675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84948309-359c-4df7-bafd-c2d6d6afeff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:40.906522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84948309-359c-4df7-bafd-c2d6d6afeff3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:40.920775 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3010/6057] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:40 2022] GET /identity/v3/roles => generated 1881 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:40.922386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84948309-359c-4df7-bafd-c2d6d6afeff3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:40.924226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-84948309-359c-4df7-bafd-c2d6d6afeff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:40.979971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cadb38-c32c-4a24-97af-875e3065a4f5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:40.981003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cadb38-c32c-4a24-97af-875e3065a4f5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:40.981564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cadb38-c32c-4a24-97af-875e3065a4f5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:40.981832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cadb38-c32c-4a24-97af-875e3065a4f5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:40.982576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cadb38-c32c-4a24-97af-875e3065a4f5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:40.982878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cadb38-c32c-4a24-97af-875e3065a4f5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:40.984565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cadb38-c32c-4a24-97af-875e3065a4f5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:40.994973 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3048/6058] 10.222.0.43 () {58 vars in 1171 bytes} [Tue Aug 30 04:44:40 2022] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:40.996214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cadb38-c32c-4a24-97af-875e3065a4f5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:41.000471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-71cadb38-c32c-4a24-97af-875e3065a4f5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:41.016602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:41.035895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cadb38-c32c-4a24-97af-875e3065a4f5 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:41.050485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a8ab3-9f16-474c-83c2-cafb01e389f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:41.052861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a8ab3-9f16-474c-83c2-cafb01e389f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:41.053487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a8ab3-9f16-474c-83c2-cafb01e389f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:41.053860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a8ab3-9f16-474c-83c2-cafb01e389f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:41.054680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a8ab3-9f16-474c-83c2-cafb01e389f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:41.055081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a8ab3-9f16-474c-83c2-cafb01e389f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:41.056818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a8ab3-9f16-474c-83c2-cafb01e389f8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:41.057836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84948309-359c-4df7-bafd-c2d6d6afeff3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:41.063557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:41.064616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:41.065216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:41.065931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/a0353903cad941a08963bf66848a2ea4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:41.069717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a0353903cad941a08963bf66848a2ea4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:41.072126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:41.078157 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3049/6059] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:41.080924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a8ab3-9f16-474c-83c2-cafb01e389f8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:41.082969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-414a8ab3-9f16-474c-83c2-cafb01e389f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:41.102462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a8ab3-9f16-474c-83c2-cafb01e389f8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:41.104543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a0353903cad941a08963bf66848a2ea4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.109164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a0353903cad941a08963bf66848a2ea4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.114022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:41.116171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:41.116601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:41.116846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] PATH_INFO: `/v3/projects/dcf8b92cfd1f4a5d926c4d00d466b971` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:41.118510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf8b92cfd1f4a5d926c4d00d466b971)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:41.121969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:41.170287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a0353903cad941a08963bf66848a2ea4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.171612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a0353903cad941a08963bf66848a2ea4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.179625 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3011/6060] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:44:40 2022] PATCH /identity/v3/domains/a0353903cad941a08963bf66848a2ea4 => generated 277 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:41.179625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:41.180778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:41.219942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'request_id': 'req-49054236-f9e9-4d51-966d-728c08179c27'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.233784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'request_id': 'req-49054236-f9e9-4d51-966d-728c08179c27'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.251543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf8b92cfd1f4a5d926c4d00d466b971', 'request_id': 'req-49054236-f9e9-4d51-966d-728c08179c27'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.269935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] The token cache is being invalidate because project dcf8b92cfd1f4a5d926c4d00d466b971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:41.270947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.271480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.277530 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3050/6061] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:41 2022] DELETE /identity/v3/projects/dcf8b92cfd1f4a5d926c4d00d466b971 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:41.277530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:41.277530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:41.326614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7933598-2b0f-4bd4-9212-69448ede6009 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:41.376008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49054236-f9e9-4d51-966d-728c08179c27 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:41.384241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1143-adba-4172-a023-ef7256ff9356 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:41.384785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1143-adba-4172-a023-ef7256ff9356 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:41.385064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1143-adba-4172-a023-ef7256ff9356 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:41.385337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1143-adba-4172-a023-ef7256ff9356 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:41.386156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d1143-adba-4172-a023-ef7256ff9356 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:41.387984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d1143-adba-4172-a023-ef7256ff9356 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:41.424128 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3051/6062] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:41 2022] POST /identity/v3/services => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:41.428489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1143-adba-4172-a023-ef7256ff9356 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:41.430724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5f3d1143-adba-4172-a023-ef7256ff9356 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:41.454911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c698abd-f95f-4458-b059-840acb6c0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:41.455799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698abd-f95f-4458-b059-840acb6c0d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:41.456250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698abd-f95f-4458-b059-840acb6c0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:41.456543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c698abd-f95f-4458-b059-840acb6c0d19 admin admin] PATH_INFO: `/v3/projects/5000bc998cf1487b87b158753bb7d7fc/users/f00b5d646a5c4bf3a7c027927dfe1543/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:41.462617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1143-adba-4172-a023-ef7256ff9356 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:41.472846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4a57-4d0e-4113-bbf6-5a564c382442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:41.473655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4a57-4d0e-4113-bbf6-5a564c382442 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:41.474443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4a57-4d0e-4113-bbf6-5a564c382442 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:41.474975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4a57-4d0e-4113-bbf6-5a564c382442 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:41.475816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb4a57-4d0e-4113-bbf6-5a564c382442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:41.479347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb4a57-4d0e-4113-bbf6-5a564c382442 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:41.496560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:41.525866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c698abd-f95f-4458-b059-840acb6c0d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5000bc998cf1487b87b158753bb7d7fc, user_id=f00b5d646a5c4bf3a7c027927dfe1543, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:41.528177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c698abd-f95f-4458-b059-840acb6c0d19 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:41.550933 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3052/6063] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:41 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:41.550933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4a57-4d0e-4113-bbf6-5a564c382442 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:41.553809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3feb4a57-4d0e-4113-bbf6-5a564c382442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:41.558191 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3012/6064] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:41 2022] PUT /identity/v3/projects/5000bc998cf1487b87b158753bb7d7fc/users/f00b5d646a5c4bf3a7c027927dfe1543/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:41.559523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b39b0-2efa-416b-b6f2-93ab1aa595b7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:41.559808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b39b0-2efa-416b-b6f2-93ab1aa595b7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:41.560102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b39b0-2efa-416b-b6f2-93ab1aa595b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:41.622527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a54b39b0-2efa-416b-b6f2-93ab1aa595b7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:41.636419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a54b39b0-2efa-416b-b6f2-93ab1aa595b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:41.676161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:41.736443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4a57-4d0e-4113-bbf6-5a564c382442 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:41.744243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:41.745059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:41.746047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:41.746329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/a0353903cad941a08963bf66848a2ea4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:41.759717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a0353903cad941a08963bf66848a2ea4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:41.760028 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3013/6065] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:41 2022] POST /identity/v3/auth/tokens => generated 4005 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:41.760914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b39b0-2efa-416b-b6f2-93ab1aa595b7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:41.761661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:41.809438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a0353903cad941a08963bf66848a2ea4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.838972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a0353903cad941a08963bf66848a2ea4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.918252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b39b0-2efa-416b-b6f2-93ab1aa595b7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:41.939526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0353903cad941a08963bf66848a2ea4', 'request_id': 'req-514647de-93e6-4306-a668-7a5a6e870041'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.957083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0353903cad941a08963bf66848a2ea4', 'request_id': 'req-514647de-93e6-4306-a668-7a5a6e870041'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:41.987810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0353903cad941a08963bf66848a2ea4', 'request_id': 'req-514647de-93e6-4306-a668-7a5a6e870041'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:42.004511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] The token cache is being invalidate because project a0353903cad941a08963bf66848a2ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:42.004800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:42.005710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:42.020043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a0353903cad941a08963bf66848a2ea4', 'request_id': 'req-514647de-93e6-4306-a668-7a5a6e870041'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:42.020847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a0353903cad941a08963bf66848a2ea4', 'request_id': 'req-514647de-93e6-4306-a668-7a5a6e870041'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:42.021466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a0353903cad941a08963bf66848a2ea4', 'request_id': 'req-514647de-93e6-4306-a668-7a5a6e870041'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:42.024945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b4c76-09e5-4083-98aa-0a78de1fdbda tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.025565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4c76-09e5-4083-98aa-0a78de1fdbda tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.025927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4c76-09e5-4083-98aa-0a78de1fdbda tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.026210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b4c76-09e5-4083-98aa-0a78de1fdbda tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.026983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b4c76-09e5-4083-98aa-0a78de1fdbda tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.028651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b4c76-09e5-4083-98aa-0a78de1fdbda tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.035709 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3053/6066] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:44:41 2022] DELETE /identity/v3/domains/a0353903cad941a08963bf66848a2ea4 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:42.035709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.035709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.051769 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-805b4c76-09e5-4083-98aa-0a78de1fdbda tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-839615569. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:42.051769 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:42.051769 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:44:42.076332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:42.084384 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3014/6067] 10.222.0.43 () {60 vars in 1156 bytes} [Tue Aug 30 04:44:41 2022] POST /identity/v3/endpoints => generated 357 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:42.086668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b4c76-09e5-4083-98aa-0a78de1fdbda tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.089152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-805b4c76-09e5-4083-98aa-0a78de1fdbda tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.144238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:42.147822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514647de-93e6-4306-a668-7a5a6e870041 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.176140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb7aa8-d041-40c3-907f-8e04e532fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.176990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb7aa8-d041-40c3-907f-8e04e532fa2b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.177278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb7aa8-d041-40c3-907f-8e04e532fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.178288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb7aa8-d041-40c3-907f-8e04e532fa2b admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.179672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb7aa8-d041-40c3-907f-8e04e532fa2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.182303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb7aa8-d041-40c3-907f-8e04e532fa2b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.187814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b4c76-09e5-4083-98aa-0a78de1fdbda tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.204023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6642-a31c-4b4f-9169-2cbee3bcf468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.204673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6642-a31c-4b4f-9169-2cbee3bcf468 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.204953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6642-a31c-4b4f-9169-2cbee3bcf468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.205278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a6642-a31c-4b4f-9169-2cbee3bcf468 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.205984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6642-a31c-4b4f-9169-2cbee3bcf468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.208168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a6642-a31c-4b4f-9169-2cbee3bcf468 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.226340 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3054/6069] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:42 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:42.226514 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3015/6069] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:42 2022] GET /identity/v3/roles => generated 1881 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:42.228576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6642-a31c-4b4f-9169-2cbee3bcf468 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.228707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60db3f-d1aa-4f34-ad95-ca434d3f7ee8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.228883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60db3f-d1aa-4f34-ad95-ca434d3f7ee8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.229162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60db3f-d1aa-4f34-ad95-ca434d3f7ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.230772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0f9a6642-a31c-4b4f-9169-2cbee3bcf468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.255340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1b60db3f-d1aa-4f34-ad95-ca434d3f7ee8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:42.257213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1b60db3f-d1aa-4f34-ad95-ca434d3f7ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.271925 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3055/6070] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:42 2022] POST /identity/v3/auth/tokens => generated 4186 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:42.272917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60db3f-d1aa-4f34-ad95-ca434d3f7ee8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.274875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1b60db3f-d1aa-4f34-ad95-ca434d3f7ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.305722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60db3f-d1aa-4f34-ad95-ca434d3f7ee8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.312441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c987f-6e4c-4945-970c-f26583c4d1fd tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.313095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c987f-6e4c-4945-970c-f26583c4d1fd tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.313381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c987f-6e4c-4945-970c-f26583c4d1fd tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.313653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c987f-6e4c-4945-970c-f26583c4d1fd tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/regions/tempest-region-839615569` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.314295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c987f-6e4c-4945-970c-f26583c4d1fd tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-839615569)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.315381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c987f-6e4c-4945-970c-f26583c4d1fd tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.317484 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3056/6071] 10.222.0.43 () {58 vars in 1203 bytes} [Tue Aug 30 04:44:42 2022] GET /identity/v3/regions/tempest-region-839615569 => generated 178 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:42.319461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c987f-6e4c-4945-970c-f26583c4d1fd tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.336739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a6642-a31c-4b4f-9169-2cbee3bcf468 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.338890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c987f-6e4c-4945-970c-f26583c4d1fd tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.346235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d12096-418e-4ddb-b5ae-b0d3036ecf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.346583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.347095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12096-418e-4ddb-b5ae-b0d3036ecf4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.347410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.347522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12096-418e-4ddb-b5ae-b0d3036ecf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.347877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.347968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d12096-418e-4ddb-b5ae-b0d3036ecf4b admin admin] PATH_INFO: `/v3/projects/5000bc998cf1487b87b158753bb7d7fc/users/f00b5d646a5c4bf3a7c027927dfe1543/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.348262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/4b2e570d86f74ee9a3e4b6841a83fee0/groups/21f181e1d90f4b04bb5313dda48b04bf/roles/bc1454faf05e44bfbb10ab20f1af111c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.351061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d12096-418e-4ddb-b5ae-b0d3036ecf4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5000bc998cf1487b87b158753bb7d7fc, user_id=f00b5d646a5c4bf3a7c027927dfe1543, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.352347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=4b2e570d86f74ee9a3e4b6841a83fee0, group_id=21f181e1d90f4b04bb5313dda48b04bf, role_id=bc1454faf05e44bfbb10ab20f1af111c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.355568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d12096-418e-4ddb-b5ae-b0d3036ecf4b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.357082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.368998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invalidating the token cache because role bc1454faf05e44bfbb10ab20f1af111c was removed from group 21f181e1d90f4b04bb5313dda48b04bf on domain 4b2e570d86f74ee9a3e4b6841a83fee0. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:42.369394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:42.370746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:42.381980 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3057/6072] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:42 2022] PUT /identity/v3/projects/5000bc998cf1487b87b158753bb7d7fc/users/f00b5d646a5c4bf3a7c027927dfe1543/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:42.383267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d12096-418e-4ddb-b5ae-b0d3036ecf4b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.387016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-14d12096-418e-4ddb-b5ae-b0d3036ecf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.403285 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3016/6073] 10.222.0.43 () {58 vars in 1467 bytes} [Tue Aug 30 04:44:42 2022] DELETE /identity/v3/domains/4b2e570d86f74ee9a3e4b6841a83fee0/groups/21f181e1d90f4b04bb5313dda48b04bf/roles/bc1454faf05e44bfbb10ab20f1af111c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:42.404183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.405567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.530038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2578a-7980-4407-b776-3cf443d2d7cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.535065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d12096-418e-4ddb-b5ae-b0d3036ecf4b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.536333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa398a5b-1414-429d-847f-dedd3fc513e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.537130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa398a5b-1414-429d-847f-dedd3fc513e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.537620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa398a5b-1414-429d-847f-dedd3fc513e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.538171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa398a5b-1414-429d-847f-dedd3fc513e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.539420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa398a5b-1414-429d-847f-dedd3fc513e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:42.539969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa398a5b-1414-429d-847f-dedd3fc513e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.542319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532abc56-bc00-436c-b95e-c52bf892ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.542754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa398a5b-1414-429d-847f-dedd3fc513e0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.543632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532abc56-bc00-436c-b95e-c52bf892ec80 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.544184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532abc56-bc00-436c-b95e-c52bf892ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.544657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532abc56-bc00-436c-b95e-c52bf892ec80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.545482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532abc56-bc00-436c-b95e-c52bf892ec80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.548587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532abc56-bc00-436c-b95e-c52bf892ec80 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.563345 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3017/6074] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:42.565497 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3058/6075] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:42 2022] GET /identity/v3/roles => generated 1881 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:42.566547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532abc56-bc00-436c-b95e-c52bf892ec80 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.567997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddb44a-a09e-41bf-a8d9-2fb510b971d4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.568517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddb44a-a09e-41bf-a8d9-2fb510b971d4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.569630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-532abc56-bc00-436c-b95e-c52bf892ec80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.574355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddb44a-a09e-41bf-a8d9-2fb510b971d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.624369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f1ddb44a-a09e-41bf-a8d9-2fb510b971d4 None None] MFA Rules not processed for user `f00b5d646a5c4bf3a7c027927dfe1543`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:42.625575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f1ddb44a-a09e-41bf-a8d9-2fb510b971d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.666316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:42.676935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532abc56-bc00-436c-b95e-c52bf892ec80 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.683178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70353991-5583-4fa6-887b-e1f4448e353d tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.684009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70353991-5583-4fa6-887b-e1f4448e353d tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.684444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70353991-5583-4fa6-887b-e1f4448e353d tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.684729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70353991-5583-4fa6-887b-e1f4448e353d tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints/22680952fadc4968a77c5d3099a10802` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.690909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70353991-5583-4fa6-887b-e1f4448e353d tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=22680952fadc4968a77c5d3099a10802)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.692747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70353991-5583-4fa6-887b-e1f4448e353d tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.698228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:42.717139 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-70353991-5583-4fa6-887b-e1f4448e353d tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1615807051. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:42.717139 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:42.717139 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:42.735397 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3018/6076] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:42 2022] POST /identity/v3/auth/tokens => generated 4278 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:42.736287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddb44a-a09e-41bf-a8d9-2fb510b971d4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.738580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f1ddb44a-a09e-41bf-a8d9-2fb510b971d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.775815 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3059/6077] 10.222.0.43 () {60 vars in 1256 bytes} [Tue Aug 30 04:44:42 2022] PATCH /identity/v3/endpoints/22680952fadc4968a77c5d3099a10802 => generated 363 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:42.776672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70353991-5583-4fa6-887b-e1f4448e353d tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.809080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70353991-5583-4fa6-887b-e1f4448e353d tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.814786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679023a-d32b-4a1e-8f52-089ae749ebf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.815546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679023a-d32b-4a1e-8f52-089ae749ebf8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.815926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679023a-d32b-4a1e-8f52-089ae749ebf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.816284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679023a-d32b-4a1e-8f52-089ae749ebf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.817035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679023a-d32b-4a1e-8f52-089ae749ebf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.819208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679023a-d32b-4a1e-8f52-089ae749ebf8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.825068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddb44a-a09e-41bf-a8d9-2fb510b971d4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.845344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc877b-a6c1-48e3-a37e-bf3efffa61b7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:42.846107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc877b-a6c1-48e3-a37e-bf3efffa61b7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:42.846386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc877b-a6c1-48e3-a37e-bf3efffa61b7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:42.846659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc877b-a6c1-48e3-a37e-bf3efffa61b7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/groups/21f181e1d90f4b04bb5313dda48b04bf/users/ae10deaf7b58448b9393e0233d45f5fa` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:42.848782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc877b-a6c1-48e3-a37e-bf3efffa61b7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=21f181e1d90f4b04bb5313dda48b04bf, user_id=ae10deaf7b58448b9393e0233d45f5fa)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:42.850896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc877b-a6c1-48e3-a37e-bf3efffa61b7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:42.857107 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3060/6078] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:42 2022] POST /identity/v3/projects => generated 389 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:42.858366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679023a-d32b-4a1e-8f52-089ae749ebf8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.865548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-10cc877b-a6c1-48e3-a37e-bf3efffa61b7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ae10deaf7b58448b9393e0233d45f5fa'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:42.886886 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3019/6079] 10.222.0.43 () {58 vars in 1344 bytes} [Tue Aug 30 04:44:42 2022] DELETE /identity/v3/groups/21f181e1d90f4b04bb5313dda48b04bf/users/ae10deaf7b58448b9393e0233d45f5fa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:42.891633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc877b-a6c1-48e3-a37e-bf3efffa61b7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:42.893354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-10cc877b-a6c1-48e3-a37e-bf3efffa61b7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:42.949053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679023a-d32b-4a1e-8f52-089ae749ebf8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.992884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc877b-a6c1-48e3-a37e-bf3efffa61b7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:42.999312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048c594-3208-4ad7-bc4b-78ba907f10f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:43.000278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c594-3208-4ad7-bc4b-78ba907f10f3 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.001486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c594-3208-4ad7-bc4b-78ba907f10f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.001486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048c594-3208-4ad7-bc4b-78ba907f10f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.035431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c48f5-f7c2-44a5-b89f-db0666d418a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:43.036265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c48f5-f7c2-44a5-b89f-db0666d418a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.036646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c48f5-f7c2-44a5-b89f-db0666d418a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.037008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c48f5-f7c2-44a5-b89f-db0666d418a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.037734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c48f5-f7c2-44a5-b89f-db0666d418a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:43.039443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c48f5-f7c2-44a5-b89f-db0666d418a1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:43.050995 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3061/6080] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:42 2022] GET /identity/v3/roles => generated 1881 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:43.053835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c48f5-f7c2-44a5-b89f-db0666d418a1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:43.091897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:43.105031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:43.113022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c594-3208-4ad7-bc4b-78ba907f10f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:43.114759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048c594-3208-4ad7-bc4b-78ba907f10f3 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:43.159247 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3020/6081] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:42 2022] GET /identity/v3/auth/tokens => generated 4097 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:43.160121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048c594-3208-4ad7-bc4b-78ba907f10f3 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:43.167966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c48f5-f7c2-44a5-b89f-db0666d418a1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:43.177367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048c594-3208-4ad7-bc4b-78ba907f10f3 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:43.179725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb0cbb-e547-4ec8-ad96-fa4cc4415d0e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:43.183144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb0cbb-e547-4ec8-ad96-fa4cc4415d0e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.183144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb0cbb-e547-4ec8-ad96-fa4cc4415d0e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.183144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb0cbb-e547-4ec8-ad96-fa4cc4415d0e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/regions/tempest-region-1615807051` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.183144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb0cbb-e547-4ec8-ad96-fa4cc4415d0e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1615807051)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:43.183144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb0cbb-e547-4ec8-ad96-fa4cc4415d0e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:43.187547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32630f7-1f79-4920-bce3-9dc0c73fe9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:43.188233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32630f7-1f79-4920-bce3-9dc0c73fe9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.192781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32630f7-1f79-4920-bce3-9dc0c73fe9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.192781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32630f7-1f79-4920-bce3-9dc0c73fe9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.193371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32630f7-1f79-4920-bce3-9dc0c73fe9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:43.194129 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3062/6082] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Aug 30 04:44:43 2022] GET /identity/v3/regions/tempest-region-1615807051 => generated 180 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:43.195439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb0cbb-e547-4ec8-ad96-fa4cc4415d0e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:43.197523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32630f7-1f79-4920-bce3-9dc0c73fe9e5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:43.252094 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3021/6083] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:43 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:43.252094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32630f7-1f79-4920-bce3-9dc0c73fe9e5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:43.264696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32630f7-1f79-4920-bce3-9dc0c73fe9e5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:43.277830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448490e2-4d93-41f9-bab0-d60ac017895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:43.281050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448490e2-4d93-41f9-bab0-d60ac017895c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.281861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448490e2-4d93-41f9-bab0-d60ac017895c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.282371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448490e2-4d93-41f9-bab0-d60ac017895c admin admin] PATH_INFO: `/v3/projects/b00920ca855b4d0a83ce8fb7593d49e1/users/c43c7be873304f56aada25c2911d55cd/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.313399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448490e2-4d93-41f9-bab0-d60ac017895c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00920ca855b4d0a83ce8fb7593d49e1, user_id=c43c7be873304f56aada25c2911d55cd, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:43.315326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb0cbb-e547-4ec8-ad96-fa4cc4415d0e tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:43.318349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448490e2-4d93-41f9-bab0-d60ac017895c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:43.321867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8e365-2485-407f-b90f-4776eec8b8e2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:43.322571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8e365-2485-407f-b90f-4776eec8b8e2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.322962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8e365-2485-407f-b90f-4776eec8b8e2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.323274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8e365-2485-407f-b90f-4776eec8b8e2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/groups/21f181e1d90f4b04bb5313dda48b04bf` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.324861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8e365-2485-407f-b90f-4776eec8b8e2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_group(group_id=21f181e1d90f4b04bb5313dda48b04bf)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:43.327667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8e365-2485-407f-b90f-4776eec8b8e2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:43.351481 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3022/6084] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:43 2022] PUT /identity/v3/projects/b00920ca855b4d0a83ce8fb7593d49e1/users/c43c7be873304f56aada25c2911d55cd/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:43.353119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448490e2-4d93-41f9-bab0-d60ac017895c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:43.429963 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3063/6085] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:44:43 2022] DELETE /identity/v3/groups/21f181e1d90f4b04bb5313dda48b04bf => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:43.429963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8e365-2485-407f-b90f-4776eec8b8e2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:43.468271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448490e2-4d93-41f9-bab0-d60ac017895c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:43.549661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f581d85-f9c7-4bdd-8e9d-9a08bda1b6a8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:43.550479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f581d85-f9c7-4bdd-8e9d-9a08bda1b6a8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.550613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8e365-2485-407f-b90f-4776eec8b8e2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:43.550875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f581d85-f9c7-4bdd-8e9d-9a08bda1b6a8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.551213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f581d85-f9c7-4bdd-8e9d-9a08bda1b6a8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints/22680952fadc4968a77c5d3099a10802` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.556734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f029b-856b-4626-b16a-53ec8b3aff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:43.557459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f029b-856b-4626-b16a-53ec8b3aff87 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.557820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f029b-856b-4626-b16a-53ec8b3aff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.558237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f029b-856b-4626-b16a-53ec8b3aff87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.558576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f581d85-f9c7-4bdd-8e9d-9a08bda1b6a8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=22680952fadc4968a77c5d3099a10802)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:43.559867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f029b-856b-4626-b16a-53ec8b3aff87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:43.560404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f581d85-f9c7-4bdd-8e9d-9a08bda1b6a8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:43.561521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f029b-856b-4626-b16a-53ec8b3aff87 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:43.571168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3f581d85-f9c7-4bdd-8e9d-9a08bda1b6a8 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '22680952fadc4968a77c5d3099a10802', 'request_id': 'req-3f581d85-f9c7-4bdd-8e9d-9a08bda1b6a8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:43.578212 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3064/6086] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:43 2022] GET /identity/v3/roles => generated 1881 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:43.582226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f029b-856b-4626-b16a-53ec8b3aff87 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:43.584397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-025f029b-856b-4626-b16a-53ec8b3aff87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:43.588093 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3023/6087] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:43 2022] DELETE /identity/v3/endpoints/22680952fadc4968a77c5d3099a10802 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:43.589795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319c183-ed8a-494d-b568-7e1d8ee38479 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.590168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319c183-ed8a-494d-b568-7e1d8ee38479 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.590442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319c183-ed8a-494d-b568-7e1d8ee38479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.601145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f029b-856b-4626-b16a-53ec8b3aff87 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:43.623503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d319c183-ed8a-494d-b568-7e1d8ee38479 None None] MFA Rules not processed for user `c43c7be873304f56aada25c2911d55cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:43.624782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d319c183-ed8a-494d-b568-7e1d8ee38479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:43.628075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:43.628737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.629128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.630001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] PATH_INFO: `/v3/users/e474e2c89eaa4b31b6eac8a1adb4dd58` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.630981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e474e2c89eaa4b31b6eac8a1adb4dd58)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:43.633182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:43.634947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:43.655484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:43.715663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e474e2c89eaa4b31b6eac8a1adb4dd58'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:43.717118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e474e2c89eaa4b31b6eac8a1adb4dd58'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:43.727752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e474e2c89eaa4b31b6eac8a1adb4dd58'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:43.743557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e474e2c89eaa4b31b6eac8a1adb4dd58'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:43.752897 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3024/6088] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:43 2022] POST /identity/v3/auth/tokens => generated 4016 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:43.753786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319c183-ed8a-494d-b568-7e1d8ee38479 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:43.761095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e474e2c89eaa4b31b6eac8a1adb4dd58'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:43.770737 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3065/6089] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:43 2022] DELETE /identity/v3/users/e474e2c89eaa4b31b6eac8a1adb4dd58 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:43.775314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:43.778089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:43.889494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319c183-ed8a-494d-b568-7e1d8ee38479 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:43.927068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c19fec-dbd0-487d-bd0d-a5023b0b9a07 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:43.931557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f286d47-329e-47a9-bd52-1539128aa8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:43.932064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286d47-329e-47a9-bd52-1539128aa8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:43.932372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286d47-329e-47a9-bd52-1539128aa8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:43.932619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f286d47-329e-47a9-bd52-1539128aa8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:43.934583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2f286d47-329e-47a9-bd52-1539128aa8a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:43.962828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f286d47-329e-47a9-bd52-1539128aa8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:43.966759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f286d47-329e-47a9-bd52-1539128aa8a0 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:43.988952 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3066/6090] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:43 2022] GET /identity/v3/auth/tokens => generated 3887 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:43.990355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f286d47-329e-47a9-bd52-1539128aa8a0 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:43.992400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2f286d47-329e-47a9-bd52-1539128aa8a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.015761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:44.016478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.016773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.017048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles/bc1454faf05e44bfbb10ab20f1af111c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.018583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bc1454faf05e44bfbb10ab20f1af111c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:44.020314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:44.086463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invalidating the token cache because role bc1454faf05e44bfbb10ab20f1af111c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:44.086463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:44.086839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:44.088741 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3025/6091] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:43 2022] DELETE /identity/v3/roles/bc1454faf05e44bfbb10ab20f1af111c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:44.092764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:44.095393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.127141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f286d47-329e-47a9-bd52-1539128aa8a0 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:44.132077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:44.166926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:44.203703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646979fe-4898-465e-99ce-99dba7e84278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:44.204490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646979fe-4898-465e-99ce-99dba7e84278 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.204859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646979fe-4898-465e-99ce-99dba7e84278 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.205425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646979fe-4898-465e-99ce-99dba7e84278 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.206205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646979fe-4898-465e-99ce-99dba7e84278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:44.207943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646979fe-4898-465e-99ce-99dba7e84278 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:44.220060 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3067/6092] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:43 2022] GET /identity/v3/roles => generated 1650 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:44.221467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540efc6-7121-4ff2-80d1-18b19df8dfbf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.221819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540efc6-7121-4ff2-80d1-18b19df8dfbf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.222185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d540efc6-7121-4ff2-80d1-18b19df8dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.229022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf7c4c-27bc-4802-b929-468b9ce801db tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:44.235233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338b785-e040-41d0-a7ce-872dd182c0d1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:44.235888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338b785-e040-41d0-a7ce-872dd182c0d1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.236167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338b785-e040-41d0-a7ce-872dd182c0d1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.236441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338b785-e040-41d0-a7ce-872dd182c0d1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/regions/tempest-region-1615807051` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.237041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338b785-e040-41d0-a7ce-872dd182c0d1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1615807051)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:44.238742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338b785-e040-41d0-a7ce-872dd182c0d1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:44.248189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d540efc6-7121-4ff2-80d1-18b19df8dfbf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:44.249828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d540efc6-7121-4ff2-80d1-18b19df8dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.253174 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-a338b785-e040-41d0-a7ce-872dd182c0d1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1615807051. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:44.253174 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:44.253174 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:44:44.259667 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3068/6093] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:44 2022] POST /identity/v3/auth/tokens => generated 4005 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:44.260659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540efc6-7121-4ff2-80d1-18b19df8dfbf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:44.261801 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3026/6094] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Aug 30 04:44:44 2022] DELETE /identity/v3/regions/tempest-region-1615807051 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:44.262780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338b785-e040-41d0-a7ce-872dd182c0d1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:44.264571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a338b785-e040-41d0-a7ce-872dd182c0d1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.264739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d540efc6-7121-4ff2-80d1-18b19df8dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.331827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d540efc6-7121-4ff2-80d1-18b19df8dfbf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:44.346931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504512f-484a-460c-9ef1-2aa46b74e35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:44.347542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504512f-484a-460c-9ef1-2aa46b74e35c service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.347879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504512f-484a-460c-9ef1-2aa46b74e35c service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.348149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504512f-484a-460c-9ef1-2aa46b74e35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.350248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9504512f-484a-460c-9ef1-2aa46b74e35c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.354029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338b785-e040-41d0-a7ce-872dd182c0d1 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:44.359162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:44.359731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.360033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.360301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/4b2e570d86f74ee9a3e4b6841a83fee0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.361523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4b2e570d86f74ee9a3e4b6841a83fee0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:44.363177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:44.387910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:44.388666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:44.419659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504512f-484a-460c-9ef1-2aa46b74e35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:44.420420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:44.421032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:44.421483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504512f-484a-460c-9ef1-2aa46b74e35c service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:44.426876 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3027/6095] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:44:44 2022] PATCH /identity/v3/domains/4b2e570d86f74ee9a3e4b6841a83fee0 => generated 277 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:44.426876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:44.426876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.445035 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3069/6096] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:44 2022] GET /identity/v3/auth/tokens => generated 4016 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:44.446227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504512f-484a-460c-9ef1-2aa46b74e35c service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:44.479980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504512f-484a-460c-9ef1-2aa46b74e35c service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:44.481761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:44.519269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086420c9-4df7-4338-af86-4bcb4efc4e5b tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:44.524908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e66ff-5533-485e-9429-2564b8eed43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:44.525720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e66ff-5533-485e-9429-2564b8eed43b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.526138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e66ff-5533-485e-9429-2564b8eed43b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.526507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e66ff-5533-485e-9429-2564b8eed43b admin admin] PATH_INFO: `/v3/projects/0f4ea402c4094e1bb51a30c00402991c/users/e5f50940222d452fb63d89c278bc7aa8/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.542518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:44.549774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e66ff-5533-485e-9429-2564b8eed43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4ea402c4094e1bb51a30c00402991c, user_id=e5f50940222d452fb63d89c278bc7aa8, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:44.555290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e66ff-5533-485e-9429-2564b8eed43b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:44.558810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b6690-d6db-49c1-ab78-1e00da2bda6c tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:44.559013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b6690-d6db-49c1-ab78-1e00da2bda6c tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.559299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b6690-d6db-49c1-ab78-1e00da2bda6c tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.559680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b6690-d6db-49c1-ab78-1e00da2bda6c tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/regions/tempest-region-839615569` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.561134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b6690-d6db-49c1-ab78-1e00da2bda6c tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-839615569)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:44.562688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b6690-d6db-49c1-ab78-1e00da2bda6c tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:44.577209 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3028/6097] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:44 2022] PUT /identity/v3/projects/0f4ea402c4094e1bb51a30c00402991c/users/e5f50940222d452fb63d89c278bc7aa8/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:44.578273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e66ff-5533-485e-9429-2564b8eed43b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:44.587029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-876e66ff-5533-485e-9429-2564b8eed43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.587267 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-d88b6690-d6db-49c1-ab78-1e00da2bda6c tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-839615569. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:44.587267 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:44.587267 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:44.600372 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3070/6098] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Aug 30 04:44:44 2022] DELETE /identity/v3/regions/tempest-region-839615569 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:44.601305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b6690-d6db-49c1-ab78-1e00da2bda6c tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:44.603215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d88b6690-d6db-49c1-ab78-1e00da2bda6c tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.665108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e66ff-5533-485e-9429-2564b8eed43b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:44.693199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d30cc5-d5b3-490c-903e-ab19613736d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:44.694401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30cc5-d5b3-490c-903e-ab19613736d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.695002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30cc5-d5b3-490c-903e-ab19613736d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.695520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d30cc5-d5b3-490c-903e-ab19613736d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.698344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-64d30cc5-d5b3-490c-903e-ab19613736d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.764440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b6690-d6db-49c1-ab78-1e00da2bda6c tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:44.795076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d30cc5-d5b3-490c-903e-ab19613736d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:44.797679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d30cc5-d5b3-490c-903e-ab19613736d1 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:44.830487 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3029/6099] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:44 2022] GET /identity/v3/auth/tokens => generated 4005 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:44.832319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc10774-5bae-4f6f-8c81-404f461ca6be None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.832719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc10774-5bae-4f6f-8c81-404f461ca6be None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.833153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc10774-5bae-4f6f-8c81-404f461ca6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.883396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-dbc10774-5bae-4f6f-8c81-404f461ca6be None None] MFA Rules not processed for user `e5f50940222d452fb63d89c278bc7aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:44.885181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dbc10774-5bae-4f6f-8c81-404f461ca6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:44.899782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:44.900542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:44.900756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:44.901035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/4b2e570d86f74ee9a3e4b6841a83fee0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:44.913674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4b2e570d86f74ee9a3e4b6841a83fee0)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:44.915376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:44.956850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:44.981506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:44.981649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:45.048667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:45.060821 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3030/6100] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:44 2022] POST /identity/v3/auth/tokens => generated 4032 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:45.062343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0', 'request_id': 'req-cc34a64b-653e-4624-a865-ccfd43e0684d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.063697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc10774-5bae-4f6f-8c81-404f461ca6be None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:45.066896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dbc10774-5bae-4f6f-8c81-404f461ca6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:45.075340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0', 'request_id': 'req-cc34a64b-653e-4624-a865-ccfd43e0684d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.087648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0', 'request_id': 'req-cc34a64b-653e-4624-a865-ccfd43e0684d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.116958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] The token cache is being invalidate because project 4b2e570d86f74ee9a3e4b6841a83fee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:45.117720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.121191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.146482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0', 'request_id': 'req-cc34a64b-653e-4624-a865-ccfd43e0684d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.147574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0', 'request_id': 'req-cc34a64b-653e-4624-a865-ccfd43e0684d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.149532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4b2e570d86f74ee9a3e4b6841a83fee0', 'request_id': 'req-cc34a64b-653e-4624-a865-ccfd43e0684d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.171268 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3071/6101] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:44:44 2022] DELETE /identity/v3/domains/4b2e570d86f74ee9a3e4b6841a83fee0 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:45.172366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:45.178173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:45.264597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc10774-5bae-4f6f-8c81-404f461ca6be None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:45.274311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34a64b-653e-4624-a865-ccfd43e0684d tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:45.281326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8899fd-5694-4758-89fb-9098e4170f7a tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:45.282057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8899fd-5694-4758-89fb-9098e4170f7a tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:45.282849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8899fd-5694-4758-89fb-9098e4170f7a tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:45.282849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8899fd-5694-4758-89fb-9098e4170f7a tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:45.283532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8899fd-5694-4758-89fb-9098e4170f7a tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:create_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:45.285231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8899fd-5694-4758-89fb-9098e4170f7a tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:45.357699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a131ef-5388-406b-aac5-c725d661cf34 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:45.358848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a131ef-5388-406b-aac5-c725d661cf34 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:45.359199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a131ef-5388-406b-aac5-c725d661cf34 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:45.359541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a131ef-5388-406b-aac5-c725d661cf34 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/services/4f4b1d4870e64b47a5c817cfa9b6d651` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:45.360351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a131ef-5388-406b-aac5-c725d661cf34 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4f4b1d4870e64b47a5c817cfa9b6d651)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:45.362280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a131ef-5388-406b-aac5-c725d661cf34 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:45.402155 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3031/6102] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:45 2022] DELETE /identity/v3/services/4f4b1d4870e64b47a5c817cfa9b6d651 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:45.403387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a131ef-5388-406b-aac5-c725d661cf34 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:45.411358 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3072/6103] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Aug 30 04:44:45 2022] POST /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials => generated 788 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:45.412345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8899fd-5694-4758-89fb-9098e4170f7a tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:45.414216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5b8899fd-5694-4758-89fb-9098e4170f7a tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:45.423160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-97a131ef-5388-406b-aac5-c725d661cf34 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:45.440730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8899fd-5694-4758-89fb-9098e4170f7a tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:45.472339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0d60a-4ae8-4f13-be12-8096b5d69ae4 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:45.473122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0d60a-4ae8-4f13-be12-8096b5d69ae4 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:45.473522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0d60a-4ae8-4f13-be12-8096b5d69ae4 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:45.473850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0d60a-4ae8-4f13-be12-8096b5d69ae4 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints/f45604bc844c4abdbc78025c266e394f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:45.493820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0d60a-4ae8-4f13-be12-8096b5d69ae4 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=f45604bc844c4abdbc78025c266e394f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:45.495598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0d60a-4ae8-4f13-be12-8096b5d69ae4 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:45.509274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-07e0d60a-4ae8-4f13-be12-8096b5d69ae4 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'f45604bc844c4abdbc78025c266e394f', 'request_id': 'req-07e0d60a-4ae8-4f13-be12-8096b5d69ae4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.533658 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3073/6104] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:45 2022] DELETE /identity/v3/endpoints/f45604bc844c4abdbc78025c266e394f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:45.534380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0d60a-4ae8-4f13-be12-8096b5d69ae4 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:45.570316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0d60a-4ae8-4f13-be12-8096b5d69ae4 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:45.585339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e26d65-ef6d-413b-b032-4150777867a0 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:45.586128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e26d65-ef6d-413b-b032-4150777867a0 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:45.586413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e26d65-ef6d-413b-b032-4150777867a0 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:45.586818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e26d65-ef6d-413b-b032-4150777867a0 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/fdaa7d6d376d4b34ae85f19cba4d5330` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:45.609857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e26d65-ef6d-413b-b032-4150777867a0 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:get_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8, application_credential_id=fdaa7d6d376d4b34ae85f19cba4d5330)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:45.614173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e26d65-ef6d-413b-b032-4150777867a0 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:45.623118 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3074/6105] 10.222.0.43 () {58 vars in 1392 bytes} [Tue Aug 30 04:44:45 2022] GET /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/fdaa7d6d376d4b34ae85f19cba4d5330 => generated 688 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:45.624075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e26d65-ef6d-413b-b032-4150777867a0 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:45.635203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:45.662905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:45.667283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a131ef-5388-406b-aac5-c725d661cf34 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:45.671889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e26d65-ef6d-413b-b032-4150777867a0 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:45.687312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbfbdd-1756-48e5-8e36-ad95a9eacf27 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:45.687981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbfbdd-1756-48e5-8e36-ad95a9eacf27 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:45.688257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbfbdd-1756-48e5-8e36-ad95a9eacf27 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:45.688529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbfbdd-1756-48e5-8e36-ad95a9eacf27 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/regions/tempest-region-1034098324` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:45.689144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbfbdd-1756-48e5-8e36-ad95a9eacf27 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1034098324)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:45.696465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbfbdd-1756-48e5-8e36-ad95a9eacf27 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:45.712402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:45.714348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:45.714985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:45.715689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/3f55ebb47ccc4eae9e1e5d009cf648fb/users/ae10deaf7b58448b9393e0233d45f5fa/roles/c3f2bd7676574e77969fee948d365700` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:45.722077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=3f55ebb47ccc4eae9e1e5d009cf648fb, user_id=ae10deaf7b58448b9393e0233d45f5fa, role_id=c3f2bd7676574e77969fee948d365700)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:45.728882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:45.735496 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3075/6106] 10.222.0.43 () {58 vars in 1209 bytes} [Tue Aug 30 04:44:45 2022] DELETE /identity/v3/regions/tempest-region-1034098324 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:45.737151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63972-43dd-46b3-83c4-5ac9cba1ec11 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:45.737782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63972-43dd-46b3-83c4-5ac9cba1ec11 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:45.738292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c63972-43dd-46b3-83c4-5ac9cba1ec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:45.744444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invalidating the token cache because role c3f2bd7676574e77969fee948d365700 was removed from user ae10deaf7b58448b9393e0233d45f5fa on domain 3f55ebb47ccc4eae9e1e5d009cf648fb. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:45.745441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.746511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:45.758373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-39c63972-43dd-46b3-83c4-5ac9cba1ec11 None None] MFA Rules not processed for user `e5f50940222d452fb63d89c278bc7aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:45.759712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-39c63972-43dd-46b3-83c4-5ac9cba1ec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:45.795649 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3032/6107] 10.222.0.43 () {58 vars in 1464 bytes} [Tue Aug 30 04:44:45 2022] DELETE /identity/v3/domains/3f55ebb47ccc4eae9e1e5d009cf648fb/users/ae10deaf7b58448b9393e0233d45f5fa/roles/c3f2bd7676574e77969fee948d365700 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:45.796684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:45.798505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:45.922777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa1ae82-99b5-4bb5-b38d-715319c18d0c tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:45.925961 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3076/6108] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:45 2022] POST /identity/v3/auth/tokens => generated 3869 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 30 04:44:45.925961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c63972-43dd-46b3-83c4-5ac9cba1ec11 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:45.928288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-39c63972-43dd-46b3-83c4-5ac9cba1ec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:45.955281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcca2b9-1ac0-4600-8c26-6c0bc275e072 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:45.956263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca2b9-1ac0-4600-8c26-6c0bc275e072 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:45.957149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca2b9-1ac0-4600-8c26-6c0bc275e072 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:45.957149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcca2b9-1ac0-4600-8c26-6c0bc275e072 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/services/95d0291c42a4406ebe1e7d4e0115ac53` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:45.958119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcca2b9-1ac0-4600-8c26-6c0bc275e072 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_service(service_id=95d0291c42a4406ebe1e7d4e0115ac53)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:45.960970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcca2b9-1ac0-4600-8c26-6c0bc275e072 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:46.004457 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3033/6109] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:45 2022] DELETE /identity/v3/services/95d0291c42a4406ebe1e7d4e0115ac53 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:46.006260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcca2b9-1ac0-4600-8c26-6c0bc275e072 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:46.008070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bdcca2b9-1ac0-4600-8c26-6c0bc275e072 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:46.018115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c63972-43dd-46b3-83c4-5ac9cba1ec11 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:46.041507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:46.042941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:46.043273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:46.043616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles/c3f2bd7676574e77969fee948d365700` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:46.045132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c3f2bd7676574e77969fee948d365700)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:46.046881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:46.049350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:46.107567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcca2b9-1ac0-4600-8c26-6c0bc275e072 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:46.110787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invalidating the token cache because role c3f2bd7676574e77969fee948d365700 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:46.110787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.111081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.116774 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3077/6110] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:45 2022] DELETE /identity/v3/roles/c3f2bd7676574e77969fee948d365700 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:46.116941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:46.117390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:46.117502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:46.117502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:46.117502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] PATH_INFO: `/v3/projects/fc4697fa56ed4cd89d609284e75d088f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:46.118437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4697fa56ed4cd89d609284e75d088f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:46.119622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:46.120448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:46.178838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:46.184244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4697fa56ed4cd89d609284e75d088f', 'request_id': 'req-14420890-9b42-4934-a3b1-cb9235b80c26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.198056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4697fa56ed4cd89d609284e75d088f', 'request_id': 'req-14420890-9b42-4934-a3b1-cb9235b80c26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.206840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4697fa56ed4cd89d609284e75d088f', 'request_id': 'req-14420890-9b42-4934-a3b1-cb9235b80c26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.225923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7309843-e5f8-4436-9946-63ae53af2629 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:46.232357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] The token cache is being invalidate because project fc4697fa56ed4cd89d609284e75d088f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:46.232666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.233578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.244119 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3034/6111] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:46 2022] DELETE /identity/v3/projects/fc4697fa56ed4cd89d609284e75d088f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:46.245187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:46.247340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:46.296645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e37133-a93d-4923-b441-73ea990324cb tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:46.297372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e37133-a93d-4923-b441-73ea990324cb tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:46.297551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e37133-a93d-4923-b441-73ea990324cb tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:46.297823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e37133-a93d-4923-b441-73ea990324cb tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/fdaa7d6d376d4b34ae85f19cba4d5330` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:46.299970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e37133-a93d-4923-b441-73ea990324cb tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8, application_credential_id=fdaa7d6d376d4b34ae85f19cba4d5330)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:46.301699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e37133-a93d-4923-b441-73ea990324cb tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:46.358952 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3078/6112] 10.222.0.43 () {58 vars in 1395 bytes} [Tue Aug 30 04:44:46 2022] DELETE /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/fdaa7d6d376d4b34ae85f19cba4d5330 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:46.359966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e37133-a93d-4923-b441-73ea990324cb tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:46.361749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-27e37133-a93d-4923-b441-73ea990324cb tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:46.395757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14420890-9b42-4934-a3b1-cb9235b80c26 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:46.401960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb988d-ba6b-4524-ad9d-f8563cf6514a tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:46.402723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb988d-ba6b-4524-ad9d-f8563cf6514a tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:46.403049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb988d-ba6b-4524-ad9d-f8563cf6514a tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:46.403323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb988d-ba6b-4524-ad9d-f8563cf6514a tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/endpoints/27d8bf52f5544b0fa62aa0f5ff7d8c6c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:46.411595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb988d-ba6b-4524-ad9d-f8563cf6514a tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=27d8bf52f5544b0fa62aa0f5ff7d8c6c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:46.413711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb988d-ba6b-4524-ad9d-f8563cf6514a tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:46.425330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8abb988d-ba6b-4524-ad9d-f8563cf6514a tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '27d8bf52f5544b0fa62aa0f5ff7d8c6c', 'request_id': 'req-8abb988d-ba6b-4524-ad9d-f8563cf6514a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.445464 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3035/6113] 10.222.0.43 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:46 2022] DELETE /identity/v3/endpoints/27d8bf52f5544b0fa62aa0f5ff7d8c6c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:46.446943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb988d-ba6b-4524-ad9d-f8563cf6514a tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:46.448742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8abb988d-ba6b-4524-ad9d-f8563cf6514a tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:46.461400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:46.470145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e37133-a93d-4923-b441-73ea990324cb tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:46.513594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:46.514322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:46.514714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:46.517018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/3f55ebb47ccc4eae9e1e5d009cf648fb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:46.520072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3f55ebb47ccc4eae9e1e5d009cf648fb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:46.522136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:46.570618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.571973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.622827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.624805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb988d-ba6b-4524-ad9d-f8563cf6514a tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:46.625863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.632830 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3079/6114] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:44:46 2022] PATCH /identity/v3/domains/3f55ebb47ccc4eae9e1e5d009cf648fb => generated 277 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:46.633773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:46.637716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:46.724204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:46.743991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:46.745024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:46.745579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:46.745982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] PATH_INFO: `/v3/users/f00b5d646a5c4bf3a7c027927dfe1543` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:46.748951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f00b5d646a5c4bf3a7c027927dfe1543)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:46.752182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:46.771463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d629a4-fca7-4da3-a72b-ca921fdd9c91 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:46.776995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efc1a-2976-4b99-881f-b25f4d5a9efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:46.778040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efc1a-2976-4b99-881f-b25f4d5a9efe service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:46.778544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efc1a-2976-4b99-881f-b25f4d5a9efe service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:46.778993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508efc1a-2976-4b99-881f-b25f4d5a9efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:46.783507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-508efc1a-2976-4b99-881f-b25f4d5a9efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:46.848098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f00b5d646a5c4bf3a7c027927dfe1543'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.871602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f00b5d646a5c4bf3a7c027927dfe1543'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.897634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f00b5d646a5c4bf3a7c027927dfe1543'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.916091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f00b5d646a5c4bf3a7c027927dfe1543'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.917169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f00b5d646a5c4bf3a7c027927dfe1543'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:46.921197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508efc1a-2976-4b99-881f-b25f4d5a9efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:46.923355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508efc1a-2976-4b99-881f-b25f4d5a9efe service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:46.926122 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3036/6115] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:46 2022] DELETE /identity/v3/users/f00b5d646a5c4bf3a7c027927dfe1543 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:46.927696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:46.929937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:46.959213 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3080/6116] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:46 2022] GET /identity/v3/auth/tokens => generated 3459 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:46.961177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efc1a-2976-4b99-881f-b25f4d5a9efe service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:46.963214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-508efc1a-2976-4b99-881f-b25f4d5a9efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:47.099414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:47.133439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93712200-9f42-4d72-9a46-699cedf632fb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:47.144539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed1dc6-4207-4250-8c68-cb740c809598 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:47.145231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed1dc6-4207-4250-8c68-cb740c809598 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:47.146808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed1dc6-4207-4250-8c68-cb740c809598 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:47.147137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed1dc6-4207-4250-8c68-cb740c809598 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:47.147863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed1dc6-4207-4250-8c68-cb740c809598 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:create_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:47.150976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed1dc6-4207-4250-8c68-cb740c809598 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:47.164671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508efc1a-2976-4b99-881f-b25f4d5a9efe service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:47.311704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481239c-702a-4c19-adce-8f87247b7c4f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:47.312586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481239c-702a-4c19-adce-8f87247b7c4f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:47.313015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481239c-702a-4c19-adce-8f87247b7c4f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:47.313444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481239c-702a-4c19-adce-8f87247b7c4f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/regions/tempest-region-136156497` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:47.315587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481239c-702a-4c19-adce-8f87247b7c4f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-136156497)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:47.323535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:47.324235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481239c-702a-4c19-adce-8f87247b7c4f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:47.351283 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3037/6117] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Aug 30 04:44:46 2022] POST /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials => generated 920 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:47.352520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed1dc6-4207-4250-8c68-cb740c809598 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:47.353507 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-b481239c-702a-4c19-adce-8f87247b7c4f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-136156497. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:44:47.353507 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:44:47.353507 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:44:47.356440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dfed1dc6-4207-4250-8c68-cb740c809598 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:47.370731 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3081/6118] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Aug 30 04:44:46 2022] DELETE /identity/v3/regions/tempest-region-136156497 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:47.370731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481239c-702a-4c19-adce-8f87247b7c4f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:47.440193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481239c-702a-4c19-adce-8f87247b7c4f tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:47.445370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37ec72-f4cb-4a73-8824-c00f08b8b6d5 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:47.446016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37ec72-f4cb-4a73-8824-c00f08b8b6d5 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:47.446604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37ec72-f4cb-4a73-8824-c00f08b8b6d5 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:47.446953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37ec72-f4cb-4a73-8824-c00f08b8b6d5 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/2e4a31062a3243c5a242a83a4811fcfc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:47.472573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37ec72-f4cb-4a73-8824-c00f08b8b6d5 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8, application_credential_id=2e4a31062a3243c5a242a83a4811fcfc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:47.476113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37ec72-f4cb-4a73-8824-c00f08b8b6d5 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:47.476651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed1dc6-4207-4250-8c68-cb740c809598 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:47.542714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:47.546245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:47.549581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:47.554756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/3f55ebb47ccc4eae9e1e5d009cf648fb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:47.559976 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3082/6119] 10.222.0.43 () {58 vars in 1395 bytes} [Tue Aug 30 04:44:47 2022] DELETE /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/2e4a31062a3243c5a242a83a4811fcfc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:47.562428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37ec72-f4cb-4a73-8824-c00f08b8b6d5 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:47.567378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fd37ec72-f4cb-4a73-8824-c00f08b8b6d5 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:47.589731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3f55ebb47ccc4eae9e1e5d009cf648fb)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:47.592083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:47.647409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37ec72-f4cb-4a73-8824-c00f08b8b6d5 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:47.660101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83460cd2-7dde-43bf-b2c1-20d4c914e100 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7acb4ee8aa46430a96e62e76e8e7118b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5656e30f7844813a26e087462541e37', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:47.661191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460cd2-7dde-43bf-b2c1-20d4c914e100 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:47.661489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460cd2-7dde-43bf-b2c1-20d4c914e100 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:47.661960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83460cd2-7dde-43bf-b2c1-20d4c914e100 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] PATH_INFO: `/v3/services/6eaa58f125ac4e448275f7bd38c063d7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:47.662583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83460cd2-7dde-43bf-b2c1-20d4c914e100 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6eaa58f125ac4e448275f7bd38c063d7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:47.664521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:47.666707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83460cd2-7dde-43bf-b2c1-20d4c914e100 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:47.672650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:47.727350 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3083/6120] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:47 2022] DELETE /identity/v3/services/6eaa58f125ac4e448275f7bd38c063d7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:47.728213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83460cd2-7dde-43bf-b2c1-20d4c914e100 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:47.794919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83460cd2-7dde-43bf-b2c1-20d4c914e100 tempest-EndPointsTestJSON-1947680306 tempest-EndPointsTestJSON-1947680306-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:47.820914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb', 'request_id': 'req-41b6c977-3efb-4efb-855d-5b80345404c7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:47.843531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb', 'request_id': 'req-41b6c977-3efb-4efb-855d-5b80345404c7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:47.860868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb', 'request_id': 'req-41b6c977-3efb-4efb-855d-5b80345404c7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:47.891049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] The token cache is being invalidate because project 3f55ebb47ccc4eae9e1e5d009cf648fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:47.891353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:47.893225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:47.915152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb', 'request_id': 'req-41b6c977-3efb-4efb-855d-5b80345404c7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:47.917700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb', 'request_id': 'req-41b6c977-3efb-4efb-855d-5b80345404c7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:47.929713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3f55ebb47ccc4eae9e1e5d009cf648fb', 'request_id': 'req-41b6c977-3efb-4efb-855d-5b80345404c7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:47.940440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:47.965669 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3038/6121] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:44:47 2022] DELETE /identity/v3/domains/3f55ebb47ccc4eae9e1e5d009cf648fb => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:47.965669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:47.968572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:47.982201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c385a-9952-4b55-a573-3ba764b57292 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:47.982824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c385a-9952-4b55-a573-3ba764b57292 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:47.984429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c385a-9952-4b55-a573-3ba764b57292 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:47.984729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0c385a-9952-4b55-a573-3ba764b57292 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:47.986414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c385a-9952-4b55-a573-3ba764b57292 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:create_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:47.990410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0c385a-9952-4b55-a573-3ba764b57292 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:48.025273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:48.165318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6c977-3efb-4efb-855d-5b80345404c7 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:48.198494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:48.199201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:48.199482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:48.199753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] PATH_INFO: `/v3/users/1a3d8bdceb0844e5ac66bbabf6c2d9a4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:48.201185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3d8bdceb0844e5ac66bbabf6c2d9a4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:48.204106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:48.250052 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3084/6122] 10.222.0.43 () {60 vars in 1315 bytes} [Tue Aug 30 04:44:47 2022] POST /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials => generated 812 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:48.252065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c385a-9952-4b55-a573-3ba764b57292 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:48.257423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0e0c385a-9952-4b55-a573-3ba764b57292 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:48.308491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3d8bdceb0844e5ac66bbabf6c2d9a4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:48.328846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3d8bdceb0844e5ac66bbabf6c2d9a4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:48.353388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3d8bdceb0844e5ac66bbabf6c2d9a4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:48.388678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3d8bdceb0844e5ac66bbabf6c2d9a4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:48.389461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3d8bdceb0844e5ac66bbabf6c2d9a4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:48.402970 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3039/6123] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:47 2022] DELETE /identity/v3/users/1a3d8bdceb0844e5ac66bbabf6c2d9a4 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:48.403567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:48.412364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:48.442567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0c385a-9952-4b55-a573-3ba764b57292 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:48.560236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843dcff2-7c68-4aa2-bfbb-6a21ed447cfe admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:48.567746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:48.569089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:48.569400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:48.569626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] PATH_INFO: `/v3/projects/5000bc998cf1487b87b158753bb7d7fc` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:48.570873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5000bc998cf1487b87b158753bb7d7fc)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:48.572973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:48.597580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46a8bb-1d60-4d4a-8af7-9360f5f78178 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:48.598451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46a8bb-1d60-4d4a-8af7-9360f5f78178 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:48.598947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46a8bb-1d60-4d4a-8af7-9360f5f78178 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:48.599461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46a8bb-1d60-4d4a-8af7-9360f5f78178 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:48.600666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46a8bb-1d60-4d4a-8af7-9360f5f78178 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:48.603138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d46a8bb-1d60-4d4a-8af7-9360f5f78178 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:48.637673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:48.643154 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3085/6124] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:48.643154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46a8bb-1d60-4d4a-8af7-9360f5f78178 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:48.648452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7d46a8bb-1d60-4d4a-8af7-9360f5f78178 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:48.690116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5000bc998cf1487b87b158753bb7d7fc', 'request_id': 'req-779abdd6-9929-4e87-abcd-c00bad9485c7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:48.712243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5000bc998cf1487b87b158753bb7d7fc', 'request_id': 'req-779abdd6-9929-4e87-abcd-c00bad9485c7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:48.725410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5000bc998cf1487b87b158753bb7d7fc', 'request_id': 'req-779abdd6-9929-4e87-abcd-c00bad9485c7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:48.729620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:48.761867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] The token cache is being invalidate because project 5000bc998cf1487b87b158753bb7d7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:48.762268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:48.762936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-779abdd6-9929-4e87-abcd-c00bad9485c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:48.764573 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3040/6125] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:48 2022] DELETE /identity/v3/projects/5000bc998cf1487b87b158753bb7d7fc => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:48.769329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920014e0-6a1c-475a-b7f7-842561d9f6ae None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:48.769621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920014e0-6a1c-475a-b7f7-842561d9f6ae None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:48.772508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920014e0-6a1c-475a-b7f7-842561d9f6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:48.808844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46a8bb-1d60-4d4a-8af7-9360f5f78178 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:48.834142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-920014e0-6a1c-475a-b7f7-842561d9f6ae None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:48.836056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-920014e0-6a1c-475a-b7f7-842561d9f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:49.012753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55862dcc-99a0-4ddf-9e0e-df2f37a639b3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:49.014388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55862dcc-99a0-4ddf-9e0e-df2f37a639b3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:49.016984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55862dcc-99a0-4ddf-9e0e-df2f37a639b3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:49.017510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55862dcc-99a0-4ddf-9e0e-df2f37a639b3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/f016b54e4dd34ddc8b8cc76be4035360` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:49.036507 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3041/6126] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:49.039782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920014e0-6a1c-475a-b7f7-842561d9f6ae None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:49.042735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-920014e0-6a1c-475a-b7f7-842561d9f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:49.044681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55862dcc-99a0-4ddf-9e0e-df2f37a639b3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8, application_credential_id=f016b54e4dd34ddc8b8cc76be4035360)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:49.050041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55862dcc-99a0-4ddf-9e0e-df2f37a639b3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:49.107980 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3086/6127] 10.222.0.43 () {58 vars in 1395 bytes} [Tue Aug 30 04:44:48 2022] DELETE /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/f016b54e4dd34ddc8b8cc76be4035360 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:49.125520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd17d1-4ded-49de-8ab6-8f123b6fe871 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:49.126620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd17d1-4ded-49de-8ab6-8f123b6fe871 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:49.127902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd17d1-4ded-49de-8ab6-8f123b6fe871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:49.181262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7ebd17d1-4ded-49de-8ab6-8f123b6fe871 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:49.183018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7ebd17d1-4ded-49de-8ab6-8f123b6fe871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:49.213394 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3087/6128] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:49.214812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd17d1-4ded-49de-8ab6-8f123b6fe871 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:49.224930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7ebd17d1-4ded-49de-8ab6-8f123b6fe871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:49.236159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920014e0-6a1c-475a-b7f7-842561d9f6ae None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:49.245664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ff3d-e7dd-43a7-8b71-a04ddb77a8cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:49.247018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ff3d-e7dd-43a7-8b71-a04ddb77a8cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:49.247432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ff3d-e7dd-43a7-8b71-a04ddb77a8cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:49.247871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253ff3d-e7dd-43a7-8b71-a04ddb77a8cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/projects/a0ec6d643ba24012ae788cf7c81891f3/users/02abbf08db7a433faa7929f7340bb578/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:49.252581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253ff3d-e7dd-43a7-8b71-a04ddb77a8cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a0ec6d643ba24012ae788cf7c81891f3, user_id=02abbf08db7a433faa7929f7340bb578, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:49.256973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253ff3d-e7dd-43a7-8b71-a04ddb77a8cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:49.275216 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3042/6129] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:49 2022] PUT /identity/v3/projects/a0ec6d643ba24012ae788cf7c81891f3/users/02abbf08db7a433faa7929f7340bb578/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:49.275988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ff3d-e7dd-43a7-8b71-a04ddb77a8cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:49.277641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1253ff3d-e7dd-43a7-8b71-a04ddb77a8cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:49.362469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd17d1-4ded-49de-8ab6-8f123b6fe871 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:49.367920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:49.384951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253ff3d-e7dd-43a7-8b71-a04ddb77a8cc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:49.390220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c885d2e-3e96-4a01-87f4-81e1748d18fc tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:49.391016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885d2e-3e96-4a01-87f4-81e1748d18fc tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:49.391819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885d2e-3e96-4a01-87f4-81e1748d18fc tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:49.392303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c885d2e-3e96-4a01-87f4-81e1748d18fc tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:49.394242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c885d2e-3e96-4a01-87f4-81e1748d18fc tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:create_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:49.396814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c885d2e-3e96-4a01-87f4-81e1748d18fc tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:49.493812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f4aa4-ecc2-426c-b32a-f949447a328a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:49.495168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f4aa4-ecc2-426c-b32a-f949447a328a service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:49.495678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f4aa4-ecc2-426c-b32a-f949447a328a service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:49.496366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f4aa4-ecc2-426c-b32a-f949447a328a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:49.523242 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3043/6130] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Aug 30 04:44:49 2022] POST /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials => generated 789 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:49.524874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7943a-2351-4ac3-bd82-f9a6046550ae None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:49.528067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7943a-2351-4ac3-bd82-f9a6046550ae None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:49.529351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7943a-2351-4ac3-bd82-f9a6046550ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:49.548505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:49.610326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0ea7943a-2351-4ac3-bd82-f9a6046550ae None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:49.610936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0ea7943a-2351-4ac3-bd82-f9a6046550ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:49.697503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f4aa4-ecc2-426c-b32a-f949447a328a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:49.699020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f4aa4-ecc2-426c-b32a-f949447a328a service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:49.714572 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3088/6131] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:49.715439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f4aa4-ecc2-426c-b32a-f949447a328a service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:49.793717 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3044/6132] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:49.794687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7943a-2351-4ac3-bd82-f9a6046550ae None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:49.815416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7943a-2351-4ac3-bd82-f9a6046550ae None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:49.830291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198bf5a-1d81-448c-97f2-831b7c790e0b tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:49.831382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198bf5a-1d81-448c-97f2-831b7c790e0b tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:49.831382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198bf5a-1d81-448c-97f2-831b7c790e0b tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:49.831582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198bf5a-1d81-448c-97f2-831b7c790e0b tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:49.832174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198bf5a-1d81-448c-97f2-831b7c790e0b tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:create_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:49.833471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198bf5a-1d81-448c-97f2-831b7c790e0b tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:49.850984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f4aa4-ecc2-426c-b32a-f949447a328a service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:49.858736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c93db-aed9-4294-b7bc-305cd8bd0961 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:49.859468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c93db-aed9-4294-b7bc-305cd8bd0961 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:49.859748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c93db-aed9-4294-b7bc-305cd8bd0961 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:49.860021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c93db-aed9-4294-b7bc-305cd8bd0961 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:49.860608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c93db-aed9-4294-b7bc-305cd8bd0961 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:49.864194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c93db-aed9-4294-b7bc-305cd8bd0961 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:49.979372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3045/6133] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Aug 30 04:44:49 2022] POST /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials => generated 789 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:49.979372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198bf5a-1d81-448c-97f2-831b7c790e0b tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:49.981401 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3089/6134] 10.222.0.43 () {58 vars in 1146 bytes} [Tue Aug 30 04:44:49 2022] GET /identity/v3/auth/projects => generated 826 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:49.983542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c93db-aed9-4294-b7bc-305cd8bd0961 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:50.001425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198bf5a-1d81-448c-97f2-831b7c790e0b tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:50.008527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c93db-aed9-4294-b7bc-305cd8bd0961 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:50.016078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f90a31-797e-4a14-8496-76326367d2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:50.016722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f90a31-797e-4a14-8496-76326367d2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:50.017001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f90a31-797e-4a14-8496-76326367d2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:50.017269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f90a31-797e-4a14-8496-76326367d2c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:50.018057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f90a31-797e-4a14-8496-76326367d2c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:50.018359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f90a31-797e-4a14-8496-76326367d2c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:50.018626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a18ecf-2046-4d9e-8c5e-7f82ab4445ae tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:50.019251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a18ecf-2046-4d9e-8c5e-7f82ab4445ae tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:50.019517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a18ecf-2046-4d9e-8c5e-7f82ab4445ae tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:50.019792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a18ecf-2046-4d9e-8c5e-7f82ab4445ae tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:50.020003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f90a31-797e-4a14-8496-76326367d2c4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:50.020499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a18ecf-2046-4d9e-8c5e-7f82ab4445ae tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:list_application_credentials(user_id=e5f50940222d452fb63d89c278bc7aa8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:50.025229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a18ecf-2046-4d9e-8c5e-7f82ab4445ae tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:50.059112 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3090/6135] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Aug 30 04:44:49 2022] GET /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials => generated 1502 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:50.059112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a18ecf-2046-4d9e-8c5e-7f82ab4445ae tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:50.061448 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3046/6136] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:50.063348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f90a31-797e-4a14-8496-76326367d2c4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:50.083213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a18ecf-2046-4d9e-8c5e-7f82ab4445ae tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:50.091378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f90a31-797e-4a14-8496-76326367d2c4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:50.095677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:50.096369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:50.096651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:50.096927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/projects/a0ec6d643ba24012ae788cf7c81891f3/users/02abbf08db7a433faa7929f7340bb578/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:50.101137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=a0ec6d643ba24012ae788cf7c81891f3, user_id=02abbf08db7a433faa7929f7340bb578, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:50.106837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:50.114238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31d8b6-9255-41fb-914e-f151dbe5bf42 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:50.115689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31d8b6-9255-41fb-914e-f151dbe5bf42 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:50.116048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31d8b6-9255-41fb-914e-f151dbe5bf42 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:50.116525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31d8b6-9255-41fb-914e-f151dbe5bf42 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/82514f151f964182ac2c2884d45b492d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:50.132157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31d8b6-9255-41fb-914e-f151dbe5bf42 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8, application_credential_id=82514f151f964182ac2c2884d45b492d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:50.135760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31d8b6-9255-41fb-914e-f151dbe5bf42 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:50.140619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invalidating the token cache because role a56982ccacee4cd0b5dba95be3067f04 was removed from user 02abbf08db7a433faa7929f7340bb578 on project a0ec6d643ba24012ae788cf7c81891f3. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:50.140937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:50.141950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:50.150819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:50.179111 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3091/6137] 10.222.0.43 () {58 vars in 1467 bytes} [Tue Aug 30 04:44:50 2022] DELETE /identity/v3/projects/a0ec6d643ba24012ae788cf7c81891f3/users/02abbf08db7a433faa7929f7340bb578/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:50.182417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:50.185330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:50.190202 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3047/6138] 10.222.0.43 () {58 vars in 1395 bytes} [Tue Aug 30 04:44:50 2022] DELETE /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/82514f151f964182ac2c2884d45b492d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:50.191115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31d8b6-9255-41fb-914e-f151dbe5bf42 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:50.194850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8f31d8b6-9255-41fb-914e-f151dbe5bf42 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:50.239284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31d8b6-9255-41fb-914e-f151dbe5bf42 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:50.278705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:50.338959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4f4c7-3568-41be-b22a-d70a0fa7f3cf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:50.339620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4f4c7-3568-41be-b22a-d70a0fa7f3cf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:50.339962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4f4c7-3568-41be-b22a-d70a0fa7f3cf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:50.340244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4f4c7-3568-41be-b22a-d70a0fa7f3cf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:50.340900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4f4c7-3568-41be-b22a-d70a0fa7f3cf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:50.342971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4f4c7-3568-41be-b22a-d70a0fa7f3cf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:50.343169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f4dcc-faac-4982-952b-408047f3fbf2 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:50.348272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1bc82-b927-4af9-a787-85d8b9e3b099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:50.349380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bc82-b927-4af9-a787-85d8b9e3b099 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:50.349758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bc82-b927-4af9-a787-85d8b9e3b099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:50.350061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1bc82-b927-4af9-a787-85d8b9e3b099 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:50.350711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1bc82-b927-4af9-a787-85d8b9e3b099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:50.352636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1bc82-b927-4af9-a787-85d8b9e3b099 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:50.374269 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3048/6139] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:50 2022] POST /identity/v3/users => generated 323 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:50.376097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4f4c7-3568-41be-b22a-d70a0fa7f3cf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:50.379321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8bb4f4c7-3568-41be-b22a-d70a0fa7f3cf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:50.421220 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3092/6140] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:50 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:50.422260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1bc82-b927-4af9-a787-85d8b9e3b099 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:50.435130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e4b1bc82-b927-4af9-a787-85d8b9e3b099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:50.498766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4f4c7-3568-41be-b22a-d70a0fa7f3cf tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:50.574159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1bc82-b927-4af9-a787-85d8b9e3b099 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:50.577776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad44bb-0f73-4538-b4e7-a54af9fe9209 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:50.580056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad44bb-0f73-4538-b4e7-a54af9fe9209 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:50.580454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad44bb-0f73-4538-b4e7-a54af9fe9209 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:50.580965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad44bb-0f73-4538-b4e7-a54af9fe9209 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/5af79bcda5964b8b8c7a287449523f1d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:50.582214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06966d-59b2-4cfd-9a56-9a81723809ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:50.583004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06966d-59b2-4cfd-9a56-9a81723809ba service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:50.583382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06966d-59b2-4cfd-9a56-9a81723809ba service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:50.583666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06966d-59b2-4cfd-9a56-9a81723809ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:50.592258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fd06966d-59b2-4cfd-9a56-9a81723809ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:50.596550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad44bb-0f73-4538-b4e7-a54af9fe9209 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8, application_credential_id=5af79bcda5964b8b8c7a287449523f1d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:50.599141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad44bb-0f73-4538-b4e7-a54af9fe9209 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:50.632949 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3049/6141] 10.222.0.43 () {58 vars in 1395 bytes} [Tue Aug 30 04:44:50 2022] DELETE /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/5af79bcda5964b8b8c7a287449523f1d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:50.634107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad44bb-0f73-4538-b4e7-a54af9fe9209 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:50.653758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:50.738582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06966d-59b2-4cfd-9a56-9a81723809ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:50.740923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06966d-59b2-4cfd-9a56-9a81723809ba service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:50.767663 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3093/6142] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:50.768855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06966d-59b2-4cfd-9a56-9a81723809ba service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:50.792783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad44bb-0f73-4538-b4e7-a54af9fe9209 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:50.811266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e243f-ad48-4d1b-9a84-ea8e07372052 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:50.812174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e243f-ad48-4d1b-9a84-ea8e07372052 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:50.813271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e243f-ad48-4d1b-9a84-ea8e07372052 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:50.814122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e243f-ad48-4d1b-9a84-ea8e07372052 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:50.814999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e243f-ad48-4d1b-9a84-ea8e07372052 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:50.818462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e243f-ad48-4d1b-9a84-ea8e07372052 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:50.864434 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3050/6143] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:50 2022] POST /identity/v3/projects => generated 362 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:50.866394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e243f-ad48-4d1b-9a84-ea8e07372052 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:50.879132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:50.931494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06966d-59b2-4cfd-9a56-9a81723809ba service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:50.999355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e243f-ad48-4d1b-9a84-ea8e07372052 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:51.025509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4948be0-d9c4-4e69-8f8c-0c1d0f96d5e3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:51.026427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4948be0-d9c4-4e69-8f8c-0c1d0f96d5e3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:51.027880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4948be0-d9c4-4e69-8f8c-0c1d0f96d5e3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:51.028159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4948be0-d9c4-4e69-8f8c-0c1d0f96d5e3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:51.030450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4948be0-d9c4-4e69-8f8c-0c1d0f96d5e3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:create_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:51.033036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4948be0-d9c4-4e69-8f8c-0c1d0f96d5e3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:51.048555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c1e89-fcd2-40e2-ac61-ab57968cbceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:51.048555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c1e89-fcd2-40e2-ac61-ab57968cbceb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:51.049092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c1e89-fcd2-40e2-ac61-ab57968cbceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:51.049092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c1e89-fcd2-40e2-ac61-ab57968cbceb admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:51.049576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c1e89-fcd2-40e2-ac61-ab57968cbceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:51.051681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c1e89-fcd2-40e2-ac61-ab57968cbceb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:51.100802 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3094/6144] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:50 2022] POST /identity/v3/users => generated 289 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:51.101650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c1e89-fcd2-40e2-ac61-ab57968cbceb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:51.223939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c1e89-fcd2-40e2-ac61-ab57968cbceb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:51.232676 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3051/6145] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Aug 30 04:44:50 2022] POST /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials => generated 788 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:51.233119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4948be0-d9c4-4e69-8f8c-0c1d0f96d5e3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:51.234822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ae4f1-26f5-478c-8d11-65e85a992f4e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:51.235642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ae4f1-26f5-478c-8d11-65e85a992f4e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:51.236128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ae4f1-26f5-478c-8d11-65e85a992f4e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:51.236539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ae4f1-26f5-478c-8d11-65e85a992f4e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:51.237506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ae4f1-26f5-478c-8d11-65e85a992f4e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:51.239777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ae4f1-26f5-478c-8d11-65e85a992f4e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:51.266265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4948be0-d9c4-4e69-8f8c-0c1d0f96d5e3 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:51.273945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a407230-c780-4a1a-b7e4-8025d216c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:51.274691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a407230-c780-4a1a-b7e4-8025d216c798 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:51.274968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a407230-c780-4a1a-b7e4-8025d216c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:51.275286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a407230-c780-4a1a-b7e4-8025d216c798 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:51.276393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a407230-c780-4a1a-b7e4-8025d216c798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:51.284495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a407230-c780-4a1a-b7e4-8025d216c798 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:51.292579 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3095/6146] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:51 2022] POST /identity/v3/projects => generated 364 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:51.296170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ae4f1-26f5-478c-8d11-65e85a992f4e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:51.299957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-324ae4f1-26f5-478c-8d11-65e85a992f4e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:51.328077 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3052/6147] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:51.331229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a407230-c780-4a1a-b7e4-8025d216c798 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:51.359080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a407230-c780-4a1a-b7e4-8025d216c798 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:51.430954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:51.480908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ae4f1-26f5-478c-8d11-65e85a992f4e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:51.490194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:51.490853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:51.491127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:51.491391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] PATH_INFO: `/v3/projects/7474543b5a054c7c8eea96c348cb8355` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:51.493806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513d680-5cb5-4cfc-ab56-49cc48a7f19c tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:51.494764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513d680-5cb5-4cfc-ab56-49cc48a7f19c tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:51.494910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513d680-5cb5-4cfc-ab56-49cc48a7f19c tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:51.495000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7474543b5a054c7c8eea96c348cb8355)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:51.495207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513d680-5cb5-4cfc-ab56-49cc48a7f19c tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:51.495981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513d680-5cb5-4cfc-ab56-49cc48a7f19c tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:create_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:51.498058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513d680-5cb5-4cfc-ab56-49cc48a7f19c tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:51.498780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:51.548326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:51.622167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7474543b5a054c7c8eea96c348cb8355', 'request_id': 'req-6d26e4b9-2a78-4ab8-94f1-867491bd3140'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:51.632320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7474543b5a054c7c8eea96c348cb8355', 'request_id': 'req-6d26e4b9-2a78-4ab8-94f1-867491bd3140'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:51.658238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7474543b5a054c7c8eea96c348cb8355', 'request_id': 'req-6d26e4b9-2a78-4ab8-94f1-867491bd3140'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:51.689212 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3053/6148] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Aug 30 04:44:51 2022] POST /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials => generated 789 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:51.690622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513d680-5cb5-4cfc-ab56-49cc48a7f19c tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:51.696211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] The token cache is being invalidate because project 7474543b5a054c7c8eea96c348cb8355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:51.696496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:51.698962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:51.703537 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3096/6149] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:51 2022] DELETE /identity/v3/projects/7474543b5a054c7c8eea96c348cb8355 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:51.705136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:51.710377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:51.896273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513d680-5cb5-4cfc-ab56-49cc48a7f19c tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:51.896855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26e4b9-2a78-4ab8-94f1-867491bd3140 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:51.921520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984f782-abf2-44c2-8e63-bc451f61784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:51.922411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984f782-abf2-44c2-8e63-bc451f61784d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:51.922695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984f782-abf2-44c2-8e63-bc451f61784d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:51.922995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984f782-abf2-44c2-8e63-bc451f61784d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:51.923630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984f782-abf2-44c2-8e63-bc451f61784d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:51.930062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984f782-abf2-44c2-8e63-bc451f61784d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:51.957521 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3097/6150] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:51.958671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984f782-abf2-44c2-8e63-bc451f61784d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:51.964637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3984f782-abf2-44c2-8e63-bc451f61784d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:52.076882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2fde8-b33f-4eb8-badc-605378df4347 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:52.077544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2fde8-b33f-4eb8-badc-605378df4347 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:52.081954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2fde8-b33f-4eb8-badc-605378df4347 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:52.082246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2fde8-b33f-4eb8-badc-605378df4347 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:52.083212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2fde8-b33f-4eb8-badc-605378df4347 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:52.092696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2fde8-b33f-4eb8-badc-605378df4347 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:52.145771 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3054/6151] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:44:51 2022] POST /identity/v3/roles => generated 239 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:52.147566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2fde8-b33f-4eb8-badc-605378df4347 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:52.153446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-16c2fde8-b33f-4eb8-badc-605378df4347 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:52.172747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984f782-abf2-44c2-8e63-bc451f61784d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:52.188771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9b695-cebd-4cb3-abb9-efb80bea3df1 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:52.189500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9b695-cebd-4cb3-abb9-efb80bea3df1 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:52.189924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9b695-cebd-4cb3-abb9-efb80bea3df1 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:52.190261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9b695-cebd-4cb3-abb9-efb80bea3df1 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:52.191023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9b695-cebd-4cb3-abb9-efb80bea3df1 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Adding query filter params (name=tempest-application_credential-1986244819) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:52.191341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9b695-cebd-4cb3-abb9-efb80bea3df1 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:list_application_credentials(user_id=e5f50940222d452fb63d89c278bc7aa8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:52.195107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9b695-cebd-4cb3-abb9-efb80bea3df1 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:52.201723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2fde8-b33f-4eb8-badc-605378df4347 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:52.220966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:52.221629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:52.221925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:52.222205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] PATH_INFO: `/v3/users/7acb4ee8aa46430a96e62e76e8e7118b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:52.226206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acb4ee8aa46430a96e62e76e8e7118b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:52.229332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:52.230314 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3098/6152] 10.222.0.43 () {58 vars in 1386 bytes} [Tue Aug 30 04:44:51 2022] GET /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials?name=tempest-application_credential-1986244819 => generated 887 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:52.231292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9b695-cebd-4cb3-abb9-efb80bea3df1 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:52.261611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9b695-cebd-4cb3-abb9-efb80bea3df1 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:52.266597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:52.277814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa9ed7-6db2-49cd-9e12-bbfb28709f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:52.278104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa9ed7-6db2-49cd-9e12-bbfb28709f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:52.278393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa9ed7-6db2-49cd-9e12-bbfb28709f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:52.278937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa9ed7-6db2-49cd-9e12-bbfb28709f06 admin admin] PATH_INFO: `/v3/projects/c450d527f6b84338af49783c90756fb4/users/2227c0fc5e464b47b85b798d9f4ef7f6/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:52.339800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa9ed7-6db2-49cd-9e12-bbfb28709f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c450d527f6b84338af49783c90756fb4, user_id=2227c0fc5e464b47b85b798d9f4ef7f6, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:52.342820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa9ed7-6db2-49cd-9e12-bbfb28709f06 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:52.367620 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3099/6153] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:52 2022] PUT /identity/v3/projects/c450d527f6b84338af49783c90756fb4/users/2227c0fc5e464b47b85b798d9f4ef7f6/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:52.368473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa9ed7-6db2-49cd-9e12-bbfb28709f06 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:52.372361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2faa9ed7-6db2-49cd-9e12-bbfb28709f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:52.384328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acb4ee8aa46430a96e62e76e8e7118b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:52.399187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acb4ee8aa46430a96e62e76e8e7118b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:52.424606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:52.435934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acb4ee8aa46430a96e62e76e8e7118b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:52.452875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acb4ee8aa46430a96e62e76e8e7118b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:52.455470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acb4ee8aa46430a96e62e76e8e7118b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:52.466955 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3055/6154] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:52 2022] DELETE /identity/v3/users/7acb4ee8aa46430a96e62e76e8e7118b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:52.467962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:52.469420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:52.554325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa9ed7-6db2-49cd-9e12-bbfb28709f06 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:52.627401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69405d-8ff0-4a60-9118-4e17c41299f4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:52.641037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4b81e-56fc-4e32-98fa-b944d972d7b4 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:52.641721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b81e-56fc-4e32-98fa-b944d972d7b4 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:52.642046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b81e-56fc-4e32-98fa-b944d972d7b4 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:52.642467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b81e-56fc-4e32-98fa-b944d972d7b4 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/4a6bbf0b50bc442db5967e9991aa597b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:52.668649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4b81e-56fc-4e32-98fa-b944d972d7b4 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8, application_credential_id=4a6bbf0b50bc442db5967e9991aa597b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:52.672544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4b81e-56fc-4e32-98fa-b944d972d7b4 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:52.717233 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3056/6155] 10.222.0.43 () {58 vars in 1395 bytes} [Tue Aug 30 04:44:52 2022] DELETE /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/4a6bbf0b50bc442db5967e9991aa597b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:52.725465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f627d41-f8f5-4876-9bc1-e896c38e2316 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:52.725798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f627d41-f8f5-4876-9bc1-e896c38e2316 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:52.726052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f627d41-f8f5-4876-9bc1-e896c38e2316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:52.738294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0d531-b7e4-4e47-accf-268feebc5f9e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:52.739203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0d531-b7e4-4e47-accf-268feebc5f9e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:52.739486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0d531-b7e4-4e47-accf-268feebc5f9e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:52.739759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0d531-b7e4-4e47-accf-268feebc5f9e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/projects/0a8cd8fe80e949d58f318a1b2977547a/users/b61daf9d065f43d6b485f1ce9ce75912/roles/5b73208c5295448f92a23e87d7d98f53` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:52.779256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0d531-b7e4-4e47-accf-268feebc5f9e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0a8cd8fe80e949d58f318a1b2977547a, user_id=b61daf9d065f43d6b485f1ce9ce75912, role_id=5b73208c5295448f92a23e87d7d98f53)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:52.788725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0d531-b7e4-4e47-accf-268feebc5f9e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:52.791935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6f627d41-f8f5-4876-9bc1-e896c38e2316 None None] MFA Rules not processed for user `2227c0fc5e464b47b85b798d9f4ef7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:52.793575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f627d41-f8f5-4876-9bc1-e896c38e2316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:52.831789 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3100/6156] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:52 2022] PUT /identity/v3/projects/0a8cd8fe80e949d58f318a1b2977547a/users/b61daf9d065f43d6b485f1ce9ce75912/roles/5b73208c5295448f92a23e87d7d98f53 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:52.832496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0d531-b7e4-4e47-accf-268feebc5f9e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:52.991674 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3057/6157] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:52.998963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f627d41-f8f5-4876-9bc1-e896c38e2316 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:53.000685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f627d41-f8f5-4876-9bc1-e896c38e2316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:53.018033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:53.031797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0d531-b7e4-4e47-accf-268feebc5f9e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:53.032111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f627d41-f8f5-4876-9bc1-e896c38e2316 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:53.042330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699671c-7c43-484e-a875-62eb2b28a6d9 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5f50940222d452fb63d89c278bc7aa8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f4ea402c4094e1bb51a30c00402991c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:53.043329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699671c-7c43-484e-a875-62eb2b28a6d9 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:53.047226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699671c-7c43-484e-a875-62eb2b28a6d9 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:53.047667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699671c-7c43-484e-a875-62eb2b28a6d9 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/afdd16c0ce834bd1b3e501516d6fcc80` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:53.062922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699671c-7c43-484e-a875-62eb2b28a6d9 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e5f50940222d452fb63d89c278bc7aa8, application_credential_id=afdd16c0ce834bd1b3e501516d6fcc80)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:53.064832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699671c-7c43-484e-a875-62eb2b28a6d9 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:53.120007 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3101/6158] 10.222.0.43 () {58 vars in 1395 bytes} [Tue Aug 30 04:44:52 2022] DELETE /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8/application_credentials/afdd16c0ce834bd1b3e501516d6fcc80 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:53.120007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699671c-7c43-484e-a875-62eb2b28a6d9 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:53.123613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7699671c-7c43-484e-a875-62eb2b28a6d9 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:53.170454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:53.208825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887090-bae5-4600-991d-e9af5099e1d9 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:53.211202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887090-bae5-4600-991d-e9af5099e1d9 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:53.211494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887090-bae5-4600-991d-e9af5099e1d9 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:53.211800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85887090-bae5-4600-991d-e9af5099e1d9 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/projects/d4bcd9f61bf54a70bce4f9303346edeb/users/b61daf9d065f43d6b485f1ce9ce75912/roles/5b73208c5295448f92a23e87d7d98f53` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:53.227007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85887090-bae5-4600-991d-e9af5099e1d9 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d4bcd9f61bf54a70bce4f9303346edeb, user_id=b61daf9d065f43d6b485f1ce9ce75912, role_id=5b73208c5295448f92a23e87d7d98f53)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:53.233652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85887090-bae5-4600-991d-e9af5099e1d9 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:53.246680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699671c-7c43-484e-a875-62eb2b28a6d9 tempest-ApplicationCredentialsV3Test-14877262 tempest-ApplicationCredentialsV3Test-14877262-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:53.259020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d15a1-bc3d-46f2-b904-e30e5e0196c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:53.260550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d15a1-bc3d-46f2-b904-e30e5e0196c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:53.261934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d15a1-bc3d-46f2-b904-e30e5e0196c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:53.262223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d15a1-bc3d-46f2-b904-e30e5e0196c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:53.262910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d15a1-bc3d-46f2-b904-e30e5e0196c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:53.267871 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3058/6159] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:52 2022] PUT /identity/v3/projects/d4bcd9f61bf54a70bce4f9303346edeb/users/b61daf9d065f43d6b485f1ce9ce75912/roles/5b73208c5295448f92a23e87d7d98f53 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:53.271441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887090-bae5-4600-991d-e9af5099e1d9 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:53.272425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d15a1-bc3d-46f2-b904-e30e5e0196c3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:53.273400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-85887090-bae5-4600-991d-e9af5099e1d9 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:53.367444 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3102/6160] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:53 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:53.367444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767dab5-2be8-4c53-b585-df1219744741 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:53.370300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767dab5-2be8-4c53-b585-df1219744741 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:53.370698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767dab5-2be8-4c53-b585-df1219744741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:53.423236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85887090-bae5-4600-991d-e9af5099e1d9 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:53.462497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6767dab5-2be8-4c53-b585-df1219744741 None None] MFA Rules not processed for user `b61daf9d065f43d6b485f1ce9ce75912`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:53.467361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6767dab5-2be8-4c53-b585-df1219744741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:53.474469 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3103/6161] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:53 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:44:53.475341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767dab5-2be8-4c53-b585-df1219744741 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:53.555091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:53.555755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:53.556032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:53.556643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] PATH_INFO: `/v3/users/e5f50940222d452fb63d89c278bc7aa8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:53.558301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f50940222d452fb63d89c278bc7aa8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:53.563605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:53.645858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767dab5-2be8-4c53-b585-df1219744741 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:53.668027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787bbba7-abf0-416a-a9fb-e93d7ff50671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:53.675255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bbba7-abf0-416a-a9fb-e93d7ff50671 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:53.675536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bbba7-abf0-416a-a9fb-e93d7ff50671 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:53.676195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787bbba7-abf0-416a-a9fb-e93d7ff50671 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:53.676992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bbba7-abf0-416a-a9fb-e93d7ff50671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:53.689630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787bbba7-abf0-416a-a9fb-e93d7ff50671 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:53.701032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f50940222d452fb63d89c278bc7aa8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:53.702660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:53.725039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f50940222d452fb63d89c278bc7aa8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:53.750401 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3104/6162] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:53 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:53.753531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0e53-395c-414b-bb1e-db610ba8d4d2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:53.753816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0e53-395c-414b-bb1e-db610ba8d4d2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:53.754126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c0e53-395c-414b-bb1e-db610ba8d4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:53.768275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f50940222d452fb63d89c278bc7aa8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:53.777745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a34c0e53-395c-414b-bb1e-db610ba8d4d2 None None] MFA Rules not processed for user `b61daf9d065f43d6b485f1ce9ce75912`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:53.780376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a34c0e53-395c-414b-bb1e-db610ba8d4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:53.784951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f50940222d452fb63d89c278bc7aa8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:53.786536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f50940222d452fb63d89c278bc7aa8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:53.795894 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3059/6163] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:53 2022] DELETE /identity/v3/users/e5f50940222d452fb63d89c278bc7aa8 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:53.796927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:53.798995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:53.912412 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3105/6164] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:53 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 30 04:44:53.913308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0e53-395c-414b-bb1e-db610ba8d4d2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:53.927891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c0e53-395c-414b-bb1e-db610ba8d4d2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:53.962031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48ac3b-da6c-4129-b13f-9f548e7e850d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:53.968062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:53.969628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:53.970238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:53.970622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] PATH_INFO: `/v3/projects/e5656e30f7844813a26e087462541e37` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:53.972328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5656e30f7844813a26e087462541e37)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:53.975525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:53.980966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:54.021905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02f638-ea90-41c2-9287-902b7e7dd805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:54.022938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f638-ea90-41c2-9287-902b7e7dd805 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:54.023421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f638-ea90-41c2-9287-902b7e7dd805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:54.023877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f638-ea90-41c2-9287-902b7e7dd805 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:54.025379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02f638-ea90-41c2-9287-902b7e7dd805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:54.027711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02f638-ea90-41c2-9287-902b7e7dd805 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:54.043789 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3106/6165] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:53 2022] GET /identity/v3/roles => generated 1650 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:54.045286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a533c43-d07c-4c7a-bdd2-bc3231a0ce85 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:54.045642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a533c43-d07c-4c7a-bdd2-bc3231a0ce85 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:54.046012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a533c43-d07c-4c7a-bdd2-bc3231a0ce85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:54.058633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5656e30f7844813a26e087462541e37', 'request_id': 'req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:54.071528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5656e30f7844813a26e087462541e37', 'request_id': 'req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:54.077337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1a533c43-d07c-4c7a-bdd2-bc3231a0ce85 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:54.078754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1a533c43-d07c-4c7a-bdd2-bc3231a0ce85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:54.084086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5656e30f7844813a26e087462541e37', 'request_id': 'req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:54.105513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] The token cache is being invalidate because project e5656e30f7844813a26e087462541e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:54.106202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:54.107146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:54.110258 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3060/6166] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:53 2022] DELETE /identity/v3/projects/e5656e30f7844813a26e087462541e37 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:54.112168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:54.114053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:54.211249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:54.224461 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3107/6167] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:54.225482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a533c43-d07c-4c7a-bdd2-bc3231a0ce85 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:54.227086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1a533c43-d07c-4c7a-bdd2-bc3231a0ce85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:54.244212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abebc1-f2ba-4e5a-bd4b-799a35fe830d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:54.255955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a7a88-4aa1-4f95-a4c1-71d8dbd2f425 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:54.256614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a7a88-4aa1-4f95-a4c1-71d8dbd2f425 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:54.256897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a7a88-4aa1-4f95-a4c1-71d8dbd2f425 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:54.257228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a7a88-4aa1-4f95-a4c1-71d8dbd2f425 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:54.261054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3c3a7a88-4aa1-4f95-a4c1-71d8dbd2f425 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:54.265688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a533c43-d07c-4c7a-bdd2-bc3231a0ce85 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:54.276687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff069f3-dd05-4fa6-92c1-9ea6774cc258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:54.277331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff069f3-dd05-4fa6-92c1-9ea6774cc258 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:54.279918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff069f3-dd05-4fa6-92c1-9ea6774cc258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:54.280275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff069f3-dd05-4fa6-92c1-9ea6774cc258 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:54.282382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff069f3-dd05-4fa6-92c1-9ea6774cc258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:54.287470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff069f3-dd05-4fa6-92c1-9ea6774cc258 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:54.316524 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3108/6168] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:54 2022] GET /identity/v3/roles => generated 1650 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:54.318052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aadba-691d-4b59-b316-68f22e940210 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:54.321302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aadba-691d-4b59-b316-68f22e940210 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:54.321552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501aadba-691d-4b59-b316-68f22e940210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:54.373057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-501aadba-691d-4b59-b316-68f22e940210 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:54.378768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-501aadba-691d-4b59-b316-68f22e940210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:54.401736 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3109/6169] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:54.404381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aadba-691d-4b59-b316-68f22e940210 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:54.408718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-501aadba-691d-4b59-b316-68f22e940210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:54.415069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a7a88-4aa1-4f95-a4c1-71d8dbd2f425 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:54.417266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a7a88-4aa1-4f95-a4c1-71d8dbd2f425 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:54.450063 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3061/6170] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Aug 30 04:44:54 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:54.451743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a7a88-4aa1-4f95-a4c1-71d8dbd2f425 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:54.504294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a7a88-4aa1-4f95-a4c1-71d8dbd2f425 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:54.519161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422c81e-aa43-4474-af81-dfc01ce38b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:54.526629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c81e-aa43-4474-af81-dfc01ce38b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:54.526982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c81e-aa43-4474-af81-dfc01ce38b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:54.527173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c81e-aa43-4474-af81-dfc01ce38b0e admin admin] PATH_INFO: `/v3/projects/9c64a6e2fd3147529194a96c5a3b1801/users/e8cf8918549c4339b068736d9f7f7ce7/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:54.574836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422c81e-aa43-4474-af81-dfc01ce38b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c64a6e2fd3147529194a96c5a3b1801, user_id=e8cf8918549c4339b068736d9f7f7ce7, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:54.579073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422c81e-aa43-4474-af81-dfc01ce38b0e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:54.622411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501aadba-691d-4b59-b316-68f22e940210 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:54.637053 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3062/6171] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:54 2022] PUT /identity/v3/projects/9c64a6e2fd3147529194a96c5a3b1801/users/e8cf8918549c4339b068736d9f7f7ce7/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:54.637053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92cbe-92a7-4c37-abaa-be9533a4b740 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:54.637053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92cbe-92a7-4c37-abaa-be9533a4b740 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:54.637053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a92cbe-92a7-4c37-abaa-be9533a4b740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:54.683085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-06a92cbe-92a7-4c37-abaa-be9533a4b740 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:54.684473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-06a92cbe-92a7-4c37-abaa-be9533a4b740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:54.783447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c683a-bf6e-40cc-ba84-a07f4bbb74ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:54.783447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c683a-bf6e-40cc-ba84-a07f4bbb74ee service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:54.783447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c683a-bf6e-40cc-ba84-a07f4bbb74ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:54.783850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c683a-bf6e-40cc-ba84-a07f4bbb74ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:54.840145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:54.890007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3063/6172] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:54.891860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8386d2-c8d1-4e29-962b-f89992a7f7b8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:54.892413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8386d2-c8d1-4e29-962b-f89992a7f7b8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:54.893154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8386d2-c8d1-4e29-962b-f89992a7f7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:54.920224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-de8386d2-c8d1-4e29-962b-f89992a7f7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:54.972182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-de8386d2-c8d1-4e29-962b-f89992a7f7b8 None None] MFA Rules not processed for user `b61daf9d065f43d6b485f1ce9ce75912`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:54.974095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-de8386d2-c8d1-4e29-962b-f89992a7f7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:55.034737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c683a-bf6e-40cc-ba84-a07f4bbb74ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:55.045195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c683a-bf6e-40cc-ba84-a07f4bbb74ee service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:55.096341 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3110/6173] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:55.098060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc8a2-4dfb-44c7-8ecb-c210d67b7e1c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:55.098606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc8a2-4dfb-44c7-8ecb-c210d67b7e1c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:55.099320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcc8a2-4dfb-44c7-8ecb-c210d67b7e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:55.124499 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3064/6174] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:54 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 30 04:44:55.126749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8386d2-c8d1-4e29-962b-f89992a7f7b8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:55.140374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8386d2-c8d1-4e29-962b-f89992a7f7b8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:55.147159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91109128-e2b7-4037-92dc-ea3f6ad82969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:55.147791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91109128-e2b7-4037-92dc-ea3f6ad82969 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:55.148064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91109128-e2b7-4037-92dc-ea3f6ad82969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:55.148331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91109128-e2b7-4037-92dc-ea3f6ad82969 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:55.148996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91109128-e2b7-4037-92dc-ea3f6ad82969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:55.149284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91109128-e2b7-4037-92dc-ea3f6ad82969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:55.151018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91109128-e2b7-4037-92dc-ea3f6ad82969 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:55.160323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-40fcc8a2-4dfb-44c7-8ecb-c210d67b7e1c None None] MFA Rules not processed for user `e8cf8918549c4339b068736d9f7f7ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:55.162020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-40fcc8a2-4dfb-44c7-8ecb-c210d67b7e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:55.164471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:55.175477 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3065/6175] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:55.177486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91109128-e2b7-4037-92dc-ea3f6ad82969 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:55.288638 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3111/6176] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:55.288638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcc8a2-4dfb-44c7-8ecb-c210d67b7e1c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:55.298544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcc8a2-4dfb-44c7-8ecb-c210d67b7e1c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:55.305145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea1d69-f318-4075-9eb7-f68967a6f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:55.305851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1d69-f318-4075-9eb7-f68967a6f382 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:55.306248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1d69-f318-4075-9eb7-f68967a6f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:55.306588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea1d69-f318-4075-9eb7-f68967a6f382 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:55.307360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea1d69-f318-4075-9eb7-f68967a6f382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:55.308625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91109128-e2b7-4037-92dc-ea3f6ad82969 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:55.310083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea1d69-f318-4075-9eb7-f68967a6f382 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:55.320077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:55.320706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:55.320983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:55.321252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/roles/5b73208c5295448f92a23e87d7d98f53` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:55.326185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5b73208c5295448f92a23e87d7d98f53)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:55.330100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:55.351786 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3112/6177] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:55 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:55.352774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea1d69-f318-4075-9eb7-f68967a6f382 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:55.403899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invalidating the token cache because role 5b73208c5295448f92a23e87d7d98f53 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:55.404671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:55.405764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:55.414306 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3066/6178] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:55 2022] DELETE /identity/v3/roles/5b73208c5295448f92a23e87d7d98f53 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:55.414306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:55.414306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:55.565332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea1d69-f318-4075-9eb7-f68967a6f382 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:55.579588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2f49-f1da-40cc-bd6c-597ea2238930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:55.580392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2f49-f1da-40cc-bd6c-597ea2238930 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:55.581152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2f49-f1da-40cc-bd6c-597ea2238930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:55.581506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2f49-f1da-40cc-bd6c-597ea2238930 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:55.582521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2f49-f1da-40cc-bd6c-597ea2238930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:55.597515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2f49-f1da-40cc-bd6c-597ea2238930 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:55.598950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accff924-e476-4f79-9652-b6bb9397ad8e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:55.617798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30b1a1-cb47-40fa-bbc7-353fde798621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:55.621580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b1a1-cb47-40fa-bbc7-353fde798621 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:55.622042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b1a1-cb47-40fa-bbc7-353fde798621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:55.622932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30b1a1-cb47-40fa-bbc7-353fde798621 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:55.623786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30b1a1-cb47-40fa-bbc7-353fde798621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:55.629225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30b1a1-cb47-40fa-bbc7-353fde798621 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:55.686722 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3067/6179] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:55 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:55.687684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30b1a1-cb47-40fa-bbc7-353fde798621 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:55.692736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ee30b1a1-cb47-40fa-bbc7-353fde798621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:55.709345 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3113/6180] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:55 2022] POST /identity/v3/projects => generated 377 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:55.709345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2f49-f1da-40cc-bd6c-597ea2238930 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:55.710215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0acb2f49-f1da-40cc-bd6c-597ea2238930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:55.724875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:55.894365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:55.911430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30b1a1-cb47-40fa-bbc7-353fde798621 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:55.923321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2f49-f1da-40cc-bd6c-597ea2238930 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:55.936163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3d0a-9cd4-40f1-815f-88f21c1a0cfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:55.936809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3d0a-9cd4-40f1-815f-88f21c1a0cfb service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:55.937083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3d0a-9cd4-40f1-815f-88f21c1a0cfb service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:55.937347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3d0a-9cd4-40f1-815f-88f21c1a0cfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:55.945350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-744a3d0a-9cd4-40f1-815f-88f21c1a0cfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:55.976530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a3d0a-9cd4-40f1-815f-88f21c1a0cfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:55.978186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a3d0a-9cd4-40f1-815f-88f21c1a0cfb service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:56.027953 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3114/6181] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:56.029908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3d0a-9cd4-40f1-815f-88f21c1a0cfb service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:56.031549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:56.032430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:56.032861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:56.033303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/projects/d4bcd9f61bf54a70bce4f9303346edeb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:56.034692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4bcd9f61bf54a70bce4f9303346edeb)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:56.036888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:56.133747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4bcd9f61bf54a70bce4f9303346edeb', 'request_id': 'req-aed19383-9a11-45f6-9e91-aee3d69fe076'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:56.156118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4bcd9f61bf54a70bce4f9303346edeb', 'request_id': 'req-aed19383-9a11-45f6-9e91-aee3d69fe076'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:56.166955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4bcd9f61bf54a70bce4f9303346edeb', 'request_id': 'req-aed19383-9a11-45f6-9e91-aee3d69fe076'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:56.178762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3d0a-9cd4-40f1-815f-88f21c1a0cfb service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:56.201794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] The token cache is being invalidate because project d4bcd9f61bf54a70bce4f9303346edeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:56.201794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:56.202458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:56.204568 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3068/6182] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:55 2022] DELETE /identity/v3/projects/d4bcd9f61bf54a70bce4f9303346edeb => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:56.205430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:56.207704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:56.289004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240807e4-7a32-4121-8424-89a33034282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:56.289841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240807e4-7a32-4121-8424-89a33034282d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:56.290969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240807e4-7a32-4121-8424-89a33034282d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:56.291246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240807e4-7a32-4121-8424-89a33034282d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:56.294242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240807e4-7a32-4121-8424-89a33034282d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:56.297623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240807e4-7a32-4121-8424-89a33034282d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:56.324037 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3115/6183] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:56.325166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240807e4-7a32-4121-8424-89a33034282d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:56.331730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-240807e4-7a32-4121-8424-89a33034282d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:56.348285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed19383-9a11-45f6-9e91-aee3d69fe076 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:56.356421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240807e4-7a32-4121-8424-89a33034282d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:56.359338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73379a-f8e8-4933-834d-70d2327b5511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:56.360901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73379a-f8e8-4933-834d-70d2327b5511 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:56.360901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73379a-f8e8-4933-834d-70d2327b5511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:56.360901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73379a-f8e8-4933-834d-70d2327b5511 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:56.361727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73379a-f8e8-4933-834d-70d2327b5511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:56.366139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73379a-f8e8-4933-834d-70d2327b5511 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:56.369779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:56.370496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:56.370868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:56.371080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] PATH_INFO: `/v3/projects/0f4ea402c4094e1bb51a30c00402991c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:56.373061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4ea402c4094e1bb51a30c00402991c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:56.375667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:56.412324 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3069/6184] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:56 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:56.418814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73379a-f8e8-4933-834d-70d2327b5511 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:56.424873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0a73379a-f8e8-4933-834d-70d2327b5511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:56.431272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:56.474424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:56.475709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4ea402c4094e1bb51a30c00402991c', 'request_id': 'req-5fc472b7-86d0-402e-9ffc-1842ac2afed3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:56.491138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4ea402c4094e1bb51a30c00402991c', 'request_id': 'req-5fc472b7-86d0-402e-9ffc-1842ac2afed3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:56.505295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4ea402c4094e1bb51a30c00402991c', 'request_id': 'req-5fc472b7-86d0-402e-9ffc-1842ac2afed3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:56.533733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] The token cache is being invalidate because project 0f4ea402c4094e1bb51a30c00402991c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:56.534047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:56.534766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:56.536566 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3116/6185] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:56 2022] DELETE /identity/v3/projects/0f4ea402c4094e1bb51a30c00402991c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:56.537384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:56.540867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:56.546144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73379a-f8e8-4933-834d-70d2327b5511 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:56.716208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc472b7-86d0-402e-9ffc-1842ac2afed3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:56.717576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b239353-ce49-45ce-bf78-8b0c38b9413e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:56.718413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b239353-ce49-45ce-bf78-8b0c38b9413e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:56.718672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b239353-ce49-45ce-bf78-8b0c38b9413e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:56.719058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b239353-ce49-45ce-bf78-8b0c38b9413e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/projects/d4bcd9f61bf54a70bce4f9303346edeb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:56.734052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9009-b5ac-4b17-8822-c46a43baf48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:56.734698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9009-b5ac-4b17-8822-c46a43baf48d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:56.734976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9009-b5ac-4b17-8822-c46a43baf48d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:56.735246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9009-b5ac-4b17-8822-c46a43baf48d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:56.735910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed9009-b5ac-4b17-8822-c46a43baf48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:56.737535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed9009-b5ac-4b17-8822-c46a43baf48d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:56.739950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b239353-ce49-45ce-bf78-8b0c38b9413e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d4bcd9f61bf54a70bce4f9303346edeb)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:56.742276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b239353-ce49-45ce-bf78-8b0c38b9413e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:56.763769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3117/6186] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:56.765639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9009-b5ac-4b17-8822-c46a43baf48d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:56.771319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-97ed9009-b5ac-4b17-8822-c46a43baf48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6b239353-ce49-45ce-bf78-8b0c38b9413e tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Could not find project: d4bcd9f61bf54a70bce4f9303346edeb.: keystone.exception.ProjectNotFound: Could not find project: d4bcd9f61bf54a70bce4f9303346edeb. Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 30 04:44:56.772588 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 30 04:44:56.773644 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:56.773644 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:56.773644 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 30 04:44:56.773644 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 30 04:44:56.773644 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:44:56.773644 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:44:56.773644 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:44:56.773644 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:44:56.773644 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d4bcd9f61bf54a70bce4f9303346edeb. Aug 30 04:44:56.773644 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:44:56.779845 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3070/6187] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:56 2022] DELETE /identity/v3/projects/d4bcd9f61bf54a70bce4f9303346edeb => generated 113 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:56.782419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787696c0-fd53-4e31-a12a-441dcbcaac87 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:56.782704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787696c0-fd53-4e31-a12a-441dcbcaac87 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:56.785635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787696c0-fd53-4e31-a12a-441dcbcaac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:56.804697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9009-b5ac-4b17-8822-c46a43baf48d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:56.820828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-787696c0-fd53-4e31-a12a-441dcbcaac87 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:56.822624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-787696c0-fd53-4e31-a12a-441dcbcaac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:56.830445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fb03-69e2-46ca-aa85-99bed7c033af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:56.831089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fb03-69e2-46ca-aa85-99bed7c033af admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:56.831371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fb03-69e2-46ca-aa85-99bed7c033af admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:56.831638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac0fb03-69e2-46ca-aa85-99bed7c033af admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:56.832299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0fb03-69e2-46ca-aa85-99bed7c033af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:56.834845 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3071/6188] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:56.835795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787696c0-fd53-4e31-a12a-441dcbcaac87 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:56.842602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac0fb03-69e2-46ca-aa85-99bed7c033af admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:56.868871 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3118/6189] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:56.869821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fb03-69e2-46ca-aa85-99bed7c033af admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:56.874083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5ac0fb03-69e2-46ca-aa85-99bed7c033af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:56.888477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787696c0-fd53-4e31-a12a-441dcbcaac87 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:56.909786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4267c1-e8f5-4243-8cf3-3a6b3b816ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:56.910646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4267c1-e8f5-4243-8cf3-3a6b3b816ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:56.912071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4267c1-e8f5-4243-8cf3-3a6b3b816ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:56.912353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4267c1-e8f5-4243-8cf3-3a6b3b816ca6 admin admin] PATH_INFO: `/v3/projects/8d88f4a4c0fb47acb78b79a3336ab15b/users/73cafed6dc6c4058b953d29a18c6c8a9/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:56.917357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac0fb03-69e2-46ca-aa85-99bed7c033af admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:56.940062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:56.941104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:56.941104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:56.941332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/projects/0a8cd8fe80e949d58f318a1b2977547a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:56.942895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0a8cd8fe80e949d58f318a1b2977547a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:56.945649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:56.986394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4267c1-e8f5-4243-8cf3-3a6b3b816ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d88f4a4c0fb47acb78b79a3336ab15b, user_id=73cafed6dc6c4058b953d29a18c6c8a9, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:56.990421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4267c1-e8f5-4243-8cf3-3a6b3b816ca6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:57.018232 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3072/6190] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:56 2022] PUT /identity/v3/projects/8d88f4a4c0fb47acb78b79a3336ab15b/users/73cafed6dc6c4058b953d29a18c6c8a9/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:57.023216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5333297-df82-4b18-ab7e-41cc3967fa3b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:57.023875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5333297-df82-4b18-ab7e-41cc3967fa3b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:57.024228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5333297-df82-4b18-ab7e-41cc3967fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:57.061685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8cd8fe80e949d58f318a1b2977547a', 'request_id': 'req-52f2d2c5-8964-47eb-868e-0325b20b54fc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:57.073310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8cd8fe80e949d58f318a1b2977547a', 'request_id': 'req-52f2d2c5-8964-47eb-868e-0325b20b54fc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:57.073646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e5333297-df82-4b18-ab7e-41cc3967fa3b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:57.075039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e5333297-df82-4b18-ab7e-41cc3967fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:57.097950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8cd8fe80e949d58f318a1b2977547a', 'request_id': 'req-52f2d2c5-8964-47eb-868e-0325b20b54fc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:57.117972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] The token cache is being invalidate because project 0a8cd8fe80e949d58f318a1b2977547a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:44:57.119854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:57.123054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:57.127367 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3119/6191] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:44:56 2022] DELETE /identity/v3/projects/0a8cd8fe80e949d58f318a1b2977547a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:57.128801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:57.131886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:57.163673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:57.199529 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3073/6192] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:57.201118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e123-84d1-40e8-a83b-ac809c5116e1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:57.202130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e123-84d1-40e8-a83b-ac809c5116e1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:57.202395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8e123-84d1-40e8-a83b-ac809c5116e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:57.239535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1db8e123-84d1-40e8-a83b-ac809c5116e1 None None] MFA Rules not processed for user `73cafed6dc6c4058b953d29a18c6c8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:57.240750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1db8e123-84d1-40e8-a83b-ac809c5116e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:57.248417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2d2c5-8964-47eb-868e-0325b20b54fc tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:57.257965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e14a8-8d1e-4a55-96bc-3dd78b3ceb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:57.258759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e14a8-8d1e-4a55-96bc-3dd78b3ceb51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:57.259101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e14a8-8d1e-4a55-96bc-3dd78b3ceb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:57.259461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e14a8-8d1e-4a55-96bc-3dd78b3ceb51 admin admin] PATH_INFO: `/v3/projects/1d5629c344f04c56a319e5f663bb9bea/users/5dacb00a726848b3a5ed8a4b47c6df60/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:57.268497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:57.284718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e14a8-8d1e-4a55-96bc-3dd78b3ceb51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5629c344f04c56a319e5f663bb9bea, user_id=5dacb00a726848b3a5ed8a4b47c6df60, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:57.287777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e14a8-8d1e-4a55-96bc-3dd78b3ceb51 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:57.308684 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3120/6193] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:57 2022] PUT /identity/v3/projects/1d5629c344f04c56a319e5f663bb9bea/users/5dacb00a726848b3a5ed8a4b47c6df60/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:57.308684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e14a8-8d1e-4a55-96bc-3dd78b3ceb51 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:57.309994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-002e14a8-8d1e-4a55-96bc-3dd78b3ceb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:57.384345 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3074/6194] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:57.386263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8e123-84d1-40e8-a83b-ac809c5116e1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:57.399815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e14a8-8d1e-4a55-96bc-3dd78b3ceb51 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:57.406721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:57.408180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:57.408684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:57.409251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/users/b61daf9d065f43d6b485f1ce9ce75912` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:57.410983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b61daf9d065f43d6b485f1ce9ce75912)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:57.413145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:57.419943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8e123-84d1-40e8-a83b-ac809c5116e1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:57.483718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b61daf9d065f43d6b485f1ce9ce75912'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:57.484736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b61daf9d065f43d6b485f1ce9ce75912'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:57.496353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b61daf9d065f43d6b485f1ce9ce75912'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:57.510381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b61daf9d065f43d6b485f1ce9ce75912'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:57.531317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b61daf9d065f43d6b485f1ce9ce75912'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:57.543581 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3121/6195] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:57 2022] DELETE /identity/v3/users/b61daf9d065f43d6b485f1ce9ce75912 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:57.544467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:57.547277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:57.570193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b2185-9895-44a9-8e21-db4ee8d80154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:57.570834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b2185-9895-44a9-8e21-db4ee8d80154 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:57.571114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b2185-9895-44a9-8e21-db4ee8d80154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:57.571389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b2185-9895-44a9-8e21-db4ee8d80154 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:57.572054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b2185-9895-44a9-8e21-db4ee8d80154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:44:57.572353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b2185-9895-44a9-8e21-db4ee8d80154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:57.574447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b2185-9895-44a9-8e21-db4ee8d80154 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:57.584645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:57.614741 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3075/6196] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:44:57.615647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b2185-9895-44a9-8e21-db4ee8d80154 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:57.618813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2f8b2185-9895-44a9-8e21-db4ee8d80154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:57.644708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b2185-9895-44a9-8e21-db4ee8d80154 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:57.670323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774d8a2-afe7-4a19-9663-0d60dd1feb64 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:57.675901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc2cd9-a58b-418c-80f7-402e43da5d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:57.676931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2cd9-a58b-418c-80f7-402e43da5d68 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:57.677389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2cd9-a58b-418c-80f7-402e43da5d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:57.681947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc2cd9-a58b-418c-80f7-402e43da5d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:57.681947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc2cd9-a58b-418c-80f7-402e43da5d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:57.681947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc2cd9-a58b-418c-80f7-402e43da5d68 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:57.696410 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3122/6197] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:57.696410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc2cd9-a58b-418c-80f7-402e43da5d68 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:57.696687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ecfc2cd9-a58b-418c-80f7-402e43da5d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:57.793753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc2cd9-a58b-418c-80f7-402e43da5d68 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:57.808314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f38a82-f01f-4728-9fc2-1e012be5939a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:57.808994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38a82-f01f-4728-9fc2-1e012be5939a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:57.809271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38a82-f01f-4728-9fc2-1e012be5939a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:57.817284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f38a82-f01f-4728-9fc2-1e012be5939a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/b503738069f3491dabe2a8b1e91ef249` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:57.824619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268e80-6ffe-4d4e-abc7-6f3374093904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:57.826437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268e80-6ffe-4d4e-abc7-6f3374093904 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:57.826708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268e80-6ffe-4d4e-abc7-6f3374093904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:57.826975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6268e80-6ffe-4d4e-abc7-6f3374093904 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:57.829249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f38a82-f01f-4728-9fc2-1e012be5939a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:44:57.830373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6268e80-6ffe-4d4e-abc7-6f3374093904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:57.832346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6268e80-6ffe-4d4e-abc7-6f3374093904 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-a5f38a82-f01f-4728-9fc2-1e012be5939a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Could not find domain: b503738069f3491dabe2a8b1e91ef249.: keystone.exception.DomainNotFound: Could not find domain: b503738069f3491dabe2a8b1e91ef249. Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b503738069f3491dabe2a8b1e91ef249. Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:57.840589 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:57.841774 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b503738069f3491dabe2a8b1e91ef249. Aug 30 04:44:57.843339 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:57.844501 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3123/6198] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:44:57 2022] PATCH /identity/v3/domains/b503738069f3491dabe2a8b1e91ef249 => generated 112 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:57.844501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f38a82-f01f-4728-9fc2-1e012be5939a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:57.850268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a5f38a82-f01f-4728-9fc2-1e012be5939a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:57.897369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f38a82-f01f-4728-9fc2-1e012be5939a tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:57.907231 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3076/6199] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:57 2022] POST /identity/v3/projects => generated 365 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:57.908263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268e80-6ffe-4d4e-abc7-6f3374093904 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.029791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:58.042298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aec483-ec2b-47c3-8bc2-aefe327a3679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.044523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aec483-ec2b-47c3-8bc2-aefe327a3679 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.046795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aec483-ec2b-47c3-8bc2-aefe327a3679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.047239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aec483-ec2b-47c3-8bc2-aefe327a3679 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.049395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aec483-ec2b-47c3-8bc2-aefe327a3679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:58.058395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aec483-ec2b-47c3-8bc2-aefe327a3679 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:58.093467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6268e80-6ffe-4d4e-abc7-6f3374093904 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:58.106296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687ecee-8235-4600-8e7a-dc147891ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.107790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687ecee-8235-4600-8e7a-dc147891ba8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.108201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687ecee-8235-4600-8e7a-dc147891ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.108571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687ecee-8235-4600-8e7a-dc147891ba8b admin admin] PATH_INFO: `/v3/projects/1d5629c344f04c56a319e5f663bb9bea/users/5dacb00a726848b3a5ed8a4b47c6df60/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.111541 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3124/6200] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:57 2022] POST /identity/v3/projects => generated 407 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:58.112049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687ecee-8235-4600-8e7a-dc147891ba8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5629c344f04c56a319e5f663bb9bea, user_id=5dacb00a726848b3a5ed8a4b47c6df60, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:58.115539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687ecee-8235-4600-8e7a-dc147891ba8b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:58.120365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aec483-ec2b-47c3-8bc2-aefe327a3679 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.130890 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3077/6201] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:57 2022] PUT /identity/v3/projects/1d5629c344f04c56a319e5f663bb9bea/users/5dacb00a726848b3a5ed8a4b47c6df60/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:58.131866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687ecee-8235-4600-8e7a-dc147891ba8b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.215714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:58.247214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687ecee-8235-4600-8e7a-dc147891ba8b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:58.247605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aec483-ec2b-47c3-8bc2-aefe327a3679 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:58.262649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde459be-fcef-4d1e-b941-e49a86aa9226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.263275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde459be-fcef-4d1e-b941-e49a86aa9226 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.263551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde459be-fcef-4d1e-b941-e49a86aa9226 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.263816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde459be-fcef-4d1e-b941-e49a86aa9226 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.264768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde459be-fcef-4d1e-b941-e49a86aa9226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:58.269074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde459be-fcef-4d1e-b941-e49a86aa9226 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:58.324040 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3078/6202] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:58 2022] POST /identity/v3/users => generated 289 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:58.324598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde459be-fcef-4d1e-b941-e49a86aa9226 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.345781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde459be-fcef-4d1e-b941-e49a86aa9226 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:58.353556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9429a-f058-43c8-901d-15d8a5bae2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.354863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9429a-f058-43c8-901d-15d8a5bae2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.355436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9429a-f058-43c8-901d-15d8a5bae2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.356021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9429a-f058-43c8-901d-15d8a5bae2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.357047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9429a-f058-43c8-901d-15d8a5bae2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:58.359866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9429a-f058-43c8-901d-15d8a5bae2e8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:58.375023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091b02b-f93b-4569-a615-f2dc783bd731 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.375809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b02b-f93b-4569-a615-f2dc783bd731 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.377757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b02b-f93b-4569-a615-f2dc783bd731 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.378462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b02b-f93b-4569-a615-f2dc783bd731 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/a0353903cad941a08963bf66848a2ea4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.398310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091b02b-f93b-4569-a615-f2dc783bd731 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:44:58.400882 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3079/6203] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:44:58 2022] POST /identity/v3/users => generated 304 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:58.404968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcad3c1-1ff0-4350-8f25-62c32082d468 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.405395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcad3c1-1ff0-4350-8f25-62c32082d468 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.405986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcad3c1-1ff0-4350-8f25-62c32082d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-b091b02b-f93b-4569-a615-f2dc783bd731 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Could not find domain: a0353903cad941a08963bf66848a2ea4.: keystone.exception.DomainNotFound: Could not find domain: a0353903cad941a08963bf66848a2ea4. Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a0353903cad941a08963bf66848a2ea4. Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:58.416181 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:58.417354 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a0353903cad941a08963bf66848a2ea4. Aug 30 04:44:58.418315 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:58.422566 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3125/6204] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:44:58 2022] PATCH /identity/v3/domains/a0353903cad941a08963bf66848a2ea4 => generated 112 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:58.423511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091b02b-f93b-4569-a615-f2dc783bd731 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.452163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091b02b-f93b-4569-a615-f2dc783bd731 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:58.469010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598d319-3799-4044-a335-946135a1ba3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.469661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598d319-3799-4044-a335-946135a1ba3d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.471280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598d319-3799-4044-a335-946135a1ba3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.471571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598d319-3799-4044-a335-946135a1ba3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.472247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598d319-3799-4044-a335-946135a1ba3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:58.473740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1fcad3c1-1ff0-4350-8f25-62c32082d468 None None] MFA Rules not processed for user `5dacb00a726848b3a5ed8a4b47c6df60`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:58.474321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598d319-3799-4044-a335-946135a1ba3d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:58.475422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1fcad3c1-1ff0-4350-8f25-62c32082d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:58.512705 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3126/6205] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:58.513381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598d319-3799-4044-a335-946135a1ba3d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.541395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598d319-3799-4044-a335-946135a1ba3d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:58.554449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585c46f-76ff-40b9-b7c4-d88342d6151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.556116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c46f-76ff-40b9-b7c4-d88342d6151d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.557248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c46f-76ff-40b9-b7c4-d88342d6151d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.558189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585c46f-76ff-40b9-b7c4-d88342d6151d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.560715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585c46f-76ff-40b9-b7c4-d88342d6151d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:58.565863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585c46f-76ff-40b9-b7c4-d88342d6151d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:58.596090 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3127/6206] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:58.596870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585c46f-76ff-40b9-b7c4-d88342d6151d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.612245 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3080/6207] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:58.613399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcad3c1-1ff0-4350-8f25-62c32082d468 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.615545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1fcad3c1-1ff0-4350-8f25-62c32082d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:58.619265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585c46f-76ff-40b9-b7c4-d88342d6151d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:58.624742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2265e-854f-4abb-b7a1-243b4efdda4f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.625580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2265e-854f-4abb-b7a1-243b4efdda4f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.625865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2265e-854f-4abb-b7a1-243b4efdda4f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.626193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2265e-854f-4abb-b7a1-243b4efdda4f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/4b2e570d86f74ee9a3e4b6841a83fee0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.637842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2265e-854f-4abb-b7a1-243b4efdda4f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-bad2265e-854f-4abb-b7a1-243b4efdda4f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Could not find domain: 4b2e570d86f74ee9a3e4b6841a83fee0.: keystone.exception.DomainNotFound: Could not find domain: 4b2e570d86f74ee9a3e4b6841a83fee0. Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 4b2e570d86f74ee9a3e4b6841a83fee0. Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:58.648675 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:58.649751 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 4b2e570d86f74ee9a3e4b6841a83fee0. Aug 30 04:44:58.650842 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:58.653185 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3128/6208] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:44:58 2022] PATCH /identity/v3/domains/4b2e570d86f74ee9a3e4b6841a83fee0 => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:58.654105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2265e-854f-4abb-b7a1-243b4efdda4f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.669273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2265e-854f-4abb-b7a1-243b4efdda4f tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:58.689270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db2e21-459c-419b-b3db-baf960076f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.690161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db2e21-459c-419b-b3db-baf960076f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.690301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db2e21-459c-419b-b3db-baf960076f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.690575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db2e21-459c-419b-b3db-baf960076f0d admin admin] PATH_INFO: `/v3/projects/65d0e031e7b443a1bd7c050b4c539d66/users/15f78a95370843be9a19009fff112a8c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.703086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:58.720937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db2e21-459c-419b-b3db-baf960076f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d0e031e7b443a1bd7c050b4c539d66, user_id=15f78a95370843be9a19009fff112a8c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:58.726232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db2e21-459c-419b-b3db-baf960076f0d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:58.737426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcad3c1-1ff0-4350-8f25-62c32082d468 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:58.745054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29bac7-c301-42de-8e38-c6aca074e6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.745971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29bac7-c301-42de-8e38-c6aca074e6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.746626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29bac7-c301-42de-8e38-c6aca074e6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.747073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29bac7-c301-42de-8e38-c6aca074e6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.749459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7a29bac7-c301-42de-8e38-c6aca074e6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:58.758765 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3129/6209] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:58 2022] PUT /identity/v3/projects/65d0e031e7b443a1bd7c050b4c539d66/users/15f78a95370843be9a19009fff112a8c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:58.759700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db2e21-459c-419b-b3db-baf960076f0d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.855607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29bac7-c301-42de-8e38-c6aca074e6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:58.858926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29bac7-c301-42de-8e38-c6aca074e6a4 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:58.890243 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3081/6210] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:58.890850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db2e21-459c-419b-b3db-baf960076f0d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:58.891268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29bac7-c301-42de-8e38-c6aca074e6a4 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.892790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7a29bac7-c301-42de-8e38-c6aca074e6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:58.897018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b314755-43b9-4ad7-a106-7c3c14ce1f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:58.898284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314755-43b9-4ad7-a106-7c3c14ce1f4c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:58.898838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314755-43b9-4ad7-a106-7c3c14ce1f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:58.899266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314755-43b9-4ad7-a106-7c3c14ce1f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:58.900063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b314755-43b9-4ad7-a106-7c3c14ce1f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:58.902948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b314755-43b9-4ad7-a106-7c3c14ce1f4c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:58.921449 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3130/6211] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:58.923052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b314755-43b9-4ad7-a106-7c3c14ce1f4c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:58.968823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:59.005630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29bac7-c301-42de-8e38-c6aca074e6a4 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:59.019263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b314755-43b9-4ad7-a106-7c3c14ce1f4c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:59.025354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b8f7-07d6-4dae-a03c-9157d7157476 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02abbf08db7a433faa7929f7340bb578', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a9478c5c75a448392bc880b339ff144', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:59.026047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b8f7-07d6-4dae-a03c-9157d7157476 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.026325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b8f7-07d6-4dae-a03c-9157d7157476 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.026598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b8f7-07d6-4dae-a03c-9157d7157476 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] PATH_INFO: `/v3/domains/3f55ebb47ccc4eae9e1e5d009cf648fb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.035113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8b8f7-07d6-4dae-a03c-9157d7157476 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-23d8b8f7-07d6-4dae-a03c-9157d7157476 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Could not find domain: 3f55ebb47ccc4eae9e1e5d009cf648fb.: keystone.exception.DomainNotFound: Could not find domain: 3f55ebb47ccc4eae9e1e5d009cf648fb. Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3f55ebb47ccc4eae9e1e5d009cf648fb. Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:44:59.041697 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:44:59.042729 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application with Lock( Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3f55ebb47ccc4eae9e1e5d009cf648fb. Aug 30 04:44:59.043556 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:44:59.046718 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3131/6212] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:44:58 2022] PATCH /identity/v3/domains/3f55ebb47ccc4eae9e1e5d009cf648fb => generated 112 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:44:59.048822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b8f7-07d6-4dae-a03c-9157d7157476 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:59.065331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b8f7-07d6-4dae-a03c-9157d7157476 tempest-TokensV3TestJSON-469007802 tempest-TokensV3TestJSON-469007802-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:59.075954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a05f-5008-4362-a6ff-c9ce7bda9f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:59.079196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a05f-5008-4362-a6ff-c9ce7bda9f1f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.079625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a05f-5008-4362-a6ff-c9ce7bda9f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.080034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a05f-5008-4362-a6ff-c9ce7bda9f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.081781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34a05f-5008-4362-a6ff-c9ce7bda9f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:59.092141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34a05f-5008-4362-a6ff-c9ce7bda9f1f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:59.116373 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3132/6213] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:44:59.120262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a05f-5008-4362-a6ff-c9ce7bda9f1f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:59.122506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309255-371b-48d5-9d24-acb28dd26810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:59.123189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309255-371b-48d5-9d24-acb28dd26810 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.123467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309255-371b-48d5-9d24-acb28dd26810 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.123745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af309255-371b-48d5-9d24-acb28dd26810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.144025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a05f-5008-4362-a6ff-c9ce7bda9f1f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:59.157137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568582e-14c3-4ac8-b0bf-461335f6eb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:59.157837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568582e-14c3-4ac8-b0bf-461335f6eb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.158138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568582e-14c3-4ac8-b0bf-461335f6eb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.158409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568582e-14c3-4ac8-b0bf-461335f6eb2a admin admin] PATH_INFO: `/v3/projects/22adcfba39a8421c819300701f74f756/users/a650049c10c141179fce37056391efb1/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.207101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568582e-14c3-4ac8-b0bf-461335f6eb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=22adcfba39a8421c819300701f74f756, user_id=a650049c10c141179fce37056391efb1, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:59.217421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568582e-14c3-4ac8-b0bf-461335f6eb2a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:59.249938 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3133/6214] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:59 2022] PUT /identity/v3/projects/22adcfba39a8421c819300701f74f756/users/a650049c10c141179fce37056391efb1/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:59.249938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568582e-14c3-4ac8-b0bf-461335f6eb2a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:59.262747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f568582e-14c3-4ac8-b0bf-461335f6eb2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:59.268916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:59.303460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af309255-371b-48d5-9d24-acb28dd26810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:59.305274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af309255-371b-48d5-9d24-acb28dd26810 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:59.329362 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3082/6215] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:59.330736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309255-371b-48d5-9d24-acb28dd26810 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:59.354596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af309255-371b-48d5-9d24-acb28dd26810 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:59.362405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568582e-14c3-4ac8-b0bf-461335f6eb2a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:59.367757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094c068-f464-46c4-ba7b-930287745087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:59.368922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094c068-f464-46c4-ba7b-930287745087 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.369320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094c068-f464-46c4-ba7b-930287745087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.369687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094c068-f464-46c4-ba7b-930287745087 admin admin] PATH_INFO: `/v3/projects/65d0e031e7b443a1bd7c050b4c539d66/users/15f78a95370843be9a19009fff112a8c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.369835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:59.371422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.371772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.372221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] PATH_INFO: `/v3/users/3badaedfb11147668d510d848a8ceac1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.373372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094c068-f464-46c4-ba7b-930287745087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d0e031e7b443a1bd7c050b4c539d66, user_id=15f78a95370843be9a19009fff112a8c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:59.373511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3badaedfb11147668d510d848a8ceac1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:59.375696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:59.379567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b094c068-f464-46c4-ba7b-930287745087 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:59.426123 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3083/6216] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:44:59 2022] PUT /identity/v3/projects/65d0e031e7b443a1bd7c050b4c539d66/users/15f78a95370843be9a19009fff112a8c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:59.428675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b4cf3-4a3f-4a1b-8c61-f2b36adbd155 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.429095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b4cf3-4a3f-4a1b-8c61-f2b36adbd155 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.429456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b4cf3-4a3f-4a1b-8c61-f2b36adbd155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.465124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7d6b4cf3-4a3f-4a1b-8c61-f2b36adbd155 None None] MFA Rules not processed for user `a650049c10c141179fce37056391efb1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:59.466969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7d6b4cf3-4a3f-4a1b-8c61-f2b36adbd155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:59.482723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3badaedfb11147668d510d848a8ceac1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:59.485411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3badaedfb11147668d510d848a8ceac1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:59.512302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3badaedfb11147668d510d848a8ceac1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:59.529338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3badaedfb11147668d510d848a8ceac1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:59.562106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-71528c15-0bcc-450e-9d52-16ece00de73b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3badaedfb11147668d510d848a8ceac1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:44:59.575632 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3134/6217] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:44:59 2022] DELETE /identity/v3/users/3badaedfb11147668d510d848a8ceac1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:44:59.589075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c04c-5d76-4b20-93c2-3767b096ab36 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.590313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c04c-5d76-4b20-93c2-3767b096ab36 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.590831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951c04c-5d76-4b20-93c2-3767b096ab36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.627701 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3084/6218] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:59.629010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b4cf3-4a3f-4a1b-8c61-f2b36adbd155 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:59.642282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7d6b4cf3-4a3f-4a1b-8c61-f2b36adbd155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:59.664543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:59.686157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d951c04c-5d76-4b20-93c2-3767b096ab36 None None] MFA Rules not processed for user `15f78a95370843be9a19009fff112a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:59.690071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d951c04c-5d76-4b20-93c2-3767b096ab36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:59.737685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b4cf3-4a3f-4a1b-8c61-f2b36adbd155 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:59.789810 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3135/6219] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:59.791476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515f489-d944-45c6-8935-676cf36e7500 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.791762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515f489-d944-45c6-8935-676cf36e7500 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.792029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515f489-d944-45c6-8935-676cf36e7500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.808528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891c5b6-83fc-49d8-a4db-248865f0fda7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:59.809169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c5b6-83fc-49d8-a4db-248865f0fda7 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.809492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c5b6-83fc-49d8-a4db-248865f0fda7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.809766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c5b6-83fc-49d8-a4db-248865f0fda7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.811717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7891c5b6-83fc-49d8-a4db-248865f0fda7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:59.816244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9515f489-d944-45c6-8935-676cf36e7500 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:44:59.817806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9515f489-d944-45c6-8935-676cf36e7500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:59.853678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:59.905057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891c5b6-83fc-49d8-a4db-248865f0fda7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:59.907818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891c5b6-83fc-49d8-a4db-248865f0fda7 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:59.912492 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3136/6220] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:44:59.912492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515f489-d944-45c6-8935-676cf36e7500 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:59.912492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9515f489-d944-45c6-8935-676cf36e7500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:44:59.924294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515f489-d944-45c6-8935-676cf36e7500 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:59.930542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf64837-c302-4494-9874-d684e13b1ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:59.931184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf64837-c302-4494-9874-d684e13b1ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.931459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf64837-c302-4494-9874-d684e13b1ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.931720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf64837-c302-4494-9874-d684e13b1ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.932373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf64837-c302-4494-9874-d684e13b1ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:59.934666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf64837-c302-4494-9874-d684e13b1ba7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:59.938506 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3085/6221] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:44:59.939578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891c5b6-83fc-49d8-a4db-248865f0fda7 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:59.954449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891c5b6-83fc-49d8-a4db-248865f0fda7 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:44:59.961275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea91145-27e6-4a86-88d8-34494c6aebd4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:44:59.961952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea91145-27e6-4a86-88d8-34494c6aebd4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:44:59.962290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea91145-27e6-4a86-88d8-34494c6aebd4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:44:59.962567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea91145-27e6-4a86-88d8-34494c6aebd4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:44:59.963454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea91145-27e6-4a86-88d8-34494c6aebd4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:44:59.965574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea91145-27e6-4a86-88d8-34494c6aebd4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:44:59.972741 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3137/6222] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:44:59 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:44:59.974088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf64837-c302-4494-9874-d684e13b1ba7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:44:59.976986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cbf64837-c302-4494-9874-d684e13b1ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:00.004542 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3086/6223] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:44:59 2022] POST /identity/v3/roles => generated 235 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:00.006112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea91145-27e6-4a86-88d8-34494c6aebd4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:00.027584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea91145-27e6-4a86-88d8-34494c6aebd4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.086437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf64837-c302-4494-9874-d684e13b1ba7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.093859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b2cd-6d25-4b62-8350-be87ce7b6bb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:00.094805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b2cd-6d25-4b62-8350-be87ce7b6bb0 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:00.095230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b2cd-6d25-4b62-8350-be87ce7b6bb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:00.095818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b2cd-6d25-4b62-8350-be87ce7b6bb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:00.123079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a133f7b-8889-417b-b0f1-b0dd3d4b673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:00.126424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a133f7b-8889-417b-b0f1-b0dd3d4b673e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:00.126928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a133f7b-8889-417b-b0f1-b0dd3d4b673e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:00.127856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a133f7b-8889-417b-b0f1-b0dd3d4b673e admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:00.128764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a133f7b-8889-417b-b0f1-b0dd3d4b673e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:00.131289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a133f7b-8889-417b-b0f1-b0dd3d4b673e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:00.168609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:00.188362 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3087/6224] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:00 2022] POST /identity/v3/users => generated 309 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:00.189738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a133f7b-8889-417b-b0f1-b0dd3d4b673e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:00.240990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80b2cd-6d25-4b62-8350-be87ce7b6bb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:00.243884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80b2cd-6d25-4b62-8350-be87ce7b6bb0 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:00.270947 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3138/6225] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:00.271758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b2cd-6d25-4b62-8350-be87ce7b6bb0 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:00.291412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b2cd-6d25-4b62-8350-be87ce7b6bb0 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.303902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16eb699-a2c9-4094-becb-1352c5391030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:00.304723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb699-a2c9-4094-becb-1352c5391030 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:00.305004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb699-a2c9-4094-becb-1352c5391030 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:00.307080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eb699-a2c9-4094-becb-1352c5391030 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:00.307271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16eb699-a2c9-4094-becb-1352c5391030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:00.307885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a133f7b-8889-417b-b0f1-b0dd3d4b673e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.311872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16eb699-a2c9-4094-becb-1352c5391030 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:00.314466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454c1f2-3db5-4c6e-8c3e-2e03c2098f69 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:00.315095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454c1f2-3db5-4c6e-8c3e-2e03c2098f69 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:00.315375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454c1f2-3db5-4c6e-8c3e-2e03c2098f69 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:00.315645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454c1f2-3db5-4c6e-8c3e-2e03c2098f69 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:00.316347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454c1f2-3db5-4c6e-8c3e-2e03c2098f69 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:00.318381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454c1f2-3db5-4c6e-8c3e-2e03c2098f69 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:00.339111 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3139/6226] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:00 2022] GET /identity/v3/roles => generated 1646 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:00.343496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16eb699-a2c9-4094-becb-1352c5391030 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:00.346631 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3088/6227] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:45:00 2022] POST /identity/v3/roles => generated 233 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:00.347590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454c1f2-3db5-4c6e-8c3e-2e03c2098f69 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:00.359119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454c1f2-3db5-4c6e-8c3e-2e03c2098f69 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.365153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758f55f-4797-4494-bd57-99a266bb6954 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:00.366011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758f55f-4797-4494-bd57-99a266bb6954 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:00.366404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758f55f-4797-4494-bd57-99a266bb6954 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:00.366981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758f55f-4797-4494-bd57-99a266bb6954 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:00.367706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758f55f-4797-4494-bd57-99a266bb6954 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:00.370231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758f55f-4797-4494-bd57-99a266bb6954 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:00.379505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16eb699-a2c9-4094-becb-1352c5391030 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.399402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163ea07-0eb6-453e-97d2-254dbefe6e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:00.399925 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3089/6228] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:45:00 2022] POST /identity/v3/roles => generated 234 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:00.401598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758f55f-4797-4494-bd57-99a266bb6954 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:00.402043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163ea07-0eb6-453e-97d2-254dbefe6e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:00.402461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163ea07-0eb6-453e-97d2-254dbefe6e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:00.402954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163ea07-0eb6-453e-97d2-254dbefe6e90 admin admin] PATH_INFO: `/v3/projects/3b6e74beb65747c8b6c9d9ab8e285c39/users/ebc15edf1fc644439f0a4ae18f996d7c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:00.425915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758f55f-4797-4494-bd57-99a266bb6954 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.437191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163ea07-0eb6-453e-97d2-254dbefe6e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6e74beb65747c8b6c9d9ab8e285c39, user_id=ebc15edf1fc644439f0a4ae18f996d7c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:00.441728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7b1c6-84ad-4df5-9465-c28ac6f2c1ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:00.442889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163ea07-0eb6-453e-97d2-254dbefe6e90 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:00.445693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7b1c6-84ad-4df5-9465-c28ac6f2c1ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:00.446700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7b1c6-84ad-4df5-9465-c28ac6f2c1ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:00.447670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7b1c6-84ad-4df5-9465-c28ac6f2c1ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:00.449431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7b1c6-84ad-4df5-9465-c28ac6f2c1ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:00.456049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7b1c6-84ad-4df5-9465-c28ac6f2c1ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:00.472808 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3140/6229] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:00 2022] PUT /identity/v3/projects/3b6e74beb65747c8b6c9d9ab8e285c39/users/ebc15edf1fc644439f0a4ae18f996d7c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:00.477109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163ea07-0eb6-453e-97d2-254dbefe6e90 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:00.498466 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3090/6230] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:45:00 2022] POST /identity/v3/domains => generated 275 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:00.507164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7b1c6-84ad-4df5-9465-c28ac6f2c1ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:00.561587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:00.640493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163ea07-0eb6-453e-97d2-254dbefe6e90 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.665959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7b1c6-84ad-4df5-9465-c28ac6f2c1ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.684700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312936b-9cb1-4b75-8ddf-26d86f4e5140 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:00.687300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312936b-9cb1-4b75-8ddf-26d86f4e5140 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:00.687606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312936b-9cb1-4b75-8ddf-26d86f4e5140 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:00.687889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312936b-9cb1-4b75-8ddf-26d86f4e5140 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:00.688768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312936b-9cb1-4b75-8ddf-26d86f4e5140 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:00.693282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312936b-9cb1-4b75-8ddf-26d86f4e5140 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:00.753436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19965826-8fe3-4490-94fa-8b25e4b3291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:00.755427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19965826-8fe3-4490-94fa-8b25e4b3291c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:00.755870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19965826-8fe3-4490-94fa-8b25e4b3291c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:00.756628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19965826-8fe3-4490-94fa-8b25e4b3291c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:00.758400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19965826-8fe3-4490-94fa-8b25e4b3291c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:00.761674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19965826-8fe3-4490-94fa-8b25e4b3291c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:00.790956 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3091/6231] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:00 2022] POST /identity/v3/projects => generated 401 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:00.792208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312936b-9cb1-4b75-8ddf-26d86f4e5140 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:00.820782 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3141/6232] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:00 2022] GET /identity/v3/roles => generated 2095 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:00.822662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19965826-8fe3-4490-94fa-8b25e4b3291c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:00.849626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19965826-8fe3-4490-94fa-8b25e4b3291c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.946063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:00.951183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312936b-9cb1-4b75-8ddf-26d86f4e5140 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:00.964698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50d278-5f0d-4535-b927-a0688bec95b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:00.965421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d278-5f0d-4535-b927-a0688bec95b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:00.965707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d278-5f0d-4535-b927-a0688bec95b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:00.966009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50d278-5f0d-4535-b927-a0688bec95b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/groups` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:00.967710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50d278-5f0d-4535-b927-a0688bec95b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:00.972338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50d278-5f0d-4535-b927-a0688bec95b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:01.027075 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3092/6233] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:45:00 2022] POST /identity/v3/groups => generated 301 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:01.027075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50d278-5f0d-4535-b927-a0688bec95b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:01.029278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304668b-d210-4bb1-a500-1688af868e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:01.032183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304668b-d210-4bb1-a500-1688af868e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:01.032479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304668b-d210-4bb1-a500-1688af868e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:01.032755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304668b-d210-4bb1-a500-1688af868e31 admin admin] PATH_INFO: `/v3/projects/3b6e74beb65747c8b6c9d9ab8e285c39/users/ebc15edf1fc644439f0a4ae18f996d7c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:01.034333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6c50d278-5f0d-4535-b927-a0688bec95b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:01.039754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304668b-d210-4bb1-a500-1688af868e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6e74beb65747c8b6c9d9ab8e285c39, user_id=ebc15edf1fc644439f0a4ae18f996d7c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:01.046073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304668b-d210-4bb1-a500-1688af868e31 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:01.079938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50d278-5f0d-4535-b927-a0688bec95b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:01.087056 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3142/6234] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:00 2022] PUT /identity/v3/projects/3b6e74beb65747c8b6c9d9ab8e285c39/users/ebc15edf1fc644439f0a4ae18f996d7c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:01.087996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304668b-d210-4bb1-a500-1688af868e31 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:01.222014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:01.222675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:01.222959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:01.223507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] PATH_INFO: `/v3/projects/a0ec6d643ba24012ae788cf7c81891f3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:01.225080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ec6d643ba24012ae788cf7c81891f3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:01.227665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:01.273728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304668b-d210-4bb1-a500-1688af868e31 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:01.291624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a5b62-e761-4eb1-bd7c-725368c4fbf8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:01.292361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5b62-e761-4eb1-bd7c-725368c4fbf8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:01.292531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5b62-e761-4eb1-bd7c-725368c4fbf8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:01.292807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5b62-e761-4eb1-bd7c-725368c4fbf8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:01.293492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a5b62-e761-4eb1-bd7c-725368c4fbf8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:01.295166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a5b62-e761-4eb1-bd7c-725368c4fbf8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:01.308416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:01.325652 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3143/6235] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:45:01 2022] POST /identity/v3/roles => generated 235 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:01.325652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a4668-2010-40cd-91af-f7cbabd0eefe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:01.325652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a4668-2010-40cd-91af-f7cbabd0eefe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:01.325652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a4668-2010-40cd-91af-f7cbabd0eefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:01.361852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ec6d643ba24012ae788cf7c81891f3', 'request_id': 'req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:01.384534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ec6d643ba24012ae788cf7c81891f3', 'request_id': 'req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:01.390734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-119a4668-2010-40cd-91af-f7cbabd0eefe None None] MFA Rules not processed for user `ebc15edf1fc644439f0a4ae18f996d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:01.392004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-119a4668-2010-40cd-91af-f7cbabd0eefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:01.402767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ec6d643ba24012ae788cf7c81891f3', 'request_id': 'req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:01.429847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] The token cache is being invalidate because project a0ec6d643ba24012ae788cf7c81891f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:01.432252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:01.435365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:01.441051 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3093/6236] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:01 2022] DELETE /identity/v3/projects/a0ec6d643ba24012ae788cf7c81891f3 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:01.455186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:01.455186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:01.554437 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3144/6237] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:01 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:01.555335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a4668-2010-40cd-91af-f7cbabd0eefe None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:01.567308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-119a4668-2010-40cd-91af-f7cbabd0eefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:01.596383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269c37-f2f2-4e32-93f5-8449fd2a55ca admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:01.610587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632860bb-c549-4185-bd50-d1d0b8c74246 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:01.611287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632860bb-c549-4185-bd50-d1d0b8c74246 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:01.611572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632860bb-c549-4185-bd50-d1d0b8c74246 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:01.611852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632860bb-c549-4185-bd50-d1d0b8c74246 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:01.615452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632860bb-c549-4185-bd50-d1d0b8c74246 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:01.622005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632860bb-c549-4185-bd50-d1d0b8c74246 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:01.666521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:01.677078 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3094/6238] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:01 2022] POST /identity/v3/users => generated 439 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:01.678532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632860bb-c549-4185-bd50-d1d0b8c74246 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:01.684798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-632860bb-c549-4185-bd50-d1d0b8c74246 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:01.695253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a4668-2010-40cd-91af-f7cbabd0eefe None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:01.709155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:01.709835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:01.710144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:01.710414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] PATH_INFO: `/v3/users/02abbf08db7a433faa7929f7340bb578` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:01.711622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02abbf08db7a433faa7929f7340bb578)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:01.713572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:01.815545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02abbf08db7a433faa7929f7340bb578'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:01.816631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02abbf08db7a433faa7929f7340bb578'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:01.840688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02abbf08db7a433faa7929f7340bb578'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:01.852353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632860bb-c549-4185-bd50-d1d0b8c74246 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:01.864154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02abbf08db7a433faa7929f7340bb578'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:01.868300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecf551-49af-408d-b2ea-a674b7ddc007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:01.869059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecf551-49af-408d-b2ea-a674b7ddc007 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:01.869333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecf551-49af-408d-b2ea-a674b7ddc007 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:01.869600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecf551-49af-408d-b2ea-a674b7ddc007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:01.874158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-72ecf551-49af-408d-b2ea-a674b7ddc007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:01.898340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02abbf08db7a433faa7929f7340bb578'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:01.916427 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3145/6239] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:01 2022] DELETE /identity/v3/users/02abbf08db7a433faa7929f7340bb578 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:01.916427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:01.921731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:02.053469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecf551-49af-408d-b2ea-a674b7ddc007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:02.055727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecf551-49af-408d-b2ea-a674b7ddc007 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:02.055881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72971bf-9ba6-4e44-a39f-a527330973c6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:02.061224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acb53b-ffa3-4ede-bf13-77a5caaf8293 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:02.061946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb53b-ffa3-4ede-bf13-77a5caaf8293 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:02.062238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb53b-ffa3-4ede-bf13-77a5caaf8293 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:02.062512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acb53b-ffa3-4ede-bf13-77a5caaf8293 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:02.063305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acb53b-ffa3-4ede-bf13-77a5caaf8293 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:02.064751 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-60acb53b-ffa3-4ede-bf13-77a5caaf8293 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:02.064751 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:45:02.064751 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:45:02.065765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acb53b-ffa3-4ede-bf13-77a5caaf8293 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:02.071042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:02.084756 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3095/6240] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:01 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:02.098220 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3146/6241] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:45:01 2022] POST /identity/v3/roles => generated 270 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:02.098770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecf551-49af-408d-b2ea-a674b7ddc007 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:02.117117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecf551-49af-408d-b2ea-a674b7ddc007 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:02.130245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee300c73-9d35-4ea7-ab3d-609178a5bf50 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:02.131018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee300c73-9d35-4ea7-ab3d-609178a5bf50 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:02.131286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee300c73-9d35-4ea7-ab3d-609178a5bf50 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:02.131562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee300c73-9d35-4ea7-ab3d-609178a5bf50 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/976e95a6680044f1af0a686dfe6bbc18` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:02.157672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee300c73-9d35-4ea7-ab3d-609178a5bf50 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user_id=c9d046925d4648d49b748031297f7cac, role_id=976e95a6680044f1af0a686dfe6bbc18)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:02.161895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee300c73-9d35-4ea7-ab3d-609178a5bf50 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:02.188604 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3096/6242] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:02 2022] PUT /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/976e95a6680044f1af0a686dfe6bbc18 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:02.193301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acb53b-ffa3-4ede-bf13-77a5caaf8293 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:02.207241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acb53b-ffa3-4ede-bf13-77a5caaf8293 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:02.361688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:02.362619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:02.362907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:02.363185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:02.363994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Adding query filter params (scope.project.id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user.id=c9d046925d4648d49b748031297f7cac) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:02.364305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:02.365343 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:02.365343 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:45:02.365343 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:45:02.367216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:02.369116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:02.454273 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3147/6243] 10.222.0.43 () {58 vars in 1356 bytes} [Tue Aug 30 04:45:02 2022] GET /identity/v3/role_assignments?scope.project.id=4b7eaf8ff1f8426a81f6bdfd35bd5461&user.id=c9d046925d4648d49b748031297f7cac&effective => generated 228 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:02.456343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee300c73-9d35-4ea7-ab3d-609178a5bf50 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:02.497029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee300c73-9d35-4ea7-ab3d-609178a5bf50 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:02.542008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:02.544084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:02.544770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:02.545462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/976e95a6680044f1af0a686dfe6bbc18` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:02.550433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user_id=c9d046925d4648d49b748031297f7cac, role_id=976e95a6680044f1af0a686dfe6bbc18)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:02.555539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:02.569078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 976e95a6680044f1af0a686dfe6bbc18 was removed from user c9d046925d4648d49b748031297f7cac on project 4b7eaf8ff1f8426a81f6bdfd35bd5461. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:02.570972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:02.572176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:02.606836 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3097/6244] 10.222.0.43 () {58 vars in 1467 bytes} [Tue Aug 30 04:45:02 2022] DELETE /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/976e95a6680044f1af0a686dfe6bbc18 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:02.611400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:02.613344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:02.654669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110822c-ba6f-43fb-8fe0-970a580df7ba tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:02.836449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:02.837283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:02.837669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:02.838065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/976e95a6680044f1af0a686dfe6bbc18` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:02.839332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=976e95a6680044f1af0a686dfe6bbc18)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:02.840460 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:02.840460 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:45:02.840460 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:45:02.844068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:02.928279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 976e95a6680044f1af0a686dfe6bbc18 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:02.928827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:02.932936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:02.935361 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3148/6245] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:02 2022] DELETE /identity/v3/roles/976e95a6680044f1af0a686dfe6bbc18 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:02.940431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:02.951940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82dfc88-05c4-4608-9408-53b27ab4a48f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:03.026337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:03.028048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:03.146848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7f4e2-9721-4d86-a140-aa338976f492 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:03.147535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7f4e2-9721-4d86-a140-aa338976f492 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:03.147819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7f4e2-9721-4d86-a140-aa338976f492 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:03.148097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7f4e2-9721-4d86-a140-aa338976f492 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/55c107a2f22a420880113d27f319e0e8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:03.155428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7f4e2-9721-4d86-a140-aa338976f492 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user_id=c9d046925d4648d49b748031297f7cac, role_id=55c107a2f22a420880113d27f319e0e8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:03.158158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7f4e2-9721-4d86-a140-aa338976f492 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:03.192329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335eb631-022a-4dff-b6db-344e2134b784 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:03.195968 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3098/6246] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:02 2022] PUT /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/55c107a2f22a420880113d27f319e0e8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:03.196898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7f4e2-9721-4d86-a140-aa338976f492 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:03.200017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9ee7f4e2-9721-4d86-a140-aa338976f492 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:03.304839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:03.329269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7f4e2-9721-4d86-a140-aa338976f492 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:03.335453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de3aa9-dd3f-4c54-99d3-3e085950fbbb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:03.336125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de3aa9-dd3f-4c54-99d3-3e085950fbbb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:03.336426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de3aa9-dd3f-4c54-99d3-3e085950fbbb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:03.336760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de3aa9-dd3f-4c54-99d3-3e085950fbbb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:03.339282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de3aa9-dd3f-4c54-99d3-3e085950fbbb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:03.340343 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-41de3aa9-dd3f-4c54-99d3-3e085950fbbb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:03.340343 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:03.340343 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:03.341404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de3aa9-dd3f-4c54-99d3-3e085950fbbb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:03.379586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:03.381921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:03.382981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:03.383945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] PATH_INFO: `/v3/projects/5a9478c5c75a448392bc880b339ff144` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:03.387524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9478c5c75a448392bc880b339ff144)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:03.388242 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3099/6247] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:03 2022] PUT /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 519 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:03.389205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de3aa9-dd3f-4c54-99d3-3e085950fbbb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:03.393628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-41de3aa9-dd3f-4c54-99d3-3e085950fbbb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:03.395543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:03.485803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:03.501355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9478c5c75a448392bc880b339ff144', 'request_id': 'req-5983090b-5477-4ff4-b1d0-c538fe57b0cc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:03.532045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9478c5c75a448392bc880b339ff144', 'request_id': 'req-5983090b-5477-4ff4-b1d0-c538fe57b0cc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:03.550897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9478c5c75a448392bc880b339ff144', 'request_id': 'req-5983090b-5477-4ff4-b1d0-c538fe57b0cc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:03.560998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de3aa9-dd3f-4c54-99d3-3e085950fbbb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:03.571396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] The token cache is being invalidate because project 5a9478c5c75a448392bc880b339ff144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:03.571811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:03.572923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:03.577354 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3149/6248] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:03 2022] DELETE /identity/v3/projects/5a9478c5c75a448392bc880b339ff144 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:03.578171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:03.582194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:03.666668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbdc4b-fcb7-4aa9-a01b-d1f4ff829f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:03.667418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbdc4b-fcb7-4aa9-a01b-d1f4ff829f49 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:03.667698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbdc4b-fcb7-4aa9-a01b-d1f4ff829f49 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:03.667967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbdc4b-fcb7-4aa9-a01b-d1f4ff829f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:03.672402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3fdbdc4b-fcb7-4aa9-a01b-d1f4ff829f49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:03.727366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983090b-5477-4ff4-b1d0-c538fe57b0cc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:03.735751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64027642-866c-4139-b1f0-2f51bf488355 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:03.736597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027642-866c-4139-b1f0-2f51bf488355 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:03.737024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027642-866c-4139-b1f0-2f51bf488355 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:03.737438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027642-866c-4139-b1f0-2f51bf488355 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:03.738361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64027642-866c-4139-b1f0-2f51bf488355 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Adding query filter params (scope.project.id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user.id=c9d046925d4648d49b748031297f7cac) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:03.738859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64027642-866c-4139-b1f0-2f51bf488355 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:03.742876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64027642-866c-4139-b1f0-2f51bf488355 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:03.853951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbdc4b-fcb7-4aa9-a01b-d1f4ff829f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:03.855979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbdc4b-fcb7-4aa9-a01b-d1f4ff829f49 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:03.856890 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3150/6249] 10.222.0.43 () {58 vars in 1356 bytes} [Tue Aug 30 04:45:03 2022] GET /identity/v3/role_assignments?scope.project.id=4b7eaf8ff1f8426a81f6bdfd35bd5461&user.id=c9d046925d4648d49b748031297f7cac&effective => generated 1061 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:03.859927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64027642-866c-4139-b1f0-2f51bf488355 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:03.870245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-64027642-866c-4139-b1f0-2f51bf488355 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:03.882896 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3100/6250] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:03 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:03.896716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbdc4b-fcb7-4aa9-a01b-d1f4ff829f49 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:03.916263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:03.946246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbdc4b-fcb7-4aa9-a01b-d1f4ff829f49 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:03.965760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddef018-3394-438a-8a62-9e4133476181 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:03.966622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddef018-3394-438a-8a62-9e4133476181 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:03.970129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddef018-3394-438a-8a62-9e4133476181 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:03.971696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddef018-3394-438a-8a62-9e4133476181 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:03.975044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddef018-3394-438a-8a62-9e4133476181 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:03.976279 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-9ddef018-3394-438a-8a62-9e4133476181 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:03.976279 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:03.976279 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:03.977656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddef018-3394-438a-8a62-9e4133476181 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:03.992870 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3101/6251] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:03 2022] DELETE /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:03.997452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddef018-3394-438a-8a62-9e4133476181 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:04.048948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64027642-866c-4139-b1f0-2f51bf488355 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:04.064120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:04.083260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddef018-3394-438a-8a62-9e4133476181 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:04.088659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2e318-e6bb-4c3d-aaf7-8fe748fe0792 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:04.089469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2e318-e6bb-4c3d-aaf7-8fe748fe0792 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:04.089843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2e318-e6bb-4c3d-aaf7-8fe748fe0792 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:04.090342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2e318-e6bb-4c3d-aaf7-8fe748fe0792 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:04.091404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2e318-e6bb-4c3d-aaf7-8fe748fe0792 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Adding query filter params (scope.project.id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user.id=c9d046925d4648d49b748031297f7cac) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:04.092008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2e318-e6bb-4c3d-aaf7-8fe748fe0792 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:04.094370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2e318-e6bb-4c3d-aaf7-8fe748fe0792 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:04.188425 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3102/6252] 10.222.0.43 () {58 vars in 1356 bytes} [Tue Aug 30 04:45:03 2022] GET /identity/v3/role_assignments?scope.project.id=4b7eaf8ff1f8426a81f6bdfd35bd5461&user.id=c9d046925d4648d49b748031297f7cac&effective => generated 577 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:04.195067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2e318-e6bb-4c3d-aaf7-8fe748fe0792 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:04.229026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2e318-e6bb-4c3d-aaf7-8fe748fe0792 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:04.246917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02821b-d0f9-4e7b-8a42-6021e822d3dc tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:04.248128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02821b-d0f9-4e7b-8a42-6021e822d3dc tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:04.248774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02821b-d0f9-4e7b-8a42-6021e822d3dc tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:04.249541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02821b-d0f9-4e7b-8a42-6021e822d3dc tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:04.254689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:04.255367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:04.255647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:04.255917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] PATH_INFO: `/v3/users/ae10deaf7b58448b9393e0233d45f5fa` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:04.256977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02821b-d0f9-4e7b-8a42-6021e822d3dc tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:04.260906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02821b-d0f9-4e7b-8a42-6021e822d3dc tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:04.264087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae10deaf7b58448b9393e0233d45f5fa)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:04.267572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-4c02821b-d0f9-4e7b-8a42-6021e822d3dc tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] 55c107a2f22a420880113d27f319e0e8 does not imply e80e47753dc740f3bd08d9cdba3e9f95.: keystone.exception.ImpliedRoleNotFound: 55c107a2f22a420880113d27f319e0e8 does not imply e80e47753dc740f3bd08d9cdba3e9f95. Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = query.one() Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._iter().one() Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._only_one_row( Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:04.295575 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 30 04:45:04.296631 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 30 04:45:04.297521 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 30 04:45:04.297521 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 30 04:45:04.297521 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 30 04:45:04.297521 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 55c107a2f22a420880113d27f319e0e8 does not imply e80e47753dc740f3bd08d9cdba3e9f95. Aug 30 04:45:04.297521 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:04.302188 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3103/6253] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:04 2022] DELETE /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 137 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:45:04.307011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02821b-d0f9-4e7b-8a42-6021e822d3dc tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:04.330276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02821b-d0f9-4e7b-8a42-6021e822d3dc tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:04.339489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:04.341040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:04.341575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:04.342645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/55c107a2f22a420880113d27f319e0e8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:04.346975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user_id=c9d046925d4648d49b748031297f7cac, role_id=55c107a2f22a420880113d27f319e0e8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:04.351320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:04.360439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 55c107a2f22a420880113d27f319e0e8 was removed from user c9d046925d4648d49b748031297f7cac on project 4b7eaf8ff1f8426a81f6bdfd35bd5461. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:04.360855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:04.361898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:04.373922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae10deaf7b58448b9393e0233d45f5fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:04.374843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae10deaf7b58448b9393e0233d45f5fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:04.384538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae10deaf7b58448b9393e0233d45f5fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:04.389698 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3104/6254] 10.222.0.43 () {58 vars in 1467 bytes} [Tue Aug 30 04:45:04 2022] DELETE /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/55c107a2f22a420880113d27f319e0e8 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:04.394995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:04.398711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:04.402546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae10deaf7b58448b9393e0233d45f5fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:04.427004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae10deaf7b58448b9393e0233d45f5fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:04.438208 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3151/6255] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:03 2022] DELETE /identity/v3/users/ae10deaf7b58448b9393e0233d45f5fa => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:04.555039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d346574-4f89-4084-b772-27d033be558b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:04.732137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7aebf-5ce0-47c9-9ada-837a0603edc7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:04.733408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7aebf-5ce0-47c9-9ada-837a0603edc7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:04.734351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7aebf-5ce0-47c9-9ada-837a0603edc7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:04.735293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7aebf-5ce0-47c9-9ada-837a0603edc7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:04.737970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7aebf-5ce0-47c9-9ada-837a0603edc7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:04.739919 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-90a7aebf-5ce0-47c9-9ada-837a0603edc7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:04.739919 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:04.739919 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:04.741985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a7aebf-5ce0-47c9-9ada-837a0603edc7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:04.774564 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3105/6256] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:04 2022] POST /identity/v3/roles => generated 271 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:04.776129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:04.778662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:04.801925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766af1c-0660-415d-b4cc-d2b713f55a22 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:04.812595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:04.813520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:04.813980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:04.816238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:04.817219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Adding query filter params (domain_id=2978357ad0ad4e2a95b53e37dc10e3d1) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:04.823808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:04.825096 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:04.825096 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:45:04.825096 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:45:04.827251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:04.847218 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3152/6257] 10.222.0.43 () {58 vars in 1207 bytes} [Tue Aug 30 04:45:04 2022] GET /identity/v3/roles?domain_id=2978357ad0ad4e2a95b53e37dc10e3d1 => generated 408 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:04.848708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7aebf-5ce0-47c9-9ada-837a0603edc7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:04.868834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7aebf-5ce0-47c9-9ada-837a0603edc7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:04.884129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:04.884885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:04.885168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:04.885444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/998ad55b63474d48aab8b52c20714334` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:04.893036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=998ad55b63474d48aab8b52c20714334)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:04.898256 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:04.898256 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:04.898256 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:04.912071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:04.971537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:05.020380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 998ad55b63474d48aab8b52c20714334 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:05.021968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:05.021968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:05.025921 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3106/6258] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:04 2022] DELETE /identity/v3/roles/998ad55b63474d48aab8b52c20714334 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:05.028176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:05.030141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:05.046906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36458d-258d-4188-a906-815c0dcd20e3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:05.121281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:05.196645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364b57-25be-43b0-9699-7f7c90d7c830 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:05.196974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364b57-25be-43b0-9699-7f7c90d7c830 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:05.197259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364b57-25be-43b0-9699-7f7c90d7c830 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:05.197532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364b57-25be-43b0-9699-7f7c90d7c830 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:05.198236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e364b57-25be-43b0-9699-7f7c90d7c830 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Adding query filter params (domain_id=2978357ad0ad4e2a95b53e37dc10e3d1) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:05.198925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e364b57-25be-43b0-9699-7f7c90d7c830 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:05.200147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e364b57-25be-43b0-9699-7f7c90d7c830 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:05.223688 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3153/6259] 10.222.0.43 () {58 vars in 1207 bytes} [Tue Aug 30 04:45:05 2022] GET /identity/v3/roles?domain_id=2978357ad0ad4e2a95b53e37dc10e3d1 => generated 148 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:05.227862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:05.252371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf1a76-2fe8-4d1a-92d9-0e6317c664ad tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:05.266129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4ba2e-5bcb-45c2-8d39-4817dbd9f666 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:05.268174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4ba2e-5bcb-45c2-8d39-4817dbd9f666 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:05.268174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4ba2e-5bcb-45c2-8d39-4817dbd9f666 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:05.268174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4ba2e-5bcb-45c2-8d39-4817dbd9f666 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/998ad55b63474d48aab8b52c20714334` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:05.306002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4ba2e-5bcb-45c2-8d39-4817dbd9f666 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-09c4ba2e-5bcb-45c2-8d39-4817dbd9f666 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Could not find role: 998ad55b63474d48aab8b52c20714334.: keystone.exception.RoleNotFound: Could not find role: 998ad55b63474d48aab8b52c20714334. Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 30 04:45:05.315916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:45:05.316918 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 998ad55b63474d48aab8b52c20714334. Aug 30 04:45:05.318719 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:05.322759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364b57-25be-43b0-9699-7f7c90d7c830 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:05.328662 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3107/6260] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:05 2022] DELETE /identity/v3/roles/998ad55b63474d48aab8b52c20714334 => generated 110 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 30 04:45:05.340342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364b57-25be-43b0-9699-7f7c90d7c830 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:05.350428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c1d8f-2e08-477e-9d60-5ce167445520 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:05.351138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c1d8f-2e08-477e-9d60-5ce167445520 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:05.351421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c1d8f-2e08-477e-9d60-5ce167445520 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:05.351696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c1d8f-2e08-477e-9d60-5ce167445520 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:05.380610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c1d8f-2e08-477e-9d60-5ce167445520 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2978357ad0ad4e2a95b53e37dc10e3d1, group_id=68ee0b6a430046ed8315a66b9ef43a04, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:05.386990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c1d8f-2e08-477e-9d60-5ce167445520 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:05.422253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4ba2e-5bcb-45c2-8d39-4817dbd9f666 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:05.423276 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3154/6261] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:05 2022] PUT /identity/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:05.437586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4ba2e-5bcb-45c2-8d39-4817dbd9f666 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:05.493694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c1d8f-2e08-477e-9d60-5ce167445520 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:05.495788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e93c1d8f-2e08-477e-9d60-5ce167445520 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:05.641939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020809-b125-451c-b371-734928b268e2 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:05.641939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020809-b125-451c-b371-734928b268e2 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:05.641939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020809-b125-451c-b371-734928b268e2 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:05.642386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71020809-b125-451c-b371-734928b268e2 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/groups/68ee0b6a430046ed8315a66b9ef43a04/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:05.642386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71020809-b125-451c-b371-734928b268e2 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2978357ad0ad4e2a95b53e37dc10e3d1, group_id=68ee0b6a430046ed8315a66b9ef43a04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:05.645300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71020809-b125-451c-b371-734928b268e2 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:05.679174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c1d8f-2e08-477e-9d60-5ce167445520 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:05.697340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:05.697977 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3108/6262] 10.222.0.43 () {58 vars in 1365 bytes} [Tue Aug 30 04:45:05 2022] GET /identity/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/groups/68ee0b6a430046ed8315a66b9ef43a04/roles => generated 410 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:05.701777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020809-b125-451c-b371-734928b268e2 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:05.704370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:05.704669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:05.709261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] PATH_INFO: `/v3/projects/af9fc6171bd6402b858ce0eb35eb3a0b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:05.713710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9fc6171bd6402b858ce0eb35eb3a0b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:05.719599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:05.722789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71020809-b125-451c-b371-734928b268e2 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:05.739441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0b9e7-23d0-474e-a953-299ce1ebeb14 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:05.740456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0b9e7-23d0-474e-a953-299ce1ebeb14 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:05.740949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0b9e7-23d0-474e-a953-299ce1ebeb14 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:05.742089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0b9e7-23d0-474e-a953-299ce1ebeb14 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:05.752465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0b9e7-23d0-474e-a953-299ce1ebeb14 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2978357ad0ad4e2a95b53e37dc10e3d1, group_id=68ee0b6a430046ed8315a66b9ef43a04, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:05.763313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0b9e7-23d0-474e-a953-299ce1ebeb14 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:05.795528 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3109/6263] 10.222.0.43 () {58 vars in 1465 bytes} [Tue Aug 30 04:45:05 2022] HEAD /identity/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:05.799725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0b9e7-23d0-474e-a953-299ce1ebeb14 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:05.832643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0b9e7-23d0-474e-a953-299ce1ebeb14 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:05.863666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9fc6171bd6402b858ce0eb35eb3a0b', 'request_id': 'req-531c397a-db45-4203-994d-c532b792e778'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:05.886206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9fc6171bd6402b858ce0eb35eb3a0b', 'request_id': 'req-531c397a-db45-4203-994d-c532b792e778'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:05.913325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9fc6171bd6402b858ce0eb35eb3a0b', 'request_id': 'req-531c397a-db45-4203-994d-c532b792e778'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:05.947850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] The token cache is being invalidate because project af9fc6171bd6402b858ce0eb35eb3a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:05.948256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:05.951723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-531c397a-db45-4203-994d-c532b792e778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:05.954098 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3155/6264] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:05 2022] DELETE /identity/v3/projects/af9fc6171bd6402b858ce0eb35eb3a0b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:05.959703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c6ce-f829-4142-8fed-bc55419e0f9e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:05.964754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c6ce-f829-4142-8fed-bc55419e0f9e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:05.965183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317c6ce-f829-4142-8fed-bc55419e0f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:06.039857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8317c6ce-f829-4142-8fed-bc55419e0f9e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:06.043483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8317c6ce-f829-4142-8fed-bc55419e0f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:06.046780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:06.047472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:06.047755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:06.048029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:06.056044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2978357ad0ad4e2a95b53e37dc10e3d1, group_id=68ee0b6a430046ed8315a66b9ef43a04, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:06.060705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:06.077686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 5a5c4f176bde47a3b68319ff10af1384 was removed from group 68ee0b6a430046ed8315a66b9ef43a04 on domain 2978357ad0ad4e2a95b53e37dc10e3d1. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:06.078035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:06.079918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:06.107494 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3110/6265] 10.222.0.43 () {58 vars in 1467 bytes} [Tue Aug 30 04:45:05 2022] DELETE /identity/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:06.115767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:06.120329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:06.141026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:06.216753 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3156/6266] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:06.218613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7bf38-6d2f-4083-bf78-6788dcb83fb5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:06.219240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7bf38-6d2f-4083-bf78-6788dcb83fb5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:06.219620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7bf38-6d2f-4083-bf78-6788dcb83fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:06.271569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d3e7bf38-6d2f-4083-bf78-6788dcb83fb5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:06.273314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d3e7bf38-6d2f-4083-bf78-6788dcb83fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:06.293836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:06.365455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ecab5-1eab-44ed-a6eb-fd4e028b57eb tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:06.384660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb3fda-31c0-44d4-92d1-c5bd23831f34 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:06.387326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3fda-31c0-44d4-92d1-c5bd23831f34 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:06.387617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3fda-31c0-44d4-92d1-c5bd23831f34 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:06.387908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb3fda-31c0-44d4-92d1-c5bd23831f34 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:06.408124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb3fda-31c0-44d4-92d1-c5bd23831f34 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, group_id=68ee0b6a430046ed8315a66b9ef43a04, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:06.416056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb3fda-31c0-44d4-92d1-c5bd23831f34 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:06.468542 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3157/6267] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:06.472270 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3111/6268] 10.222.0.43 () {60 vars in 1486 bytes} [Tue Aug 30 04:45:06 2022] PUT /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:06.472952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7bf38-6d2f-4083-bf78-6788dcb83fb5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:06.474577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb3fda-31c0-44d4-92d1-c5bd23831f34 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:06.502537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7bf38-6d2f-4083-bf78-6788dcb83fb5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:06.619646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb3fda-31c0-44d4-92d1-c5bd23831f34 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:06.643217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c2aaf-9681-4434-a36a-77b57b5432ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:06.643902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c2aaf-9681-4434-a36a-77b57b5432ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:06.644184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c2aaf-9681-4434-a36a-77b57b5432ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:06.644492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c2aaf-9681-4434-a36a-77b57b5432ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/groups/68ee0b6a430046ed8315a66b9ef43a04/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:06.646557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c2aaf-9681-4434-a36a-77b57b5432ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_grants(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, group_id=68ee0b6a430046ed8315a66b9ef43a04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:06.649122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c2aaf-9681-4434-a36a-77b57b5432ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:06.678294 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3112/6269] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Aug 30 04:45:06 2022] GET /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/groups/68ee0b6a430046ed8315a66b9ef43a04/roles => generated 411 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:06.679269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c2aaf-9681-4434-a36a-77b57b5432ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:06.700107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c2aaf-9681-4434-a36a-77b57b5432ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:06.708591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca736097-aa74-42c1-970c-c7545ced4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:06.709589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca736097-aa74-42c1-970c-c7545ced4985 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:06.711254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca736097-aa74-42c1-970c-c7545ced4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:06.712923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca736097-aa74-42c1-970c-c7545ced4985 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:06.713845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca736097-aa74-42c1-970c-c7545ced4985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:06.715416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca736097-aa74-42c1-970c-c7545ced4985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:06.719464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca736097-aa74-42c1-970c-c7545ced4985 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:06.746244 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3158/6270] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:06.752829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca736097-aa74-42c1-970c-c7545ced4985 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:06.755572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7d278-0e49-4334-9658-3e3c6637b60e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:06.756258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7d278-0e49-4334-9658-3e3c6637b60e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:06.756540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7d278-0e49-4334-9658-3e3c6637b60e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:06.756817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7d278-0e49-4334-9658-3e3c6637b60e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/groups/68ee0b6a430046ed8315a66b9ef43a04/users/c9d046925d4648d49b748031297f7cac` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:06.765821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7d278-0e49-4334-9658-3e3c6637b60e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=68ee0b6a430046ed8315a66b9ef43a04, user_id=c9d046925d4648d49b748031297f7cac)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:06.767089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca736097-aa74-42c1-970c-c7545ced4985 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:06.767810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7d278-0e49-4334-9658-3e3c6637b60e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:06.774154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fef49-b696-41cc-ab8f-4f308241c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:06.775184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fef49-b696-41cc-ab8f-4f308241c40f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:06.775712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fef49-b696-41cc-ab8f-4f308241c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:06.776184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3fef49-b696-41cc-ab8f-4f308241c40f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:06.777024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fef49-b696-41cc-ab8f-4f308241c40f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:06.779349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3fef49-b696-41cc-ab8f-4f308241c40f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:06.859331 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3159/6271] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:06 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:06.860248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fef49-b696-41cc-ab8f-4f308241c40f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:06.867078 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3113/6272] 10.222.0.43 () {60 vars in 1360 bytes} [Tue Aug 30 04:45:06 2022] PUT /identity/v3/groups/68ee0b6a430046ed8315a66b9ef43a04/users/c9d046925d4648d49b748031297f7cac => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:06.872496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c90bb-2241-425c-8fc6-9c99e20d7bb1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:06.872780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c90bb-2241-425c-8fc6-9c99e20d7bb1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:06.872975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c90bb-2241-425c-8fc6-9c99e20d7bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:06.975191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d21c90bb-2241-425c-8fc6-9c99e20d7bb1 None None] MFA Rules not processed for user `c9d046925d4648d49b748031297f7cac`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:06.977096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d21c90bb-2241-425c-8fc6-9c99e20d7bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:07.044031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:07.066361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3fef49-b696-41cc-ab8f-4f308241c40f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:07.078114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fa24-7b4f-4ded-8b2a-ebe296db738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:07.078934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fa24-7b4f-4ded-8b2a-ebe296db738c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:07.079328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fa24-7b4f-4ded-8b2a-ebe296db738c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:07.081696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fa24-7b4f-4ded-8b2a-ebe296db738c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:07.084767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1fa24-7b4f-4ded-8b2a-ebe296db738c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:07.087940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1fa24-7b4f-4ded-8b2a-ebe296db738c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:07.135963 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3160/6273] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:06 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:07.138882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fa24-7b4f-4ded-8b2a-ebe296db738c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:07.165035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fa24-7b4f-4ded-8b2a-ebe296db738c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:07.178751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990c5d5-be9d-4ed0-9484-241273578980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:07.179302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c5d5-be9d-4ed0-9484-241273578980 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:07.179580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c5d5-be9d-4ed0-9484-241273578980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:07.179848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c5d5-be9d-4ed0-9484-241273578980 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:07.180506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990c5d5-be9d-4ed0-9484-241273578980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:07.182612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990c5d5-be9d-4ed0-9484-241273578980 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:07.197213 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3114/6274] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:06 2022] POST /identity/v3/auth/tokens => generated 3265 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:07.201069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c90bb-2241-425c-8fc6-9c99e20d7bb1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:07.210591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:07.224733 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3161/6275] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:07 2022] GET /identity/v3/roles => generated 2321 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:07.226384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990c5d5-be9d-4ed0-9484-241273578980 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:07.255070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990c5d5-be9d-4ed0-9484-241273578980 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:07.266924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39206b19-8ac4-434e-be51-678b4c39d727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:07.267565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206b19-8ac4-434e-be51-678b4c39d727 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:07.267845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206b19-8ac4-434e-be51-678b4c39d727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:07.268110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206b19-8ac4-434e-be51-678b4c39d727 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:07.268865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39206b19-8ac4-434e-be51-678b4c39d727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:07.271325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39206b19-8ac4-434e-be51-678b4c39d727 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:07.303355 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3162/6276] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:07 2022] GET /identity/v3/roles => generated 2321 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:45:07.304737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39206b19-8ac4-434e-be51-678b4c39d727 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:07.325308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39206b19-8ac4-434e-be51-678b4c39d727 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:07.345897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22129b21-6eae-4723-bbba-caf4287698d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:07.346708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129b21-6eae-4723-bbba-caf4287698d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:07.346990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129b21-6eae-4723-bbba-caf4287698d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:07.347265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22129b21-6eae-4723-bbba-caf4287698d7 admin admin] PATH_INFO: `/v3/projects/16b9d92af2f546dba3a4ab571f9acf03/users/b2a1a3f178934c9b948a5bed6fcf89a2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:07.384381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22129b21-6eae-4723-bbba-caf4287698d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b9d92af2f546dba3a4ab571f9acf03, user_id=b2a1a3f178934c9b948a5bed6fcf89a2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:07.387357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22129b21-6eae-4723-bbba-caf4287698d7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:07.388563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c90bb-2241-425c-8fc6-9c99e20d7bb1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:07.403085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310e61-a4ef-440b-b007-c4728f9d36d8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:07.403952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310e61-a4ef-440b-b007-c4728f9d36d8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:07.404292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310e61-a4ef-440b-b007-c4728f9d36d8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:07.404574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310e61-a4ef-440b-b007-c4728f9d36d8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:07.407645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50310e61-a4ef-440b-b007-c4728f9d36d8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:check_grant(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, group_id=68ee0b6a430046ed8315a66b9ef43a04, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:07.410822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50310e61-a4ef-440b-b007-c4728f9d36d8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:07.424241 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3163/6277] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:07 2022] PUT /identity/v3/projects/16b9d92af2f546dba3a4ab571f9acf03/users/b2a1a3f178934c9b948a5bed6fcf89a2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:07.426448 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3115/6278] 10.222.0.43 () {58 vars in 1468 bytes} [Tue Aug 30 04:45:07 2022] HEAD /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:07.430384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310e61-a4ef-440b-b007-c4728f9d36d8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:07.431609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10213-cbe1-44b6-80ac-aabf5f1ce304 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:07.431609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10213-cbe1-44b6-80ac-aabf5f1ce304 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:07.431609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c10213-cbe1-44b6-80ac-aabf5f1ce304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:07.448393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310e61-a4ef-440b-b007-c4728f9d36d8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:07.513483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-18c10213-cbe1-44b6-80ac-aabf5f1ce304 None None] MFA Rules not processed for user `b2a1a3f178934c9b948a5bed6fcf89a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:07.516299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-18c10213-cbe1-44b6-80ac-aabf5f1ce304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:07.610671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:07.611447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:07.611793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:07.612130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:07.626263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, group_id=68ee0b6a430046ed8315a66b9ef43a04, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:07.629085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:07.656276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 5a5c4f176bde47a3b68319ff10af1384 was removed from group 68ee0b6a430046ed8315a66b9ef43a04 on project 4b7eaf8ff1f8426a81f6bdfd35bd5461. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:07.656276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:07.657369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:07.692617 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3164/6279] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:07.692811 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3116/6280] 10.222.0.43 () {58 vars in 1470 bytes} [Tue Aug 30 04:45:07 2022] DELETE /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:07.695135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:07.695279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c10213-cbe1-44b6-80ac-aabf5f1ce304 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:07.700781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:07.834843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d84fbf-53c7-4ba8-8023-57a049e710ee tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:07.850600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc612ae0-076f-46ac-8bac-a3b7aa1c87e9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:07.851382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc612ae0-076f-46ac-8bac-a3b7aa1c87e9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:07.851728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc612ae0-076f-46ac-8bac-a3b7aa1c87e9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:07.852066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc612ae0-076f-46ac-8bac-a3b7aa1c87e9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/groups/68ee0b6a430046ed8315a66b9ef43a04/users/c9d046925d4648d49b748031297f7cac` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:07.861683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc612ae0-076f-46ac-8bac-a3b7aa1c87e9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=68ee0b6a430046ed8315a66b9ef43a04, user_id=c9d046925d4648d49b748031297f7cac)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:07.863147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c10213-cbe1-44b6-80ac-aabf5f1ce304 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:07.864063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc612ae0-076f-46ac-8bac-a3b7aa1c87e9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:07.878008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc612ae0-076f-46ac-8bac-a3b7aa1c87e9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c9d046925d4648d49b748031297f7cac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:07.900266 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3117/6281] 10.222.0.43 () {58 vars in 1344 bytes} [Tue Aug 30 04:45:07 2022] DELETE /identity/v3/groups/68ee0b6a430046ed8315a66b9ef43a04/users/c9d046925d4648d49b748031297f7cac => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:07.905221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc612ae0-076f-46ac-8bac-a3b7aa1c87e9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:07.949262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:07.960500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:08.024368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df888e-a990-41b0-81a0-aeba62f74011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:08.025524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df888e-a990-41b0-81a0-aeba62f74011 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.025828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df888e-a990-41b0-81a0-aeba62f74011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.026123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df888e-a990-41b0-81a0-aeba62f74011 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.026996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df888e-a990-41b0-81a0-aeba62f74011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:08.032490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df888e-a990-41b0-81a0-aeba62f74011 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:08.061124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc612ae0-076f-46ac-8bac-a3b7aa1c87e9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:08.079400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21164916-2108-40d2-a388-8b629d65c6d3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:08.080266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164916-2108-40d2-a388-8b629d65c6d3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.080609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164916-2108-40d2-a388-8b629d65c6d3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.080955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21164916-2108-40d2-a388-8b629d65c6d3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/system/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.084709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21164916-2108-40d2-a388-8b629d65c6d3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=68ee0b6a430046ed8315a66b9ef43a04, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:08.088219 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-21164916-2108-40d2-a388-8b629d65c6d3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:08.088219 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:08.088219 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:08.089140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21164916-2108-40d2-a388-8b629d65c6d3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:08.098958 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3165/6282] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:07 2022] POST /identity/v3/projects => generated 379 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:08.100073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df888e-a990-41b0-81a0-aeba62f74011 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:08.102209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-49df888e-a990-41b0-81a0-aeba62f74011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:08.113755 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3118/6283] 10.222.0.43 () {60 vars in 1381 bytes} [Tue Aug 30 04:45:07 2022] PUT /identity/v3/system/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:08.118117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21164916-2108-40d2-a388-8b629d65c6d3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:08.130935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21164916-2108-40d2-a388-8b629d65c6d3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:08.262566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df888e-a990-41b0-81a0-aeba62f74011 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:08.281262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db2faf-35f9-4932-a155-4dc802c07493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:08.282099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db2faf-35f9-4932-a155-4dc802c07493 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.282381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db2faf-35f9-4932-a155-4dc802c07493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.282659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db2faf-35f9-4932-a155-4dc802c07493 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.283308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db2faf-35f9-4932-a155-4dc802c07493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:08.292600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db2faf-35f9-4932-a155-4dc802c07493 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:08.329637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb0c0c-26d6-4656-b611-e390f5c94fb8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:08.330717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb0c0c-26d6-4656-b611-e390f5c94fb8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.331279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb0c0c-26d6-4656-b611-e390f5c94fb8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.332250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb0c0c-26d6-4656-b611-e390f5c94fb8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/system/groups/68ee0b6a430046ed8315a66b9ef43a04/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.350384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb0c0c-26d6-4656-b611-e390f5c94fb8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=68ee0b6a430046ed8315a66b9ef43a04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:08.356010 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3166/6284] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:08 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:45:08.356214 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-0edb0c0c-26d6-4656-b611-e390f5c94fb8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:08.356214 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:08.356214 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:08.356863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb0c0c-26d6-4656-b611-e390f5c94fb8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:08.357187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db2faf-35f9-4932-a155-4dc802c07493 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:08.378582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db2faf-35f9-4932-a155-4dc802c07493 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:08.391448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc4a3c-be3c-4889-9e09-28f19e5c3b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:08.392610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc4a3c-be3c-4889-9e09-28f19e5c3b83 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.393059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc4a3c-be3c-4889-9e09-28f19e5c3b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.393336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc4a3c-be3c-4889-9e09-28f19e5c3b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.394042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc4a3c-be3c-4889-9e09-28f19e5c3b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:08.400043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc4a3c-be3c-4889-9e09-28f19e5c3b83 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:08.426064 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3119/6285] 10.222.0.43 () {58 vars in 1263 bytes} [Tue Aug 30 04:45:08 2022] GET /identity/v3/system/groups/68ee0b6a430046ed8315a66b9ef43a04/roles => generated 376 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:08.429695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb0c0c-26d6-4656-b611-e390f5c94fb8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:08.436701 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3167/6286] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:08 2022] GET /identity/v3/roles => generated 2321 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:08.440696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc4a3c-be3c-4889-9e09-28f19e5c3b83 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:08.465645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb0c0c-26d6-4656-b611-e390f5c94fb8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:08.468736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc4a3c-be3c-4889-9e09-28f19e5c3b83 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:08.483518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce3a06-41f0-4d30-be16-6b22ecbc8cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:08.484133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce3a06-41f0-4d30-be16-6b22ecbc8cfc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.484406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce3a06-41f0-4d30-be16-6b22ecbc8cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.484675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce3a06-41f0-4d30-be16-6b22ecbc8cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.485604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce3a06-41f0-4d30-be16-6b22ecbc8cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:08.489798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce3a06-41f0-4d30-be16-6b22ecbc8cfc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:08.497198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff77b-3235-4ce6-b0ae-b2d45a876706 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:08.499172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff77b-3235-4ce6-b0ae-b2d45a876706 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.499691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff77b-3235-4ce6-b0ae-b2d45a876706 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.500483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ff77b-3235-4ce6-b0ae-b2d45a876706 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/system/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.503508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ff77b-3235-4ce6-b0ae-b2d45a876706 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=68ee0b6a430046ed8315a66b9ef43a04, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:08.505623 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-cc6ff77b-3235-4ce6-b0ae-b2d45a876706 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:08.505623 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:08.505623 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:08.508260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ff77b-3235-4ce6-b0ae-b2d45a876706 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:08.511329 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3168/6287] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:08 2022] GET /identity/v3/roles => generated 2321 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:45:08.515852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce3a06-41f0-4d30-be16-6b22ecbc8cfc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:08.528654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce3a06-41f0-4d30-be16-6b22ecbc8cfc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:08.530763 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3120/6288] 10.222.0.43 () {58 vars in 1363 bytes} [Tue Aug 30 04:45:08 2022] HEAD /identity/v3/system/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:08.534736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f009903-9075-40bb-9a3e-c41ad9399f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:08.535217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff77b-3235-4ce6-b0ae-b2d45a876706 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:08.535706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009903-9075-40bb-9a3e-c41ad9399f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.535706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009903-9075-40bb-9a3e-c41ad9399f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.535974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009903-9075-40bb-9a3e-c41ad9399f0f admin admin] PATH_INFO: `/v3/projects/18515501dcfe4713a673556f6f7aa9a0/users/f232761c61654108b85eaee620489275/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.553701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ff77b-3235-4ce6-b0ae-b2d45a876706 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:08.557460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f009903-9075-40bb-9a3e-c41ad9399f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18515501dcfe4713a673556f6f7aa9a0, user_id=f232761c61654108b85eaee620489275, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:08.561120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f009903-9075-40bb-9a3e-c41ad9399f0f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:08.561841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d79d-998d-45c6-9ba8-e17dae91f59c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:08.562536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d79d-998d-45c6-9ba8-e17dae91f59c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.562819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d79d-998d-45c6-9ba8-e17dae91f59c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.563089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17d79d-998d-45c6-9ba8-e17dae91f59c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/system/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.565721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17d79d-998d-45c6-9ba8-e17dae91f59c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=68ee0b6a430046ed8315a66b9ef43a04, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:08.567279 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-7b17d79d-998d-45c6-9ba8-e17dae91f59c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:08.567279 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:08.567279 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:08.570468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17d79d-998d-45c6-9ba8-e17dae91f59c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:08.589265 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3121/6289] 10.222.0.43 () {58 vars in 1365 bytes} [Tue Aug 30 04:45:08 2022] DELETE /identity/v3/system/groups/68ee0b6a430046ed8315a66b9ef43a04/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:08.595025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d79d-998d-45c6-9ba8-e17dae91f59c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:08.606756 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3169/6290] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:08 2022] PUT /identity/v3/projects/18515501dcfe4713a673556f6f7aa9a0/users/f232761c61654108b85eaee620489275/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:08.610154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c219ed0-eff8-4b7d-b7d3-8173de824272 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.610286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c219ed0-eff8-4b7d-b7d3-8173de824272 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.610759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c219ed0-eff8-4b7d-b7d3-8173de824272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.677907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17d79d-998d-45c6-9ba8-e17dae91f59c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:08.734756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7c219ed0-eff8-4b7d-b7d3-8173de824272 None None] MFA Rules not processed for user `f232761c61654108b85eaee620489275`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:08.736102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c219ed0-eff8-4b7d-b7d3-8173de824272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:08.859748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69d566-f8bd-4a0b-b85f-87451f81b28f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:08.860719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d566-f8bd-4a0b-b85f-87451f81b28f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:08.860719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d566-f8bd-4a0b-b85f-87451f81b28f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:08.861129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69d566-f8bd-4a0b-b85f-87451f81b28f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:08.871075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69d566-f8bd-4a0b-b85f-87451f81b28f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2978357ad0ad4e2a95b53e37dc10e3d1, user_id=c9d046925d4648d49b748031297f7cac, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:08.881807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69d566-f8bd-4a0b-b85f-87451f81b28f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:08.886589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:08.917491 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3122/6291] 10.222.0.43 () {60 vars in 1480 bytes} [Tue Aug 30 04:45:08 2022] PUT /identity/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:08.917695 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3170/6292] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:45:08.926526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69d566-f8bd-4a0b-b85f-87451f81b28f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:08.927696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c219ed0-eff8-4b7d-b7d3-8173de824272 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:08.931239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c219ed0-eff8-4b7d-b7d3-8173de824272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:09.008745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:09.051442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c219ed0-eff8-4b7d-b7d3-8173de824272 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:09.097774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69d566-f8bd-4a0b-b85f-87451f81b28f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:09.111837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725c34a-131a-4811-8c70-47fa18276fc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:09.112578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725c34a-131a-4811-8c70-47fa18276fc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.112858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725c34a-131a-4811-8c70-47fa18276fc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.113132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725c34a-131a-4811-8c70-47fa18276fc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/users/c9d046925d4648d49b748031297f7cac/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.117716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725c34a-131a-4811-8c70-47fa18276fc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=2978357ad0ad4e2a95b53e37dc10e3d1, user_id=c9d046925d4648d49b748031297f7cac)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:09.127263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725c34a-131a-4811-8c70-47fa18276fc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:09.142858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b0d1b-d064-4f7e-98ef-45a7fbce08cb tempest-IdentityV3ProjectsTest-264075847 tempest-IdentityV3ProjectsTest-264075847-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2a1a3f178934c9b948a5bed6fcf89a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16b9d92af2f546dba3a4ab571f9acf03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:09.146235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b0d1b-d064-4f7e-98ef-45a7fbce08cb tempest-IdentityV3ProjectsTest-264075847 tempest-IdentityV3ProjectsTest-264075847-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.146745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b0d1b-d064-4f7e-98ef-45a7fbce08cb tempest-IdentityV3ProjectsTest-264075847 tempest-IdentityV3ProjectsTest-264075847-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.147211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b0d1b-d064-4f7e-98ef-45a7fbce08cb tempest-IdentityV3ProjectsTest-264075847 tempest-IdentityV3ProjectsTest-264075847-project] PATH_INFO: `/v3/users/b2a1a3f178934c9b948a5bed6fcf89a2/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.149365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b0d1b-d064-4f7e-98ef-45a7fbce08cb tempest-IdentityV3ProjectsTest-264075847 tempest-IdentityV3ProjectsTest-264075847-project] RBAC: Authorizing `identity:list_user_projects(user_id=b2a1a3f178934c9b948a5bed6fcf89a2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:09.151940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b0d1b-d064-4f7e-98ef-45a7fbce08cb tempest-IdentityV3ProjectsTest-264075847 tempest-IdentityV3ProjectsTest-264075847-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:09.153189 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3123/6293] 10.222.0.43 () {58 vars in 1362 bytes} [Tue Aug 30 04:45:08 2022] GET /identity/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/users/c9d046925d4648d49b748031297f7cac/roles => generated 409 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:09.159331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725c34a-131a-4811-8c70-47fa18276fc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:09.193240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725c34a-131a-4811-8c70-47fa18276fc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:09.205416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f106a2-0743-440d-882c-283ca3ddbcaa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:09.206155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f106a2-0743-440d-882c-283ca3ddbcaa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.206448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f106a2-0743-440d-882c-283ca3ddbcaa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.206735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f106a2-0743-440d-882c-283ca3ddbcaa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.219599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f106a2-0743-440d-882c-283ca3ddbcaa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=2978357ad0ad4e2a95b53e37dc10e3d1, user_id=c9d046925d4648d49b748031297f7cac, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:09.222515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f106a2-0743-440d-882c-283ca3ddbcaa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:09.232882 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3124/6294] 10.222.0.43 () {58 vars in 1462 bytes} [Tue Aug 30 04:45:09 2022] HEAD /identity/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:09.236995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f106a2-0743-440d-882c-283ca3ddbcaa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:09.259618 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3171/6295] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Aug 30 04:45:08 2022] GET /identity/v3/users/b2a1a3f178934c9b948a5bed6fcf89a2/projects => generated 515 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:09.260493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f106a2-0743-440d-882c-283ca3ddbcaa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:09.266022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:09.266575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae3051-ce88-49f7-81fa-ca2659b6c81f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.266902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.267185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.267460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.267824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae3051-ce88-49f7-81fa-ca2659b6c81f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.268447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae3051-ce88-49f7-81fa-ca2659b6c81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.270144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2978357ad0ad4e2a95b53e37dc10e3d1, user_id=c9d046925d4648d49b748031297f7cac, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:09.273030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:09.279872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 5a5c4f176bde47a3b68319ff10af1384 was removed from user c9d046925d4648d49b748031297f7cac on domain 2978357ad0ad4e2a95b53e37dc10e3d1. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:09.280036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:09.280621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:09.303338 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3125/6296] 10.222.0.43 () {58 vars in 1464 bytes} [Tue Aug 30 04:45:09 2022] DELETE /identity/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:09.304349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:09.306643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:09.341689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-18ae3051-ce88-49f7-81fa-ca2659b6c81f None None] MFA Rules not processed for user `b2a1a3f178934c9b948a5bed6fcf89a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:09.345979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-18ae3051-ce88-49f7-81fa-ca2659b6c81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:09.388148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3960458-10ed-4d89-9e68-6185cb8b592b tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:09.393952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cef94b-ddbc-40d3-8278-7d85ab8dd174 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:09.395383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cef94b-ddbc-40d3-8278-7d85ab8dd174 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.395743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cef94b-ddbc-40d3-8278-7d85ab8dd174 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.396311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cef94b-ddbc-40d3-8278-7d85ab8dd174 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.399029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cef94b-ddbc-40d3-8278-7d85ab8dd174 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user_id=c9d046925d4648d49b748031297f7cac, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:09.402129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cef94b-ddbc-40d3-8278-7d85ab8dd174 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:09.435248 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3126/6297] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:09 2022] PUT /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:09.436268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cef94b-ddbc-40d3-8278-7d85ab8dd174 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:09.489105 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3172/6298] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:09.493828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7b16a-b813-49f1-a93a-2e4dd73517dd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.494362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7b16a-b813-49f1-a93a-2e4dd73517dd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.494712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7b16a-b813-49f1-a93a-2e4dd73517dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.541444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a8b7b16a-b813-49f1-a93a-2e4dd73517dd None None] MFA Rules not processed for user `b2a1a3f178934c9b948a5bed6fcf89a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:09.552713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a8b7b16a-b813-49f1-a93a-2e4dd73517dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:09.561631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cef94b-ddbc-40d3-8278-7d85ab8dd174 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:09.573234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:09.574207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dc6c5-2bc8-4e53-8300-e0bbfb3fb200 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:09.575071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc6c5-2bc8-4e53-8300-e0bbfb3fb200 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.575700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc6c5-2bc8-4e53-8300-e0bbfb3fb200 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.576051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9dc6c5-2bc8-4e53-8300-e0bbfb3fb200 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.578196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dc6c5-2bc8-4e53-8300-e0bbfb3fb200 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_grants(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user_id=c9d046925d4648d49b748031297f7cac)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:09.581380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9dc6c5-2bc8-4e53-8300-e0bbfb3fb200 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:09.615290 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3127/6299] 10.222.0.43 () {58 vars in 1365 bytes} [Tue Aug 30 04:45:09 2022] GET /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles => generated 410 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:09.617102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dc6c5-2bc8-4e53-8300-e0bbfb3fb200 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:09.645283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.models.token_model [None req-a8b7b16a-b813-49f1-a93a-2e4dd73517dd None None] User b2a1a3f178934c9b948a5bed6fcf89a2 has no access to project 18515501dcfe4713a673556f6f7aa9a0 {{(pid=82098) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Aug 30 04:45:09.648318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9dc6c5-2bc8-4e53-8300-e0bbfb3fb200 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:09.650835 n-d-820368-36 devstack@keystone.service[82098]: WARNING keystone.server.flask.application [None req-a8b7b16a-b813-49f1-a93a-2e4dd73517dd None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 30 04:45:09.654879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9072c8-882f-41d5-9013-acc7f97188b9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:09.655090 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3173/6300] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:09 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 161 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 30 04:45:09.656285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9072c8-882f-41d5-9013-acc7f97188b9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.662151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7b16a-b813-49f1-a93a-2e4dd73517dd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:09.662241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9072c8-882f-41d5-9013-acc7f97188b9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.662538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9072c8-882f-41d5-9013-acc7f97188b9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.664509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a8b7b16a-b813-49f1-a93a-2e4dd73517dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:09.668630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9072c8-882f-41d5-9013-acc7f97188b9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:check_grant(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user_id=c9d046925d4648d49b748031297f7cac, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:09.671349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9072c8-882f-41d5-9013-acc7f97188b9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:09.692460 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3128/6301] 10.222.0.43 () {58 vars in 1465 bytes} [Tue Aug 30 04:45:09 2022] HEAD /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:09.696658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9072c8-882f-41d5-9013-acc7f97188b9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:09.721828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9072c8-882f-41d5-9013-acc7f97188b9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:09.739034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:09.740195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.740691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.741169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.745161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461, user_id=c9d046925d4648d49b748031297f7cac, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:09.749909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:09.755443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:09.758687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 5a5c4f176bde47a3b68319ff10af1384 was removed from user c9d046925d4648d49b748031297f7cac on project 4b7eaf8ff1f8426a81f6bdfd35bd5461. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:09.759407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:09.761411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:09.790875 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3129/6302] 10.222.0.43 () {58 vars in 1467 bytes} [Tue Aug 30 04:45:09 2022] DELETE /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:09.795807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:09.799128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:09.827864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7b16a-b813-49f1-a93a-2e4dd73517dd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:09.953965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf391a0-4c0e-40d1-bbf6-879209711ee4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:09.978207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb2b46-4143-4096-ac78-88829c74671f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:09.979546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb2b46-4143-4096-ac78-88829c74671f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:09.983493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb2b46-4143-4096-ac78-88829c74671f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:09.984438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb2b46-4143-4096-ac78-88829c74671f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/system/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:09.988585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb2b46-4143-4096-ac78-88829c74671f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c9d046925d4648d49b748031297f7cac, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:09.994006 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-b3fb2b46-4143-4096-ac78-88829c74671f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:09.994006 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:09.994006 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:09.997722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb2b46-4143-4096-ac78-88829c74671f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:10.014396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:10.015535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.015746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.016108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] PATH_INFO: `/v3/users/b2a1a3f178934c9b948a5bed6fcf89a2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.017491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2a1a3f178934c9b948a5bed6fcf89a2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:10.019923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:10.027231 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3130/6303] 10.222.0.43 () {60 vars in 1378 bytes} [Tue Aug 30 04:45:09 2022] PUT /identity/v3/system/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:10.031375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb2b46-4143-4096-ac78-88829c74671f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:10.049542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb2b46-4143-4096-ac78-88829c74671f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:10.064599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac668-651a-474d-803f-27b33922f032 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:10.065315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac668-651a-474d-803f-27b33922f032 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.065598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac668-651a-474d-803f-27b33922f032 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.065929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cac668-651a-474d-803f-27b33922f032 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/system/users/c9d046925d4648d49b748031297f7cac/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.068176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cac668-651a-474d-803f-27b33922f032 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=c9d046925d4648d49b748031297f7cac)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:10.069691 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-26cac668-651a-474d-803f-27b33922f032 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:10.069691 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:10.069691 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:10.070876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cac668-651a-474d-803f-27b33922f032 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:10.096118 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3131/6304] 10.222.0.43 () {58 vars in 1260 bytes} [Tue Aug 30 04:45:10 2022] GET /identity/v3/system/users/c9d046925d4648d49b748031297f7cac/roles => generated 375 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:10.097351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac668-651a-474d-803f-27b33922f032 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:10.100763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-26cac668-651a-474d-803f-27b33922f032 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:10.115912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2a1a3f178934c9b948a5bed6fcf89a2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:10.118007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2a1a3f178934c9b948a5bed6fcf89a2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:10.125324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cac668-651a-474d-803f-27b33922f032 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:10.131816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:10.133229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.133765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.134279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] PATH_INFO: `/v3/users/2227c0fc5e464b47b85b798d9f4ef7f6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.136015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2227c0fc5e464b47b85b798d9f4ef7f6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:10.140035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2a1a3f178934c9b948a5bed6fcf89a2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:10.140939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:10.159391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2a1a3f178934c9b948a5bed6fcf89a2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:10.182565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:10.190104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2a1a3f178934c9b948a5bed6fcf89a2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:10.202812 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3174/6305] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:09 2022] DELETE /identity/v3/users/b2a1a3f178934c9b948a5bed6fcf89a2 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:10.205395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:10.208334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:10.251251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2227c0fc5e464b47b85b798d9f4ef7f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:10.271451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2227c0fc5e464b47b85b798d9f4ef7f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:10.291561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2227c0fc5e464b47b85b798d9f4ef7f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:10.306164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2227c0fc5e464b47b85b798d9f4ef7f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:10.307596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c655244-fa3e-44a8-9921-7545174fffdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2227c0fc5e464b47b85b798d9f4ef7f6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:10.310509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be34de2-c26b-4c33-ba07-240a18ed5095 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:10.322647 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3132/6306] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:10 2022] DELETE /identity/v3/users/2227c0fc5e464b47b85b798d9f4ef7f6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:10.325732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c48e1-0b05-4209-860b-07e336e7b117 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.326633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3fe70a-16bd-4bdf-b576-c1298b23749a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:10.327324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe70a-16bd-4bdf-b576-c1298b23749a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.327606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe70a-16bd-4bdf-b576-c1298b23749a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.327897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3fe70a-16bd-4bdf-b576-c1298b23749a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/system/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.328516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c48e1-0b05-4209-860b-07e336e7b117 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.328793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c48e1-0b05-4209-860b-07e336e7b117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.334180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fe70a-16bd-4bdf-b576-c1298b23749a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=c9d046925d4648d49b748031297f7cac, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:10.335266 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-3b3fe70a-16bd-4bdf-b576-c1298b23749a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:10.335266 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:45:10.335266 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:45:10.336166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3fe70a-16bd-4bdf-b576-c1298b23749a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:10.360942 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3175/6307] 10.222.0.43 () {58 vars in 1360 bytes} [Tue Aug 30 04:45:10 2022] HEAD /identity/v3/system/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:10.364411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe3494-4258-4b6d-a699-a9ffda47b013 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.364739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe3494-4258-4b6d-a699-a9ffda47b013 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.364928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe3494-4258-4b6d-a699-a9ffda47b013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.375044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6f5c48e1-0b05-4209-860b-07e336e7b117 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:10.376287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f5c48e1-0b05-4209-860b-07e336e7b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:10.418765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bbbe3494-4258-4b6d-a699-a9ffda47b013 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:10.420035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bbbe3494-4258-4b6d-a699-a9ffda47b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:10.514989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:10.575795 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3133/6308] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:10.576680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c48e1-0b05-4209-860b-07e336e7b117 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:10.580548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f5c48e1-0b05-4209-860b-07e336e7b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:10.611177 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3176/6309] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:10.621750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe3494-4258-4b6d-a699-a9ffda47b013 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:10.625161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bbbe3494-4258-4b6d-a699-a9ffda47b013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:10.748552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c48e1-0b05-4209-860b-07e336e7b117 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:10.761081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe3494-4258-4b6d-a699-a9ffda47b013 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:10.764359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff66f8-e678-4200-8f3d-84ec41812939 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:10.765900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff66f8-e678-4200-8f3d-84ec41812939 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.766413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff66f8-e678-4200-8f3d-84ec41812939 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.766857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff66f8-e678-4200-8f3d-84ec41812939 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/system/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.769477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff66f8-e678-4200-8f3d-84ec41812939 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=c9d046925d4648d49b748031297f7cac, role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:10.771814 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-5eff66f8-e678-4200-8f3d-84ec41812939 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:10.771814 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:10.771814 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:10.774314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff66f8-e678-4200-8f3d-84ec41812939 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:10.775099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe6ee3-441b-460e-a3f6-d26f7d07b2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:10.777038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6ee3-441b-460e-a3f6-d26f7d07b2fe service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.777470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6ee3-441b-460e-a3f6-d26f7d07b2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.778619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6ee3-441b-460e-a3f6-d26f7d07b2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.796863 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3134/6310] 10.222.0.43 () {58 vars in 1362 bytes} [Tue Aug 30 04:45:10 2022] DELETE /identity/v3/system/users/c9d046925d4648d49b748031297f7cac/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:10.798236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff66f8-e678-4200-8f3d-84ec41812939 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:10.809049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe6ee3-441b-460e-a3f6-d26f7d07b2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:10.812547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe6ee3-441b-460e-a3f6-d26f7d07b2fe service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:10.821352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff66f8-e678-4200-8f3d-84ec41812939 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:10.826025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26fa25-d5be-4b81-b8c8-b271525a77ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:10.826828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26fa25-d5be-4b81-b8c8-b271525a77ca service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.827256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26fa25-d5be-4b81-b8c8-b271525a77ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.827673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26fa25-d5be-4b81-b8c8-b271525a77ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.839137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26fa25-d5be-4b81-b8c8-b271525a77ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:10.839465 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3177/6311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:45:10.840470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe6ee3-441b-460e-a3f6-d26f7d07b2fe service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:10.841237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a26fa25-d5be-4b81-b8c8-b271525a77ca service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:10.856745 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3135/6312] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:10.878264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe6ee3-441b-460e-a3f6-d26f7d07b2fe service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:10.889064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227aef-c44e-4ef9-b881-06eae2ee0475 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:10.889700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227aef-c44e-4ef9-b881-06eae2ee0475 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.890030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227aef-c44e-4ef9-b881-06eae2ee0475 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.890303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd227aef-c44e-4ef9-b881-06eae2ee0475 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.891168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd227aef-c44e-4ef9-b881-06eae2ee0475 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:10.892808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd227aef-c44e-4ef9-b881-06eae2ee0475 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:10.946514 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3178/6313] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:45:10 2022] POST /identity/v3/roles => generated 270 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:10.950386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26fa25-d5be-4b81-b8c8-b271525a77ca service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:10.967729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26fa25-d5be-4b81-b8c8-b271525a77ca service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:10.989717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c514e56-05b1-4426-9c84-d5d08bf996ec tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:10.991195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c514e56-05b1-4426-9c84-d5d08bf996ec tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:10.992078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c514e56-05b1-4426-9c84-d5d08bf996ec tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:10.992563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c514e56-05b1-4426-9c84-d5d08bf996ec tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:10.993491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c514e56-05b1-4426-9c84-d5d08bf996ec tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:10.997912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c514e56-05b1-4426-9c84-d5d08bf996ec tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:11.061895 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3136/6314] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:45:10 2022] POST /identity/v3/roles => generated 270 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:11.068934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227aef-c44e-4ef9-b881-06eae2ee0475 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:11.083311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd227aef-c44e-4ef9-b881-06eae2ee0475 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:11.099915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9c70-846d-421f-9568-d813ebfcc872 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:11.101202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9c70-846d-421f-9568-d813ebfcc872 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:11.101202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9c70-846d-421f-9568-d813ebfcc872 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:11.101436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb9c70-846d-421f-9568-d813ebfcc872 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/bf03dc76880243748fd6048798d96f21/implies/40cc99fd287f4145b5c6378126c6d0c1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:11.104732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb9c70-846d-421f-9568-d813ebfcc872 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bf03dc76880243748fd6048798d96f21, implied_role_id=40cc99fd287f4145b5c6378126c6d0c1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:11.105791 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-bacb9c70-846d-421f-9568-d813ebfcc872 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:11.105791 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:45:11.105791 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:45:11.106713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb9c70-846d-421f-9568-d813ebfcc872 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:11.163978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:11.190828 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3179/6315] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:11 2022] PUT /identity/v3/roles/bf03dc76880243748fd6048798d96f21/implies/40cc99fd287f4145b5c6378126c6d0c1 => generated 531 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:11.197000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c514e56-05b1-4426-9c84-d5d08bf996ec tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:11.220756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c514e56-05b1-4426-9c84-d5d08bf996ec tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:11.341508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119ab7f-c96c-4d33-aee5-dd9db4ea3315 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:11.342583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119ab7f-c96c-4d33-aee5-dd9db4ea3315 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:11.342939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119ab7f-c96c-4d33-aee5-dd9db4ea3315 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:11.343282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119ab7f-c96c-4d33-aee5-dd9db4ea3315 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:11.344094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119ab7f-c96c-4d33-aee5-dd9db4ea3315 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:11.348041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119ab7f-c96c-4d33-aee5-dd9db4ea3315 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:11.389918 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3137/6316] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:45:11 2022] POST /identity/v3/domains => generated 275 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:11.393849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9c70-846d-421f-9568-d813ebfcc872 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:11.411712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb9c70-846d-421f-9568-d813ebfcc872 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:11.519038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26420707-2226-47c2-beb0-52f92415216f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:11.520282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26420707-2226-47c2-beb0-52f92415216f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:11.521556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26420707-2226-47c2-beb0-52f92415216f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:11.523381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26420707-2226-47c2-beb0-52f92415216f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:11.526388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26420707-2226-47c2-beb0-52f92415216f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:11.529208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26420707-2226-47c2-beb0-52f92415216f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:11.585669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119ab7f-c96c-4d33-aee5-dd9db4ea3315 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:11.599235 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3180/6317] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:45:11 2022] POST /identity/v3/roles => generated 270 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:11.603218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119ab7f-c96c-4d33-aee5-dd9db4ea3315 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:11.611536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c8177-aca1-4d3a-9c94-50c2c3076f06 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:11.612831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c8177-aca1-4d3a-9c94-50c2c3076f06 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:11.613261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c8177-aca1-4d3a-9c94-50c2c3076f06 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:11.613907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c8177-aca1-4d3a-9c94-50c2c3076f06 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/bf03dc76880243748fd6048798d96f21/implies/63039ce5e1ed4e77932ff5564cb1238f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:11.617662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c8177-aca1-4d3a-9c94-50c2c3076f06 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bf03dc76880243748fd6048798d96f21, implied_role_id=63039ce5e1ed4e77932ff5564cb1238f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:11.620974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c8177-aca1-4d3a-9c94-50c2c3076f06 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:11.672562 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3138/6318] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:11 2022] PUT /identity/v3/roles/bf03dc76880243748fd6048798d96f21/implies/63039ce5e1ed4e77932ff5564cb1238f => generated 531 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:11.676667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26420707-2226-47c2-beb0-52f92415216f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:11.694814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26420707-2226-47c2-beb0-52f92415216f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:11.789000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f6cd1-d39a-4299-9d7c-26fa6cb56448 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:11.789851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f6cd1-d39a-4299-9d7c-26fa6cb56448 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:11.790182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f6cd1-d39a-4299-9d7c-26fa6cb56448 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:11.790462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f6cd1-d39a-4299-9d7c-26fa6cb56448 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/bf03dc76880243748fd6048798d96f21/implies/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:11.793073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f6cd1-d39a-4299-9d7c-26fa6cb56448 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=bf03dc76880243748fd6048798d96f21, implied_role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:11.794892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f6cd1-d39a-4299-9d7c-26fa6cb56448 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:11.831740 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3181/6319] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:11 2022] PUT /identity/v3/roles/bf03dc76880243748fd6048798d96f21/implies/5a5c4f176bde47a3b68319ff10af1384 => generated 526 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:45:11.837266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c8177-aca1-4d3a-9c94-50c2c3076f06 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:11.850505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c8177-aca1-4d3a-9c94-50c2c3076f06 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:11.877060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f6cd1-d39a-4299-9d7c-26fa6cb56448 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:11.880667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-235f6cd1-d39a-4299-9d7c-26fa6cb56448 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:11.900334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:11.999768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317bc5e-ab38-4ca9-b8ab-ca0f45ef5da1 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:12.000904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317bc5e-ab38-4ca9-b8ab-ca0f45ef5da1 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:12.000904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317bc5e-ab38-4ca9-b8ab-ca0f45ef5da1 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:12.002468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317bc5e-ab38-4ca9-b8ab-ca0f45ef5da1 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/5a5c4f176bde47a3b68319ff10af1384/implies/bf03dc76880243748fd6048798d96f21` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:12.005765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317bc5e-ab38-4ca9-b8ab-ca0f45ef5da1 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=5a5c4f176bde47a3b68319ff10af1384, implied_role_id=bf03dc76880243748fd6048798d96f21)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:12.007646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317bc5e-ab38-4ca9-b8ab-ca0f45ef5da1 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:12.048987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f6cd1-d39a-4299-9d7c-26fa6cb56448 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-4317bc5e-ab38-4ca9-b8ab-ca0f45ef5da1 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] bf03dc76880243748fd6048798d96f21 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: bf03dc76880243748fd6048798d96f21 cannot be an implied roles. Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 30 04:45:12.051466 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 30 04:45:12.052375 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:12.052375 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:12.052375 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 30 04:45:12.052375 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 30 04:45:12.052375 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: bf03dc76880243748fd6048798d96f21 cannot be an implied roles. Aug 30 04:45:12.052375 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:12.057343 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3139/6320] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:11 2022] PUT /identity/v3/roles/5a5c4f176bde47a3b68319ff10af1384/implies/bf03dc76880243748fd6048798d96f21 => generated 116 bytes in 221 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:45:12.058300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317bc5e-ab38-4ca9-b8ab-ca0f45ef5da1 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:12.061359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:12.062390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:12.062941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:12.063219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] PATH_INFO: `/v3/projects/16b9d92af2f546dba3a4ab571f9acf03` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:12.064754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4317bc5e-ab38-4ca9-b8ab-ca0f45ef5da1 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:12.067451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=16b9d92af2f546dba3a4ab571f9acf03)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:12.072994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:12.095660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317bc5e-ab38-4ca9-b8ab-ca0f45ef5da1 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:12.097579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:12.108774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:12.110700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:12.111150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:12.112302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] PATH_INFO: `/v3/projects/c450d527f6b84338af49783c90756fb4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:12.116010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c450d527f6b84338af49783c90756fb4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:12.126821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:12.187016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16b9d92af2f546dba3a4ab571f9acf03', 'request_id': 'req-221db2e6-54b2-4352-b4e2-9f17b7123f3e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.205218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16b9d92af2f546dba3a4ab571f9acf03', 'request_id': 'req-221db2e6-54b2-4352-b4e2-9f17b7123f3e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.224851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16b9d92af2f546dba3a4ab571f9acf03', 'request_id': 'req-221db2e6-54b2-4352-b4e2-9f17b7123f3e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.238666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c450d527f6b84338af49783c90756fb4', 'request_id': 'req-9b27090c-5166-45c6-b6f0-598f528347ed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.246343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] The token cache is being invalidate because project 16b9d92af2f546dba3a4ab571f9acf03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:12.246636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.247350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.249056 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3182/6321] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:11 2022] DELETE /identity/v3/projects/16b9d92af2f546dba3a4ab571f9acf03 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:12.249831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:12.252526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c450d527f6b84338af49783c90756fb4', 'request_id': 'req-9b27090c-5166-45c6-b6f0-598f528347ed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.252735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:12.263858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c450d527f6b84338af49783c90756fb4', 'request_id': 'req-9b27090c-5166-45c6-b6f0-598f528347ed'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.280186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] The token cache is being invalidate because project c450d527f6b84338af49783c90756fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:12.281290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.282418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.285748 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3140/6322] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:12 2022] DELETE /identity/v3/projects/c450d527f6b84338af49783c90756fb4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:12.287162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:12.289444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:12.370057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db2e6-54b2-4352-b4e2-9f17b7123f3e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:12.407757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27090c-5166-45c6-b6f0-598f528347ed admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:12.420180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:12.422011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:12.422363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:12.422701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] PATH_INFO: `/v3/users/f232761c61654108b85eaee620489275` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:12.424129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f232761c61654108b85eaee620489275)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:12.426532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:12.458405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822da59-2d45-4497-b891-6058716517c8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:12.459188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822da59-2d45-4497-b891-6058716517c8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:12.459535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822da59-2d45-4497-b891-6058716517c8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:12.459873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822da59-2d45-4497-b891-6058716517c8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/bf03dc76880243748fd6048798d96f21/implies/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:12.463053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822da59-2d45-4497-b891-6058716517c8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf03dc76880243748fd6048798d96f21, implied_role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:12.464327 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-2822da59-2d45-4497-b891-6058716517c8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:12.464327 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:45:12.464327 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:45:12.465426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822da59-2d45-4497-b891-6058716517c8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:12.484751 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3183/6323] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:12 2022] DELETE /identity/v3/roles/bf03dc76880243748fd6048798d96f21/implies/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:12.486195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822da59-2d45-4497-b891-6058716517c8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:12.489575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2822da59-2d45-4497-b891-6058716517c8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:12.511450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:12.544811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f232761c61654108b85eaee620489275'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.559155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f232761c61654108b85eaee620489275'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.589547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f232761c61654108b85eaee620489275'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.600528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:12.626982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f232761c61654108b85eaee620489275'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.627928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f232761c61654108b85eaee620489275'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.642001 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3141/6324] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:12 2022] DELETE /identity/v3/users/f232761c61654108b85eaee620489275 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:12.643422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:12.645370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:12.677085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822da59-2d45-4497-b891-6058716517c8 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:12.771209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11203569-65bc-4309-a353-f90d3acf98e2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:12.776859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cf7ed-21f4-40be-87b0-f3bdfbd4efaf tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:12.777581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cf7ed-21f4-40be-87b0-f3bdfbd4efaf tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:12.777949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cf7ed-21f4-40be-87b0-f3bdfbd4efaf tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:12.778289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cf7ed-21f4-40be-87b0-f3bdfbd4efaf tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/bf03dc76880243748fd6048798d96f21/implies/63039ce5e1ed4e77932ff5564cb1238f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:12.784025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cf7ed-21f4-40be-87b0-f3bdfbd4efaf tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf03dc76880243748fd6048798d96f21, implied_role_id=63039ce5e1ed4e77932ff5564cb1238f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:12.787057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57cf7ed-21f4-40be-87b0-f3bdfbd4efaf tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:12.804365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:12.805126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:12.806903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:12.807290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] PATH_INFO: `/v3/users/e8cf8918549c4339b068736d9f7f7ce7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:12.812294 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3142/6325] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:12 2022] DELETE /identity/v3/roles/bf03dc76880243748fd6048798d96f21/implies/63039ce5e1ed4e77932ff5564cb1238f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:12.814021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cf7ed-21f4-40be-87b0-f3bdfbd4efaf tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:12.816988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cf8918549c4339b068736d9f7f7ce7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:12.820808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:12.945104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cf8918549c4339b068736d9f7f7ce7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.947136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cf8918549c4339b068736d9f7f7ce7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.961844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cf7ed-21f4-40be-87b0-f3bdfbd4efaf tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:12.967546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cf8918549c4339b068736d9f7f7ce7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:12.978806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:12.980329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:12.980766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:12.981248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/63039ce5e1ed4e77932ff5564cb1238f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:12.982718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=63039ce5e1ed4e77932ff5564cb1238f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:12.984698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:12.988228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cf8918549c4339b068736d9f7f7ce7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.016389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cf8918549c4339b068736d9f7f7ce7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.032455 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3184/6326] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:12 2022] DELETE /identity/v3/users/e8cf8918549c4339b068736d9f7f7ce7 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:13.063000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 63039ce5e1ed4e77932ff5564cb1238f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:13.064007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.064917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.070622 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3143/6327] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:12 2022] DELETE /identity/v3/roles/63039ce5e1ed4e77932ff5564cb1238f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:13.074967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:13.077137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:13.233308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3464215-03b9-4230-b471-03a54d07da9e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:13.264329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:13.361095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:13.361784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:13.362422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:13.362727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2560ffcdeb3b4c8ab71506be939fd7eb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:13.378518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2560ffcdeb3b4c8ab71506be939fd7eb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:13.380575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:13.408050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.409466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.461781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:13.462011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.463019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.463600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:13.467751 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3185/6328] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:45:13 2022] PATCH /identity/v3/domains/2560ffcdeb3b4c8ab71506be939fd7eb => generated 276 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:13.471680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:13.474852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:13.506424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:13.603188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a6ccc-c3f1-452c-9821-e597ed7cd28c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:13.730816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4f840-348d-496e-94af-0a860fc92286 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:13.749386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:13.752579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:13.755348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:13.755653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2560ffcdeb3b4c8ab71506be939fd7eb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:13.806253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2560ffcdeb3b4c8ab71506be939fd7eb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:13.814536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:13.816914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:13.820986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:13.821557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:13.823476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] PATH_INFO: `/v3/projects/18515501dcfe4713a673556f6f7aa9a0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:13.828150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] RBAC: Authorizing `identity:delete_project(project_id=18515501dcfe4713a673556f6f7aa9a0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:13.835062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:13.884389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.914493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.964293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18515501dcfe4713a673556f6f7aa9a0', 'request_id': 'req-19501ea4-965d-40a8-b73c-8260f6a3467c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.976893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18515501dcfe4713a673556f6f7aa9a0', 'request_id': 'req-19501ea4-965d-40a8-b73c-8260f6a3467c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.990496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18515501dcfe4713a673556f6f7aa9a0', 'request_id': 'req-19501ea4-965d-40a8-b73c-8260f6a3467c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:13.993124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:14.000386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb', 'request_id': 'req-cf88b226-47e3-4162-b190-9675836c9ba9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.013961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb', 'request_id': 'req-cf88b226-47e3-4162-b190-9675836c9ba9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.021951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] The token cache is being invalidate because project 18515501dcfe4713a673556f6f7aa9a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:14.024426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.025588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19501ea4-965d-40a8-b73c-8260f6a3467c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.029927 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3144/6329] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:13 2022] DELETE /identity/v3/projects/18515501dcfe4713a673556f6f7aa9a0 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:14.034832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38db15-6787-45cb-a9f3-401524f7c15b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:14.035110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38db15-6787-45cb-a9f3-401524f7c15b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:14.035581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38db15-6787-45cb-a9f3-401524f7c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:14.036126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb', 'request_id': 'req-cf88b226-47e3-4162-b190-9675836c9ba9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.071924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] The token cache is being invalidate because project 2560ffcdeb3b4c8ab71506be939fd7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:14.072533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.077261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.083281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fc38db15-6787-45cb-a9f3-401524f7c15b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:14.084786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fc38db15-6787-45cb-a9f3-401524f7c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:14.101000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb', 'request_id': 'req-cf88b226-47e3-4162-b190-9675836c9ba9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.101775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb', 'request_id': 'req-cf88b226-47e3-4162-b190-9675836c9ba9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.102427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2560ffcdeb3b4c8ab71506be939fd7eb', 'request_id': 'req-cf88b226-47e3-4162-b190-9675836c9ba9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.122615 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3186/6330] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:45:13 2022] DELETE /identity/v3/domains/2560ffcdeb3b4c8ab71506be939fd7eb => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:14.127166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:14.128660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:14.207768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:14.240132 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3145/6331] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:14.249373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833fb5-c43d-412c-adfa-286ab02e65cf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:14.249685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833fb5-c43d-412c-adfa-286ab02e65cf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:14.249971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4833fb5-c43d-412c-adfa-286ab02e65cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:14.284234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88b226-47e3-4162-b190-9675836c9ba9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:14.293631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a4833fb5-c43d-412c-adfa-286ab02e65cf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:14.297723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a4833fb5-c43d-412c-adfa-286ab02e65cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:14.298795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4daf6-7e26-45ce-a5fb-7a207d3a5db6 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:14.299507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4daf6-7e26-45ce-a5fb-7a207d3a5db6 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:14.299784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4daf6-7e26-45ce-a5fb-7a207d3a5db6 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:14.300062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4daf6-7e26-45ce-a5fb-7a207d3a5db6 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/bf03dc76880243748fd6048798d96f21/implies/40cc99fd287f4145b5c6378126c6d0c1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:14.302344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4daf6-7e26-45ce-a5fb-7a207d3a5db6 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=bf03dc76880243748fd6048798d96f21, implied_role_id=40cc99fd287f4145b5c6378126c6d0c1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:14.304171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4daf6-7e26-45ce-a5fb-7a207d3a5db6 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:14.311962 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3146/6332] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:45:14.317801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833fb5-c43d-412c-adfa-286ab02e65cf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:14.328237 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3187/6333] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:14 2022] DELETE /identity/v3/roles/bf03dc76880243748fd6048798d96f21/implies/40cc99fd287f4145b5c6378126c6d0c1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:14.332229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4daf6-7e26-45ce-a5fb-7a207d3a5db6 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:14.340855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4833fb5-c43d-412c-adfa-286ab02e65cf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:14.469217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4daf6-7e26-45ce-a5fb-7a207d3a5db6 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:14.480684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:14.481364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:14.481655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:14.481955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/40cc99fd287f4145b5c6378126c6d0c1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:14.483270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=40cc99fd287f4145b5c6378126c6d0c1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:14.485588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:14.497973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3313eae-b5a9-4692-a7ca-3cd3df592a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:14.498369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313eae-b5a9-4692-a7ca-3cd3df592a50 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:14.498679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313eae-b5a9-4692-a7ca-3cd3df592a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:14.498774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313eae-b5a9-4692-a7ca-3cd3df592a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:14.499890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3313eae-b5a9-4692-a7ca-3cd3df592a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:14.501024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3313eae-b5a9-4692-a7ca-3cd3df592a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:14.501968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3313eae-b5a9-4692-a7ca-3cd3df592a50 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:14.517399 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3147/6334] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:14.518490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3313eae-b5a9-4692-a7ca-3cd3df592a50 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:14.527943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c3313eae-b5a9-4692-a7ca-3cd3df592a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:14.541691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3313eae-b5a9-4692-a7ca-3cd3df592a50 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:14.547398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:14.548131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:14.548485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:14.548724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] PATH_INFO: `/v3/projects/9c64a6e2fd3147529194a96c5a3b1801` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:14.550247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c64a6e2fd3147529194a96c5a3b1801)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:14.552535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:14.561804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 40cc99fd287f4145b5c6378126c6d0c1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:14.562428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.563386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.569045 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3188/6335] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:14 2022] DELETE /identity/v3/roles/40cc99fd287f4145b5c6378126c6d0c1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:14.570250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:14.572465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:14.592164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:14.676827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c64a6e2fd3147529194a96c5a3b1801', 'request_id': 'req-19790e54-06bd-4a16-ad45-8b977e75bf07'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.698115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c64a6e2fd3147529194a96c5a3b1801', 'request_id': 'req-19790e54-06bd-4a16-ad45-8b977e75bf07'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.710109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c64a6e2fd3147529194a96c5a3b1801', 'request_id': 'req-19790e54-06bd-4a16-ad45-8b977e75bf07'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.730560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] The token cache is being invalidate because project 9c64a6e2fd3147529194a96c5a3b1801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:14.730944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.731894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.736910 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3148/6336] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:14 2022] DELETE /identity/v3/projects/9c64a6e2fd3147529194a96c5a3b1801 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:14.736910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:14.737423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:14.807988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ab2b-8c48-4e90-ba1a-9bdbd6cd9be7 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:14.893029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790e54-06bd-4a16-ad45-8b977e75bf07 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:14.907642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:14.908183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:14.908469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:14.908745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/bf03dc76880243748fd6048798d96f21` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:14.911320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=bf03dc76880243748fd6048798d96f21)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:14.912977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:14.926352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:14.990929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role bf03dc76880243748fd6048798d96f21 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:14.991540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.993107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:14.997299 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3149/6337] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:14 2022] DELETE /identity/v3/roles/bf03dc76880243748fd6048798d96f21 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:14.999013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:15.008151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:15.045637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa37b0d-7e1c-4141-a044-9f26d07322d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:15.046300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa37b0d-7e1c-4141-a044-9f26d07322d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:15.046575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa37b0d-7e1c-4141-a044-9f26d07322d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:15.046850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa37b0d-7e1c-4141-a044-9f26d07322d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:15.048872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa37b0d-7e1c-4141-a044-9f26d07322d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:15.052871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa37b0d-7e1c-4141-a044-9f26d07322d2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:15.118473 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3189/6338] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:14 2022] POST /identity/v3/projects => generated 357 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:15.124659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739dde3-7445-402e-972a-cb6777c23f39 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:15.128559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa37b0d-7e1c-4141-a044-9f26d07322d2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:15.132928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5fa37b0d-7e1c-4141-a044-9f26d07322d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:15.250294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:15.251605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:15.251889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:15.252162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] PATH_INFO: `/v3/users/5dacb00a726848b3a5ed8a4b47c6df60` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:15.255560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dacb00a726848b3a5ed8a4b47c6df60)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:15.258224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:15.339187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa37b0d-7e1c-4141-a044-9f26d07322d2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:15.352481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943ecd2-9419-4a29-b281-5b6cde80b78e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:15.354497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943ecd2-9419-4a29-b281-5b6cde80b78e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:15.356782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943ecd2-9419-4a29-b281-5b6cde80b78e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:15.359123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943ecd2-9419-4a29-b281-5b6cde80b78e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:15.362483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943ecd2-9419-4a29-b281-5b6cde80b78e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:15.365857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943ecd2-9419-4a29-b281-5b6cde80b78e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:15.380700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dacb00a726848b3a5ed8a4b47c6df60'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:15.413359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dacb00a726848b3a5ed8a4b47c6df60'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:15.414583 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3190/6339] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:15 2022] PUT /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 519 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:15.416812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943ecd2-9419-4a29-b281-5b6cde80b78e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:15.421623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a943ecd2-9419-4a29-b281-5b6cde80b78e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:15.465966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dacb00a726848b3a5ed8a4b47c6df60'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:15.480994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dacb00a726848b3a5ed8a4b47c6df60'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:15.481473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dacb00a726848b3a5ed8a4b47c6df60'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:15.492633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:15.495889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:15.498922 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3150/6340] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:14 2022] DELETE /identity/v3/users/5dacb00a726848b3a5ed8a4b47c6df60 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:15.503860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:15.511409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:15.581244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943ecd2-9419-4a29-b281-5b6cde80b78e tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:15.692227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd632d5-d9e1-4249-a5c5-23c3496704d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:15.692921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd632d5-d9e1-4249-a5c5-23c3496704d7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:15.693150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd632d5-d9e1-4249-a5c5-23c3496704d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:15.693566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd632d5-d9e1-4249-a5c5-23c3496704d7 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:15.694247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd632d5-d9e1-4249-a5c5-23c3496704d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:15.696999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd632d5-d9e1-4249-a5c5-23c3496704d7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:15.734930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16ba31-804d-4672-9e94-56b21c9a76d0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:15.749273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:15.751357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:15.751979 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3191/6341] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:15 2022] POST /identity/v3/users => generated 279 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:15.753366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:15.753974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:15.755048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd632d5-d9e1-4249-a5c5-23c3496704d7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:15.756729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:15.758989 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:15.758989 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:15.758989 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:15.760943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cdd632d5-d9e1-4249-a5c5-23c3496704d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:15.761205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:15.762746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:15.764168 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:15.764168 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:15.764168 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:15.765696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:15.773018 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3151/6342] 10.222.0.43 () {58 vars in 1345 bytes} [Tue Aug 30 04:45:15 2022] HEAD /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:15.777252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:15.788192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd632d5-d9e1-4249-a5c5-23c3496704d7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:15.803969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea17afb-095a-4fe3-8018-ba5fba9ff04c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:15.805444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06145333-1769-4dc5-889a-8209a7ced8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:15.806268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06145333-1769-4dc5-889a-8209a7ced8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:15.806523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06145333-1769-4dc5-889a-8209a7ced8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:15.806791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06145333-1769-4dc5-889a-8209a7ced8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:15.808837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06145333-1769-4dc5-889a-8209a7ced8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:15.811948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06145333-1769-4dc5-889a-8209a7ced8f7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:15.817073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60111f5-1466-4fa7-96ee-865aaa5da219 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:15.820124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60111f5-1466-4fa7-96ee-865aaa5da219 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:15.820420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60111f5-1466-4fa7-96ee-865aaa5da219 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:15.820742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60111f5-1466-4fa7-96ee-865aaa5da219 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:15.827251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60111f5-1466-4fa7-96ee-865aaa5da219 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:15.829236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60111f5-1466-4fa7-96ee-865aaa5da219 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:15.847325 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3192/6343] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:15 2022] GET /identity/v3/roles => generated 2321 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:15.851771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06145333-1769-4dc5-889a-8209a7ced8f7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:15.858317 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3152/6344] 10.222.0.43 () {58 vars in 1344 bytes} [Tue Aug 30 04:45:15 2022] GET /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 519 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:15.859461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60111f5-1466-4fa7-96ee-865aaa5da219 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:15.875605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06145333-1769-4dc5-889a-8209a7ced8f7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:15.884762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcce90b-b300-4aa8-8606-7f59cdeaaa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:15.885636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcce90b-b300-4aa8-8606-7f59cdeaaa2a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:15.886274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcce90b-b300-4aa8-8606-7f59cdeaaa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:15.886689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcce90b-b300-4aa8-8606-7f59cdeaaa2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:15.887524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcce90b-b300-4aa8-8606-7f59cdeaaa2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:15.890087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcce90b-b300-4aa8-8606-7f59cdeaaa2a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:15.890952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60111f5-1466-4fa7-96ee-865aaa5da219 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:15.907629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b87946-4e22-4036-b552-509e0f21ca96 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:15.908539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b87946-4e22-4036-b552-509e0f21ca96 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:15.908855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b87946-4e22-4036-b552-509e0f21ca96 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:15.909163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b87946-4e22-4036-b552-509e0f21ca96 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:15.911845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b87946-4e22-4036-b552-509e0f21ca96 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:15.913596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b87946-4e22-4036-b552-509e0f21ca96 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:15.929487 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3193/6345] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:15 2022] GET /identity/v3/roles => generated 2321 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:15.932838 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3153/6346] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:15 2022] DELETE /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:15.933597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcce90b-b300-4aa8-8606-7f59cdeaaa2a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:15.937027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b87946-4e22-4036-b552-509e0f21ca96 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:15.966447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcce90b-b300-4aa8-8606-7f59cdeaaa2a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:16.074705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b87946-4e22-4036-b552-509e0f21ca96 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:16.093355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea7194-140a-48d8-8dec-65eef1a67b80 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:16.094088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea7194-140a-48d8-8dec-65eef1a67b80 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:16.094535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea7194-140a-48d8-8dec-65eef1a67b80 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:16.094825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea7194-140a-48d8-8dec-65eef1a67b80 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:16.096926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea7194-140a-48d8-8dec-65eef1a67b80 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:16.099286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea7194-140a-48d8-8dec-65eef1a67b80 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-19ea7194-140a-48d8-8dec-65eef1a67b80 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] 55c107a2f22a420880113d27f319e0e8 does not imply e80e47753dc740f3bd08d9cdba3e9f95.: keystone.exception.ImpliedRoleNotFound: 55c107a2f22a420880113d27f319e0e8 does not imply e80e47753dc740f3bd08d9cdba3e9f95. Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = query.one() Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._iter().one() Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._only_one_row( Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:16.117484 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 30 04:45:16.118569 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 30 04:45:16.119650 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 30 04:45:16.119650 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 55c107a2f22a420880113d27f319e0e8 does not imply e80e47753dc740f3bd08d9cdba3e9f95. Aug 30 04:45:16.119650 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:16.126255 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3154/6347] 10.222.0.43 () {58 vars in 1344 bytes} [Tue Aug 30 04:45:15 2022] GET /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 137 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 30 04:45:16.130643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea7194-140a-48d8-8dec-65eef1a67b80 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:16.132469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2fda7f-9533-4e18-8c05-8a2201676973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:16.133278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fda7f-9533-4e18-8c05-8a2201676973 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:16.133654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fda7f-9533-4e18-8c05-8a2201676973 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:16.134063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2fda7f-9533-4e18-8c05-8a2201676973 admin admin] PATH_INFO: `/v3/projects/3a0f15bf92f34a2e83a08d6185fb3718/users/75154528a5934c5b847f2216f45c2a89/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:16.147644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea7194-140a-48d8-8dec-65eef1a67b80 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:16.167024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dcc5a-e964-4fa6-91a4-d8aa5f97f577 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:16.167258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dcc5a-e964-4fa6-91a4-d8aa5f97f577 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:16.168632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dcc5a-e964-4fa6-91a4-d8aa5f97f577 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:16.168932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dcc5a-e964-4fa6-91a4-d8aa5f97f577 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:16.170832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dcc5a-e964-4fa6-91a4-d8aa5f97f577 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:16.172384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dcc5a-e964-4fa6-91a4-d8aa5f97f577 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:16.172789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fda7f-9533-4e18-8c05-8a2201676973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0f15bf92f34a2e83a08d6185fb3718, user_id=75154528a5934c5b847f2216f45c2a89, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:16.175636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2fda7f-9533-4e18-8c05-8a2201676973 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-ed9dcc5a-e964-4fa6-91a4-d8aa5f97f577 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] 55c107a2f22a420880113d27f319e0e8 does not imply e80e47753dc740f3bd08d9cdba3e9f95.: keystone.exception.ImpliedRoleNotFound: 55c107a2f22a420880113d27f319e0e8 does not imply e80e47753dc740f3bd08d9cdba3e9f95. Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = query.one() Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._iter().one() Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._only_one_row( Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:16.198770 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 30 04:45:16.199930 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 30 04:45:16.203092 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 30 04:45:16.203092 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 30 04:45:16.203092 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 30 04:45:16.203092 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 55c107a2f22a420880113d27f319e0e8 does not imply e80e47753dc740f3bd08d9cdba3e9f95. Aug 30 04:45:16.203092 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:16.203092 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3155/6348] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:16 2022] DELETE /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 137 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:45:16.208067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dcc5a-e964-4fa6-91a4-d8aa5f97f577 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:16.224409 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3194/6349] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:15 2022] PUT /identity/v3/projects/3a0f15bf92f34a2e83a08d6185fb3718/users/75154528a5934c5b847f2216f45c2a89/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:16.225979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c383fd-7e77-4a70-8522-7f8dc353190f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:16.226270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c383fd-7e77-4a70-8522-7f8dc353190f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:16.226574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c383fd-7e77-4a70-8522-7f8dc353190f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:16.237691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dcc5a-e964-4fa6-91a4-d8aa5f97f577 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:16.260262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-19c383fd-7e77-4a70-8522-7f8dc353190f None None] MFA Rules not processed for user `75154528a5934c5b847f2216f45c2a89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:16.261506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-19c383fd-7e77-4a70-8522-7f8dc353190f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:16.289318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:16.387762 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3195/6350] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:16.389777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83030994-ee4d-46eb-ad30-83a22965c1d0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:16.389978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83030994-ee4d-46eb-ad30-83a22965c1d0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:16.390258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83030994-ee4d-46eb-ad30-83a22965c1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:16.396054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40299e76-58bf-4533-bc84-800d5f1ed06c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:16.396735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40299e76-58bf-4533-bc84-800d5f1ed06c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:16.397019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40299e76-58bf-4533-bc84-800d5f1ed06c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:16.402147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40299e76-58bf-4533-bc84-800d5f1ed06c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:16.404827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40299e76-58bf-4533-bc84-800d5f1ed06c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:16.406526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40299e76-58bf-4533-bc84-800d5f1ed06c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:16.417127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:16.445774 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3156/6351] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:16 2022] PUT /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 519 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:45:16.446329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-83030994-ee4d-46eb-ad30-83a22965c1d0 None None] MFA Rules not processed for user `75154528a5934c5b847f2216f45c2a89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:16.446742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40299e76-58bf-4533-bc84-800d5f1ed06c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:16.447829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-83030994-ee4d-46eb-ad30-83a22965c1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:16.452497 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3196/6352] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:16 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:45:16.458397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6a4bf-cd4a-4196-a92f-f80ed5639857 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:16.458807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6a4bf-cd4a-4196-a92f-f80ed5639857 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:16.459171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6a4bf-cd4a-4196-a92f-f80ed5639857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:16.483255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e9d6a4bf-cd4a-4196-a92f-f80ed5639857 None None] MFA Rules not processed for user `75154528a5934c5b847f2216f45c2a89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:16.484792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e9d6a4bf-cd4a-4196-a92f-f80ed5639857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:16.489826 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3197/6353] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:16 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:45:16.500275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6a4bf-cd4a-4196-a92f-f80ed5639857 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:16.547419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40299e76-58bf-4533-bc84-800d5f1ed06c tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:16.558556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bb251-214b-41f5-8158-01bbc2d4f21d tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:16.564209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bb251-214b-41f5-8158-01bbc2d4f21d tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:16.564826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bb251-214b-41f5-8158-01bbc2d4f21d tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:16.565121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bb251-214b-41f5-8158-01bbc2d4f21d tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/269243cf4019424999f7dc3585b172d1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:16.568636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bb251-214b-41f5-8158-01bbc2d4f21d tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=269243cf4019424999f7dc3585b172d1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:16.570878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bb251-214b-41f5-8158-01bbc2d4f21d tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:16.666795 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3157/6354] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:16 2022] PUT /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/269243cf4019424999f7dc3585b172d1 => generated 520 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:16.671115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bb251-214b-41f5-8158-01bbc2d4f21d tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:16.718368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6a4bf-cd4a-4196-a92f-f80ed5639857 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:16.871431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bb251-214b-41f5-8158-01bbc2d4f21d tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:16.905099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333466-4321-4bdc-9909-11a194941c47 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:16.905969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333466-4321-4bdc-9909-11a194941c47 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:16.906182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333466-4321-4bdc-9909-11a194941c47 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:16.906426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56333466-4321-4bdc-9909-11a194941c47 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/269243cf4019424999f7dc3585b172d1/implies/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:16.907176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299c111-fb43-4130-9459-c43029933df2 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75154528a5934c5b847f2216f45c2a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0f15bf92f34a2e83a08d6185fb3718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:16.909511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c111-fb43-4130-9459-c43029933df2 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] REQUEST_METHOD: `HEAD` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:16.909795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c111-fb43-4130-9459-c43029933df2 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:16.910237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299c111-fb43-4130-9459-c43029933df2 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:16.921083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56333466-4321-4bdc-9909-11a194941c47 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=269243cf4019424999f7dc3585b172d1, implied_role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:16.926962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56333466-4321-4bdc-9909-11a194941c47 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:16.960779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299c111-fb43-4130-9459-c43029933df2 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: Authorizing `identity:check_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:16.967874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6299c111-fb43-4130-9459-c43029933df2 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:16.981476 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3198/6355] 10.222.0.43 () {56 vars in 1264 bytes} [Tue Aug 30 04:45:16 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Aug 30 04:45:16.989191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299c111-fb43-4130-9459-c43029933df2 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:17.033212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299c111-fb43-4130-9459-c43029933df2 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:17.038114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3158/6356] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:16 2022] PUT /identity/v3/roles/269243cf4019424999f7dc3585b172d1/implies/5a5c4f176bde47a3b68319ff10af1384 => generated 520 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:17.039789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333466-4321-4bdc-9909-11a194941c47 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:17.045427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-56333466-4321-4bdc-9909-11a194941c47 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:17.196443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:17.207379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3588a-85f4-4742-a766-16296590490c tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75154528a5934c5b847f2216f45c2a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0f15bf92f34a2e83a08d6185fb3718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:17.208435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3588a-85f4-4742-a766-16296590490c tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:17.208928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3588a-85f4-4742-a766-16296590490c tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:17.210061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3588a-85f4-4742-a766-16296590490c tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:17.228783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3588a-85f4-4742-a766-16296590490c tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:17.236592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3588a-85f4-4742-a766-16296590490c tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:17.257601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:17.259518 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3199/6357] 10.222.0.43 () {56 vars in 1263 bytes} [Tue Aug 30 04:45:16 2022] GET /identity/v3/auth/tokens => generated 344 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:17.260628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3588a-85f4-4742-a766-16296590490c tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:17.319243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56333466-4321-4bdc-9909-11a194941c47 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:17.325303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:17.325982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:17.326260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:17.326589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] PATH_INFO: `/v3/projects/1d5629c344f04c56a319e5f663bb9bea` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:17.327676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5629c344f04c56a319e5f663bb9bea)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:17.329655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:17.376842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3588a-85f4-4742-a766-16296590490c tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:17.393897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85d76d-9f1b-42e5-b9c3-bec87141d838 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:17.396546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85d76d-9f1b-42e5-b9c3-bec87141d838 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:17.397210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85d76d-9f1b-42e5-b9c3-bec87141d838 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:17.397695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85d76d-9f1b-42e5-b9c3-bec87141d838 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:17.399006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85d76d-9f1b-42e5-b9c3-bec87141d838 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:17.403834 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-4c85d76d-9f1b-42e5-b9c3-bec87141d838 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:17.403834 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:45:17.403834 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:45:17.405178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85d76d-9f1b-42e5-b9c3-bec87141d838 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:17.435343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5629c344f04c56a319e5f663bb9bea', 'request_id': 'req-9e705c66-851f-44fa-a403-642cfe4c761a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:17.447767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5629c344f04c56a319e5f663bb9bea', 'request_id': 'req-9e705c66-851f-44fa-a403-642cfe4c761a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:17.453906 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3200/6358] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Aug 30 04:45:17 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:17.455841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85d76d-9f1b-42e5-b9c3-bec87141d838 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:17.459978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5629c344f04c56a319e5f663bb9bea', 'request_id': 'req-9e705c66-851f-44fa-a403-642cfe4c761a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:17.482802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85d76d-9f1b-42e5-b9c3-bec87141d838 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:17.488806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] The token cache is being invalidate because project 1d5629c344f04c56a319e5f663bb9bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:17.489103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:17.498434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:17.500674 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3159/6359] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:17 2022] DELETE /identity/v3/projects/1d5629c344f04c56a319e5f663bb9bea => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:17.501866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:17.503541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:17.594052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699c95c-0b2c-43c4-b421-ed531dd73355 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75154528a5934c5b847f2216f45c2a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0f15bf92f34a2e83a08d6185fb3718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:17.594742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699c95c-0b2c-43c4-b421-ed531dd73355 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:17.597469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699c95c-0b2c-43c4-b421-ed531dd73355 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:17.597821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699c95c-0b2c-43c4-b421-ed531dd73355 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:17.603053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a699c95c-0b2c-43c4-b421-ed531dd73355 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:17.619644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699c95c-0b2c-43c4-b421-ed531dd73355 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:17.621536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699c95c-0b2c-43c4-b421-ed531dd73355 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:17.679117 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3201/6360] 10.222.0.43 () {56 vars in 1266 bytes} [Tue Aug 30 04:45:17 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:17.680731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3865-8457-412a-aa6a-19050bbb393d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:17.681049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3865-8457-412a-aa6a-19050bbb393d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:17.681325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3865-8457-412a-aa6a-19050bbb393d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:17.688517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e705c66-851f-44fa-a403-642cfe4c761a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:17.698386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6722bb-2863-4024-ac8b-cd8227c25042 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:17.699436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6722bb-2863-4024-ac8b-cd8227c25042 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:17.699975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6722bb-2863-4024-ac8b-cd8227c25042 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:17.700440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6722bb-2863-4024-ac8b-cd8227c25042 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/269243cf4019424999f7dc3585b172d1/implies/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:17.711490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6722bb-2863-4024-ac8b-cd8227c25042 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=269243cf4019424999f7dc3585b172d1, implied_role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:17.713723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6722bb-2863-4024-ac8b-cd8227c25042 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:17.729310 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3160/6361] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:17 2022] DELETE /identity/v3/roles/269243cf4019424999f7dc3585b172d1/implies/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:17.730789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6722bb-2863-4024-ac8b-cd8227c25042 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:17.733839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0d8d3865-8457-412a-aa6a-19050bbb393d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:17.734125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9a6722bb-2863-4024-ac8b-cd8227c25042 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:17.740735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0d8d3865-8457-412a-aa6a-19050bbb393d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:17.872893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6722bb-2863-4024-ac8b-cd8227c25042 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:17.877862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06107d3-98e6-4cd9-921e-cf44e5fdcf9b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75154528a5934c5b847f2216f45c2a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0f15bf92f34a2e83a08d6185fb3718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:17.878629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06107d3-98e6-4cd9-921e-cf44e5fdcf9b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:17.879265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06107d3-98e6-4cd9-921e-cf44e5fdcf9b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:17.879769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06107d3-98e6-4cd9-921e-cf44e5fdcf9b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:17.891564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c06107d3-98e6-4cd9-921e-cf44e5fdcf9b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:17.917016 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3202/6362] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:17.918428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3865-8457-412a-aa6a-19050bbb393d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-c06107d3-98e6-4cd9-921e-cf44e5fdcf9b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 30 04:45:17.928902 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 30 04:45:17.929924 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 30 04:45:17.930834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:17.930834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:17.930834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 30 04:45:17.930834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 30 04:45:17.930834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 30 04:45:17.930834 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:17.931765 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3161/6363] 10.222.0.43 () {56 vars in 1264 bytes} [Tue Aug 30 04:45:17 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Aug 30 04:45:17.932649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6dd22-6f51-496a-9bfb-765fb95388f8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:17.932934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6dd22-6f51-496a-9bfb-765fb95388f8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:17.933204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6dd22-6f51-496a-9bfb-765fb95388f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:17.961484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:17.982776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ddd6dd22-6f51-496a-9bfb-765fb95388f8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:17.987561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ddd6dd22-6f51-496a-9bfb-765fb95388f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:18.024881 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3162/6364] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:18.026631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18e2d-a513-4167-8421-cd2de75f761d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:18.028935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18e2d-a513-4167-8421-cd2de75f761d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:18.030129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18e2d-a513-4167-8421-cd2de75f761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:18.112698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-53f18e2d-a513-4167-8421-cd2de75f761d None None] MFA Rules not processed for user `75154528a5934c5b847f2216f45c2a89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:18.114304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-53f18e2d-a513-4167-8421-cd2de75f761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:18.123183 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3163/6365] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:18 2022] POST /identity/v3/auth/tokens => generated 344 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:45:18.124162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f18e2d-a513-4167-8421-cd2de75f761d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:18.141488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3865-8457-412a-aa6a-19050bbb393d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:18.142918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:18.148527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812779ac-0d8d-4485-872f-64d1e2dd3523 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:18.149910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812779ac-0d8d-4485-872f-64d1e2dd3523 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:18.150335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812779ac-0d8d-4485-872f-64d1e2dd3523 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:18.150884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812779ac-0d8d-4485-872f-64d1e2dd3523 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/269243cf4019424999f7dc3585b172d1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:18.152912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812779ac-0d8d-4485-872f-64d1e2dd3523 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=269243cf4019424999f7dc3585b172d1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:18.155307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812779ac-0d8d-4485-872f-64d1e2dd3523 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:18.155860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f18e2d-a513-4167-8421-cd2de75f761d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:18.167275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af0f92-0f0d-4ea4-91cd-3c473cda5703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:18.167911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af0f92-0f0d-4ea4-91cd-3c473cda5703 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:18.168192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af0f92-0f0d-4ea4-91cd-3c473cda5703 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:18.168460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af0f92-0f0d-4ea4-91cd-3c473cda5703 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:18.172003 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3203/6366] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:17 2022] DELETE /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/269243cf4019424999f7dc3585b172d1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:18.173372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812779ac-0d8d-4485-872f-64d1e2dd3523 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:18.176249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af0f92-0f0d-4ea4-91cd-3c473cda5703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:18.177205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af0f92-0f0d-4ea4-91cd-3c473cda5703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:18.182350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af0f92-0f0d-4ea4-91cd-3c473cda5703 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:18.230107 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3164/6367] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:18.236318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af0f92-0f0d-4ea4-91cd-3c473cda5703 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:18.290067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af0f92-0f0d-4ea4-91cd-3c473cda5703 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:18.444039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f92f3-f7e1-469f-858b-3533a6930e68 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:18.444875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812779ac-0d8d-4485-872f-64d1e2dd3523 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:18.446641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f92f3-f7e1-469f-858b-3533a6930e68 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:18.447097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f92f3-f7e1-469f-858b-3533a6930e68 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:18.447571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f92f3-f7e1-469f-858b-3533a6930e68 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:18.450330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06dd8f-1964-4638-84e8-4bd9c53250d9 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75154528a5934c5b847f2216f45c2a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0f15bf92f34a2e83a08d6185fb3718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:18.451205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06dd8f-1964-4638-84e8-4bd9c53250d9 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:18.451578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06dd8f-1964-4638-84e8-4bd9c53250d9 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:18.451973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06dd8f-1964-4638-84e8-4bd9c53250d9 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:18.452452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f92f3-f7e1-469f-858b-3533a6930e68 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:18.458311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f92f3-f7e1-469f-858b-3533a6930e68 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:18.461812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06dd8f-1964-4638-84e8-4bd9c53250d9 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:18.463808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06dd8f-1964-4638-84e8-4bd9c53250d9 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:18.476723 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3204/6368] 10.222.0.43 () {56 vars in 1263 bytes} [Tue Aug 30 04:45:18 2022] GET /identity/v3/auth/tokens => generated 344 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:18.476723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06dd8f-1964-4638-84e8-4bd9c53250d9 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:18.482603 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3165/6369] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:18 2022] DELETE /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:18.484758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f92f3-f7e1-469f-858b-3533a6930e68 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:18.585287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06dd8f-1964-4638-84e8-4bd9c53250d9 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:18.623627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f92f3-f7e1-469f-858b-3533a6930e68 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:18.633525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c1c7e-25ee-4932-8509-81687091df7b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75154528a5934c5b847f2216f45c2a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0f15bf92f34a2e83a08d6185fb3718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:18.643958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c1c7e-25ee-4932-8509-81687091df7b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:18.644275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c1c7e-25ee-4932-8509-81687091df7b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:18.644685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c1c7e-25ee-4932-8509-81687091df7b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:18.657222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:18.662928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c1c7e-25ee-4932-8509-81687091df7b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:18.664880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c1c7e-25ee-4932-8509-81687091df7b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:18.690195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16123e97-5da3-48cf-9ec4-d699d41e2fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:18.695598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16123e97-5da3-48cf-9ec4-d699d41e2fed admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:18.696786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16123e97-5da3-48cf-9ec4-d699d41e2fed admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:18.697140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16123e97-5da3-48cf-9ec4-d699d41e2fed admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:18.699463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16123e97-5da3-48cf-9ec4-d699d41e2fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:18.704209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16123e97-5da3-48cf-9ec4-d699d41e2fed admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:18.709076 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3166/6370] 10.222.0.43 () {56 vars in 1266 bytes} [Tue Aug 30 04:45:18 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:18.709896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c1c7e-25ee-4932-8509-81687091df7b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:18.794144 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3205/6371] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:18 2022] POST /identity/v3/projects => generated 365 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:18.794144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16123e97-5da3-48cf-9ec4-d699d41e2fed admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:18.863220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c1c7e-25ee-4932-8509-81687091df7b tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:18.932832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:18.945289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16123e97-5da3-48cf-9ec4-d699d41e2fed admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:18.959516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9d676-37fe-4a60-b231-7b26c5ed4e78 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75154528a5934c5b847f2216f45c2a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0f15bf92f34a2e83a08d6185fb3718', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:18.960547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9d676-37fe-4a60-b231-7b26c5ed4e78 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:18.960832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9d676-37fe-4a60-b231-7b26c5ed4e78 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:18.961143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9d676-37fe-4a60-b231-7b26c5ed4e78 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:18.963310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-38e9d676-37fe-4a60-b231-7b26c5ed4e78 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-38e9d676-37fe-4a60-b231-7b26c5ed4e78 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 30 04:45:18.988666 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 30 04:45:18.990000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 30 04:45:18.990997 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:18.990997 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:18.990997 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 30 04:45:18.990997 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 30 04:45:18.990997 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 30 04:45:18.990997 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:45:18.993112 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3206/6372] 10.222.0.43 () {56 vars in 1263 bytes} [Tue Aug 30 04:45:18 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:45:18.993983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9d676-37fe-4a60-b231-7b26c5ed4e78 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:19.002956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5881b-b58e-4cc5-b6f7-a0227c29a56f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:19.004349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5881b-b58e-4cc5-b6f7-a0227c29a56f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:19.005370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5881b-b58e-4cc5-b6f7-a0227c29a56f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:19.013847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5881b-b58e-4cc5-b6f7-a0227c29a56f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:19.015037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5881b-b58e-4cc5-b6f7-a0227c29a56f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:19.016949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5881b-b58e-4cc5-b6f7-a0227c29a56f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:19.034565 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3167/6373] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:18 2022] GET /identity/v3/roles => generated 2321 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:19.036153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5881b-b58e-4cc5-b6f7-a0227c29a56f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:19.040977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8a5881b-b58e-4cc5-b6f7-a0227c29a56f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:19.135114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9d676-37fe-4a60-b231-7b26c5ed4e78 tempest-TokensV3Test-16340251 tempest-TokensV3Test-16340251-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:19.142070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a184b-1929-4939-aec4-41394deb1062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:19.144243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a184b-1929-4939-aec4-41394deb1062 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:19.145051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a184b-1929-4939-aec4-41394deb1062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:19.145643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a184b-1929-4939-aec4-41394deb1062 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:19.146530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a184b-1929-4939-aec4-41394deb1062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:19.149468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a184b-1929-4939-aec4-41394deb1062 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:19.160218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5881b-b58e-4cc5-b6f7-a0227c29a56f tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:19.165721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:19.166765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:19.167109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:19.167485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] PATH_INFO: `/v3/users/75154528a5934c5b847f2216f45c2a89` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:19.168918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=75154528a5934c5b847f2216f45c2a89)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:19.171034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:19.213760 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3207/6374] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:18 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:19.213972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a184b-1929-4939-aec4-41394deb1062 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:19.254553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a184b-1929-4939-aec4-41394deb1062 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:19.264807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65398f68-4fea-4d10-99da-55c0799dfd57 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:19.265431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398f68-4fea-4d10-99da-55c0799dfd57 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:19.270055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398f68-4fea-4d10-99da-55c0799dfd57 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:19.270055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65398f68-4fea-4d10-99da-55c0799dfd57 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:19.270055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65398f68-4fea-4d10-99da-55c0799dfd57 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:19.270055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65398f68-4fea-4d10-99da-55c0799dfd57 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:19.313055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75154528a5934c5b847f2216f45c2a89'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:19.318191 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3208/6375] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:45:19 2022] POST /identity/v3/roles => generated 235 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:19.320072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65398f68-4fea-4d10-99da-55c0799dfd57 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:19.326742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-65398f68-4fea-4d10-99da-55c0799dfd57 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:19.331037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75154528a5934c5b847f2216f45c2a89'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:19.356779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65398f68-4fea-4d10-99da-55c0799dfd57 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:19.358658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75154528a5934c5b847f2216f45c2a89'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:19.367933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:19.368762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:19.369170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:19.369478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] PATH_INFO: `/v3/users/c43c7be873304f56aada25c2911d55cd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:19.370767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43c7be873304f56aada25c2911d55cd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:19.373112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75154528a5934c5b847f2216f45c2a89'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:19.373755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75154528a5934c5b847f2216f45c2a89'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:19.375130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:19.384922 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3168/6376] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:19 2022] DELETE /identity/v3/users/75154528a5934c5b847f2216f45c2a89 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:19.386438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:19.389539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:19.462397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:19.485753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43c7be873304f56aada25c2911d55cd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:19.487708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43c7be873304f56aada25c2911d55cd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:19.502134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:19.505371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d1e12-dfc9-4786-ac4a-c1e021dee0cf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:19.507916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43c7be873304f56aada25c2911d55cd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:19.517618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e39710-b72c-4966-90e9-e6b4a374939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:19.518337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e39710-b72c-4966-90e9-e6b4a374939d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:19.519286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e39710-b72c-4966-90e9-e6b4a374939d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:19.520139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e39710-b72c-4966-90e9-e6b4a374939d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:19.520673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43c7be873304f56aada25c2911d55cd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:19.524261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e39710-b72c-4966-90e9-e6b4a374939d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:19.530434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e39710-b72c-4966-90e9-e6b4a374939d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:19.546241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43c7be873304f56aada25c2911d55cd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:19.558715 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3209/6377] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:19 2022] DELETE /identity/v3/users/c43c7be873304f56aada25c2911d55cd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:19.558715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:19.558715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:19.566732 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3169/6378] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:19 2022] GET /identity/v3/roles => generated 2547 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:19.571038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167f27f-af6e-40fa-be7d-d52cae1f3652 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:19.571439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167f27f-af6e-40fa-be7d-d52cae1f3652 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:19.571978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167f27f-af6e-40fa-be7d-d52cae1f3652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:19.655422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8167f27f-af6e-40fa-be7d-d52cae1f3652 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:19.658623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f31b2-4575-4830-a68d-4d929f4a3aed admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:19.660719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8167f27f-af6e-40fa-be7d-d52cae1f3652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:19.671652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ce47e-71f5-49a9-b279-7f81aea33999 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:19.685638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ce47e-71f5-49a9-b279-7f81aea33999 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:19.687848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ce47e-71f5-49a9-b279-7f81aea33999 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:19.688362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ce47e-71f5-49a9-b279-7f81aea33999 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/67f69a9ee1d14c418bba6e1adf8853f2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:19.697334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ce47e-71f5-49a9-b279-7f81aea33999 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:update_role(role_id=67f69a9ee1d14c418bba6e1adf8853f2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:19.700156 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-fc8ce47e-71f5-49a9-b279-7f81aea33999 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:19.700156 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:45:19.700156 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:45:19.701516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ce47e-71f5-49a9-b279-7f81aea33999 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:19.774823 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3210/6379] 10.222.0.43 () {60 vars in 1243 bytes} [Tue Aug 30 04:45:19 2022] PATCH /identity/v3/roles/67f69a9ee1d14c418bba6e1adf8853f2 => generated 238 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:19.774823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a5da3-28cf-40d4-a83e-25d99fa29a70 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:19.774823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a5da3-28cf-40d4-a83e-25d99fa29a70 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:19.774823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a5da3-28cf-40d4-a83e-25d99fa29a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:19.823333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-840a5da3-28cf-40d4-a83e-25d99fa29a70 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:19.824548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-840a5da3-28cf-40d4-a83e-25d99fa29a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:19.847410 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3170/6380] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:19.849749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167f27f-af6e-40fa-be7d-d52cae1f3652 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:19.853198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8167f27f-af6e-40fa-be7d-d52cae1f3652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:19.882078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167f27f-af6e-40fa-be7d-d52cae1f3652 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:19.898778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f648e-fd81-4bfe-8df6-50cbd6b659ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:19.900553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f648e-fd81-4bfe-8df6-50cbd6b659ce admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:19.900909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f648e-fd81-4bfe-8df6-50cbd6b659ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:19.901399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f648e-fd81-4bfe-8df6-50cbd6b659ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:19.904208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f648e-fd81-4bfe-8df6-50cbd6b659ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:19.925453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f648e-fd81-4bfe-8df6-50cbd6b659ce admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:19.955744 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3171/6381] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:19 2022] GET /identity/v3/roles => generated 2550 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:19.957693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f648e-fd81-4bfe-8df6-50cbd6b659ce admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:19.987257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f648e-fd81-4bfe-8df6-50cbd6b659ce admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:19.995026 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3211/6382] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:19.995974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a5da3-28cf-40d4-a83e-25d99fa29a70 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:19.999926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905c507-b2f2-4fb3-b7cd-36fb654532ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:20.003991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c507-b2f2-4fb3-b7cd-36fb654532ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.004369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c507-b2f2-4fb3-b7cd-36fb654532ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.004851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c507-b2f2-4fb3-b7cd-36fb654532ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/67f69a9ee1d14c418bba6e1adf8853f2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.006036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-840a5da3-28cf-40d4-a83e-25d99fa29a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:20.020882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905c507-b2f2-4fb3-b7cd-36fb654532ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:get_role(role_id=67f69a9ee1d14c418bba6e1adf8853f2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:20.022032 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-1905c507-b2f2-4fb3-b7cd-36fb654532ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:20.022032 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:20.022032 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:20.025809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1905c507-b2f2-4fb3-b7cd-36fb654532ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:20.029204 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3172/6383] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:45:19 2022] GET /identity/v3/roles/67f69a9ee1d14c418bba6e1adf8853f2 => generated 238 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:20.029972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905c507-b2f2-4fb3-b7cd-36fb654532ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:20.046366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905c507-b2f2-4fb3-b7cd-36fb654532ff tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:20.054520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accf331-6392-43d2-99b9-5a9822aaaacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:20.055540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accf331-6392-43d2-99b9-5a9822aaaacc admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.056299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accf331-6392-43d2-99b9-5a9822aaaacc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.056768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accf331-6392-43d2-99b9-5a9822aaaacc admin admin] PATH_INFO: `/v3/projects/7c3af38aa4f34d498028d69d5bd0a7bb/users/6d4d9f2123e84a76a91e27cda159ab7b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.095846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accf331-6392-43d2-99b9-5a9822aaaacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3af38aa4f34d498028d69d5bd0a7bb, user_id=6d4d9f2123e84a76a91e27cda159ab7b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:20.100740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accf331-6392-43d2-99b9-5a9822aaaacc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:20.126451 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3173/6384] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:20 2022] PUT /identity/v3/projects/7c3af38aa4f34d498028d69d5bd0a7bb/users/6d4d9f2123e84a76a91e27cda159ab7b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:20.127331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accf331-6392-43d2-99b9-5a9822aaaacc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:20.152538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a5da3-28cf-40d4-a83e-25d99fa29a70 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:20.167880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:20.253707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085d931-61d0-4c2e-9e1a-080dbc690725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:20.254507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085d931-61d0-4c2e-9e1a-080dbc690725 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.255493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085d931-61d0-4c2e-9e1a-080dbc690725 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.255791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085d931-61d0-4c2e-9e1a-080dbc690725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.299044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accf331-6392-43d2-99b9-5a9822aaaacc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:20.303579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b94a52-2684-4ff2-80f9-edcdb0e07e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:20.304390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b94a52-2684-4ff2-80f9-edcdb0e07e74 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.304669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b94a52-2684-4ff2-80f9-edcdb0e07e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.304944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b94a52-2684-4ff2-80f9-edcdb0e07e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.359308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:20.374812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085d931-61d0-4c2e-9e1a-080dbc690725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:20.376290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085d931-61d0-4c2e-9e1a-080dbc690725 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:20.389788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b94a52-2684-4ff2-80f9-edcdb0e07e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:20.391534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b94a52-2684-4ff2-80f9-edcdb0e07e74 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:20.394936 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3212/6385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:20.396079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085d931-61d0-4c2e-9e1a-080dbc690725 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:20.404718 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3174/6386] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:20.406485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba473148-764c-44ff-ab86-c44bb8214ff9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.406914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba473148-764c-44ff-ab86-c44bb8214ff9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.407366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba473148-764c-44ff-ab86-c44bb8214ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.444457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ba473148-764c-44ff-ab86-c44bb8214ff9 None None] MFA Rules not processed for user `6d4d9f2123e84a76a91e27cda159ab7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:20.446206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ba473148-764c-44ff-ab86-c44bb8214ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:20.549745 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3175/6387] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:20.550962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba473148-764c-44ff-ab86-c44bb8214ff9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:20.553953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ba473148-764c-44ff-ab86-c44bb8214ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:20.559019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085d931-61d0-4c2e-9e1a-080dbc690725 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:20.579655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fd5d3-fd59-4630-984a-5e4544a402b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:20.580682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fd5d3-fd59-4630-984a-5e4544a402b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.581167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fd5d3-fd59-4630-984a-5e4544a402b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.581642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fd5d3-fd59-4630-984a-5e4544a402b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.582990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fd5d3-fd59-4630-984a-5e4544a402b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:20.585008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fd5d3-fd59-4630-984a-5e4544a402b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:20.586053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba473148-764c-44ff-ab86-c44bb8214ff9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:20.594285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:20.594960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.595293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.595565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] PATH_INFO: `/v3/users/18ec86bd7e1c4a1cafcc195a6a16787b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.597326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ec86bd7e1c4a1cafcc195a6a16787b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:20.600194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:20.610828 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3213/6388] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:20 2022] GET /identity/v3/roles => generated 2550 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:20.612102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fd5d3-fd59-4630-984a-5e4544a402b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:20.626422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fd5d3-fd59-4630-984a-5e4544a402b5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:20.634703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a16018-58f3-4031-9bc7-028082662d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:20.636740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a16018-58f3-4031-9bc7-028082662d52 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.637535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a16018-58f3-4031-9bc7-028082662d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.638125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a16018-58f3-4031-9bc7-028082662d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.639307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a16018-58f3-4031-9bc7-028082662d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:20.642370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a16018-58f3-4031-9bc7-028082662d52 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:20.681487 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3214/6389] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:20 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:20.682674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a16018-58f3-4031-9bc7-028082662d52 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:20.688627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ec86bd7e1c4a1cafcc195a6a16787b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:20.710585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ec86bd7e1c4a1cafcc195a6a16787b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:20.741575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:20.741824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ec86bd7e1c4a1cafcc195a6a16787b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:20.760887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ec86bd7e1c4a1cafcc195a6a16787b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:20.761621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ec86bd7e1c4a1cafcc195a6a16787b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:20.770665 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3176/6390] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:20 2022] DELETE /identity/v3/users/18ec86bd7e1c4a1cafcc195a6a16787b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:20.771710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:20.773359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:20.785404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a16018-58f3-4031-9bc7-028082662d52 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:20.838956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:20.871006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:20.871667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.871948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.872608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/67f69a9ee1d14c418bba6e1adf8853f2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.877832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_role(role_id=67f69a9ee1d14c418bba6e1adf8853f2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:20.883835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:20.885350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60596032-8eba-47c8-a555-add27bebddda admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:20.897611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35631fa4-06d5-4cdd-b385-20c292cb94c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:20.900119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35631fa4-06d5-4cdd-b385-20c292cb94c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.900398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35631fa4-06d5-4cdd-b385-20c292cb94c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.900669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35631fa4-06d5-4cdd-b385-20c292cb94c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.901340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35631fa4-06d5-4cdd-b385-20c292cb94c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:20.906351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35631fa4-06d5-4cdd-b385-20c292cb94c0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:20.962463 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3177/6391] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:20 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:20.962463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156130a-d9a3-45d6-9114-84fdef0b0daf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:20.962463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156130a-d9a3-45d6-9114-84fdef0b0daf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:20.962463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156130a-d9a3-45d6-9114-84fdef0b0daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:20.979078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 67f69a9ee1d14c418bba6e1adf8853f2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:20.979078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:20.979915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:20.985890 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3215/6392] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:20 2022] DELETE /identity/v3/roles/67f69a9ee1d14c418bba6e1adf8853f2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:20.985890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:20.986756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:20.991926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c156130a-d9a3-45d6-9114-84fdef0b0daf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:20.993564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c156130a-d9a3-45d6-9114-84fdef0b0daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:21.152399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087a9d0-c6b2-4e77-bc58-e3416b5e5478 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:21.156628 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3178/6393] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:21.157654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156130a-d9a3-45d6-9114-84fdef0b0daf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:21.159660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c156130a-d9a3-45d6-9114-84fdef0b0daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:21.171108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f48f0-c580-4453-8a4e-3b25c7603619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:21.171745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f48f0-c580-4453-8a4e-3b25c7603619 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:21.172835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f48f0-c580-4453-8a4e-3b25c7603619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:21.173120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f48f0-c580-4453-8a4e-3b25c7603619 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:21.176639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f48f0-c580-4453-8a4e-3b25c7603619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:21.181188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f48f0-c580-4453-8a4e-3b25c7603619 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:21.203571 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3216/6394] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:20 2022] GET /identity/v3/roles => generated 2321 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:21.204553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f48f0-c580-4453-8a4e-3b25c7603619 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:21.209430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-367f48f0-c580-4453-8a4e-3b25c7603619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:21.232783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f48f0-c580-4453-8a4e-3b25c7603619 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:21.240210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:21.241025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:21.241616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:21.241947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] PATH_INFO: `/v3/projects/b00920ca855b4d0a83ce8fb7593d49e1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:21.245196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00920ca855b4d0a83ce8fb7593d49e1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:21.247990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:21.260012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156130a-d9a3-45d6-9114-84fdef0b0daf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:21.266575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d700006-ae32-4ff8-ba4d-63dc87128ce3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:21.267624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d700006-ae32-4ff8-ba4d-63dc87128ce3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:21.268052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d700006-ae32-4ff8-ba4d-63dc87128ce3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:21.268496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d700006-ae32-4ff8-ba4d-63dc87128ce3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:21.279426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d700006-ae32-4ff8-ba4d-63dc87128ce3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:21.281271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d700006-ae32-4ff8-ba4d-63dc87128ce3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:21.316547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:21.336094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00920ca855b4d0a83ce8fb7593d49e1', 'request_id': 'req-27bb635a-fc2d-45c1-9387-f9773336f2f4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:21.345024 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3179/6395] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:21 2022] PUT /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 519 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:21.346240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d700006-ae32-4ff8-ba4d-63dc87128ce3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:21.348705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00920ca855b4d0a83ce8fb7593d49e1', 'request_id': 'req-27bb635a-fc2d-45c1-9387-f9773336f2f4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:21.348906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4d700006-ae32-4ff8-ba4d-63dc87128ce3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:21.360490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00920ca855b4d0a83ce8fb7593d49e1', 'request_id': 'req-27bb635a-fc2d-45c1-9387-f9773336f2f4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:21.377146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] The token cache is being invalidate because project b00920ca855b4d0a83ce8fb7593d49e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:21.378247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:21.379946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:21.383817 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3217/6396] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:21 2022] DELETE /identity/v3/projects/b00920ca855b4d0a83ce8fb7593d49e1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:21.385401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:21.387880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:21.478128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:21.494374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d700006-ae32-4ff8-ba4d-63dc87128ce3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:21.503681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:21.505238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:21.505890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:21.507553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] PATH_INFO: `/v3/users/a650049c10c141179fce37056391efb1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:21.510384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a650049c10c141179fce37056391efb1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:21.512687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:21.534726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb635a-fc2d-45c1-9387-f9773336f2f4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:21.606734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a650049c10c141179fce37056391efb1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:21.625432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a650049c10c141179fce37056391efb1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:21.655068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2fbd5-0e39-4733-85cf-992728274665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:21.656947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a650049c10c141179fce37056391efb1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:21.659180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2fbd5-0e39-4733-85cf-992728274665 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:21.659782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2fbd5-0e39-4733-85cf-992728274665 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:21.660205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2fbd5-0e39-4733-85cf-992728274665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:21.665862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bfa2fbd5-0e39-4733-85cf-992728274665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:21.684439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a650049c10c141179fce37056391efb1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:21.684439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a650049c10c141179fce37056391efb1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:21.686881 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3180/6397] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:21 2022] DELETE /identity/v3/users/a650049c10c141179fce37056391efb1 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:21.687900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:21.690543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:21.694748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2fbd5-0e39-4733-85cf-992728274665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:21.696279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2fbd5-0e39-4733-85cf-992728274665 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:21.709434 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3218/6398] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:21.711287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2fbd5-0e39-4733-85cf-992728274665 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:21.712717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bfa2fbd5-0e39-4733-85cf-992728274665 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:21.773571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9fa0e-b531-4b41-b527-0c3c38c091d7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:21.779127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e022ea-b324-475e-b511-ad50fb4ccbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:21.783079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e022ea-b324-475e-b511-ad50fb4ccbb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:21.783523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e022ea-b324-475e-b511-ad50fb4ccbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:21.783907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e022ea-b324-475e-b511-ad50fb4ccbb0 admin admin] PATH_INFO: `/v3/projects/663938bbe2294a10befe69e94d082cab/users/e2d81536a2a04f75a56bc15ed3203786/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:21.802144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e022ea-b324-475e-b511-ad50fb4ccbb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663938bbe2294a10befe69e94d082cab, user_id=e2d81536a2a04f75a56bc15ed3203786, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:21.805217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e022ea-b324-475e-b511-ad50fb4ccbb0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:21.826050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2fbd5-0e39-4733-85cf-992728274665 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:21.838671 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3181/6399] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:21 2022] PUT /identity/v3/projects/663938bbe2294a10befe69e94d082cab/users/e2d81536a2a04f75a56bc15ed3203786/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:21.841713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa772e07-2b0e-4ac5-ac3c-f8f2da8f7ee8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:21.842279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa772e07-2b0e-4ac5-ac3c-f8f2da8f7ee8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:21.842627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa772e07-2b0e-4ac5-ac3c-f8f2da8f7ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:21.867334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:21.893288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fa772e07-2b0e-4ac5-ac3c-f8f2da8f7ee8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:21.896977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fa772e07-2b0e-4ac5-ac3c-f8f2da8f7ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:21.937950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355669-a874-49fe-844c-a395eac22bc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:21.938735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355669-a874-49fe-844c-a395eac22bc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:21.939108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355669-a874-49fe-844c-a395eac22bc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:21.939456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23355669-a874-49fe-844c-a395eac22bc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/269243cf4019424999f7dc3585b172d1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:21.945619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23355669-a874-49fe-844c-a395eac22bc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=269243cf4019424999f7dc3585b172d1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:21.947721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23355669-a874-49fe-844c-a395eac22bc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:22.001142 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3219/6400] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:21 2022] PUT /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/269243cf4019424999f7dc3585b172d1 => generated 520 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:22.007376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355669-a874-49fe-844c-a395eac22bc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:22.012468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-23355669-a874-49fe-844c-a395eac22bc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.029148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:22.054687 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3182/6401] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:22.056557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ed4c4-f5d1-4e18-969b-5c2df463ba10 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.056870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ed4c4-f5d1-4e18-969b-5c2df463ba10 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.057142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ed4c4-f5d1-4e18-969b-5c2df463ba10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.101839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-378ed4c4-f5d1-4e18-969b-5c2df463ba10 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:22.103396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-378ed4c4-f5d1-4e18-969b-5c2df463ba10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.153554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23355669-a874-49fe-844c-a395eac22bc9 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:22.167154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:22.167870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.168151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.168437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] PATH_INFO: `/v3/projects/3a0f15bf92f34a2e83a08d6185fb3718` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.174070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0f15bf92f34a2e83a08d6185fb3718)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:22.176969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:22.211198 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3183/6402] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:22.228265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ed4c4-f5d1-4e18-969b-5c2df463ba10 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:22.240249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ed4c4-f5d1-4e18-969b-5c2df463ba10 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:22.246247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27510c64-13f2-4a64-8ead-1a5389cabba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:22.247050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27510c64-13f2-4a64-8ead-1a5389cabba7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.247335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27510c64-13f2-4a64-8ead-1a5389cabba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.247978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27510c64-13f2-4a64-8ead-1a5389cabba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.248296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27510c64-13f2-4a64-8ead-1a5389cabba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:22.250189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27510c64-13f2-4a64-8ead-1a5389cabba7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:22.270091 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3184/6403] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:22 2022] GET /identity/v3/roles => generated 2321 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:22.270992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27510c64-13f2-4a64-8ead-1a5389cabba7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:22.272714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-27510c64-13f2-4a64-8ead-1a5389cabba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.294135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0f15bf92f34a2e83a08d6185fb3718', 'request_id': 'req-93aa797d-55ee-4bfd-8935-43256552680c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:22.307213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0f15bf92f34a2e83a08d6185fb3718', 'request_id': 'req-93aa797d-55ee-4bfd-8935-43256552680c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:22.321768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0f15bf92f34a2e83a08d6185fb3718', 'request_id': 'req-93aa797d-55ee-4bfd-8935-43256552680c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:22.354560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] The token cache is being invalidate because project 3a0f15bf92f34a2e83a08d6185fb3718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:22.355659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:22.359416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:22.362652 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3220/6404] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:22 2022] DELETE /identity/v3/projects/3a0f15bf92f34a2e83a08d6185fb3718 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:22.364788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:22.368387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27510c64-13f2-4a64-8ead-1a5389cabba7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:22.369977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.465566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dad32-a19a-4c56-96d5-8989c75e7e67 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:22.466195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dad32-a19a-4c56-96d5-8989c75e7e67 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.466477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dad32-a19a-4c56-96d5-8989c75e7e67 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.466753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dad32-a19a-4c56-96d5-8989c75e7e67 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/269243cf4019424999f7dc3585b172d1/implies/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.468837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dad32-a19a-4c56-96d5-8989c75e7e67 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=269243cf4019424999f7dc3585b172d1, implied_role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:22.470719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7dad32-a19a-4c56-96d5-8989c75e7e67 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:22.475325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:22.498446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa797d-55ee-4bfd-8935-43256552680c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:22.505050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:22.506312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.506748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.507124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] PATH_INFO: `/v3/projects/27d3b0718baf46b5a475337001ca7457` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.508494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d3b0718baf46b5a475337001ca7457)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:22.510992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:22.530439 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3185/6405] 10.222.0.43 () {60 vars in 1363 bytes} [Tue Aug 30 04:45:22 2022] PUT /identity/v3/roles/269243cf4019424999f7dc3585b172d1/implies/5a5c4f176bde47a3b68319ff10af1384 => generated 520 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:22.532660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1547f-7f89-4ab0-a95a-bd8e14d112bf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.533604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1547f-7f89-4ab0-a95a-bd8e14d112bf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.535731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1547f-7f89-4ab0-a95a-bd8e14d112bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.573388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-04f1547f-7f89-4ab0-a95a-bd8e14d112bf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:22.575043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-04f1547f-7f89-4ab0-a95a-bd8e14d112bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.591376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:22.596815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d3b0718baf46b5a475337001ca7457', 'request_id': 'req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:22.604633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d3b0718baf46b5a475337001ca7457', 'request_id': 'req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:22.615845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d3b0718baf46b5a475337001ca7457', 'request_id': 'req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:22.642634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] The token cache is being invalidate because project 27d3b0718baf46b5a475337001ca7457 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:22.644010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:22.645169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:22.650525 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3221/6406] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:22 2022] DELETE /identity/v3/projects/27d3b0718baf46b5a475337001ca7457 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:22.651991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:22.653666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.690562 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3186/6407] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:22.694197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1547f-7f89-4ab0-a95a-bd8e14d112bf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:22.694197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-04f1547f-7f89-4ab0-a95a-bd8e14d112bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.708018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1547f-7f89-4ab0-a95a-bd8e14d112bf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:22.713211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b297803-982b-4f4c-9973-cae3c20199ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:22.714110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297803-982b-4f4c-9973-cae3c20199ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.714602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297803-982b-4f4c-9973-cae3c20199ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.714918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b297803-982b-4f4c-9973-cae3c20199ef admin admin] PATH_INFO: `/v3/projects/663938bbe2294a10befe69e94d082cab/users/e2d81536a2a04f75a56bc15ed3203786/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.717855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b297803-982b-4f4c-9973-cae3c20199ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=663938bbe2294a10befe69e94d082cab, user_id=e2d81536a2a04f75a56bc15ed3203786, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:22.720893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b297803-982b-4f4c-9973-cae3c20199ef admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:22.757936 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3187/6408] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:22 2022] PUT /identity/v3/projects/663938bbe2294a10befe69e94d082cab/users/e2d81536a2a04f75a56bc15ed3203786/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:22.757936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1875b7b-ec9f-48ef-80d6-a385b0fcf134 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.757936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1875b7b-ec9f-48ef-80d6-a385b0fcf134 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.757936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1875b7b-ec9f-48ef-80d6-a385b0fcf134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.789776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e1875b7b-ec9f-48ef-80d6-a385b0fcf134 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:22.790215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ccbe65-53c6-48cb-b110-c8b6dfb3c8ce admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:22.791411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e1875b7b-ec9f-48ef-80d6-a385b0fcf134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.861688 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3188/6409] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:22.862980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1875b7b-ec9f-48ef-80d6-a385b0fcf134 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:22.864570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e1875b7b-ec9f-48ef-80d6-a385b0fcf134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.900922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786327c-8a86-45d8-b099-2104bd61e2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:22.901654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786327c-8a86-45d8-b099-2104bd61e2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.901967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786327c-8a86-45d8-b099-2104bd61e2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.902240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786327c-8a86-45d8-b099-2104bd61e2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.904132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b786327c-8a86-45d8-b099-2104bd61e2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.932515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786327c-8a86-45d8-b099-2104bd61e2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:22.934901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786327c-8a86-45d8-b099-2104bd61e2d1 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:22.944186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1875b7b-ec9f-48ef-80d6-a385b0fcf134 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:22.946357 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3222/6410] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:22.947213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786327c-8a86-45d8-b099-2104bd61e2d1 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:22.949547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b786327c-8a86-45d8-b099-2104bd61e2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:22.959037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fce85-5801-40e3-8940-33a7080ba7df tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:22.959562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fce85-5801-40e3-8940-33a7080ba7df tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.959849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fce85-5801-40e3-8940-33a7080ba7df tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.960679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fce85-5801-40e3-8940-33a7080ba7df tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/269243cf4019424999f7dc3585b172d1/implies` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.962974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fce85-5801-40e3-8940-33a7080ba7df tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=269243cf4019424999f7dc3585b172d1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:22.965045 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-540fce85-5801-40e3-8940-33a7080ba7df tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:45:22.965045 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:45:22.965045 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:45:22.966449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fce85-5801-40e3-8940-33a7080ba7df tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:22.968730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786327c-8a86-45d8-b099-2104bd61e2d1 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:22.976764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:22.977095 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3189/6411] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Aug 30 04:45:22 2022] GET /identity/v3/roles/269243cf4019424999f7dc3585b172d1/implies => generated 489 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:22.978381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:22.978888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:22.979159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fce85-5801-40e3-8940-33a7080ba7df tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:22.979509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] PATH_INFO: `/v3/users/42dcc29830b948e09d429716dac362db` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:22.981393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42dcc29830b948e09d429716dac362db)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:22.984981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:22.994112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fce85-5801-40e3-8940-33a7080ba7df tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:23.000417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9f1342-3bd2-4eac-baec-d9260867544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:23.001437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f1342-3bd2-4eac-baec-d9260867544f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:23.002019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f1342-3bd2-4eac-baec-d9260867544f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:23.002352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f1342-3bd2-4eac-baec-d9260867544f admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:23.003348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f1342-3bd2-4eac-baec-d9260867544f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:23.003772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f1342-3bd2-4eac-baec-d9260867544f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:23.006097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9f1342-3bd2-4eac-baec-d9260867544f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:23.025379 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3190/6412] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:23.030600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d045b-5b1e-402c-9382-1f5539fec851 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:23.031227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:23.033192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d045b-5b1e-402c-9382-1f5539fec851 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:23.033701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d045b-5b1e-402c-9382-1f5539fec851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:23.077775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42dcc29830b948e09d429716dac362db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:23.079580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42dcc29830b948e09d429716dac362db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:23.080654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3d5d045b-5b1e-402c-9382-1f5539fec851 None None] MFA Rules not processed for user `e2d81536a2a04f75a56bc15ed3203786`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:23.083905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3d5d045b-5b1e-402c-9382-1f5539fec851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:23.096980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42dcc29830b948e09d429716dac362db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:23.113846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:23.115694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42dcc29830b948e09d429716dac362db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:23.145790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1711d004-9466-401b-ab78-5ed00056344f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42dcc29830b948e09d429716dac362db'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:23.172183 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3223/6413] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:22 2022] DELETE /identity/v3/users/42dcc29830b948e09d429716dac362db => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:23.191118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bc923-79c2-406b-b26c-cb2b45688993 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:23.191481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bc923-79c2-406b-b26c-cb2b45688993 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:23.193451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4bc923-79c2-406b-b26c-cb2b45688993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:23.199821 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3191/6414] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:23.200537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d045b-5b1e-402c-9382-1f5539fec851 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:23.207002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3d5d045b-5b1e-402c-9382-1f5539fec851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:23.235096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d045b-5b1e-402c-9382-1f5539fec851 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:23.271199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-de4bc923-79c2-406b-b26c-cb2b45688993 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:23.273645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-de4bc923-79c2-406b-b26c-cb2b45688993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:23.369225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883f911-46bb-48e5-875d-ce2c942b6ba3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:23.369813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f911-46bb-48e5-875d-ce2c942b6ba3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:23.381200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f911-46bb-48e5-875d-ce2c942b6ba3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:23.381641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f911-46bb-48e5-875d-ce2c942b6ba3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:23.387069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883f911-46bb-48e5-875d-ce2c942b6ba3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=55c107a2f22a420880113d27f319e0e8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:23.390230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883f911-46bb-48e5-875d-ce2c942b6ba3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:23.404659 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3192/6415] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Aug 30 04:45:23 2022] GET /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies => generated 658 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:23.406224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883f911-46bb-48e5-875d-ce2c942b6ba3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:23.408506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c883f911-46bb-48e5-875d-ce2c942b6ba3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:23.412819 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3224/6416] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:23.415007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bc923-79c2-406b-b26c-cb2b45688993 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:23.419913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-de4bc923-79c2-406b-b26c-cb2b45688993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:23.434713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883f911-46bb-48e5-875d-ce2c942b6ba3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:23.441045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dc6af-e125-440b-a3b4-6745b72e7bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:23.442079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dc6af-e125-440b-a3b4-6745b72e7bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:23.442366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dc6af-e125-440b-a3b4-6745b72e7bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:23.442679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613dc6af-e125-440b-a3b4-6745b72e7bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:23.443444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613dc6af-e125-440b-a3b4-6745b72e7bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:23.445720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613dc6af-e125-440b-a3b4-6745b72e7bd7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:23.519334 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3193/6417] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:23 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:23.521905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dc6af-e125-440b-a3b4-6745b72e7bd7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:23.529061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-613dc6af-e125-440b-a3b4-6745b72e7bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:23.603746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4bc923-79c2-406b-b26c-cb2b45688993 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:23.691815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574273c-eb86-446b-a6c5-022f05b5ee72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:23.692620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574273c-eb86-446b-a6c5-022f05b5ee72 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:23.693055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574273c-eb86-446b-a6c5-022f05b5ee72 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:23.693467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574273c-eb86-446b-a6c5-022f05b5ee72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:23.721045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:23.772738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613dc6af-e125-440b-a3b4-6745b72e7bd7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:23.780827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:23.781627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:23.782740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:23.784537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] PATH_INFO: `/v3/projects/22adcfba39a8421c819300701f74f756` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:23.786397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22adcfba39a8421c819300701f74f756)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:23.789623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:23.823059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574273c-eb86-446b-a6c5-022f05b5ee72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:23.825208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574273c-eb86-446b-a6c5-022f05b5ee72 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:23.845339 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3225/6418] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:23 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:23.846632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574273c-eb86-446b-a6c5-022f05b5ee72 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:23.850961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:23.886232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22adcfba39a8421c819300701f74f756', 'request_id': 'req-4089f466-4124-4aa7-b9ab-7d19740bfc27'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:23.898439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22adcfba39a8421c819300701f74f756', 'request_id': 'req-4089f466-4124-4aa7-b9ab-7d19740bfc27'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:23.907994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22adcfba39a8421c819300701f74f756', 'request_id': 'req-4089f466-4124-4aa7-b9ab-7d19740bfc27'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:23.933440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] The token cache is being invalidate because project 22adcfba39a8421c819300701f74f756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:23.933768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:23.938359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:23.940015 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3194/6419] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:23 2022] DELETE /identity/v3/projects/22adcfba39a8421c819300701f74f756 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:23.943924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:23.953819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:23.989156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574273c-eb86-446b-a6c5-022f05b5ee72 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:24.110752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089f466-4124-4aa7-b9ab-7d19740bfc27 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:24.123780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25d68-8e63-4a30-ad50-2d5b53253489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:24.124417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25d68-8e63-4a30-ad50-2d5b53253489 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:24.124698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25d68-8e63-4a30-ad50-2d5b53253489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:24.124964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef25d68-8e63-4a30-ad50-2d5b53253489 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:24.125931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25d68-8e63-4a30-ad50-2d5b53253489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:24.126239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25d68-8e63-4a30-ad50-2d5b53253489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:24.127869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef25d68-8e63-4a30-ad50-2d5b53253489 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:24.132600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a20795-b503-49e3-a4b7-fa37f6b409ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:24.133502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a20795-b503-49e3-a4b7-fa37f6b409ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:24.133992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a20795-b503-49e3-a4b7-fa37f6b409ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:24.134507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a20795-b503-49e3-a4b7-fa37f6b409ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/269243cf4019424999f7dc3585b172d1/implies/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:24.141365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a20795-b503-49e3-a4b7-fa37f6b409ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=269243cf4019424999f7dc3585b172d1, implied_role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:24.143428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a20795-b503-49e3-a4b7-fa37f6b409ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:24.153738 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3195/6420] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:24.154603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25d68-8e63-4a30-ad50-2d5b53253489 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:24.160631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ef25d68-8e63-4a30-ad50-2d5b53253489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:24.164506 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3226/6421] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:23 2022] DELETE /identity/v3/roles/269243cf4019424999f7dc3585b172d1/implies/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:24.165779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a20795-b503-49e3-a4b7-fa37f6b409ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:24.171129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-78a20795-b503-49e3-a4b7-fa37f6b409ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:24.194888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef25d68-8e63-4a30-ad50-2d5b53253489 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:24.321800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:24.331255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b3ed3-e979-40b9-856f-2c5a4d1e4eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:24.334981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3ed3-e979-40b9-856f-2c5a4d1e4eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:24.335539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3ed3-e979-40b9-856f-2c5a4d1e4eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:24.336060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3ed3-e979-40b9-856f-2c5a4d1e4eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:24.337187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b3ed3-e979-40b9-856f-2c5a4d1e4eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:24.338431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a20795-b503-49e3-a4b7-fa37f6b409ac tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:24.341403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b3ed3-e979-40b9-856f-2c5a4d1e4eb8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:24.350194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:24.350891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:24.351169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:24.351448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] PATH_INFO: `/v3/projects/210ea363af0e43f9957b724cda272a0d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:24.352655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=210ea363af0e43f9957b724cda272a0d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:24.354681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:24.377406 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3196/6422] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:24 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:24.378770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b3ed3-e979-40b9-856f-2c5a4d1e4eb8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:24.381061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-417b3ed3-e979-40b9-856f-2c5a4d1e4eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:24.395209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b3ed3-e979-40b9-856f-2c5a4d1e4eb8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:24.401168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:24.402021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:24.402229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:24.402502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] PATH_INFO: `/v3/users/ebc15edf1fc644439f0a4ae18f996d7c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:24.406120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc15edf1fc644439f0a4ae18f996d7c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:24.408224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:24.429349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210ea363af0e43f9957b724cda272a0d', 'request_id': 'req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:24.447339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210ea363af0e43f9957b724cda272a0d', 'request_id': 'req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:24.464195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210ea363af0e43f9957b724cda272a0d', 'request_id': 'req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:24.472309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:24.484835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] The token cache is being invalidate because project 210ea363af0e43f9957b724cda272a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:24.485305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:24.486554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:24.489360 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3227/6423] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:24 2022] DELETE /identity/v3/projects/210ea363af0e43f9957b724cda272a0d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:24.490555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:24.494094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:24.510178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc15edf1fc644439f0a4ae18f996d7c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:24.530149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc15edf1fc644439f0a4ae18f996d7c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:24.562000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc15edf1fc644439f0a4ae18f996d7c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:24.580659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc15edf1fc644439f0a4ae18f996d7c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:24.581785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc15edf1fc644439f0a4ae18f996d7c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:24.594638 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3197/6424] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:24 2022] DELETE /identity/v3/users/ebc15edf1fc644439f0a4ae18f996d7c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:24.595804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:24.598826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:24.636791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd39a4f-e02c-47ed-97bb-f782d8f0f21b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:24.705765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc339a8f-6fa3-4294-8eef-2f584a69d710 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:24.712444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e1c58-7d5d-4e7c-9acf-15043e6a6292 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:24.713123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e1c58-7d5d-4e7c-9acf-15043e6a6292 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:24.713404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e1c58-7d5d-4e7c-9acf-15043e6a6292 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:24.713684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e1c58-7d5d-4e7c-9acf-15043e6a6292 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/269243cf4019424999f7dc3585b172d1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:24.717123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e1c58-7d5d-4e7c-9acf-15043e6a6292 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=269243cf4019424999f7dc3585b172d1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:24.719260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e1c58-7d5d-4e7c-9acf-15043e6a6292 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:24.732779 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3198/6425] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:24 2022] DELETE /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/269243cf4019424999f7dc3585b172d1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:24.734017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e1c58-7d5d-4e7c-9acf-15043e6a6292 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:24.739647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-561e1c58-7d5d-4e7c-9acf-15043e6a6292 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:24.749203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d3fa7-f836-4142-929a-64d24948e99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:24.750220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d3fa7-f836-4142-929a-64d24948e99b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:24.750501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d3fa7-f836-4142-929a-64d24948e99b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:24.750919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d3fa7-f836-4142-929a-64d24948e99b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:24.751579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d3fa7-f836-4142-929a-64d24948e99b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:24.754593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d3fa7-f836-4142-929a-64d24948e99b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:24.794111 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3228/6426] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:24 2022] POST /identity/v3/projects => generated 373 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:24.795013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d3fa7-f836-4142-929a-64d24948e99b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:24.798715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-332d3fa7-f836-4142-929a-64d24948e99b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:24.820305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e1c58-7d5d-4e7c-9acf-15043e6a6292 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:24.828654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:24.892358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df735ce-1fdf-47bd-be7d-df3eb39f3b91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:24.893024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df735ce-1fdf-47bd-be7d-df3eb39f3b91 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:24.893364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df735ce-1fdf-47bd-be7d-df3eb39f3b91 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:24.893776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df735ce-1fdf-47bd-be7d-df3eb39f3b91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:24.896249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8df735ce-1fdf-47bd-be7d-df3eb39f3b91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:24.915202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d3fa7-f836-4142-929a-64d24948e99b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:24.920597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e161fb-db02-4417-a1eb-6301bc6c85bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:24.921230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e161fb-db02-4417-a1eb-6301bc6c85bc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:24.921514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e161fb-db02-4417-a1eb-6301bc6c85bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:24.921829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e161fb-db02-4417-a1eb-6301bc6c85bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:24.922680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e161fb-db02-4417-a1eb-6301bc6c85bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:24.924316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e161fb-db02-4417-a1eb-6301bc6c85bc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:24.925757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:24.942698 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3229/6427] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:24 2022] GET /identity/v3/roles => generated 2321 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:24.943754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e161fb-db02-4417-a1eb-6301bc6c85bc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:24.945780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-31e161fb-db02-4417-a1eb-6301bc6c85bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:24.960308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e161fb-db02-4417-a1eb-6301bc6c85bc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:24.965342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:24.966088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:24.966371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:24.966641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] PATH_INFO: `/v3/users/5a757a1b4af04798a1a067abfb1e6a83` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:24.967803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a757a1b4af04798a1a067abfb1e6a83)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:24.969745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:24.973411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df735ce-1fdf-47bd-be7d-df3eb39f3b91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:24.974975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df735ce-1fdf-47bd-be7d-df3eb39f3b91 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:24.984372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3199/6428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:24.985268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df735ce-1fdf-47bd-be7d-df3eb39f3b91 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:25.036901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a757a1b4af04798a1a067abfb1e6a83'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.038159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a757a1b4af04798a1a067abfb1e6a83'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.048404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a757a1b4af04798a1a067abfb1e6a83'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.060652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a757a1b4af04798a1a067abfb1e6a83'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.074942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df735ce-1fdf-47bd-be7d-df3eb39f3b91 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:25.076823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a757a1b4af04798a1a067abfb1e6a83'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.080619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf230-9186-45fd-bb51-9faf35b2a883 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:25.082290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf230-9186-45fd-bb51-9faf35b2a883 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:25.083381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf230-9186-45fd-bb51-9faf35b2a883 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:25.083381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbf230-9186-45fd-bb51-9faf35b2a883 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:25.085505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbf230-9186-45fd-bb51-9faf35b2a883 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=55c107a2f22a420880113d27f319e0e8, implied_role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:25.087424 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3230/6429] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:24 2022] DELETE /identity/v3/users/5a757a1b4af04798a1a067abfb1e6a83 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:25.087585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbf230-9186-45fd-bb51-9faf35b2a883 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:25.088453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:25.090591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:25.107038 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3200/6430] 10.222.0.43 () {58 vars in 1347 bytes} [Tue Aug 30 04:45:24 2022] DELETE /identity/v3/roles/55c107a2f22a420880113d27f319e0e8/implies/e80e47753dc740f3bd08d9cdba3e9f95 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:25.109297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf230-9186-45fd-bb51-9faf35b2a883 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:25.113703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-55fbf230-9186-45fd-bb51-9faf35b2a883 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:25.213380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076de1d-c379-41f8-8918-d074f14ffc16 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:25.261128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:25.275541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbf230-9186-45fd-bb51-9faf35b2a883 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:25.286383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:25.287286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:25.287633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:25.287971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] PATH_INFO: `/v3/projects/3b6e74beb65747c8b6c9d9ab8e285c39` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:25.289709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6e74beb65747c8b6c9d9ab8e285c39)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:25.293439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:25.320221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724de7a-9d5c-43b5-b8e6-958e189d2d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:25.322119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724de7a-9d5c-43b5-b8e6-958e189d2d49 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:25.322640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724de7a-9d5c-43b5-b8e6-958e189d2d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:25.323109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724de7a-9d5c-43b5-b8e6-958e189d2d49 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:25.324131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724de7a-9d5c-43b5-b8e6-958e189d2d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:25.327955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b724de7a-9d5c-43b5-b8e6-958e189d2d49 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:25.369483 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3231/6431] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:25 2022] POST /identity/v3/users => generated 287 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:25.373716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724de7a-9d5c-43b5-b8e6-958e189d2d49 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:25.375830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b724de7a-9d5c-43b5-b8e6-958e189d2d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:25.390314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724de7a-9d5c-43b5-b8e6-958e189d2d49 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:25.412175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6e74beb65747c8b6c9d9ab8e285c39', 'request_id': 'req-8769e94a-4c21-4e16-8655-437e3f9dc0c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.427690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6e74beb65747c8b6c9d9ab8e285c39', 'request_id': 'req-8769e94a-4c21-4e16-8655-437e3f9dc0c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.445775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6e74beb65747c8b6c9d9ab8e285c39', 'request_id': 'req-8769e94a-4c21-4e16-8655-437e3f9dc0c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.448331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:25.474392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] The token cache is being invalidate because project 3b6e74beb65747c8b6c9d9ab8e285c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:25.474682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.475493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.483684 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3201/6432] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:25 2022] DELETE /identity/v3/projects/3b6e74beb65747c8b6c9d9ab8e285c39 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:25.483684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:25.483684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:25.562612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee3c9-84ab-4f08-8a01-238da4a48597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:25.563311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee3c9-84ab-4f08-8a01-238da4a48597 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:25.563595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee3c9-84ab-4f08-8a01-238da4a48597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:25.579378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee3c9-84ab-4f08-8a01-238da4a48597 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:25.580199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ee3c9-84ab-4f08-8a01-238da4a48597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:25.583310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ee3c9-84ab-4f08-8a01-238da4a48597 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:25.606398 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3232/6433] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:25 2022] GET /identity/v3/roles => generated 2321 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:25.611100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee3c9-84ab-4f08-8a01-238da4a48597 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:25.614521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5f9ee3c9-84ab-4f08-8a01-238da4a48597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:25.631879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee3c9-84ab-4f08-8a01-238da4a48597 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:25.649650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977da3db-5bac-46a9-ba35-de5c86147d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:25.650633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977da3db-5bac-46a9-ba35-de5c86147d09 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:25.650966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977da3db-5bac-46a9-ba35-de5c86147d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:25.651245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977da3db-5bac-46a9-ba35-de5c86147d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:25.651900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977da3db-5bac-46a9-ba35-de5c86147d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:25.653510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977da3db-5bac-46a9-ba35-de5c86147d09 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:25.665274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769e94a-4c21-4e16-8655-437e3f9dc0c6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:25.671977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733c417-5eda-4229-aa09-16f1bcffc07a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:25.672907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733c417-5eda-4229-aa09-16f1bcffc07a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:25.673395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733c417-5eda-4229-aa09-16f1bcffc07a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:25.673865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733c417-5eda-4229-aa09-16f1bcffc07a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2560ffcdeb3b4c8ab71506be939fd7eb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:25.682925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733c417-5eda-4229-aa09-16f1bcffc07a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:45:25.683103 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3233/6434] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:25 2022] GET /identity/v3/roles => generated 2321 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:25.684347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3dec-2731-4974-a4da-a336c77271f3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:25.690469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3dec-2731-4974-a4da-a336c77271f3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:25.690781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba3dec-2731-4974-a4da-a336c77271f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-7733c417-5eda-4229-aa09-16f1bcffc07a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Could not find domain: 2560ffcdeb3b4c8ab71506be939fd7eb.: keystone.exception.DomainNotFound: Could not find domain: 2560ffcdeb3b4c8ab71506be939fd7eb. Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2560ffcdeb3b4c8ab71506be939fd7eb. Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:45:25.692410 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:25.693522 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2560ffcdeb3b4c8ab71506be939fd7eb. Aug 30 04:45:25.694839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:25.696876 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3202/6435] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:45:25 2022] PATCH /identity/v3/domains/2560ffcdeb3b4c8ab71506be939fd7eb => generated 112 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:45:25.697696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733c417-5eda-4229-aa09-16f1bcffc07a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:25.700521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7733c417-5eda-4229-aa09-16f1bcffc07a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:25.717715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733c417-5eda-4229-aa09-16f1bcffc07a tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:25.725073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9aba3dec-2731-4974-a4da-a336c77271f3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:25.726672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9aba3dec-2731-4974-a4da-a336c77271f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:25.731804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:25.732649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:25.733098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:25.733374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] PATH_INFO: `/v3/projects/1d349f9666934347a9153fa11e7808fd` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:25.734777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d349f9666934347a9153fa11e7808fd)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:25.737409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:25.741341 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3234/6436] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:25.742595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3dec-2731-4974-a4da-a336c77271f3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:25.743924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9aba3dec-2731-4974-a4da-a336c77271f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:25.757634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba3dec-2731-4974-a4da-a336c77271f3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:25.763412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc8a0c-3883-4214-b8e9-84a8b227163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:25.764249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc8a0c-3883-4214-b8e9-84a8b227163e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:25.764488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc8a0c-3883-4214-b8e9-84a8b227163e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:25.764832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc8a0c-3883-4214-b8e9-84a8b227163e admin admin] PATH_INFO: `/v3/projects/c863daea2c01494eb47f768ddae309bd/users/376c643973644463b76de06dccbfa5be/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:25.782878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc8a0c-3883-4214-b8e9-84a8b227163e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c863daea2c01494eb47f768ddae309bd, user_id=376c643973644463b76de06dccbfa5be, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:25.785813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc8a0c-3883-4214-b8e9-84a8b227163e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:25.810411 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3235/6437] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:25 2022] PUT /identity/v3/projects/c863daea2c01494eb47f768ddae309bd/users/376c643973644463b76de06dccbfa5be/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:25.810411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc8a0c-3883-4214-b8e9-84a8b227163e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:25.836424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d349f9666934347a9153fa11e7808fd', 'request_id': 'req-dd4b6287-a071-4591-859b-6bf907a28664'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.855643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d349f9666934347a9153fa11e7808fd', 'request_id': 'req-dd4b6287-a071-4591-859b-6bf907a28664'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.873772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d349f9666934347a9153fa11e7808fd', 'request_id': 'req-dd4b6287-a071-4591-859b-6bf907a28664'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.919153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] The token cache is being invalidate because project 1d349f9666934347a9153fa11e7808fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:25.919451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.921247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:25.922848 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3203/6438] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:25 2022] DELETE /identity/v3/projects/1d349f9666934347a9153fa11e7808fd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:25.923638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:25.925025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:25.939135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc8a0c-3883-4214-b8e9-84a8b227163e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:25.979843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:26.032980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b6287-a071-4591-859b-6bf907a28664 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:26.039323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:26.040373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.040883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.041442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/users/c9d046925d4648d49b748031297f7cac` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.043953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c9d046925d4648d49b748031297f7cac)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:26.047318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:26.067970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:26.107177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cc311-ccaa-4a28-ae19-09fcff96defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:26.108124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cc311-ccaa-4a28-ae19-09fcff96defc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.108587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cc311-ccaa-4a28-ae19-09fcff96defc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.109051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cc311-ccaa-4a28-ae19-09fcff96defc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.109954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cc311-ccaa-4a28-ae19-09fcff96defc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:26.111808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9cc311-ccaa-4a28-ae19-09fcff96defc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:26.133337 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3236/6439] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:25 2022] GET /identity/v3/roles => generated 2321 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:26.135036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6b40-189a-454e-b1e8-2be9214087c4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.135524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6b40-189a-454e-b1e8-2be9214087c4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.136152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c6b40-189a-454e-b1e8-2be9214087c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.146652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9d046925d4648d49b748031297f7cac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:26.163280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9d046925d4648d49b748031297f7cac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:26.168024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-de4c6b40-189a-454e-b1e8-2be9214087c4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:26.169527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-de4c6b40-189a-454e-b1e8-2be9214087c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:26.185026 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3237/6440] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:26.186221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c85574-0dd0-45bc-be4f-f1be70c67be3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.186500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c85574-0dd0-45bc-be4f-f1be70c67be3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.186797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c85574-0dd0-45bc-be4f-f1be70c67be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.187535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9d046925d4648d49b748031297f7cac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:26.199298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9d046925d4648d49b748031297f7cac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:26.200057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0fb5d833-53a1-49ef-b978-a669686bf2d0 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9d046925d4648d49b748031297f7cac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:26.216076 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3204/6441] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:25 2022] DELETE /identity/v3/users/c9d046925d4648d49b748031297f7cac => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:26.219250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78681d-2793-4f99-8451-3075783bc9eb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.220290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78681d-2793-4f99-8451-3075783bc9eb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.220561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78681d-2793-4f99-8451-3075783bc9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.224104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-05c85574-0dd0-45bc-be4f-f1be70c67be3 None None] MFA Rules not processed for user `376c643973644463b76de06dccbfa5be`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:26.226057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-05c85574-0dd0-45bc-be4f-f1be70c67be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:26.261008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-dc78681d-2793-4f99-8451-3075783bc9eb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:26.262277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dc78681d-2793-4f99-8451-3075783bc9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:26.331268 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3238/6442] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:26.332574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c85574-0dd0-45bc-be4f-f1be70c67be3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:26.339031 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3205/6443] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:26.340193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78681d-2793-4f99-8451-3075783bc9eb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:26.341486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dc78681d-2793-4f99-8451-3075783bc9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:26.344328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-05c85574-0dd0-45bc-be4f-f1be70c67be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:26.361207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78681d-2793-4f99-8451-3075783bc9eb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:26.362720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c85574-0dd0-45bc-be4f-f1be70c67be3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:26.368948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94771-265e-4dec-bd27-aa1a8e289c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:26.370071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94771-265e-4dec-bd27-aa1a8e289c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.370738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94771-265e-4dec-bd27-aa1a8e289c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.371314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a94771-265e-4dec-bd27-aa1a8e289c54 admin admin] PATH_INFO: `/v3/projects/5765b5f366ed4328938fdd3ce47e3af6/users/61b9621f1a3c453aa7512226fcde8406/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.377989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f06a4-3b51-4a42-873d-d5237b070099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:26.378775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f06a4-3b51-4a42-873d-d5237b070099 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.379295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f06a4-3b51-4a42-873d-d5237b070099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.379577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f06a4-3b51-4a42-873d-d5237b070099 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.380531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f06a4-3b51-4a42-873d-d5237b070099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:26.380842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f06a4-3b51-4a42-873d-d5237b070099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:26.382545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f06a4-3b51-4a42-873d-d5237b070099 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:26.392280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94771-265e-4dec-bd27-aa1a8e289c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5765b5f366ed4328938fdd3ce47e3af6, user_id=61b9621f1a3c453aa7512226fcde8406, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:26.396477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a94771-265e-4dec-bd27-aa1a8e289c54 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:26.414061 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3206/6444] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:26.415043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f06a4-3b51-4a42-873d-d5237b070099 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:26.416903 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3239/6445] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:26 2022] PUT /identity/v3/projects/5765b5f366ed4328938fdd3ce47e3af6/users/61b9621f1a3c453aa7512226fcde8406/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:26.417058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-304f06a4-3b51-4a42-873d-d5237b070099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:26.418113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94771-265e-4dec-bd27-aa1a8e289c54 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:26.421500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b2a94771-265e-4dec-bd27-aa1a8e289c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:26.497013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a94771-265e-4dec-bd27-aa1a8e289c54 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:26.502440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d171f-6590-4396-8e17-bb6938120908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:26.503199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d171f-6590-4396-8e17-bb6938120908 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.503884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d171f-6590-4396-8e17-bb6938120908 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.504484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d171f-6590-4396-8e17-bb6938120908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.515808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f06a4-3b51-4a42-873d-d5237b070099 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:26.542136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:26.573170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:26.598510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:26.600302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.601039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.601565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/5a5c4f176bde47a3b68319ff10af1384` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.607937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5a5c4f176bde47a3b68319ff10af1384)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:26.610097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:26.623226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d171f-6590-4396-8e17-bb6938120908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:26.624907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d171f-6590-4396-8e17-bb6938120908 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:26.662063 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3240/6446] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:26.663824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ab29c-e437-4337-a4c6-b9fa7aff7940 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.665981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 5a5c4f176bde47a3b68319ff10af1384 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:26.666677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:26.667747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:26.674045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ab29c-e437-4337-a4c6-b9fa7aff7940 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.674439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ab29c-e437-4337-a4c6-b9fa7aff7940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.676196 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3207/6447] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:26 2022] DELETE /identity/v3/roles/5a5c4f176bde47a3b68319ff10af1384 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:26.677491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:26.689330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:26.719944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a77ab29c-e437-4337-a4c6-b9fa7aff7940 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:26.721804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a77ab29c-e437-4337-a4c6-b9fa7aff7940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:26.850471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cf0d1-ea0d-49d3-945d-59c078778e12 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:26.871190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4237c-7f29-4794-b97c-6f27ae7c9918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:26.873934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4237c-7f29-4794-b97c-6f27ae7c9918 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.874462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4237c-7f29-4794-b97c-6f27ae7c9918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.875191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4237c-7f29-4794-b97c-6f27ae7c9918 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.876140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4237c-7f29-4794-b97c-6f27ae7c9918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:26.878736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4237c-7f29-4794-b97c-6f27ae7c9918 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:26.914155 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3241/6448] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:26.915515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1eb79-5cab-4611-ad96-de77f45292f5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:26.915804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1eb79-5cab-4611-ad96-de77f45292f5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:26.916075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1eb79-5cab-4611-ad96-de77f45292f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:26.942640 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3208/6449] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:26 2022] POST /identity/v3/projects => generated 381 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:26.943875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4237c-7f29-4794-b97c-6f27ae7c9918 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:26.946258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-33d4237c-7f29-4794-b97c-6f27ae7c9918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:26.990866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f2c1eb79-5cab-4611-ad96-de77f45292f5 None None] MFA Rules not processed for user `61b9621f1a3c453aa7512226fcde8406`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:26.992573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f2c1eb79-5cab-4611-ad96-de77f45292f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:27.028374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4237c-7f29-4794-b97c-6f27ae7c9918 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:27.034696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd8f1-44da-4245-8933-d7a77233c9c4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:27.036147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd8f1-44da-4245-8933-d7a77233c9c4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:27.036787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd8f1-44da-4245-8933-d7a77233c9c4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:27.037397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5dd8f1-44da-4245-8933-d7a77233c9c4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/groups/68ee0b6a430046ed8315a66b9ef43a04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:27.039924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd8f1-44da-4245-8933-d7a77233c9c4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_group(group_id=68ee0b6a430046ed8315a66b9ef43a04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:27.042173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5dd8f1-44da-4245-8933-d7a77233c9c4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:27.065315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:27.110135 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3209/6450] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:45:26 2022] DELETE /identity/v3/groups/68ee0b6a430046ed8315a66b9ef43a04 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:27.111844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd8f1-44da-4245-8933-d7a77233c9c4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:27.182191 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3242/6451] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:27.183052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1eb79-5cab-4611-ad96-de77f45292f5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:27.267218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5dd8f1-44da-4245-8933-d7a77233c9c4 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:27.274692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f193123-ee71-42cf-add2-97619c7704b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:27.275335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f193123-ee71-42cf-add2-97619c7704b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:27.275618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f193123-ee71-42cf-add2-97619c7704b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:27.275891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f193123-ee71-42cf-add2-97619c7704b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:27.276576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f193123-ee71-42cf-add2-97619c7704b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:27.276933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f193123-ee71-42cf-add2-97619c7704b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:27.279543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f193123-ee71-42cf-add2-97619c7704b3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:27.304158 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3210/6452] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:27.304158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f193123-ee71-42cf-add2-97619c7704b3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:27.309982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1eb79-5cab-4611-ad96-de77f45292f5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:27.315539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b30d7-23f8-49a6-a62b-20f6cd366dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:27.316243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b30d7-23f8-49a6-a62b-20f6cd366dbb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:27.316527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b30d7-23f8-49a6-a62b-20f6cd366dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:27.316804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b30d7-23f8-49a6-a62b-20f6cd366dbb admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:27.317725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b30d7-23f8-49a6-a62b-20f6cd366dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:27.319725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b30d7-23f8-49a6-a62b-20f6cd366dbb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:27.333113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:27.353316 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3243/6453] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:27 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:27.358820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b30d7-23f8-49a6-a62b-20f6cd366dbb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:27.360880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dc1b30d7-23f8-49a6-a62b-20f6cd366dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:27.414325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f193123-ee71-42cf-add2-97619c7704b3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:27.420504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:27.421317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:27.421735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:27.422244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:27.423544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4b7eaf8ff1f8426a81f6bdfd35bd5461)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:27.426931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:27.453276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b30d7-23f8-49a6-a62b-20f6cd366dbb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:27.458313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7142a-28e8-427a-9131-24486ff165f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:27.459210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7142a-28e8-427a-9131-24486ff165f0 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:27.470631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7142a-28e8-427a-9131-24486ff165f0 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:27.472079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7142a-28e8-427a-9131-24486ff165f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:27.517472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7eaf8ff1f8426a81f6bdfd35bd5461', 'request_id': 'req-a9dc5bca-aa41-4fac-abda-99c4671b30d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:27.535125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7eaf8ff1f8426a81f6bdfd35bd5461', 'request_id': 'req-a9dc5bca-aa41-4fac-abda-99c4671b30d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:27.548487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7eaf8ff1f8426a81f6bdfd35bd5461', 'request_id': 'req-a9dc5bca-aa41-4fac-abda-99c4671b30d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:27.560723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:27.570967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] The token cache is being invalidate because project 4b7eaf8ff1f8426a81f6bdfd35bd5461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:27.571317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:27.571923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:27.582353 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3211/6454] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:27 2022] DELETE /identity/v3/projects/4b7eaf8ff1f8426a81f6bdfd35bd5461 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:27.583519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:27.587403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:27.601909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7142a-28e8-427a-9131-24486ff165f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:27.604732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7142a-28e8-427a-9131-24486ff165f0 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:27.621462 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3244/6455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:27.622396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7142a-28e8-427a-9131-24486ff165f0 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:27.642109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7142a-28e8-427a-9131-24486ff165f0 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:27.779353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc5bca-aa41-4fac-abda-99c4671b30d5 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:27.788552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc01494-ef96-499c-b03b-820a6abe5d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:27.789363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc01494-ef96-499c-b03b-820a6abe5d29 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:27.789699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053f2d0-3075-4e5d-9e29-d67eb1ee8b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:27.789835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc01494-ef96-499c-b03b-820a6abe5d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:27.790308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc01494-ef96-499c-b03b-820a6abe5d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:27.790787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053f2d0-3075-4e5d-9e29-d67eb1ee8b00 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:27.791220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc01494-ef96-499c-b03b-820a6abe5d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:27.791686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053f2d0-3075-4e5d-9e29-d67eb1ee8b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:27.791969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053f2d0-3075-4e5d-9e29-d67eb1ee8b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:27.792659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053f2d0-3075-4e5d-9e29-d67eb1ee8b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:27.794346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc01494-ef96-499c-b03b-820a6abe5d29 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:27.794733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053f2d0-3075-4e5d-9e29-d67eb1ee8b00 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:27.812062 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3245/6456] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:27 2022] GET /identity/v3/roles => generated 2095 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:27.813000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053f2d0-3075-4e5d-9e29-d67eb1ee8b00 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:27.815110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3053f2d0-3075-4e5d-9e29-d67eb1ee8b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:27.843040 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3212/6457] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:27 2022] POST /identity/v3/projects => generated 357 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:27.845247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc01494-ef96-499c-b03b-820a6abe5d29 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:27.850422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fdc01494-ef96-499c-b03b-820a6abe5d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:27.864445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:27.909164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053f2d0-3075-4e5d-9e29-d67eb1ee8b00 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:27.945137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc01494-ef96-499c-b03b-820a6abe5d29 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:27.954204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:27.955369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:27.955878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:27.956245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] PATH_INFO: `/v3/users/61b9621f1a3c453aa7512226fcde8406` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:27.959051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b9621f1a3c453aa7512226fcde8406)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:27.961379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:28.015670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:28.017210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:28.017504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:28.017829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:28.020921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2978357ad0ad4e2a95b53e37dc10e3d1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:28.023323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:28.053019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.053791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.092163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.092857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.095526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b9621f1a3c453aa7512226fcde8406'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.099623 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3246/6458] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:45:27 2022] PATCH /identity/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1 => generated 276 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:28.099623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:28.099623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:28.107565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b9621f1a3c453aa7512226fcde8406'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.126916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b9621f1a3c453aa7512226fcde8406'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.142628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b9621f1a3c453aa7512226fcde8406'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.143392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b9621f1a3c453aa7512226fcde8406'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.159753 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3213/6459] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:27 2022] DELETE /identity/v3/users/61b9621f1a3c453aa7512226fcde8406 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:28.159753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:28.161062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:28.172087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:28.241392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e0898-193c-4f5b-ac20-2167cf0a6b19 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:28.364155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081898a2-7a41-4e0d-bfcf-374015ca61c1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:28.371994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:28.382583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a55b47-4196-4ad4-9239-56b103f0da78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:28.383421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a55b47-4196-4ad4-9239-56b103f0da78 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:28.383701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a55b47-4196-4ad4-9239-56b103f0da78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:28.384144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a55b47-4196-4ad4-9239-56b103f0da78 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:28.385108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a55b47-4196-4ad4-9239-56b103f0da78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:28.386954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a55b47-4196-4ad4-9239-56b103f0da78 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:28.393399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79e71-fb3d-4f8d-8f79-3014c729053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:28.394780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79e71-fb3d-4f8d-8f79-3014c729053b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:28.398343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79e71-fb3d-4f8d-8f79-3014c729053b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:28.401051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c79e71-fb3d-4f8d-8f79-3014c729053b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:28.402616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c79e71-fb3d-4f8d-8f79-3014c729053b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:28.404814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c79e71-fb3d-4f8d-8f79-3014c729053b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:28.449155 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3247/6461] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:28 2022] GET /identity/v3/roles => generated 2095 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:28.450021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79e71-fb3d-4f8d-8f79-3014c729053b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:28.451862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-27c79e71-fb3d-4f8d-8f79-3014c729053b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:28.452002 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3214/6461] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:28 2022] POST /identity/v3/users => generated 279 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:28.454408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822956b4-f162-423e-905a-96ba8cb52a75 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:28.478488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822956b4-f162-423e-905a-96ba8cb52a75 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:28.478707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822956b4-f162-423e-905a-96ba8cb52a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:28.525898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-822956b4-f162-423e-905a-96ba8cb52a75 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:28.528232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-822956b4-f162-423e-905a-96ba8cb52a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:28.549229 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3215/6462] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:28.552005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822956b4-f162-423e-905a-96ba8cb52a75 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:28.562489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c79e71-fb3d-4f8d-8f79-3014c729053b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:28.573919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822956b4-f162-423e-905a-96ba8cb52a75 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:28.580055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:28.588470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:28.588761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:28.589036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:28.593110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9927eb-a325-438e-affa-8f2b376413f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:28.594626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9927eb-a325-438e-affa-8f2b376413f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:28.595130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9927eb-a325-438e-affa-8f2b376413f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:28.595420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9927eb-a325-438e-affa-8f2b376413f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:28.596149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9927eb-a325-438e-affa-8f2b376413f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:28.599583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9927eb-a325-438e-affa-8f2b376413f5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:28.609262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2978357ad0ad4e2a95b53e37dc10e3d1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:28.611575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:28.618630 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3216/6463] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:28 2022] GET /identity/v3/roles => generated 2095 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:28.622635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9927eb-a325-438e-affa-8f2b376413f5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:28.624989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7a9927eb-a325-438e-affa-8f2b376413f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:28.650844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9927eb-a325-438e-affa-8f2b376413f5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:28.656702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c7207-ef6b-4a6f-a58b-bf4ae4caf8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:28.657392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c7207-ef6b-4a6f-a58b-bf4ae4caf8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:28.657671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c7207-ef6b-4a6f-a58b-bf4ae4caf8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:28.657991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c7207-ef6b-4a6f-a58b-bf4ae4caf8bc admin admin] PATH_INFO: `/v3/projects/ed34a1a765d04ecfa975f557fc3b23a2/users/a9710d5d3d7f4cd79f33d2fb78dee719/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:28.667984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.687161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.696497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c7207-ef6b-4a6f-a58b-bf4ae4caf8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed34a1a765d04ecfa975f557fc3b23a2, user_id=a9710d5d3d7f4cd79f33d2fb78dee719, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:28.704829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c7207-ef6b-4a6f-a58b-bf4ae4caf8bc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:28.734711 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3217/6464] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:28 2022] PUT /identity/v3/projects/ed34a1a765d04ecfa975f557fc3b23a2/users/a9710d5d3d7f4cd79f33d2fb78dee719/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:28.736591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c7207-ef6b-4a6f-a58b-bf4ae4caf8bc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:28.740425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-df6c7207-ef6b-4a6f-a58b-bf4ae4caf8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:28.793255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1', 'request_id': 'req-2b394234-eb1a-4910-9623-d75045d802be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.802077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1', 'request_id': 'req-2b394234-eb1a-4910-9623-d75045d802be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.814227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1', 'request_id': 'req-2b394234-eb1a-4910-9623-d75045d802be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.831391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] The token cache is being invalidate because project 2978357ad0ad4e2a95b53e37dc10e3d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:28.831718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.832809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.841615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1', 'request_id': 'req-2b394234-eb1a-4910-9623-d75045d802be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.842570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1', 'request_id': 'req-2b394234-eb1a-4910-9623-d75045d802be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.843755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2978357ad0ad4e2a95b53e37dc10e3d1', 'request_id': 'req-2b394234-eb1a-4910-9623-d75045d802be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:28.857936 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3248/6465] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:45:28 2022] DELETE /identity/v3/domains/2978357ad0ad4e2a95b53e37dc10e3d1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:28.857936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:28.860256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:28.860535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c7207-ef6b-4a6f-a58b-bf4ae4caf8bc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:28.904637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:28.951117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394234-eb1a-4910-9623-d75045d802be tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:28.956614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287aa94-5d0e-4754-b695-2fe4ce27361b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:28.957486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287aa94-5d0e-4754-b695-2fe4ce27361b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:28.957855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287aa94-5d0e-4754-b695-2fe4ce27361b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:28.958247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287aa94-5d0e-4754-b695-2fe4ce27361b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:28.958997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287aa94-5d0e-4754-b695-2fe4ce27361b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:28.960748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287aa94-5d0e-4754-b695-2fe4ce27361b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:28.973910 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3249/6466] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:28 2022] GET /identity/v3/roles => generated 2095 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:28.975467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a5f1-1dbe-4317-93c2-241b76d09405 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:28.975900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a5f1-1dbe-4317-93c2-241b76d09405 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:28.976265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a5f1-1dbe-4317-93c2-241b76d09405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:28.986046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9eadf-4e05-41a8-9b36-9109ccd084ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:28.988063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9eadf-4e05-41a8-9b36-9109ccd084ad service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:28.988666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9eadf-4e05-41a8-9b36-9109ccd084ad service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:28.989413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9eadf-4e05-41a8-9b36-9109ccd084ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:28.993037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c9d9eadf-4e05-41a8-9b36-9109ccd084ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:29.009162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9eadf-4e05-41a8-9b36-9109ccd084ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:29.012303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9eadf-4e05-41a8-9b36-9109ccd084ad service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:29.026007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3218/6467] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:29.027182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9eadf-4e05-41a8-9b36-9109ccd084ad service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:29.029101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c9d9eadf-4e05-41a8-9b36-9109ccd084ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:29.046010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:29.048132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5de1a5f1-1dbe-4317-93c2-241b76d09405 None None] MFA Rules not processed for user `a9710d5d3d7f4cd79f33d2fb78dee719`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:29.049560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5de1a5f1-1dbe-4317-93c2-241b76d09405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:29.131617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9eadf-4e05-41a8-9b36-9109ccd084ad service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:29.138335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:29.139654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:29.140114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:29.140667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/269243cf4019424999f7dc3585b172d1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:29.142399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_role(role_id=269243cf4019424999f7dc3585b172d1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:29.145769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:29.192421 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3250/6468] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:29.193369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1a5f1-1dbe-4317-93c2-241b76d09405 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:29.226443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1a5f1-1dbe-4317-93c2-241b76d09405 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:29.242377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bacd71-5209-4893-9786-6a9f22a3f49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:29.243111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bacd71-5209-4893-9786-6a9f22a3f49b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:29.243385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bacd71-5209-4893-9786-6a9f22a3f49b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:29.243652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bacd71-5209-4893-9786-6a9f22a3f49b admin admin] PATH_INFO: `/v3/projects/77c448f629da4a4e96681e9dae759ac6/users/ef5af1eefc54489899437e0166f82c14/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:29.257491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 269243cf4019424999f7dc3585b172d1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:29.258018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:29.258724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:29.263947 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3219/6469] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:29 2022] DELETE /identity/v3/roles/269243cf4019424999f7dc3585b172d1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:29.264678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:29.267314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:29.284055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bacd71-5209-4893-9786-6a9f22a3f49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c448f629da4a4e96681e9dae759ac6, user_id=ef5af1eefc54489899437e0166f82c14, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:29.288005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bacd71-5209-4893-9786-6a9f22a3f49b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:29.305292 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3251/6470] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:29 2022] PUT /identity/v3/projects/77c448f629da4a4e96681e9dae759ac6/users/ef5af1eefc54489899437e0166f82c14/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:29.309525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bacd71-5209-4893-9786-6a9f22a3f49b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:29.316520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f2bacd71-5209-4893-9786-6a9f22a3f49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:29.431915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260104fd-2fb3-4afc-8346-5fc55eeacfa3 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:29.448913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bacd71-5209-4893-9786-6a9f22a3f49b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:29.474792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233d48d-7340-4204-8f29-aeb983b8a217 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:29.475621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233d48d-7340-4204-8f29-aeb983b8a217 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:29.477058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233d48d-7340-4204-8f29-aeb983b8a217 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:29.477349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233d48d-7340-4204-8f29-aeb983b8a217 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/e80e47753dc740f3bd08d9cdba3e9f95` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:29.479854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233d48d-7340-4204-8f29-aeb983b8a217 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e80e47753dc740f3bd08d9cdba3e9f95)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:29.482663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233d48d-7340-4204-8f29-aeb983b8a217 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:29.539590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503570e3-6d09-444a-a917-ac03fe6ecb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:29.540277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503570e3-6d09-444a-a917-ac03fe6ecb4f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:29.540715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503570e3-6d09-444a-a917-ac03fe6ecb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:29.540996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503570e3-6d09-444a-a917-ac03fe6ecb4f admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:29.542026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503570e3-6d09-444a-a917-ac03fe6ecb4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:29.544999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503570e3-6d09-444a-a917-ac03fe6ecb4f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:29.547384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:29.562559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a233d48d-7340-4204-8f29-aeb983b8a217 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role e80e47753dc740f3bd08d9cdba3e9f95 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:29.562998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a233d48d-7340-4204-8f29-aeb983b8a217 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:29.564151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a233d48d-7340-4204-8f29-aeb983b8a217 tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:29.571499 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3252/6471] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:29 2022] DELETE /identity/v3/roles/e80e47753dc740f3bd08d9cdba3e9f95 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:29.573505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f83d6-c676-4e66-850f-61e08dd3b47c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:29.573803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f83d6-c676-4e66-850f-61e08dd3b47c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:29.574090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f83d6-c676-4e66-850f-61e08dd3b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:29.641281 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3220/6472] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:29 2022] POST /identity/v3/projects => generated 383 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:29.649829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503570e3-6d09-444a-a917-ac03fe6ecb4f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:29.659135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-503570e3-6d09-444a-a917-ac03fe6ecb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:29.661645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b02f83d6-c676-4e66-850f-61e08dd3b47c None None] MFA Rules not processed for user `ef5af1eefc54489899437e0166f82c14`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:29.663128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b02f83d6-c676-4e66-850f-61e08dd3b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:29.689252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:29.829934 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3253/6473] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:29.834525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f83d6-c676-4e66-850f-61e08dd3b47c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:29.836037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b02f83d6-c676-4e66-850f-61e08dd3b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:29.867555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503570e3-6d09-444a-a917-ac03fe6ecb4f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:29.886364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15f78a95370843be9a19009fff112a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65d0e031e7b443a1bd7c050b4c539d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:29.887285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:29.887808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:29.890180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] PATH_INFO: `/v3/roles/55c107a2f22a420880113d27f319e0e8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:29.893012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorizing `identity:delete_role(role_id=55c107a2f22a420880113d27f319e0e8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:29.898049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:30.001937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invalidating the token cache because role 55c107a2f22a420880113d27f319e0e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:30.001937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.007171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.014361 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3221/6474] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:29 2022] DELETE /identity/v3/roles/55c107a2f22a420880113d27f319e0e8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:30.020315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:30.020576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f83d6-c676-4e66-850f-61e08dd3b47c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:30.023929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:30.201501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f46270-4220-4cee-81ba-9ae5be7d3b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:30.202866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f46270-4220-4cee-81ba-9ae5be7d3b3f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:30.203369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f46270-4220-4cee-81ba-9ae5be7d3b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:30.203876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f46270-4220-4cee-81ba-9ae5be7d3b3f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:30.205184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f46270-4220-4cee-81ba-9ae5be7d3b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:30.208160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f46270-4220-4cee-81ba-9ae5be7d3b3f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:30.248359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a519fe-a2cb-4526-ad5a-a309adab48aa tempest-RolesV3TestJSON-652453989 tempest-RolesV3TestJSON-652453989-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:30.263901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:30.265811 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3254/6475] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:29 2022] POST /identity/v3/users => generated 298 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:30.265988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:30.266755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f46270-4220-4cee-81ba-9ae5be7d3b3f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:30.267210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:30.268210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] PATH_INFO: `/v3/projects/5765b5f366ed4328938fdd3ce47e3af6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:30.272917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-07f46270-4220-4cee-81ba-9ae5be7d3b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:30.273390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5765b5f366ed4328938fdd3ce47e3af6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:30.276531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:30.303309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f46270-4220-4cee-81ba-9ae5be7d3b3f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:30.335258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ebc94-453a-4aa6-92ba-f1ccea8a985d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:30.335908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ebc94-453a-4aa6-92ba-f1ccea8a985d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:30.336191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ebc94-453a-4aa6-92ba-f1ccea8a985d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:30.336462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ebc94-453a-4aa6-92ba-f1ccea8a985d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:30.337117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ebc94-453a-4aa6-92ba-f1ccea8a985d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:30.339136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ebc94-453a-4aa6-92ba-f1ccea8a985d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:30.385550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5765b5f366ed4328938fdd3ce47e3af6', 'request_id': 'req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.411022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:30.413114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5765b5f366ed4328938fdd3ce47e3af6', 'request_id': 'req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.419893 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3255/6476] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:30 2022] POST /identity/v3/projects => generated 355 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:30.419893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ebc94-453a-4aa6-92ba-f1ccea8a985d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:30.421998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-002ebc94-453a-4aa6-92ba-f1ccea8a985d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:30.423725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5765b5f366ed4328938fdd3ce47e3af6', 'request_id': 'req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.438420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] The token cache is being invalidate because project 5765b5f366ed4328938fdd3ce47e3af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:30.439054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.439465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.445082 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3222/6477] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:30 2022] DELETE /identity/v3/projects/5765b5f366ed4328938fdd3ce47e3af6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:30.446151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:30.448613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:30.455544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:30.581634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ebc94-453a-4aa6-92ba-f1ccea8a985d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:30.593792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:30.594610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:30.594886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:30.595155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] PATH_INFO: `/v3/users/73cafed6dc6c4058b953d29a18c6c8a9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:30.596771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73cafed6dc6c4058b953d29a18c6c8a9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:30.598533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bce4c-6764-4bc9-96f6-45d7c51b4cdf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:30.602272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:30.614343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c6531-7dfc-4601-bed6-eae0c4c44755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:30.615379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6531-7dfc-4601-bed6-eae0c4c44755 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:30.616109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6531-7dfc-4601-bed6-eae0c4c44755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:30.616457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c6531-7dfc-4601-bed6-eae0c4c44755 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:30.617251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c6531-7dfc-4601-bed6-eae0c4c44755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:30.620597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c6531-7dfc-4601-bed6-eae0c4c44755 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:30.633154 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3223/6478] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:30.634176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c6531-7dfc-4601-bed6-eae0c4c44755 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:30.638064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-985c6531-7dfc-4601-bed6-eae0c4c44755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:30.653427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c6531-7dfc-4601-bed6-eae0c4c44755 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:30.660120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e93b0a-f7f5-4540-9ec1-4ba5fbbb9015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:30.661327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e93b0a-f7f5-4540-9ec1-4ba5fbbb9015 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:30.661794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e93b0a-f7f5-4540-9ec1-4ba5fbbb9015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:30.663161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e93b0a-f7f5-4540-9ec1-4ba5fbbb9015 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:30.663752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e93b0a-f7f5-4540-9ec1-4ba5fbbb9015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:30.665833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e93b0a-f7f5-4540-9ec1-4ba5fbbb9015 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:30.697804 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3224/6479] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:30 2022] POST /identity/v3/users => generated 284 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:30.699855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f1f3-2fd0-44f5-9cc4-99cedca91882 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:30.701094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f1f3-2fd0-44f5-9cc4-99cedca91882 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:30.701558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b092f1f3-2fd0-44f5-9cc4-99cedca91882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:30.749477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b092f1f3-2fd0-44f5-9cc4-99cedca91882 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:30.751082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b092f1f3-2fd0-44f5-9cc4-99cedca91882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:30.753755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73cafed6dc6c4058b953d29a18c6c8a9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.754535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73cafed6dc6c4058b953d29a18c6c8a9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.772040 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3225/6480] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:30.773150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f1f3-2fd0-44f5-9cc4-99cedca91882 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:30.776869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73cafed6dc6c4058b953d29a18c6c8a9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.796024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73cafed6dc6c4058b953d29a18c6c8a9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.813114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b092f1f3-2fd0-44f5-9cc4-99cedca91882 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:30.828347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543314dc-743b-4963-82f0-4b90731f658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:30.831374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543314dc-743b-4963-82f0-4b90731f658a admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:30.831688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543314dc-743b-4963-82f0-4b90731f658a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:30.831963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543314dc-743b-4963-82f0-4b90731f658a admin admin] PATH_INFO: `/v3/projects/5e3f309bd4724451854a23a8b568cced/users/14271019c02b40688f6029a301c5b61b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:30.836451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73cafed6dc6c4058b953d29a18c6c8a9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:30.846006 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3256/6481] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:30 2022] DELETE /identity/v3/users/73cafed6dc6c4058b953d29a18c6c8a9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:30.846665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:30.850797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:30.882850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543314dc-743b-4963-82f0-4b90731f658a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3f309bd4724451854a23a8b568cced, user_id=14271019c02b40688f6029a301c5b61b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:30.885677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543314dc-743b-4963-82f0-4b90731f658a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:30.916755 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3226/6482] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:30 2022] PUT /identity/v3/projects/5e3f309bd4724451854a23a8b568cced/users/14271019c02b40688f6029a301c5b61b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:30.917599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a09258-886a-4948-98aa-17067175acbe None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:30.917914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a09258-886a-4948-98aa-17067175acbe None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:30.918182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a09258-886a-4948-98aa-17067175acbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:30.975978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-12a09258-886a-4948-98aa-17067175acbe None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:30.977227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-12a09258-886a-4948-98aa-17067175acbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:30.995600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ae6ff-b964-4e53-bf95-137d1baf45a3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:31.050297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:31.143775 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3227/6483] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:31.147411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf4cc0-ef07-4f91-9644-28337f64cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:31.148396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf4cc0-ef07-4f91-9644-28337f64cc3b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:31.148511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97a72c-c6e9-4ea9-a323-6516d9b838ac None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:31.148615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf4cc0-ef07-4f91-9644-28337f64cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:31.148615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf4cc0-ef07-4f91-9644-28337f64cc3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:31.148766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97a72c-c6e9-4ea9-a323-6516d9b838ac None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:31.148981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97a72c-c6e9-4ea9-a323-6516d9b838ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:31.149240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf4cc0-ef07-4f91-9644-28337f64cc3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:31.150954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf4cc0-ef07-4f91-9644-28337f64cc3b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:31.200096 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3257/6484] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:31.201102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf4cc0-ef07-4f91-9644-28337f64cc3b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:31.210382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fc97a72c-c6e9-4ea9-a323-6516d9b838ac None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:31.213952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fc97a72c-c6e9-4ea9-a323-6516d9b838ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:31.215426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-82bf4cc0-ef07-4f91-9644-28337f64cc3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:31.239354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf4cc0-ef07-4f91-9644-28337f64cc3b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:31.253790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acefe91-ede4-4632-90fd-0f01162ae180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:31.254528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acefe91-ede4-4632-90fd-0f01162ae180 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:31.257087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acefe91-ede4-4632-90fd-0f01162ae180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:31.257386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acefe91-ede4-4632-90fd-0f01162ae180 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:31.258099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acefe91-ede4-4632-90fd-0f01162ae180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:31.261145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acefe91-ede4-4632-90fd-0f01162ae180 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:31.274206 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3228/6485] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:31.281604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97a72c-c6e9-4ea9-a323-6516d9b838ac None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:31.299423 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3258/6486] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:31.302226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acefe91-ede4-4632-90fd-0f01162ae180 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:31.313455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acefe91-ede4-4632-90fd-0f01162ae180 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:31.320299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af58e-04fb-48b6-8e0c-a4e7ed8ca500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:31.321271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af58e-04fb-48b6-8e0c-a4e7ed8ca500 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:31.321775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af58e-04fb-48b6-8e0c-a4e7ed8ca500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:31.322302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8af58e-04fb-48b6-8e0c-a4e7ed8ca500 admin admin] PATH_INFO: `/v3/projects/0bac1775896b488d87378ac30f9dd9b4/users/a45ef50dc144410db265879ca9dca659/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:31.323003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97a72c-c6e9-4ea9-a323-6516d9b838ac None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:31.341612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd9878-69be-4126-b30a-a6a9e7bf4858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:31.342297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9878-69be-4126-b30a-a6a9e7bf4858 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:31.343123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9878-69be-4126-b30a-a6a9e7bf4858 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:31.343400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd9878-69be-4126-b30a-a6a9e7bf4858 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:31.344708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd9878-69be-4126-b30a-a6a9e7bf4858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:31.345145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd9878-69be-4126-b30a-a6a9e7bf4858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:31.347108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd9878-69be-4126-b30a-a6a9e7bf4858 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:31.354453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8af58e-04fb-48b6-8e0c-a4e7ed8ca500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bac1775896b488d87378ac30f9dd9b4, user_id=a45ef50dc144410db265879ca9dca659, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:31.358497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8af58e-04fb-48b6-8e0c-a4e7ed8ca500 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:31.373201 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3229/6487] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:31.373923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd9878-69be-4126-b30a-a6a9e7bf4858 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:31.382664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24cd9878-69be-4126-b30a-a6a9e7bf4858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:31.389408 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3259/6488] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:31 2022] PUT /identity/v3/projects/0bac1775896b488d87378ac30f9dd9b4/users/a45ef50dc144410db265879ca9dca659/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:31.389622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af58e-04fb-48b6-8e0c-a4e7ed8ca500 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:31.448071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:31.493042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd9878-69be-4126-b30a-a6a9e7bf4858 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:31.559956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8af58e-04fb-48b6-8e0c-a4e7ed8ca500 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:31.610986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a905d66-2301-48f1-9cd6-43f33e7c67f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:31.612124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a905d66-2301-48f1-9cd6-43f33e7c67f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:31.615479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a905d66-2301-48f1-9cd6-43f33e7c67f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:31.615479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a905d66-2301-48f1-9cd6-43f33e7c67f2 admin admin] PATH_INFO: `/v3/projects/5e3f309bd4724451854a23a8b568cced/users/14271019c02b40688f6029a301c5b61b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:31.624922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a905d66-2301-48f1-9cd6-43f33e7c67f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3f309bd4724451854a23a8b568cced, user_id=14271019c02b40688f6029a301c5b61b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:31.629908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a905d66-2301-48f1-9cd6-43f33e7c67f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:31.646009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf36540-d701-4f93-802c-e1aa930b2b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:31.646841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf36540-d701-4f93-802c-e1aa930b2b5b service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:31.647119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf36540-d701-4f93-802c-e1aa930b2b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:31.647384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf36540-d701-4f93-802c-e1aa930b2b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:31.666463 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3260/6489] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:31 2022] PUT /identity/v3/projects/5e3f309bd4724451854a23a8b568cced/users/14271019c02b40688f6029a301c5b61b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:31.670933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a905d66-2301-48f1-9cd6-43f33e7c67f2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:31.686523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf36540-d701-4f93-802c-e1aa930b2b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:31.687947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf36540-d701-4f93-802c-e1aa930b2b5b service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:31.707579 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3230/6490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:31.708618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf36540-d701-4f93-802c-e1aa930b2b5b service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:31.734135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf36540-d701-4f93-802c-e1aa930b2b5b service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:31.762659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a905d66-2301-48f1-9cd6-43f33e7c67f2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:31.770163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08792cac-baa9-42d1-8134-999bd391b190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:31.771069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08792cac-baa9-42d1-8134-999bd391b190 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:31.771485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08792cac-baa9-42d1-8134-999bd391b190 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:31.771979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08792cac-baa9-42d1-8134-999bd391b190 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:31.772740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08792cac-baa9-42d1-8134-999bd391b190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:31.775645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08792cac-baa9-42d1-8134-999bd391b190 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:31.819711 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3261/6491] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:31 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:31.819711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be3578-4a88-4a67-bc16-f250eedf2be1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:31.819711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be3578-4a88-4a67-bc16-f250eedf2be1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:31.819711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be3578-4a88-4a67-bc16-f250eedf2be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:31.838169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:31.871897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-38be3578-4a88-4a67-bc16-f250eedf2be1 None None] MFA Rules not processed for user `14271019c02b40688f6029a301c5b61b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:31.873383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-38be3578-4a88-4a67-bc16-f250eedf2be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:31.893484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bab133-7b9b-41ed-a07c-0a852d9a1ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:31.894782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bab133-7b9b-41ed-a07c-0a852d9a1ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:31.895418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bab133-7b9b-41ed-a07c-0a852d9a1ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:31.895916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bab133-7b9b-41ed-a07c-0a852d9a1ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:31.896671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bab133-7b9b-41ed-a07c-0a852d9a1ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:31.898652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bab133-7b9b-41ed-a07c-0a852d9a1ee2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:31.924695 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3231/6492] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:31.925861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bab133-7b9b-41ed-a07c-0a852d9a1ee2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:31.968977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bab133-7b9b-41ed-a07c-0a852d9a1ee2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:31.970082 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3262/6493] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:31.970893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be3578-4a88-4a67-bc16-f250eedf2be1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:32.067732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be3578-4a88-4a67-bc16-f250eedf2be1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:32.073216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa30b63-81a4-4a06-8cc2-3d9324494753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:32.073941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa30b63-81a4-4a06-8cc2-3d9324494753 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:32.074250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa30b63-81a4-4a06-8cc2-3d9324494753 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:32.074524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa30b63-81a4-4a06-8cc2-3d9324494753 admin admin] PATH_INFO: `/v3/projects/0bac1775896b488d87378ac30f9dd9b4/users/a45ef50dc144410db265879ca9dca659/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:32.076997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa30b63-81a4-4a06-8cc2-3d9324494753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bac1775896b488d87378ac30f9dd9b4, user_id=a45ef50dc144410db265879ca9dca659, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:32.080849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa30b63-81a4-4a06-8cc2-3d9324494753 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:32.103352 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3263/6494] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:31 2022] PUT /identity/v3/projects/0bac1775896b488d87378ac30f9dd9b4/users/a45ef50dc144410db265879ca9dca659/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:32.103352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa30b63-81a4-4a06-8cc2-3d9324494753 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:32.103352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2fa30b63-81a4-4a06-8cc2-3d9324494753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:32.103729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9769b81-2798-466d-b364-da14661704b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:32.103729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9769b81-2798-466d-b364-da14661704b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:32.104263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9769b81-2798-466d-b364-da14661704b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:32.104567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9769b81-2798-466d-b364-da14661704b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:32.105297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9769b81-2798-466d-b364-da14661704b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:32.107892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9769b81-2798-466d-b364-da14661704b7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:32.163544 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3232/6495] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:31 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:32.165166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9ad9-43b2-4b1e-8610-b96cc56687c9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:32.165548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9ad9-43b2-4b1e-8610-b96cc56687c9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:32.165934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f9ad9-43b2-4b1e-8610-b96cc56687c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:32.179969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa30b63-81a4-4a06-8cc2-3d9324494753 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:32.183709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe5fdf-b10d-4846-9f28-eeaac640eeae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:32.184344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5fdf-b10d-4846-9f28-eeaac640eeae service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:32.184800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5fdf-b10d-4846-9f28-eeaac640eeae service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:32.185065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe5fdf-b10d-4846-9f28-eeaac640eeae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:32.237148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:32.244507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-459f9ad9-43b2-4b1e-8610-b96cc56687c9 None None] MFA Rules not processed for user `a45ef50dc144410db265879ca9dca659`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:32.247682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-459f9ad9-43b2-4b1e-8610-b96cc56687c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:32.257487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:32.269115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe5fdf-b10d-4846-9f28-eeaac640eeae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:32.273243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe5fdf-b10d-4846-9f28-eeaac640eeae service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:32.288738 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3264/6496] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:32 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:32.289843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe5fdf-b10d-4846-9f28-eeaac640eeae service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:32.405271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe5fdf-b10d-4846-9f28-eeaac640eeae service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:32.415438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563cea4-7c1d-4dba-ade2-193e73ae6f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:32.416114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563cea4-7c1d-4dba-ade2-193e73ae6f98 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:32.416396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563cea4-7c1d-4dba-ade2-193e73ae6f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:32.416792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563cea4-7c1d-4dba-ade2-193e73ae6f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:32.417321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563cea4-7c1d-4dba-ade2-193e73ae6f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:32.424544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9563cea4-7c1d-4dba-ade2-193e73ae6f98 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:32.460153 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3265/6497] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:32.460153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563cea4-7c1d-4dba-ade2-193e73ae6f98 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:32.460455 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3233/6498] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:32.460882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9563cea4-7c1d-4dba-ade2-193e73ae6f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:32.461274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f9ad9-43b2-4b1e-8610-b96cc56687c9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:32.480287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f9ad9-43b2-4b1e-8610-b96cc56687c9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:32.486992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563cea4-7c1d-4dba-ade2-193e73ae6f98 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:32.489051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecf4dd-cb7f-4c54-89dd-844ef8511d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:32.489801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecf4dd-cb7f-4c54-89dd-844ef8511d47 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:32.490611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecf4dd-cb7f-4c54-89dd-844ef8511d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:32.491265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecf4dd-cb7f-4c54-89dd-844ef8511d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:32.492566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecf4dd-cb7f-4c54-89dd-844ef8511d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:32.495820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecf4dd-cb7f-4c54-89dd-844ef8511d47 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:32.500126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:32.500797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:32.501070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:32.501780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] PATH_INFO: `/v3/projects/8d88f4a4c0fb47acb78b79a3336ab15b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:32.504019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d88f4a4c0fb47acb78b79a3336ab15b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:32.508208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:32.521136 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3234/6499] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:32.522238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecf4dd-cb7f-4c54-89dd-844ef8511d47 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:32.547639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecf4dd-cb7f-4c54-89dd-844ef8511d47 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:32.553354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b13a49-b1a7-46c1-b3cc-960af13475be tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a45ef50dc144410db265879ca9dca659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bac1775896b488d87378ac30f9dd9b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:32.555163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b13a49-b1a7-46c1-b3cc-960af13475be tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:32.555607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b13a49-b1a7-46c1-b3cc-960af13475be tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:32.556047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b13a49-b1a7-46c1-b3cc-960af13475be tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:32.556880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b13a49-b1a7-46c1-b3cc-960af13475be tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:32.557703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b13a49-b1a7-46c1-b3cc-960af13475be tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:32.559481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b13a49-b1a7-46c1-b3cc-960af13475be tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:32.596668 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3235/6500] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:32.597934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b13a49-b1a7-46c1-b3cc-960af13475be tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:32.616078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d88f4a4c0fb47acb78b79a3336ab15b', 'request_id': 'req-c7c3ad0d-9492-48a8-a9bd-654e523dab34'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:32.616367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b13a49-b1a7-46c1-b3cc-960af13475be tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:32.628486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d88f4a4c0fb47acb78b79a3336ab15b', 'request_id': 'req-c7c3ad0d-9492-48a8-a9bd-654e523dab34'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:32.645794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d88f4a4c0fb47acb78b79a3336ab15b', 'request_id': 'req-c7c3ad0d-9492-48a8-a9bd-654e523dab34'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:32.664542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] The token cache is being invalidate because project 8d88f4a4c0fb47acb78b79a3336ab15b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:32.664542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:32.667957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:32.670030 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3266/6501] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:32 2022] DELETE /identity/v3/projects/8d88f4a4c0fb47acb78b79a3336ab15b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:32.670907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:32.674575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:32.776255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e9ac4-87f8-40c6-8425-e073284b8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:32.777984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e9ac4-87f8-40c6-8425-e073284b8d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:32.778503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e9ac4-87f8-40c6-8425-e073284b8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:32.778973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e9ac4-87f8-40c6-8425-e073284b8d4b admin admin] PATH_INFO: `/v3/projects/70240d1827af4c00b9bc9b4bed93601c/users/07464002c4414783ae012c2db7140190/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:32.805918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e9ac4-87f8-40c6-8425-e073284b8d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70240d1827af4c00b9bc9b4bed93601c, user_id=07464002c4414783ae012c2db7140190, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:32.809697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e9ac4-87f8-40c6-8425-e073284b8d4b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:32.837059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:32.846155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3ad0d-9492-48a8-a9bd-654e523dab34 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:32.873712 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3236/6502] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:32 2022] PUT /identity/v3/projects/70240d1827af4c00b9bc9b4bed93601c/users/07464002c4414783ae012c2db7140190/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:32.874813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e9ac4-87f8-40c6-8425-e073284b8d4b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:32.881662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ae6e9ac4-87f8-40c6-8425-e073284b8d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:32.999088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf708b-f993-4c7b-bf89-09ee8b1ad123 tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a45ef50dc144410db265879ca9dca659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bac1775896b488d87378ac30f9dd9b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:33.000927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf708b-f993-4c7b-bf89-09ee8b1ad123 tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:33.001951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf708b-f993-4c7b-bf89-09ee8b1ad123 tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:33.003161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf708b-f993-4c7b-bf89-09ee8b1ad123 tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:33.004579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf708b-f993-4c7b-bf89-09ee8b1ad123 tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:33.007721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf708b-f993-4c7b-bf89-09ee8b1ad123 tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:33.024971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e9ac4-87f8-40c6-8425-e073284b8d4b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:33.045276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:33.045967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:33.046413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:33.046760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] PATH_INFO: `/v3/users/15f78a95370843be9a19009fff112a8c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:33.051224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15f78a95370843be9a19009fff112a8c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:33.055800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:33.064789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:33.085045 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3267/6503] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:32 2022] POST /identity/v3/projects => generated 349 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:33.088228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de8e38-18cb-4c08-b07e-a061ff8bf0f7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:33.090298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de8e38-18cb-4c08-b07e-a061ff8bf0f7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:33.090298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de8e38-18cb-4c08-b07e-a061ff8bf0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:33.188112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15f78a95370843be9a19009fff112a8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:33.202219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-54de8e38-18cb-4c08-b07e-a061ff8bf0f7 None None] MFA Rules not processed for user `07464002c4414783ae012c2db7140190`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:33.205182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-54de8e38-18cb-4c08-b07e-a061ff8bf0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:33.211633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15f78a95370843be9a19009fff112a8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:33.250082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15f78a95370843be9a19009fff112a8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:33.259137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15f78a95370843be9a19009fff112a8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:33.259838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15f78a95370843be9a19009fff112a8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:33.273287 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3237/6504] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:32 2022] DELETE /identity/v3/users/15f78a95370843be9a19009fff112a8c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:33.274777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:33.278279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:33.384244 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3268/6505] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:33.397840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de8e38-18cb-4c08-b07e-a061ff8bf0f7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:33.399161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-54de8e38-18cb-4c08-b07e-a061ff8bf0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:33.435288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eba161-5348-4893-b0ec-1d016f5a1376 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:33.447317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b577be-6bc8-4fb2-82aa-f4cfdec7da5c tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a45ef50dc144410db265879ca9dca659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bac1775896b488d87378ac30f9dd9b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:33.449154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b577be-6bc8-4fb2-82aa-f4cfdec7da5c tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:33.449375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b577be-6bc8-4fb2-82aa-f4cfdec7da5c tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:33.449648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b577be-6bc8-4fb2-82aa-f4cfdec7da5c tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:33.451378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b577be-6bc8-4fb2-82aa-f4cfdec7da5c tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:33.451691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b577be-6bc8-4fb2-82aa-f4cfdec7da5c tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:33.455423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b577be-6bc8-4fb2-82aa-f4cfdec7da5c tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:33.479196 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3238/6506] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:33.513632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b577be-6bc8-4fb2-82aa-f4cfdec7da5c tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:33.516410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-82b577be-6bc8-4fb2-82aa-f4cfdec7da5c tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:33.529408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de8e38-18cb-4c08-b07e-a061ff8bf0f7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:33.595762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:33.644356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a51a2-2011-4579-afb6-7dca9e30068d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:33.644988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a51a2-2011-4579-afb6-7dca9e30068d service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:33.645392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a51a2-2011-4579-afb6-7dca9e30068d service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:33.645560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a51a2-2011-4579-afb6-7dca9e30068d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:33.719432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b577be-6bc8-4fb2-82aa-f4cfdec7da5c tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:33.729784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601881-82cc-4556-9d30-49460272aadc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:33.732248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601881-82cc-4556-9d30-49460272aadc service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:33.732538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601881-82cc-4556-9d30-49460272aadc service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:33.732815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67601881-82cc-4556-9d30-49460272aadc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:33.764697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67601881-82cc-4556-9d30-49460272aadc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:33.770626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67601881-82cc-4556-9d30-49460272aadc service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:33.802376 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3239/6507] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:45:33.823094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a51a2-2011-4579-afb6-7dca9e30068d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:33.824628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a51a2-2011-4579-afb6-7dca9e30068d service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:33.836613 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3269/6508] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:34.202865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601881-82cc-4556-9d30-49460272aadc service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:34.205627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-67601881-82cc-4556-9d30-49460272aadc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:34.242121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:34.379008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67601881-82cc-4556-9d30-49460272aadc service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:34.418703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:34.419559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:34.419811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:34.420085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] PATH_INFO: `/v3/projects/65d0e031e7b443a1bd7c050b4c539d66` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:34.422102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d0e031e7b443a1bd7c050b4c539d66)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:34.426053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:34.472873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a51a2-2011-4579-afb6-7dca9e30068d service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:34.489921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a51a2-2011-4579-afb6-7dca9e30068d service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:34.505746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a45ef50dc144410db265879ca9dca659', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bac1775896b488d87378ac30f9dd9b4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:34.506844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:34.507154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:34.507602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] PATH_INFO: `/v3/projects/af39c9ff9b6748e7b85a07f1d6772b22` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:34.509044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af39c9ff9b6748e7b85a07f1d6772b22)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:34.513932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:34.543996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d0e031e7b443a1bd7c050b4c539d66', 'request_id': 'req-429d2433-5a60-4274-b34a-311d6a22e6f9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.558680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d0e031e7b443a1bd7c050b4c539d66', 'request_id': 'req-429d2433-5a60-4274-b34a-311d6a22e6f9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.570204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d0e031e7b443a1bd7c050b4c539d66', 'request_id': 'req-429d2433-5a60-4274-b34a-311d6a22e6f9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.593837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] The token cache is being invalidate because project 65d0e031e7b443a1bd7c050b4c539d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:34.594285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.594881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-429d2433-5a60-4274-b34a-311d6a22e6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.605138 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3240/6509] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:34 2022] DELETE /identity/v3/projects/65d0e031e7b443a1bd7c050b4c539d66 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:34.606828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac1846-5d86-4447-8af4-10c6d56e53a9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:34.607114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac1846-5d86-4447-8af4-10c6d56e53a9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:34.607389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac1846-5d86-4447-8af4-10c6d56e53a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:34.610029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af39c9ff9b6748e7b85a07f1d6772b22', 'request_id': 'req-b8226fd5-3553-4a40-951f-e011a199b7ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.618966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af39c9ff9b6748e7b85a07f1d6772b22', 'request_id': 'req-b8226fd5-3553-4a40-951f-e011a199b7ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.633931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af39c9ff9b6748e7b85a07f1d6772b22', 'request_id': 'req-b8226fd5-3553-4a40-951f-e011a199b7ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.663936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] The token cache is being invalidate because project af39c9ff9b6748e7b85a07f1d6772b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:34.665005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.666401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.666886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b6ac1846-5d86-4447-8af4-10c6d56e53a9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:34.668555 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3270/6510] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:34 2022] DELETE /identity/v3/projects/af39c9ff9b6748e7b85a07f1d6772b22 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:34.674609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b6ac1846-5d86-4447-8af4-10c6d56e53a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:34.689240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:34.690717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:34.765360 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3241/6511] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:45:34.768861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b61ad-569f-4dde-893e-966ca05d6145 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:34.769301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b61ad-569f-4dde-893e-966ca05d6145 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:34.769589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b61ad-569f-4dde-893e-966ca05d6145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:34.799036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-266b61ad-569f-4dde-893e-966ca05d6145 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:34.800643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-266b61ad-569f-4dde-893e-966ca05d6145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:34.808749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8226fd5-3553-4a40-951f-e011a199b7ac tempest-QuotasTest-605132279 tempest-QuotasTest-605132279-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:34.814843 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3242/6512] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:34.815472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:34.816255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:34.816533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:34.816801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] PATH_INFO: `/v3/users/07464002c4414783ae012c2db7140190` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:34.817367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b61ad-569f-4dde-893e-966ca05d6145 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:34.818428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07464002c4414783ae012c2db7140190)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:34.820493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:34.841294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:34.843278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b61ad-569f-4dde-893e-966ca05d6145 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:34.859999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d02e75-6335-4074-b392-13594acf0ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:34.861043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d02e75-6335-4074-b392-13594acf0ccf admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:34.862192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d02e75-6335-4074-b392-13594acf0ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:34.863641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d02e75-6335-4074-b392-13594acf0ccf admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:34.864604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d02e75-6335-4074-b392-13594acf0ccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:34.865371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d02e75-6335-4074-b392-13594acf0ccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:34.874135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d02e75-6335-4074-b392-13594acf0ccf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:34.904595 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3243/6513] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:34.905784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d02e75-6335-4074-b392-13594acf0ccf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:34.915533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07464002c4414783ae012c2db7140190'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.916556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07464002c4414783ae012c2db7140190'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.928663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d02e75-6335-4074-b392-13594acf0ccf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:34.932589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07464002c4414783ae012c2db7140190'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.944899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e5381-61fd-4ef4-b827-effa42b3b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:34.945953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e5381-61fd-4ef4-b827-effa42b3b269 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:34.946342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e5381-61fd-4ef4-b827-effa42b3b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:34.946654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e5381-61fd-4ef4-b827-effa42b3b269 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:34.949357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e5381-61fd-4ef4-b827-effa42b3b269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:34.954455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07464002c4414783ae012c2db7140190'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.959154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e5381-61fd-4ef4-b827-effa42b3b269 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:34.980641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-defbc81c-ed81-4927-9730-7a9840da91e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07464002c4414783ae012c2db7140190'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:34.999481 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3271/6514] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:34 2022] DELETE /identity/v3/users/07464002c4414783ae012c2db7140190 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:35.005252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf418d-b976-46eb-9141-2371171731f4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:35.005691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf418d-b976-46eb-9141-2371171731f4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:35.005898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf418d-b976-46eb-9141-2371171731f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:35.021937 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3244/6515] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:34 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:35.023293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e5381-61fd-4ef4-b827-effa42b3b269 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:35.025859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0d0e5381-61fd-4ef4-b827-effa42b3b269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:35.036240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:35.048420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-35cf418d-b976-46eb-9141-2371171731f4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:35.050993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-35cf418d-b976-46eb-9141-2371171731f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:35.209159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e5381-61fd-4ef4-b827-effa42b3b269 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:35.218992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dead0-0763-45ca-9ba3-198d1a1824e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:35.219635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dead0-0763-45ca-9ba3-198d1a1824e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:35.219907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dead0-0763-45ca-9ba3-198d1a1824e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:35.220180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dead0-0763-45ca-9ba3-198d1a1824e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:35.220826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dead0-0763-45ca-9ba3-198d1a1824e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:35.225708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17dead0-0763-45ca-9ba3-198d1a1824e7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:35.248745 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3272/6516] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:35.249890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf418d-b976-46eb-9141-2371171731f4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:35.254365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-35cf418d-b976-46eb-9141-2371171731f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:35.281733 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3245/6517] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:35 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:35.284108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf418d-b976-46eb-9141-2371171731f4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:35.285940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dead0-0763-45ca-9ba3-198d1a1824e7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:35.306019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:35.306902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:35.307327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:35.307742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] PATH_INFO: `/v3/users/ef5af1eefc54489899437e0166f82c14` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:35.310461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5af1eefc54489899437e0166f82c14)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:35.313234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:35.317254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dead0-0763-45ca-9ba3-198d1a1824e7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:35.330693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab53251-b6ea-4ebb-bdce-2987850604f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:35.331332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab53251-b6ea-4ebb-bdce-2987850604f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:35.331643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab53251-b6ea-4ebb-bdce-2987850604f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:35.331909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab53251-b6ea-4ebb-bdce-2987850604f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:35.332574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab53251-b6ea-4ebb-bdce-2987850604f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:35.334366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab53251-b6ea-4ebb-bdce-2987850604f9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:35.361790 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3246/6518] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:35.363982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab53251-b6ea-4ebb-bdce-2987850604f9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:35.369205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cab53251-b6ea-4ebb-bdce-2987850604f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:35.420865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5af1eefc54489899437e0166f82c14'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:35.421997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5af1eefc54489899437e0166f82c14'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:35.440790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5af1eefc54489899437e0166f82c14'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:35.460209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5af1eefc54489899437e0166f82c14'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:35.488016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5af1eefc54489899437e0166f82c14'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:35.497231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab53251-b6ea-4ebb-bdce-2987850604f9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:35.508716 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3273/6519] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:35 2022] DELETE /identity/v3/users/ef5af1eefc54489899437e0166f82c14 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:35.508860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3634ce-5c7b-4982-9b01-64b5ed7e3084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:35.508971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:35.509539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3634ce-5c7b-4982-9b01-64b5ed7e3084 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:35.511087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3634ce-5c7b-4982-9b01-64b5ed7e3084 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:35.511382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:35.512061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3634ce-5c7b-4982-9b01-64b5ed7e3084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:35.518528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2e3634ce-5c7b-4982-9b01-64b5ed7e3084 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:35.526893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:35.556704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3634ce-5c7b-4982-9b01-64b5ed7e3084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:35.561690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3634ce-5c7b-4982-9b01-64b5ed7e3084 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:35.591122 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3247/6520] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:35.593557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082663d0-1aca-4c98-9858-3066b562746a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:35.595634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082663d0-1aca-4c98-9858-3066b562746a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:35.595793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082663d0-1aca-4c98-9858-3066b562746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:35.663436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-082663d0-1aca-4c98-9858-3066b562746a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:35.666968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-082663d0-1aca-4c98-9858-3066b562746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:35.671822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cafb6-2c94-4a44-b1ee-cc82774a9688 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:35.691484 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3248/6521] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:35.698671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef19d3-f302-4260-8c0f-2f173d727c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:35.699373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef19d3-f302-4260-8c0f-2f173d727c23 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:35.699661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef19d3-f302-4260-8c0f-2f173d727c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:35.700104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef19d3-f302-4260-8c0f-2f173d727c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:35.700637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef19d3-f302-4260-8c0f-2f173d727c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:35.702280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef19d3-f302-4260-8c0f-2f173d727c23 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:35.712935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082663d0-1aca-4c98-9858-3066b562746a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:35.714653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-082663d0-1aca-4c98-9858-3066b562746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:35.735153 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3274/6522] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:35.742102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef19d3-f302-4260-8c0f-2f173d727c23 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:35.760433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef19d3-f302-4260-8c0f-2f173d727c23 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:35.774512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c316deb-b22c-4732-b26a-b1e2ec6baa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:35.775404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316deb-b22c-4732-b26a-b1e2ec6baa2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:35.775848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316deb-b22c-4732-b26a-b1e2ec6baa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:35.776129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316deb-b22c-4732-b26a-b1e2ec6baa2d admin admin] PATH_INFO: `/v3/projects/6d15c1a3cdbe497c85299be456977ed2/users/e4551491ca3449b8ad43fa899496cfba/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:35.810546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c316deb-b22c-4732-b26a-b1e2ec6baa2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d15c1a3cdbe497c85299be456977ed2, user_id=e4551491ca3449b8ad43fa899496cfba, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:35.816980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c316deb-b22c-4732-b26a-b1e2ec6baa2d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:35.853814 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3275/6523] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:35 2022] PUT /identity/v3/projects/6d15c1a3cdbe497c85299be456977ed2/users/e4551491ca3449b8ad43fa899496cfba/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:35.866326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0c874-67f3-4032-9589-18e41ef4c72d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:35.866615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0c874-67f3-4032-9589-18e41ef4c72d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:35.866888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0c874-67f3-4032-9589-18e41ef4c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:35.868820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082663d0-1aca-4c98-9858-3066b562746a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:35.912766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a0d0c874-67f3-4032-9589-18e41ef4c72d None None] MFA Rules not processed for user `e4551491ca3449b8ad43fa899496cfba`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:35.914232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a0d0c874-67f3-4032-9589-18e41ef4c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:35.986958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:36.008429 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3276/6524] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:36.013520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0c874-67f3-4032-9589-18e41ef4c72d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.029094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d0c874-67f3-4032-9589-18e41ef4c72d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.034162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a4e50-3407-489a-bfb5-d3e2d0a2ca60 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.035541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a4e50-3407-489a-bfb5-d3e2d0a2ca60 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.035541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a4e50-3407-489a-bfb5-d3e2d0a2ca60 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.035771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a4e50-3407-489a-bfb5-d3e2d0a2ca60 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.036452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a4e50-3407-489a-bfb5-d3e2d0a2ca60 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e4551491ca3449b8ad43fa899496cfba)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.038319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34a4e50-3407-489a-bfb5-d3e2d0a2ca60 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.050219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00f900-1093-48bc-ab14-9b6c83eb627c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.051230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00f900-1093-48bc-ab14-9b6c83eb627c service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.051606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00f900-1093-48bc-ab14-9b6c83eb627c service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.051871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00f900-1093-48bc-ab14-9b6c83eb627c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.073710 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3277/6525] 10.222.0.43 () {60 vars in 1299 bytes} [Tue Aug 30 04:45:36 2022] POST /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2 => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:36.077956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a4e50-3407-489a-bfb5-d3e2d0a2ca60 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.102224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a4e50-3407-489a-bfb5-d3e2d0a2ca60 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.117459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d14fa-b6d4-4503-a933-7096b473df31 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.118784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d14fa-b6d4-4503-a933-7096b473df31 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.120307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d14fa-b6d4-4503-a933-7096b473df31 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.120912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d14fa-b6d4-4503-a933-7096b473df31 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/861c6dad18cb49e397162ecd63056add` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.125129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d14fa-b6d4-4503-a933-7096b473df31 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e4551491ca3449b8ad43fa899496cfba, credential_id=861c6dad18cb49e397162ecd63056add)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.132108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d14fa-b6d4-4503-a933-7096b473df31 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.192058 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3278/6526] 10.222.0.43 () {58 vars in 1380 bytes} [Tue Aug 30 04:45:36 2022] DELETE /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/861c6dad18cb49e397162ecd63056add => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:36.198112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d14fa-b6d4-4503-a933-7096b473df31 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.224865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d14fa-b6d4-4503-a933-7096b473df31 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.244183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5a187-9016-4a62-9c1a-b8dcd58186a6 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.244879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a187-9016-4a62-9c1a-b8dcd58186a6 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.245763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a187-9016-4a62-9c1a-b8dcd58186a6 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.245763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e5a187-9016-4a62-9c1a-b8dcd58186a6 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.246119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5a187-9016-4a62-9c1a-b8dcd58186a6 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e4551491ca3449b8ad43fa899496cfba)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.248587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00f900-1093-48bc-ab14-9b6c83eb627c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.248820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e5a187-9016-4a62-9c1a-b8dcd58186a6 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.250112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00f900-1093-48bc-ab14-9b6c83eb627c service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.272379 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3249/6527] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:45:36.282383 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3279/6528] 10.222.0.43 () {60 vars in 1299 bytes} [Tue Aug 30 04:45:36 2022] POST /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2 => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:36.286430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00f900-1093-48bc-ab14-9b6c83eb627c service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.291717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5a187-9016-4a62-9c1a-b8dcd58186a6 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.302323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-57e5a187-9016-4a62-9c1a-b8dcd58186a6 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:36.303945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00f900-1093-48bc-ab14-9b6c83eb627c service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.318472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6bfac-8a20-4ccf-a65a-b6aab0652101 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.319851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6bfac-8a20-4ccf-a65a-b6aab0652101 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.320150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6bfac-8a20-4ccf-a65a-b6aab0652101 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.320427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6bfac-8a20-4ccf-a65a-b6aab0652101 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/027bd324e0314cba97d868b8a03797c1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.331977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6bfac-8a20-4ccf-a65a-b6aab0652101 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e4551491ca3449b8ad43fa899496cfba, credential_id=027bd324e0314cba97d868b8a03797c1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.333494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6bfac-8a20-4ccf-a65a-b6aab0652101 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.348710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e5a187-9016-4a62-9c1a-b8dcd58186a6 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.366210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.366533 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3250/6529] 10.222.0.43 () {58 vars in 1380 bytes} [Tue Aug 30 04:45:36 2022] DELETE /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/027bd324e0314cba97d868b8a03797c1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:36.366986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.367263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.367369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6bfac-8a20-4ccf-a65a-b6aab0652101 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.367586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] PATH_INFO: `/v3/users/6d4d9f2123e84a76a91e27cda159ab7b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.369128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4d9f2123e84a76a91e27cda159ab7b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.373599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.387464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6bfac-8a20-4ccf-a65a-b6aab0652101 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.402261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce47a85-ac52-4123-8439-4708ba9d2e33 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.403091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce47a85-ac52-4123-8439-4708ba9d2e33 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.403381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce47a85-ac52-4123-8439-4708ba9d2e33 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.403655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce47a85-ac52-4123-8439-4708ba9d2e33 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/027bd324e0314cba97d868b8a03797c1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.419867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6ce47a85-ac52-4123-8439-4708ba9d2e33 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Could not find credential: 2582b79584e28c5ff524d2e9028c8512b01fdf458d0b801106397e1f0fa72ef8.: keystone.exception.CredentialNotFound: Could not find credential: 2582b79584e28c5ff524d2e9028c8512b01fdf458d0b801106397e1f0fa72ef8. Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 30 04:45:36.430519 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:45:36.431414 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 2582b79584e28c5ff524d2e9028c8512b01fdf458d0b801106397e1f0fa72ef8. Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:45:36.432871 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3251/6530] 10.222.0.43 () {58 vars in 1377 bytes} [Tue Aug 30 04:45:36 2022] GET /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/027bd324e0314cba97d868b8a03797c1 => generated 148 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:45:36.437468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce47a85-ac52-4123-8439-4708ba9d2e33 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.461309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce47a85-ac52-4123-8439-4708ba9d2e33 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.469866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67d32a-4a03-45fc-b7c8-1ad9cdd9921b tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.470551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67d32a-4a03-45fc-b7c8-1ad9cdd9921b tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.470828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67d32a-4a03-45fc-b7c8-1ad9cdd9921b tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.471099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67d32a-4a03-45fc-b7c8-1ad9cdd9921b tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.471760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67d32a-4a03-45fc-b7c8-1ad9cdd9921b tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e4551491ca3449b8ad43fa899496cfba)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.473325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67d32a-4a03-45fc-b7c8-1ad9cdd9921b tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.488053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4d9f2123e84a76a91e27cda159ab7b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:36.489668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4d9f2123e84a76a91e27cda159ab7b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:36.508329 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3252/6531] 10.222.0.43 () {60 vars in 1299 bytes} [Tue Aug 30 04:45:36 2022] POST /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2 => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:36.509324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67d32a-4a03-45fc-b7c8-1ad9cdd9921b tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.525686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4d9f2123e84a76a91e27cda159ab7b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:36.530811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67d32a-4a03-45fc-b7c8-1ad9cdd9921b tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.542459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc5d1-364a-490e-8b05-b509833c9a0d tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.543219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc5d1-364a-490e-8b05-b509833c9a0d tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.543512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc5d1-364a-490e-8b05-b509833c9a0d tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.543809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cc5d1-364a-490e-8b05-b509833c9a0d tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.544477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cc5d1-364a-490e-8b05-b509833c9a0d tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e4551491ca3449b8ad43fa899496cfba)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.546091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cc5d1-364a-490e-8b05-b509833c9a0d tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.546629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4d9f2123e84a76a91e27cda159ab7b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:36.573856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3b3026d0-d62a-4b23-87e7-0f52f3efa7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4d9f2123e84a76a91e27cda159ab7b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:36.579475 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3253/6532] 10.222.0.43 () {60 vars in 1299 bytes} [Tue Aug 30 04:45:36 2022] POST /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2 => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:36.580531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc5d1-364a-490e-8b05-b509833c9a0d tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.590861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c53cc5d1-364a-490e-8b05-b509833c9a0d tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:36.602241 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3280/6533] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:36 2022] DELETE /identity/v3/users/6d4d9f2123e84a76a91e27cda159ab7b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:36.604056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c9691-aad6-4aed-9809-9fab1a01e551 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.604325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c9691-aad6-4aed-9809-9fab1a01e551 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.604598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c9691-aad6-4aed-9809-9fab1a01e551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.613147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cc5d1-364a-490e-8b05-b509833c9a0d tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.658985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-676c9691-aad6-4aed-9809-9fab1a01e551 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:36.660298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-676c9691-aad6-4aed-9809-9fab1a01e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:36.778063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f846de-2838-4f2e-ad63-8fba1a72e10f tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.778735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f846de-2838-4f2e-ad63-8fba1a72e10f tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.779013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f846de-2838-4f2e-ad63-8fba1a72e10f tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.779284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f846de-2838-4f2e-ad63-8fba1a72e10f tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.779885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f846de-2838-4f2e-ad63-8fba1a72e10f tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=e4551491ca3449b8ad43fa899496cfba)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.782418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f846de-2838-4f2e-ad63-8fba1a72e10f tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.815494 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3254/6534] 10.222.0.43 () {58 vars in 1278 bytes} [Tue Aug 30 04:45:36 2022] GET /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2 => generated 865 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:36.817177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f846de-2838-4f2e-ad63-8fba1a72e10f tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.827941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f846de-2838-4f2e-ad63-8fba1a72e10f tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.829214 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3281/6535] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:36.834301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d601bf1-bf15-45eb-b461-b259dfa2b42e tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.835368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601bf1-bf15-45eb-b461-b259dfa2b42e tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.836715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601bf1-bf15-45eb-b461-b259dfa2b42e tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.836715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601bf1-bf15-45eb-b461-b259dfa2b42e tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/58a7a6f2ec87401b8d05042e25278077` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.838638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d601bf1-bf15-45eb-b461-b259dfa2b42e tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e4551491ca3449b8ad43fa899496cfba, credential_id=58a7a6f2ec87401b8d05042e25278077)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.840251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d601bf1-bf15-45eb-b461-b259dfa2b42e tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.865993 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3255/6536] 10.222.0.43 () {58 vars in 1380 bytes} [Tue Aug 30 04:45:36 2022] DELETE /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/58a7a6f2ec87401b8d05042e25278077 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:36.868534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c9691-aad6-4aed-9809-9fab1a01e551 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.870764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-676c9691-aad6-4aed-9809-9fab1a01e551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:36.874490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d601bf1-bf15-45eb-b461-b259dfa2b42e tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:36.900432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d601bf1-bf15-45eb-b461-b259dfa2b42e tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:36.917513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4745fbb-4276-4dd0-9821-70f7b4ffe44a tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:36.918296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4745fbb-4276-4dd0-9821-70f7b4ffe44a tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:36.918583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4745fbb-4276-4dd0-9821-70f7b4ffe44a tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:36.919616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4745fbb-4276-4dd0-9821-70f7b4ffe44a tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/528c9b2eff1c4a1facc0c0c4e4d1a001` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:36.922686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4745fbb-4276-4dd0-9821-70f7b4ffe44a tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e4551491ca3449b8ad43fa899496cfba, credential_id=528c9b2eff1c4a1facc0c0c4e4d1a001)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:36.941116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4745fbb-4276-4dd0-9821-70f7b4ffe44a tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:36.998537 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3256/6537] 10.222.0.43 () {58 vars in 1380 bytes} [Tue Aug 30 04:45:36 2022] DELETE /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/528c9b2eff1c4a1facc0c0c4e4d1a001 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:36.999592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4745fbb-4276-4dd0-9821-70f7b4ffe44a tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:37.025827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4745fbb-4276-4dd0-9821-70f7b4ffe44a tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:37.036969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017731ca-32f0-440a-8ba4-34ddaf32a9f5 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:37.038412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017731ca-32f0-440a-8ba4-34ddaf32a9f5 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:37.039804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017731ca-32f0-440a-8ba4-34ddaf32a9f5 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:37.040091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017731ca-32f0-440a-8ba4-34ddaf32a9f5 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:37.043234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017731ca-32f0-440a-8ba4-34ddaf32a9f5 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=e4551491ca3449b8ad43fa899496cfba)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:37.046036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017731ca-32f0-440a-8ba4-34ddaf32a9f5 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:37.046826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c9691-aad6-4aed-9809-9fab1a01e551 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:37.061902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b69ab-df5f-4bbb-8d16-f0aa850098dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:37.062597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b69ab-df5f-4bbb-8d16-f0aa850098dc service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:37.062875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b69ab-df5f-4bbb-8d16-f0aa850098dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:37.063697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b69ab-df5f-4bbb-8d16-f0aa850098dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:37.063818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:37.102826 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3257/6538] 10.222.0.43 () {60 vars in 1299 bytes} [Tue Aug 30 04:45:36 2022] POST /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2 => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:37.105428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017731ca-32f0-440a-8ba4-34ddaf32a9f5 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:37.108248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b69ab-df5f-4bbb-8d16-f0aa850098dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:37.113726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b69ab-df5f-4bbb-8d16-f0aa850098dc service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:37.134729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017731ca-32f0-440a-8ba4-34ddaf32a9f5 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:37.148297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c872e-a48b-4fe1-a940-d8b7aa86f9a8 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:37.149019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c872e-a48b-4fe1-a940-d8b7aa86f9a8 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:37.149300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c872e-a48b-4fe1-a940-d8b7aa86f9a8 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:37.149574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c872e-a48b-4fe1-a940-d8b7aa86f9a8 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/dabadbdae289413685b006055683d8ce` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:37.154129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c872e-a48b-4fe1-a940-d8b7aa86f9a8 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=e4551491ca3449b8ad43fa899496cfba, credential_id=dabadbdae289413685b006055683d8ce)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:37.157245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c872e-a48b-4fe1-a940-d8b7aa86f9a8 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:37.170994 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3282/6539] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:37.173831 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3258/6540] 10.222.0.43 () {58 vars in 1377 bytes} [Tue Aug 30 04:45:37 2022] GET /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/dabadbdae289413685b006055683d8ce => generated 367 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:37.179580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b69ab-df5f-4bbb-8d16-f0aa850098dc service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:37.211134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b69ab-df5f-4bbb-8d16-f0aa850098dc service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:37.225682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2e725-8a06-45c3-a233-8b2a86ddf149 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4551491ca3449b8ad43fa899496cfba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d15c1a3cdbe497c85299be456977ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:37.227635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e725-8a06-45c3-a233-8b2a86ddf149 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:37.227921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e725-8a06-45c3-a233-8b2a86ddf149 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:37.228194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2e725-8a06-45c3-a233-8b2a86ddf149 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/dabadbdae289413685b006055683d8ce` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:37.234236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2e725-8a06-45c3-a233-8b2a86ddf149 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=e4551491ca3449b8ad43fa899496cfba, credential_id=dabadbdae289413685b006055683d8ce)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:37.235698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2e725-8a06-45c3-a233-8b2a86ddf149 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:37.277565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c872e-a48b-4fe1-a940-d8b7aa86f9a8 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:37.277749 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3283/6541] 10.222.0.43 () {58 vars in 1380 bytes} [Tue Aug 30 04:45:37 2022] DELETE /identity/v3/users/e4551491ca3449b8ad43fa899496cfba/credentials/OS-EC2/dabadbdae289413685b006055683d8ce => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:37.279721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8d9c872e-a48b-4fe1-a940-d8b7aa86f9a8 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:37.316853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c872e-a48b-4fe1-a940-d8b7aa86f9a8 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:37.323138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:37.323796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:37.324075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:37.324779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] PATH_INFO: `/v3/users/e4551491ca3449b8ad43fa899496cfba` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:37.326181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4551491ca3449b8ad43fa899496cfba)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:37.328283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:37.396383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2e725-8a06-45c3-a233-8b2a86ddf149 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:37.414230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0cb2e725-8a06-45c3-a233-8b2a86ddf149 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:37.417752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4551491ca3449b8ad43fa899496cfba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:37.449599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2e725-8a06-45c3-a233-8b2a86ddf149 tempest-EC2CredentialsTest-1421789523 tempest-EC2CredentialsTest-1421789523-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:37.461670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:37.462992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:37.462992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:37.463231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] PATH_INFO: `/v3/users/a9710d5d3d7f4cd79f33d2fb78dee719` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:37.464943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9710d5d3d7f4cd79f33d2fb78dee719)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:37.466967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4551491ca3449b8ad43fa899496cfba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:37.468533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:37.493458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4551491ca3449b8ad43fa899496cfba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:37.508744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4551491ca3449b8ad43fa899496cfba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:37.509920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4551491ca3449b8ad43fa899496cfba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:37.511527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:37.521006 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3259/6542] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:37 2022] DELETE /identity/v3/users/e4551491ca3449b8ad43fa899496cfba => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:37.522222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:37.524244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:37.579423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9710d5d3d7f4cd79f33d2fb78dee719'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:37.580414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9710d5d3d7f4cd79f33d2fb78dee719'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:37.598884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9710d5d3d7f4cd79f33d2fb78dee719'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:37.617849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9710d5d3d7f4cd79f33d2fb78dee719'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:37.646940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-508a1b36-092e-4c13-9f32-b567ad3dc80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9710d5d3d7f4cd79f33d2fb78dee719'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:37.656053 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3284/6543] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:37 2022] DELETE /identity/v3/users/a9710d5d3d7f4cd79f33d2fb78dee719 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:37.657655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd090-e57d-4639-b8ab-8e817798fa12 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:37.659062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd090-e57d-4639-b8ab-8e817798fa12 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:37.664037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfd090-e57d-4639-b8ab-8e817798fa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:37.718411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2ecfd090-e57d-4639-b8ab-8e817798fa12 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:37.721540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2ecfd090-e57d-4639-b8ab-8e817798fa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:37.874522 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3285/6544] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:37.875710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd090-e57d-4639-b8ab-8e817798fa12 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:37.878801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2ecfd090-e57d-4639-b8ab-8e817798fa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:37.908580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfd090-e57d-4639-b8ab-8e817798fa12 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:37.918712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:37.918993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:37.920054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:37.920054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] PATH_INFO: `/v3/projects/77c448f629da4a4e96681e9dae759ac6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:37.924579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c448f629da4a4e96681e9dae759ac6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:37.934220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:38.014063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c448f629da4a4e96681e9dae759ac6', 'request_id': 'req-168611e1-4ddb-4afe-918d-9c18a3d60ab5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.023179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c448f629da4a4e96681e9dae759ac6', 'request_id': 'req-168611e1-4ddb-4afe-918d-9c18a3d60ab5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.034441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c448f629da4a4e96681e9dae759ac6', 'request_id': 'req-168611e1-4ddb-4afe-918d-9c18a3d60ab5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.072715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] The token cache is being invalidate because project 77c448f629da4a4e96681e9dae759ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:38.075667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.076478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-168611e1-4ddb-4afe-918d-9c18a3d60ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.080256 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3286/6545] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:37 2022] DELETE /identity/v3/projects/77c448f629da4a4e96681e9dae759ac6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:38.087496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80a16-02f4-4a5f-a872-1917abed33e1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:38.087775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80a16-02f4-4a5f-a872-1917abed33e1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:38.088018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f80a16-02f4-4a5f-a872-1917abed33e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:38.102849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c97d6-4c8e-4321-b94e-90cfab73d067 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:38.128647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e5f80a16-02f4-4a5f-a872-1917abed33e1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:38.130117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e5f80a16-02f4-4a5f-a872-1917abed33e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:38.177568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:38.262877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:38.263395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:38.263678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:38.263954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] PATH_INFO: `/v3/projects/70240d1827af4c00b9bc9b4bed93601c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:38.265218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70240d1827af4c00b9bc9b4bed93601c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:38.272448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:38.285231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:38.321137 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3287/6546] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:38.323413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f80a16-02f4-4a5f-a872-1917abed33e1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:38.341267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e5f80a16-02f4-4a5f-a872-1917abed33e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:38.346940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70240d1827af4c00b9bc9b4bed93601c', 'request_id': 'req-abc35724-0642-492c-9fe9-9b74d5a98053'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.368501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70240d1827af4c00b9bc9b4bed93601c', 'request_id': 'req-abc35724-0642-492c-9fe9-9b74d5a98053'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.384187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70240d1827af4c00b9bc9b4bed93601c', 'request_id': 'req-abc35724-0642-492c-9fe9-9b74d5a98053'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.415049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] The token cache is being invalidate because project 70240d1827af4c00b9bc9b4bed93601c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:38.415418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.416230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.422506 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3260/6547] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:37 2022] DELETE /identity/v3/projects/70240d1827af4c00b9bc9b4bed93601c => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:38.423538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:38.427735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:38.506420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f80a16-02f4-4a5f-a872-1917abed33e1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:38.590050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc35724-0642-492c-9fe9-9b74d5a98053 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:38.618684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:38.619531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:38.619846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:38.620183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] PATH_INFO: `/v3/users/a45ef50dc144410db265879ca9dca659` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:38.622902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45ef50dc144410db265879ca9dca659)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:38.631041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:38.658059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f447a2-557e-40af-8892-161bb0a61e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:38.659031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f447a2-557e-40af-8892-161bb0a61e08 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:38.659296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f447a2-557e-40af-8892-161bb0a61e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:38.660801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f447a2-557e-40af-8892-161bb0a61e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:38.663060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-88f447a2-557e-40af-8892-161bb0a61e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:38.690154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f447a2-557e-40af-8892-161bb0a61e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:38.695801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f447a2-557e-40af-8892-161bb0a61e08 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:38.726399 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3288/6548] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:38.730175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f447a2-557e-40af-8892-161bb0a61e08 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:38.732980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45ef50dc144410db265879ca9dca659'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.733530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-88f447a2-557e-40af-8892-161bb0a61e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:38.747791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45ef50dc144410db265879ca9dca659'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.764672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f447a2-557e-40af-8892-161bb0a61e08 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:38.771366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45ef50dc144410db265879ca9dca659'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.781663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:38.782974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:38.783531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:38.784057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] PATH_INFO: `/v3/projects/7c3af38aa4f34d498028d69d5bd0a7bb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:38.787321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3af38aa4f34d498028d69d5bd0a7bb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:38.789588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45ef50dc144410db265879ca9dca659'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.790467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45ef50dc144410db265879ca9dca659'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.794255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:38.797383 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3261/6549] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:38 2022] DELETE /identity/v3/users/a45ef50dc144410db265879ca9dca659 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:38.798456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:38.801021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:38.826686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:38.908790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27575e-14b3-43e8-8013-f69fabba4a33 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:38.939329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3af38aa4f34d498028d69d5bd0a7bb', 'request_id': 'req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.952575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3af38aa4f34d498028d69d5bd0a7bb', 'request_id': 'req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.972946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3af38aa4f34d498028d69d5bd0a7bb', 'request_id': 'req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:38.984425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:38.992347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] The token cache is being invalidate because project 7c3af38aa4f34d498028d69d5bd0a7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:38.996195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:39.000729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac7f373d-4234-4e6c-b9fb-7fec8c2de039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:39.004816 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3289/6550] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:38 2022] DELETE /identity/v3/projects/7c3af38aa4f34d498028d69d5bd0a7bb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:39.012007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642c58b-8f6d-4019-9753-efb72303691d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:39.013003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642c58b-8f6d-4019-9753-efb72303691d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:39.013998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642c58b-8f6d-4019-9753-efb72303691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:39.044733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80281a-410b-49d3-890a-b647c40e820b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:39.045564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80281a-410b-49d3-890a-b647c40e820b service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:39.045847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80281a-410b-49d3-890a-b647c40e820b service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:39.046139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80281a-410b-49d3-890a-b647c40e820b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:39.051581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5f80281a-410b-49d3-890a-b647c40e820b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:39.064155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0642c58b-8f6d-4019-9753-efb72303691d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:39.065578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0642c58b-8f6d-4019-9753-efb72303691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:39.191690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80281a-410b-49d3-890a-b647c40e820b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:39.193225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80281a-410b-49d3-890a-b647c40e820b service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:39.209677 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3290/6551] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:39.212845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642c58b-8f6d-4019-9753-efb72303691d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:39.216048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0642c58b-8f6d-4019-9753-efb72303691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:39.220586 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3262/6552] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:39.223847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f426e4-f5ea-4685-b9af-861429a003d2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:39.225329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f426e4-f5ea-4685-b9af-861429a003d2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:39.225599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f426e4-f5ea-4685-b9af-861429a003d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:39.244605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642c58b-8f6d-4019-9753-efb72303691d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:39.257446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:39.259905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:39.260183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:39.260456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] PATH_INFO: `/v3/users/e2d81536a2a04f75a56bc15ed3203786` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:39.262742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2d81536a2a04f75a56bc15ed3203786)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:39.267798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:39.270091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-27f426e4-f5ea-4685-b9af-861429a003d2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:39.273220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-27f426e4-f5ea-4685-b9af-861429a003d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:39.295431 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3263/6553] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:39.297012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f426e4-f5ea-4685-b9af-861429a003d2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:39.320865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f426e4-f5ea-4685-b9af-861429a003d2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:39.331893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd897d90-7f54-4ed7-9e2c-4134dd60db3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:39.332550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd897d90-7f54-4ed7-9e2c-4134dd60db3a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:39.332830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd897d90-7f54-4ed7-9e2c-4134dd60db3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:39.333102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd897d90-7f54-4ed7-9e2c-4134dd60db3a admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:39.333785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd897d90-7f54-4ed7-9e2c-4134dd60db3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:39.334300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd897d90-7f54-4ed7-9e2c-4134dd60db3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:39.336101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd897d90-7f54-4ed7-9e2c-4134dd60db3a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:39.369196 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3264/6554] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:45:39.370814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd897d90-7f54-4ed7-9e2c-4134dd60db3a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:39.393158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd897d90-7f54-4ed7-9e2c-4134dd60db3a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:39.407025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19960b-69b4-4fb5-8438-792b80fca45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:39.407727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19960b-69b4-4fb5-8438-792b80fca45e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:39.408011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19960b-69b4-4fb5-8438-792b80fca45e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:39.408286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19960b-69b4-4fb5-8438-792b80fca45e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:39.408946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19960b-69b4-4fb5-8438-792b80fca45e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:39.416327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19960b-69b4-4fb5-8438-792b80fca45e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:39.478424 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3265/6555] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:39 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:39.482952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19960b-69b4-4fb5-8438-792b80fca45e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:39.592950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:39.644577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19960b-69b4-4fb5-8438-792b80fca45e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:39.659600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dda44d-373d-4165-af3b-6bd19ba47a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:39.660251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dda44d-373d-4165-af3b-6bd19ba47a56 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:39.660529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dda44d-373d-4165-af3b-6bd19ba47a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:39.660799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dda44d-373d-4165-af3b-6bd19ba47a56 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:39.661445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dda44d-373d-4165-af3b-6bd19ba47a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:39.663437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dda44d-373d-4165-af3b-6bd19ba47a56 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:39.687341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2d81536a2a04f75a56bc15ed3203786'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:39.689571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2d81536a2a04f75a56bc15ed3203786'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:39.700760 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3266/6556] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:39 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:39.704728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dda44d-373d-4165-af3b-6bd19ba47a56 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:39.708512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2d81536a2a04f75a56bc15ed3203786'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:39.724607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2d81536a2a04f75a56bc15ed3203786'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:39.728004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dda44d-373d-4165-af3b-6bd19ba47a56 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:39.735798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39844d-2279-49bb-859a-03e3c44070dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:39.736424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39844d-2279-49bb-859a-03e3c44070dd admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:39.736700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39844d-2279-49bb-859a-03e3c44070dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:39.736966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39844d-2279-49bb-859a-03e3c44070dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:39.737766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39844d-2279-49bb-859a-03e3c44070dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:39.739520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39844d-2279-49bb-859a-03e3c44070dd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:39.746937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2d81536a2a04f75a56bc15ed3203786'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:39.758517 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3291/6557] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:39 2022] DELETE /identity/v3/users/e2d81536a2a04f75a56bc15ed3203786 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:39.769796 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3267/6558] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:45:39.774494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:39.776279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:39.972021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac6aba-0385-449f-b3b8-7053b1049cc0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:39.977851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315eabf-58c6-4c3c-9cc0-898759c03b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:39.978523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315eabf-58c6-4c3c-9cc0-898759c03b3e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:39.978797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315eabf-58c6-4c3c-9cc0-898759c03b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:39.979064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315eabf-58c6-4c3c-9cc0-898759c03b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:39.979714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315eabf-58c6-4c3c-9cc0-898759c03b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:39.981337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315eabf-58c6-4c3c-9cc0-898759c03b3e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:40.002670 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3292/6559] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:40.003731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39844d-2279-49bb-859a-03e3c44070dd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:40.024084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39844d-2279-49bb-859a-03e3c44070dd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:40.039448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37751b64-5d07-4cee-8492-a16e0f0e89b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:40.040136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37751b64-5d07-4cee-8492-a16e0f0e89b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:40.040411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37751b64-5d07-4cee-8492-a16e0f0e89b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:40.040681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37751b64-5d07-4cee-8492-a16e0f0e89b4 admin admin] PATH_INFO: `/v3/projects/3110667f551e41d98e51b208a385428d/users/b8fc7ec3730141cea5560b1d093846e8/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:40.058015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37751b64-5d07-4cee-8492-a16e0f0e89b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3110667f551e41d98e51b208a385428d, user_id=b8fc7ec3730141cea5560b1d093846e8, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:40.060689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37751b64-5d07-4cee-8492-a16e0f0e89b4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:40.088518 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3268/6560] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:40 2022] PUT /identity/v3/projects/3110667f551e41d98e51b208a385428d/users/b8fc7ec3730141cea5560b1d093846e8/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:40.102118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596d116-8f54-428d-a64f-13dfd99e0635 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:40.102331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596d116-8f54-428d-a64f-13dfd99e0635 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:40.102597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596d116-8f54-428d-a64f-13dfd99e0635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:40.176503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:40.197644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f596d116-8f54-428d-a64f-13dfd99e0635 None None] MFA Rules not processed for user `b8fc7ec3730141cea5560b1d093846e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:40.199021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f596d116-8f54-428d-a64f-13dfd99e0635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:40.203824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37751b64-5d07-4cee-8492-a16e0f0e89b4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:40.206623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-37751b64-5d07-4cee-8492-a16e0f0e89b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:40.371723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37751b64-5d07-4cee-8492-a16e0f0e89b4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:40.376962 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3293/6561] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:40.385391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:40.386248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:40.387061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:40.387061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] PATH_INFO: `/v3/projects/6d15c1a3cdbe497c85299be456977ed2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:40.388888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d15c1a3cdbe497c85299be456977ed2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:40.392936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:40.427938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596d116-8f54-428d-a64f-13dfd99e0635 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:40.433155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f596d116-8f54-428d-a64f-13dfd99e0635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:40.520691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d15c1a3cdbe497c85299be456977ed2', 'request_id': 'req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.532590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d15c1a3cdbe497c85299be456977ed2', 'request_id': 'req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.544796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d15c1a3cdbe497c85299be456977ed2', 'request_id': 'req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.568057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] The token cache is being invalidate because project 6d15c1a3cdbe497c85299be456977ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:40.568569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.569382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.571037 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3269/6562] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:40 2022] DELETE /identity/v3/projects/6d15c1a3cdbe497c85299be456977ed2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:40.571992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:40.575774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:40.595066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596d116-8f54-428d-a64f-13dfd99e0635 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:40.661294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:40.702646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042863e8-63ec-4b3f-a092-97238c202fc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:40.703268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042863e8-63ec-4b3f-a092-97238c202fc3 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:40.703548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042863e8-63ec-4b3f-a092-97238c202fc3 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:40.703816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042863e8-63ec-4b3f-a092-97238c202fc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:40.706520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-042863e8-63ec-4b3f-a092-97238c202fc3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:40.730293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce58e8-2115-44ee-bf13-4d5551ac4ee3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:40.742557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:40.743476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:40.744042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:40.745203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] PATH_INFO: `/v3/projects/ed34a1a765d04ecfa975f557fc3b23a2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:40.748359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed34a1a765d04ecfa975f557fc3b23a2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:40.754820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:40.778252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042863e8-63ec-4b3f-a092-97238c202fc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:40.780007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042863e8-63ec-4b3f-a092-97238c202fc3 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:40.792648 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3294/6563] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:40.793553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042863e8-63ec-4b3f-a092-97238c202fc3 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:40.795152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-042863e8-63ec-4b3f-a092-97238c202fc3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:40.811098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042863e8-63ec-4b3f-a092-97238c202fc3 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:40.818371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:40.819091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:40.819500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:40.819777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] PATH_INFO: `/v3/projects/0bac1775896b488d87378ac30f9dd9b4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:40.821221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bac1775896b488d87378ac30f9dd9b4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:40.824505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:40.827643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:40.857944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed34a1a765d04ecfa975f557fc3b23a2', 'request_id': 'req-23a2104c-352a-455b-8e15-09962a24584d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.881860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed34a1a765d04ecfa975f557fc3b23a2', 'request_id': 'req-23a2104c-352a-455b-8e15-09962a24584d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.890160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bac1775896b488d87378ac30f9dd9b4', 'request_id': 'req-24618bb8-c805-4b1f-88fd-e1baa8275bb3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.891479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed34a1a765d04ecfa975f557fc3b23a2', 'request_id': 'req-23a2104c-352a-455b-8e15-09962a24584d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.900348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bac1775896b488d87378ac30f9dd9b4', 'request_id': 'req-24618bb8-c805-4b1f-88fd-e1baa8275bb3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.912603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bac1775896b488d87378ac30f9dd9b4', 'request_id': 'req-24618bb8-c805-4b1f-88fd-e1baa8275bb3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.929162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] The token cache is being invalidate because project ed34a1a765d04ecfa975f557fc3b23a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:40.929162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.931282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] The token cache is being invalidate because project 0bac1775896b488d87378ac30f9dd9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:40.931861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.932761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24618bb8-c805-4b1f-88fd-e1baa8275bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.934877 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3295/6564] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:40 2022] DELETE /identity/v3/projects/0bac1775896b488d87378ac30f9dd9b4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:40.935539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23a2104c-352a-455b-8e15-09962a24584d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:40.936482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d30e0-4a48-4601-ae24-2c8233d8520c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:40.936866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d30e0-4a48-4601-ae24-2c8233d8520c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:40.937238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d30e0-4a48-4601-ae24-2c8233d8520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:40.940275 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3270/6565] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:40 2022] DELETE /identity/v3/projects/ed34a1a765d04ecfa975f557fc3b23a2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:40.942148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e7537-f384-481a-8fe9-7579fdd1b772 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:40.943628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e7537-f384-481a-8fe9-7579fdd1b772 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:40.944606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e7537-f384-481a-8fe9-7579fdd1b772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:40.974479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-836d30e0-4a48-4601-ae24-2c8233d8520c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:40.976333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-836d30e0-4a48-4601-ae24-2c8233d8520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:40.992489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7e4e7537-f384-481a-8fe9-7579fdd1b772 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:40.996461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7e4e7537-f384-481a-8fe9-7579fdd1b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:41.076496 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3296/6566] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:41.084066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d30e0-4a48-4601-ae24-2c8233d8520c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:41.085524 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3271/6567] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:41.087202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa0637-8ed3-4c8c-ab7f-9313c0a17eab None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.087695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa0637-8ed3-4c8c-ab7f-9313c0a17eab None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.088134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa0637-8ed3-4c8c-ab7f-9313c0a17eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.093652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-836d30e0-4a48-4601-ae24-2c8233d8520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:41.111944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8daa0637-8ed3-4c8c-ab7f-9313c0a17eab None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:41.113729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8daa0637-8ed3-4c8c-ab7f-9313c0a17eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:41.124267 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3272/6568] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:41.126039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e37ab-4fcf-491d-90aa-c1bf4113efcc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.126532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e37ab-4fcf-491d-90aa-c1bf4113efcc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.126946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e37ab-4fcf-491d-90aa-c1bf4113efcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.134275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d30e0-4a48-4601-ae24-2c8233d8520c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:41.149791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:41.150481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.150788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.151010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] PATH_INFO: `/v3/users/14271019c02b40688f6029a301c5b61b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.152816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b03e37ab-4fcf-491d-90aa-c1bf4113efcc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:41.153321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14271019c02b40688f6029a301c5b61b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:41.154276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b03e37ab-4fcf-491d-90aa-c1bf4113efcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:41.155286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:41.181238 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3273/6569] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:41.183556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e37ab-4fcf-491d-90aa-c1bf4113efcc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:41.214743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e37ab-4fcf-491d-90aa-c1bf4113efcc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:41.233335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcd233-8e7c-499a-bfc7-d735f2635045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:41.234126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcd233-8e7c-499a-bfc7-d735f2635045 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.234440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcd233-8e7c-499a-bfc7-d735f2635045 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.237894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcd233-8e7c-499a-bfc7-d735f2635045 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.239210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcd233-8e7c-499a-bfc7-d735f2635045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:41.241633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcd233-8e7c-499a-bfc7-d735f2635045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:41.244519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcd233-8e7c-499a-bfc7-d735f2635045 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:41.273062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14271019c02b40688f6029a301c5b61b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.274290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14271019c02b40688f6029a301c5b61b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.279867 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3274/6570] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:41.280958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcd233-8e7c-499a-bfc7-d735f2635045 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:41.291899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5fbcd233-8e7c-499a-bfc7-d735f2635045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:41.292535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14271019c02b40688f6029a301c5b61b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.308030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14271019c02b40688f6029a301c5b61b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.316397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcd233-8e7c-499a-bfc7-d735f2635045 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:41.323205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:41.323862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.324136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.324401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] PATH_INFO: `/v3/projects/663938bbe2294a10befe69e94d082cab` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.326203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663938bbe2294a10befe69e94d082cab)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:41.328280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:41.330404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14271019c02b40688f6029a301c5b61b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.338437 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3297/6571] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:41 2022] DELETE /identity/v3/users/14271019c02b40688f6029a301c5b61b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:41.339787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:41.350597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:41.370033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:41.373324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:41.397677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663938bbe2294a10befe69e94d082cab', 'request_id': 'req-18315eee-2f9b-49dd-ad1d-8036de00f4a7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.408351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663938bbe2294a10befe69e94d082cab', 'request_id': 'req-18315eee-2f9b-49dd-ad1d-8036de00f4a7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.420034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663938bbe2294a10befe69e94d082cab', 'request_id': 'req-18315eee-2f9b-49dd-ad1d-8036de00f4a7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.435674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] The token cache is being invalidate because project 663938bbe2294a10befe69e94d082cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:41.436140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.436856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.439412 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3275/6572] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:41 2022] DELETE /identity/v3/projects/663938bbe2294a10befe69e94d082cab => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:41.440450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:41.441903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:41.514852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93624b35-12be-4aa7-bb12-12e9ecade914 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:41.543164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18315eee-2f9b-49dd-ad1d-8036de00f4a7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:41.549825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:41.550583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.550925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.551402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] PATH_INFO: `/v3/users/b8fc7ec3730141cea5560b1d093846e8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.552612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8fc7ec3730141cea5560b1d093846e8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:41.555256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:41.696817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8fc7ec3730141cea5560b1d093846e8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.709731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8fc7ec3730141cea5560b1d093846e8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.713687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f5afe-e87f-4199-97e0-08ec8ae292fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:41.714716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f5afe-e87f-4199-97e0-08ec8ae292fa admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.715141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f5afe-e87f-4199-97e0-08ec8ae292fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.715454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f5afe-e87f-4199-97e0-08ec8ae292fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.716276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f5afe-e87f-4199-97e0-08ec8ae292fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:41.718311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f5afe-e87f-4199-97e0-08ec8ae292fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:41.722604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f5afe-e87f-4199-97e0-08ec8ae292fa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:41.729750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8fc7ec3730141cea5560b1d093846e8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.756457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8fc7ec3730141cea5560b1d093846e8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.757211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8fc7ec3730141cea5560b1d093846e8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:41.765159 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3276/6573] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:41 2022] DELETE /identity/v3/users/b8fc7ec3730141cea5560b1d093846e8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:41.766683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:41.768585 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3298/6574] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:41.770760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:41.774153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9e02e-65a5-4f96-8b8e-e49135496c40 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.774479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9e02e-65a5-4f96-8b8e-e49135496c40 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.774739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9e02e-65a5-4f96-8b8e-e49135496c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.816888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4eb9e02e-65a5-4f96-8b8e-e49135496c40 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:41.819774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4eb9e02e-65a5-4f96-8b8e-e49135496c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:41.838136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:41.903842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f447862-53dd-4e4c-82e7-53dfd6487539 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:41.917346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411efdac-b522-4344-9ad3-b148db47e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:41.918265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411efdac-b522-4344-9ad3-b148db47e19a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.918733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411efdac-b522-4344-9ad3-b148db47e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.919138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411efdac-b522-4344-9ad3-b148db47e19a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.920107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411efdac-b522-4344-9ad3-b148db47e19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:41.922214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411efdac-b522-4344-9ad3-b148db47e19a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:41.931981 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3299/6575] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:41.931981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9e02e-65a5-4f96-8b8e-e49135496c40 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:41.931981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4eb9e02e-65a5-4f96-8b8e-e49135496c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:41.951031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9e02e-65a5-4f96-8b8e-e49135496c40 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:41.964286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:41.964286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.964286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.977741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] PATH_INFO: `/v3/projects/5e3f309bd4724451854a23a8b568cced` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.983807 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3277/6576] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:41 2022] POST /identity/v3/projects => generated 397 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:41.986315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d41cb-ab5e-44b6-85c8-72f5ee4c5ec9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:41.987037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d41cb-ab5e-44b6-85c8-72f5ee4c5ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:41.987485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d41cb-ab5e-44b6-85c8-72f5ee4c5ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:41.994758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e3f309bd4724451854a23a8b568cced)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.000587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.014308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-221d41cb-ab5e-44b6-85c8-72f5ee4c5ec9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:42.016146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-221d41cb-ab5e-44b6-85c8-72f5ee4c5ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:42.082628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:42.091408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e3f309bd4724451854a23a8b568cced', 'request_id': 'req-bacefdbe-1194-4acd-bd90-69af244a01fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:42.105115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e3f309bd4724451854a23a8b568cced', 'request_id': 'req-bacefdbe-1194-4acd-bd90-69af244a01fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:42.117605 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3278/6577] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:42.119065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d41cb-ab5e-44b6-85c8-72f5ee4c5ec9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.120720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-221d41cb-ab5e-44b6-85c8-72f5ee4c5ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:42.129032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e3f309bd4724451854a23a8b568cced', 'request_id': 'req-bacefdbe-1194-4acd-bd90-69af244a01fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:42.136173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d41cb-ab5e-44b6-85c8-72f5ee4c5ec9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.147136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] The token cache is being invalidate because project 5e3f309bd4724451854a23a8b568cced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:42.147676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:42.149217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bacefdbe-1194-4acd-bd90-69af244a01fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:42.151177 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3300/6578] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:41 2022] DELETE /identity/v3/projects/5e3f309bd4724451854a23a8b568cced => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:42.152933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ce64-3cdb-4fad-aed7-6561bedc9631 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.153363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ce64-3cdb-4fad-aed7-6561bedc9631 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.153775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ce64-3cdb-4fad-aed7-6561bedc9631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.178323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1000ce64-3cdb-4fad-aed7-6561bedc9631 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:42.180008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1000ce64-3cdb-4fad-aed7-6561bedc9631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:42.253565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97ece3-ff5d-4880-be3d-04af5f7fbdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.254312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97ece3-ff5d-4880-be3d-04af5f7fbdaf admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.254553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97ece3-ff5d-4880-be3d-04af5f7fbdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.254866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e97ece3-ff5d-4880-be3d-04af5f7fbdaf admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.255620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97ece3-ff5d-4880-be3d-04af5f7fbdaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.260133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e97ece3-ff5d-4880-be3d-04af5f7fbdaf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.280556 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3301/6579] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:42.281611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ce64-3cdb-4fad-aed7-6561bedc9631 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.283121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1000ce64-3cdb-4fad-aed7-6561bedc9631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:42.297748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ce64-3cdb-4fad-aed7-6561bedc9631 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.304349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c63e08-ee20-44a7-b5ba-112d6efe60c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.305221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c63e08-ee20-44a7-b5ba-112d6efe60c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.305604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c63e08-ee20-44a7-b5ba-112d6efe60c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.306806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c63e08-ee20-44a7-b5ba-112d6efe60c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.307794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c63e08-ee20-44a7-b5ba-112d6efe60c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.310021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c63e08-ee20-44a7-b5ba-112d6efe60c5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.313144 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3279/6580] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:42 2022] POST /identity/v3/projects => generated 363 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:42.314604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97ece3-ff5d-4880-be3d-04af5f7fbdaf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.319150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2e97ece3-ff5d-4880-be3d-04af5f7fbdaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:42.352649 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3302/6581] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:42 2022] POST /identity/v3/users => generated 305 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:42.363297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162c38a-619a-464b-9704-0e03edf76790 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.368262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162c38a-619a-464b-9704-0e03edf76790 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.369416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162c38a-619a-464b-9704-0e03edf76790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.399921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:42.421426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e97ece3-ff5d-4880-be3d-04af5f7fbdaf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.426289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ade62-1870-45cb-8069-48311a4b2697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.427085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ade62-1870-45cb-8069-48311a4b2697 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.427434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ade62-1870-45cb-8069-48311a4b2697 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.428726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ade62-1870-45cb-8069-48311a4b2697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.428915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b162c38a-619a-464b-9704-0e03edf76790 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:42.430326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b162c38a-619a-464b-9704-0e03edf76790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:42.431657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-274ade62-1870-45cb-8069-48311a4b2697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:42.549538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ade62-1870-45cb-8069-48311a4b2697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.552279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ade62-1870-45cb-8069-48311a4b2697 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.562769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3303/6582] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:42.568203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162c38a-619a-464b-9704-0e03edf76790 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.582918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162c38a-619a-464b-9704-0e03edf76790 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.587940 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3280/6583] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:42.588588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb5cad-b8df-4013-9c05-576a39c0f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.591751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb5cad-b8df-4013-9c05-576a39c0f06e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.591751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb5cad-b8df-4013-9c05-576a39c0f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.591751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb5cad-b8df-4013-9c05-576a39c0f06e admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.591751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb5cad-b8df-4013-9c05-576a39c0f06e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:42.591751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb5cad-b8df-4013-9c05-576a39c0f06e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.593465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb5cad-b8df-4013-9c05-576a39c0f06e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.593688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ade62-1870-45cb-8069-48311a4b2697 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.596421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-274ade62-1870-45cb-8069-48311a4b2697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:42.611134 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3304/6584] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:42.611134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb5cad-b8df-4013-9c05-576a39c0f06e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.618727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ade62-1870-45cb-8069-48311a4b2697 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.623825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb5cad-b8df-4013-9c05-576a39c0f06e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.625297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deed465-6c47-4e96-8ef5-c7a41d3d4266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.626131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deed465-6c47-4e96-8ef5-c7a41d3d4266 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.626553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deed465-6c47-4e96-8ef5-c7a41d3d4266 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.626970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deed465-6c47-4e96-8ef5-c7a41d3d4266 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.628494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deed465-6c47-4e96-8ef5-c7a41d3d4266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.630678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deed465-6c47-4e96-8ef5-c7a41d3d4266 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.631460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a73afd-2ef9-40c9-bf9d-6612d0af0bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.632463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a73afd-2ef9-40c9-bf9d-6612d0af0bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.632852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a73afd-2ef9-40c9-bf9d-6612d0af0bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.633343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a73afd-2ef9-40c9-bf9d-6612d0af0bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.634844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a73afd-2ef9-40c9-bf9d-6612d0af0bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.636860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a73afd-2ef9-40c9-bf9d-6612d0af0bd9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.654622 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3305/6585] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:42.656203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421015-9de5-40b6-8e68-043edea63561 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.656741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421015-9de5-40b6-8e68-043edea63561 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.657207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421015-9de5-40b6-8e68-043edea63561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.685690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6a421015-9de5-40b6-8e68-043edea63561 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:42.687158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6a421015-9de5-40b6-8e68-043edea63561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:42.689494 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3281/6586] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:42 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:42.693321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deed465-6c47-4e96-8ef5-c7a41d3d4266 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.696816 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3306/6587] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:42.697962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421015-9de5-40b6-8e68-043edea63561 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.709463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421015-9de5-40b6-8e68-043edea63561 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.714924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbb3c8-9bfb-4c17-83b4-4cf3761d6562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.715513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deed465-6c47-4e96-8ef5-c7a41d3d4266 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.715811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbb3c8-9bfb-4c17-83b4-4cf3761d6562 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.716290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbb3c8-9bfb-4c17-83b4-4cf3761d6562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.716662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbb3c8-9bfb-4c17-83b4-4cf3761d6562 admin admin] PATH_INFO: `/v3/projects/b69bf98aa91643079a372f60fd7865ad/users/64938f14157e4c70b0b872dc0ca141ed/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.728373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a0d0f-db20-48c1-9be3-1354baa3c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.729004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a0d0f-db20-48c1-9be3-1354baa3c57d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.729284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a0d0f-db20-48c1-9be3-1354baa3c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.729548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a0d0f-db20-48c1-9be3-1354baa3c57d admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.730237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a0d0f-db20-48c1-9be3-1354baa3c57d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.734904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a0d0f-db20-48c1-9be3-1354baa3c57d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.737016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbb3c8-9bfb-4c17-83b4-4cf3761d6562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69bf98aa91643079a372f60fd7865ad, user_id=64938f14157e4c70b0b872dc0ca141ed, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.741231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bbb3c8-9bfb-4c17-83b4-4cf3761d6562 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.755807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:42.762402 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3307/6588] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:42 2022] PUT /identity/v3/projects/b69bf98aa91643079a372f60fd7865ad/users/64938f14157e4c70b0b872dc0ca141ed/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:42.764033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbb3c8-9bfb-4c17-83b4-4cf3761d6562 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.791163 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3282/6589] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:42 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:42.791163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a0d0f-db20-48c1-9be3-1354baa3c57d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.920207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bbb3c8-9bfb-4c17-83b4-4cf3761d6562 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.932027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c61c69-4317-4c5c-a2ff-2157fd084dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.932831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c61c69-4317-4c5c-a2ff-2157fd084dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.933211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c61c69-4317-4c5c-a2ff-2157fd084dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.933611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c61c69-4317-4c5c-a2ff-2157fd084dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.934514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c61c69-4317-4c5c-a2ff-2157fd084dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.936231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c61c69-4317-4c5c-a2ff-2157fd084dc7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.943305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a0d0f-db20-48c1-9be3-1354baa3c57d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.956418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3282ddd-6498-41bc-80ff-7e599cd4b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.957330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3282ddd-6498-41bc-80ff-7e599cd4b3fd admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.957825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3282ddd-6498-41bc-80ff-7e599cd4b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.961712 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3308/6590] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:42.961712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c61c69-4317-4c5c-a2ff-2157fd084dc7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:42.962105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3282ddd-6498-41bc-80ff-7e599cd4b3fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.962378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3282ddd-6498-41bc-80ff-7e599cd4b3fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:42.962709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3282ddd-6498-41bc-80ff-7e599cd4b3fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.970607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3282ddd-6498-41bc-80ff-7e599cd4b3fd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:42.980421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c61c69-4317-4c5c-a2ff-2157fd084dc7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:42.985765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0199e-f98e-4848-a266-a17fe84b0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:42.986578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0199e-f98e-4848-a266-a17fe84b0014 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:42.986956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0199e-f98e-4848-a266-a17fe84b0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:42.987364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0199e-f98e-4848-a266-a17fe84b0014 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:42.988452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0199e-f98e-4848-a266-a17fe84b0014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:42.990452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d0199e-f98e-4848-a266-a17fe84b0014 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:43.008751 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3283/6592] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:43.010258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3282ddd-6498-41bc-80ff-7e599cd4b3fd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:43.010791 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3309/6591] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:43.012187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0199e-f98e-4848-a266-a17fe84b0014 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:43.033765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3282ddd-6498-41bc-80ff-7e599cd4b3fd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:43.036881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0199e-f98e-4848-a266-a17fe84b0014 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:43.045241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418495e9-6e55-4e02-a32c-484849b5568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:43.047040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418495e9-6e55-4e02-a32c-484849b5568f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.047815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bf0d1-568f-47ea-aab2-58b2807a748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:43.048214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418495e9-6e55-4e02-a32c-484849b5568f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.048739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418495e9-6e55-4e02-a32c-484849b5568f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.050600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bf0d1-568f-47ea-aab2-58b2807a748e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.050600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bf0d1-568f-47ea-aab2-58b2807a748e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.052224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418495e9-6e55-4e02-a32c-484849b5568f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:43.054004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bf0d1-568f-47ea-aab2-58b2807a748e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.054807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bf0d1-568f-47ea-aab2-58b2807a748e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:43.057742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bf0d1-568f-47ea-aab2-58b2807a748e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:43.059324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418495e9-6e55-4e02-a32c-484849b5568f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:43.085508 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3310/6593] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:43.086779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bf0d1-568f-47ea-aab2-58b2807a748e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:43.104662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bf0d1-568f-47ea-aab2-58b2807a748e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:43.110605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c8a59-b73d-4e2b-a87b-e9fe3b5deabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:43.111465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c8a59-b73d-4e2b-a87b-e9fe3b5deabd admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.111846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c8a59-b73d-4e2b-a87b-e9fe3b5deabd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.112336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c8a59-b73d-4e2b-a87b-e9fe3b5deabd admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.113653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c8a59-b73d-4e2b-a87b-e9fe3b5deabd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:43.113814 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3284/6594] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:43 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:43.115215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418495e9-6e55-4e02-a32c-484849b5568f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:43.116504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c8a59-b73d-4e2b-a87b-e9fe3b5deabd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:43.132064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418495e9-6e55-4e02-a32c-484849b5568f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:43.140002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc09b4-7096-4ad5-8604-84b52a6c2c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:43.140730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc09b4-7096-4ad5-8604-84b52a6c2c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.141050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc09b4-7096-4ad5-8604-84b52a6c2c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.141317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc09b4-7096-4ad5-8604-84b52a6c2c16 admin admin] PATH_INFO: `/v3/projects/b69bf98aa91643079a372f60fd7865ad/users/64938f14157e4c70b0b872dc0ca141ed/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.163274 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3311/6595] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:43 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:43.164919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c8a59-b73d-4e2b-a87b-e9fe3b5deabd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:43.171946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc09b4-7096-4ad5-8604-84b52a6c2c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b69bf98aa91643079a372f60fd7865ad, user_id=64938f14157e4c70b0b872dc0ca141ed, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:43.185245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc09b4-7096-4ad5-8604-84b52a6c2c16 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:43.220420 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3285/6596] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:43 2022] PUT /identity/v3/projects/b69bf98aa91643079a372f60fd7865ad/users/64938f14157e4c70b0b872dc0ca141ed/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:43.221506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc09b4-7096-4ad5-8604-84b52a6c2c16 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:43.265952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c8a59-b73d-4e2b-a87b-e9fe3b5deabd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:43.273680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:43.342001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:43.354666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e032f-4e13-444f-9c10-aead9209e3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:43.358084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e032f-4e13-444f-9c10-aead9209e3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.358760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e032f-4e13-444f-9c10-aead9209e3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.360213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e032f-4e13-444f-9c10-aead9209e3d5 admin admin] PATH_INFO: `/v3/projects/fac15d7cb7c04de19cfd156d380631b4/users/6de01c5cbe244926b848a9c5d78f081d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.398182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e032f-4e13-444f-9c10-aead9209e3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac15d7cb7c04de19cfd156d380631b4, user_id=6de01c5cbe244926b848a9c5d78f081d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:43.399157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc09b4-7096-4ad5-8604-84b52a6c2c16 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:43.404902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e032f-4e13-444f-9c10-aead9209e3d5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:43.414695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7236f4-fa9d-4226-8f7c-9695950f8c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:43.415550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7236f4-fa9d-4226-8f7c-9695950f8c04 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.415894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7236f4-fa9d-4226-8f7c-9695950f8c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.416225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7236f4-fa9d-4226-8f7c-9695950f8c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.417724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7236f4-fa9d-4226-8f7c-9695950f8c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:43.420283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7236f4-fa9d-4226-8f7c-9695950f8c04 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:43.431987 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3286/6597] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:43.435197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7236f4-fa9d-4226-8f7c-9695950f8c04 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:43.435295 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3312/6598] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:43 2022] PUT /identity/v3/projects/fac15d7cb7c04de19cfd156d380631b4/users/6de01c5cbe244926b848a9c5d78f081d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:43.440797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205c82-eaab-4581-ab2b-ecd31d3830e9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.442029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205c82-eaab-4581-ab2b-ecd31d3830e9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.442345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205c82-eaab-4581-ab2b-ecd31d3830e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.486790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7236f4-fa9d-4226-8f7c-9695950f8c04 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:43.494898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-98205c82-eaab-4581-ab2b-ecd31d3830e9 None None] MFA Rules not processed for user `64938f14157e4c70b0b872dc0ca141ed`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:43.496296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-98205c82-eaab-4581-ab2b-ecd31d3830e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:43.665150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df19bf8-aad7-4ebd-8b68-abed4c18e07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:43.665963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df19bf8-aad7-4ebd-8b68-abed4c18e07f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.666342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df19bf8-aad7-4ebd-8b68-abed4c18e07f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.666709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df19bf8-aad7-4ebd-8b68-abed4c18e07f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.667491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df19bf8-aad7-4ebd-8b68-abed4c18e07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:43.669923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df19bf8-aad7-4ebd-8b68-abed4c18e07f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:43.714759 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3313/6599] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:43 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:43.718439 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3287/6600] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:43 2022] POST /identity/v3/users => generated 296 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:43.720693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8404b-59f6-40a1-9aa3-f52c53adc473 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.721284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df19bf8-aad7-4ebd-8b68-abed4c18e07f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:43.722934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8404b-59f6-40a1-9aa3-f52c53adc473 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.723585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8404b-59f6-40a1-9aa3-f52c53adc473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.735965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df19bf8-aad7-4ebd-8b68-abed4c18e07f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:43.745262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093cd8-41c2-497d-819d-6a32bba3a814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:43.746108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093cd8-41c2-497d-819d-6a32bba3a814 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.746491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093cd8-41c2-497d-819d-6a32bba3a814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.746857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093cd8-41c2-497d-819d-6a32bba3a814 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.747898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36093cd8-41c2-497d-819d-6a32bba3a814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:43.751011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36093cd8-41c2-497d-819d-6a32bba3a814 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:43.768170 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3288/6601] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:43.770439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093cd8-41c2-497d-819d-6a32bba3a814 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:43.772535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-36093cd8-41c2-497d-819d-6a32bba3a814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:43.790077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093cd8-41c2-497d-819d-6a32bba3a814 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:43.796527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:43.797368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:43.797838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:43.798279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] PATH_INFO: `/v3/projects/3110667f551e41d98e51b208a385428d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:43.800009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3110667f551e41d98e51b208a385428d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:43.803272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:43.854691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c8a8404b-59f6-40a1-9aa3-f52c53adc473 None None] MFA Rules not processed for user `6de01c5cbe244926b848a9c5d78f081d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:43.857570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c8a8404b-59f6-40a1-9aa3-f52c53adc473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:43.914454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3110667f551e41d98e51b208a385428d', 'request_id': 'req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:43.932929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3110667f551e41d98e51b208a385428d', 'request_id': 'req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:43.951355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3110667f551e41d98e51b208a385428d', 'request_id': 'req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:43.969669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] The token cache is being invalidate because project 3110667f551e41d98e51b208a385428d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:43.970001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:43.974726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:43.979951 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3289/6602] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:43 2022] DELETE /identity/v3/projects/3110667f551e41d98e51b208a385428d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:43.979951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:43.980780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:43.998718 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3314/6603] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:44.000380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8404b-59f6-40a1-9aa3-f52c53adc473 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.009520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:44.113734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd69b6b-c55b-421e-8a5d-fb4bfd7a87f3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.135483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1aea6d-f241-44e2-a29f-68024da8cb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.138458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1aea6d-f241-44e2-a29f-68024da8cb3b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.139503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1aea6d-f241-44e2-a29f-68024da8cb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.140132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1aea6d-f241-44e2-a29f-68024da8cb3b admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.140962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1aea6d-f241-44e2-a29f-68024da8cb3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.141498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:44.148843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1aea6d-f241-44e2-a29f-68024da8cb3b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.156785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8404b-59f6-40a1-9aa3-f52c53adc473 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.179934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff675ce-a017-4faf-a49f-711ef9ee3533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.183207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff675ce-a017-4faf-a49f-711ef9ee3533 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.183521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff675ce-a017-4faf-a49f-711ef9ee3533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.183802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff675ce-a017-4faf-a49f-711ef9ee3533 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.184471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff675ce-a017-4faf-a49f-711ef9ee3533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.190604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff675ce-a017-4faf-a49f-711ef9ee3533 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.191277 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3290/6604] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:43 2022] POST /identity/v3/projects => generated 399 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:44.192515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1aea6d-f241-44e2-a29f-68024da8cb3b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.196630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cd1aea6d-f241-44e2-a29f-68024da8cb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:44.223598 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3315/6605] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:44.225783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0034-ac63-40c5-9e78-beaf9f6e949c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.227254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0034-ac63-40c5-9e78-beaf9f6e949c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.228714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0034-ac63-40c5-9e78-beaf9f6e949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.276766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-733f0034-ac63-40c5-9e78-beaf9f6e949c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:44.278281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-733f0034-ac63-40c5-9e78-beaf9f6e949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:44.332982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1aea6d-f241-44e2-a29f-68024da8cb3b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.338665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a948-7e61-4c84-880a-55c4e59ef99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.339560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a948-7e61-4c84-880a-55c4e59ef99c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.339839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a948-7e61-4c84-880a-55c4e59ef99c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.340111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868a948-7e61-4c84-880a-55c4e59ef99c admin admin] PATH_INFO: `/v3/projects/0e12cc89a3f2406b9caa3222fa8dd486/users/b031dc580d424d0fa87f328c051451ac/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.358467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868a948-7e61-4c84-880a-55c4e59ef99c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e12cc89a3f2406b9caa3222fa8dd486, user_id=b031dc580d424d0fa87f328c051451ac, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.361787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868a948-7e61-4c84-880a-55c4e59ef99c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.382071 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3316/6606] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:44.382071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f0034-ac63-40c5-9e78-beaf9f6e949c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.383327 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3291/6607] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:44 2022] PUT /identity/v3/projects/0e12cc89a3f2406b9caa3222fa8dd486/users/b031dc580d424d0fa87f328c051451ac/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:44.386696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a948-7e61-4c84-880a-55c4e59ef99c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.404922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-733f0034-ac63-40c5-9e78-beaf9f6e949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:44.419561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f0034-ac63-40c5-9e78-beaf9f6e949c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.513425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868a948-7e61-4c84-880a-55c4e59ef99c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.522925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe493f-331e-4810-8597-43d4e8d567ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.523631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe493f-331e-4810-8597-43d4e8d567ef admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.523874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe493f-331e-4810-8597-43d4e8d567ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.524141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe493f-331e-4810-8597-43d4e8d567ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.524874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe493f-331e-4810-8597-43d4e8d567ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.525583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab9ff0-14f1-4af4-9c02-a99b020201d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.526438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab9ff0-14f1-4af4-9c02-a99b020201d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.526827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab9ff0-14f1-4af4-9c02-a99b020201d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.527043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab9ff0-14f1-4af4-9c02-a99b020201d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.527213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe493f-331e-4810-8597-43d4e8d567ef admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.528139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab9ff0-14f1-4af4-9c02-a99b020201d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.531703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab9ff0-14f1-4af4-9c02-a99b020201d2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.561233 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3292/6608] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:44 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:44.561766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab9ff0-14f1-4af4-9c02-a99b020201d2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.563695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e8ab9ff0-14f1-4af4-9c02-a99b020201d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:44.564671 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3317/6609] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:44 2022] POST /identity/v3/projects => generated 365 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:44.566297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59cfa0-4ff3-4e58-8fa4-330f7f9d74b2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.566767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59cfa0-4ff3-4e58-8fa4-330f7f9d74b2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.567180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59cfa0-4ff3-4e58-8fa4-330f7f9d74b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.583208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab9ff0-14f1-4af4-9c02-a99b020201d2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.598944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8e59cfa0-4ff3-4e58-8fa4-330f7f9d74b2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:44.600267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8e59cfa0-4ff3-4e58-8fa4-330f7f9d74b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:44.604680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:44.722959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d065b4-718d-42bf-a8ff-6c850e1c3209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.724879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d065b4-718d-42bf-a8ff-6c850e1c3209 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.725235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d065b4-718d-42bf-a8ff-6c850e1c3209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.725501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d065b4-718d-42bf-a8ff-6c850e1c3209 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.729387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d065b4-718d-42bf-a8ff-6c850e1c3209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.737177 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3318/6610] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:44.737177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709c3d-848f-46cf-ae8b-8ef5ee130b19 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.737177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709c3d-848f-46cf-ae8b-8ef5ee130b19 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.737177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709c3d-848f-46cf-ae8b-8ef5ee130b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.738282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d065b4-718d-42bf-a8ff-6c850e1c3209 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.767368 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3293/6611] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:44.768362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d065b4-718d-42bf-a8ff-6c850e1c3209 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.783703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-74709c3d-848f-46cf-ae8b-8ef5ee130b19 None None] MFA Rules not processed for user `b031dc580d424d0fa87f328c051451ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:44.784308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d065b4-718d-42bf-a8ff-6c850e1c3209 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.785308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-74709c3d-848f-46cf-ae8b-8ef5ee130b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:44.789894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464708e8-0609-4777-b1cd-4729dbe30310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.790814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464708e8-0609-4777-b1cd-4729dbe30310 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.791097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464708e8-0609-4777-b1cd-4729dbe30310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.791365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464708e8-0609-4777-b1cd-4729dbe30310 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.792275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464708e8-0609-4777-b1cd-4729dbe30310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.793156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:44.794614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464708e8-0609-4777-b1cd-4729dbe30310 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.810057 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3294/6612] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:44.811197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464708e8-0609-4777-b1cd-4729dbe30310 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.834842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464708e8-0609-4777-b1cd-4729dbe30310 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.847603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252dc21-1804-4d48-b027-699f29e42b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.848507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252dc21-1804-4d48-b027-699f29e42b77 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.848945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252dc21-1804-4d48-b027-699f29e42b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.849367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252dc21-1804-4d48-b027-699f29e42b77 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.850187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252dc21-1804-4d48-b027-699f29e42b77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.852314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252dc21-1804-4d48-b027-699f29e42b77 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.871015 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3319/6613] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:44.872148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709c3d-848f-46cf-ae8b-8ef5ee130b19 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.898834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709c3d-848f-46cf-ae8b-8ef5ee130b19 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.913372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3295/6614] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:44 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:44.914388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252dc21-1804-4d48-b027-699f29e42b77 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.916822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa2ea2-95ec-48b9-ba2c-e0faef88d8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.917469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa2ea2-95ec-48b9-ba2c-e0faef88d8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.917745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa2ea2-95ec-48b9-ba2c-e0faef88d8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.918040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa2ea2-95ec-48b9-ba2c-e0faef88d8e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.921181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa2ea2-95ec-48b9-ba2c-e0faef88d8e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:44.921493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa2ea2-95ec-48b9-ba2c-e0faef88d8e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.926001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa2ea2-95ec-48b9-ba2c-e0faef88d8e3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.939430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252dc21-1804-4d48-b027-699f29e42b77 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.945121 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3320/6615] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:44.946224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa2ea2-95ec-48b9-ba2c-e0faef88d8e3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.951705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb86ca-0262-46f0-96c6-695f5b605c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.952398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb86ca-0262-46f0-96c6-695f5b605c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.952679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb86ca-0262-46f0-96c6-695f5b605c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.952950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb86ca-0262-46f0-96c6-695f5b605c97 admin admin] PATH_INFO: `/v3/projects/297502011889446fba303a693f621b3b/users/7ce57ce8cd4a4bf2826389a69b27538d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.961085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa2ea2-95ec-48b9-ba2c-e0faef88d8e3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:44.969261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578488e-0632-46ac-b80b-4cec0df7a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:44.969525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb86ca-0262-46f0-96c6-695f5b605c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297502011889446fba303a693f621b3b, user_id=7ce57ce8cd4a4bf2826389a69b27538d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.970776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578488e-0632-46ac-b80b-4cec0df7a5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:44.971057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578488e-0632-46ac-b80b-4cec0df7a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:44.971328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578488e-0632-46ac-b80b-4cec0df7a5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:44.972842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb86ca-0262-46f0-96c6-695f5b605c97 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.973910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578488e-0632-46ac-b80b-4cec0df7a5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:44.976115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578488e-0632-46ac-b80b-4cec0df7a5c4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:44.993445 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3321/6616] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:44.995968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578488e-0632-46ac-b80b-4cec0df7a5c4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:44.999811 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3296/6617] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:44 2022] PUT /identity/v3/projects/297502011889446fba303a693f621b3b/users/7ce57ce8cd4a4bf2826389a69b27538d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:45.000868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb86ca-0262-46f0-96c6-695f5b605c97 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:45.023688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578488e-0632-46ac-b80b-4cec0df7a5c4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.088469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb86ca-0262-46f0-96c6-695f5b605c97 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.101336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4967a-e057-4f47-a686-99efb7dd9900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:45.102558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4967a-e057-4f47-a686-99efb7dd9900 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.102884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4967a-e057-4f47-a686-99efb7dd9900 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.103252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4967a-e057-4f47-a686-99efb7dd9900 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.104971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4967a-e057-4f47-a686-99efb7dd9900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:45.111650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4967a-e057-4f47-a686-99efb7dd9900 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:45.128727 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3297/6618] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:45.128727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4967a-e057-4f47-a686-99efb7dd9900 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:45.132202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-afc4967a-e057-4f47-a686-99efb7dd9900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:45.133597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f7a8c-f3f7-4c09-9bc6-ba898d10bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:45.138609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f7a8c-f3f7-4c09-9bc6-ba898d10bf9d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.139175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f7a8c-f3f7-4c09-9bc6-ba898d10bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.139841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f7a8c-f3f7-4c09-9bc6-ba898d10bf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.140721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f7a8c-f3f7-4c09-9bc6-ba898d10bf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:45.144105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f7a8c-f3f7-4c09-9bc6-ba898d10bf9d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:45.156376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4967a-e057-4f47-a686-99efb7dd9900 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.164067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:45.165248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.165637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.166049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] PATH_INFO: `/v3/users/376c643973644463b76de06dccbfa5be` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.168034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376c643973644463b76de06dccbfa5be)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:45.171969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:45.197722 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3322/6619] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:44 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:45.198604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f7a8c-f3f7-4c09-9bc6-ba898d10bf9d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:45.243284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376c643973644463b76de06dccbfa5be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:45.244514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:45.253863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376c643973644463b76de06dccbfa5be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:45.271125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376c643973644463b76de06dccbfa5be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:45.273049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f7a8c-f3f7-4c09-9bc6-ba898d10bf9d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.278324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c3fc8-1b87-486e-bf54-fe940fca341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:45.279025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3fc8-1b87-486e-bf54-fe940fca341e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.279302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3fc8-1b87-486e-bf54-fe940fca341e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.279574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3fc8-1b87-486e-bf54-fe940fca341e admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.280267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c3fc8-1b87-486e-bf54-fe940fca341e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:45.280868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376c643973644463b76de06dccbfa5be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:45.281565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376c643973644463b76de06dccbfa5be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:45.282449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c3fc8-1b87-486e-bf54-fe940fca341e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:45.289512 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3298/6620] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:45 2022] DELETE /identity/v3/users/376c643973644463b76de06dccbfa5be => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:45.295957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:45.297979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:45.303568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:45.325144 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3323/6621] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:45 2022] POST /identity/v3/projects => generated 411 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:45.325144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca16a1-b915-42aa-91f3-dfc5ec620bcb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.325144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca16a1-b915-42aa-91f3-dfc5ec620bcb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.325144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca16a1-b915-42aa-91f3-dfc5ec620bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.361218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-37ca16a1-b915-42aa-91f3-dfc5ec620bcb None None] MFA Rules not processed for user `7ce57ce8cd4a4bf2826389a69b27538d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:45.362603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-37ca16a1-b915-42aa-91f3-dfc5ec620bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:45.379530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c5b46-bfcd-48f4-8ddf-cfcd26dac062 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.438018 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3324/6622] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:45.439188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca16a1-b915-42aa-91f3-dfc5ec620bcb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:45.440788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-37ca16a1-b915-42aa-91f3-dfc5ec620bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:45.451804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2809e-e784-45d2-8318-6c4b1a48023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:45.452486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2809e-e784-45d2-8318-6c4b1a48023d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.452928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2809e-e784-45d2-8318-6c4b1a48023d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.453200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2809e-e784-45d2-8318-6c4b1a48023d admin admin] PATH_INFO: `/v3/projects/c8dbb9ea95614a98a9af3f46832f63d1/users/3b298e1034594ba889f313379309eb08/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.472681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2809e-e784-45d2-8318-6c4b1a48023d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8dbb9ea95614a98a9af3f46832f63d1, user_id=3b298e1034594ba889f313379309eb08, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:45.476186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2809e-e784-45d2-8318-6c4b1a48023d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:45.491749 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3299/6623] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:45 2022] PUT /identity/v3/projects/c8dbb9ea95614a98a9af3f46832f63d1/users/3b298e1034594ba889f313379309eb08/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:45.492332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2809e-e784-45d2-8318-6c4b1a48023d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:45.493906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bfb2809e-e784-45d2-8318-6c4b1a48023d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:45.522542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca16a1-b915-42aa-91f3-dfc5ec620bcb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.568849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:45.574683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2809e-e784-45d2-8318-6c4b1a48023d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.580997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb99b6c-0a37-484b-b3d9-030c77ab385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:45.582819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99b6c-0a37-484b-b3d9-030c77ab385c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.583152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99b6c-0a37-484b-b3d9-030c77ab385c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.583425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99b6c-0a37-484b-b3d9-030c77ab385c admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.584259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb99b6c-0a37-484b-b3d9-030c77ab385c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:45.587684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb99b6c-0a37-484b-b3d9-030c77ab385c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:45.588081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6428-885f-49d9-aa02-3d0d0f823d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:45.588621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6428-885f-49d9-aa02-3d0d0f823d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.588897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6428-885f-49d9-aa02-3d0d0f823d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.589162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6428-885f-49d9-aa02-3d0d0f823d1d admin admin] PATH_INFO: `/v3/projects/cfe0d468c9a74d958c54d774c7b8b133/users/c448a8861d0646fe836f0e99c23b4345/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.607805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6428-885f-49d9-aa02-3d0d0f823d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe0d468c9a74d958c54d774c7b8b133, user_id=c448a8861d0646fe836f0e99c23b4345, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:45.610528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6428-885f-49d9-aa02-3d0d0f823d1d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:45.614449 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3300/6624] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:45 2022] POST /identity/v3/users => generated 298 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:45.614449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b3055-87e3-4d5a-8b1a-af4da9a86cec None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.614449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b3055-87e3-4d5a-8b1a-af4da9a86cec None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.614449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b3055-87e3-4d5a-8b1a-af4da9a86cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.628615 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3325/6625] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:45 2022] PUT /identity/v3/projects/cfe0d468c9a74d958c54d774c7b8b133/users/c448a8861d0646fe836f0e99c23b4345/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:45.632994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6428-885f-49d9-aa02-3d0d0f823d1d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:45.632994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-820d6428-885f-49d9-aa02-3d0d0f823d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:45.647236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1a5b3055-87e3-4d5a-8b1a-af4da9a86cec None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:45.648486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1a5b3055-87e3-4d5a-8b1a-af4da9a86cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:45.651072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:45.716010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6428-885f-49d9-aa02-3d0d0f823d1d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.720704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12ea62-6e4d-4604-96ae-9c18641c7fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:45.721321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12ea62-6e4d-4604-96ae-9c18641c7fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.721598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12ea62-6e4d-4604-96ae-9c18641c7fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.721863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12ea62-6e4d-4604-96ae-9c18641c7fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.722566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12ea62-6e4d-4604-96ae-9c18641c7fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:45.726494 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3301/6626] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:45.726494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b3055-87e3-4d5a-8b1a-af4da9a86cec None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:45.726718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12ea62-6e4d-4604-96ae-9c18641c7fa6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:45.727817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1a5b3055-87e3-4d5a-8b1a-af4da9a86cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:45.743268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b3055-87e3-4d5a-8b1a-af4da9a86cec None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.748139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:45.748832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.749114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.749387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] PATH_INFO: `/v3/users/6bdc957ddc1c4418a400179e6a6688ce` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.750758 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3326/6627] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:45 2022] POST /identity/v3/users => generated 306 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:45.751223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12ea62-6e4d-4604-96ae-9c18641c7fa6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:45.751476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bdc957ddc1c4418a400179e6a6688ce)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:45.752867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8d12ea62-6e4d-4604-96ae-9c18641c7fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:45.753767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:45.809843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdc957ddc1c4418a400179e6a6688ce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:45.823754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12ea62-6e4d-4604-96ae-9c18641c7fa6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.824971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdc957ddc1c4418a400179e6a6688ce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:45.828265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef1efb-0207-4a75-961a-b6ddf4397267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:45.828884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef1efb-0207-4a75-961a-b6ddf4397267 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.829148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef1efb-0207-4a75-961a-b6ddf4397267 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.829423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef1efb-0207-4a75-961a-b6ddf4397267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.841266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdc957ddc1c4418a400179e6a6688ce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:45.853131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdc957ddc1c4418a400179e6a6688ce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:45.853863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45612a5d-2952-4c52-9e1d-7be4d197df1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdc957ddc1c4418a400179e6a6688ce'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:45.866077 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3302/6628] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:45 2022] DELETE /identity/v3/users/6bdc957ddc1c4418a400179e6a6688ce => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:45.866077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4a78-7201-485b-bffb-04ab02506ead None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:45.866077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4a78-7201-485b-bffb-04ab02506ead None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:45.866077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d4a78-7201-485b-bffb-04ab02506ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:45.897179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef1efb-0207-4a75-961a-b6ddf4397267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:45.899097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef1efb-0207-4a75-961a-b6ddf4397267 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:45.907093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a46d4a78-7201-485b-bffb-04ab02506ead None None] MFA Rules not processed for user `3b298e1034594ba889f313379309eb08`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:45.908720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a46d4a78-7201-485b-bffb-04ab02506ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:45.910951 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3327/6629] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:45 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:45.912328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef1efb-0207-4a75-961a-b6ddf4397267 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:45.924252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef1efb-0207-4a75-961a-b6ddf4397267 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:45.995317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:45.998293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:46.010955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ad051-0156-4c9e-9f7d-64641c87fe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.011701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ad051-0156-4c9e-9f7d-64641c87fe3a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.012073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ad051-0156-4c9e-9f7d-64641c87fe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.012412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ad051-0156-4c9e-9f7d-64641c87fe3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.013740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ad051-0156-4c9e-9f7d-64641c87fe3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.016669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ad051-0156-4c9e-9f7d-64641c87fe3a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.034393 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3328/6630] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:46.034393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ad051-0156-4c9e-9f7d-64641c87fe3a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.035721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9d2ad051-0156-4c9e-9f7d-64641c87fe3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.041297 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3303/6631] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:46.041297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d4a78-7201-485b-bffb-04ab02506ead None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.041297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a46d4a78-7201-485b-bffb-04ab02506ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.057630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ad051-0156-4c9e-9f7d-64641c87fe3a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.065000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4997e7b-9ff1-467d-8486-733f565dace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.065951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4997e7b-9ff1-467d-8486-733f565dace3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.066213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4997e7b-9ff1-467d-8486-733f565dace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.066487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4997e7b-9ff1-467d-8486-733f565dace3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.067143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4997e7b-9ff1-467d-8486-733f565dace3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.068794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4997e7b-9ff1-467d-8486-733f565dace3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.093702 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3329/6632] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:46.094770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4997e7b-9ff1-467d-8486-733f565dace3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.097675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c4997e7b-9ff1-467d-8486-733f565dace3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.116726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4997e7b-9ff1-467d-8486-733f565dace3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.126074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecb34b-ee8a-4fa4-86f3-6761d746c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.129233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecb34b-ee8a-4fa4-86f3-6761d746c913 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.129784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecb34b-ee8a-4fa4-86f3-6761d746c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.130190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ecb34b-ee8a-4fa4-86f3-6761d746c913 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.131005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecb34b-ee8a-4fa4-86f3-6761d746c913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.134748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ecb34b-ee8a-4fa4-86f3-6761d746c913 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.157804 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3330/6633] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:46.157804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecb34b-ee8a-4fa4-86f3-6761d746c913 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.161181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-01ecb34b-ee8a-4fa4-86f3-6761d746c913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.162659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d4a78-7201-485b-bffb-04ab02506ead None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.169213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a695a-4c58-42e8-9640-cefe16954a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.170247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a695a-4c58-42e8-9640-cefe16954a1c service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.170784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a695a-4c58-42e8-9640-cefe16954a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.171053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a695a-4c58-42e8-9640-cefe16954a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.172828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e94a695a-4c58-42e8-9640-cefe16954a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.185747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a695a-4c58-42e8-9640-cefe16954a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.187256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a695a-4c58-42e8-9640-cefe16954a1c service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.206370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ecb34b-ee8a-4fa4-86f3-6761d746c913 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.206517 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3304/6634] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:46.206517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a695a-4c58-42e8-9640-cefe16954a1c service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.206517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e94a695a-4c58-42e8-9640-cefe16954a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.213405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.214432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.214856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.215269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] PATH_INFO: `/v3/users/7ce57ce8cd4a4bf2826389a69b27538d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.216549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a695a-4c58-42e8-9640-cefe16954a1c service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.216853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce57ce8cd4a4bf2826389a69b27538d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.219322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.222383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd018eee-c346-4a65-8158-d725c944b0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.223081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd018eee-c346-4a65-8158-d725c944b0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.223362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd018eee-c346-4a65-8158-d725c944b0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.223631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd018eee-c346-4a65-8158-d725c944b0ee admin admin] PATH_INFO: `/v3/projects/83cec2f469124827b958d7029f731245/users/234875f2f1304d388556ad453688e0d8/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.243401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd018eee-c346-4a65-8158-d725c944b0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cec2f469124827b958d7029f731245, user_id=234875f2f1304d388556ad453688e0d8, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.246766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd018eee-c346-4a65-8158-d725c944b0ee admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.271057 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3305/6635] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:46 2022] PUT /identity/v3/projects/83cec2f469124827b958d7029f731245/users/234875f2f1304d388556ad453688e0d8/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:46.272396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd018eee-c346-4a65-8158-d725c944b0ee admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.274283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bd018eee-c346-4a65-8158-d725c944b0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.284065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce57ce8cd4a4bf2826389a69b27538d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.285298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce57ce8cd4a4bf2826389a69b27538d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.296668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce57ce8cd4a4bf2826389a69b27538d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.309027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce57ce8cd4a4bf2826389a69b27538d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.333613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce57ce8cd4a4bf2826389a69b27538d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.340616 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3331/6636] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:46 2022] DELETE /identity/v3/users/7ce57ce8cd4a4bf2826389a69b27538d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:46.344692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.346147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.361270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd018eee-c346-4a65-8158-d725c944b0ee admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.428565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2218-0b82-4f09-b674-c2754931639e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.429266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2218-0b82-4f09-b674-c2754931639e service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.429611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2218-0b82-4f09-b674-c2754931639e service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.429725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2218-0b82-4f09-b674-c2754931639e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.431671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e9aa2218-0b82-4f09-b674-c2754931639e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.458825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7d2bf-0994-48dd-85b1-c4506d4b4ebf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.466093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179e71-14b0-43f7-9194-bcfadcb9b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.467694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179e71-14b0-43f7-9194-bcfadcb9b4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.467981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179e71-14b0-43f7-9194-bcfadcb9b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.468323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179e71-14b0-43f7-9194-bcfadcb9b4f8 admin admin] PATH_INFO: `/v3/projects/cfe0d468c9a74d958c54d774c7b8b133/users/c448a8861d0646fe836f0e99c23b4345/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.472600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179e71-14b0-43f7-9194-bcfadcb9b4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe0d468c9a74d958c54d774c7b8b133, user_id=c448a8861d0646fe836f0e99c23b4345, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.476042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179e71-14b0-43f7-9194-bcfadcb9b4f8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.480337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:46.492579 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3332/6637] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:46 2022] PUT /identity/v3/projects/cfe0d468c9a74d958c54d774c7b8b133/users/c448a8861d0646fe836f0e99c23b4345/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:46.493596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179e71-14b0-43f7-9194-bcfadcb9b4f8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.500180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fa179e71-14b0-43f7-9194-bcfadcb9b4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.536922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa2218-0b82-4f09-b674-c2754931639e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.538619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa2218-0b82-4f09-b674-c2754931639e service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.549730 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3306/6638] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:46 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:46.550661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2218-0b82-4f09-b674-c2754931639e service glance] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.552051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e9aa2218-0b82-4f09-b674-c2754931639e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.555019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:46.566756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2218-0b82-4f09-b674-c2754931639e service glance] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.585152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179e71-14b0-43f7-9194-bcfadcb9b4f8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.590423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.591061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.591337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.591599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] PATH_INFO: `/v3/projects/2fb24eb03c754cb6b7cfa6486c7c403f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.592765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb24eb03c754cb6b7cfa6486c7c403f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.594745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.641520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc0687-053f-410a-baf7-fc9cc0c3015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.642175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0687-053f-410a-baf7-fc9cc0c3015a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.642498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0687-053f-410a-baf7-fc9cc0c3015a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.643332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc0687-053f-410a-baf7-fc9cc0c3015a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.644143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc0687-053f-410a-baf7-fc9cc0c3015a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.645914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc0687-053f-410a-baf7-fc9cc0c3015a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.656515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb24eb03c754cb6b7cfa6486c7c403f', 'request_id': 'req-351161f6-1494-49dd-bae7-6f61fc37b991'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.658398 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3307/6639] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:46.659798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc0687-053f-410a-baf7-fc9cc0c3015a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.662562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d8cc0687-053f-410a-baf7-fc9cc0c3015a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.673834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb24eb03c754cb6b7cfa6486c7c403f', 'request_id': 'req-351161f6-1494-49dd-bae7-6f61fc37b991'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.676446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc0687-053f-410a-baf7-fc9cc0c3015a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.692239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb24eb03c754cb6b7cfa6486c7c403f', 'request_id': 'req-351161f6-1494-49dd-bae7-6f61fc37b991'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.707958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] The token cache is being invalidate because project 2fb24eb03c754cb6b7cfa6486c7c403f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:46.708299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.709026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-351161f6-1494-49dd-bae7-6f61fc37b991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.713863 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3333/6640] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:46 2022] DELETE /identity/v3/projects/2fb24eb03c754cb6b7cfa6486c7c403f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:46.713863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028f94b-39c5-4b6c-8dc1-b323eb2cbaa5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.714134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028f94b-39c5-4b6c-8dc1-b323eb2cbaa5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.714798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028f94b-39c5-4b6c-8dc1-b323eb2cbaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.744720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b028f94b-39c5-4b6c-8dc1-b323eb2cbaa5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:46.745957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b028f94b-39c5-4b6c-8dc1-b323eb2cbaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.759755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd5ffc-4432-47a6-97e9-1a9de396781b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.760857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd5ffc-4432-47a6-97e9-1a9de396781b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.762018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd5ffc-4432-47a6-97e9-1a9de396781b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.762437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd5ffc-4432-47a6-97e9-1a9de396781b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.763231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd5ffc-4432-47a6-97e9-1a9de396781b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.765049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd5ffc-4432-47a6-97e9-1a9de396781b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.780784 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3308/6641] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:46.783052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd5ffc-4432-47a6-97e9-1a9de396781b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.786693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-95dd5ffc-4432-47a6-97e9-1a9de396781b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.808856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd5ffc-4432-47a6-97e9-1a9de396781b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:46.814043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:46.814446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.814902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.815538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] PATH_INFO: `/v3/projects/c863daea2c01494eb47f768ddae309bd` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.816933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c863daea2c01494eb47f768ddae309bd)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:46.819268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:46.820100 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3334/6642] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:46.830244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfedb40-ecb5-4a20-8b3d-7aa190f4f176 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:46.830530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfedb40-ecb5-4a20-8b3d-7aa190f4f176 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:46.830804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfedb40-ecb5-4a20-8b3d-7aa190f4f176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:46.868710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7dfedb40-ecb5-4a20-8b3d-7aa190f4f176 None None] MFA Rules not processed for user `c448a8861d0646fe836f0e99c23b4345`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:46.869946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7dfedb40-ecb5-4a20-8b3d-7aa190f4f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.897111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c863daea2c01494eb47f768ddae309bd', 'request_id': 'req-5c2201f7-ad3d-439e-92ec-21256b9219b4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.907969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c863daea2c01494eb47f768ddae309bd', 'request_id': 'req-5c2201f7-ad3d-439e-92ec-21256b9219b4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.911891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:46.919693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c863daea2c01494eb47f768ddae309bd', 'request_id': 'req-5c2201f7-ad3d-439e-92ec-21256b9219b4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.939382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] The token cache is being invalidate because project c863daea2c01494eb47f768ddae309bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:46.939677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.940478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:46.942830 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3309/6643] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:46 2022] DELETE /identity/v3/projects/c863daea2c01494eb47f768ddae309bd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:46.943464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.944914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:46.960757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:46.977929 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3335/6644] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:46.978873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfedb40-ecb5-4a20-8b3d-7aa190f4f176 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:46.980483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7dfedb40-ecb5-4a20-8b3d-7aa190f4f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.000631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfedb40-ecb5-4a20-8b3d-7aa190f4f176 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:47.042253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2201f7-ad3d-439e-92ec-21256b9219b4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:47.047232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75413c-9f0b-4d75-972d-8a3cdfa8989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:47.048063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75413c-9f0b-4d75-972d-8a3cdfa8989b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.048343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75413c-9f0b-4d75-972d-8a3cdfa8989b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.048612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75413c-9f0b-4d75-972d-8a3cdfa8989b admin admin] PATH_INFO: `/v3/projects/72f922b05790479f889a190ac9e4caa6/users/a5020e8e2a5845b383d7dd27623454c1/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.068689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:47.069244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75413c-9f0b-4d75-972d-8a3cdfa8989b admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f922b05790479f889a190ac9e4caa6, user_id=a5020e8e2a5845b383d7dd27623454c1, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:47.070212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.070634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.071157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] PATH_INFO: `/v3/users/e486e2c0fb304519aeb698052c26e933` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.072246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75413c-9f0b-4d75-972d-8a3cdfa8989b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:47.073005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e486e2c0fb304519aeb698052c26e933)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:47.076218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:47.091443 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3310/6645] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:46 2022] PUT /identity/v3/projects/72f922b05790479f889a190ac9e4caa6/users/a5020e8e2a5845b383d7dd27623454c1/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:47.092711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75413c-9f0b-4d75-972d-8a3cdfa8989b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:47.094517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6c75413c-9f0b-4d75-972d-8a3cdfa8989b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.150197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e486e2c0fb304519aeb698052c26e933'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:47.151134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e486e2c0fb304519aeb698052c26e933'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:47.160796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e486e2c0fb304519aeb698052c26e933'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:47.171408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e486e2c0fb304519aeb698052c26e933'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:47.177999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75413c-9f0b-4d75-972d-8a3cdfa8989b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:47.183281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35315f-689a-4919-a607-a1c1af75ec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:47.184169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35315f-689a-4919-a607-a1c1af75ec6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.184534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35315f-689a-4919-a607-a1c1af75ec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.184920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35315f-689a-4919-a607-a1c1af75ec6c admin admin] PATH_INFO: `/v3/projects/83cec2f469124827b958d7029f731245/users/234875f2f1304d388556ad453688e0d8/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.186769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e486e2c0fb304519aeb698052c26e933'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:47.187101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35315f-689a-4919-a607-a1c1af75ec6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83cec2f469124827b958d7029f731245, user_id=234875f2f1304d388556ad453688e0d8, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:47.189907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35315f-689a-4919-a607-a1c1af75ec6c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:47.194325 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3336/6646] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:46 2022] DELETE /identity/v3/users/e486e2c0fb304519aeb698052c26e933 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:47.195457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:47.202290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.212040 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3311/6647] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:47 2022] PUT /identity/v3/projects/83cec2f469124827b958d7029f731245/users/234875f2f1304d388556ad453688e0d8/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:47.212040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a096d-870e-43d0-b4be-2bc5a0f99455 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.212040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a096d-870e-43d0-b4be-2bc5a0f99455 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.212040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a096d-870e-43d0-b4be-2bc5a0f99455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.256232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d21a096d-870e-43d0-b4be-2bc5a0f99455 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:47.257524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d21a096d-870e-43d0-b4be-2bc5a0f99455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.331144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bd016-383c-4aeb-8324-4612f18bc22f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:47.355512 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3312/6648] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:47.356701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a096d-870e-43d0-b4be-2bc5a0f99455 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:47.370997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:47.372655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:47.404346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c9fa0-772d-470e-9624-4c2eea182822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:47.404902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9fa0-772d-470e-9624-4c2eea182822 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.405174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9fa0-772d-470e-9624-4c2eea182822 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.405450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c9fa0-772d-470e-9624-4c2eea182822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.407485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fb6c9fa0-772d-470e-9624-4c2eea182822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.421148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c9fa0-772d-470e-9624-4c2eea182822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:47.422793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c9fa0-772d-470e-9624-4c2eea182822 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:47.434346 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3337/6649] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:47.435314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c9fa0-772d-470e-9624-4c2eea182822 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:47.447589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fb6c9fa0-772d-470e-9624-4c2eea182822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.467335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a096d-870e-43d0-b4be-2bc5a0f99455 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:47.469792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c9fa0-772d-470e-9624-4c2eea182822 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:47.473588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7100c8c-80b2-4b95-b6c8-2f423a5eac42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:47.474453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100c8c-80b2-4b95-b6c8-2f423a5eac42 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.474929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100c8c-80b2-4b95-b6c8-2f423a5eac42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.475599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100c8c-80b2-4b95-b6c8-2f423a5eac42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.478204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:47.478370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f7100c8c-80b2-4b95-b6c8-2f423a5eac42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.479158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.479584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.480031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] PATH_INFO: `/v3/users/64938f14157e4c70b0b872dc0ca141ed` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.482077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64938f14157e4c70b0b872dc0ca141ed)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:47.484210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:47.560339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64938f14157e4c70b0b872dc0ca141ed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:47.561494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64938f14157e4c70b0b872dc0ca141ed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:47.566600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7100c8c-80b2-4b95-b6c8-2f423a5eac42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:47.568094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7100c8c-80b2-4b95-b6c8-2f423a5eac42 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:47.573471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64938f14157e4c70b0b872dc0ca141ed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:47.580752 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3313/6650] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:47.582317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd15eb-abc7-4c01-bc2d-05f37f4212ca None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.582626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd15eb-abc7-4c01-bc2d-05f37f4212ca None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.582898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd15eb-abc7-4c01-bc2d-05f37f4212ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.586632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64938f14157e4c70b0b872dc0ca141ed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:47.604809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6949e7ba-e255-4d24-a65c-d67c24b08c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64938f14157e4c70b0b872dc0ca141ed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:47.615118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e5fd15eb-abc7-4c01-bc2d-05f37f4212ca None None] MFA Rules not processed for user `a5020e8e2a5845b383d7dd27623454c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:47.615676 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3338/6651] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:47 2022] DELETE /identity/v3/users/64938f14157e4c70b0b872dc0ca141ed => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:47.617852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd89c9-cf03-4a8b-b3f0-d8534fe023b4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.618257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd89c9-cf03-4a8b-b3f0-d8534fe023b4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.619052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd89c9-cf03-4a8b-b3f0-d8534fe023b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.620330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e5fd15eb-abc7-4c01-bc2d-05f37f4212ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.655941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c3fd89c9-cf03-4a8b-b3f0-d8534fe023b4 None None] MFA Rules not processed for user `234875f2f1304d388556ad453688e0d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:47.657156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c3fd89c9-cf03-4a8b-b3f0-d8534fe023b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.745275 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3314/6652] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:47.748119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19096-dc04-4082-b71a-954211a2e8ad None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.748703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19096-dc04-4082-b71a-954211a2e8ad None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.749125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19096-dc04-4082-b71a-954211a2e8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.780823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c2e19096-dc04-4082-b71a-954211a2e8ad None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:47.781764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c2e19096-dc04-4082-b71a-954211a2e8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.824292 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3339/6653] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:47.826155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd89c9-cf03-4a8b-b3f0-d8534fe023b4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:47.831906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c3fd89c9-cf03-4a8b-b3f0-d8534fe023b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.842752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:47.894302 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3315/6654] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:47.895996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093aa31-8cc6-4fc1-a226-433fbe30474b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.896943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093aa31-8cc6-4fc1-a226-433fbe30474b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.897437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093aa31-8cc6-4fc1-a226-433fbe30474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.923545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d093aa31-8cc6-4fc1-a226-433fbe30474b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:47.923807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:47.925374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d093aa31-8cc6-4fc1-a226-433fbe30474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.938376 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3316/6655] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:47.939441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093aa31-8cc6-4fc1-a226-433fbe30474b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:47.941564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d093aa31-8cc6-4fc1-a226-433fbe30474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:47.957065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093aa31-8cc6-4fc1-a226-433fbe30474b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:47.963377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892e4bc-6202-4cfe-91a2-ac5b576c2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:47.964233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e4bc-6202-4cfe-91a2-ac5b576c2efc admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:47.964734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e4bc-6202-4cfe-91a2-ac5b576c2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:47.965179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e4bc-6202-4cfe-91a2-ac5b576c2efc admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:47.966022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892e4bc-6202-4cfe-91a2-ac5b576c2efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:47.968497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892e4bc-6202-4cfe-91a2-ac5b576c2efc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.000302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd89c9-cf03-4a8b-b3f0-d8534fe023b4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.006315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.007264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.007699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.008132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] PATH_INFO: `/v3/projects/fbe28799f0a647dfaf12a93fc95de927` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.009415 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3317/6656] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:47 2022] POST /identity/v3/projects => generated 411 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:48.010186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe28799f0a647dfaf12a93fc95de927)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.010390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892e4bc-6202-4cfe-91a2-ac5b576c2efc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:48.012571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.012709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9892e4bc-6202-4cfe-91a2-ac5b576c2efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.081391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe28799f0a647dfaf12a93fc95de927', 'request_id': 'req-2012f593-fb02-4b9e-b618-f3668d080f6e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:48.091394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe28799f0a647dfaf12a93fc95de927', 'request_id': 'req-2012f593-fb02-4b9e-b618-f3668d080f6e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:48.094352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892e4bc-6202-4cfe-91a2-ac5b576c2efc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.103728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe28799f0a647dfaf12a93fc95de927', 'request_id': 'req-2012f593-fb02-4b9e-b618-f3668d080f6e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:48.124856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] The token cache is being invalidate because project fbe28799f0a647dfaf12a93fc95de927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:48.125237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:48.126011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:48.128500 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3340/6657] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:47 2022] DELETE /identity/v3/projects/fbe28799f0a647dfaf12a93fc95de927 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:48.129470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:48.132934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.172539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c0de9-24f6-4214-82bf-0fee8e43a2cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.173914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c0de9-24f6-4214-82bf-0fee8e43a2cf service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.174113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c0de9-24f6-4214-82bf-0fee8e43a2cf service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.174407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c0de9-24f6-4214-82bf-0fee8e43a2cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.176608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-542c0de9-24f6-4214-82bf-0fee8e43a2cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.249867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012f593-fb02-4b9e-b618-f3668d080f6e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.259787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.260645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.260773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.261130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] PATH_INFO: `/v3/projects/297502011889446fba303a693f621b3b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.262628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=297502011889446fba303a693f621b3b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.264654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.285096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c0de9-24f6-4214-82bf-0fee8e43a2cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.287404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c0de9-24f6-4214-82bf-0fee8e43a2cf service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.305111 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3318/6658] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:48.307176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c0de9-24f6-4214-82bf-0fee8e43a2cf service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:48.308915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-542c0de9-24f6-4214-82bf-0fee8e43a2cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.326354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c0de9-24f6-4214-82bf-0fee8e43a2cf service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.326674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297502011889446fba303a693f621b3b', 'request_id': 'req-24b17c34-0304-4125-bf21-c4eb9a6555c9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:48.333830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297502011889446fba303a693f621b3b', 'request_id': 'req-24b17c34-0304-4125-bf21-c4eb9a6555c9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:48.345783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297502011889446fba303a693f621b3b', 'request_id': 'req-24b17c34-0304-4125-bf21-c4eb9a6555c9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:48.347742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:48.363605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:48.367207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] The token cache is being invalidate because project 297502011889446fba303a693f621b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:48.367614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:48.368510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:48.373867 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3341/6659] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:48 2022] DELETE /identity/v3/projects/297502011889446fba303a693f621b3b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:48.373867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:48.376220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.450537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66705d3-5f56-4c22-a723-4a47041aa258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.451239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66705d3-5f56-4c22-a723-4a47041aa258 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.451548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66705d3-5f56-4c22-a723-4a47041aa258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.451799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66705d3-5f56-4c22-a723-4a47041aa258 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.453058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66705d3-5f56-4c22-a723-4a47041aa258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:48.453363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66705d3-5f56-4c22-a723-4a47041aa258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.455988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66705d3-5f56-4c22-a723-4a47041aa258 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.465317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b17c34-0304-4125-bf21-c4eb9a6555c9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.470346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb1f5c-b20d-4665-be74-410a3317be7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.473921 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3319/6660] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:48.474500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1f5c-b20d-4665-be74-410a3317be7f service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.474500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1f5c-b20d-4665-be74-410a3317be7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.474674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66705d3-5f56-4c22-a723-4a47041aa258 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:48.474781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb1f5c-b20d-4665-be74-410a3317be7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.480124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a66705d3-5f56-4c22-a723-4a47041aa258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.482222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0eeb1f5c-b20d-4665-be74-410a3317be7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.496623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66705d3-5f56-4c22-a723-4a47041aa258 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.498386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb1f5c-b20d-4665-be74-410a3317be7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.499946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb1f5c-b20d-4665-be74-410a3317be7f service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.503638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c44c2-97e0-4806-862a-75e49f3227ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.504633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c44c2-97e0-4806-862a-75e49f3227ab admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.505516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c44c2-97e0-4806-862a-75e49f3227ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.505816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c44c2-97e0-4806-862a-75e49f3227ab admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.506828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c44c2-97e0-4806-862a-75e49f3227ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.509033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c44c2-97e0-4806-862a-75e49f3227ab admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.514021 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3342/6661] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:48.515499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79919-94b6-427a-9fd7-de1b6851fd68 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.515814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79919-94b6-427a-9fd7-de1b6851fd68 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.516186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79919-94b6-427a-9fd7-de1b6851fd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.538095 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3320/6662] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:48 2022] POST /identity/v3/users => generated 312 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:48.539478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696d41c-4359-450e-ad4a-8a6046556d50 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.539758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696d41c-4359-450e-ad4a-8a6046556d50 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.540028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696d41c-4359-450e-ad4a-8a6046556d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.542091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bcb79919-94b6-427a-9fd7-de1b6851fd68 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:48.543382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bcb79919-94b6-427a-9fd7-de1b6851fd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.553612 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3343/6663] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:48.554571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79919-94b6-427a-9fd7-de1b6851fd68 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:48.555930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bcb79919-94b6-427a-9fd7-de1b6851fd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.571862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79919-94b6-427a-9fd7-de1b6851fd68 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.574082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4696d41c-4359-450e-ad4a-8a6046556d50 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:48.575533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4696d41c-4359-450e-ad4a-8a6046556d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.584572 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3321/6664] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:48.585643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696d41c-4359-450e-ad4a-8a6046556d50 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:48.586217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfd273-437d-4d9b-ba08-dd053fcc3e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.586894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd273-437d-4d9b-ba08-dd053fcc3e35 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.587175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd273-437d-4d9b-ba08-dd053fcc3e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.587448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acfd273-437d-4d9b-ba08-dd053fcc3e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.587578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4696d41c-4359-450e-ad4a-8a6046556d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.588098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfd273-437d-4d9b-ba08-dd053fcc3e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.590085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acfd273-437d-4d9b-ba08-dd053fcc3e35 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.660984 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3344/6665] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:48 2022] POST /identity/v3/projects => generated 359 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:48.662125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfd273-437d-4d9b-ba08-dd053fcc3e35 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:48.670018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696d41c-4359-450e-ad4a-8a6046556d50 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.741807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acfd273-437d-4d9b-ba08-dd053fcc3e35 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.754706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec51284-321b-4604-8d93-a5c472f33c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.755360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec51284-321b-4604-8d93-a5c472f33c8b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.755646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec51284-321b-4604-8d93-a5c472f33c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.755922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec51284-321b-4604-8d93-a5c472f33c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.756597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec51284-321b-4604-8d93-a5c472f33c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.758271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec51284-321b-4604-8d93-a5c472f33c8b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.771547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28de3-a5be-4be6-a244-a60bdcc70ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.775112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28de3-a5be-4be6-a244-a60bdcc70ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.775750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28de3-a5be-4be6-a244-a60bdcc70ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.776765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28de3-a5be-4be6-a244-a60bdcc70ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.788692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1cc28de3-a5be-4be6-a244-a60bdcc70ac4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.790220 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3345/6666] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:48.794059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc77371-e03f-4c60-b87c-cdd5fe09609e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.795499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc77371-e03f-4c60-b87c-cdd5fe09609e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.796215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc77371-e03f-4c60-b87c-cdd5fe09609e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.828447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ffc77371-e03f-4c60-b87c-cdd5fe09609e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:48.833204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ffc77371-e03f-4c60-b87c-cdd5fe09609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.846449 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3346/6667] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:48.846449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c72fc-8b97-4394-a5a5-68fe8ae3dd4a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.846449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c72fc-8b97-4394-a5a5-68fe8ae3dd4a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.846449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c72fc-8b97-4394-a5a5-68fe8ae3dd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.869118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-743c72fc-8b97-4394-a5a5-68fe8ae3dd4a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:48.870782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-743c72fc-8b97-4394-a5a5-68fe8ae3dd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:48.894484 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3347/6668] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:48.895587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28de3-a5be-4be6-a244-a60bdcc70ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.895720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c72fc-8b97-4394-a5a5-68fe8ae3dd4a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:48.897404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28de3-a5be-4be6-a244-a60bdcc70ac4 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.908742 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3322/6669] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:48.910173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28de3-a5be-4be6-a244-a60bdcc70ac4 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:48.916537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:48.923806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c72fc-8b97-4394-a5a5-68fe8ae3dd4a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.924402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28de3-a5be-4be6-a244-a60bdcc70ac4 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:48.936134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c09acd-55d5-4e2a-ba91-972355d8001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.936769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09acd-55d5-4e2a-ba91-972355d8001c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.937046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e237b3f-b424-42c4-b631-82f2665a24a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:48.937202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09acd-55d5-4e2a-ba91-972355d8001c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.937296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c09acd-55d5-4e2a-ba91-972355d8001c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.937970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c09acd-55d5-4e2a-ba91-972355d8001c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.938094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e237b3f-b424-42c4-b631-82f2665a24a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:48.938631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e237b3f-b424-42c4-b631-82f2665a24a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:48.938895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e237b3f-b424-42c4-b631-82f2665a24a1 admin admin] PATH_INFO: `/v3/projects/2563aae6027842589b7a33d14dc9f051/users/84b8434673044971880bc79b6f2c0aee/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:48.941441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c09acd-55d5-4e2a-ba91-972355d8001c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.973957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e237b3f-b424-42c4-b631-82f2665a24a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2563aae6027842589b7a33d14dc9f051, user_id=84b8434673044971880bc79b6f2c0aee, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:48.977399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e237b3f-b424-42c4-b631-82f2665a24a1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:48.984264 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3348/6670] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:48 2022] POST /identity/v3/users => generated 280 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:48.988169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c09acd-55d5-4e2a-ba91-972355d8001c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.000146 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3323/6671] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:48 2022] PUT /identity/v3/projects/2563aae6027842589b7a33d14dc9f051/users/84b8434673044971880bc79b6f2c0aee/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:49.000146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e237b3f-b424-42c4-b631-82f2665a24a1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.015457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c09acd-55d5-4e2a-ba91-972355d8001c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.135713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:49.138705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e237b3f-b424-42c4-b631-82f2665a24a1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.148685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c38997-3a50-45ad-8763-56d7f8402ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.150442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c38997-3a50-45ad-8763-56d7f8402ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.150928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c38997-3a50-45ad-8763-56d7f8402ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.151402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c38997-3a50-45ad-8763-56d7f8402ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.152327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c38997-3a50-45ad-8763-56d7f8402ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:49.152921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c38997-3a50-45ad-8763-56d7f8402ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.154949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c38997-3a50-45ad-8763-56d7f8402ca3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.169484 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3324/6672] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:49.170956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c38997-3a50-45ad-8763-56d7f8402ca3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.198399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c38997-3a50-45ad-8763-56d7f8402ca3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.199337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b0992-19f9-4faf-b416-226baf589d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.200389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b0992-19f9-4faf-b416-226baf589d03 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.200668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b0992-19f9-4faf-b416-226baf589d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.200938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b0992-19f9-4faf-b416-226baf589d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.201597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b0992-19f9-4faf-b416-226baf589d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:49.201913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b0992-19f9-4faf-b416-226baf589d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.203768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b0992-19f9-4faf-b416-226baf589d03 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.213572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fdf79-1b6f-4e6b-8c0a-cd9918661602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.215747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fdf79-1b6f-4e6b-8c0a-cd9918661602 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.219324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fdf79-1b6f-4e6b-8c0a-cd9918661602 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.219699 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3349/6673] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:49.220101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fdf79-1b6f-4e6b-8c0a-cd9918661602 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.221137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fdf79-1b6f-4e6b-8c0a-cd9918661602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.221309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b0992-19f9-4faf-b416-226baf589d03 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.228147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fdf79-1b6f-4e6b-8c0a-cd9918661602 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.236125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b0992-19f9-4faf-b416-226baf589d03 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.243484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08033188-6b7c-4d84-83f5-61f562cbbd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.244190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08033188-6b7c-4d84-83f5-61f562cbbd0b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.244471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08033188-6b7c-4d84-83f5-61f562cbbd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.244741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08033188-6b7c-4d84-83f5-61f562cbbd0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.245613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08033188-6b7c-4d84-83f5-61f562cbbd0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.247626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08033188-6b7c-4d84-83f5-61f562cbbd0b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.256435 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3325/6674] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:49.258005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fdf79-1b6f-4e6b-8c0a-cd9918661602 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.269267 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3350/6675] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:49.269267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08033188-6b7c-4d84-83f5-61f562cbbd0b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.272911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-475fdf79-1b6f-4e6b-8c0a-cd9918661602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:49.280541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08033188-6b7c-4d84-83f5-61f562cbbd0b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.285943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30c756-1e30-4a1f-93f4-e18177e1d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.286558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30c756-1e30-4a1f-93f4-e18177e1d8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.286838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30c756-1e30-4a1f-93f4-e18177e1d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.287110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30c756-1e30-4a1f-93f4-e18177e1d8a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.287767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30c756-1e30-4a1f-93f4-e18177e1d8a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.290654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30c756-1e30-4a1f-93f4-e18177e1d8a8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.312608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fdf79-1b6f-4e6b-8c0a-cd9918661602 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.328704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.329809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.330541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.331032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] PATH_INFO: `/v3/projects/b69bf98aa91643079a372f60fd7865ad` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.333489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b69bf98aa91643079a372f60fd7865ad)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.335876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.336682 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3351/6676] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:49 2022] POST /identity/v3/projects => generated 397 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:49.342202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30c756-1e30-4a1f-93f4-e18177e1d8a8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.419617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b69bf98aa91643079a372f60fd7865ad', 'request_id': 'req-6bbbb927-3b05-4d26-b03b-bf66df368a1b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.430894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b69bf98aa91643079a372f60fd7865ad', 'request_id': 'req-6bbbb927-3b05-4d26-b03b-bf66df368a1b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.441640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b69bf98aa91643079a372f60fd7865ad', 'request_id': 'req-6bbbb927-3b05-4d26-b03b-bf66df368a1b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.452120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30c756-1e30-4a1f-93f4-e18177e1d8a8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.463130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] The token cache is being invalidate because project b69bf98aa91643079a372f60fd7865ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:49.463130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.467857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.477638 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3326/6677] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:49 2022] DELETE /identity/v3/projects/b69bf98aa91643079a372f60fd7865ad => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:49.478950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.481064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:49.550725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ba933-b2cd-4656-9956-19134bccdb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.550725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ba933-b2cd-4656-9956-19134bccdb08 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.551140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ba933-b2cd-4656-9956-19134bccdb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.551265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ba933-b2cd-4656-9956-19134bccdb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.551904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ba933-b2cd-4656-9956-19134bccdb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.553998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ba933-b2cd-4656-9956-19134bccdb08 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.565196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:49.590047 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3352/6678] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:49 2022] POST /identity/v3/projects => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:49.591190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ba933-b2cd-4656-9956-19134bccdb08 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.594980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fb1ba933-b2cd-4656-9956-19134bccdb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:49.597158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbb927-3b05-4d26-b03b-bf66df368a1b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.630633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:49.673643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabcdc4-000a-4816-a391-906739ef98c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.674448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabcdc4-000a-4816-a391-906739ef98c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.675175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabcdc4-000a-4816-a391-906739ef98c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.675559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabcdc4-000a-4816-a391-906739ef98c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.676303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabcdc4-000a-4816-a391-906739ef98c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.681618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fabcdc4-000a-4816-a391-906739ef98c9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.686964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ba933-b2cd-4656-9956-19134bccdb08 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.694112 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3327/6679] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:49.695008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabcdc4-000a-4816-a391-906739ef98c9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.696342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c18a8-60bb-44e3-b26c-6381e0bac7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.697341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c18a8-60bb-44e3-b26c-6381e0bac7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.697503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9fabcdc4-000a-4816-a391-906739ef98c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:49.698321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c18a8-60bb-44e3-b26c-6381e0bac7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.698921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c18a8-60bb-44e3-b26c-6381e0bac7ad admin admin] PATH_INFO: `/v3/projects/2563aae6027842589b7a33d14dc9f051/users/84b8434673044971880bc79b6f2c0aee/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.701164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c18a8-60bb-44e3-b26c-6381e0bac7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2563aae6027842589b7a33d14dc9f051, user_id=84b8434673044971880bc79b6f2c0aee, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.705098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c18a8-60bb-44e3-b26c-6381e0bac7ad admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.711360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fabcdc4-000a-4816-a391-906739ef98c9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.718903 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3353/6680] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:49 2022] PUT /identity/v3/projects/2563aae6027842589b7a33d14dc9f051/users/84b8434673044971880bc79b6f2c0aee/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:49.719900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c18a8-60bb-44e3-b26c-6381e0bac7ad admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.721596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-783c18a8-60bb-44e3-b26c-6381e0bac7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:49.796671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ee85b-e2a7-474f-bffc-c19989d292fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.798027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ee85b-e2a7-474f-bffc-c19989d292fe admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.798498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ee85b-e2a7-474f-bffc-c19989d292fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.798986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ee85b-e2a7-474f-bffc-c19989d292fe admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.800377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ee85b-e2a7-474f-bffc-c19989d292fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.800621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c18a8-60bb-44e3-b26c-6381e0bac7ad admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.803122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ee85b-e2a7-474f-bffc-c19989d292fe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.806150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.807022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.807559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.808159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] PATH_INFO: `/v3/users/b031dc580d424d0fa87f328c051451ac` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.810146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b031dc580d424d0fa87f328c051451ac)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.812392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.834688 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3328/6681] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:49 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:49.834688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ee85b-e2a7-474f-bffc-c19989d292fe admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.842935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8d2ee85b-e2a7-474f-bffc-c19989d292fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:49.860274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ee85b-e2a7-474f-bffc-c19989d292fe admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:49.868903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:49.869626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:49.869942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:49.870252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] PATH_INFO: `/v3/users/3b298e1034594ba889f313379309eb08` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:49.871442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b298e1034594ba889f313379309eb08)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:49.874615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:49.905159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b031dc580d424d0fa87f328c051451ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.905620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b031dc580d424d0fa87f328c051451ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.915541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b031dc580d424d0fa87f328c051451ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.924657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b031dc580d424d0fa87f328c051451ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.939042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b298e1034594ba889f313379309eb08'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.939257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b031dc580d424d0fa87f328c051451ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.945984 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3354/6682] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:49 2022] DELETE /identity/v3/users/b031dc580d424d0fa87f328c051451ac => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:49.947051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b298e1034594ba889f313379309eb08'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.949474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.950916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:49.959688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:49.961379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b298e1034594ba889f313379309eb08'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.971599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b298e1034594ba889f313379309eb08'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.972500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b298e1034594ba889f313379309eb08'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:49.981112 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3329/6683] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:49 2022] DELETE /identity/v3/users/3b298e1034594ba889f313379309eb08 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:49.982148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:49.983690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:50.019428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:50.052059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b2015-6620-4290-9a26-4f04e3deafb9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.096240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fce82d-b7d8-42f1-8274-60656c5019c9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.103048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf89fa-d2c3-44df-a46b-60d0dfb90469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:50.103945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf89fa-d2c3-44df-a46b-60d0dfb90469 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.104181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf89fa-d2c3-44df-a46b-60d0dfb90469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.104625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf89fa-d2c3-44df-a46b-60d0dfb90469 admin admin] PATH_INFO: `/v3/projects/524eed44a60c41fd8f1fd7f3cfa0cda3/users/1c6f29e81f364d2fa5d10c37ed2b6544/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.120349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aab2a3-3f71-4af1-9242-47fe49ba60b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:50.121403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aab2a3-3f71-4af1-9242-47fe49ba60b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.121780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aab2a3-3f71-4af1-9242-47fe49ba60b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.122178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aab2a3-3f71-4af1-9242-47fe49ba60b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.122940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aab2a3-3f71-4af1-9242-47fe49ba60b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:50.123740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf89fa-d2c3-44df-a46b-60d0dfb90469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524eed44a60c41fd8f1fd7f3cfa0cda3, user_id=1c6f29e81f364d2fa5d10c37ed2b6544, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:50.125506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aab2a3-3f71-4af1-9242-47fe49ba60b3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:50.127653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf89fa-d2c3-44df-a46b-60d0dfb90469 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:50.147180 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3330/6684] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:49 2022] PUT /identity/v3/projects/524eed44a60c41fd8f1fd7f3cfa0cda3/users/1c6f29e81f364d2fa5d10c37ed2b6544/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:50.148800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234658e-380a-4cbb-bc46-84a9ff59ad8e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.149308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234658e-380a-4cbb-bc46-84a9ff59ad8e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.149763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234658e-380a-4cbb-bc46-84a9ff59ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.153597 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3355/6685] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:49 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:50.154788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aab2a3-3f71-4af1-9242-47fe49ba60b3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:50.157112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-50aab2a3-3f71-4af1-9242-47fe49ba60b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:50.174228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aab2a3-3f71-4af1-9242-47fe49ba60b3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.247010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b234658e-380a-4cbb-bc46-84a9ff59ad8e None None] MFA Rules not processed for user `84b8434673044971880bc79b6f2c0aee`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:50.248472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b234658e-380a-4cbb-bc46-84a9ff59ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:50.252404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333fc5f-3913-4ed7-be38-2a4dacc7ef27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:50.253553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333fc5f-3913-4ed7-be38-2a4dacc7ef27 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.253985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333fc5f-3913-4ed7-be38-2a4dacc7ef27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.254400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333fc5f-3913-4ed7-be38-2a4dacc7ef27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.255838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333fc5f-3913-4ed7-be38-2a4dacc7ef27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:50.257860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333fc5f-3913-4ed7-be38-2a4dacc7ef27 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:50.273483 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3356/6686] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:50.273483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333fc5f-3913-4ed7-be38-2a4dacc7ef27 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:50.275258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d333fc5f-3913-4ed7-be38-2a4dacc7ef27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:50.376926 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3331/6687] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:50 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:50.387018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727973-00e3-4c2a-b50a-45e3b6f7da95 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.387674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727973-00e3-4c2a-b50a-45e3b6f7da95 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.388176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c727973-00e3-4c2a-b50a-45e3b6f7da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.391664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333fc5f-3913-4ed7-be38-2a4dacc7ef27 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.400911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0685a8-56fc-4874-9073-0b616e25a91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:50.401583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0685a8-56fc-4874-9073-0b616e25a91f service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.401865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0685a8-56fc-4874-9073-0b616e25a91f service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.402147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0685a8-56fc-4874-9073-0b616e25a91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.406966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eb0685a8-56fc-4874-9073-0b616e25a91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:50.414313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3c727973-00e3-4c2a-b50a-45e3b6f7da95 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:50.418414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3c727973-00e3-4c2a-b50a-45e3b6f7da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:50.434670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:50.441421 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3332/6688] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:50.442960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d37499-3c68-4f38-b100-be4b8bddea8e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.443245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d37499-3c68-4f38-b100-be4b8bddea8e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.443515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d37499-3c68-4f38-b100-be4b8bddea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.480844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-36d37499-3c68-4f38-b100-be4b8bddea8e None None] MFA Rules not processed for user `1c6f29e81f364d2fa5d10c37ed2b6544`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:50.482079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-36d37499-3c68-4f38-b100-be4b8bddea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:50.500632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0685a8-56fc-4874-9073-0b616e25a91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:50.502441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0685a8-56fc-4874-9073-0b616e25a91f service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:50.516125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3357/6689] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:50.517062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0685a8-56fc-4874-9073-0b616e25a91f service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:50.518400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eb0685a8-56fc-4874-9073-0b616e25a91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:50.534724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0685a8-56fc-4874-9073-0b616e25a91f service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.544901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:50.545391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95abf3-e76c-4677-b3f7-3041e34c46d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:50.546403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95abf3-e76c-4677-b3f7-3041e34c46d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.546930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95abf3-e76c-4677-b3f7-3041e34c46d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.547044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95abf3-e76c-4677-b3f7-3041e34c46d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.547651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95abf3-e76c-4677-b3f7-3041e34c46d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:50.549231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95abf3-e76c-4677-b3f7-3041e34c46d5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:50.563785 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3358/6690] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:50.563785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95abf3-e76c-4677-b3f7-3041e34c46d5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:50.573512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95abf3-e76c-4677-b3f7-3041e34c46d5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.578862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1fabe-be53-4606-87eb-711aeb392b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:50.579909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1fabe-be53-4606-87eb-711aeb392b4d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.580284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1fabe-be53-4606-87eb-711aeb392b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.580643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1fabe-be53-4606-87eb-711aeb392b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.581907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1fabe-be53-4606-87eb-711aeb392b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:50.583826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1fabe-be53-4606-87eb-711aeb392b4d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:50.598789 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3359/6691] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:50.599663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1fabe-be53-4606-87eb-711aeb392b4d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:50.601583 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3333/6692] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:50.605911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d37499-3c68-4f38-b100-be4b8bddea8e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:50.607691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-36d37499-3c68-4f38-b100-be4b8bddea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:50.623426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d37499-3c68-4f38-b100-be4b8bddea8e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.631246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1fabe-be53-4606-87eb-711aeb392b4d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.632929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa516ec-24f9-4daf-a03e-1327dbef1add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:50.633583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa516ec-24f9-4daf-a03e-1327dbef1add service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.633865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa516ec-24f9-4daf-a03e-1327dbef1add service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.634167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa516ec-24f9-4daf-a03e-1327dbef1add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.645611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20073d-23ef-44af-99f4-c481b0e5e492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:50.646588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20073d-23ef-44af-99f4-c481b0e5e492 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.647199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20073d-23ef-44af-99f4-c481b0e5e492 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.647437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20073d-23ef-44af-99f4-c481b0e5e492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.654845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa516ec-24f9-4daf-a03e-1327dbef1add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:50.656595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa516ec-24f9-4daf-a03e-1327dbef1add service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:50.663674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20073d-23ef-44af-99f4-c481b0e5e492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:50.665447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20073d-23ef-44af-99f4-c481b0e5e492 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:50.668660 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3334/6693] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:50.675446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa516ec-24f9-4daf-a03e-1327dbef1add service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:50.684045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-efa516ec-24f9-4daf-a03e-1327dbef1add service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:50.701238 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3360/6694] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:50 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:50.702234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20073d-23ef-44af-99f4-c481b0e5e492 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:50.704343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa516ec-24f9-4daf-a03e-1327dbef1add service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.709965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:50.710927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.711347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.711757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] PATH_INFO: `/v3/projects/c8dbb9ea95614a98a9af3f46832f63d1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.713075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8dbb9ea95614a98a9af3f46832f63d1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:50.715251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:50.734660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20073d-23ef-44af-99f4-c481b0e5e492 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.753783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25e2ac-1fbc-4fbe-a306-6d8f773a1805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:50.754592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25e2ac-1fbc-4fbe-a306-6d8f773a1805 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:50.757114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25e2ac-1fbc-4fbe-a306-6d8f773a1805 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:50.757114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25e2ac-1fbc-4fbe-a306-6d8f773a1805 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:50.760053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25e2ac-1fbc-4fbe-a306-6d8f773a1805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:50.764095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25e2ac-1fbc-4fbe-a306-6d8f773a1805 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:50.778468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8dbb9ea95614a98a9af3f46832f63d1', 'request_id': 'req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:50.790474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8dbb9ea95614a98a9af3f46832f63d1', 'request_id': 'req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:50.798797 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3361/6695] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:50.800085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25e2ac-1fbc-4fbe-a306-6d8f773a1805 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:50.813842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8dbb9ea95614a98a9af3f46832f63d1', 'request_id': 'req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:50.814354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25e2ac-1fbc-4fbe-a306-6d8f773a1805 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:50.836610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] The token cache is being invalidate because project c8dbb9ea95614a98a9af3f46832f63d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:50.836879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:50.837637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:50.842813 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3335/6696] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:50 2022] DELETE /identity/v3/projects/c8dbb9ea95614a98a9af3f46832f63d1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:50.843877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:50.848383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.009663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f92119-bc38-4976-a085-6e1ba8ee86b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:51.010752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92119-bc38-4976-a085-6e1ba8ee86b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.011058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92119-bc38-4976-a085-6e1ba8ee86b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.011367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f92119-bc38-4976-a085-6e1ba8ee86b7 admin admin] PATH_INFO: `/v3/projects/cbe3f46e0a9b40c78465a09fad99a7a0/users/b960937993524b9aa9a50b3f1b9e8235/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.062362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2b091-72c3-4e5a-b305-98e6c5965a9c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:51.064307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f92119-bc38-4976-a085-6e1ba8ee86b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe3f46e0a9b40c78465a09fad99a7a0, user_id=b960937993524b9aa9a50b3f1b9e8235, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:51.068702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5236e-b02c-48e6-8c14-70ad5192da4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:51.069442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5236e-b02c-48e6-8c14-70ad5192da4c service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.070004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5236e-b02c-48e6-8c14-70ad5192da4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.070480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5236e-b02c-48e6-8c14-70ad5192da4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.072581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24b5236e-b02c-48e6-8c14-70ad5192da4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.084979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f92119-bc38-4976-a085-6e1ba8ee86b7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:51.123526 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3362/6697] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:50 2022] PUT /identity/v3/projects/cbe3f46e0a9b40c78465a09fad99a7a0/users/b960937993524b9aa9a50b3f1b9e8235/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:51.123526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f92119-bc38-4976-a085-6e1ba8ee86b7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:51.123526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d8f92119-bc38-4976-a085-6e1ba8ee86b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.178960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5236e-b02c-48e6-8c14-70ad5192da4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:51.180691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5236e-b02c-48e6-8c14-70ad5192da4c service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:51.194259 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3336/6698] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:51.196203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7b75-30c8-485d-80a7-025feffe6d90 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.196712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7b75-30c8-485d-80a7-025feffe6d90 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.197159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb7b75-30c8-485d-80a7-025feffe6d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.209542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:51.225084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b2cb7b75-30c8-485d-80a7-025feffe6d90 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:51.226930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b2cb7b75-30c8-485d-80a7-025feffe6d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.234594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f92119-bc38-4976-a085-6e1ba8ee86b7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:51.236928 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3337/6699] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:51.238629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846c18b-675c-4412-85ec-db4cc7825b79 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.238934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846c18b-675c-4412-85ec-db4cc7825b79 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.239650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8846c18b-675c-4412-85ec-db4cc7825b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.251192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2575e-23fb-4cf0-ad8e-3fe54305c796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:51.251889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2575e-23fb-4cf0-ad8e-3fe54305c796 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.252163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2575e-23fb-4cf0-ad8e-3fe54305c796 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.252434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2575e-23fb-4cf0-ad8e-3fe54305c796 admin admin] PATH_INFO: `/v3/projects/184ceadf06eb419599196d1fc6fcdb93/users/105c266b331a44678788118ed9bc7bd8/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.256348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:51.272633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8846c18b-675c-4412-85ec-db4cc7825b79 None None] MFA Rules not processed for user `b960937993524b9aa9a50b3f1b9e8235`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:51.274045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8846c18b-675c-4412-85ec-db4cc7825b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.293279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2575e-23fb-4cf0-ad8e-3fe54305c796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184ceadf06eb419599196d1fc6fcdb93, user_id=105c266b331a44678788118ed9bc7bd8, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:51.295908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2575e-23fb-4cf0-ad8e-3fe54305c796 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:51.324879 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3363/6700] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:51 2022] PUT /identity/v3/projects/184ceadf06eb419599196d1fc6fcdb93/users/105c266b331a44678788118ed9bc7bd8/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:51.326551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce16f24-0212-4239-85df-64de728b40cd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.326886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce16f24-0212-4239-85df-64de728b40cd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.327100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce16f24-0212-4239-85df-64de728b40cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.355592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5ce16f24-0212-4239-85df-64de728b40cd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:51.356838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5ce16f24-0212-4239-85df-64de728b40cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.435162 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3338/6701] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:51.437319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17085e62-e919-47a4-b9bb-bcf01d55584e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.437756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17085e62-e919-47a4-b9bb-bcf01d55584e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.438289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17085e62-e919-47a4-b9bb-bcf01d55584e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.475485 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3364/6702] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:51.477227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-17085e62-e919-47a4-b9bb-bcf01d55584e None None] MFA Rules not processed for user `105c266b331a44678788118ed9bc7bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:51.477718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce16f24-0212-4239-85df-64de728b40cd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:51.478475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-17085e62-e919-47a4-b9bb-bcf01d55584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.479940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5ce16f24-0212-4239-85df-64de728b40cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.512180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce16f24-0212-4239-85df-64de728b40cd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:51.517938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:51.518754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.519049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.519390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] PATH_INFO: `/v3/projects/0e12cc89a3f2406b9caa3222fa8dd486` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.529186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e12cc89a3f2406b9caa3222fa8dd486)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:51.531942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:51.577169 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3339/6703] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:51.578301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17085e62-e919-47a4-b9bb-bcf01d55584e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:51.580050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-17085e62-e919-47a4-b9bb-bcf01d55584e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.599985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e12cc89a3f2406b9caa3222fa8dd486', 'request_id': 'req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:51.610428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e12cc89a3f2406b9caa3222fa8dd486', 'request_id': 'req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:51.622778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e12cc89a3f2406b9caa3222fa8dd486', 'request_id': 'req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:51.651961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] The token cache is being invalidate because project 0e12cc89a3f2406b9caa3222fa8dd486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:51.652249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:51.652937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:51.657598 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3365/6704] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:51 2022] DELETE /identity/v3/projects/0e12cc89a3f2406b9caa3222fa8dd486 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:51.658637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:51.660102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.678921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17085e62-e919-47a4-b9bb-bcf01d55584e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:51.717107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:51.741546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa43c-96c1-4d82-8068-e05f722bbb3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:51.742224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa43c-96c1-4d82-8068-e05f722bbb3a service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.742499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa43c-96c1-4d82-8068-e05f722bbb3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.742761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa43c-96c1-4d82-8068-e05f722bbb3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.744644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8fbaa43c-96c1-4d82-8068-e05f722bbb3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.804326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e5b76d-80a8-4b1c-8180-4aa4257a8e78 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:51.811721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7915fa-d2cc-4753-9b0c-b55c201da1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:51.813580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7915fa-d2cc-4753-9b0c-b55c201da1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.814190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7915fa-d2cc-4753-9b0c-b55c201da1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.815648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7915fa-d2cc-4753-9b0c-b55c201da1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.816355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7915fa-d2cc-4753-9b0c-b55c201da1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:51.816658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7915fa-d2cc-4753-9b0c-b55c201da1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:51.819315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7915fa-d2cc-4753-9b0c-b55c201da1b0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:51.830334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:51.834768 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3366/6705] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:51.835618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7915fa-d2cc-4753-9b0c-b55c201da1b0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:51.837965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9a7915fa-d2cc-4753-9b0c-b55c201da1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.854984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7915fa-d2cc-4753-9b0c-b55c201da1b0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:51.861565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaa43c-96c1-4d82-8068-e05f722bbb3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:51.862341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96be4fe-3591-4229-90d6-23c14b9f36f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:51.862967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96be4fe-3591-4229-90d6-23c14b9f36f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.863243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96be4fe-3591-4229-90d6-23c14b9f36f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.863512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96be4fe-3591-4229-90d6-23c14b9f36f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.864004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaa43c-96c1-4d82-8068-e05f722bbb3a service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:51.864149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96be4fe-3591-4229-90d6-23c14b9f36f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:51.867885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96be4fe-3591-4229-90d6-23c14b9f36f9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:51.877203 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3340/6706] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:51 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:51.878497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa43c-96c1-4d82-8068-e05f722bbb3a service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:51.881440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8fbaa43c-96c1-4d82-8068-e05f722bbb3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:51.900911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa43c-96c1-4d82-8068-e05f722bbb3a service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:51.908786 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3367/6707] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:51 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:51.908786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96be4fe-3591-4229-90d6-23c14b9f36f9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:51.909280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:51.909280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:51.909731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:51.910123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] PATH_INFO: `/v3/users/234875f2f1304d388556ad453688e0d8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:51.915381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=234875f2f1304d388556ad453688e0d8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:51.919126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.019456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234875f2f1304d388556ad453688e0d8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:52.037447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96be4fe-3591-4229-90d6-23c14b9f36f9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.038415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234875f2f1304d388556ad453688e0d8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:52.043483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb451-392e-4cc4-be77-35a45d0be208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.044155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb451-392e-4cc4-be77-35a45d0be208 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.044436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb451-392e-4cc4-be77-35a45d0be208 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.044867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb451-392e-4cc4-be77-35a45d0be208 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.045709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bb451-392e-4cc4-be77-35a45d0be208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.048481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7bb451-392e-4cc4-be77-35a45d0be208 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.058111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234875f2f1304d388556ad453688e0d8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:52.072709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234875f2f1304d388556ad453688e0d8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:52.073937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234875f2f1304d388556ad453688e0d8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:52.087660 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3341/6708] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:51 2022] DELETE /identity/v3/users/234875f2f1304d388556ad453688e0d8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:52.088951 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3368/6709] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:51 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:52.090146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.093209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb451-392e-4cc4-be77-35a45d0be208 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.094512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:52.097913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8e7bb451-392e-4cc4-be77-35a45d0be208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:52.194287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb451-392e-4cc4-be77-35a45d0be208 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.199580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac46bc-8d41-4bda-a26b-06867baba7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.200203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac46bc-8d41-4bda-a26b-06867baba7ac admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.200477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac46bc-8d41-4bda-a26b-06867baba7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.200740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac46bc-8d41-4bda-a26b-06867baba7ac admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.201423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac46bc-8d41-4bda-a26b-06867baba7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.203649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac46bc-8d41-4bda-a26b-06867baba7ac admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.236746 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3369/6710] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:52 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:52.241939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac46bc-8d41-4bda-a26b-06867baba7ac admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.245823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f4a5f-12d2-4b4e-b093-b71d95c5a60d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.252454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7a6da-5eed-42a1-9501-32225d8d1826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.253602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7a6da-5eed-42a1-9501-32225d8d1826 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.253978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7a6da-5eed-42a1-9501-32225d8d1826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.254900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7a6da-5eed-42a1-9501-32225d8d1826 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.255780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7a6da-5eed-42a1-9501-32225d8d1826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.259253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7a6da-5eed-42a1-9501-32225d8d1826 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.264593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac46bc-8d41-4bda-a26b-06867baba7ac admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.279921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bbfc0-9492-4681-8707-d822c1c283fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.281069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bbfc0-9492-4681-8707-d822c1c283fc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.281702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bbfc0-9492-4681-8707-d822c1c283fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.282204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bbfc0-9492-4681-8707-d822c1c283fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.283836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bbfc0-9492-4681-8707-d822c1c283fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.286017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bbfc0-9492-4681-8707-d822c1c283fc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.294001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:52.314220 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3370/6711] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:52.315853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bbfc0-9492-4681-8707-d822c1c283fc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.331077 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3342/6712] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:52 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:52.331328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bbfc0-9492-4681-8707-d822c1c283fc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.334376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7a6da-5eed-42a1-9501-32225d8d1826 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.337460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0edc73-761b-4767-9911-4a2b001865d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.338366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0edc73-761b-4767-9911-4a2b001865d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.338739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0edc73-761b-4767-9911-4a2b001865d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.339200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0edc73-761b-4767-9911-4a2b001865d3 admin admin] PATH_INFO: `/v3/projects/0abbcfbdbfe742cebe8baa6ff2ab4ed3/users/f6676901cb4d49bf9b16e1f4f8036a92/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.364207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0edc73-761b-4767-9911-4a2b001865d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abbcfbdbfe742cebe8baa6ff2ab4ed3, user_id=f6676901cb4d49bf9b16e1f4f8036a92, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.364803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7a6da-5eed-42a1-9501-32225d8d1826 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.383327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0edc73-761b-4767-9911-4a2b001865d3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.398429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583dd8-f50d-46a6-a2bf-923a6dcb4a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.399753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583dd8-f50d-46a6-a2bf-923a6dcb4a42 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.399994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583dd8-f50d-46a6-a2bf-923a6dcb4a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.400392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583dd8-f50d-46a6-a2bf-923a6dcb4a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.402235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa583dd8-f50d-46a6-a2bf-923a6dcb4a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.404555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa583dd8-f50d-46a6-a2bf-923a6dcb4a42 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.423802 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3371/6713] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:52 2022] PUT /identity/v3/projects/0abbcfbdbfe742cebe8baa6ff2ab4ed3/users/f6676901cb4d49bf9b16e1f4f8036a92/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:52.428959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0edc73-761b-4767-9911-4a2b001865d3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.438722 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3343/6714] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:52.443487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583dd8-f50d-46a6-a2bf-923a6dcb4a42 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.476478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583dd8-f50d-46a6-a2bf-923a6dcb4a42 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.494926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:52.587065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0edc73-761b-4767-9911-4a2b001865d3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.596841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9bf85-dc76-412c-8d90-c9eeda3da4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.597968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9bf85-dc76-412c-8d90-c9eeda3da4cc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.603025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9bf85-dc76-412c-8d90-c9eeda3da4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.603372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9bf85-dc76-412c-8d90-c9eeda3da4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.604484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9bf85-dc76-412c-8d90-c9eeda3da4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.606338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9bf85-dc76-412c-8d90-c9eeda3da4cc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.620930 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3372/6715] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:52.625269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284dd21-6d09-4765-981c-cc2aa54151cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.626080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9bf85-dc76-412c-8d90-c9eeda3da4cc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.626216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284dd21-6d09-4765-981c-cc2aa54151cf admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.626433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284dd21-6d09-4765-981c-cc2aa54151cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.626699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284dd21-6d09-4765-981c-cc2aa54151cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.627585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284dd21-6d09-4765-981c-cc2aa54151cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.629797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284dd21-6d09-4765-981c-cc2aa54151cf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.641464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9bf85-dc76-412c-8d90-c9eeda3da4cc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.647774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24049ad7-fc8b-4855-843c-bd6a0a155600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.649482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049ad7-fc8b-4855-843c-bd6a0a155600 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.650023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049ad7-fc8b-4855-843c-bd6a0a155600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.650536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24049ad7-fc8b-4855-843c-bd6a0a155600 admin admin] PATH_INFO: `/v3/projects/0abbcfbdbfe742cebe8baa6ff2ab4ed3/users/f6676901cb4d49bf9b16e1f4f8036a92/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.654376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24049ad7-fc8b-4855-843c-bd6a0a155600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abbcfbdbfe742cebe8baa6ff2ab4ed3, user_id=f6676901cb4d49bf9b16e1f4f8036a92, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.657522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24049ad7-fc8b-4855-843c-bd6a0a155600 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.658434 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3344/6716] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:52.662659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284dd21-6d09-4765-981c-cc2aa54151cf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.671111 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3373/6717] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:52 2022] PUT /identity/v3/projects/0abbcfbdbfe742cebe8baa6ff2ab4ed3/users/f6676901cb4d49bf9b16e1f4f8036a92/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:52.682640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1e59-d9b1-44df-a10e-0cd0f0ef7733 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.684053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1e59-d9b1-44df-a10e-0cd0f0ef7733 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.685587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1e59-d9b1-44df-a10e-0cd0f0ef7733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.691534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284dd21-6d09-4765-981c-cc2aa54151cf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.733546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-34cb1e59-d9b1-44df-a10e-0cd0f0ef7733 None None] MFA Rules not processed for user `f6676901cb4d49bf9b16e1f4f8036a92`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:52.735080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-34cb1e59-d9b1-44df-a10e-0cd0f0ef7733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:52.805361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4aaf8-75fd-4fb8-b522-092707ae9504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.806469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4aaf8-75fd-4fb8-b522-092707ae9504 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.806812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4aaf8-75fd-4fb8-b522-092707ae9504 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.807144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4aaf8-75fd-4fb8-b522-092707ae9504 admin admin] PATH_INFO: `/v3/projects/6f28567fbf8d441bbf165437bc271b45/users/0e2d7d5ddc10455fa73b3424e0c2c3a3/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.824677 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3374/6718] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:52.829290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1e59-d9b1-44df-a10e-0cd0f0ef7733 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.838545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4aaf8-75fd-4fb8-b522-092707ae9504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f28567fbf8d441bbf165437bc271b45, user_id=0e2d7d5ddc10455fa73b3424e0c2c3a3, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.845752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4aaf8-75fd-4fb8-b522-092707ae9504 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.846678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1e59-d9b1-44df-a10e-0cd0f0ef7733 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:52.853388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fa338-80ce-4ffd-bf69-9e5ede7b29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:52.854071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa338-80ce-4ffd-bf69-9e5ede7b29a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.854356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa338-80ce-4ffd-bf69-9e5ede7b29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.854611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fa338-80ce-4ffd-bf69-9e5ede7b29a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.855439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fa338-80ce-4ffd-bf69-9e5ede7b29a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:52.857588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fa338-80ce-4ffd-bf69-9e5ede7b29a7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:52.876107 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3345/6719] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:52 2022] PUT /identity/v3/projects/6f28567fbf8d441bbf165437bc271b45/users/0e2d7d5ddc10455fa73b3424e0c2c3a3/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:52.899321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30692-b110-40f5-9d18-308cbc37cbf6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:52.899771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30692-b110-40f5-9d18-308cbc37cbf6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:52.900602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f30692-b110-40f5-9d18-308cbc37cbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:52.923189 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3375/6720] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:52 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:52.929530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fa338-80ce-4ffd-bf69-9e5ede7b29a7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:52.980129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f9f30692-b110-40f5-9d18-308cbc37cbf6 None None] MFA Rules not processed for user `0e2d7d5ddc10455fa73b3424e0c2c3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:52.981726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f9f30692-b110-40f5-9d18-308cbc37cbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:53.054703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fa338-80ce-4ffd-bf69-9e5ede7b29a7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.059657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:53.064764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd84b6-2fc2-4c44-8ffc-50b2e705cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.068101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd84b6-2fc2-4c44-8ffc-50b2e705cf5a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.068101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd84b6-2fc2-4c44-8ffc-50b2e705cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.068101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd84b6-2fc2-4c44-8ffc-50b2e705cf5a admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.068780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd84b6-2fc2-4c44-8ffc-50b2e705cf5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.084352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd84b6-2fc2-4c44-8ffc-50b2e705cf5a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.102720 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3346/6721] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:53.103762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:53.103966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f30692-b110-40f5-9d18-308cbc37cbf6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:53.105781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f9f30692-b110-40f5-9d18-308cbc37cbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:53.126209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f30692-b110-40f5-9d18-308cbc37cbf6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.129449 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3376/6722] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:52 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:53.131664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd84b6-2fc2-4c44-8ffc-50b2e705cf5a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:53.136821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.138207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.138452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.138539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] PATH_INFO: `/v3/users/6de01c5cbe244926b848a9c5d78f081d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.140422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de01c5cbe244926b848a9c5d78f081d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.144523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.149113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd84b6-2fc2-4c44-8ffc-50b2e705cf5a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.157229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37514333-2db2-4b26-af4c-f6ae2827b0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.157894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514333-2db2-4b26-af4c-f6ae2827b0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.158808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514333-2db2-4b26-af4c-f6ae2827b0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.158808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37514333-2db2-4b26-af4c-f6ae2827b0f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.160162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37514333-2db2-4b26-af4c-f6ae2827b0f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.162786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37514333-2db2-4b26-af4c-f6ae2827b0f1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.241098 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3377/6723] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:53 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:53.242264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37514333-2db2-4b26-af4c-f6ae2827b0f1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:53.267106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de01c5cbe244926b848a9c5d78f081d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:53.281775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de01c5cbe244926b848a9c5d78f081d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:53.313938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de01c5cbe244926b848a9c5d78f081d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:53.328681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de01c5cbe244926b848a9c5d78f081d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:53.330427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de01c5cbe244926b848a9c5d78f081d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:53.351987 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3347/6724] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:53 2022] DELETE /identity/v3/users/6de01c5cbe244926b848a9c5d78f081d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:53.353376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:53.356079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:53.363973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37514333-2db2-4b26-af4c-f6ae2827b0f1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.439905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6495045d-7fb1-4b76-b523-2d9c3f4c3a2d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.445082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb148-ed02-403f-b5a0-7bf6099ecb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.446215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb148-ed02-403f-b5a0-7bf6099ecb7d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.446593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb148-ed02-403f-b5a0-7bf6099ecb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.446956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fb148-ed02-403f-b5a0-7bf6099ecb7d admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.447692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fb148-ed02-403f-b5a0-7bf6099ecb7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.449727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fb148-ed02-403f-b5a0-7bf6099ecb7d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.460416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac78cf-ae83-4606-9fc4-9f4bcc1dea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.461042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac78cf-ae83-4606-9fc4-9f4bcc1dea0c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.461318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac78cf-ae83-4606-9fc4-9f4bcc1dea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.461584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac78cf-ae83-4606-9fc4-9f4bcc1dea0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.462270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac78cf-ae83-4606-9fc4-9f4bcc1dea0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.464078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac78cf-ae83-4606-9fc4-9f4bcc1dea0c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.482063 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3378/6725] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:53.483473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d8b6c-4be7-4a66-9386-8b9a663b80a9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.483754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d8b6c-4be7-4a66-9386-8b9a663b80a9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.484022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d8b6c-4be7-4a66-9386-8b9a663b80a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.484277 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3348/6726] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:53 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:53.485193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb148-ed02-403f-b5a0-7bf6099ecb7d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:53.488302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-861fb148-ed02-403f-b5a0-7bf6099ecb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:53.509337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7b8d8b6c-4be7-4a66-9386-8b9a663b80a9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:53.510680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7b8d8b6c-4be7-4a66-9386-8b9a663b80a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:53.516335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fb148-ed02-403f-b5a0-7bf6099ecb7d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.525167 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3379/6727] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:53.526864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d8b6c-4be7-4a66-9386-8b9a663b80a9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:53.538834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1723d1-db88-4af0-89ea-12409fb8e8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.539827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1723d1-db88-4af0-89ea-12409fb8e8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.540188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1723d1-db88-4af0-89ea-12409fb8e8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.540606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1723d1-db88-4af0-89ea-12409fb8e8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.541628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1723d1-db88-4af0-89ea-12409fb8e8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.542975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d8b6c-4be7-4a66-9386-8b9a663b80a9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.543631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1723d1-db88-4af0-89ea-12409fb8e8d2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.548772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910013a-5450-4f80-81aa-364a2776a64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.550451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910013a-5450-4f80-81aa-364a2776a64f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.550944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910013a-5450-4f80-81aa-364a2776a64f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.551418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910013a-5450-4f80-81aa-364a2776a64f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.552261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910013a-5450-4f80-81aa-364a2776a64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.554309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910013a-5450-4f80-81aa-364a2776a64f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.560247 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3349/6728] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:53.560247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1723d1-db88-4af0-89ea-12409fb8e8d2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:53.564938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3a1723d1-db88-4af0-89ea-12409fb8e8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:53.577469 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3380/6729] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:53.578651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910013a-5450-4f80-81aa-364a2776a64f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:53.600751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910013a-5450-4f80-81aa-364a2776a64f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.608225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140793b-3e6e-44c4-8992-14efa2e11c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.609190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140793b-3e6e-44c4-8992-14efa2e11c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.609734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140793b-3e6e-44c4-8992-14efa2e11c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.610318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140793b-3e6e-44c4-8992-14efa2e11c01 admin admin] PATH_INFO: `/v3/projects/2e39f4e5175841a5a469e9cc04ffa7a1/users/3b46662f2a2e4635a91378385cb8e6ad/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.630704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140793b-3e6e-44c4-8992-14efa2e11c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e39f4e5175841a5a469e9cc04ffa7a1, user_id=3b46662f2a2e4635a91378385cb8e6ad, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.632804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:53.653964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140793b-3e6e-44c4-8992-14efa2e11c01 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.660228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1723d1-db88-4af0-89ea-12409fb8e8d2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.667968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fc112-5249-4108-bdd7-5b819675e4ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.668717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fc112-5249-4108-bdd7-5b819675e4ff service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.669032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fc112-5249-4108-bdd7-5b819675e4ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.669799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3fc112-5249-4108-bdd7-5b819675e4ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.683974 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3381/6730] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:53 2022] PUT /identity/v3/projects/2e39f4e5175841a5a469e9cc04ffa7a1/users/3b46662f2a2e4635a91378385cb8e6ad/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:53.693986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fc112-5249-4108-bdd7-5b819675e4ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.694556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140793b-3e6e-44c4-8992-14efa2e11c01 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:53.694670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3fc112-5249-4108-bdd7-5b819675e4ff service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.700269 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3350/6731] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:53.700981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fc112-5249-4108-bdd7-5b819675e4ff service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:53.702665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fd3fc112-5249-4108-bdd7-5b819675e4ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:53.719824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3fc112-5249-4108-bdd7-5b819675e4ff service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.790114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:53.815809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.816799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.817223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.817861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] PATH_INFO: `/v3/projects/83cec2f469124827b958d7029f731245` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.820891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83cec2f469124827b958d7029f731245)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.823669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.850465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140793b-3e6e-44c4-8992-14efa2e11c01 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:53.869011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903d0d4-178c-47ec-9591-4c1cee656cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:53.869732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903d0d4-178c-47ec-9591-4c1cee656cee admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.870047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903d0d4-178c-47ec-9591-4c1cee656cee admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.870331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903d0d4-178c-47ec-9591-4c1cee656cee admin admin] PATH_INFO: `/v3/projects/a45f1c6197c345968c4255e093622c24/users/9941ecdd4f98492abc14795c028be436/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.896830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903d0d4-178c-47ec-9591-4c1cee656cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45f1c6197c345968c4255e093622c24, user_id=9941ecdd4f98492abc14795c028be436, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:53.899853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903d0d4-178c-47ec-9591-4c1cee656cee admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:53.918175 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3382/6732] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:53 2022] PUT /identity/v3/projects/a45f1c6197c345968c4255e093622c24/users/9941ecdd4f98492abc14795c028be436/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:53.922839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5f31-3776-4cc7-8dd1-c51974565bd9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:53.923222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5f31-3776-4cc7-8dd1-c51974565bd9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:53.923500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b5f31-3776-4cc7-8dd1-c51974565bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:53.943547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83cec2f469124827b958d7029f731245', 'request_id': 'req-12fc07bc-45e5-4c7b-956b-3e75b660abe5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:53.957413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ca3b5f31-3776-4cc7-8dd1-c51974565bd9 None None] MFA Rules not processed for user `3b46662f2a2e4635a91378385cb8e6ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:53.958703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ca3b5f31-3776-4cc7-8dd1-c51974565bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:53.967579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83cec2f469124827b958d7029f731245', 'request_id': 'req-12fc07bc-45e5-4c7b-956b-3e75b660abe5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:53.979254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83cec2f469124827b958d7029f731245', 'request_id': 'req-12fc07bc-45e5-4c7b-956b-3e75b660abe5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:54.001831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] The token cache is being invalidate because project 83cec2f469124827b958d7029f731245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:54.002544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:54.003561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:54.009064 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3351/6733] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:53 2022] DELETE /identity/v3/projects/83cec2f469124827b958d7029f731245 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:54.010365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:54.012858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:54.057205 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3383/6734] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:54.059216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bf4e-d495-4273-b2c2-2500864eab13 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:54.060252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bf4e-d495-4273-b2c2-2500864eab13 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:54.060632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bf4e-d495-4273-b2c2-2500864eab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:54.092030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1d25bf4e-d495-4273-b2c2-2500864eab13 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:54.093523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1d25bf4e-d495-4273-b2c2-2500864eab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:54.097804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc07bc-45e5-4c7b-956b-3e75b660abe5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:54.103387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24dffc-f138-43f4-8acd-8e5a0c5339d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:54.104008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24dffc-f138-43f4-8acd-8e5a0c5339d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:54.104280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24dffc-f138-43f4-8acd-8e5a0c5339d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:54.104553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24dffc-f138-43f4-8acd-8e5a0c5339d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:54.105196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24dffc-f138-43f4-8acd-8e5a0c5339d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:54.106574 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3384/6735] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:54.107971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25bf4e-d495-4273-b2c2-2500864eab13 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:54.120021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24dffc-f138-43f4-8acd-8e5a0c5339d2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:54.120253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1d25bf4e-d495-4273-b2c2-2500864eab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:54.148466 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3352/6736] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:54.152621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24dffc-f138-43f4-8acd-8e5a0c5339d2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:54.171694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24dffc-f138-43f4-8acd-8e5a0c5339d2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:54.200116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f4cbf-d1b5-4689-a374-1f53169095cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:54.201324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f4cbf-d1b5-4689-a374-1f53169095cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:54.202922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f4cbf-d1b5-4689-a374-1f53169095cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:54.203425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f4cbf-d1b5-4689-a374-1f53169095cb admin admin] PATH_INFO: `/v3/projects/a45f1c6197c345968c4255e093622c24/users/9941ecdd4f98492abc14795c028be436/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:54.216075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f4cbf-d1b5-4689-a374-1f53169095cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45f1c6197c345968c4255e093622c24, user_id=9941ecdd4f98492abc14795c028be436, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:54.219471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f4cbf-d1b5-4689-a374-1f53169095cb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:54.224997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:54.245446 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3353/6737] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:54 2022] PUT /identity/v3/projects/a45f1c6197c345968c4255e093622c24/users/9941ecdd4f98492abc14795c028be436/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:54.247791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb293d-0999-45f0-9821-f8a461420295 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:54.248284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb293d-0999-45f0-9821-f8a461420295 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:54.248776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb293d-0999-45f0-9821-f8a461420295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:54.288191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25bf4e-d495-4273-b2c2-2500864eab13 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:54.298899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fafb293d-0999-45f0-9821-f8a461420295 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:54.300356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fafb293d-0999-45f0-9821-f8a461420295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:54.376764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec0fcb-fea8-42d1-8183-0cf05a696621 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:54.377516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec0fcb-fea8-42d1-8183-0cf05a696621 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:54.377820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec0fcb-fea8-42d1-8183-0cf05a696621 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:54.378121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec0fcb-fea8-42d1-8183-0cf05a696621 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:54.380334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ffec0fcb-fea8-42d1-8183-0cf05a696621 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:54.396395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:54.448567 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3354/6738] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:54.448567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021df6a-0524-4e5f-8abe-c6159ed504b1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:54.448567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021df6a-0524-4e5f-8abe-c6159ed504b1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:54.448567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021df6a-0524-4e5f-8abe-c6159ed504b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:54.490759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec0fcb-fea8-42d1-8183-0cf05a696621 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:54.493972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec0fcb-fea8-42d1-8183-0cf05a696621 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:54.507347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b021df6a-0524-4e5f-8abe-c6159ed504b1 None None] MFA Rules not processed for user `9941ecdd4f98492abc14795c028be436`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:54.509109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b021df6a-0524-4e5f-8abe-c6159ed504b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:54.523485 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3385/6739] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:54.525486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec0fcb-fea8-42d1-8183-0cf05a696621 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:54.539468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec0fcb-fea8-42d1-8183-0cf05a696621 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:54.546663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8fc78-6cb1-4128-85e1-263f2ac93cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:54.548363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8fc78-6cb1-4128-85e1-263f2ac93cca admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:54.548857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8fc78-6cb1-4128-85e1-263f2ac93cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:54.550311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8fc78-6cb1-4128-85e1-263f2ac93cca admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:54.551649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8fc78-6cb1-4128-85e1-263f2ac93cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:54.552327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8fc78-6cb1-4128-85e1-263f2ac93cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:54.554895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8fc78-6cb1-4128-85e1-263f2ac93cca admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:54.575838 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3386/6740] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:54.583491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8fc78-6cb1-4128-85e1-263f2ac93cca admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:54.611610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8fc78-6cb1-4128-85e1-263f2ac93cca admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:54.629751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d4368-86cc-4b12-8bec-85ab73c51d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:54.630355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d4368-86cc-4b12-8bec-85ab73c51d20 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:54.630615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d4368-86cc-4b12-8bec-85ab73c51d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:54.630885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d4368-86cc-4b12-8bec-85ab73c51d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:54.632096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d4368-86cc-4b12-8bec-85ab73c51d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:54.633688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d4368-86cc-4b12-8bec-85ab73c51d20 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:54.676235 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3355/6741] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:54.690344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021df6a-0524-4e5f-8abe-c6159ed504b1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:54.691932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b021df6a-0524-4e5f-8abe-c6159ed504b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:54.730123 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3387/6742] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:54 2022] POST /identity/v3/projects => generated 359 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:45:54.738652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d4368-86cc-4b12-8bec-85ab73c51d20 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:54.854180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021df6a-0524-4e5f-8abe-c6159ed504b1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:54.950791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d4368-86cc-4b12-8bec-85ab73c51d20 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:54.957999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:54.966420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ad9f-fe80-47fb-8125-0e1646a62d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:54.968679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ad9f-fe80-47fb-8125-0e1646a62d92 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:54.969060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ad9f-fe80-47fb-8125-0e1646a62d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:54.970452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3ad9f-fe80-47fb-8125-0e1646a62d92 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:54.972377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3ad9f-fe80-47fb-8125-0e1646a62d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:54.978849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3ad9f-fe80-47fb-8125-0e1646a62d92 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:55.006228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae808a-96e7-4865-a100-ab1c26e240f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:55.009257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae808a-96e7-4865-a100-ab1c26e240f5 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:55.009648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae808a-96e7-4865-a100-ab1c26e240f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:55.011224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae808a-96e7-4865-a100-ab1c26e240f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:55.015615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-edae808a-96e7-4865-a100-ab1c26e240f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:55.050949 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3388/6743] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:54 2022] POST /identity/v3/users => generated 280 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:45:55.051874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ad9f-fe80-47fb-8125-0e1646a62d92 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:55.079203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3ad9f-fe80-47fb-8125-0e1646a62d92 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:55.095280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53e53f-a748-4a73-a5b9-b4b8fdea4b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:55.108967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e53f-a748-4a73-a5b9-b4b8fdea4b25 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:55.109249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e53f-a748-4a73-a5b9-b4b8fdea4b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:55.109590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e53f-a748-4a73-a5b9-b4b8fdea4b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:55.112838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53e53f-a748-4a73-a5b9-b4b8fdea4b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:55.127318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53e53f-a748-4a73-a5b9-b4b8fdea4b25 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:55.146657 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3389/6744] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:55.149118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53e53f-a748-4a73-a5b9-b4b8fdea4b25 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:55.174160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53e53f-a748-4a73-a5b9-b4b8fdea4b25 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:55.191070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498b921-af0e-4b4b-8b93-cb96080ad135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:55.191972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498b921-af0e-4b4b-8b93-cb96080ad135 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:55.192327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498b921-af0e-4b4b-8b93-cb96080ad135 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:55.192721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498b921-af0e-4b4b-8b93-cb96080ad135 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:55.193609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498b921-af0e-4b4b-8b93-cb96080ad135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:55.195348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498b921-af0e-4b4b-8b93-cb96080ad135 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:55.222719 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3390/6745] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:45:55.227606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae808a-96e7-4865-a100-ab1c26e240f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:55.227922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498b921-af0e-4b4b-8b93-cb96080ad135 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:55.229227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae808a-96e7-4865-a100-ab1c26e240f5 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:55.246943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498b921-af0e-4b4b-8b93-cb96080ad135 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:55.250045 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3356/6746] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:55.265917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aa2e2-404a-4f01-affc-433eba4f53d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:55.266724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aa2e2-404a-4f01-affc-433eba4f53d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:55.266890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aa2e2-404a-4f01-affc-433eba4f53d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:55.267163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aa2e2-404a-4f01-affc-433eba4f53d0 admin admin] PATH_INFO: `/v3/projects/d471220b3ee1409bbf780969a7c7255c/users/b96c4a7fc929403181016707ba1ee0fe/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:55.321338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323aa2e2-404a-4f01-affc-433eba4f53d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d471220b3ee1409bbf780969a7c7255c, user_id=b96c4a7fc929403181016707ba1ee0fe, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:55.324062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323aa2e2-404a-4f01-affc-433eba4f53d0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:55.420593 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3391/6747] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:45:55 2022] PUT /identity/v3/projects/d471220b3ee1409bbf780969a7c7255c/users/b96c4a7fc929403181016707ba1ee0fe/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:45:55.423336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100ee94-6c9e-4a77-ba06-5c31378a10dd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:55.423769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100ee94-6c9e-4a77-ba06-5c31378a10dd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:55.424206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100ee94-6c9e-4a77-ba06-5c31378a10dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:55.483244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5100ee94-6c9e-4a77-ba06-5c31378a10dd None None] MFA Rules not processed for user `b96c4a7fc929403181016707ba1ee0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:55.484491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5100ee94-6c9e-4a77-ba06-5c31378a10dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:55.710018 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3357/6748] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:55.745483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aa2e2-404a-4f01-affc-433eba4f53d0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:55.748735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-323aa2e2-404a-4f01-affc-433eba4f53d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:55.761312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100ee94-6c9e-4a77-ba06-5c31378a10dd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:55.763032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5100ee94-6c9e-4a77-ba06-5c31378a10dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:55.785234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:55.965095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aa2e2-404a-4f01-affc-433eba4f53d0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:55.968659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100ee94-6c9e-4a77-ba06-5c31378a10dd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:55.976859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:55.979006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:55.979371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b4461-b6d5-4576-88b2-24d85529c4bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:55.980238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b4461-b6d5-4576-88b2-24d85529c4bb service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:55.980607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b4461-b6d5-4576-88b2-24d85529c4bb service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:55.980857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:55.981073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b4461-b6d5-4576-88b2-24d85529c4bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:55.981451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] PATH_INFO: `/v3/projects/fac15d7cb7c04de19cfd156d380631b4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:55.985750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac15d7cb7c04de19cfd156d380631b4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:55.989340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:56.007091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b4461-b6d5-4576-88b2-24d85529c4bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:56.014867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b4461-b6d5-4576-88b2-24d85529c4bb service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:56.045375 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3358/6749] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:45:56.050110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b4461-b6d5-4576-88b2-24d85529c4bb service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:56.052207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dc2b4461-b6d5-4576-88b2-24d85529c4bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:56.083734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b4461-b6d5-4576-88b2-24d85529c4bb service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:56.116797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac15d7cb7c04de19cfd156d380631b4', 'request_id': 'req-0be1e901-3628-4eff-b555-13f8a9421831'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.128833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac15d7cb7c04de19cfd156d380631b4', 'request_id': 'req-0be1e901-3628-4eff-b555-13f8a9421831'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.132281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:56.144608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac15d7cb7c04de19cfd156d380631b4', 'request_id': 'req-0be1e901-3628-4eff-b555-13f8a9421831'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.168407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] The token cache is being invalidate because project fac15d7cb7c04de19cfd156d380631b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:56.168693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.170782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.183157 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3392/6750] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:55 2022] DELETE /identity/v3/projects/fac15d7cb7c04de19cfd156d380631b4 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:56.183157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:56.183609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:56.239662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:56.242284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:56.242559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:56.242830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] PATH_INFO: `/v3/users/f6676901cb4d49bf9b16e1f4f8036a92` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:56.245314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6676901cb4d49bf9b16e1f4f8036a92)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:56.251855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:56.358122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1e901-3628-4eff-b555-13f8a9421831 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:56.358122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:56.358122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:56.358122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:56.358493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] PATH_INFO: `/v3/users/b96c4a7fc929403181016707ba1ee0fe` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:56.360278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96c4a7fc929403181016707ba1ee0fe)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:56.362662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:56.405588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6676901cb4d49bf9b16e1f4f8036a92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.424481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6676901cb4d49bf9b16e1f4f8036a92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.448881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6676901cb4d49bf9b16e1f4f8036a92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.475641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:56.478007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6676901cb4d49bf9b16e1f4f8036a92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.479875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6676901cb4d49bf9b16e1f4f8036a92'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.479995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96c4a7fc929403181016707ba1ee0fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.480996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96c4a7fc929403181016707ba1ee0fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.493641 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3359/6751] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:56 2022] DELETE /identity/v3/users/f6676901cb4d49bf9b16e1f4f8036a92 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:56.494674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96c4a7fc929403181016707ba1ee0fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.495163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:56.497094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:56.519459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96c4a7fc929403181016707ba1ee0fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.546934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96c4a7fc929403181016707ba1ee0fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.583015 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3393/6752] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:56 2022] DELETE /identity/v3/users/b96c4a7fc929403181016707ba1ee0fe => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:56.584149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:56.588411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:56.635687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f941fe-6f98-4035-8dbf-f6c62e65b056 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:56.744598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:56.764543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:56.765315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:56.765860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:56.766295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] PATH_INFO: `/v3/users/c448a8861d0646fe836f0e99c23b4345` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:56.769226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c448a8861d0646fe836f0e99c23b4345)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:56.769402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843bdc2-0e04-4230-92bd-79726e6f8d4b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:56.772950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:56.784503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:56.785304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:56.785670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:56.786042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] PATH_INFO: `/v3/users/a5020e8e2a5845b383d7dd27623454c1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:56.788008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5020e8e2a5845b383d7dd27623454c1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:56.794250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:56.880090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c448a8861d0646fe836f0e99c23b4345'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.897255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c448a8861d0646fe836f0e99c23b4345'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.937731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c448a8861d0646fe836f0e99c23b4345'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.955956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c448a8861d0646fe836f0e99c23b4345'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.957042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c918bdc6-64f2-4258-8810-216ef72ba874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c448a8861d0646fe836f0e99c23b4345'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.964292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5020e8e2a5845b383d7dd27623454c1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.965325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5020e8e2a5845b383d7dd27623454c1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.973120 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3360/6753] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:56 2022] DELETE /identity/v3/users/c448a8861d0646fe836f0e99c23b4345 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:56.990695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64cf8-a75b-4a4d-bdf2-288966c212d9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:56.990917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5020e8e2a5845b383d7dd27623454c1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:56.991010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64cf8-a75b-4a4d-bdf2-288966c212d9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:56.991238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64cf8-a75b-4a4d-bdf2-288966c212d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:57.017396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5020e8e2a5845b383d7dd27623454c1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:57.051686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-27d64cf8-a75b-4a4d-bdf2-288966c212d9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:57.061190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-27d64cf8-a75b-4a4d-bdf2-288966c212d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:57.061600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0602c5d-909c-44bc-905c-7decff98feda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5020e8e2a5845b383d7dd27623454c1'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:57.089378 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3394/6754] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:45:56 2022] DELETE /identity/v3/users/a5020e8e2a5845b383d7dd27623454c1 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:57.090951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa1a92-6579-42b3-98a6-3debfa78b452 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:57.091237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa1a92-6579-42b3-98a6-3debfa78b452 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:57.091531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa1a92-6579-42b3-98a6-3debfa78b452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:57.159534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f1aa1a92-6579-42b3-98a6-3debfa78b452 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:57.167386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f1aa1a92-6579-42b3-98a6-3debfa78b452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:57.234954 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3361/6755] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:57.234954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc07e7f-937e-4711-b405-178dc3bee840 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:57.234954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc07e7f-937e-4711-b405-178dc3bee840 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:57.234954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc07e7f-937e-4711-b405-178dc3bee840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:57.281902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ebc07e7f-937e-4711-b405-178dc3bee840 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:57.283161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ebc07e7f-937e-4711-b405-178dc3bee840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:57.286139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:57.385335 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3395/6756] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:57.385335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa1a92-6579-42b3-98a6-3debfa78b452 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:57.387879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f1aa1a92-6579-42b3-98a6-3debfa78b452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:57.509549 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3362/6757] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:57.510556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc07e7f-937e-4711-b405-178dc3bee840 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:57.520329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ebc07e7f-937e-4711-b405-178dc3bee840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:57.537203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:57.552350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa1a92-6579-42b3-98a6-3debfa78b452 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:57.567115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8008b-e8e7-4890-ab55-3e04a7c1503b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:57.567969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8008b-e8e7-4890-ab55-3e04a7c1503b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:57.568362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8008b-e8e7-4890-ab55-3e04a7c1503b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:57.568736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8008b-e8e7-4890-ab55-3e04a7c1503b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:57.583534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8008b-e8e7-4890-ab55-3e04a7c1503b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:57.585544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8008b-e8e7-4890-ab55-3e04a7c1503b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:57.629445 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3396/6758] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:57.646191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8008b-e8e7-4890-ab55-3e04a7c1503b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:57.662059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8008b-e8e7-4890-ab55-3e04a7c1503b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:57.666906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc07e7f-937e-4711-b405-178dc3bee840 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:57.672708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798493-fc4c-434c-9499-ddb79d5344a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:57.674511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798493-fc4c-434c-9499-ddb79d5344a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:57.675470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798493-fc4c-434c-9499-ddb79d5344a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:57.675812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61798493-fc4c-434c-9499-ddb79d5344a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:57.676288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8630-1bf1-406b-bfcc-2f0f879aafe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:57.677338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8630-1bf1-406b-bfcc-2f0f879aafe4 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:57.682086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8630-1bf1-406b-bfcc-2f0f879aafe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:57.682466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8630-1bf1-406b-bfcc-2f0f879aafe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:57.722877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b8630-1bf1-406b-bfcc-2f0f879aafe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:57.723219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61798493-fc4c-434c-9499-ddb79d5344a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:57.724854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61798493-fc4c-434c-9499-ddb79d5344a1 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:57.730335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b8630-1bf1-406b-bfcc-2f0f879aafe4 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:57.738532 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3363/6759] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:57.761449 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3397/6760] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:45:59.234148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798493-fc4c-434c-9499-ddb79d5344a1 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:59.236287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-61798493-fc4c-434c-9499-ddb79d5344a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:59.260378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61798493-fc4c-434c-9499-ddb79d5344a1 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:59.273793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:59.274492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:59.274769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:59.275039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] PATH_INFO: `/v3/projects/d471220b3ee1409bbf780969a7c7255c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:59.276255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d471220b3ee1409bbf780969a7c7255c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:59.278255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:59.391363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd471220b3ee1409bbf780969a7c7255c', 'request_id': 'req-b1215a06-e69a-44bd-a025-c3d51f1a7171'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:59.409107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd471220b3ee1409bbf780969a7c7255c', 'request_id': 'req-b1215a06-e69a-44bd-a025-c3d51f1a7171'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:59.417408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd471220b3ee1409bbf780969a7c7255c', 'request_id': 'req-b1215a06-e69a-44bd-a025-c3d51f1a7171'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:59.443553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] The token cache is being invalidate because project d471220b3ee1409bbf780969a7c7255c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:45:59.443853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:59.445921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b1215a06-e69a-44bd-a025-c3d51f1a7171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:45:59.451928 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3364/6761] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:45:59 2022] DELETE /identity/v3/projects/d471220b3ee1409bbf780969a7c7255c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:45:59.456933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a513b6-d4d6-4ed4-bd19-367d6a141f96 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:59.457447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a513b6-d4d6-4ed4-bd19-367d6a141f96 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:59.457636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a513b6-d4d6-4ed4-bd19-367d6a141f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:59.511507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d0a513b6-d4d6-4ed4-bd19-367d6a141f96 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:59.515106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d0a513b6-d4d6-4ed4-bd19-367d6a141f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:59.629817 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3398/6762] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:59.637748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2e7e-728e-4e62-aa3b-872d6c177ec7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:59.638186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2e7e-728e-4e62-aa3b-872d6c177ec7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:59.638476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be2e7e-728e-4e62-aa3b-872d6c177ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:59.671294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a2be2e7e-728e-4e62-aa3b-872d6c177ec7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:45:59.672730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a2be2e7e-728e-4e62-aa3b-872d6c177ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:59.685488 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3365/6763] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:45:59.687456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a513b6-d4d6-4ed4-bd19-367d6a141f96 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:59.699100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a513b6-d4d6-4ed4-bd19-367d6a141f96 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:59.711186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564317dc-b84d-4ff6-8540-eda6fd7d6718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:59.712340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564317dc-b84d-4ff6-8540-eda6fd7d6718 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:59.712621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564317dc-b84d-4ff6-8540-eda6fd7d6718 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:59.712895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564317dc-b84d-4ff6-8540-eda6fd7d6718 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:59.713750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564317dc-b84d-4ff6-8540-eda6fd7d6718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:45:59.714081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564317dc-b84d-4ff6-8540-eda6fd7d6718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:59.723671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564317dc-b84d-4ff6-8540-eda6fd7d6718 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:59.744976 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3399/6764] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:45:59.749697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2e7e-728e-4e62-aa3b-872d6c177ec7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:59.764443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be2e7e-728e-4e62-aa3b-872d6c177ec7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:59.783135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4eda-ca08-493b-a0d3-4aa771338a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:45:59.784828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4eda-ca08-493b-a0d3-4aa771338a46 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:45:59.785110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4eda-ca08-493b-a0d3-4aa771338a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:45:59.785418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4eda-ca08-493b-a0d3-4aa771338a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:45:59.787487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4eda-ca08-493b-a0d3-4aa771338a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:45:59.789440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4eda-ca08-493b-a0d3-4aa771338a46 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:45:59.804324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564317dc-b84d-4ff6-8540-eda6fd7d6718 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:59.806294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-564317dc-b84d-4ff6-8540-eda6fd7d6718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:45:59.854225 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3366/6765] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:45:59 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:45:59.854225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4eda-ca08-493b-a0d3-4aa771338a46 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:45:59.935818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564317dc-b84d-4ff6-8540-eda6fd7d6718 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:45:59.954720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:00.016506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4eda-ca08-493b-a0d3-4aa771338a46 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:00.022860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b750865-3f18-4125-aabe-f872e1064085 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:00.023616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750865-3f18-4125-aabe-f872e1064085 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.024003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750865-3f18-4125-aabe-f872e1064085 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.024463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750865-3f18-4125-aabe-f872e1064085 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:00.024999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819278a-1623-4352-b5df-09a67f13e132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:00.026282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819278a-1623-4352-b5df-09a67f13e132 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.026833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819278a-1623-4352-b5df-09a67f13e132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.027354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3b750865-3f18-4125-aabe-f872e1064085 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:00.027484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819278a-1623-4352-b5df-09a67f13e132 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:00.028862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819278a-1623-4352-b5df-09a67f13e132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:00.031401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819278a-1623-4352-b5df-09a67f13e132 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:00.045749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:00.074304 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3367/6766] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:45:59 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:00.076697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819278a-1623-4352-b5df-09a67f13e132 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:00.080019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9819278a-1623-4352-b5df-09a67f13e132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:00.100628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819278a-1623-4352-b5df-09a67f13e132 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:00.108879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:00.109787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.110241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.110639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] PATH_INFO: `/v3/projects/cfe0d468c9a74d958c54d774c7b8b133` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:00.112987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe0d468c9a74d958c54d774c7b8b133)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:00.116436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:00.118750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b750865-3f18-4125-aabe-f872e1064085 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:00.120203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b750865-3f18-4125-aabe-f872e1064085 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:00.144591 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3400/6767] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:45:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:00.161052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b750865-3f18-4125-aabe-f872e1064085 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:00.198793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b750865-3f18-4125-aabe-f872e1064085 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:00.227349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe0d468c9a74d958c54d774c7b8b133', 'request_id': 'req-1a312deb-0087-4eb7-a21c-43c5aa71900b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.259565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe0d468c9a74d958c54d774c7b8b133', 'request_id': 'req-1a312deb-0087-4eb7-a21c-43c5aa71900b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.294654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe0d468c9a74d958c54d774c7b8b133', 'request_id': 'req-1a312deb-0087-4eb7-a21c-43c5aa71900b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.349393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459a934-c6ac-48c7-8112-73bfbdf569d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:00.350140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459a934-c6ac-48c7-8112-73bfbdf569d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.350412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459a934-c6ac-48c7-8112-73bfbdf569d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.350601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] The token cache is being invalidate because project cfe0d468c9a74d958c54d774c7b8b133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:00.350720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459a934-c6ac-48c7-8112-73bfbdf569d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:00.350879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.351311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459a934-c6ac-48c7-8112-73bfbdf569d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:00.351527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.359902 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3368/6768] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:00 2022] DELETE /identity/v3/projects/cfe0d468c9a74d958c54d774c7b8b133 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:00.359902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:00.360170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459a934-c6ac-48c7-8112-73bfbdf569d3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:00.360288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:00.391481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a312deb-0087-4eb7-a21c-43c5aa71900b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:00.403258 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3401/6769] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:00.403721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:00.405257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8b22-5ab4-427e-beb1-62fd2414ac81 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.405697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8b22-5ab4-427e-beb1-62fd2414ac81 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.406172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8b22-5ab4-427e-beb1-62fd2414ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:00.408058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.408058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.408058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] PATH_INFO: `/v3/projects/0abbcfbdbfe742cebe8baa6ff2ab4ed3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:00.410178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abbcfbdbfe742cebe8baa6ff2ab4ed3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:00.412177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:00.460296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1eeb8b22-5ab4-427e-beb1-62fd2414ac81 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:00.463652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1eeb8b22-5ab4-427e-beb1-62fd2414ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:00.479799 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3402/6770] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:00.482086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8b22-5ab4-427e-beb1-62fd2414ac81 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:00.485053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1eeb8b22-5ab4-427e-beb1-62fd2414ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:00.519933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abbcfbdbfe742cebe8baa6ff2ab4ed3', 'request_id': 'req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.529946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb8b22-5ab4-427e-beb1-62fd2414ac81 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:00.537754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abbcfbdbfe742cebe8baa6ff2ab4ed3', 'request_id': 'req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.548970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abbcfbdbfe742cebe8baa6ff2ab4ed3', 'request_id': 'req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.561316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] The token cache is being invalidate because project 0abbcfbdbfe742cebe8baa6ff2ab4ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:00.561898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.562721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d14fb8b-c2d2-4d41-aa1f-b7c137573483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.564390 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3369/6771] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:00 2022] DELETE /identity/v3/projects/0abbcfbdbfe742cebe8baa6ff2ab4ed3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:00.569462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f287-aa56-457c-88b5-265621755195 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.570090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f287-aa56-457c-88b5-265621755195 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.570508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9f287-aa56-457c-88b5-265621755195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:00.609998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-24d9f287-aa56-457c-88b5-265621755195 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:00.611876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24d9f287-aa56-457c-88b5-265621755195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:00.612419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3a038-0c7e-46f6-bb3b-5c7a2e6a7356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:00.613188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a038-0c7e-46f6-bb3b-5c7a2e6a7356 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.613587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a038-0c7e-46f6-bb3b-5c7a2e6a7356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.614120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3a038-0c7e-46f6-bb3b-5c7a2e6a7356 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:00.615387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3a038-0c7e-46f6-bb3b-5c7a2e6a7356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:00.617281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3a038-0c7e-46f6-bb3b-5c7a2e6a7356 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:00.619310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:00.631464 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3403/6772] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:00.632457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3a038-0c7e-46f6-bb3b-5c7a2e6a7356 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:00.640907 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3370/6773] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:00.642126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9f287-aa56-457c-88b5-265621755195 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:00.643068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ece3a038-0c7e-46f6-bb3b-5c7a2e6a7356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:00.646801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24d9f287-aa56-457c-88b5-265621755195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:00.665577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3a038-0c7e-46f6-bb3b-5c7a2e6a7356 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:00.674692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:00.675532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.675892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.676257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] PATH_INFO: `/v3/users/3b46662f2a2e4635a91378385cb8e6ad` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:00.677367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9f287-aa56-457c-88b5-265621755195 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:00.689114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b46662f2a2e4635a91378385cb8e6ad)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:00.691888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:00.696805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2893631-a909-426e-9763-c73f824f1756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:00.697503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893631-a909-426e-9763-c73f824f1756 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.697836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893631-a909-426e-9763-c73f824f1756 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.698137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2893631-a909-426e-9763-c73f824f1756 admin admin] PATH_INFO: `/v3/projects/aa7a84367266489f88e0680b9c5097f4/users/49ed224480ca486dbca9c895b9d464eb/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:00.749742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2893631-a909-426e-9763-c73f824f1756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa7a84367266489f88e0680b9c5097f4, user_id=49ed224480ca486dbca9c895b9d464eb, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:00.751957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2893631-a909-426e-9763-c73f824f1756 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:00.813576 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3371/6774] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:00 2022] PUT /identity/v3/projects/aa7a84367266489f88e0680b9c5097f4/users/49ed224480ca486dbca9c895b9d464eb/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:00.814894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2893631-a909-426e-9763-c73f824f1756 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:00.823845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b46662f2a2e4635a91378385cb8e6ad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.824541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b46662f2a2e4635a91378385cb8e6ad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.836721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b46662f2a2e4635a91378385cb8e6ad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.884177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b46662f2a2e4635a91378385cb8e6ad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.919394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:00.935668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6acdaed1-62ae-4063-8379-a1048a8a7908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b46662f2a2e4635a91378385cb8e6ad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:00.959929 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3404/6775] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:00 2022] DELETE /identity/v3/users/3b46662f2a2e4635a91378385cb8e6ad => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:00.961979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4b6f3-1a91-4012-ad6b-fa85a757a051 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:00.962872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4b6f3-1a91-4012-ad6b-fa85a757a051 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:00.963338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4b6f3-1a91-4012-ad6b-fa85a757a051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:01.008473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2893631-a909-426e-9763-c73f824f1756 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:01.040958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-73e4b6f3-1a91-4012-ad6b-fa85a757a051 None None] MFA Rules not processed for user `49ed224480ca486dbca9c895b9d464eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:01.043002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-73e4b6f3-1a91-4012-ad6b-fa85a757a051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:01.156282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b89f9a-42a1-4ef0-8b6b-ac48c1603f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:01.156914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b89f9a-42a1-4ef0-8b6b-ac48c1603f35 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:01.157191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b89f9a-42a1-4ef0-8b6b-ac48c1603f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:01.157461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b89f9a-42a1-4ef0-8b6b-ac48c1603f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:01.161796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b89f9a-42a1-4ef0-8b6b-ac48c1603f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:01.162276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b89f9a-42a1-4ef0-8b6b-ac48c1603f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:01.164161 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3405/6776] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:01.165402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4b6f3-1a91-4012-ad6b-fa85a757a051 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:01.167031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-73e4b6f3-1a91-4012-ad6b-fa85a757a051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:01.171422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b89f9a-42a1-4ef0-8b6b-ac48c1603f35 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:01.186385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4b6f3-1a91-4012-ad6b-fa85a757a051 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:01.192668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:01.193661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:01.194176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:01.194669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] PATH_INFO: `/v3/projects/72f922b05790479f889a190ac9e4caa6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:01.196288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f922b05790479f889a190ac9e4caa6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:01.198984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:01.204530 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3372/6777] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:01.204530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b89f9a-42a1-4ef0-8b6b-ac48c1603f35 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:01.224749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c2b89f9a-42a1-4ef0-8b6b-ac48c1603f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:01.242920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b89f9a-42a1-4ef0-8b6b-ac48c1603f35 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:01.264944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f922b05790479f889a190ac9e4caa6', 'request_id': 'req-c6021065-e236-4021-b915-3b90b8cb7e6f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:01.268118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:01.278498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f922b05790479f889a190ac9e4caa6', 'request_id': 'req-c6021065-e236-4021-b915-3b90b8cb7e6f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:01.295998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f922b05790479f889a190ac9e4caa6', 'request_id': 'req-c6021065-e236-4021-b915-3b90b8cb7e6f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:01.329738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] The token cache is being invalidate because project 72f922b05790479f889a190ac9e4caa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:01.333290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:01.334304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:01.339555 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3406/6778] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:01 2022] DELETE /identity/v3/projects/72f922b05790479f889a190ac9e4caa6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:01.340507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:01.343050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:01.370440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e3784-f792-492c-85c8-996f6f7c62d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:01.371734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e3784-f792-492c-85c8-996f6f7c62d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:01.373137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e3784-f792-492c-85c8-996f6f7c62d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:01.373581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e3784-f792-492c-85c8-996f6f7c62d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:01.374485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e3784-f792-492c-85c8-996f6f7c62d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:01.377140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e3784-f792-492c-85c8-996f6f7c62d9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:01.424123 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3373/6779] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:01 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:01.425358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e3784-f792-492c-85c8-996f6f7c62d9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:01.428240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3b4e3784-f792-492c-85c8-996f6f7c62d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:01.448272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6021065-e236-4021-b915-3b90b8cb7e6f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:01.536252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:01.541450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e3784-f792-492c-85c8-996f6f7c62d9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:01.549381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:01.550797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:01.551345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:01.551734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] PATH_INFO: `/v3/users/84b8434673044971880bc79b6f2c0aee` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:01.553199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b8434673044971880bc79b6f2c0aee)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:01.555786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:01.589430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53001e4-bb9a-4469-933c-45401a20616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:01.591039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53001e4-bb9a-4469-933c-45401a20616b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:01.591960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53001e4-bb9a-4469-933c-45401a20616b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:01.592878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53001e4-bb9a-4469-933c-45401a20616b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:01.594626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53001e4-bb9a-4469-933c-45401a20616b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:01.598490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53001e4-bb9a-4469-933c-45401a20616b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:01.633826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b8434673044971880bc79b6f2c0aee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:01.642637 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3407/6780] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:01 2022] POST /identity/v3/projects => generated 385 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:01.646949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53001e4-bb9a-4469-933c-45401a20616b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:01.655593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b53001e4-bb9a-4469-933c-45401a20616b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:01.655750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b8434673044971880bc79b6f2c0aee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:01.672887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b8434673044971880bc79b6f2c0aee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:01.692280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b8434673044971880bc79b6f2c0aee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:01.693307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b8434673044971880bc79b6f2c0aee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:01.701388 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3374/6781] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:01 2022] DELETE /identity/v3/users/84b8434673044971880bc79b6f2c0aee => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:01.704631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:01.704747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:01.775889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53001e4-bb9a-4469-933c-45401a20616b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:01.795443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a160a40-874f-4a97-b683-a698b16c68d4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:01.801894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641130f6-0691-4feb-9e55-3a1d77573a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:01.802772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641130f6-0691-4feb-9e55-3a1d77573a94 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:01.803425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641130f6-0691-4feb-9e55-3a1d77573a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:01.803919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641130f6-0691-4feb-9e55-3a1d77573a94 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:01.805087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641130f6-0691-4feb-9e55-3a1d77573a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:01.812535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641130f6-0691-4feb-9e55-3a1d77573a94 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:01.845489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:01.850294 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3375/6782] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:01 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:01.850294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641130f6-0691-4feb-9e55-3a1d77573a94 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:01.852823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-641130f6-0691-4feb-9e55-3a1d77573a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:01.874475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641130f6-0691-4feb-9e55-3a1d77573a94 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:01.885693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a272e-c978-4042-ac72-a9517e91f842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:01.886236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a272e-c978-4042-ac72-a9517e91f842 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:01.886509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a272e-c978-4042-ac72-a9517e91f842 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:01.886773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539a272e-c978-4042-ac72-a9517e91f842 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:01.887501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a272e-c978-4042-ac72-a9517e91f842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:01.889490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539a272e-c978-4042-ac72-a9517e91f842 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:01.906367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034edf48-56cb-40b4-bd18-39a75d8f8cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:01.907729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034edf48-56cb-40b4-bd18-39a75d8f8cdf service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:01.908320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034edf48-56cb-40b4-bd18-39a75d8f8cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:01.908685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034edf48-56cb-40b4-bd18-39a75d8f8cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:01.913448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-034edf48-56cb-40b4-bd18-39a75d8f8cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:01.922852 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3376/6783] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:01 2022] POST /identity/v3/users => generated 293 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:01.927171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a272e-c978-4042-ac72-a9517e91f842 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:01.941682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539a272e-c978-4042-ac72-a9517e91f842 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:01.958274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470d5b2-8812-414e-975e-8e5b31eba7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:01.959438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470d5b2-8812-414e-975e-8e5b31eba7aa admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:01.959719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470d5b2-8812-414e-975e-8e5b31eba7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:01.959988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470d5b2-8812-414e-975e-8e5b31eba7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:01.963775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470d5b2-8812-414e-975e-8e5b31eba7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:01.973539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470d5b2-8812-414e-975e-8e5b31eba7aa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:01.992270 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3377/6784] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:01.992270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470d5b2-8812-414e-975e-8e5b31eba7aa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:02.007638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470d5b2-8812-414e-975e-8e5b31eba7aa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:02.014218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034edf48-56cb-40b4-bd18-39a75d8f8cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:02.014218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034edf48-56cb-40b4-bd18-39a75d8f8cdf service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:02.018992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02452b37-b5d3-440f-b102-0343e7c91eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:02.020017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02452b37-b5d3-440f-b102-0343e7c91eca admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.020495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02452b37-b5d3-440f-b102-0343e7c91eca admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.021115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02452b37-b5d3-440f-b102-0343e7c91eca admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.022732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02452b37-b5d3-440f-b102-0343e7c91eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:02.025683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02452b37-b5d3-440f-b102-0343e7c91eca admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:02.029041 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3408/6785] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:02.048637 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3378/6786] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:02.049863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02452b37-b5d3-440f-b102-0343e7c91eca admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:02.050702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034edf48-56cb-40b4-bd18-39a75d8f8cdf service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:02.054014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-02452b37-b5d3-440f-b102-0343e7c91eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:02.076108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034edf48-56cb-40b4-bd18-39a75d8f8cdf service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:02.081566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02452b37-b5d3-440f-b102-0343e7c91eca admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:02.088450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848d5d-2dd4-4e71-97c8-5d043245924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:02.089946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848d5d-2dd4-4e71-97c8-5d043245924d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.090295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848d5d-2dd4-4e71-97c8-5d043245924d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.090480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb848d5d-2dd4-4e71-97c8-5d043245924d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.091128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb848d5d-2dd4-4e71-97c8-5d043245924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:02.093719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb848d5d-2dd4-4e71-97c8-5d043245924d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:02.096920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:02.097739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.097833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.098120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] PATH_INFO: `/v3/projects/2e39f4e5175841a5a469e9cc04ffa7a1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.099757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e39f4e5175841a5a469e9cc04ffa7a1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:02.105334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:02.128022 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3409/6787] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:02.128256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848d5d-2dd4-4e71-97c8-5d043245924d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:02.154530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb848d5d-2dd4-4e71-97c8-5d043245924d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:02.171350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc833ec0-fe13-4b68-bc95-97aa5a77649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:02.172120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc833ec0-fe13-4b68-bc95-97aa5a77649f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.173061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc833ec0-fe13-4b68-bc95-97aa5a77649f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.173509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc833ec0-fe13-4b68-bc95-97aa5a77649f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.173717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=83,keystone:DELETE=10,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:02.176867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc833ec0-fe13-4b68-bc95-97aa5a77649f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:02.181672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc833ec0-fe13-4b68-bc95-97aa5a77649f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:02.213685 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3410/6788] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:02.217814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc833ec0-fe13-4b68-bc95-97aa5a77649f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:02.244717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e39f4e5175841a5a469e9cc04ffa7a1', 'request_id': 'req-998c68a1-9269-4ef5-97d2-8757085e5251'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:02.257364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc833ec0-fe13-4b68-bc95-97aa5a77649f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:02.263898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e39f4e5175841a5a469e9cc04ffa7a1', 'request_id': 'req-998c68a1-9269-4ef5-97d2-8757085e5251'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:02.278897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e39f4e5175841a5a469e9cc04ffa7a1', 'request_id': 'req-998c68a1-9269-4ef5-97d2-8757085e5251'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:02.306568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] The token cache is being invalidate because project 2e39f4e5175841a5a469e9cc04ffa7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:02.307200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:02.308627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:02.310965 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3379/6789] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:02 2022] DELETE /identity/v3/projects/2e39f4e5175841a5a469e9cc04ffa7a1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:02.312611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:02.315450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:02.400255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c68a1-9269-4ef5-97d2-8757085e5251 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:02.402574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55b68b-4c97-49fb-9424-cc7a749e084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:02.403322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55b68b-4c97-49fb-9424-cc7a749e084e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.403707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55b68b-4c97-49fb-9424-cc7a749e084e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.404053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55b68b-4c97-49fb-9424-cc7a749e084e admin admin] PATH_INFO: `/v3/projects/ba982b76fa6b43c0a3930a81bc711362/users/947cde64892a47dfb93605d1be778051/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.406264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87088186-7908-42ef-8951-e1397aa93e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:02.407077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088186-7908-42ef-8951-e1397aa93e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.407422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088186-7908-42ef-8951-e1397aa93e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.407906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088186-7908-42ef-8951-e1397aa93e81 admin admin] PATH_INFO: `/v3/projects/734fc77b23604b83b8c8094db3b9554d/users/5beb70819d7e446e99155917be5c5cf4/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.430731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87088186-7908-42ef-8951-e1397aa93e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734fc77b23604b83b8c8094db3b9554d, user_id=5beb70819d7e446e99155917be5c5cf4, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:02.434245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87088186-7908-42ef-8951-e1397aa93e81 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:02.452790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55b68b-4c97-49fb-9424-cc7a749e084e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba982b76fa6b43c0a3930a81bc711362, user_id=947cde64892a47dfb93605d1be778051, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:02.471787 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3380/6790] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:02 2022] PUT /identity/v3/projects/734fc77b23604b83b8c8094db3b9554d/users/5beb70819d7e446e99155917be5c5cf4/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:02.472145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55b68b-4c97-49fb-9424-cc7a749e084e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:02.472248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191235-a885-4789-972c-98dfcf59c0f5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.472248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191235-a885-4789-972c-98dfcf59c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.472248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191235-a885-4789-972c-98dfcf59c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.493632 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3411/6791] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:02 2022] PUT /identity/v3/projects/ba982b76fa6b43c0a3930a81bc711362/users/947cde64892a47dfb93605d1be778051/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:02.494448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55b68b-4c97-49fb-9424-cc7a749e084e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:02.501750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-de55b68b-4c97-49fb-9424-cc7a749e084e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:02.515701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a4191235-a885-4789-972c-98dfcf59c0f5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:02.517114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a4191235-a885-4789-972c-98dfcf59c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:02.557813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:02.613462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55b68b-4c97-49fb-9424-cc7a749e084e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:02.623835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:02.624628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.625713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.626131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] PATH_INFO: `/v3/projects/2563aae6027842589b7a33d14dc9f051` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.627443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2563aae6027842589b7a33d14dc9f051)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:02.629018 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3381/6792] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:02.630506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02bd08-2d67-4307-94c6-ff8c052b1c5b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.631553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02bd08-2d67-4307-94c6-ff8c052b1c5b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.632021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02bd08-2d67-4307-94c6-ff8c052b1c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.636920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:02.695833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ab02bd08-2d67-4307-94c6-ff8c052b1c5b None None] MFA Rules not processed for user `5beb70819d7e446e99155917be5c5cf4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:02.697707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2563aae6027842589b7a33d14dc9f051', 'request_id': 'req-4e34bab2-d1f3-4dc9-8570-07d5f731da92'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:02.699906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ab02bd08-2d67-4307-94c6-ff8c052b1c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:02.705050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2563aae6027842589b7a33d14dc9f051', 'request_id': 'req-4e34bab2-d1f3-4dc9-8570-07d5f731da92'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:02.717571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2563aae6027842589b7a33d14dc9f051', 'request_id': 'req-4e34bab2-d1f3-4dc9-8570-07d5f731da92'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:02.727573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:02.732357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] The token cache is being invalidate because project 2563aae6027842589b7a33d14dc9f051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:02.732969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:02.734072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4e34bab2-d1f3-4dc9-8570-07d5f731da92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:02.736610 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3412/6793] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:02 2022] DELETE /identity/v3/projects/2563aae6027842589b7a33d14dc9f051 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:02.738599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db967a3a-9dfd-41e5-a3bf-1ece52152b40 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.739109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db967a3a-9dfd-41e5-a3bf-1ece52152b40 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.739571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db967a3a-9dfd-41e5-a3bf-1ece52152b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.778067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-db967a3a-9dfd-41e5-a3bf-1ece52152b40 None None] MFA Rules not processed for user `947cde64892a47dfb93605d1be778051`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:02.780201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-db967a3a-9dfd-41e5-a3bf-1ece52152b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:02.819829 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3382/6794] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:02.821156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4fc9-fb20-44cc-a58a-86ea0a81f466 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.821448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4fc9-fb20-44cc-a58a-86ea0a81f466 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.821718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd4fc9-fb20-44cc-a58a-86ea0a81f466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:02.849304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fcdd4fc9-fb20-44cc-a58a-86ea0a81f466 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:02.851701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fcdd4fc9-fb20-44cc-a58a-86ea0a81f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:02.974793 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3413/6795] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:02.980070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b58749-67d1-44d5-a980-720384688593 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:02.980841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b58749-67d1-44d5-a980-720384688593 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:02.981441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b58749-67d1-44d5-a980-720384688593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.022919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b2b58749-67d1-44d5-a980-720384688593 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:03.024839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b2b58749-67d1-44d5-a980-720384688593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:03.030675 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3383/6796] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:03.035195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd4fc9-fb20-44cc-a58a-86ea0a81f466 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.039096 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3414/6797] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:03.040152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fcdd4fc9-fb20-44cc-a58a-86ea0a81f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:03.046843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b58749-67d1-44d5-a980-720384688593 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.049772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b2b58749-67d1-44d5-a980-720384688593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:03.077422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b58749-67d1-44d5-a980-720384688593 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.084393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2bf02-25a1-45bf-aa17-963fa2a13478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.085011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2bf02-25a1-45bf-aa17-963fa2a13478 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.085285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2bf02-25a1-45bf-aa17-963fa2a13478 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.086299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2bf02-25a1-45bf-aa17-963fa2a13478 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.086299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2bf02-25a1-45bf-aa17-963fa2a13478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.089147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2bf02-25a1-45bf-aa17-963fa2a13478 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.152059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd4fc9-fb20-44cc-a58a-86ea0a81f466 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.157977 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3415/6798] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:03 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:03.163715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2bf02-25a1-45bf-aa17-963fa2a13478 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.172058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e7214-b5f5-4cc2-bbee-de6a57e372d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.173171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e7214-b5f5-4cc2-bbee-de6a57e372d2 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.173457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e7214-b5f5-4cc2-bbee-de6a57e372d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.174452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e7214-b5f5-4cc2-bbee-de6a57e372d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.189966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e7214-b5f5-4cc2-bbee-de6a57e372d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.191540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e7214-b5f5-4cc2-bbee-de6a57e372d2 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.207252 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3384/6799] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:03.212494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4abd2e-fcdb-4dd4-9ba8-08211f54d271 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.212765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4abd2e-fcdb-4dd4-9ba8-08211f54d271 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.214697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4abd2e-fcdb-4dd4-9ba8-08211f54d271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.241221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ef4abd2e-fcdb-4dd4-9ba8-08211f54d271 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:03.242891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ef4abd2e-fcdb-4dd4-9ba8-08211f54d271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:03.251730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:03.338519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2bf02-25a1-45bf-aa17-963fa2a13478 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.342789 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3385/6800] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:03.343764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4abd2e-fcdb-4dd4-9ba8-08211f54d271 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.355181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ee921-8931-47e2-b4e6-8609e78d5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.355745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4abd2e-fcdb-4dd4-9ba8-08211f54d271 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.356037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ee921-8931-47e2-b4e6-8609e78d5f29 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.359536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ee921-8931-47e2-b4e6-8609e78d5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.359942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ee921-8931-47e2-b4e6-8609e78d5f29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.361376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59bcb1-28f1-4dc5-a2a3-6f3c5ab41c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.362130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bcb1-28f1-4dc5-a2a3-6f3c5ab41c00 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.362378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ee921-8931-47e2-b4e6-8609e78d5f29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:03.362519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bcb1-28f1-4dc5-a2a3-6f3c5ab41c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.362919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ee921-8931-47e2-b4e6-8609e78d5f29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.363532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59bcb1-28f1-4dc5-a2a3-6f3c5ab41c00 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.364238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59bcb1-28f1-4dc5-a2a3-6f3c5ab41c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.366557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59bcb1-28f1-4dc5-a2a3-6f3c5ab41c00 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.367962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ee921-8931-47e2-b4e6-8609e78d5f29 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.378782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:03.406499 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3416/6801] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:03.407564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ee921-8931-47e2-b4e6-8609e78d5f29 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.418172 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3386/6802] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:03 2022] POST /identity/v3/users => generated 298 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:03.421894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59bcb1-28f1-4dc5-a2a3-6f3c5ab41c00 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.440421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ee921-8931-47e2-b4e6-8609e78d5f29 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.442571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59bcb1-28f1-4dc5-a2a3-6f3c5ab41c00 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.445737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97a30b-543f-41a7-bd19-bac2c45d2571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.446478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97a30b-543f-41a7-bd19-bac2c45d2571 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.446866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97a30b-543f-41a7-bd19-bac2c45d2571 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.447226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97a30b-543f-41a7-bd19-bac2c45d2571 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.447970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97a30b-543f-41a7-bd19-bac2c45d2571 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:03.448367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97a30b-543f-41a7-bd19-bac2c45d2571 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.448864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cf03c-260d-44d0-afe5-5627a27afda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.449648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cf03c-260d-44d0-afe5-5627a27afda1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.450113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cf03c-260d-44d0-afe5-5627a27afda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.450747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97a30b-543f-41a7-bd19-bac2c45d2571 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.450973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cf03c-260d-44d0-afe5-5627a27afda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.451776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cf03c-260d-44d0-afe5-5627a27afda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.454995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cf03c-260d-44d0-afe5-5627a27afda1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.485710 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3417/6803] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:03.486804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97a30b-543f-41a7-bd19-bac2c45d2571 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.491876 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3387/6804] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:03 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:03.493085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cf03c-260d-44d0-afe5-5627a27afda1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.501099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97a30b-543f-41a7-bd19-bac2c45d2571 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.588752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cf03c-260d-44d0-afe5-5627a27afda1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.595334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc1e00-e044-45a1-b774-821974f49881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.596292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc1e00-e044-45a1-b774-821974f49881 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.597044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc1e00-e044-45a1-b774-821974f49881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.597477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc1e00-e044-45a1-b774-821974f49881 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.598319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc1e00-e044-45a1-b774-821974f49881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.601423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc1e00-e044-45a1-b774-821974f49881 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.610108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18f286-b2f6-4130-bc0b-ec468a77a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.610883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18f286-b2f6-4130-bc0b-ec468a77a897 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.611258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18f286-b2f6-4130-bc0b-ec468a77a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.611620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18f286-b2f6-4130-bc0b-ec468a77a897 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.612418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18f286-b2f6-4130-bc0b-ec468a77a897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.614590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18f286-b2f6-4130-bc0b-ec468a77a897 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.626458 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3418/6805] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:03.627494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18f286-b2f6-4130-bc0b-ec468a77a897 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.652967 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3388/6806] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:03 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:03.653731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18f286-b2f6-4130-bc0b-ec468a77a897 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.656174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc1e00-e044-45a1-b774-821974f49881 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.732311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb672a-f5dd-4496-8e82-183d84917771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.733199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb672a-f5dd-4496-8e82-183d84917771 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.733478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb672a-f5dd-4496-8e82-183d84917771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.733843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb672a-f5dd-4496-8e82-183d84917771 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.734739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb672a-f5dd-4496-8e82-183d84917771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.742274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb672a-f5dd-4496-8e82-183d84917771 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.756126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc1e00-e044-45a1-b774-821974f49881 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.761741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d213e-e59d-4cf2-871c-13a6d6ae46e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.762560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d213e-e59d-4cf2-871c-13a6d6ae46e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.762850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d213e-e59d-4cf2-871c-13a6d6ae46e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.763114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d213e-e59d-4cf2-871c-13a6d6ae46e5 admin admin] PATH_INFO: `/v3/projects/76fe77ce59b7435caaaaeda7f479b9fa/users/67f154f53727489688f0388a17007c32/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.770088 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3419/6807] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:03 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:03.771398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb672a-f5dd-4496-8e82-183d84917771 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.782595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb672a-f5dd-4496-8e82-183d84917771 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.788761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca65dc-6e23-44f6-91c5-20e079106de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.789838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca65dc-6e23-44f6-91c5-20e079106de6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.790342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca65dc-6e23-44f6-91c5-20e079106de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.790817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca65dc-6e23-44f6-91c5-20e079106de6 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.791708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca65dc-6e23-44f6-91c5-20e079106de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.794068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca65dc-6e23-44f6-91c5-20e079106de6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.797821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d213e-e59d-4cf2-871c-13a6d6ae46e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fe77ce59b7435caaaaeda7f479b9fa, user_id=67f154f53727489688f0388a17007c32, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.800676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d213e-e59d-4cf2-871c-13a6d6ae46e5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.823727 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3389/6808] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:03 2022] PUT /identity/v3/projects/76fe77ce59b7435caaaaeda7f479b9fa/users/67f154f53727489688f0388a17007c32/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:03.824727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d213e-e59d-4cf2-871c-13a6d6ae46e5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.825983 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3420/6809] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:03 2022] POST /identity/v3/users => generated 284 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:03.827320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca65dc-6e23-44f6-91c5-20e079106de6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.842442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca65dc-6e23-44f6-91c5-20e079106de6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.864633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:03.904641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:03.932253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b953a-100f-4693-bd99-2a88cf0e4957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.942002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b953a-100f-4693-bd99-2a88cf0e4957 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.942668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b953a-100f-4693-bd99-2a88cf0e4957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.943069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b953a-100f-4693-bd99-2a88cf0e4957 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.944181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b953a-100f-4693-bd99-2a88cf0e4957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.946323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b953a-100f-4693-bd99-2a88cf0e4957 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.959242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d213e-e59d-4cf2-871c-13a6d6ae46e5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:03.965615 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3421/6810] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:03.965615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b953a-100f-4693-bd99-2a88cf0e4957 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:03.973566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed0061-6242-4c38-907c-151639d4c2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:03.974049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0061-6242-4c38-907c-151639d4c2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:03.974360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0061-6242-4c38-907c-151639d4c2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:03.974684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed0061-6242-4c38-907c-151639d4c2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:03.975330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed0061-6242-4c38-907c-151639d4c2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:03.980193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed0061-6242-4c38-907c-151639d4c2e9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:03.984630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b953a-100f-4693-bd99-2a88cf0e4957 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:04.003543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d6aad-0fae-4ebc-a5e0-5156caf9f1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:04.004425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d6aad-0fae-4ebc-a5e0-5156caf9f1dd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.004806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d6aad-0fae-4ebc-a5e0-5156caf9f1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.005190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d6aad-0fae-4ebc-a5e0-5156caf9f1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:04.006298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d6aad-0fae-4ebc-a5e0-5156caf9f1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:04.007741 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3390/6811] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:04.008510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d6aad-0fae-4ebc-a5e0-5156caf9f1dd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:04.008642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed0061-6242-4c38-907c-151639d4c2e9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:04.024211 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3422/6812] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:04.030249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d6aad-0fae-4ebc-a5e0-5156caf9f1dd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:04.041130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed0061-6242-4c38-907c-151639d4c2e9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:04.054086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51333b2c-60b0-4300-8486-1478daa91439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:04.056406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51333b2c-60b0-4300-8486-1478daa91439 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.056822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51333b2c-60b0-4300-8486-1478daa91439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.057197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51333b2c-60b0-4300-8486-1478daa91439 admin admin] PATH_INFO: `/v3/projects/76fe77ce59b7435caaaaeda7f479b9fa/users/67f154f53727489688f0388a17007c32/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:04.058091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d6aad-0fae-4ebc-a5e0-5156caf9f1dd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:04.062160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51333b2c-60b0-4300-8486-1478daa91439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fe77ce59b7435caaaaeda7f479b9fa, user_id=67f154f53727489688f0388a17007c32, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:04.069685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cfe45-3c20-441e-9bca-ebbc10beb3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:04.070803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51333b2c-60b0-4300-8486-1478daa91439 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:04.072267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cfe45-3c20-441e-9bca-ebbc10beb3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.073469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cfe45-3c20-441e-9bca-ebbc10beb3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.073852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cfe45-3c20-441e-9bca-ebbc10beb3fd admin admin] PATH_INFO: `/v3/projects/995bf67979634abd9f72835141f73c71/users/f006cb4b8ff64147a9b5168694d85481/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:04.114837 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3391/6813] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:04 2022] PUT /identity/v3/projects/76fe77ce59b7435caaaaeda7f479b9fa/users/67f154f53727489688f0388a17007c32/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:04.114837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51333b2c-60b0-4300-8486-1478daa91439 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:04.130075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cfe45-3c20-441e-9bca-ebbc10beb3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=995bf67979634abd9f72835141f73c71, user_id=f006cb4b8ff64147a9b5168694d85481, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:04.137850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cfe45-3c20-441e-9bca-ebbc10beb3fd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:04.169825 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3423/6814] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:04 2022] PUT /identity/v3/projects/995bf67979634abd9f72835141f73c71/users/f006cb4b8ff64147a9b5168694d85481/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:04.174812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d0c9-5932-47bf-a18f-622791ee98c9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.175358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d0c9-5932-47bf-a18f-622791ee98c9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.180933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d0c9-5932-47bf-a18f-622791ee98c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:04.244336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51333b2c-60b0-4300-8486-1478daa91439 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:04.273028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f183d0c9-5932-47bf-a18f-622791ee98c9 None None] MFA Rules not processed for user `67f154f53727489688f0388a17007c32`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:04.274663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f183d0c9-5932-47bf-a18f-622791ee98c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:04.329026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cec99-6f64-4fe4-a600-74b68e27c44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:04.330079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cec99-6f64-4fe4-a600-74b68e27c44c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.331305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cec99-6f64-4fe4-a600-74b68e27c44c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.331305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cec99-6f64-4fe4-a600-74b68e27c44c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:04.331894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cec99-6f64-4fe4-a600-74b68e27c44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:04.333726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cec99-6f64-4fe4-a600-74b68e27c44c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:04.347527 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3392/6815] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:04.352228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cec99-6f64-4fe4-a600-74b68e27c44c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:04.363850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cec99-6f64-4fe4-a600-74b68e27c44c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:04.370950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fb10f-97f5-422a-add2-be4c13338640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:04.372420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb10f-97f5-422a-add2-be4c13338640 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.372890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb10f-97f5-422a-add2-be4c13338640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.373404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93fb10f-97f5-422a-add2-be4c13338640 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:04.374230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fb10f-97f5-422a-add2-be4c13338640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:04.376371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93fb10f-97f5-422a-add2-be4c13338640 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:04.390312 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3393/6816] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:04.391755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fb10f-97f5-422a-add2-be4c13338640 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:04.393955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d93fb10f-97f5-422a-add2-be4c13338640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:04.410063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93fb10f-97f5-422a-add2-be4c13338640 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:04.423042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:04.423918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.424300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.424854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] PATH_INFO: `/v3/users/5beb70819d7e446e99155917be5c5cf4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:04.427619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5beb70819d7e446e99155917be5c5cf4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:04.428831 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3424/6817] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:04.430943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183d0c9-5932-47bf-a18f-622791ee98c9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:04.431522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:04.486847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183d0c9-5932-47bf-a18f-622791ee98c9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:04.509402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a87a75-9e1e-4c83-8533-1386e304910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:04.510272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87a75-9e1e-4c83-8533-1386e304910e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.510524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87a75-9e1e-4c83-8533-1386e304910e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.510759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87a75-9e1e-4c83-8533-1386e304910e admin admin] PATH_INFO: `/v3/projects/61b27759a50b464db6d50b54e8585b2c/users/df3b62fc26dd492487c1b9909248c5a4/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:04.554449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:04.557200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a87a75-9e1e-4c83-8533-1386e304910e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b27759a50b464db6d50b54e8585b2c, user_id=df3b62fc26dd492487c1b9909248c5a4, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:04.559538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5beb70819d7e446e99155917be5c5cf4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:04.560105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a87a75-9e1e-4c83-8533-1386e304910e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:04.580054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5beb70819d7e446e99155917be5c5cf4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:04.593352 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3425/6818] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:04 2022] PUT /identity/v3/projects/61b27759a50b464db6d50b54e8585b2c/users/df3b62fc26dd492487c1b9909248c5a4/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:04.593352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a87a75-9e1e-4c83-8533-1386e304910e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:04.626311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5beb70819d7e446e99155917be5c5cf4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:04.660100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5beb70819d7e446e99155917be5c5cf4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:04.660760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5beb70819d7e446e99155917be5c5cf4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:04.669420 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3394/6819] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:04 2022] DELETE /identity/v3/users/5beb70819d7e446e99155917be5c5cf4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:04.673591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:04.673927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:04.678728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:04.735702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a87a75-9e1e-4c83-8533-1386e304910e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:04.832854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa00c9-b803-472f-b53d-76b9659c0fe4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:04.843606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00737bdc-1dc9-40fa-bace-a0c6ac9f4546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:04.844513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737bdc-1dc9-40fa-bace-a0c6ac9f4546 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.844972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737bdc-1dc9-40fa-bace-a0c6ac9f4546 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.845420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737bdc-1dc9-40fa-bace-a0c6ac9f4546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:04.850371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-00737bdc-1dc9-40fa-bace-a0c6ac9f4546 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:04.876239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7b0cd-d7ef-4f04-accd-9cf76cc6ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:04.876925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b0cd-d7ef-4f04-accd-9cf76cc6ab7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.877212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b0cd-d7ef-4f04-accd-9cf76cc6ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.877558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7b0cd-d7ef-4f04-accd-9cf76cc6ab7c admin admin] PATH_INFO: `/v3/projects/995bf67979634abd9f72835141f73c71/users/f006cb4b8ff64147a9b5168694d85481/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:04.887535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7b0cd-d7ef-4f04-accd-9cf76cc6ab7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=995bf67979634abd9f72835141f73c71, user_id=f006cb4b8ff64147a9b5168694d85481, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:04.890245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7b0cd-d7ef-4f04-accd-9cf76cc6ab7c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:04.911017 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3426/6820] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:04 2022] PUT /identity/v3/projects/995bf67979634abd9f72835141f73c71/users/f006cb4b8ff64147a9b5168694d85481/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:04.931452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d958-33f3-4929-b02e-eae14150cee7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:04.931804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d958-33f3-4929-b02e-eae14150cee7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:04.932002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d958-33f3-4929-b02e-eae14150cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:05.004846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00737bdc-1dc9-40fa-bace-a0c6ac9f4546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:05.006547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00737bdc-1dc9-40fa-bace-a0c6ac9f4546 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:05.033641 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3395/6821] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:05.035427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6cb3d-f027-4c90-ab68-2ce6ca6fc11b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:05.035718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6cb3d-f027-4c90-ab68-2ce6ca6fc11b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:05.035991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6cb3d-f027-4c90-ab68-2ce6ca6fc11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:05.058883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-40e6d958-33f3-4929-b02e-eae14150cee7 None None] MFA Rules not processed for user `df3b62fc26dd492487c1b9909248c5a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:05.062183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-40e6d958-33f3-4929-b02e-eae14150cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:05.079199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1ff6cb3d-f027-4c90-ab68-2ce6ca6fc11b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:05.080646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ff6cb3d-f027-4c90-ab68-2ce6ca6fc11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:05.214853 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3427/6822] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:05.220532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047006df-7434-4d6f-832b-f55e61bab530 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:05.222395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047006df-7434-4d6f-832b-f55e61bab530 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:05.222978 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3396/6823] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:05.223901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6cb3d-f027-4c90-ab68-2ce6ca6fc11b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:05.225145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047006df-7434-4d6f-832b-f55e61bab530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:05.225350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ff6cb3d-f027-4c90-ab68-2ce6ca6fc11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:05.248589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6cb3d-f027-4c90-ab68-2ce6ca6fc11b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:05.262394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5bc43-69d1-4d18-89b6-982e1b410615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:05.263027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5bc43-69d1-4d18-89b6-982e1b410615 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:05.263304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5bc43-69d1-4d18-89b6-982e1b410615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:05.263611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5bc43-69d1-4d18-89b6-982e1b410615 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:05.264224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5bc43-69d1-4d18-89b6-982e1b410615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:05.266292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5bc43-69d1-4d18-89b6-982e1b410615 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:05.286157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-047006df-7434-4d6f-832b-f55e61bab530 None None] MFA Rules not processed for user `f006cb4b8ff64147a9b5168694d85481`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:05.287493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-047006df-7434-4d6f-832b-f55e61bab530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:05.320081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:05.341978 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3397/6824] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:05 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:05.342854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5bc43-69d1-4d18-89b6-982e1b410615 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:05.350016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-49a5bc43-69d1-4d18-89b6-982e1b410615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:05.393272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:05.400400 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3428/6825] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:05.401556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047006df-7434-4d6f-832b-f55e61bab530 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:05.424855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047006df-7434-4d6f-832b-f55e61bab530 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:05.578854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5bc43-69d1-4d18-89b6-982e1b410615 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:05.602485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86040b9-4eee-4236-b520-b90bae9ae51e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:05.603143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86040b9-4eee-4236-b520-b90bae9ae51e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:05.603419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86040b9-4eee-4236-b520-b90bae9ae51e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:05.603688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86040b9-4eee-4236-b520-b90bae9ae51e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:05.606217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3730ff3-2a80-4185-8a7a-202667686f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:05.606857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730ff3-2a80-4185-8a7a-202667686f57 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:05.607132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730ff3-2a80-4185-8a7a-202667686f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:05.607396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3730ff3-2a80-4185-8a7a-202667686f57 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:05.608057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3730ff3-2a80-4185-8a7a-202667686f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:05.613989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3730ff3-2a80-4185-8a7a-202667686f57 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:05.642646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86040b9-4eee-4236-b520-b90bae9ae51e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:05.644188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86040b9-4eee-4236-b520-b90bae9ae51e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:05.689107 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3398/6826] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:05.689107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86040b9-4eee-4236-b520-b90bae9ae51e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:05.689107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a86040b9-4eee-4236-b520-b90bae9ae51e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:05.696552 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3429/6827] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:05 2022] POST /identity/v3/users => generated 291 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:05.704665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3730ff3-2a80-4185-8a7a-202667686f57 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:05.755811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86040b9-4eee-4236-b520-b90bae9ae51e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:05.762418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3730ff3-2a80-4185-8a7a-202667686f57 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:05.772199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e31d3e-9497-4121-aacf-bed333873098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:05.775188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e31d3e-9497-4121-aacf-bed333873098 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:05.776228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e31d3e-9497-4121-aacf-bed333873098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:05.777409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e31d3e-9497-4121-aacf-bed333873098 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:05.778406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e31d3e-9497-4121-aacf-bed333873098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:05.778786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5bd67-8132-4c8c-ba0e-562f4636d8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:05.781415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5bd67-8132-4c8c-ba0e-562f4636d8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:05.781969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5bd67-8132-4c8c-ba0e-562f4636d8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:05.782537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5bd67-8132-4c8c-ba0e-562f4636d8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:05.785567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5bd67-8132-4c8c-ba0e-562f4636d8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:05.786342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e31d3e-9497-4121-aacf-bed333873098 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:05.790492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5bd67-8132-4c8c-ba0e-562f4636d8d3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:05.825315 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3430/6828] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:05.828339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5bd67-8132-4c8c-ba0e-562f4636d8d3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:05.852688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5bd67-8132-4c8c-ba0e-562f4636d8d3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:05.871990 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3399/6829] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:05 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:05.874677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccaa49-241d-4c64-80f2-ae129c93a2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:05.876660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccaa49-241d-4c64-80f2-ae129c93a2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:05.877077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e31d3e-9497-4121-aacf-bed333873098 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:05.878785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccaa49-241d-4c64-80f2-ae129c93a2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:05.879718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccaa49-241d-4c64-80f2-ae129c93a2e5 admin admin] PATH_INFO: `/v3/projects/ec9c0a2ecf9a4915a60aaf0c0fc7d5bb/users/5e53b43844be4904b2c1df0626e2cebf/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:05.921571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccaa49-241d-4c64-80f2-ae129c93a2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9c0a2ecf9a4915a60aaf0c0fc7d5bb, user_id=5e53b43844be4904b2c1df0626e2cebf, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:05.930689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccaa49-241d-4c64-80f2-ae129c93a2e5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:05.966008 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3431/6830] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:05 2022] PUT /identity/v3/projects/ec9c0a2ecf9a4915a60aaf0c0fc7d5bb/users/5e53b43844be4904b2c1df0626e2cebf/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:05.971482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccaa49-241d-4c64-80f2-ae129c93a2e5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:06.048256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e31d3e-9497-4121-aacf-bed333873098 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:06.147336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccaa49-241d-4c64-80f2-ae129c93a2e5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:06.160968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378f7be-3196-4c84-a0b4-fd7e197505c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:06.163619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378f7be-3196-4c84-a0b4-fd7e197505c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:06.163819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378f7be-3196-4c84-a0b4-fd7e197505c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:06.164558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378f7be-3196-4c84-a0b4-fd7e197505c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:06.168140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378f7be-3196-4c84-a0b4-fd7e197505c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:06.172940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378f7be-3196-4c84-a0b4-fd7e197505c5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:06.222971 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3432/6831] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:06.228013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378f7be-3196-4c84-a0b4-fd7e197505c5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:06.242801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c3f1f-2a73-4114-9754-538205adabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:06.244749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3f1f-2a73-4114-9754-538205adabea admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:06.244947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3f1f-2a73-4114-9754-538205adabea admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:06.245220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3f1f-2a73-4114-9754-538205adabea admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:06.247127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c3f1f-2a73-4114-9754-538205adabea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:06.251823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c3f1f-2a73-4114-9754-538205adabea admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:06.259141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378f7be-3196-4c84-a0b4-fd7e197505c5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:06.274812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ecdca-8c71-4e67-99b7-6cee498e44c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:06.275607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ecdca-8c71-4e67-99b7-6cee498e44c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:06.275985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ecdca-8c71-4e67-99b7-6cee498e44c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:06.276358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ecdca-8c71-4e67-99b7-6cee498e44c6 admin admin] PATH_INFO: `/v3/projects/ec9c0a2ecf9a4915a60aaf0c0fc7d5bb/users/5e53b43844be4904b2c1df0626e2cebf/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:06.281641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ecdca-8c71-4e67-99b7-6cee498e44c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9c0a2ecf9a4915a60aaf0c0fc7d5bb, user_id=5e53b43844be4904b2c1df0626e2cebf, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:06.291075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ecdca-8c71-4e67-99b7-6cee498e44c6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:06.323553 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3400/6832] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:05 2022] POST /identity/v3/users => generated 291 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:06.327363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c3f1f-2a73-4114-9754-538205adabea admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:06.346045 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3433/6833] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:06 2022] PUT /identity/v3/projects/ec9c0a2ecf9a4915a60aaf0c0fc7d5bb/users/5e53b43844be4904b2c1df0626e2cebf/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:06.358657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c67ab-1500-4c97-9ec8-7b9edd40b03d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:06.359025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c67ab-1500-4c97-9ec8-7b9edd40b03d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:06.359368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c67ab-1500-4c97-9ec8-7b9edd40b03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:06.362330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c3f1f-2a73-4114-9754-538205adabea admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:06.387713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:06.433127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-457c67ab-1500-4c97-9ec8-7b9edd40b03d None None] MFA Rules not processed for user `5e53b43844be4904b2c1df0626e2cebf`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:06.434652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-457c67ab-1500-4c97-9ec8-7b9edd40b03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:06.471130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:06.512430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a4802-d177-4f1c-95fb-0582b05429f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:06.513067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4802-d177-4f1c-95fb-0582b05429f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:06.513350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4802-d177-4f1c-95fb-0582b05429f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:06.513621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a4802-d177-4f1c-95fb-0582b05429f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:06.514493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a4802-d177-4f1c-95fb-0582b05429f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:06.516990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a4802-d177-4f1c-95fb-0582b05429f9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:06.542477 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3401/6834] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:06.546238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a4802-d177-4f1c-95fb-0582b05429f9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:06.564025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a4802-d177-4f1c-95fb-0582b05429f9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:06.574317 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3434/6835] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:06.576846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095f368-25d2-4004-99d1-73d4bcf55f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:06.577572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095f368-25d2-4004-99d1-73d4bcf55f27 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:06.577854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095f368-25d2-4004-99d1-73d4bcf55f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:06.578149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095f368-25d2-4004-99d1-73d4bcf55f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:06.578803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095f368-25d2-4004-99d1-73d4bcf55f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:06.580641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8095f368-25d2-4004-99d1-73d4bcf55f27 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:06.608084 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3402/6836] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:46:06.612057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c67ab-1500-4c97-9ec8-7b9edd40b03d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:06.619106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095f368-25d2-4004-99d1-73d4bcf55f27 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:06.630793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c67ab-1500-4c97-9ec8-7b9edd40b03d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:06.656999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7003c4-aefc-4890-b016-fcfe56a83781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:06.658465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7003c4-aefc-4890-b016-fcfe56a83781 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:06.664997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7003c4-aefc-4890-b016-fcfe56a83781 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:06.665531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7003c4-aefc-4890-b016-fcfe56a83781 admin admin] PATH_INFO: `/v3/projects/6d8b2d156fb94b78bc8c37f1a49a2aa7/users/e7724cb9d55b4f8eb2618b2b88279915/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:06.730214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7003c4-aefc-4890-b016-fcfe56a83781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d8b2d156fb94b78bc8c37f1a49a2aa7, user_id=e7724cb9d55b4f8eb2618b2b88279915, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:06.741187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7003c4-aefc-4890-b016-fcfe56a83781 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:06.784778 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3435/6837] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:06 2022] PUT /identity/v3/projects/6d8b2d156fb94b78bc8c37f1a49a2aa7/users/e7724cb9d55b4f8eb2618b2b88279915/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:06.795022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bacd-3b11-46e3-acce-d53401744675 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:06.795495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bacd-3b11-46e3-acce-d53401744675 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:06.795853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2bacd-3b11-46e3-acce-d53401744675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:06.827414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8095f368-25d2-4004-99d1-73d4bcf55f27 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:06.867536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-71c2bacd-3b11-46e3-acce-d53401744675 None None] MFA Rules not processed for user `e7724cb9d55b4f8eb2618b2b88279915`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:06.871549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-71c2bacd-3b11-46e3-acce-d53401744675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:06.930231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077cc0c-3ce9-49bd-937f-b197c58ad43a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:06.932162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077cc0c-3ce9-49bd-937f-b197c58ad43a service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:06.932307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077cc0c-3ce9-49bd-937f-b197c58ad43a service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:06.932546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077cc0c-3ce9-49bd-937f-b197c58ad43a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:07.016826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077cc0c-3ce9-49bd-937f-b197c58ad43a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:07.018766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077cc0c-3ce9-49bd-937f-b197c58ad43a service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:07.033283 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3403/6838] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:07.066445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077cc0c-3ce9-49bd-937f-b197c58ad43a service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:07.068232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b077cc0c-3ce9-49bd-937f-b197c58ad43a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:07.068353 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3436/6839] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:46:07.075798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:07.202644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077cc0c-3ce9-49bd-937f-b197c58ad43a service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:07.207593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a5a98a-5889-4ac8-abc5-986a795a5f99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:07.209140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a98a-5889-4ac8-abc5-986a795a5f99 service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:07.209140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a98a-5889-4ac8-abc5-986a795a5f99 service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:07.209318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a5a98a-5889-4ac8-abc5-986a795a5f99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:07.424431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5a98a-5889-4ac8-abc5-986a795a5f99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:07.427309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a5a98a-5889-4ac8-abc5-986a795a5f99 service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:07.470958 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3404/6840] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:46:07.783905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2bacd-3b11-46e3-acce-d53401744675 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:07.786373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-71c2bacd-3b11-46e3-acce-d53401744675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:07.945524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2bacd-3b11-46e3-acce-d53401744675 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:07.952181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:07.953060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:07.953369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:07.953694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] PATH_INFO: `/v3/projects/734fc77b23604b83b8c8094db3b9554d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:07.955288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734fc77b23604b83b8c8094db3b9554d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:07.958114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:08.029602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:08.087193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734fc77b23604b83b8c8094db3b9554d', 'request_id': 'req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:08.102433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734fc77b23604b83b8c8094db3b9554d', 'request_id': 'req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:08.129221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734fc77b23604b83b8c8094db3b9554d', 'request_id': 'req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:08.145070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] The token cache is being invalidate because project 734fc77b23604b83b8c8094db3b9554d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:08.145479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:08.146649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-02d73106-f7ce-4dac-aecc-7ddc5edd3cf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:08.151867 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3437/6841] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:07 2022] DELETE /identity/v3/projects/734fc77b23604b83b8c8094db3b9554d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:08.153663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d966b8-1150-4244-a13e-765a527e8608 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:08.154180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d966b8-1150-4244-a13e-765a527e8608 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:08.154350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d966b8-1150-4244-a13e-765a527e8608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:08.207533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d8d966b8-1150-4244-a13e-765a527e8608 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:08.208918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d8d966b8-1150-4244-a13e-765a527e8608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:08.332158 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3405/6842] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:46:08.340104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80febf-1b30-41f0-ab3a-c123364cf91b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:08.340721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80febf-1b30-41f0-ab3a-c123364cf91b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:08.341143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80febf-1b30-41f0-ab3a-c123364cf91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:08.379176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5c80febf-1b30-41f0-ab3a-c123364cf91b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:08.380667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5c80febf-1b30-41f0-ab3a-c123364cf91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:08.397202 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3438/6843] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:08.401209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d966b8-1150-4244-a13e-765a527e8608 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:08.412464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d966b8-1150-4244-a13e-765a527e8608 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:08.431148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cea1a-5868-466e-b811-8f1aab1223ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:08.433201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cea1a-5868-466e-b811-8f1aab1223ab admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:08.435071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cea1a-5868-466e-b811-8f1aab1223ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:08.435421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308cea1a-5868-466e-b811-8f1aab1223ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:08.437233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cea1a-5868-466e-b811-8f1aab1223ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:08.437461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cea1a-5868-466e-b811-8f1aab1223ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:08.441214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308cea1a-5868-466e-b811-8f1aab1223ab admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:08.472043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80febf-1b30-41f0-ab3a-c123364cf91b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:08.481563 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3406/6844] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:08.486207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c80febf-1b30-41f0-ab3a-c123364cf91b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:08.497163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb8fb-0406-4f12-a66f-d7c852aac4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:08.497931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb8fb-0406-4f12-a66f-d7c852aac4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:08.499196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb8fb-0406-4f12-a66f-d7c852aac4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:08.500360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bb8fb-0406-4f12-a66f-d7c852aac4e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:08.502847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb8fb-0406-4f12-a66f-d7c852aac4e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:08.505045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bb8fb-0406-4f12-a66f-d7c852aac4e8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:08.581052 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3439/6845] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:08 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:08.585866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cea1a-5868-466e-b811-8f1aab1223ab admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:08.602277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308cea1a-5868-466e-b811-8f1aab1223ab admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:08.736681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:08.834955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8195398-df84-48e1-9b40-84ecafc433f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:08.835715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8195398-df84-48e1-9b40-84ecafc433f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:08.839264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8195398-df84-48e1-9b40-84ecafc433f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:08.839665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8195398-df84-48e1-9b40-84ecafc433f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:08.840450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8195398-df84-48e1-9b40-84ecafc433f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:08.847975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb8fb-0406-4f12-a66f-d7c852aac4e8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:08.850218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-747bb8fb-0406-4f12-a66f-d7c852aac4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:08.856591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8195398-df84-48e1-9b40-84ecafc433f4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:08.913031 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3407/6846] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:08 2022] POST /identity/v3/users => generated 289 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:08.917771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8195398-df84-48e1-9b40-84ecafc433f4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:08.939620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8195398-df84-48e1-9b40-84ecafc433f4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:08.953530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bb8fb-0406-4f12-a66f-d7c852aac4e8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:08.958673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3949631-b72f-42b7-8691-457aecb19030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:08.960039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3949631-b72f-42b7-8691-457aecb19030 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:08.960490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3949631-b72f-42b7-8691-457aecb19030 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:08.961052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3949631-b72f-42b7-8691-457aecb19030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:08.963246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e3949631-b72f-42b7-8691-457aecb19030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:08.972588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0186c2-ba09-4fec-95a9-7a66411754c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:08.976522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0186c2-ba09-4fec-95a9-7a66411754c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:08.978058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0186c2-ba09-4fec-95a9-7a66411754c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:08.979704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0186c2-ba09-4fec-95a9-7a66411754c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:08.981508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0186c2-ba09-4fec-95a9-7a66411754c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:08.984864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0186c2-ba09-4fec-95a9-7a66411754c0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:09.018913 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3408/6847] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:09.024262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0186c2-ba09-4fec-95a9-7a66411754c0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:09.058137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0186c2-ba09-4fec-95a9-7a66411754c0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:09.071656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abb0b2-94f0-4812-af4a-c5b02bda048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:09.072624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abb0b2-94f0-4812-af4a-c5b02bda048b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:09.073155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abb0b2-94f0-4812-af4a-c5b02bda048b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:09.073774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abb0b2-94f0-4812-af4a-c5b02bda048b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:09.074803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abb0b2-94f0-4812-af4a-c5b02bda048b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:09.076773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5abb0b2-94f0-4812-af4a-c5b02bda048b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:09.097322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3949631-b72f-42b7-8691-457aecb19030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:09.099263 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3409/6848] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:09.100517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3949631-b72f-42b7-8691-457aecb19030 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:09.101398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abb0b2-94f0-4812-af4a-c5b02bda048b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:09.106919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d5abb0b2-94f0-4812-af4a-c5b02bda048b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:09.125939 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3440/6849] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:09.127776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3949631-b72f-42b7-8691-457aecb19030 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:09.139419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5abb0b2-94f0-4812-af4a-c5b02bda048b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:09.149454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:09.152161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:09.153419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3949631-b72f-42b7-8691-457aecb19030 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:09.153936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:09.154819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] PATH_INFO: `/v3/users/f006cb4b8ff64147a9b5168694d85481` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:09.157214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f006cb4b8ff64147a9b5168694d85481)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:09.161082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:09.167829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335204b-a408-42e6-a01a-231aa7157826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:09.169303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335204b-a408-42e6-a01a-231aa7157826 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:09.169997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335204b-a408-42e6-a01a-231aa7157826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:09.171305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335204b-a408-42e6-a01a-231aa7157826 admin admin] PATH_INFO: `/v3/projects/2fbaaade62094415a1615bc199e2d5ab/users/33ed5457b13543f58faa42ef2905a1b2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:09.270594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335204b-a408-42e6-a01a-231aa7157826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbaaade62094415a1615bc199e2d5ab, user_id=33ed5457b13543f58faa42ef2905a1b2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:09.274309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335204b-a408-42e6-a01a-231aa7157826 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:09.291771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f006cb4b8ff64147a9b5168694d85481'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:09.308887 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3441/6850] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:09 2022] PUT /identity/v3/projects/2fbaaade62094415a1615bc199e2d5ab/users/33ed5457b13543f58faa42ef2905a1b2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:09.310531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490fdd9-db1d-4e82-995b-53b3b0a0d050 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:09.310810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490fdd9-db1d-4e82-995b-53b3b0a0d050 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:09.311078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490fdd9-db1d-4e82-995b-53b3b0a0d050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:09.317828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f006cb4b8ff64147a9b5168694d85481'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:09.376993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f006cb4b8ff64147a9b5168694d85481'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:09.396085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f006cb4b8ff64147a9b5168694d85481'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:09.397629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b473fc4c-cdbc-45ec-9c21-d7628656b277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f006cb4b8ff64147a9b5168694d85481'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:09.408963 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3410/6851] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:09 2022] DELETE /identity/v3/users/f006cb4b8ff64147a9b5168694d85481 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:09.411130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33119f7a-ad04-40f3-ae01-5f4d00b64d73 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:09.411130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33119f7a-ad04-40f3-ae01-5f4d00b64d73 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:09.411130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33119f7a-ad04-40f3-ae01-5f4d00b64d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:09.419516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d490fdd9-db1d-4e82-995b-53b3b0a0d050 None None] MFA Rules not processed for user `33ed5457b13543f58faa42ef2905a1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:09.420784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d490fdd9-db1d-4e82-995b-53b3b0a0d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:09.432685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:09.463126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-33119f7a-ad04-40f3-ae01-5f4d00b64d73 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:09.465137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-33119f7a-ad04-40f3-ae01-5f4d00b64d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:09.571590 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3442/6852] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:09.624637 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3411/6853] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:09.654698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490fdd9-db1d-4e82-995b-53b3b0a0d050 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:09.656208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d490fdd9-db1d-4e82-995b-53b3b0a0d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:09.691025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33119f7a-ad04-40f3-ae01-5f4d00b64d73 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:09.692941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-33119f7a-ad04-40f3-ae01-5f4d00b64d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:09.760961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490fdd9-db1d-4e82-995b-53b3b0a0d050 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:09.766647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce690f4-265e-49e4-8ac4-6ab1ab19c8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:09.767735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce690f4-265e-49e4-8ac4-6ab1ab19c8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:09.768596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce690f4-265e-49e4-8ac4-6ab1ab19c8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:09.769338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce690f4-265e-49e4-8ac4-6ab1ab19c8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:09.778256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:09.808722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce690f4-265e-49e4-8ac4-6ab1ab19c8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:09.815197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce690f4-265e-49e4-8ac4-6ab1ab19c8c8 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:09.843149 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3443/6854] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:09.855239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33119f7a-ad04-40f3-ae01-5f4d00b64d73 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:09.874524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590f608-28f9-4508-82fc-9d2eb07142fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:09.875770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590f608-28f9-4508-82fc-9d2eb07142fa service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:09.876144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590f608-28f9-4508-82fc-9d2eb07142fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:09.876441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590f608-28f9-4508-82fc-9d2eb07142fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:09.895401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590f608-28f9-4508-82fc-9d2eb07142fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:09.896956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590f608-28f9-4508-82fc-9d2eb07142fa service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:09.914938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce690f4-265e-49e4-8ac4-6ab1ab19c8c8 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:09.916788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5ce690f4-265e-49e4-8ac4-6ab1ab19c8c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:09.922702 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3412/6855] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:09.937903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce690f4-265e-49e4-8ac4-6ab1ab19c8c8 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:09.946941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:09.947706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:09.947985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:09.948345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] PATH_INFO: `/v3/users/33ed5457b13543f58faa42ef2905a1b2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:09.950155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ed5457b13543f58faa42ef2905a1b2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:09.952934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:10.064943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ed5457b13543f58faa42ef2905a1b2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:10.074399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ed5457b13543f58faa42ef2905a1b2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:10.082383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ed5457b13543f58faa42ef2905a1b2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:10.103887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ed5457b13543f58faa42ef2905a1b2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:10.138449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ed5457b13543f58faa42ef2905a1b2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:10.146974 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3444/6856] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:09 2022] DELETE /identity/v3/users/33ed5457b13543f58faa42ef2905a1b2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:10.151805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f7741-3ba4-4d81-b821-8bfeb3ae8617 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:10.152148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f7741-3ba4-4d81-b821-8bfeb3ae8617 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:10.152546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f7741-3ba4-4d81-b821-8bfeb3ae8617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:10.213452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-016f7741-3ba4-4d81-b821-8bfeb3ae8617 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:10.215411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-016f7741-3ba4-4d81-b821-8bfeb3ae8617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:10.334758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:10.337914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:10.382258 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3413/6857] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:46:10.395136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:10.432117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f7741-3ba4-4d81-b821-8bfeb3ae8617 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:10.439170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-016f7741-3ba4-4d81-b821-8bfeb3ae8617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:10.468459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b8373-1d02-48c3-b050-68f8884ba07d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:10.482964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc745a5-024f-4a83-8c4d-66abb18b9f83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:10.483690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc745a5-024f-4a83-8c4d-66abb18b9f83 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:10.483968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc745a5-024f-4a83-8c4d-66abb18b9f83 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:10.484234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc745a5-024f-4a83-8c4d-66abb18b9f83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:10.487379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dbc745a5-024f-4a83-8c4d-66abb18b9f83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:10.579113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f7741-3ba4-4d81-b821-8bfeb3ae8617 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:10.595090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab0b22-98e4-4b13-bc3a-edb0ebc1ce71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:10.597528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0b22-98e4-4b13-bc3a-edb0ebc1ce71 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:10.597911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0b22-98e4-4b13-bc3a-edb0ebc1ce71 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:10.601952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0b22-98e4-4b13-bc3a-edb0ebc1ce71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:10.633969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab0b22-98e4-4b13-bc3a-edb0ebc1ce71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:10.634583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc745a5-024f-4a83-8c4d-66abb18b9f83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:10.637051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc745a5-024f-4a83-8c4d-66abb18b9f83 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:10.645143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab0b22-98e4-4b13-bc3a-edb0ebc1ce71 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:10.670736 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3445/6858] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:46:10.710469 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3414/6859] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:46:12.339500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc745a5-024f-4a83-8c4d-66abb18b9f83 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:12.341032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dbc745a5-024f-4a83-8c4d-66abb18b9f83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:12.376560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc745a5-024f-4a83-8c4d-66abb18b9f83 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:12.392519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:12.393230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:12.393601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:12.393894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] PATH_INFO: `/v3/users/df3b62fc26dd492487c1b9909248c5a4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:12.400398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3b62fc26dd492487c1b9909248c5a4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:12.402395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:12.544955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3b62fc26dd492487c1b9909248c5a4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:12.547808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3b62fc26dd492487c1b9909248c5a4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:12.564603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3b62fc26dd492487c1b9909248c5a4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:12.589064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3b62fc26dd492487c1b9909248c5a4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:12.613210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3b62fc26dd492487c1b9909248c5a4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:12.629627 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3446/6860] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:12 2022] DELETE /identity/v3/users/df3b62fc26dd492487c1b9909248c5a4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:12.644115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b012cf-e3eb-449c-a4a5-2ad325cd9a4e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:12.644664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b012cf-e3eb-449c-a4a5-2ad325cd9a4e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:12.644816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b012cf-e3eb-449c-a4a5-2ad325cd9a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:12.717955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f1b012cf-e3eb-449c-a4a5-2ad325cd9a4e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:12.722087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f1b012cf-e3eb-449c-a4a5-2ad325cd9a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:12.886262 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3415/6861] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:12.950977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:12.952712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:12.967475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b012cf-e3eb-449c-a4a5-2ad325cd9a4e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:12.969250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f1b012cf-e3eb-449c-a4a5-2ad325cd9a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:12.988374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b012cf-e3eb-449c-a4a5-2ad325cd9a4e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:13.006448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:13.007250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:13.007996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:13.010002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] PATH_INFO: `/v3/projects/2fbaaade62094415a1615bc199e2d5ab` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:13.011552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbaaade62094415a1615bc199e2d5ab)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:13.013622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:13.016845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:13.068542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:13.111978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0ec08-e8bf-44cd-98b6-ac67a7b5c641 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:13.112897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbaaade62094415a1615bc199e2d5ab', 'request_id': 'req-17354509-a7f2-40a2-beca-6bf7078c146b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:13.134623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbaaade62094415a1615bc199e2d5ab', 'request_id': 'req-17354509-a7f2-40a2-beca-6bf7078c146b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:13.158666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbaaade62094415a1615bc199e2d5ab', 'request_id': 'req-17354509-a7f2-40a2-beca-6bf7078c146b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:13.171678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] The token cache is being invalidate because project 2fbaaade62094415a1615bc199e2d5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:13.172150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:13.174040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:13.177546 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3416/6862] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:12 2022] DELETE /identity/v3/projects/2fbaaade62094415a1615bc199e2d5ab => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:13.179364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:13.185306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:13.276301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6f6f0-09c4-47dc-8e0d-230b032d14f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:13.276998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6f6f0-09c4-47dc-8e0d-230b032d14f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:13.277273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6f6f0-09c4-47dc-8e0d-230b032d14f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:13.277538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6f6f0-09c4-47dc-8e0d-230b032d14f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:13.285820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c3e6f6f0-09c4-47dc-8e0d-230b032d14f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:13.421710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17354509-a7f2-40a2-beca-6bf7078c146b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:13.441273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:13.442272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:13.442807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:13.443192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] PATH_INFO: `/v3/projects/995bf67979634abd9f72835141f73c71` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:13.446049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=995bf67979634abd9f72835141f73c71)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:13.448138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:13.473608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6f6f0-09c4-47dc-8e0d-230b032d14f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:13.489287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6f6f0-09c4-47dc-8e0d-230b032d14f9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:13.537843 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3447/6863] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:13.540089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe327a-040d-4fe9-8b97-0495597ef7ff None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:13.551102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe327a-040d-4fe9-8b97-0495597ef7ff None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:13.551412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe327a-040d-4fe9-8b97-0495597ef7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:13.583991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995bf67979634abd9f72835141f73c71', 'request_id': 'req-7557ef41-3ae0-4fc1-864c-f40825249cba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:13.613572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995bf67979634abd9f72835141f73c71', 'request_id': 'req-7557ef41-3ae0-4fc1-864c-f40825249cba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:13.626327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ebbe327a-040d-4fe9-8b97-0495597ef7ff None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:13.627185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995bf67979634abd9f72835141f73c71', 'request_id': 'req-7557ef41-3ae0-4fc1-864c-f40825249cba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:13.631042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ebbe327a-040d-4fe9-8b97-0495597ef7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:13.669258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] The token cache is being invalidate because project 995bf67979634abd9f72835141f73c71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:13.669773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:13.672161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:13.680588 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3417/6864] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:13 2022] DELETE /identity/v3/projects/995bf67979634abd9f72835141f73c71 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:13.684424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:13.689595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:13.755742 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3448/6865] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:13.764921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf279c8-48f5-411a-9ffd-9734ea3e2cac None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:13.765203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf279c8-48f5-411a-9ffd-9734ea3e2cac None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:13.765469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf279c8-48f5-411a-9ffd-9734ea3e2cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:13.780947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:13.809204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bdf279c8-48f5-411a-9ffd-9734ea3e2cac None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:13.811245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bdf279c8-48f5-411a-9ffd-9734ea3e2cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:13.822812 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3449/6866] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:13.826795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf279c8-48f5-411a-9ffd-9734ea3e2cac None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:13.837598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf279c8-48f5-411a-9ffd-9734ea3e2cac None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:13.844238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dfdfd-2007-46ff-9ba8-6d3af4dc0430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:13.844964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dfdfd-2007-46ff-9ba8-6d3af4dc0430 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:13.845304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dfdfd-2007-46ff-9ba8-6d3af4dc0430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:13.845636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9dfdfd-2007-46ff-9ba8-6d3af4dc0430 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:13.846796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dfdfd-2007-46ff-9ba8-6d3af4dc0430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:13.847165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dfdfd-2007-46ff-9ba8-6d3af4dc0430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:13.849415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9dfdfd-2007-46ff-9ba8-6d3af4dc0430 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:13.869953 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3450/6867] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:13.871921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dfdfd-2007-46ff-9ba8-6d3af4dc0430 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:13.890314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9dfdfd-2007-46ff-9ba8-6d3af4dc0430 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:13.912829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30127ab2-ec0d-4738-87d1-1ad1273af0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:13.913393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127ab2-ec0d-4738-87d1-1ad1273af0ea admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:13.913671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127ab2-ec0d-4738-87d1-1ad1273af0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:13.913968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30127ab2-ec0d-4738-87d1-1ad1273af0ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:13.914614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30127ab2-ec0d-4738-87d1-1ad1273af0ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:13.922766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30127ab2-ec0d-4738-87d1-1ad1273af0ea admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:13.924765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557ef41-3ae0-4fc1-864c-f40825249cba admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:13.949514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:13.950216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:13.950498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:13.950771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] PATH_INFO: `/v3/users/e7724cb9d55b4f8eb2618b2b88279915` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:13.951935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7724cb9d55b4f8eb2618b2b88279915)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:13.953931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:13.986516 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3451/6868] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:13 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:13.988565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30127ab2-ec0d-4738-87d1-1ad1273af0ea admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:14.009657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:14.066405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7724cb9d55b4f8eb2618b2b88279915'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:14.084864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7724cb9d55b4f8eb2618b2b88279915'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:14.109676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7724cb9d55b4f8eb2618b2b88279915'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:14.131450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7724cb9d55b4f8eb2618b2b88279915'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:14.132534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7724cb9d55b4f8eb2618b2b88279915'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:14.150535 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3418/6869] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:13 2022] DELETE /identity/v3/users/e7724cb9d55b4f8eb2618b2b88279915 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:14.153933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30127ab2-ec0d-4738-87d1-1ad1273af0ea admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:14.315348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0897034-a3bd-464a-ae53-d69eaf713e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:14.316089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0897034-a3bd-464a-ae53-d69eaf713e30 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:14.316427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0897034-a3bd-464a-ae53-d69eaf713e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:14.316699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0897034-a3bd-464a-ae53-d69eaf713e30 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:14.317345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0897034-a3bd-464a-ae53-d69eaf713e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:14.327404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0897034-a3bd-464a-ae53-d69eaf713e30 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:14.405500 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3452/6870] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:13 2022] POST /identity/v3/users => generated 283 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:14.407359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:14.409731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:14.462170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889595-90fb-4ff5-948c-df4e95315eb8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:14.484870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f63202-d96a-4524-a395-bf57759a5f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:14.486123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63202-d96a-4524-a395-bf57759a5f08 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:14.486637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63202-d96a-4524-a395-bf57759a5f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:14.487652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f63202-d96a-4524-a395-bf57759a5f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:14.488849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f63202-d96a-4524-a395-bf57759a5f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:14.497245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f63202-d96a-4524-a395-bf57759a5f08 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:14.564488 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3419/6871] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:14.565896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0897034-a3bd-464a-ae53-d69eaf713e30 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:14.584343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0897034-a3bd-464a-ae53-d69eaf713e30 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:14.604143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bed3e-7b1e-47d6-94ec-58373858bd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:14.605042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bed3e-7b1e-47d6-94ec-58373858bd7e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:14.605321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bed3e-7b1e-47d6-94ec-58373858bd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:14.605596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bed3e-7b1e-47d6-94ec-58373858bd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:14.609077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bed3e-7b1e-47d6-94ec-58373858bd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:14.610801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bed3e-7b1e-47d6-94ec-58373858bd7e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:14.637513 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3453/6872] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:14.641598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f63202-d96a-4524-a395-bf57759a5f08 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:14.666904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f63202-d96a-4524-a395-bf57759a5f08 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:14.680208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e791-cc7f-48b7-b96e-7458610abfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:14.681954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e791-cc7f-48b7-b96e-7458610abfb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:14.683176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e791-cc7f-48b7-b96e-7458610abfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:14.683787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e791-cc7f-48b7-b96e-7458610abfb5 admin admin] PATH_INFO: `/v3/projects/7a4af66c38794da7bb73cbc900e8876a/users/fd2b91ecd6294093a7b8e3813621a5e0/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:14.784255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073e791-cc7f-48b7-b96e-7458610abfb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4af66c38794da7bb73cbc900e8876a, user_id=fd2b91ecd6294093a7b8e3813621a5e0, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:14.818053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073e791-cc7f-48b7-b96e-7458610abfb5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:14.868830 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3420/6873] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:14 2022] PUT /identity/v3/projects/7a4af66c38794da7bb73cbc900e8876a/users/fd2b91ecd6294093a7b8e3813621a5e0/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:14.870883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a19c-e2b2-4baa-ab7b-0ecc5b02c4cd None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:14.871248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a19c-e2b2-4baa-ab7b-0ecc5b02c4cd None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:14.871439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302a19c-e2b2-4baa-ab7b-0ecc5b02c4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:14.932152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7302a19c-e2b2-4baa-ab7b-0ecc5b02c4cd None None] MFA Rules not processed for user `fd2b91ecd6294093a7b8e3813621a5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:14.933426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7302a19c-e2b2-4baa-ab7b-0ecc5b02c4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:15.102197 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3454/6874] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:15.112971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e791-cc7f-48b7-b96e-7458610abfb5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:15.263698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e791-cc7f-48b7-b96e-7458610abfb5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:15.276857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760885a-bb70-491d-9ab4-3a7c97bf55b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:15.277551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760885a-bb70-491d-9ab4-3a7c97bf55b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:15.277912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760885a-bb70-491d-9ab4-3a7c97bf55b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:15.278220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760885a-bb70-491d-9ab4-3a7c97bf55b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:15.279668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760885a-bb70-491d-9ab4-3a7c97bf55b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:15.282012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760885a-bb70-491d-9ab4-3a7c97bf55b8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:15.297198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302a19c-e2b2-4baa-ab7b-0ecc5b02c4cd None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:15.298898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7302a19c-e2b2-4baa-ab7b-0ecc5b02c4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:15.301229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:15.332134 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3421/6875] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:15 2022] POST /identity/v3/projects => generated 363 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:15.333335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760885a-bb70-491d-9ab4-3a7c97bf55b8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:15.334699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302a19c-e2b2-4baa-ab7b-0ecc5b02c4cd None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:15.387856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:15.490445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760885a-bb70-491d-9ab4-3a7c97bf55b8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:15.491466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:15.492167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:15.492488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:15.492758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] PATH_INFO: `/v3/projects/61b27759a50b464db6d50b54e8585b2c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:15.507003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b27759a50b464db6d50b54e8585b2c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:15.508731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3df40-9e0b-4cac-9027-c39239371e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:15.509385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3df40-9e0b-4cac-9027-c39239371e62 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:15.509667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3df40-9e0b-4cac-9027-c39239371e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:15.509964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3df40-9e0b-4cac-9027-c39239371e62 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:15.510696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3df40-9e0b-4cac-9027-c39239371e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:15.512734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3df40-9e0b-4cac-9027-c39239371e62 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:15.514638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:15.557677 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3422/6876] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:15 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:15.561300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3df40-9e0b-4cac-9027-c39239371e62 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:15.565280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-74b3df40-9e0b-4cac-9027-c39239371e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:15.607542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3df40-9e0b-4cac-9027-c39239371e62 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:15.619363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b27759a50b464db6d50b54e8585b2c', 'request_id': 'req-dc760e10-4837-4a2e-8bd6-838c0dbece37'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:15.635440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b27759a50b464db6d50b54e8585b2c', 'request_id': 'req-dc760e10-4837-4a2e-8bd6-838c0dbece37'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:15.660247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b27759a50b464db6d50b54e8585b2c', 'request_id': 'req-dc760e10-4837-4a2e-8bd6-838c0dbece37'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:15.679720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] The token cache is being invalidate because project 61b27759a50b464db6d50b54e8585b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:15.681791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:15.684447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:15.691366 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3455/6877] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:15 2022] DELETE /identity/v3/projects/61b27759a50b464db6d50b54e8585b2c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:15.692945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:15.695478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:15.789163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:15.792046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:15.792377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:15.792696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] PATH_INFO: `/v3/users/105c266b331a44678788118ed9bc7bd8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:15.796963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] RBAC: Authorizing `identity:delete_user(user_id=105c266b331a44678788118ed9bc7bd8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:15.803616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:15.975930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc760e10-4837-4a2e-8bd6-838c0dbece37 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:15.997414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a621fc0-152a-4bab-927b-47c02c61580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:15.998877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105c266b331a44678788118ed9bc7bd8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.000922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a621fc0-152a-4bab-927b-47c02c61580a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:16.001252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a621fc0-152a-4bab-927b-47c02c61580a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:16.002432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a621fc0-152a-4bab-927b-47c02c61580a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:16.007947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a621fc0-152a-4bab-927b-47c02c61580a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:16.019634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a621fc0-152a-4bab-927b-47c02c61580a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:16.042543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105c266b331a44678788118ed9bc7bd8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.072830 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3456/6878] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:16.074983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a621fc0-152a-4bab-927b-47c02c61580a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:16.082608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3a621fc0-152a-4bab-927b-47c02c61580a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:16.097665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105c266b331a44678788118ed9bc7bd8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.120571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a621fc0-152a-4bab-927b-47c02c61580a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:16.130974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105c266b331a44678788118ed9bc7bd8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.131629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105c266b331a44678788118ed9bc7bd8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.134560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:16.145103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:16.145669 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3423/6879] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:15 2022] DELETE /identity/v3/users/105c266b331a44678788118ed9bc7bd8 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:16.149737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:16.153802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:16.154113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:16.154387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] PATH_INFO: `/v3/users/5e53b43844be4904b2c1df0626e2cebf` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:16.154863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:16.172391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e53b43844be4904b2c1df0626e2cebf)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:16.176049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:16.295477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:16.300745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e53b43844be4904b2c1df0626e2cebf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.304081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e53b43844be4904b2c1df0626e2cebf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.325306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e53b43844be4904b2c1df0626e2cebf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.335691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e53b43844be4904b2c1df0626e2cebf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.356029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52520352-ed46-41f6-8708-dc8ba337564f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:16.359198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e53b43844be4904b2c1df0626e2cebf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.367450 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3457/6880] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:16 2022] DELETE /identity/v3/users/5e53b43844be4904b2c1df0626e2cebf => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:16.368647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:16.371362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:16.372003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:16.372284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:16.372561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] PATH_INFO: `/v3/projects/6d8b2d156fb94b78bc8c37f1a49a2aa7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:16.379365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d8b2d156fb94b78bc8c37f1a49a2aa7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:16.382596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:16.385470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:16.533162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d8b2d156fb94b78bc8c37f1a49a2aa7', 'request_id': 'req-e75fcbe5-a91a-473f-ac81-357ff9f96326'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.553999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d8b2d156fb94b78bc8c37f1a49a2aa7', 'request_id': 'req-e75fcbe5-a91a-473f-ac81-357ff9f96326'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.566428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf104-37e8-406c-9b98-40aceb6e3244 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:16.567169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d8b2d156fb94b78bc8c37f1a49a2aa7', 'request_id': 'req-e75fcbe5-a91a-473f-ac81-357ff9f96326'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.597078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] The token cache is being invalidate because project 6d8b2d156fb94b78bc8c37f1a49a2aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:16.599937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.602560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e75fcbe5-a91a-473f-ac81-357ff9f96326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.616985 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3424/6881] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:16 2022] DELETE /identity/v3/projects/6d8b2d156fb94b78bc8c37f1a49a2aa7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:16.620695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c8550-16a3-42f3-b767-1d803d986e07 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:16.621101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c8550-16a3-42f3-b767-1d803d986e07 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:16.621448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c8550-16a3-42f3-b767-1d803d986e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:16.662272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d37c8550-16a3-42f3-b767-1d803d986e07 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:16.663776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d37c8550-16a3-42f3-b767-1d803d986e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:16.754798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d59155-6938-4422-a78d-16588703d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:16.756533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d59155-6938-4422-a78d-16588703d053 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:16.758775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d59155-6938-4422-a78d-16588703d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:16.759843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d59155-6938-4422-a78d-16588703d053 admin admin] PATH_INFO: `/v3/projects/8b3500f994ee47bb83a6902adc26e100/users/11d9a3010edc437bab812d99b7a7bfdd/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:16.766035 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3425/6882] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:16.778257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c8550-16a3-42f3-b767-1d803d986e07 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:16.780854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d37c8550-16a3-42f3-b767-1d803d986e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:16.796408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c8550-16a3-42f3-b767-1d803d986e07 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:16.800491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d59155-6938-4422-a78d-16588703d053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3500f994ee47bb83a6902adc26e100, user_id=11d9a3010edc437bab812d99b7a7bfdd, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:16.806553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d59155-6938-4422-a78d-16588703d053 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:16.807379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:16.808195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:16.810917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:16.811293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] PATH_INFO: `/v3/users/1c6f29e81f364d2fa5d10c37ed2b6544` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:16.812706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c6f29e81f364d2fa5d10c37ed2b6544)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:16.814976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:16.842454 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3458/6883] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:16 2022] PUT /identity/v3/projects/8b3500f994ee47bb83a6902adc26e100/users/11d9a3010edc437bab812d99b7a7bfdd/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:16.843807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb3e53-de77-4561-99f4-b1d34e2f6e1b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:16.844087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb3e53-de77-4561-99f4-b1d34e2f6e1b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:16.844356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb3e53-de77-4561-99f4-b1d34e2f6e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:16.856563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:16.911975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-21bb3e53-de77-4561-99f4-b1d34e2f6e1b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:16.913394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-21bb3e53-de77-4561-99f4-b1d34e2f6e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:16.919453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c6f29e81f364d2fa5d10c37ed2b6544'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.941124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c6f29e81f364d2fa5d10c37ed2b6544'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.976712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c6f29e81f364d2fa5d10c37ed2b6544'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.997650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c6f29e81f364d2fa5d10c37ed2b6544'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:16.998306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c6f29e81f364d2fa5d10c37ed2b6544'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:17.009450 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3426/6884] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:16 2022] DELETE /identity/v3/users/1c6f29e81f364d2fa5d10c37ed2b6544 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:17.009450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:17.018412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:17.133604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:17.179642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab25731-6665-4248-9bcd-1f75d10b2dd7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:17.191751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3afcb-442a-490e-9c09-960dd019d7e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:17.194195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3afcb-442a-490e-9c09-960dd019d7e4 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:17.194447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3afcb-442a-490e-9c09-960dd019d7e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:17.194770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3afcb-442a-490e-9c09-960dd019d7e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:17.198562 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3459/6885] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:17.205830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb3e53-de77-4561-99f4-b1d34e2f6e1b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:17.205959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-74c3afcb-442a-490e-9c09-960dd019d7e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:17.213862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-21bb3e53-de77-4561-99f4-b1d34e2f6e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:17.269486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb3e53-de77-4561-99f4-b1d34e2f6e1b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:17.377646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3afcb-442a-490e-9c09-960dd019d7e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:17.379658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3afcb-442a-490e-9c09-960dd019d7e4 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:17.397982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb31b-2a9a-4a1d-b06a-dfd3b8e83f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:17.398618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb31b-2a9a-4a1d-b06a-dfd3b8e83f95 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:17.398899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb31b-2a9a-4a1d-b06a-dfd3b8e83f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:17.399170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18adb31b-2a9a-4a1d-b06a-dfd3b8e83f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:17.399827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adb31b-2a9a-4a1d-b06a-dfd3b8e83f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:17.401581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18adb31b-2a9a-4a1d-b06a-dfd3b8e83f95 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:17.406141 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3427/6886] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:17.410264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479938-f683-40b8-b86d-9a56c688e08a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:17.422224 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3460/6887] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:17.423200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb31b-2a9a-4a1d-b06a-dfd3b8e83f95 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:17.427709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479938-f683-40b8-b86d-9a56c688e08a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:17.429038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-18adb31b-2a9a-4a1d-b06a-dfd3b8e83f95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:17.433718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f479938-f683-40b8-b86d-9a56c688e08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:17.455839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18adb31b-2a9a-4a1d-b06a-dfd3b8e83f95 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:17.472341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:17.473030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:17.473301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:17.473578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] PATH_INFO: `/v3/projects/ec9c0a2ecf9a4915a60aaf0c0fc7d5bb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:17.474891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9c0a2ecf9a4915a60aaf0c0fc7d5bb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:17.476846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:17.506199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2f479938-f683-40b8-b86d-9a56c688e08a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:17.512202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2f479938-f683-40b8-b86d-9a56c688e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:17.541097 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3428/6888] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:17.542684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5ee1-279c-41b8-8119-06abb5d503ef None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:17.544221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5ee1-279c-41b8-8119-06abb5d503ef None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:17.545863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f5ee1-279c-41b8-8119-06abb5d503ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:17.601651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-816f5ee1-279c-41b8-8119-06abb5d503ef None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:17.603259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-816f5ee1-279c-41b8-8119-06abb5d503ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:17.643824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9c0a2ecf9a4915a60aaf0c0fc7d5bb', 'request_id': 'req-433327bf-2226-4294-98c8-1310df46a25a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:17.668491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9c0a2ecf9a4915a60aaf0c0fc7d5bb', 'request_id': 'req-433327bf-2226-4294-98c8-1310df46a25a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:17.693938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9c0a2ecf9a4915a60aaf0c0fc7d5bb', 'request_id': 'req-433327bf-2226-4294-98c8-1310df46a25a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:17.729991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] The token cache is being invalidate because project ec9c0a2ecf9a4915a60aaf0c0fc7d5bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:17.730281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:17.731991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:17.734923 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3461/6889] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:17 2022] DELETE /identity/v3/projects/ec9c0a2ecf9a4915a60aaf0c0fc7d5bb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:17.746412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:17.747952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:17.750963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:17.818548 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3429/6890] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:17.819451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5ee1-279c-41b8-8119-06abb5d503ef None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:17.823967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-816f5ee1-279c-41b8-8119-06abb5d503ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:17.962938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433327bf-2226-4294-98c8-1310df46a25a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:17.974945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b918dff-f385-4856-8517-7c6cae6bec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:17.975655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918dff-f385-4856-8517-7c6cae6bec09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:17.975949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918dff-f385-4856-8517-7c6cae6bec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:17.976183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b918dff-f385-4856-8517-7c6cae6bec09 admin admin] PATH_INFO: `/v3/projects/8b3500f994ee47bb83a6902adc26e100/users/11d9a3010edc437bab812d99b7a7bfdd/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:17.984517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b918dff-f385-4856-8517-7c6cae6bec09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b3500f994ee47bb83a6902adc26e100, user_id=11d9a3010edc437bab812d99b7a7bfdd, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:17.989399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b918dff-f385-4856-8517-7c6cae6bec09 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:18.030358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f5ee1-279c-41b8-8119-06abb5d503ef None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:18.033916 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3462/6891] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:17 2022] PUT /identity/v3/projects/8b3500f994ee47bb83a6902adc26e100/users/11d9a3010edc437bab812d99b7a7bfdd/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:18.035945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889e694-9436-4b6b-bb7e-04702dcf5aec None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:18.037664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889e694-9436-4b6b-bb7e-04702dcf5aec None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:18.037969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889e694-9436-4b6b-bb7e-04702dcf5aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:18.140815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:18.171118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b889e694-9436-4b6b-bb7e-04702dcf5aec None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:18.173963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b889e694-9436-4b6b-bb7e-04702dcf5aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:18.198560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920bab5-179f-4de3-ba83-f0d9f13d8cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:18.199195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bab5-179f-4de3-ba83-f0d9f13d8cab service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:18.199476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bab5-179f-4de3-ba83-f0d9f13d8cab service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:18.199749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bab5-179f-4de3-ba83-f0d9f13d8cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:18.203985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9920bab5-179f-4de3-ba83-f0d9f13d8cab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:18.368494 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3463/6892] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:18.369822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889e694-9436-4b6b-bb7e-04702dcf5aec None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:18.381664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920bab5-179f-4de3-ba83-f0d9f13d8cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:18.383211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920bab5-179f-4de3-ba83-f0d9f13d8cab service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:18.383516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889e694-9436-4b6b-bb7e-04702dcf5aec None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:18.389098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa00d0-ca19-478b-bf53-d4df8d2ebe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:18.390522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa00d0-ca19-478b-bf53-d4df8d2ebe96 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:18.390968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa00d0-ca19-478b-bf53-d4df8d2ebe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:18.391330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa00d0-ca19-478b-bf53-d4df8d2ebe96 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:18.392000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa00d0-ca19-478b-bf53-d4df8d2ebe96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:18.392349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa00d0-ca19-478b-bf53-d4df8d2ebe96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:18.394237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa00d0-ca19-478b-bf53-d4df8d2ebe96 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:18.414462 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3464/6893] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:18.417299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd81017-aa1c-4ebe-a912-2d86c61d2b49 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:18.418483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd81017-aa1c-4ebe-a912-2d86c61d2b49 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:18.418920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd81017-aa1c-4ebe-a912-2d86c61d2b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:18.428251 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3430/6894] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:18.429782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467d92-1882-4415-a229-98eb3b302979 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:18.431597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467d92-1882-4415-a229-98eb3b302979 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:18.433444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df467d92-1882-4415-a229-98eb3b302979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:18.505711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-df467d92-1882-4415-a229-98eb3b302979 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:18.506092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4bd81017-aa1c-4ebe-a912-2d86c61d2b49 None None] MFA Rules not processed for user `11d9a3010edc437bab812d99b7a7bfdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:18.507330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-df467d92-1882-4415-a229-98eb3b302979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:18.510463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4bd81017-aa1c-4ebe-a912-2d86c61d2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:18.536757 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3431/6895] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:18.537735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df467d92-1882-4415-a229-98eb3b302979 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:18.567974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df467d92-1882-4415-a229-98eb3b302979 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:18.581528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a100d94-9685-4b4d-92b2-2042218ab6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:18.581813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a100d94-9685-4b4d-92b2-2042218ab6fd admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:18.582155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a100d94-9685-4b4d-92b2-2042218ab6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:18.582494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a100d94-9685-4b4d-92b2-2042218ab6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:18.583213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a100d94-9685-4b4d-92b2-2042218ab6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:18.585598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a100d94-9685-4b4d-92b2-2042218ab6fd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:18.684973 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3465/6896] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:18.685847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd81017-aa1c-4ebe-a912-2d86c61d2b49 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:18.690457 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3432/6897] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:18 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:18.698236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a100d94-9685-4b4d-92b2-2042218ab6fd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:18.723771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd81017-aa1c-4ebe-a912-2d86c61d2b49 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:18.749007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:18.860947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a100d94-9685-4b4d-92b2-2042218ab6fd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:18.871675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd3f94-9033-460c-b066-aa1cbdd8a738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:18.872408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd3f94-9033-460c-b066-aa1cbdd8a738 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:18.872671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd3f94-9033-460c-b066-aa1cbdd8a738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:18.872939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd3f94-9033-460c-b066-aa1cbdd8a738 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:18.873584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd3f94-9033-460c-b066-aa1cbdd8a738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:18.879874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd3f94-9033-460c-b066-aa1cbdd8a738 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:18.920478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7198cc8-5731-4061-becc-4b7efda3492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:18.921158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198cc8-5731-4061-becc-4b7efda3492a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:18.921473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198cc8-5731-4061-becc-4b7efda3492a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:18.921747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198cc8-5731-4061-becc-4b7efda3492a admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:18.922708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7198cc8-5731-4061-becc-4b7efda3492a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:18.923024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7198cc8-5731-4061-becc-4b7efda3492a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:18.928465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7198cc8-5731-4061-becc-4b7efda3492a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:18.933704 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3433/6898] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:18 2022] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:46:18.934727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd3f94-9033-460c-b066-aa1cbdd8a738 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:18.946043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f1dd3f94-9033-460c-b066-aa1cbdd8a738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:18.979398 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3466/6899] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:18.980164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7198cc8-5731-4061-becc-4b7efda3492a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:18.985659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d7198cc8-5731-4061-becc-4b7efda3492a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:19.037508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7198cc8-5731-4061-becc-4b7efda3492a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:19.044184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:19.044879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:19.045159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:19.045430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] PATH_INFO: `/v3/projects/184ceadf06eb419599196d1fc6fcdb93` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:19.046888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184ceadf06eb419599196d1fc6fcdb93)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:19.049413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:19.067745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:19.080499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd3f94-9033-460c-b066-aa1cbdd8a738 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:19.094520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92e52-85a7-400a-b5a6-479ea6372f87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:19.095546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92e52-85a7-400a-b5a6-479ea6372f87 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:19.096086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92e52-85a7-400a-b5a6-479ea6372f87 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:19.096583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92e52-85a7-400a-b5a6-479ea6372f87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:19.159964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184ceadf06eb419599196d1fc6fcdb93', 'request_id': 'req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.179551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184ceadf06eb419599196d1fc6fcdb93', 'request_id': 'req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.193445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184ceadf06eb419599196d1fc6fcdb93', 'request_id': 'req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.204871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd92e52-85a7-400a-b5a6-479ea6372f87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:19.207946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd92e52-85a7-400a-b5a6-479ea6372f87 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:19.221280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] The token cache is being invalidate because project 184ceadf06eb419599196d1fc6fcdb93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:19.221549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.222282 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3434/6900] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:19.224407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92e52-85a7-400a-b5a6-479ea6372f87 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:19.233501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.236055 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3467/6901] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:18 2022] DELETE /identity/v3/projects/184ceadf06eb419599196d1fc6fcdb93 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:19.239435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92e52-85a7-400a-b5a6-479ea6372f87 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:19.239947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:19.242094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:19.386464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6abd3-dffb-4b05-9990-0675c64f8e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:19.387120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6abd3-dffb-4b05-9990-0675c64f8e77 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:19.390682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6abd3-dffb-4b05-9990-0675c64f8e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:19.390682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6abd3-dffb-4b05-9990-0675c64f8e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:19.394418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6abd3-dffb-4b05-9990-0675c64f8e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:19.399190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6abd3-dffb-4b05-9990-0675c64f8e77 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:19.412329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:19.417157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc22ba1-f92b-4e14-ad78-3b427bbf7eb7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:19.426226 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3435/6902] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:19.426999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6abd3-dffb-4b05-9990-0675c64f8e77 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:19.429696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:19.430394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:19.430828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:19.431243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] PATH_INFO: `/v3/projects/524eed44a60c41fd8f1fd7f3cfa0cda3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:19.432861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524eed44a60c41fd8f1fd7f3cfa0cda3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:19.433862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dcb6abd3-dffb-4b05-9990-0675c64f8e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:19.437433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:19.467861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6abd3-dffb-4b05-9990-0675c64f8e77 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:19.492734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51829a4a-70ac-46cd-9048-540d267479a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:19.493774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51829a4a-70ac-46cd-9048-540d267479a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:19.493774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51829a4a-70ac-46cd-9048-540d267479a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:19.494120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51829a4a-70ac-46cd-9048-540d267479a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:19.494565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51829a4a-70ac-46cd-9048-540d267479a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:19.500348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51829a4a-70ac-46cd-9048-540d267479a4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:19.546613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524eed44a60c41fd8f1fd7f3cfa0cda3', 'request_id': 'req-d91c56eb-9157-4fcb-96b5-1d8771af0a80'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.562850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524eed44a60c41fd8f1fd7f3cfa0cda3', 'request_id': 'req-d91c56eb-9157-4fcb-96b5-1d8771af0a80'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.583453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524eed44a60c41fd8f1fd7f3cfa0cda3', 'request_id': 'req-d91c56eb-9157-4fcb-96b5-1d8771af0a80'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.602622 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3436/6903] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:19 2022] POST /identity/v3/projects => generated 389 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:19.603512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51829a4a-70ac-46cd-9048-540d267479a4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:19.606654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] The token cache is being invalidate because project 524eed44a60c41fd8f1fd7f3cfa0cda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:19.606878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.610544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.616329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-51829a4a-70ac-46cd-9048-540d267479a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:19.616467 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3468/6904] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:19 2022] DELETE /identity/v3/projects/524eed44a60c41fd8f1fd7f3cfa0cda3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:19.616467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:19.616615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:19.730347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:19.780595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51829a4a-70ac-46cd-9048-540d267479a4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:19.794076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:19.794889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:19.795266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:19.795634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] PATH_INFO: `/v3/users/0e2d7d5ddc10455fa73b3424e0c2c3a3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:19.797645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2d7d5ddc10455fa73b3424e0c2c3a3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:19.803330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:19.823317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c56eb-9157-4fcb-96b5-1d8771af0a80 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:19.920744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2d7d5ddc10455fa73b3424e0c2c3a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.938353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2d7d5ddc10455fa73b3424e0c2c3a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.938510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71964d1-c2d7-4a43-8b83-7a9f8275fc51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:19.939137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71964d1-c2d7-4a43-8b83-7a9f8275fc51 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:19.939411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71964d1-c2d7-4a43-8b83-7a9f8275fc51 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:19.939713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71964d1-c2d7-4a43-8b83-7a9f8275fc51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:19.942538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f71964d1-c2d7-4a43-8b83-7a9f8275fc51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:19.971732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2d7d5ddc10455fa73b3424e0c2c3a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:19.999440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2d7d5ddc10455fa73b3424e0c2c3a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:20.000491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2d7d5ddc10455fa73b3424e0c2c3a3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:20.009556 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3437/6905] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:19 2022] DELETE /identity/v3/users/0e2d7d5ddc10455fa73b3424e0c2c3a3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:20.026571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:20.032303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:20.117806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71964d1-c2d7-4a43-8b83-7a9f8275fc51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:20.119729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71964d1-c2d7-4a43-8b83-7a9f8275fc51 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:20.134470 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3469/6906] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:20.135679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71964d1-c2d7-4a43-8b83-7a9f8275fc51 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:20.137885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f71964d1-c2d7-4a43-8b83-7a9f8275fc51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:20.179724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71964d1-c2d7-4a43-8b83-7a9f8275fc51 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:20.238172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:20.265571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff5dd0-35bf-474c-b172-b5c5cc36be12 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:20.277961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38579-ce20-4b20-ac15-e9111c646a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:20.278743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38579-ce20-4b20-ac15-e9111c646a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:20.280338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38579-ce20-4b20-ac15-e9111c646a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:20.280676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38579-ce20-4b20-ac15-e9111c646a4d admin admin] PATH_INFO: `/v3/projects/4dec2b3f836c447da00c61b2c5d5022c/users/545c01ea4954407389413a4f6925d8ee/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:20.323274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a38579-ce20-4b20-ac15-e9111c646a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dec2b3f836c447da00c61b2c5d5022c, user_id=545c01ea4954407389413a4f6925d8ee, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:20.326219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6b231-ca23-4113-8b1c-f9fcb67a1915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:20.326863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6b231-ca23-4113-8b1c-f9fcb67a1915 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:20.327148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6b231-ca23-4113-8b1c-f9fcb67a1915 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:20.327418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6b231-ca23-4113-8b1c-f9fcb67a1915 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:20.328075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6b231-ca23-4113-8b1c-f9fcb67a1915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:20.330046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc6b231-ca23-4113-8b1c-f9fcb67a1915 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:20.331390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a38579-ce20-4b20-ac15-e9111c646a4d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:20.358113 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3438/6907] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:20 2022] PUT /identity/v3/projects/4dec2b3f836c447da00c61b2c5d5022c/users/545c01ea4954407389413a4f6925d8ee/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:20.367723 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3470/6908] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:20 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:20.371483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e72a41-d88f-4f02-8e66-afc8256e1620 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:20.371884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6b231-ca23-4113-8b1c-f9fcb67a1915 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:20.373300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e72a41-d88f-4f02-8e66-afc8256e1620 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:20.373952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e72a41-d88f-4f02-8e66-afc8256e1620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:20.416375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc6b231-ca23-4113-8b1c-f9fcb67a1915 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:20.458594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b0e72a41-d88f-4f02-8e66-afc8256e1620 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:20.459863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b0e72a41-d88f-4f02-8e66-afc8256e1620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:20.497861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:20.573128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1746db-a4e6-40d7-bb50-ac48eb4668ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:20.573762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1746db-a4e6-40d7-bb50-ac48eb4668ec admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:20.574084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1746db-a4e6-40d7-bb50-ac48eb4668ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:20.574358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1746db-a4e6-40d7-bb50-ac48eb4668ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:20.575520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1746db-a4e6-40d7-bb50-ac48eb4668ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:20.577414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1746db-a4e6-40d7-bb50-ac48eb4668ec admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:20.599984 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3471/6909] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:20.599984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1746db-a4e6-40d7-bb50-ac48eb4668ec admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:20.600721 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3439/6910] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:20.601781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e72a41-d88f-4f02-8e66-afc8256e1620 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:20.608827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7d1746db-a4e6-40d7-bb50-ac48eb4668ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:20.620003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e72a41-d88f-4f02-8e66-afc8256e1620 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:20.627962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1746db-a4e6-40d7-bb50-ac48eb4668ec admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:20.630894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933012d8-2a39-4081-8f57-9c459a0147b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:20.632443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933012d8-2a39-4081-8f57-9c459a0147b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:20.632443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933012d8-2a39-4081-8f57-9c459a0147b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:20.632443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933012d8-2a39-4081-8f57-9c459a0147b0 admin admin] PATH_INFO: `/v3/projects/4dec2b3f836c447da00c61b2c5d5022c/users/545c01ea4954407389413a4f6925d8ee/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:20.639419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933012d8-2a39-4081-8f57-9c459a0147b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dec2b3f836c447da00c61b2c5d5022c, user_id=545c01ea4954407389413a4f6925d8ee, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:20.648222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389dfa7-c741-46a5-aca0-2400da2d8f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:20.649259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933012d8-2a39-4081-8f57-9c459a0147b0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:20.651085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389dfa7-c741-46a5-aca0-2400da2d8f4d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:20.652213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389dfa7-c741-46a5-aca0-2400da2d8f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:20.653306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389dfa7-c741-46a5-aca0-2400da2d8f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:20.654251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389dfa7-c741-46a5-aca0-2400da2d8f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:20.658230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389dfa7-c741-46a5-aca0-2400da2d8f4d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:20.677952 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3440/6911] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:20 2022] PUT /identity/v3/projects/4dec2b3f836c447da00c61b2c5d5022c/users/545c01ea4954407389413a4f6925d8ee/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:20.684265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19fec9-04f0-4839-86ed-3c78e4f37bd4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:20.684610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19fec9-04f0-4839-86ed-3c78e4f37bd4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:20.684893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19fec9-04f0-4839-86ed-3c78e4f37bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:20.687891 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3472/6912] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:20.688866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389dfa7-c741-46a5-aca0-2400da2d8f4d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:20.693721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3389dfa7-c741-46a5-aca0-2400da2d8f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:20.733904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8f19fec9-04f0-4839-86ed-3c78e4f37bd4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:20.737203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8f19fec9-04f0-4839-86ed-3c78e4f37bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:20.856336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389dfa7-c741-46a5-aca0-2400da2d8f4d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:20.860502 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3441/6913] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:20.860502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19fec9-04f0-4839-86ed-3c78e4f37bd4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:20.862118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8f19fec9-04f0-4839-86ed-3c78e4f37bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:20.900652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19fec9-04f0-4839-86ed-3c78e4f37bd4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:20.908099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:20.909910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:20.910651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:20.911120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] PATH_INFO: `/v3/users/b960937993524b9aa9a50b3f1b9e8235` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:20.913551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b960937993524b9aa9a50b3f1b9e8235)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:20.916085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:20.933552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62826622-3284-4603-b32d-1fd2a86e9a1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:20.934311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62826622-3284-4603-b32d-1fd2a86e9a1e service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:20.934589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62826622-3284-4603-b32d-1fd2a86e9a1e service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:20.934859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62826622-3284-4603-b32d-1fd2a86e9a1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:20.936831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-62826622-3284-4603-b32d-1fd2a86e9a1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:20.951461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62826622-3284-4603-b32d-1fd2a86e9a1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:20.953512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62826622-3284-4603-b32d-1fd2a86e9a1e service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:20.983979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b960937993524b9aa9a50b3f1b9e8235'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:20.984801 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3473/6914] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:20.987662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62826622-3284-4603-b32d-1fd2a86e9a1e service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:20.993213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b960937993524b9aa9a50b3f1b9e8235'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:20.998961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:21.009241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b960937993524b9aa9a50b3f1b9e8235'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.021404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b960937993524b9aa9a50b3f1b9e8235'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.022311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2fe51971-1734-4b12-a297-a7b7f87e8523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b960937993524b9aa9a50b3f1b9e8235'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.027895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62826622-3284-4603-b32d-1fd2a86e9a1e service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:21.032122 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3442/6915] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:20 2022] DELETE /identity/v3/users/b960937993524b9aa9a50b3f1b9e8235 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:21.033941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33a380-0978-481e-895d-c3431e4dcd6f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.034685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc440c-edd8-42cd-b38c-aa1f4ee2bfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:21.034820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33a380-0978-481e-895d-c3431e4dcd6f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.035425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33a380-0978-481e-895d-c3431e4dcd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.035972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc440c-edd8-42cd-b38c-aa1f4ee2bfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.036326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc440c-edd8-42cd-b38c-aa1f4ee2bfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.036662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc440c-edd8-42cd-b38c-aa1f4ee2bfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.037367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc440c-edd8-42cd-b38c-aa1f4ee2bfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:21.039479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc440c-edd8-42cd-b38c-aa1f4ee2bfc6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:21.053552 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3474/6916] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:21.055455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc440c-edd8-42cd-b38c-aa1f4ee2bfc6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:21.057449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-55dc440c-edd8-42cd-b38c-aa1f4ee2bfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.073433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc440c-edd8-42cd-b38c-aa1f4ee2bfc6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:21.080489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6a33a380-0978-481e-895d-c3431e4dcd6f None None] MFA Rules not processed for user `545c01ea4954407389413a4f6925d8ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:21.082430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6a33a380-0978-481e-895d-c3431e4dcd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.101557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:21.145669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:21.146780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.147146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.147501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] PATH_INFO: `/v3/projects/6f28567fbf8d441bbf165437bc271b45` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.149211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f28567fbf8d441bbf165437bc271b45)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:21.151384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:21.202263 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3443/6917] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:21.204113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33a380-0978-481e-895d-c3431e4dcd6f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:21.205661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6a33a380-0978-481e-895d-c3431e4dcd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.222576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33a380-0978-481e-895d-c3431e4dcd6f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:21.242749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f28567fbf8d441bbf165437bc271b45', 'request_id': 'req-3cf102e4-6a03-4f15-a477-a49193ed9cff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.250656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f28567fbf8d441bbf165437bc271b45', 'request_id': 'req-3cf102e4-6a03-4f15-a477-a49193ed9cff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.261070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f28567fbf8d441bbf165437bc271b45', 'request_id': 'req-3cf102e4-6a03-4f15-a477-a49193ed9cff'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.275656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] The token cache is being invalidate because project 6f28567fbf8d441bbf165437bc271b45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:21.276100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.276879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3cf102e4-6a03-4f15-a477-a49193ed9cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.278877 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3475/6918] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:21 2022] DELETE /identity/v3/projects/6f28567fbf8d441bbf165437bc271b45 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:21.280393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d74060-03e5-48c1-bc2e-64131b7c885c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.280752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d74060-03e5-48c1-bc2e-64131b7c885c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.281085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d74060-03e5-48c1-bc2e-64131b7c885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.303857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d0d74060-03e5-48c1-bc2e-64131b7c885c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:21.305336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d0d74060-03e5-48c1-bc2e-64131b7c885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.305532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2e60b-9b32-4f0d-b2e2-0a7eaa41caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:21.306210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2e60b-9b32-4f0d-b2e2-0a7eaa41caac admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.306488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2e60b-9b32-4f0d-b2e2-0a7eaa41caac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.306756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2e60b-9b32-4f0d-b2e2-0a7eaa41caac admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.307413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2e60b-9b32-4f0d-b2e2-0a7eaa41caac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:21.307711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2e60b-9b32-4f0d-b2e2-0a7eaa41caac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:21.309328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2e60b-9b32-4f0d-b2e2-0a7eaa41caac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:21.314726 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3476/6919] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:21.319191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d74060-03e5-48c1-bc2e-64131b7c885c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:21.320894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d0d74060-03e5-48c1-bc2e-64131b7c885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.326104 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3444/6920] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:21.327156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2e60b-9b32-4f0d-b2e2-0a7eaa41caac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:21.328826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ba2e60b-9b32-4f0d-b2e2-0a7eaa41caac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.336299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d74060-03e5-48c1-bc2e-64131b7c885c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:21.343019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfe4c4-9a57-407f-92df-451d6b81e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:21.343188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2e60b-9b32-4f0d-b2e2-0a7eaa41caac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:21.343786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfe4c4-9a57-407f-92df-451d6b81e9bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.344122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfe4c4-9a57-407f-92df-451d6b81e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.344449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfe4c4-9a57-407f-92df-451d6b81e9bf admin admin] PATH_INFO: `/v3/projects/2f321e89fc6548b0be3d5c9ef008e95b/users/2ca94d8c369f450d8465801026d4fc3b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.348577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b366b3-56ce-4785-8589-74fefeac0eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:21.349295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b366b3-56ce-4785-8589-74fefeac0eaa admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.349646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b366b3-56ce-4785-8589-74fefeac0eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.350073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b366b3-56ce-4785-8589-74fefeac0eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.350786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b366b3-56ce-4785-8589-74fefeac0eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:21.352829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b366b3-56ce-4785-8589-74fefeac0eaa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:21.364771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfe4c4-9a57-407f-92df-451d6b81e9bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f321e89fc6548b0be3d5c9ef008e95b, user_id=2ca94d8c369f450d8465801026d4fc3b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:21.368849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfe4c4-9a57-407f-92df-451d6b81e9bf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:21.395351 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3445/6922] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:21 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:21.396186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b366b3-56ce-4785-8589-74fefeac0eaa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:21.399807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e6b366b3-56ce-4785-8589-74fefeac0eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.400956 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3477/6922] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:21 2022] PUT /identity/v3/projects/2f321e89fc6548b0be3d5c9ef008e95b/users/2ca94d8c369f450d8465801026d4fc3b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:21.402178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfe4c4-9a57-407f-92df-451d6b81e9bf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:21.403909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c1bfe4c4-9a57-407f-92df-451d6b81e9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.459344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:21.486708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b366b3-56ce-4785-8589-74fefeac0eaa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:21.492933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:21.493953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.494305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.494712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] PATH_INFO: `/v3/users/9941ecdd4f98492abc14795c028be436` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.495991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9941ecdd4f98492abc14795c028be436)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:21.498050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:21.509763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfe4c4-9a57-407f-92df-451d6b81e9bf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:21.561369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9941ecdd4f98492abc14795c028be436'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.570753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9941ecdd4f98492abc14795c028be436'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.591413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9941ecdd4f98492abc14795c028be436'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.601053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9941ecdd4f98492abc14795c028be436'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.601769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9941ecdd4f98492abc14795c028be436'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:21.609660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:21.640982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b371e06-d3ed-4718-8a08-ef2a7d4cdb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:21.640982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371e06-d3ed-4718-8a08-ef2a7d4cdb57 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.640982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371e06-d3ed-4718-8a08-ef2a7d4cdb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.640982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b371e06-d3ed-4718-8a08-ef2a7d4cdb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.644024 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3446/6923] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:21 2022] DELETE /identity/v3/users/9941ecdd4f98492abc14795c028be436 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:21.644279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7b371e06-d3ed-4718-8a08-ef2a7d4cdb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.646897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:21.650727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.669642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b371e06-d3ed-4718-8a08-ef2a7d4cdb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:21.671191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b371e06-d3ed-4718-8a08-ef2a7d4cdb57 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:21.697116 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3478/6924] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:21.698279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b371e06-d3ed-4718-8a08-ef2a7d4cdb57 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:21.701338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7b371e06-d3ed-4718-8a08-ef2a7d4cdb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:21.720993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b371e06-d3ed-4718-8a08-ef2a7d4cdb57 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:21.779903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca640650-ed53-466a-96c7-7c9e85014737 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:21.791884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce2136-a6f6-43cb-8a8b-12e122819b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:21.792285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce2136-a6f6-43cb-8a8b-12e122819b9d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.793231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce2136-a6f6-43cb-8a8b-12e122819b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.793231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce2136-a6f6-43cb-8a8b-12e122819b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.795345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce2136-a6f6-43cb-8a8b-12e122819b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:21.801157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce2136-a6f6-43cb-8a8b-12e122819b9d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:21.868327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532d022-db00-49bc-98b2-ccd3b9a465bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:21.872010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532d022-db00-49bc-98b2-ccd3b9a465bf admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.873279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532d022-db00-49bc-98b2-ccd3b9a465bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.873572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532d022-db00-49bc-98b2-ccd3b9a465bf admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.874721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532d022-db00-49bc-98b2-ccd3b9a465bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:21.875555 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3447/6925] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:21 2022] POST /identity/v3/projects => generated 369 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:21.882442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56599509-9048-4905-922b-6c3b9b484194 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:21.882730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56599509-9048-4905-922b-6c3b9b484194 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:21.883540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532d022-db00-49bc-98b2-ccd3b9a465bf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:21.885133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56599509-9048-4905-922b-6c3b9b484194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:21.978252 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3479/6926] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:21 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:21.980273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532d022-db00-49bc-98b2-ccd3b9a465bf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:22.009743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532d022-db00-49bc-98b2-ccd3b9a465bf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:22.011461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-56599509-9048-4905-922b-6c3b9b484194 None None] MFA Rules not processed for user `2ca94d8c369f450d8465801026d4fc3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:22.016458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-56599509-9048-4905-922b-6c3b9b484194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:22.128725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:22.255981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbad4fd-2714-4fd5-8a1d-b2ed6551d031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:22.260351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbad4fd-2714-4fd5-8a1d-b2ed6551d031 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:22.261682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbad4fd-2714-4fd5-8a1d-b2ed6551d031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:22.263740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbad4fd-2714-4fd5-8a1d-b2ed6551d031 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:22.265278 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3448/6927] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:22.266032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbad4fd-2714-4fd5-8a1d-b2ed6551d031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:22.269324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56599509-9048-4905-922b-6c3b9b484194 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:22.272910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbad4fd-2714-4fd5-8a1d-b2ed6551d031 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:22.295326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56599509-9048-4905-922b-6c3b9b484194 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:22.307709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c2b4-24c5-4578-a3cc-e4e451d27279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:22.310520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c2b4-24c5-4578-a3cc-e4e451d27279 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:22.310802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c2b4-24c5-4578-a3cc-e4e451d27279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:22.312068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c2b4-24c5-4578-a3cc-e4e451d27279 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:22.315189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c2b4-24c5-4578-a3cc-e4e451d27279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:22.317236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c2b4-24c5-4578-a3cc-e4e451d27279 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:22.336221 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3449/6928] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:22.337319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c2b4-24c5-4578-a3cc-e4e451d27279 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:22.343681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ffd5c2b4-24c5-4578-a3cc-e4e451d27279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:22.359011 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3480/6929] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:21 2022] POST /identity/v3/users => generated 285 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:22.361328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbad4fd-2714-4fd5-8a1d-b2ed6551d031 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:22.379236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbad4fd-2714-4fd5-8a1d-b2ed6551d031 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:22.385575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211843-405a-4168-be81-b67d01b560de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:22.386601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211843-405a-4168-be81-b67d01b560de admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:22.387288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211843-405a-4168-be81-b67d01b560de admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:22.387666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc211843-405a-4168-be81-b67d01b560de admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:22.388419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc211843-405a-4168-be81-b67d01b560de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:22.397142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc211843-405a-4168-be81-b67d01b560de admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:22.432499 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3481/6930] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:22.435001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211843-405a-4168-be81-b67d01b560de admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:22.437066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cc211843-405a-4168-be81-b67d01b560de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:22.450040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c2b4-24c5-4578-a3cc-e4e451d27279 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:22.456740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b867dc-ec0e-4175-a44f-132c79973142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:22.458051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b867dc-ec0e-4175-a44f-132c79973142 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:22.461182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b867dc-ec0e-4175-a44f-132c79973142 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:22.461468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b867dc-ec0e-4175-a44f-132c79973142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:22.474289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b867dc-ec0e-4175-a44f-132c79973142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:22.475901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b867dc-ec0e-4175-a44f-132c79973142 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:22.476383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc211843-405a-4168-be81-b67d01b560de admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:22.494630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:22.495673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:22.496328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:22.497159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] PATH_INFO: `/v3/projects/cbe3f46e0a9b40c78465a09fad99a7a0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:22.498679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe3f46e0a9b40c78465a09fad99a7a0)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:22.500746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:22.515062 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3450/6931] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:22.517483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b867dc-ec0e-4175-a44f-132c79973142 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:22.551009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b867dc-ec0e-4175-a44f-132c79973142 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:22.563684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a0db-2082-403f-b562-3017c79355b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:22.564458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a0db-2082-403f-b562-3017c79355b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:22.565013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a0db-2082-403f-b562-3017c79355b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:22.565411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188a0db-2082-403f-b562-3017c79355b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:22.569624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188a0db-2082-403f-b562-3017c79355b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:22.573823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188a0db-2082-403f-b562-3017c79355b6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:22.602119 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3451/6932] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:22.603132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a0db-2082-403f-b562-3017c79355b6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:22.616333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188a0db-2082-403f-b562-3017c79355b6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:22.649918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:22.657536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe3f46e0a9b40c78465a09fad99a7a0', 'request_id': 'req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:22.676908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe3f46e0a9b40c78465a09fad99a7a0', 'request_id': 'req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:22.709750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe3f46e0a9b40c78465a09fad99a7a0', 'request_id': 'req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:22.734804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] The token cache is being invalidate because project cbe3f46e0a9b40c78465a09fad99a7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:22.735184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:22.738990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:22.748122 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3482/6933] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:22 2022] DELETE /identity/v3/projects/cbe3f46e0a9b40c78465a09fad99a7a0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:22.750298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:22.752917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:22.771549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1a44a-32cc-4ae1-b9f9-be1a84973c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:22.776847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1a44a-32cc-4ae1-b9f9-be1a84973c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:22.777325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1a44a-32cc-4ae1-b9f9-be1a84973c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:22.777692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1a44a-32cc-4ae1-b9f9-be1a84973c39 admin admin] PATH_INFO: `/v3/projects/10acca11ff934913be1e4e6567a40f11/users/a8bc8ac4dde3416f8d24347bd1d42bd7/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:22.836967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1a44a-32cc-4ae1-b9f9-be1a84973c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10acca11ff934913be1e4e6567a40f11, user_id=a8bc8ac4dde3416f8d24347bd1d42bd7, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:22.842901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1a44a-32cc-4ae1-b9f9-be1a84973c39 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:22.874528 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3452/6934] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:22 2022] PUT /identity/v3/projects/10acca11ff934913be1e4e6567a40f11/users/a8bc8ac4dde3416f8d24347bd1d42bd7/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:22.877995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1a44a-32cc-4ae1-b9f9-be1a84973c39 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:22.882388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-19d1a44a-32cc-4ae1-b9f9-be1a84973c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:22.967024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5fc20-1406-480f-bdfb-c6e3a7aa3fad admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:23.009965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:23.113470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1a44a-32cc-4ae1-b9f9-be1a84973c39 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:23.126029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:23.126942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.127714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.128063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] PATH_INFO: `/v3/projects/a45f1c6197c345968c4255e093622c24` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:23.129188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dbb9b-394a-4cf8-b5f4-afeae91d84f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:23.129826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dbb9b-394a-4cf8-b5f4-afeae91d84f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.130128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dbb9b-394a-4cf8-b5f4-afeae91d84f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.130397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dbb9b-394a-4cf8-b5f4-afeae91d84f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:23.130598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45f1c6197c345968c4255e093622c24)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:23.131073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dbb9b-394a-4cf8-b5f4-afeae91d84f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:23.135707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:23.135797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dbb9b-394a-4cf8-b5f4-afeae91d84f2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:23.162023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3453/6935] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:23.163713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e11fd-99cb-4df0-a121-9b909fc7ad9f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.164000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e11fd-99cb-4df0-a121-9b909fc7ad9f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.164273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e11fd-99cb-4df0-a121-9b909fc7ad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:23.208782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ce9e11fd-99cb-4df0-a121-9b909fc7ad9f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:23.210435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ce9e11fd-99cb-4df0-a121-9b909fc7ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:23.231842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45f1c6197c345968c4255e093622c24', 'request_id': 'req-6bdf5b0d-ed61-45d1-922a-2893d040faa2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:23.264877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45f1c6197c345968c4255e093622c24', 'request_id': 'req-6bdf5b0d-ed61-45d1-922a-2893d040faa2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:23.301055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45f1c6197c345968c4255e093622c24', 'request_id': 'req-6bdf5b0d-ed61-45d1-922a-2893d040faa2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:23.333862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] The token cache is being invalidate because project a45f1c6197c345968c4255e093622c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:23.334545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:23.338141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6bdf5b0d-ed61-45d1-922a-2893d040faa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:23.344854 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3483/6936] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:22 2022] DELETE /identity/v3/projects/a45f1c6197c345968c4255e093622c24 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:23.345530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a098e1-489a-49bc-8664-c7a59eaf034e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.346209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a098e1-489a-49bc-8664-c7a59eaf034e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.346971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a098e1-489a-49bc-8664-c7a59eaf034e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:23.407748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:23.413372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3454/6937] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:23.425903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e11fd-99cb-4df0-a121-9b909fc7ad9f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:23.425903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ce9e11fd-99cb-4df0-a121-9b909fc7ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:23.430354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-52a098e1-489a-49bc-8664-c7a59eaf034e None None] MFA Rules not processed for user `a8bc8ac4dde3416f8d24347bd1d42bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:23.432454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-52a098e1-489a-49bc-8664-c7a59eaf034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:23.442022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e11fd-99cb-4df0-a121-9b909fc7ad9f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:23.447538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571a044-d3c0-4139-98f2-fb95a60e72eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:23.448402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571a044-d3c0-4139-98f2-fb95a60e72eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.448682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571a044-d3c0-4139-98f2-fb95a60e72eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.448951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571a044-d3c0-4139-98f2-fb95a60e72eb admin admin] PATH_INFO: `/v3/projects/1a959c0aeac142c49e3fecdf77e27fa5/users/2712b2583a2c4abfa708e364c38ffdad/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:23.466623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571a044-d3c0-4139-98f2-fb95a60e72eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a959c0aeac142c49e3fecdf77e27fa5, user_id=2712b2583a2c4abfa708e364c38ffdad, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:23.469732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571a044-d3c0-4139-98f2-fb95a60e72eb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:23.497545 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3455/6938] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:23 2022] PUT /identity/v3/projects/1a959c0aeac142c49e3fecdf77e27fa5/users/2712b2583a2c4abfa708e364c38ffdad/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:23.498770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571a044-d3c0-4139-98f2-fb95a60e72eb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:23.510440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5571a044-d3c0-4139-98f2-fb95a60e72eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:23.586719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571a044-d3c0-4139-98f2-fb95a60e72eb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:23.591505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ee771-adc6-4984-b471-70cbea619de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:23.592543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ee771-adc6-4984-b471-70cbea619de6 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.592874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ee771-adc6-4984-b471-70cbea619de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.593148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ee771-adc6-4984-b471-70cbea619de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:23.594963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c08ee771-adc6-4984-b471-70cbea619de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:23.650905 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3484/6939] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:23.652240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbc513-0abe-4473-8988-6752c1e18a5b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.653194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbc513-0abe-4473-8988-6752c1e18a5b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.653479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbc513-0abe-4473-8988-6752c1e18a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:23.676299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-eccbc513-0abe-4473-8988-6752c1e18a5b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:23.677538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eccbc513-0abe-4473-8988-6752c1e18a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:23.716687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ee771-adc6-4984-b471-70cbea619de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:23.719969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ee771-adc6-4984-b471-70cbea619de6 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:23.725025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:23.753546 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3456/6940] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:23.758553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917459-caa5-4000-8e92-1e3f92eaa818 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.758879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917459-caa5-4000-8e92-1e3f92eaa818 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.759215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea917459-caa5-4000-8e92-1e3f92eaa818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:23.805021 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3485/6941] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:23.805021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaaf30-7ac0-41e1-a4d6-8c23be021ce6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.805021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaaf30-7ac0-41e1-a4d6-8c23be021ce6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.805021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdaaf30-7ac0-41e1-a4d6-8c23be021ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:23.820301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ea917459-caa5-4000-8e92-1e3f92eaa818 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:23.821037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ea917459-caa5-4000-8e92-1e3f92eaa818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:23.830912 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3457/6942] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:23.832249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea917459-caa5-4000-8e92-1e3f92eaa818 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:23.833837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ea917459-caa5-4000-8e92-1e3f92eaa818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:23.868265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3cdaaf30-7ac0-41e1-a4d6-8c23be021ce6 None None] MFA Rules not processed for user `2712b2583a2c4abfa708e364c38ffdad`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:23.870212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3cdaaf30-7ac0-41e1-a4d6-8c23be021ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:23.954806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea917459-caa5-4000-8e92-1e3f92eaa818 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:23.967503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0af45f-bb3d-42a8-909e-03ac708cc39d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:23.968042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0af45f-bb3d-42a8-909e-03ac708cc39d service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.968317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0af45f-bb3d-42a8-909e-03ac708cc39d service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.968600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0af45f-bb3d-42a8-909e-03ac708cc39d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:23.971164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dd0af45f-bb3d-42a8-909e-03ac708cc39d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:23.995204 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3486/6943] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:23.997705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470641f4-e995-45f4-8e78-14f115d809de None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:23.998205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470641f4-e995-45f4-8e78-14f115d809de None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:23.998762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470641f4-e995-45f4-8e78-14f115d809de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:24.025185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-470641f4-e995-45f4-8e78-14f115d809de None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:24.027861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-470641f4-e995-45f4-8e78-14f115d809de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:24.041106 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3487/6944] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:24.046583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470641f4-e995-45f4-8e78-14f115d809de None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:24.069185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470641f4-e995-45f4-8e78-14f115d809de None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:24.091060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362488a2-e8f3-421a-b3b2-20e09d16fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:24.091060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362488a2-e8f3-421a-b3b2-20e09d16fbba admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:24.091060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362488a2-e8f3-421a-b3b2-20e09d16fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:24.091413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362488a2-e8f3-421a-b3b2-20e09d16fbba admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:24.091987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362488a2-e8f3-421a-b3b2-20e09d16fbba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:24.092185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362488a2-e8f3-421a-b3b2-20e09d16fbba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:24.094936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0af45f-bb3d-42a8-909e-03ac708cc39d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:24.109323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0af45f-bb3d-42a8-909e-03ac708cc39d service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:24.112263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362488a2-e8f3-421a-b3b2-20e09d16fbba admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:24.158935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3458/6945] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:24.177426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0af45f-bb3d-42a8-909e-03ac708cc39d service glance] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:24.195356 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3488/6946] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:24.198281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362488a2-e8f3-421a-b3b2-20e09d16fbba admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:24.242618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362488a2-e8f3-421a-b3b2-20e09d16fbba admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:24.260913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0af45f-bb3d-42a8-909e-03ac708cc39d service glance] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:24.261170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d2028-3fd4-46f6-8cd8-6c8e4d8864dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:24.261972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d2028-3fd4-46f6-8cd8-6c8e4d8864dc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:24.263747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d2028-3fd4-46f6-8cd8-6c8e4d8864dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:24.264223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d2028-3fd4-46f6-8cd8-6c8e4d8864dc admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:24.265806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d2028-3fd4-46f6-8cd8-6c8e4d8864dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:24.266413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d2028-3fd4-46f6-8cd8-6c8e4d8864dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:24.276127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d2028-3fd4-46f6-8cd8-6c8e4d8864dc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:24.291760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c7aa5-8758-46a9-8211-e74529181d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:24.295045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7aa5-8758-46a9-8211-e74529181d2a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:24.298944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7aa5-8758-46a9-8211-e74529181d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:24.299701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7aa5-8758-46a9-8211-e74529181d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:24.300509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c7aa5-8758-46a9-8211-e74529181d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:24.307719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c7aa5-8758-46a9-8211-e74529181d2a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:24.310044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:24.332569 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3489/6947] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:24.333525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d2028-3fd4-46f6-8cd8-6c8e4d8864dc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:24.379940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d2028-3fd4-46f6-8cd8-6c8e4d8864dc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:24.392915 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3459/6948] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:24 2022] POST /identity/v3/projects => generated 369 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:24.393854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c7aa5-8758-46a9-8211-e74529181d2a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:24.409380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a4114-fccb-41a6-950d-10217c952b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:24.410690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a4114-fccb-41a6-950d-10217c952b49 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:24.412622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a4114-fccb-41a6-950d-10217c952b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:24.413552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a4114-fccb-41a6-950d-10217c952b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:24.415378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a4114-fccb-41a6-950d-10217c952b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:24.427623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a4114-fccb-41a6-950d-10217c952b49 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:24.599840 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3490/6949] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:24 2022] POST /identity/v3/projects => generated 373 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:24.606867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a4114-fccb-41a6-950d-10217c952b49 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:24.671119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c7aa5-8758-46a9-8211-e74529181d2a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:24.756002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:24.780780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a4114-fccb-41a6-950d-10217c952b49 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:24.798386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb2a9a-388b-4fb3-8bf5-3a46384b794e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:24.799341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2a9a-388b-4fb3-8bf5-3a46384b794e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:24.799632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2a9a-388b-4fb3-8bf5-3a46384b794e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:24.799908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb2a9a-388b-4fb3-8bf5-3a46384b794e admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:24.802158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb2a9a-388b-4fb3-8bf5-3a46384b794e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:24.805861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb2a9a-388b-4fb3-8bf5-3a46384b794e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:24.825417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cebe97-e249-4cce-a229-f2cf870d4313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:24.826095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cebe97-e249-4cce-a229-f2cf870d4313 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:24.826369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cebe97-e249-4cce-a229-f2cf870d4313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:24.826773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cebe97-e249-4cce-a229-f2cf870d4313 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:24.827416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cebe97-e249-4cce-a229-f2cf870d4313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:24.829446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cebe97-e249-4cce-a229-f2cf870d4313 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:24.864055 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3491/6950] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:24 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:24.865370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb2a9a-388b-4fb3-8bf5-3a46384b794e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:24.871265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8fbb2a9a-388b-4fb3-8bf5-3a46384b794e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:24.895820 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3460/6951] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:24 2022] POST /identity/v3/projects => generated 373 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:24.895820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cebe97-e249-4cce-a229-f2cf870d4313 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:24.905100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb2a9a-388b-4fb3-8bf5-3a46384b794e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.009490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cebe97-e249-4cce-a229-f2cf870d4313 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.014810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc29692-c8bf-4d34-bc3e-26421d25398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:25.015539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc29692-c8bf-4d34-bc3e-26421d25398a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.015839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc29692-c8bf-4d34-bc3e-26421d25398a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.016068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc29692-c8bf-4d34-bc3e-26421d25398a admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.016799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc29692-c8bf-4d34-bc3e-26421d25398a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:25.018996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc29692-c8bf-4d34-bc3e-26421d25398a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:25.023257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:25.023916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.024188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.024456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] PATH_INFO: `/v3/users/49ed224480ca486dbca9c895b9d464eb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.025670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ed224480ca486dbca9c895b9d464eb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:25.027757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:25.052177 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3461/6952] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:24 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:25.053448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc29692-c8bf-4d34-bc3e-26421d25398a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:25.056842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6bc29692-c8bf-4d34-bc3e-26421d25398a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:25.089913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc29692-c8bf-4d34-bc3e-26421d25398a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.104544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:25.105223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.105502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.105767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] PATH_INFO: `/v3/users/545c01ea4954407389413a4f6925d8ee` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.108547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545c01ea4954407389413a4f6925d8ee)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:25.117555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:25.149121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ed224480ca486dbca9c895b9d464eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:25.152425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ed224480ca486dbca9c895b9d464eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:25.164316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ed224480ca486dbca9c895b9d464eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:25.177221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ed224480ca486dbca9c895b9d464eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:25.187333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:25.200316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ed224480ca486dbca9c895b9d464eb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:25.206163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545c01ea4954407389413a4f6925d8ee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:25.212828 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3492/6953] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:24 2022] DELETE /identity/v3/users/49ed224480ca486dbca9c895b9d464eb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:25.212828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:25.212828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:25.227042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545c01ea4954407389413a4f6925d8ee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:25.256060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545c01ea4954407389413a4f6925d8ee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:25.273019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545c01ea4954407389413a4f6925d8ee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:25.274187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545c01ea4954407389413a4f6925d8ee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:25.287304 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3462/6954] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:25 2022] DELETE /identity/v3/users/545c01ea4954407389413a4f6925d8ee => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:25.291639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:25.295695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:25.321660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671c34f-b2ed-45ef-ae57-58bf903985b2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.333647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:25.436645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4f3a2-9f42-491a-8085-967494529107 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.443248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3ae59-14b1-4d5b-bd3a-a7f95f541b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:25.444033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3ae59-14b1-4d5b-bd3a-a7f95f541b48 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.444379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3ae59-14b1-4d5b-bd3a-a7f95f541b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.444724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3ae59-14b1-4d5b-bd3a-a7f95f541b48 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.445454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3ae59-14b1-4d5b-bd3a-a7f95f541b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:25.450910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3ae59-14b1-4d5b-bd3a-a7f95f541b48 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:25.488501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9dbe1-9738-465b-8956-6da7ebd5c907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:25.489297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9dbe1-9738-465b-8956-6da7ebd5c907 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.490726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9dbe1-9738-465b-8956-6da7ebd5c907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.491108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9dbe1-9738-465b-8956-6da7ebd5c907 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.491939 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3463/6955] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:25 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:25.492185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9dbe1-9738-465b-8956-6da7ebd5c907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:25.493046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3ae59-14b1-4d5b-bd3a-a7f95f541b48 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:25.494009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9dbe1-9738-465b-8956-6da7ebd5c907 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:25.500169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5fd3ae59-14b1-4d5b-bd3a-a7f95f541b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:25.517166 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3493/6956] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:25.518706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791b6e7-0279-4aac-8eae-1115f9410e53 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.519006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791b6e7-0279-4aac-8eae-1115f9410e53 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.521923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791b6e7-0279-4aac-8eae-1115f9410e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.522097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3ae59-14b1-4d5b-bd3a-a7f95f541b48 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.528285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7964a60-02ad-4673-8f78-d43729d46176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:25.528997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964a60-02ad-4673-8f78-d43729d46176 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.529339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964a60-02ad-4673-8f78-d43729d46176 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.529737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7964a60-02ad-4673-8f78-d43729d46176 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.530640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7964a60-02ad-4673-8f78-d43729d46176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:25.533345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7964a60-02ad-4673-8f78-d43729d46176 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:25.547177 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3464/6957] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:25.548714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7ed5-9403-4302-87e7-620a65716333 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.549143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7ed5-9403-4302-87e7-620a65716333 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.549829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f7ed5-9403-4302-87e7-620a65716333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.577049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a98f7ed5-9403-4302-87e7-620a65716333 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:25.578173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a98f7ed5-9403-4302-87e7-620a65716333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:25.580695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f791b6e7-0279-4aac-8eae-1115f9410e53 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:25.582089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f791b6e7-0279-4aac-8eae-1115f9410e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:25.587823 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3465/6958] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:25.588729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f7ed5-9403-4302-87e7-620a65716333 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:25.602736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f7ed5-9403-4302-87e7-620a65716333 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.616739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4083cb3-bc32-45a0-9665-26fe0b41af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:25.617453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4083cb3-bc32-45a0-9665-26fe0b41af7d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.617814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4083cb3-bc32-45a0-9665-26fe0b41af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.618166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4083cb3-bc32-45a0-9665-26fe0b41af7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.618944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4083cb3-bc32-45a0-9665-26fe0b41af7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:25.623807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4083cb3-bc32-45a0-9665-26fe0b41af7d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:25.624777 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3494/6959] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:25.626290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791b6e7-0279-4aac-8eae-1115f9410e53 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:25.637587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f791b6e7-0279-4aac-8eae-1115f9410e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:25.653922 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3466/6960] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:25.654902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4083cb3-bc32-45a0-9665-26fe0b41af7d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:25.673055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791b6e7-0279-4aac-8eae-1115f9410e53 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.682347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4083cb3-bc32-45a0-9665-26fe0b41af7d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.690555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da93ef-0b93-419f-bdf4-50b00bf12ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:25.691082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da93ef-0b93-419f-bdf4-50b00bf12ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.691364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da93ef-0b93-419f-bdf4-50b00bf12ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.692299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ec1d3-a155-463f-83a1-b17e5c9b66c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:25.692779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da93ef-0b93-419f-bdf4-50b00bf12ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.692992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ec1d3-a155-463f-83a1-b17e5c9b66c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.693274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ec1d3-a155-463f-83a1-b17e5c9b66c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.693461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da93ef-0b93-419f-bdf4-50b00bf12ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:25.693586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ec1d3-a155-463f-83a1-b17e5c9b66c7 admin admin] PATH_INFO: `/v3/projects/9cd4276653da420f801ab9c21a23fa0f/users/674ba52e93ad45b99819487744d05368/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:25.698980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da93ef-0b93-419f-bdf4-50b00bf12ae7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:25.722050 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3467/6961] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:25.724827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da93ef-0b93-419f-bdf4-50b00bf12ae7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:25.730160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-58da93ef-0b93-419f-bdf4-50b00bf12ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:25.753808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ec1d3-a155-463f-83a1-b17e5c9b66c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd4276653da420f801ab9c21a23fa0f, user_id=674ba52e93ad45b99819487744d05368, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:25.759233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ec1d3-a155-463f-83a1-b17e5c9b66c7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:25.788266 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3495/6962] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:25 2022] PUT /identity/v3/projects/9cd4276653da420f801ab9c21a23fa0f/users/674ba52e93ad45b99819487744d05368/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:25.792072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ec1d3-a155-463f-83a1-b17e5c9b66c7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:25.797733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0f0ec1d3-a155-463f-83a1-b17e5c9b66c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:25.882899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da93ef-0b93-419f-bdf4-50b00bf12ae7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.979601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ec1d3-a155-463f-83a1-b17e5c9b66c7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:25.993779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14d2a-5ac2-454c-be41-5c2ae3ab0602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:25.994446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14d2a-5ac2-454c-be41-5c2ae3ab0602 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:25.994722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14d2a-5ac2-454c-be41-5c2ae3ab0602 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:25.994987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e14d2a-5ac2-454c-be41-5c2ae3ab0602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:26.023318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:26.045448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f55f73-ab6c-4867-9f4e-cfb58a211782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:26.046140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f55f73-ab6c-4867-9f4e-cfb58a211782 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:26.046417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f55f73-ab6c-4867-9f4e-cfb58a211782 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:26.046689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f55f73-ab6c-4867-9f4e-cfb58a211782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:26.151286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:26.205136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e14d2a-5ac2-454c-be41-5c2ae3ab0602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:26.207684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e14d2a-5ac2-454c-be41-5c2ae3ab0602 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:26.240280 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3496/6963] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:26.243593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14d2a-5ac2-454c-be41-5c2ae3ab0602 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:26.246142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f55f73-ab6c-4867-9f4e-cfb58a211782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:26.247646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f55f73-ab6c-4867-9f4e-cfb58a211782 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:26.270947 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3468/6964] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:26.272802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f55f73-ab6c-4867-9f4e-cfb58a211782 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:26.276011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e14d2a-5ac2-454c-be41-5c2ae3ab0602 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:26.300141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f55f73-ab6c-4867-9f4e-cfb58a211782 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:26.303314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9af304-6eda-4672-a1f0-00be7765bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:26.305926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9af304-6eda-4672-a1f0-00be7765bb7e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:26.306799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f69e0-2040-46a3-b1b0-386f1d22f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:26.307684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9af304-6eda-4672-a1f0-00be7765bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:26.308465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f69e0-2040-46a3-b1b0-386f1d22f37c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:26.308895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f69e0-2040-46a3-b1b0-386f1d22f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:26.309021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9af304-6eda-4672-a1f0-00be7765bb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:26.309436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f69e0-2040-46a3-b1b0-386f1d22f37c admin admin] PATH_INFO: `/v3/projects/6eedbd0bbdfd4314aefe85410771d571/users/76c80315753e46ff91c0d4696e4a2007/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:26.310881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9af304-6eda-4672-a1f0-00be7765bb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:26.331096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9af304-6eda-4672-a1f0-00be7765bb7e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:26.347844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f69e0-2040-46a3-b1b0-386f1d22f37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eedbd0bbdfd4314aefe85410771d571, user_id=76c80315753e46ff91c0d4696e4a2007, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:26.351528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f69e0-2040-46a3-b1b0-386f1d22f37c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:26.356219 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3497/6965] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:26.359744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9af304-6eda-4672-a1f0-00be7765bb7e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:26.410021 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3469/6966] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:26 2022] PUT /identity/v3/projects/6eedbd0bbdfd4314aefe85410771d571/users/76c80315753e46ff91c0d4696e4a2007/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:26.410021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f69e0-2040-46a3-b1b0-386f1d22f37c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:26.418766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9af304-6eda-4672-a1f0-00be7765bb7e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:26.536803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f69e0-2040-46a3-b1b0-386f1d22f37c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:26.542321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86521141-5b07-4ef4-9e7b-ff1a94e82656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:26.543261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86521141-5b07-4ef4-9e7b-ff1a94e82656 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:26.543558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86521141-5b07-4ef4-9e7b-ff1a94e82656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:26.544093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86521141-5b07-4ef4-9e7b-ff1a94e82656 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:26.545405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86521141-5b07-4ef4-9e7b-ff1a94e82656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:26.546227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebce75-8f02-407d-8521-4bbcd0e48708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:26.547201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86521141-5b07-4ef4-9e7b-ff1a94e82656 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:26.548162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebce75-8f02-407d-8521-4bbcd0e48708 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:26.552281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebce75-8f02-407d-8521-4bbcd0e48708 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:26.552805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebce75-8f02-407d-8521-4bbcd0e48708 admin admin] PATH_INFO: `/v3/projects/9608e1e491ba463bb7ea9ee8ceb819ba/users/43e7e2b5fb2144dda9331bc7c6a77238/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:26.586321 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3498/6967] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:26.593390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0bba-4e9e-45ec-9052-6d8b2cb396ab None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:26.593676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0bba-4e9e-45ec-9052-6d8b2cb396ab None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:26.594020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c0bba-4e9e-45ec-9052-6d8b2cb396ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:26.594828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebce75-8f02-407d-8521-4bbcd0e48708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9608e1e491ba463bb7ea9ee8ceb819ba, user_id=43e7e2b5fb2144dda9331bc7c6a77238, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:26.603111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebce75-8f02-407d-8521-4bbcd0e48708 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:26.662605 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3470/6968] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:26 2022] PUT /identity/v3/projects/9608e1e491ba463bb7ea9ee8ceb819ba/users/43e7e2b5fb2144dda9331bc7c6a77238/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:26.662605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebce75-8f02-407d-8521-4bbcd0e48708 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:26.663209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1a5c0bba-4e9e-45ec-9052-6d8b2cb396ab None None] MFA Rules not processed for user `76c80315753e46ff91c0d4696e4a2007`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:26.663209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1a5c0bba-4e9e-45ec-9052-6d8b2cb396ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:26.764197 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3499/6969] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:26.765784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4bef-0fd3-4441-97ac-c73793b494e5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:26.766067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4bef-0fd3-4441-97ac-c73793b494e5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:26.767775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4bef-0fd3-4441-97ac-c73793b494e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:26.843081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5c5b4bef-0fd3-4441-97ac-c73793b494e5 None None] MFA Rules not processed for user `43e7e2b5fb2144dda9331bc7c6a77238`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:26.849206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5c5b4bef-0fd3-4441-97ac-c73793b494e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:26.876290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:26.926288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebce75-8f02-407d-8521-4bbcd0e48708 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:26.958702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6006067-ed9a-461f-bd00-1abab78ba5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:26.959651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6006067-ed9a-461f-bd00-1abab78ba5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:26.962668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6006067-ed9a-461f-bd00-1abab78ba5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:26.962668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6006067-ed9a-461f-bd00-1abab78ba5fa admin admin] PATH_INFO: `/v3/projects/9cd4276653da420f801ab9c21a23fa0f/users/674ba52e93ad45b99819487744d05368/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:26.972192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6006067-ed9a-461f-bd00-1abab78ba5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd4276653da420f801ab9c21a23fa0f, user_id=674ba52e93ad45b99819487744d05368, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:26.986425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6006067-ed9a-461f-bd00-1abab78ba5fa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:27.027633 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3471/6970] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:26 2022] PUT /identity/v3/projects/9cd4276653da420f801ab9c21a23fa0f/users/674ba52e93ad45b99819487744d05368/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:27.033013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6006067-ed9a-461f-bd00-1abab78ba5fa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:27.049785 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3500/6971] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:27.050375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539172b6-e90c-42dd-97b7-18b72cf9eb3f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:27.050661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539172b6-e90c-42dd-97b7-18b72cf9eb3f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:27.050937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539172b6-e90c-42dd-97b7-18b72cf9eb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:27.145703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:27.146393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-539172b6-e90c-42dd-97b7-18b72cf9eb3f None None] MFA Rules not processed for user `674ba52e93ad45b99819487744d05368`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:27.147637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-539172b6-e90c-42dd-97b7-18b72cf9eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:27.224853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6006067-ed9a-461f-bd00-1abab78ba5fa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:27.231531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184e2cf-7ff7-483e-8f85-41e7f8767bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:27.232535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184e2cf-7ff7-483e-8f85-41e7f8767bff service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:27.233027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184e2cf-7ff7-483e-8f85-41e7f8767bff service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:27.233492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184e2cf-7ff7-483e-8f85-41e7f8767bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:27.315732 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3501/6972] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:27.317046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539172b6-e90c-42dd-97b7-18b72cf9eb3f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:27.331974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-539172b6-e90c-42dd-97b7-18b72cf9eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:27.354276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184e2cf-7ff7-483e-8f85-41e7f8767bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:27.357207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184e2cf-7ff7-483e-8f85-41e7f8767bff service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:27.387686 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3472/6973] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:27.389000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184e2cf-7ff7-483e-8f85-41e7f8767bff service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:27.391254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6184e2cf-7ff7-483e-8f85-41e7f8767bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:27.484759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184e2cf-7ff7-483e-8f85-41e7f8767bff service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:27.489708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217d1f4-8487-4a8e-abac-fd55aaa2a77b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:27.490722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217d1f4-8487-4a8e-abac-fd55aaa2a77b service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:27.491914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217d1f4-8487-4a8e-abac-fd55aaa2a77b service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:27.492411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217d1f4-8487-4a8e-abac-fd55aaa2a77b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:27.515743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539172b6-e90c-42dd-97b7-18b72cf9eb3f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:27.529085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:27.529743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:27.530045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:27.530484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] PATH_INFO: `/v3/projects/4dec2b3f836c447da00c61b2c5d5022c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:27.531683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dec2b3f836c447da00c61b2c5d5022c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:27.534224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:27.591092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217d1f4-8487-4a8e-abac-fd55aaa2a77b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:27.596009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217d1f4-8487-4a8e-abac-fd55aaa2a77b service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:27.622886 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3473/6974] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:27.626474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217d1f4-8487-4a8e-abac-fd55aaa2a77b service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:27.628388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8217d1f4-8487-4a8e-abac-fd55aaa2a77b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:27.633214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:27.650609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dec2b3f836c447da00c61b2c5d5022c', 'request_id': 'req-937761da-9695-43b4-bfee-efe2ee5a20e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:27.663785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217d1f4-8487-4a8e-abac-fd55aaa2a77b service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:27.675854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dec2b3f836c447da00c61b2c5d5022c', 'request_id': 'req-937761da-9695-43b4-bfee-efe2ee5a20e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:27.694517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dec2b3f836c447da00c61b2c5d5022c', 'request_id': 'req-937761da-9695-43b4-bfee-efe2ee5a20e6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:27.720415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] The token cache is being invalidate because project 4dec2b3f836c447da00c61b2c5d5022c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:27.720991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:27.722212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:27.725233 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3502/6975] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:27 2022] DELETE /identity/v3/projects/4dec2b3f836c447da00c61b2c5d5022c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:27.726715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:27.731067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:27.752315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:27.842759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:27.845236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:27.849747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:27.850672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] PATH_INFO: `/v3/projects/aa7a84367266489f88e0680b9c5097f4` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:27.853245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa7a84367266489f88e0680b9c5097f4)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:27.860018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:27.920310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937761da-9695-43b4-bfee-efe2ee5a20e6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:27.963348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa7a84367266489f88e0680b9c5097f4', 'request_id': 'req-df6db0d3-4d1c-45f9-8913-aab338f70971'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:27.975494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa7a84367266489f88e0680b9c5097f4', 'request_id': 'req-df6db0d3-4d1c-45f9-8913-aab338f70971'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:27.999971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa7a84367266489f88e0680b9c5097f4', 'request_id': 'req-df6db0d3-4d1c-45f9-8913-aab338f70971'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.026261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] The token cache is being invalidate because project aa7a84367266489f88e0680b9c5097f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:28.026671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.029146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.035698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49729af-0849-45d7-9e35-0bc022e3530c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:28.036018 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3474/6976] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:27 2022] DELETE /identity/v3/projects/aa7a84367266489f88e0680b9c5097f4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:28.037021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49729af-0849-45d7-9e35-0bc022e3530c service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:28.037560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49729af-0849-45d7-9e35-0bc022e3530c service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:28.037681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:28.038989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49729af-0849-45d7-9e35-0bc022e3530c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:28.041789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:28.043989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e49729af-0849-45d7-9e35-0bc022e3530c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:28.212267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49729af-0849-45d7-9e35-0bc022e3530c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:28.213794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49729af-0849-45d7-9e35-0bc022e3530c service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:28.241267 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3503/6977] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:28.252409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49729af-0849-45d7-9e35-0bc022e3530c service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:28.253730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e49729af-0849-45d7-9e35-0bc022e3530c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:28.268642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6db0d3-4d1c-45f9-8913-aab338f70971 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:28.283973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:28.284695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:28.285103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:28.285382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] PATH_INFO: `/v3/users/a8bc8ac4dde3416f8d24347bd1d42bd7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:28.288103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8bc8ac4dde3416f8d24347bd1d42bd7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:28.290114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:28.291037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49729af-0849-45d7-9e35-0bc022e3530c service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:28.308985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:28.309676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:28.311258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:28.311537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] PATH_INFO: `/v3/users/947cde64892a47dfb93605d1be778051` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:28.313780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=947cde64892a47dfb93605d1be778051)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:28.318265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:28.421498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8bc8ac4dde3416f8d24347bd1d42bd7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.444261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:28.453733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8bc8ac4dde3416f8d24347bd1d42bd7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.475493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:28.485212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947cde64892a47dfb93605d1be778051'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.486442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947cde64892a47dfb93605d1be778051'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.492363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8bc8ac4dde3416f8d24347bd1d42bd7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.535307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947cde64892a47dfb93605d1be778051'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.547248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8bc8ac4dde3416f8d24347bd1d42bd7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.547994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8066ae8-e454-466b-beab-9c092216d8d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8bc8ac4dde3416f8d24347bd1d42bd7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.565621 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3475/6978] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:28 2022] DELETE /identity/v3/users/a8bc8ac4dde3416f8d24347bd1d42bd7 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:28.577004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947cde64892a47dfb93605d1be778051'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.633923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947cde64892a47dfb93605d1be778051'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:28.656783 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3504/6979] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:28 2022] DELETE /identity/v3/users/947cde64892a47dfb93605d1be778051 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:30.484928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b66b1d-e633-42be-b761-15565071a149 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:30.486036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b66b1d-e633-42be-b761-15565071a149 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:30.486544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b66b1d-e633-42be-b761-15565071a149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:30.539793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e4b66b1d-e633-42be-b761-15565071a149 None None] MFA Rules not processed for user `43e7e2b5fb2144dda9331bc7c6a77238`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:30.546626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e4b66b1d-e633-42be-b761-15565071a149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:30.822694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:30.824710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:30.829205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3476/6980] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:30.976021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b66b1d-e633-42be-b761-15565071a149 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:30.980159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e4b66b1d-e633-42be-b761-15565071a149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:31.026237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae7cd8-1c4f-4cdd-96f4-6646e0b532c5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:31.029187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b66b1d-e633-42be-b761-15565071a149 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:31.037580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:31.043997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:31.044596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:31.044868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:31.045140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] PATH_INFO: `/v3/projects/10acca11ff934913be1e4e6567a40f11` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:31.046434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10acca11ff934913be1e4e6567a40f11)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:31.048662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:31.056691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:31.057022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:31.057307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] PATH_INFO: `/v3/projects/ba982b76fa6b43c0a3930a81bc711362` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:31.062304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba982b76fa6b43c0a3930a81bc711362)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:31.069360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:31.171340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10acca11ff934913be1e4e6567a40f11', 'request_id': 'req-b940a63a-5090-43eb-9ea5-747fdb487617'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.192439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10acca11ff934913be1e4e6567a40f11', 'request_id': 'req-b940a63a-5090-43eb-9ea5-747fdb487617'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.204379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba982b76fa6b43c0a3930a81bc711362', 'request_id': 'req-5d7b625a-3709-462b-9919-c21456973cd4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.227729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba982b76fa6b43c0a3930a81bc711362', 'request_id': 'req-5d7b625a-3709-462b-9919-c21456973cd4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.236090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10acca11ff934913be1e4e6567a40f11', 'request_id': 'req-b940a63a-5090-43eb-9ea5-747fdb487617'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.237147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba982b76fa6b43c0a3930a81bc711362', 'request_id': 'req-5d7b625a-3709-462b-9919-c21456973cd4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.265162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] The token cache is being invalidate because project ba982b76fa6b43c0a3930a81bc711362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:31.266691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.267972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.279509 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3477/6981] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:30 2022] DELETE /identity/v3/projects/ba982b76fa6b43c0a3930a81bc711362 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:31.281177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:31.287965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:31.320784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] The token cache is being invalidate because project 10acca11ff934913be1e4e6567a40f11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:31.321334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.322996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b940a63a-5090-43eb-9ea5-747fdb487617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.332915 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3505/6982] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:30 2022] DELETE /identity/v3/projects/10acca11ff934913be1e4e6567a40f11 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:46:31.334579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47190c1-cf7b-4f4c-bd53-7f2cce4d3b76 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:31.335028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47190c1-cf7b-4f4c-bd53-7f2cce4d3b76 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:31.335446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47190c1-cf7b-4f4c-bd53-7f2cce4d3b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:31.377120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f47190c1-cf7b-4f4c-bd53-7f2cce4d3b76 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:31.379144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f47190c1-cf7b-4f4c-bd53-7f2cce4d3b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:31.450221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:31.469721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b625a-3709-462b-9919-c21456973cd4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:31.482439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:31.483212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:31.483587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:31.486186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] PATH_INFO: `/v3/users/67f154f53727489688f0388a17007c32` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:31.490333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=67f154f53727489688f0388a17007c32)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:31.494538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:31.525359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:31.535583 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3506/6983] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:31.538019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47190c1-cf7b-4f4c-bd53-7f2cce4d3b76 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:31.545062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f47190c1-cf7b-4f4c-bd53-7f2cce4d3b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:31.589710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47190c1-cf7b-4f4c-bd53-7f2cce4d3b76 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:31.600421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:31.601332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:31.601786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:31.602434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] PATH_INFO: `/v3/users/2712b2583a2c4abfa708e364c38ffdad` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:31.602925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67f154f53727489688f0388a17007c32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.607372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2712b2583a2c4abfa708e364c38ffdad)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:31.609553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:31.628481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67f154f53727489688f0388a17007c32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.663475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67f154f53727489688f0388a17007c32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.682488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67f154f53727489688f0388a17007c32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.683205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35112d7d-b67f-4318-b663-cdfdc082d46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67f154f53727489688f0388a17007c32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.706988 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3478/6984] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:31 2022] DELETE /identity/v3/users/67f154f53727489688f0388a17007c32 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:31.710276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07affb-c39f-4827-a50e-75c704950c19 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:31.710574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07affb-c39f-4827-a50e-75c704950c19 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:31.710834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07affb-c39f-4827-a50e-75c704950c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:31.736253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2712b2583a2c4abfa708e364c38ffdad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.737225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2712b2583a2c4abfa708e364c38ffdad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.751766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2712b2583a2c4abfa708e364c38ffdad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.752811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ce07affb-c39f-4827-a50e-75c704950c19 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:31.756130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ce07affb-c39f-4827-a50e-75c704950c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:31.766045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2712b2583a2c4abfa708e364c38ffdad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.790880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b85f1438-0cf0-4732-b94f-e2c5764157f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2712b2583a2c4abfa708e364c38ffdad'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:31.801137 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3507/6985] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:31 2022] DELETE /identity/v3/users/2712b2583a2c4abfa708e364c38ffdad => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:31.805226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9bf8a-ca77-4d94-b04b-80382a385c6d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:31.805763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9bf8a-ca77-4d94-b04b-80382a385c6d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:31.806162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9bf8a-ca77-4d94-b04b-80382a385c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:31.833370 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3479/6986] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:31.838789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07affb-c39f-4827-a50e-75c704950c19 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:31.849167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07affb-c39f-4827-a50e-75c704950c19 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:31.875298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-06f9bf8a-ca77-4d94-b04b-80382a385c6d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:31.879092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-06f9bf8a-ca77-4d94-b04b-80382a385c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:31.917433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca0ed8-1ba5-42d6-afe1-0a49953fdb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:31.918394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca0ed8-1ba5-42d6-afe1-0a49953fdb53 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:31.918916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca0ed8-1ba5-42d6-afe1-0a49953fdb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:31.919433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca0ed8-1ba5-42d6-afe1-0a49953fdb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:31.920258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca0ed8-1ba5-42d6-afe1-0a49953fdb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:31.920681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca0ed8-1ba5-42d6-afe1-0a49953fdb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:31.922656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca0ed8-1ba5-42d6-afe1-0a49953fdb53 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:31.942051 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3480/6987] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:31.942849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca0ed8-1ba5-42d6-afe1-0a49953fdb53 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:31.955656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca0ed8-1ba5-42d6-afe1-0a49953fdb53 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:31.961375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85162667-a529-4a4f-9e9a-058c666eee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:31.963113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162667-a529-4a4f-9e9a-058c666eee25 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:31.963113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162667-a529-4a4f-9e9a-058c666eee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:31.963113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85162667-a529-4a4f-9e9a-058c666eee25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:31.963958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85162667-a529-4a4f-9e9a-058c666eee25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:31.966646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85162667-a529-4a4f-9e9a-058c666eee25 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:31.997063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:32.014959 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3481/6988] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:31 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:32.016851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85162667-a529-4a4f-9e9a-058c666eee25 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:32.073096 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3508/6989] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:32.107592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9bf8a-ca77-4d94-b04b-80382a385c6d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:32.109064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-06f9bf8a-ca77-4d94-b04b-80382a385c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:32.247062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85162667-a529-4a4f-9e9a-058c666eee25 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:32.264743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c03d8-7c4e-4980-8640-a2cf8e6fcec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:32.267041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c03d8-7c4e-4980-8640-a2cf8e6fcec5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:32.268518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c03d8-7c4e-4980-8640-a2cf8e6fcec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:32.269128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c03d8-7c4e-4980-8640-a2cf8e6fcec5 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:32.270340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c03d8-7c4e-4980-8640-a2cf8e6fcec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:32.278019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c03d8-7c4e-4980-8640-a2cf8e6fcec5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:32.326935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3482/6990] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:32 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:32.331799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:32.332873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c03d8-7c4e-4980-8640-a2cf8e6fcec5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:32.341315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d16c03d8-7c4e-4980-8640-a2cf8e6fcec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:32.351883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9bf8a-ca77-4d94-b04b-80382a385c6d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:32.542758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c86b-689b-4b58-b626-c6c9c374f981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:32.544903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c86b-689b-4b58-b626-c6c9c374f981 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:32.545186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c86b-689b-4b58-b626-c6c9c374f981 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:32.545457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58c86b-689b-4b58-b626-c6c9c374f981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:32.583583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58c86b-689b-4b58-b626-c6c9c374f981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:32.592337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58c86b-689b-4b58-b626-c6c9c374f981 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:32.620157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c03d8-7c4e-4980-8640-a2cf8e6fcec5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:32.621109 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3509/6991] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:46:32.622035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c86b-689b-4b58-b626-c6c9c374f981 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:32.634979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6386311-5dd0-489a-830a-ced6e4f4928a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:32.636284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6386311-5dd0-489a-830a-ced6e4f4928a service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:32.636436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6386311-5dd0-489a-830a-ced6e4f4928a service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:32.637780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6386311-5dd0-489a-830a-ced6e4f4928a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:32.644126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a6386311-5dd0-489a-830a-ced6e4f4928a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:32.646460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58c86b-689b-4b58-b626-c6c9c374f981 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:32.653480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef28a-a654-4e6a-b82b-41cba2150fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:32.654419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef28a-a654-4e6a-b82b-41cba2150fda admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:32.654775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef28a-a654-4e6a-b82b-41cba2150fda admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:32.655103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cef28a-a654-4e6a-b82b-41cba2150fda admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:32.655873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cef28a-a654-4e6a-b82b-41cba2150fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:32.657739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cef28a-a654-4e6a-b82b-41cba2150fda admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:32.676458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6386311-5dd0-489a-830a-ced6e4f4928a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:32.692048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6386311-5dd0-489a-830a-ced6e4f4928a service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:32.721685 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3510/6992] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:32.723234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef28a-a654-4e6a-b82b-41cba2150fda admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:32.755164 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3483/6993] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:32.768740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cef28a-a654-4e6a-b82b-41cba2150fda admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:32.816404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7943b4-6ec6-4ace-a500-b7f157ad3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:32.817455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7943b4-6ec6-4ace-a500-b7f157ad3048 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:32.817992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7943b4-6ec6-4ace-a500-b7f157ad3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:32.818485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7943b4-6ec6-4ace-a500-b7f157ad3048 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:32.819633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7943b4-6ec6-4ace-a500-b7f157ad3048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:32.823635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7943b4-6ec6-4ace-a500-b7f157ad3048 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:32.841033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6386311-5dd0-489a-830a-ced6e4f4928a service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:32.845787 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3511/6994] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:32.857948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6386311-5dd0-489a-830a-ced6e4f4928a service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:32.895641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489dac6-78ea-4908-ac91-0b271dde8145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:32.896355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489dac6-78ea-4908-ac91-0b271dde8145 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:32.898595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489dac6-78ea-4908-ac91-0b271dde8145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:32.898931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489dac6-78ea-4908-ac91-0b271dde8145 admin admin] PATH_INFO: `/v3/projects/28b5d7bf70fa4416b0a4419db2d38e94/users/df042b03595b4ff7be6679c6beb2c46e/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:32.980187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489dac6-78ea-4908-ac91-0b271dde8145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b5d7bf70fa4416b0a4419db2d38e94, user_id=df042b03595b4ff7be6679c6beb2c46e, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:32.983904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489dac6-78ea-4908-ac91-0b271dde8145 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:33.023492 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3484/6995] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:32 2022] PUT /identity/v3/projects/28b5d7bf70fa4416b0a4419db2d38e94/users/df042b03595b4ff7be6679c6beb2c46e/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:46:33.027032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad69d-428d-4839-a055-03ec642b571b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:33.027889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad69d-428d-4839-a055-03ec642b571b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:33.028366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcad69d-428d-4839-a055-03ec642b571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:33.073909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bdcad69d-428d-4839-a055-03ec642b571b None None] MFA Rules not processed for user `df042b03595b4ff7be6679c6beb2c46e`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:33.075556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bdcad69d-428d-4839-a055-03ec642b571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:33.238813 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3512/6996] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:33.243649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489dac6-78ea-4908-ac91-0b271dde8145 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:33.403462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:33.414662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489dac6-78ea-4908-ac91-0b271dde8145 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:33.428133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a4e30-f003-4524-9184-3f691cc6e891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:33.429026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4e30-f003-4524-9184-3f691cc6e891 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:33.430116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4e30-f003-4524-9184-3f691cc6e891 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:33.430557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4e30-f003-4524-9184-3f691cc6e891 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:33.431355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a4e30-f003-4524-9184-3f691cc6e891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:33.437153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a4e30-f003-4524-9184-3f691cc6e891 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:33.527663 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3485/6997] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:33 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:33.528925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcad69d-428d-4839-a055-03ec642b571b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:33.547774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcad69d-428d-4839-a055-03ec642b571b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:33.665933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a4e30-f003-4524-9184-3f691cc6e891 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:33.668084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-000a4e30-f003-4524-9184-3f691cc6e891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:33.734038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1239d-5866-466a-a344-7be41db77693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:33.734686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1239d-5866-466a-a344-7be41db77693 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:33.734943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1239d-5866-466a-a344-7be41db77693 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:33.735212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1239d-5866-466a-a344-7be41db77693 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:33.739416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1239d-5866-466a-a344-7be41db77693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:33.741520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1239d-5866-466a-a344-7be41db77693 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:33.785236 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3513/6998] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:33 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:33.788500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1239d-5866-466a-a344-7be41db77693 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:33.800398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:33.807220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1239d-5866-466a-a344-7be41db77693 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:33.819384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c246f7-9add-49ce-bc05-de48dea33f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:33.821436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c246f7-9add-49ce-bc05-de48dea33f68 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:33.822452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c246f7-9add-49ce-bc05-de48dea33f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:33.822778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c246f7-9add-49ce-bc05-de48dea33f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:33.824180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a4e30-f003-4524-9184-3f691cc6e891 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:33.824311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c246f7-9add-49ce-bc05-de48dea33f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:33.826970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c246f7-9add-49ce-bc05-de48dea33f68 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:33.836778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:33.837435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:33.837710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:33.858275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] PATH_INFO: `/v3/projects/76fe77ce59b7435caaaaeda7f479b9fa` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:33.863522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76fe77ce59b7435caaaaeda7f479b9fa)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:33.873839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:33.881202 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3514/6999] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:33.884205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c246f7-9add-49ce-bc05-de48dea33f68 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:33.918251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c246f7-9add-49ce-bc05-de48dea33f68 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:33.942987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a13dc-d321-4a51-8058-4dadd40acf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:33.950777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a13dc-d321-4a51-8058-4dadd40acf5a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:33.951161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a13dc-d321-4a51-8058-4dadd40acf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:33.951438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a13dc-d321-4a51-8058-4dadd40acf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:33.952144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a13dc-d321-4a51-8058-4dadd40acf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:33.956157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29a13dc-d321-4a51-8058-4dadd40acf5a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:33.977087 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3515/7000] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:33.980284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a13dc-d321-4a51-8058-4dadd40acf5a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:33.999199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a13dc-d321-4a51-8058-4dadd40acf5a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:34.005222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76fe77ce59b7435caaaaeda7f479b9fa', 'request_id': 'req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:34.017097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76fe77ce59b7435caaaaeda7f479b9fa', 'request_id': 'req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:34.030153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76fe77ce59b7435caaaaeda7f479b9fa', 'request_id': 'req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:34.061988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] The token cache is being invalidate because project 76fe77ce59b7435caaaaeda7f479b9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:34.062283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:34.065196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a932cb0-500f-4ebf-9f6c-6e87dffafd43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:34.067093 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3486/7001] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:33 2022] DELETE /identity/v3/projects/76fe77ce59b7435caaaaeda7f479b9fa => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:34.075312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d11176-845e-469f-b1b2-ef8de345dd4e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:34.075592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d11176-845e-469f-b1b2-ef8de345dd4e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:34.078159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d11176-845e-469f-b1b2-ef8de345dd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:34.160007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-46d11176-845e-469f-b1b2-ef8de345dd4e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:34.164646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-46d11176-845e-469f-b1b2-ef8de345dd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:34.198749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360f9f1-5309-42ac-8d64-0a08bfe87fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:34.200655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360f9f1-5309-42ac-8d64-0a08bfe87fea admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:34.200936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360f9f1-5309-42ac-8d64-0a08bfe87fea admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:34.201205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360f9f1-5309-42ac-8d64-0a08bfe87fea admin admin] PATH_INFO: `/v3/projects/887b1be921954b80881f4b80e2154f47/users/1f813c08bb964120bdc798f73976b0b0/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:34.258357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360f9f1-5309-42ac-8d64-0a08bfe87fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=887b1be921954b80881f4b80e2154f47, user_id=1f813c08bb964120bdc798f73976b0b0, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:34.262677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360f9f1-5309-42ac-8d64-0a08bfe87fea admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:34.327118 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3516/7002] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:33 2022] PUT /identity/v3/projects/887b1be921954b80881f4b80e2154f47/users/1f813c08bb964120bdc798f73976b0b0/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:34.330752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff8691-1017-48e0-b3cf-fb0d22c514d4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:34.331324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff8691-1017-48e0-b3cf-fb0d22c514d4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:34.331606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff8691-1017-48e0-b3cf-fb0d22c514d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:34.407835 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3487/7003] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:34.414817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd328db-3774-43cb-a191-312d01c7ef3a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:34.415522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd328db-3774-43cb-a191-312d01c7ef3a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:34.415522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd328db-3774-43cb-a191-312d01c7ef3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:34.438158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3fff8691-1017-48e0-b3cf-fb0d22c514d4 None None] MFA Rules not processed for user `1f813c08bb964120bdc798f73976b0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:34.439965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3fff8691-1017-48e0-b3cf-fb0d22c514d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:34.466621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ddd328db-3774-43cb-a191-312d01c7ef3a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:34.469774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ddd328db-3774-43cb-a191-312d01c7ef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:34.494535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:34.629100 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3517/7004] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:34.636272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff8691-1017-48e0-b3cf-fb0d22c514d4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:34.639946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3fff8691-1017-48e0-b3cf-fb0d22c514d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:34.661025 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3488/7005] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:34.661025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd328db-3774-43cb-a191-312d01c7ef3a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:34.668881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ddd328db-3774-43cb-a191-312d01c7ef3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:34.692496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff8691-1017-48e0-b3cf-fb0d22c514d4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:34.717292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:34.717985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:34.718331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:34.718879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] PATH_INFO: `/v3/projects/1a959c0aeac142c49e3fecdf77e27fa5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:34.725387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a959c0aeac142c49e3fecdf77e27fa5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:34.727672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:34.862781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd328db-3774-43cb-a191-312d01c7ef3a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:34.876092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a959c0aeac142c49e3fecdf77e27fa5', 'request_id': 'req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:34.879790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:34.905258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a959c0aeac142c49e3fecdf77e27fa5', 'request_id': 'req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:34.924686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a959c0aeac142c49e3fecdf77e27fa5', 'request_id': 'req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:34.948243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] The token cache is being invalidate because project 1a959c0aeac142c49e3fecdf77e27fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:34.951517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:34.952525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:34.955600 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3518/7006] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:34 2022] DELETE /identity/v3/projects/1a959c0aeac142c49e3fecdf77e27fa5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:34.956992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:34.962397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:35.015028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f2f0-4cfd-4b3f-ac69-6141dddf82c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:35.016036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f2f0-4cfd-4b3f-ac69-6141dddf82c8 service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:35.016545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f2f0-4cfd-4b3f-ac69-6141dddf82c8 service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:35.016886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f2f0-4cfd-4b3f-ac69-6141dddf82c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:35.021961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eb65f2f0-4cfd-4b3f-ac69-6141dddf82c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:35.155827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efc1c9-8e43-4e3c-8561-e8b2572f79e4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:35.171381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a796b9a-ef8e-4361-ab5a-84e53ddfabf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:35.175934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a796b9a-ef8e-4361-ab5a-84e53ddfabf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:35.176343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a796b9a-ef8e-4361-ab5a-84e53ddfabf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:35.178258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a796b9a-ef8e-4361-ab5a-84e53ddfabf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:35.179103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a796b9a-ef8e-4361-ab5a-84e53ddfabf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:35.181661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a796b9a-ef8e-4361-ab5a-84e53ddfabf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:35.185901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a796b9a-ef8e-4361-ab5a-84e53ddfabf1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:35.194790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f2f0-4cfd-4b3f-ac69-6141dddf82c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:35.197514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f2f0-4cfd-4b3f-ac69-6141dddf82c8 service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:35.212775 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3489/7007] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:35.213696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f2f0-4cfd-4b3f-ac69-6141dddf82c8 service glance] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:35.215244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eb65f2f0-4cfd-4b3f-ac69-6141dddf82c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:35.218719 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3519/7008] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:35.221786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a796b9a-ef8e-4361-ab5a-84e53ddfabf1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:35.235036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f2f0-4cfd-4b3f-ac69-6141dddf82c8 service glance] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:35.235714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a796b9a-ef8e-4361-ab5a-84e53ddfabf1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:35.242426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:35.242660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a04f3-37b0-4dc1-a94a-8127857dada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:35.243091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:35.243422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:35.243532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a04f3-37b0-4dc1-a94a-8127857dada7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:35.243703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] PATH_INFO: `/v3/users/674ba52e93ad45b99819487744d05368` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:35.243970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a04f3-37b0-4dc1-a94a-8127857dada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:35.244333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a04f3-37b0-4dc1-a94a-8127857dada7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:35.244877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] RBAC: Authorizing `identity:delete_user(user_id=674ba52e93ad45b99819487744d05368)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:35.245387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a04f3-37b0-4dc1-a94a-8127857dada7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:35.247175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:35.247527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a04f3-37b0-4dc1-a94a-8127857dada7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:35.270035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:35.290400 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3520/7009] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:35 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:35.294480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a04f3-37b0-4dc1-a94a-8127857dada7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:35.319314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '674ba52e93ad45b99819487744d05368'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:35.340903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '674ba52e93ad45b99819487744d05368'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:35.360227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '674ba52e93ad45b99819487744d05368'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:35.377633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '674ba52e93ad45b99819487744d05368'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:35.378603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '674ba52e93ad45b99819487744d05368'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:35.391512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a04f3-37b0-4dc1-a94a-8127857dada7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:35.402974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49144fd8-3404-4cf5-975e-1aa04f2eb096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:35.402974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49144fd8-3404-4cf5-975e-1aa04f2eb096 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:35.402974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49144fd8-3404-4cf5-975e-1aa04f2eb096 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:35.402974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49144fd8-3404-4cf5-975e-1aa04f2eb096 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:35.403374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49144fd8-3404-4cf5-975e-1aa04f2eb096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:35.404864 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3490/7010] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:35 2022] DELETE /identity/v3/users/674ba52e93ad45b99819487744d05368 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:35.410295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49144fd8-3404-4cf5-975e-1aa04f2eb096 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:35.442441 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3521/7011] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:35 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:35.446527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:35.448600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:35.475482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49144fd8-3404-4cf5-975e-1aa04f2eb096 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:35.479749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-49144fd8-3404-4cf5-975e-1aa04f2eb096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:35.605398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c912732-309d-4677-9df2-1f352416446f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:35.624918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:35.630598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09727a2d-a8e6-4709-a6c3-4c88a39c26be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:35.630598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09727a2d-a8e6-4709-a6c3-4c88a39c26be admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:35.630914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09727a2d-a8e6-4709-a6c3-4c88a39c26be admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:35.631178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09727a2d-a8e6-4709-a6c3-4c88a39c26be admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:35.631797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09727a2d-a8e6-4709-a6c3-4c88a39c26be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:35.633460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09727a2d-a8e6-4709-a6c3-4c88a39c26be admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:35.665894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49144fd8-3404-4cf5-975e-1aa04f2eb096 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:35.694849 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3491/7012] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:35.696750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09727a2d-a8e6-4709-a6c3-4c88a39c26be admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:35.724229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09727a2d-a8e6-4709-a6c3-4c88a39c26be admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:35.736580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bec69-af6d-4489-8434-07c66a05f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:35.738533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bec69-af6d-4489-8434-07c66a05f8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:35.741672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bec69-af6d-4489-8434-07c66a05f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:35.742119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6bec69-af6d-4489-8434-07c66a05f8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:35.743122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bec69-af6d-4489-8434-07c66a05f8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:35.747968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6bec69-af6d-4489-8434-07c66a05f8b4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:35.775013 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3492/7013] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:35.781483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bec69-af6d-4489-8434-07c66a05f8b4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:35.807132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6bec69-af6d-4489-8434-07c66a05f8b4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:35.820808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0f130-ad3d-416e-981b-62f49b188b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:35.821800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f130-ad3d-416e-981b-62f49b188b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:35.822841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f130-ad3d-416e-981b-62f49b188b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:35.827823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc91a85-c7e0-4a66-bd48-1f705e67de93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:35.828829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc91a85-c7e0-4a66-bd48-1f705e67de93 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:35.829215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc91a85-c7e0-4a66-bd48-1f705e67de93 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:35.829611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc91a85-c7e0-4a66-bd48-1f705e67de93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:35.833730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f130-ad3d-416e-981b-62f49b188b22 admin admin] PATH_INFO: `/v3/projects/12108e74029f4046bbd67d232a8f1aaf/users/4f01992e959c428387d42d346ee9eb8c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:35.840024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0fc91a85-c7e0-4a66-bd48-1f705e67de93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:35.854215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0f130-ad3d-416e-981b-62f49b188b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12108e74029f4046bbd67d232a8f1aaf, user_id=4f01992e959c428387d42d346ee9eb8c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:35.857098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0f130-ad3d-416e-981b-62f49b188b22 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:35.892517 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3493/7014] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:35 2022] PUT /identity/v3/projects/12108e74029f4046bbd67d232a8f1aaf/users/4f01992e959c428387d42d346ee9eb8c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:35.894267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29aba-b96b-45d1-8655-fbf2693682fb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:35.894663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29aba-b96b-45d1-8655-fbf2693682fb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:35.895059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e29aba-b96b-45d1-8655-fbf2693682fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:35.939824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-98e29aba-b96b-45d1-8655-fbf2693682fb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:35.941345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-98e29aba-b96b-45d1-8655-fbf2693682fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:35.978400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc91a85-c7e0-4a66-bd48-1f705e67de93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:35.979873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc91a85-c7e0-4a66-bd48-1f705e67de93 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:35.991527 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3522/7015] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:46:36.089964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:36.110494 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3494/7016] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:36.185536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc91a85-c7e0-4a66-bd48-1f705e67de93 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:36.188398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0fc91a85-c7e0-4a66-bd48-1f705e67de93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:36.200890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e29aba-b96b-45d1-8655-fbf2693682fb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:36.202833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-98e29aba-b96b-45d1-8655-fbf2693682fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:36.227938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc91a85-c7e0-4a66-bd48-1f705e67de93 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:36.258759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:36.259865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:36.260257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:36.262230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] PATH_INFO: `/v3/users/17fc1309afe74c32a5cd1c242ea5afaf` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:36.264512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fc1309afe74c32a5cd1c242ea5afaf)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:36.266718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:36.391983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fc1309afe74c32a5cd1c242ea5afaf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:36.394521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fc1309afe74c32a5cd1c242ea5afaf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:36.413122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e29aba-b96b-45d1-8655-fbf2693682fb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:36.415011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fc1309afe74c32a5cd1c242ea5afaf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:36.424775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2f70c-8933-4ae2-bfdf-df05d55ad67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:36.425727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2f70c-8933-4ae2-bfdf-df05d55ad67c service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:36.426208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2f70c-8933-4ae2-bfdf-df05d55ad67c service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:36.426665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2f70c-8933-4ae2-bfdf-df05d55ad67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:36.435229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fc1309afe74c32a5cd1c242ea5afaf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:36.446692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2f70c-8933-4ae2-bfdf-df05d55ad67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:36.448786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2f70c-8933-4ae2-bfdf-df05d55ad67c service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:36.483499 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3495/7017] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:36.495233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fc1309afe74c32a5cd1c242ea5afaf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:36.504037 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3523/7018] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:36 2022] DELETE /identity/v3/users/17fc1309afe74c32a5cd1c242ea5afaf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:36.685645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2f70c-8933-4ae2-bfdf-df05d55ad67c service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:36.687146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3aa2f70c-8933-4ae2-bfdf-df05d55ad67c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:36.719772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:36.721278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:36.722628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2f70c-8933-4ae2-bfdf-df05d55ad67c service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:36.793591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:36.864764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:36.865704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:36.866146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:36.866603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] PATH_INFO: `/v3/projects/9cd4276653da420f801ab9c21a23fa0f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:36.868541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd4276653da420f801ab9c21a23fa0f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:36.870697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:36.911852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4dbc71-73d5-4db4-b446-526c9f4f0f1b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:36.946733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:36.948572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:36.953339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:36.953663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] PATH_INFO: `/v3/users/df042b03595b4ff7be6679c6beb2c46e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:36.955296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df042b03595b4ff7be6679c6beb2c46e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:36.967791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:37.066895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd4276653da420f801ab9c21a23fa0f', 'request_id': 'req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:37.104089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd4276653da420f801ab9c21a23fa0f', 'request_id': 'req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:37.108388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df042b03595b4ff7be6679c6beb2c46e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:37.109571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df042b03595b4ff7be6679c6beb2c46e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:37.127386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd4276653da420f801ab9c21a23fa0f', 'request_id': 'req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:37.132406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df042b03595b4ff7be6679c6beb2c46e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:37.155127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df042b03595b4ff7be6679c6beb2c46e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:37.164587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] The token cache is being invalidate because project 9cd4276653da420f801ab9c21a23fa0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:37.165635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:37.168210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5b45ee26-2070-4f73-99e1-6c5bccfbea9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:37.175897 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3496/7019] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:36 2022] DELETE /identity/v3/projects/9cd4276653da420f801ab9c21a23fa0f => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:37.184342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad1d3-9478-42b4-95eb-ea6f9b59951c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:37.185149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad1d3-9478-42b4-95eb-ea6f9b59951c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:37.187475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad1d3-9478-42b4-95eb-ea6f9b59951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:37.209758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b370db9a-7434-452b-8eeb-1fd3a4c77e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df042b03595b4ff7be6679c6beb2c46e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:37.224801 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3524/7020] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:36 2022] DELETE /identity/v3/users/df042b03595b4ff7be6679c6beb2c46e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:46:37.235538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5dca-6328-4390-86f8-6d48834fa270 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:37.236251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5dca-6328-4390-86f8-6d48834fa270 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:37.236251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5dca-6328-4390-86f8-6d48834fa270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:37.258516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0fcad1d3-9478-42b4-95eb-ea6f9b59951c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:37.260604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fcad1d3-9478-42b4-95eb-ea6f9b59951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:37.291093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f34d5dca-6328-4390-86f8-6d48834fa270 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:37.292338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f34d5dca-6328-4390-86f8-6d48834fa270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:37.330533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:37.435141 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3497/7021] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:37.447951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb732f1-35de-4a5d-88c3-e36493b7aeff None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:37.447951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb732f1-35de-4a5d-88c3-e36493b7aeff None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:37.447951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb732f1-35de-4a5d-88c3-e36493b7aeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:37.517243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9cb732f1-35de-4a5d-88c3-e36493b7aeff None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:37.525596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9cb732f1-35de-4a5d-88c3-e36493b7aeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:37.541055 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3525/7022] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:37.552497 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3498/7023] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:46:37.557051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5dca-6328-4390-86f8-6d48834fa270 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:37.588072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5dca-6328-4390-86f8-6d48834fa270 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:37.612593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9d982-990b-4e8b-ba1b-eecda4791319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:37.614874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9d982-990b-4e8b-ba1b-eecda4791319 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:37.619763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9d982-990b-4e8b-ba1b-eecda4791319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:37.623130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9d982-990b-4e8b-ba1b-eecda4791319 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:37.624170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9d982-990b-4e8b-ba1b-eecda4791319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:37.624725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9d982-990b-4e8b-ba1b-eecda4791319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:37.628771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9d982-990b-4e8b-ba1b-eecda4791319 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:37.694760 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3526/7024] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:37.695606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb732f1-35de-4a5d-88c3-e36493b7aeff None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:37.702260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9d982-990b-4e8b-ba1b-eecda4791319 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:37.705624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5ca9d982-990b-4e8b-ba1b-eecda4791319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:37.706010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb732f1-35de-4a5d-88c3-e36493b7aeff None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:37.723827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62238d3f-764f-45b1-9a09-98d3320805d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:37.724488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62238d3f-764f-45b1-9a09-98d3320805d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:37.724769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62238d3f-764f-45b1-9a09-98d3320805d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:37.724980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62238d3f-764f-45b1-9a09-98d3320805d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:37.725626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62238d3f-764f-45b1-9a09-98d3320805d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:37.728208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62238d3f-764f-45b1-9a09-98d3320805d6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:37.800529 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3499/7025] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:37 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:37.802155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62238d3f-764f-45b1-9a09-98d3320805d6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:37.824775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:37.883781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9d982-990b-4e8b-ba1b-eecda4791319 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:38.008898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62238d3f-764f-45b1-9a09-98d3320805d6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:38.023239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425be48-d9e9-4c5b-be7e-f6c584980fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:38.023908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425be48-d9e9-4c5b-be7e-f6c584980fcb admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:38.024602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425be48-d9e9-4c5b-be7e-f6c584980fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:38.024602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425be48-d9e9-4c5b-be7e-f6c584980fcb admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:38.027086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425be48-d9e9-4c5b-be7e-f6c584980fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:38.027086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425be48-d9e9-4c5b-be7e-f6c584980fcb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:38.083214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87212991-e765-4b7b-a714-b9225acde59e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:38.083852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87212991-e765-4b7b-a714-b9225acde59e service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:38.084129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87212991-e765-4b7b-a714-b9225acde59e service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:38.084401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87212991-e765-4b7b-a714-b9225acde59e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:38.121264 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3500/7026] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:37 2022] POST /identity/v3/users => generated 294 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:38.126154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425be48-d9e9-4c5b-be7e-f6c584980fcb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:38.147235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87212991-e765-4b7b-a714-b9225acde59e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:38.148861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87212991-e765-4b7b-a714-b9225acde59e service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:38.165765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425be48-d9e9-4c5b-be7e-f6c584980fcb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:38.190453 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3527/7027] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:38.194407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983596c5-292a-4d2b-aee1-0b7549473aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:38.195963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983596c5-292a-4d2b-aee1-0b7549473aba admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:38.196243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983596c5-292a-4d2b-aee1-0b7549473aba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:38.200190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983596c5-292a-4d2b-aee1-0b7549473aba admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:38.201209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983596c5-292a-4d2b-aee1-0b7549473aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:38.206893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983596c5-292a-4d2b-aee1-0b7549473aba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:38.241595 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3501/7028] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:38.247744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87212991-e765-4b7b-a714-b9225acde59e service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:38.283733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87212991-e765-4b7b-a714-b9225acde59e service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:38.308552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffe4d1-0b57-4e6f-bf18-1edabd1cbb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:38.310717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffe4d1-0b57-4e6f-bf18-1edabd1cbb7f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:38.313485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffe4d1-0b57-4e6f-bf18-1edabd1cbb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:38.314620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ffe4d1-0b57-4e6f-bf18-1edabd1cbb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:38.316255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffe4d1-0b57-4e6f-bf18-1edabd1cbb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:38.318957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ffe4d1-0b57-4e6f-bf18-1edabd1cbb7f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:38.346898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983596c5-292a-4d2b-aee1-0b7549473aba admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:38.349975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-983596c5-292a-4d2b-aee1-0b7549473aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:38.383618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983596c5-292a-4d2b-aee1-0b7549473aba admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:38.388048 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3528/7029] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:38.389279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffe4d1-0b57-4e6f-bf18-1edabd1cbb7f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:38.408657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:38.410379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:38.412870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:38.412870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] PATH_INFO: `/v3/projects/12b78869c9e74bff88dacb6cf3ad0f26` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:38.414958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b78869c9e74bff88dacb6cf3ad0f26)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:38.420257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:38.426400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ffe4d1-0b57-4e6f-bf18-1edabd1cbb7f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:38.452734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224b789-b194-4720-98fe-9755fa0b9164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:38.453476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224b789-b194-4720-98fe-9755fa0b9164 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:38.454530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224b789-b194-4720-98fe-9755fa0b9164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:38.454915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224b789-b194-4720-98fe-9755fa0b9164 admin admin] PATH_INFO: `/v3/projects/b30c11fdb6a6422faf9ea684a6f8bcdd/users/dcef355530b5463993382be32194a536/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:38.516922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224b789-b194-4720-98fe-9755fa0b9164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30c11fdb6a6422faf9ea684a6f8bcdd, user_id=dcef355530b5463993382be32194a536, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:38.524252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9224b789-b194-4720-98fe-9755fa0b9164 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:38.552235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b78869c9e74bff88dacb6cf3ad0f26', 'request_id': 'req-60702ad8-93aa-4a69-905a-cd654584f24d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:38.570207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b78869c9e74bff88dacb6cf3ad0f26', 'request_id': 'req-60702ad8-93aa-4a69-905a-cd654584f24d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:38.572087 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3529/7030] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:38 2022] PUT /identity/v3/projects/b30c11fdb6a6422faf9ea684a6f8bcdd/users/dcef355530b5463993382be32194a536/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:38.581681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b78869c9e74bff88dacb6cf3ad0f26', 'request_id': 'req-60702ad8-93aa-4a69-905a-cd654584f24d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:38.588798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29b96-aaf4-419c-ad48-fa0db4bcf3a4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:38.589077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29b96-aaf4-419c-ad48-fa0db4bcf3a4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:38.589348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29b96-aaf4-419c-ad48-fa0db4bcf3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:38.598480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] The token cache is being invalidate because project 12b78869c9e74bff88dacb6cf3ad0f26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:38.599156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:38.600525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60702ad8-93aa-4a69-905a-cd654584f24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:38.603106 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3502/7031] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:38 2022] DELETE /identity/v3/projects/12b78869c9e74bff88dacb6cf3ad0f26 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:38.613662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dbd60-7bd3-4488-9a08-217c3cd71b5d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:38.615598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dbd60-7bd3-4488-9a08-217c3cd71b5d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:38.616220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2dbd60-7bd3-4488-9a08-217c3cd71b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:38.653572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:38.678728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8de29b96-aaf4-419c-ad48-fa0db4bcf3a4 None None] MFA Rules not processed for user `dcef355530b5463993382be32194a536`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:38.682349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8de29b96-aaf4-419c-ad48-fa0db4bcf3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:38.720214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3a2dbd60-7bd3-4488-9a08-217c3cd71b5d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:38.724948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3a2dbd60-7bd3-4488-9a08-217c3cd71b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:38.793905 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3530/7032] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:38.798678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de29b96-aaf4-419c-ad48-fa0db4bcf3a4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:38.801968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8de29b96-aaf4-419c-ad48-fa0db4bcf3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:38.891513 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3503/7033] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:46:38.899681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81339d82-62ea-4530-8ed4-20f6d04884d5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:38.900197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81339d82-62ea-4530-8ed4-20f6d04884d5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:38.900549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81339d82-62ea-4530-8ed4-20f6d04884d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.004607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:39.017185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-81339d82-62ea-4530-8ed4-20f6d04884d5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:39.018740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-81339d82-62ea-4530-8ed4-20f6d04884d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:39.054219 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3504/7034] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:39.056437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81339d82-62ea-4530-8ed4-20f6d04884d5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:39.069984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de29b96-aaf4-419c-ad48-fa0db4bcf3a4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:39.078268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81339d82-62ea-4530-8ed4-20f6d04884d5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:39.091882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a172-a68f-4d09-9662-1fdc6857920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:39.092291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01338766-c111-4c94-9ee2-46c49469d0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:39.092652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a172-a68f-4d09-9662-1fdc6857920f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.092930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a172-a68f-4d09-9662-1fdc6857920f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.093080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01338766-c111-4c94-9ee2-46c49469d0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.093178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516a172-a68f-4d09-9662-1fdc6857920f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.093478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01338766-c111-4c94-9ee2-46c49469d0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.093818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01338766-c111-4c94-9ee2-46c49469d0a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.094005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a172-a68f-4d09-9662-1fdc6857920f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:39.094585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01338766-c111-4c94-9ee2-46c49469d0a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:39.094951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01338766-c111-4c94-9ee2-46c49469d0a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:39.096144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516a172-a68f-4d09-9662-1fdc6857920f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:39.101035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01338766-c111-4c94-9ee2-46c49469d0a7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:39.139827 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3505/7035] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:46:39.140781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01338766-c111-4c94-9ee2-46c49469d0a7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:39.162901 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3531/7036] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:38 2022] POST /identity/v3/projects => generated 387 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:46:39.164008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a172-a68f-4d09-9662-1fdc6857920f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:39.182600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01338766-c111-4c94-9ee2-46c49469d0a7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:39.288949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516a172-a68f-4d09-9662-1fdc6857920f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:39.305151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e14b1-4ac6-4927-9015-b4229657d8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:39.305999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e14b1-4ac6-4927-9015-b4229657d8db admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.306817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e14b1-4ac6-4927-9015-b4229657d8db admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.308324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e14b1-4ac6-4927-9015-b4229657d8db admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.309550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e14b1-4ac6-4927-9015-b4229657d8db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:39.313298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e14b1-4ac6-4927-9015-b4229657d8db admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:39.317423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10112ce3-d721-4fd8-8d6b-1b2cee72a343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:39.318430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10112ce3-d721-4fd8-8d6b-1b2cee72a343 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.319528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10112ce3-d721-4fd8-8d6b-1b2cee72a343 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.319872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10112ce3-d721-4fd8-8d6b-1b2cee72a343 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.320596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10112ce3-d721-4fd8-8d6b-1b2cee72a343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:39.323116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10112ce3-d721-4fd8-8d6b-1b2cee72a343 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:39.370967 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3532/7037] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:39 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:39.373115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e14b1-4ac6-4927-9015-b4229657d8db admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:39.394690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e14b1-4ac6-4927-9015-b4229657d8db admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:39.396476 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3506/7038] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:39 2022] POST /identity/v3/projects => generated 367 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:39.402340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10112ce3-d721-4fd8-8d6b-1b2cee72a343 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:39.533592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca83cfd-d392-400c-9238-97e86314ad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:39.535598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca83cfd-d392-400c-9238-97e86314ad3b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.535873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca83cfd-d392-400c-9238-97e86314ad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.536142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca83cfd-d392-400c-9238-97e86314ad3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.536799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca83cfd-d392-400c-9238-97e86314ad3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:39.538459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca83cfd-d392-400c-9238-97e86314ad3b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:39.542427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10112ce3-d721-4fd8-8d6b-1b2cee72a343 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:39.555345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05914df7-4f85-4a92-820b-4adbd2733b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:39.555924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05914df7-4f85-4a92-820b-4adbd2733b70 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.556679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05914df7-4f85-4a92-820b-4adbd2733b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.556679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05914df7-4f85-4a92-820b-4adbd2733b70 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.557064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05914df7-4f85-4a92-820b-4adbd2733b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:39.559050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05914df7-4f85-4a92-820b-4adbd2733b70 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:39.568472 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3533/7039] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:39.570136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca83cfd-d392-400c-9238-97e86314ad3b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:39.584651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca83cfd-d392-400c-9238-97e86314ad3b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:39.594958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:39.599340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54a7c6-0a90-4c1e-9687-52f7e8b3376f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:39.602253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54a7c6-0a90-4c1e-9687-52f7e8b3376f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.602253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54a7c6-0a90-4c1e-9687-52f7e8b3376f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.602253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54a7c6-0a90-4c1e-9687-52f7e8b3376f admin admin] PATH_INFO: `/v3/projects/6401aaf29fc74a07b448ec7eb85a234b/users/b0fd682856db49c3a4a5543320a80882/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.609250 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3507/7040] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:39 2022] POST /identity/v3/users => generated 284 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:39.613829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05914df7-4f85-4a92-820b-4adbd2733b70 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:39.637526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05914df7-4f85-4a92-820b-4adbd2733b70 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:39.673169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c54119-edb1-4f57-9513-3c457efebc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:39.675166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54a7c6-0a90-4c1e-9687-52f7e8b3376f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6401aaf29fc74a07b448ec7eb85a234b, user_id=b0fd682856db49c3a4a5543320a80882, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:39.676494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c54119-edb1-4f57-9513-3c457efebc17 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.683124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c54119-edb1-4f57-9513-3c457efebc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.683124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c54119-edb1-4f57-9513-3c457efebc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.683124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c54119-edb1-4f57-9513-3c457efebc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:39.683570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54a7c6-0a90-4c1e-9687-52f7e8b3376f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:39.690503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c54119-edb1-4f57-9513-3c457efebc17 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:39.725583 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3508/7041] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:39.727909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c54119-edb1-4f57-9513-3c457efebc17 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:39.747915 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3534/7042] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:39 2022] PUT /identity/v3/projects/6401aaf29fc74a07b448ec7eb85a234b/users/b0fd682856db49c3a4a5543320a80882/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:46:39.749558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50814f14-c75b-451d-be7a-29b7a2809d5f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.752053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50814f14-c75b-451d-be7a-29b7a2809d5f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.752491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50814f14-c75b-451d-be7a-29b7a2809d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.756152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c54119-edb1-4f57-9513-3c457efebc17 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:39.821388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-50814f14-c75b-451d-be7a-29b7a2809d5f None None] MFA Rules not processed for user `4f01992e959c428387d42d346ee9eb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:39.824049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-50814f14-c75b-451d-be7a-29b7a2809d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:39.870598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:39.904985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cedce-030e-45f1-af6d-18d2eee9531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:39.905638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cedce-030e-45f1-af6d-18d2eee9531e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.905920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cedce-030e-45f1-af6d-18d2eee9531e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.906191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cedce-030e-45f1-af6d-18d2eee9531e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.906845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cedce-030e-45f1-af6d-18d2eee9531e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:39.909836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cedce-030e-45f1-af6d-18d2eee9531e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:39.937778 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3509/7043] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:46:39.940083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cedce-030e-45f1-af6d-18d2eee9531e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:39.963543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cedce-030e-45f1-af6d-18d2eee9531e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:39.980499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86261cdc-9dcd-4df5-bfb1-5490693d24c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:39.981740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86261cdc-9dcd-4df5-bfb1-5490693d24c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:39.981740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86261cdc-9dcd-4df5-bfb1-5490693d24c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:39.981740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86261cdc-9dcd-4df5-bfb1-5490693d24c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:39.982308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86261cdc-9dcd-4df5-bfb1-5490693d24c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:39.983942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86261cdc-9dcd-4df5-bfb1-5490693d24c5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:40.000886 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3535/7044] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:40.005343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50814f14-c75b-451d-be7a-29b7a2809d5f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:40.024069 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3510/7045] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:40.025003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86261cdc-9dcd-4df5-bfb1-5490693d24c5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:40.029026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50814f14-c75b-451d-be7a-29b7a2809d5f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:40.030873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-86261cdc-9dcd-4df5-bfb1-5490693d24c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:40.042686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353be7c-72cf-41e7-a4f4-0fe3d98ac315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:40.043381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353be7c-72cf-41e7-a4f4-0fe3d98ac315 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:40.043657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353be7c-72cf-41e7-a4f4-0fe3d98ac315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:40.043928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353be7c-72cf-41e7-a4f4-0fe3d98ac315 admin admin] PATH_INFO: `/v3/projects/cb2f36f063ee4249a28d27aca270159d/users/971a57476ed948349c28b32913b897be/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:40.081314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353be7c-72cf-41e7-a4f4-0fe3d98ac315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2f36f063ee4249a28d27aca270159d, user_id=971a57476ed948349c28b32913b897be, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:40.084016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353be7c-72cf-41e7-a4f4-0fe3d98ac315 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:40.115527 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3536/7046] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:40 2022] PUT /identity/v3/projects/cb2f36f063ee4249a28d27aca270159d/users/971a57476ed948349c28b32913b897be/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:40.118992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353be7c-72cf-41e7-a4f4-0fe3d98ac315 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:40.191103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86261cdc-9dcd-4df5-bfb1-5490693d24c5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:40.331256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8c6b-efc0-4653-85df-532526de40df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:40.331656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8c6b-efc0-4653-85df-532526de40df service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:40.331836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8c6b-efc0-4653-85df-532526de40df service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:40.332381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8c6b-efc0-4653-85df-532526de40df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:40.341414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353be7c-72cf-41e7-a4f4-0fe3d98ac315 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:40.357096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb9700-50dc-489b-841a-69b546f3b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:40.357815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9700-50dc-489b-841a-69b546f3b95b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:40.359187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9700-50dc-489b-841a-69b546f3b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:40.359187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb9700-50dc-489b-841a-69b546f3b95b admin admin] PATH_INFO: `/v3/projects/6401aaf29fc74a07b448ec7eb85a234b/users/b0fd682856db49c3a4a5543320a80882/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:40.361048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb9700-50dc-489b-841a-69b546f3b95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6401aaf29fc74a07b448ec7eb85a234b, user_id=b0fd682856db49c3a4a5543320a80882, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:40.366879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb9700-50dc-489b-841a-69b546f3b95b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:40.393640 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3537/7047] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:40 2022] PUT /identity/v3/projects/6401aaf29fc74a07b448ec7eb85a234b/users/b0fd682856db49c3a4a5543320a80882/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:40.394898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a491f-0d4b-45a6-a24b-de01c88c8c83 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:40.395155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a491f-0d4b-45a6-a24b-de01c88c8c83 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:40.395429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a491f-0d4b-45a6-a24b-de01c88c8c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:40.408221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:40.449445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8c6b-efc0-4653-85df-532526de40df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:40.451008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-220a491f-0d4b-45a6-a24b-de01c88c8c83 None None] MFA Rules not processed for user `971a57476ed948349c28b32913b897be`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:40.452304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-220a491f-0d4b-45a6-a24b-de01c88c8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:40.455639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8c6b-efc0-4653-85df-532526de40df service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:40.473076 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3511/7048] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:40.475577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899ba00-f1c4-46a3-aea2-e0bde76f8b47 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:40.476272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899ba00-f1c4-46a3-aea2-e0bde76f8b47 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:40.476900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899ba00-f1c4-46a3-aea2-e0bde76f8b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:40.516230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f899ba00-f1c4-46a3-aea2-e0bde76f8b47 None None] MFA Rules not processed for user `b0fd682856db49c3a4a5543320a80882`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:40.517628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f899ba00-f1c4-46a3-aea2-e0bde76f8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:40.648973 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3538/7049] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:40.654230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a491f-0d4b-45a6-a24b-de01c88c8c83 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:40.737990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:40.791546 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3512/7050] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:40.794914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899ba00-f1c4-46a3-aea2-e0bde76f8b47 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:40.804204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f899ba00-f1c4-46a3-aea2-e0bde76f8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:40.899072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a491f-0d4b-45a6-a24b-de01c88c8c83 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:40.924612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cf0ce-240f-4925-b11d-5110f3cc86fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:40.928539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf0ce-240f-4925-b11d-5110f3cc86fb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:40.929863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf0ce-240f-4925-b11d-5110f3cc86fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:40.930615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cf0ce-240f-4925-b11d-5110f3cc86fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:40.933989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cf0ce-240f-4925-b11d-5110f3cc86fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:40.942511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50cf0ce-240f-4925-b11d-5110f3cc86fb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:40.981475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899ba00-f1c4-46a3-aea2-e0bde76f8b47 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:40.996166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:40.997128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:40.997824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:40.998466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] PATH_INFO: `/v3/projects/28b5d7bf70fa4416b0a4419db2d38e94` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:41.000454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b5d7bf70fa4416b0a4419db2d38e94)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:41.004437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:41.054990 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3539/7051] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:40 2022] POST /identity/v3/projects => generated 365 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:41.058323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cf0ce-240f-4925-b11d-5110f3cc86fb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:41.064278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d50cf0ce-240f-4925-b11d-5110f3cc86fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:41.139117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b5d7bf70fa4416b0a4419db2d38e94', 'request_id': 'req-168726ac-6fff-4b3c-a5f7-031a8065c0e6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:41.166212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b5d7bf70fa4416b0a4419db2d38e94', 'request_id': 'req-168726ac-6fff-4b3c-a5f7-031a8065c0e6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:41.187849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b5d7bf70fa4416b0a4419db2d38e94', 'request_id': 'req-168726ac-6fff-4b3c-a5f7-031a8065c0e6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:41.215107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cf0ce-240f-4925-b11d-5110f3cc86fb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:41.218430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:41.237940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] The token cache is being invalidate because project 28b5d7bf70fa4416b0a4419db2d38e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:41.238304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:41.241060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:41.255562 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3513/7052] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:40 2022] DELETE /identity/v3/projects/28b5d7bf70fa4416b0a4419db2d38e94 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:41.259953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:41.263465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:41.408426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9201d7f-2ad2-46ca-a94f-7b601d21b43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:41.410170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9201d7f-2ad2-46ca-a94f-7b601d21b43c service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:41.411587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9201d7f-2ad2-46ca-a94f-7b601d21b43c service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:41.412111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9201d7f-2ad2-46ca-a94f-7b601d21b43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:41.414562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f9201d7f-2ad2-46ca-a94f-7b601d21b43c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:41.509060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168726ac-6fff-4b3c-a5f7-031a8065c0e6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:41.520023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b889163-57fa-4067-b1af-3990125df0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:41.520783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b889163-57fa-4067-b1af-3990125df0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:41.522071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b889163-57fa-4067-b1af-3990125df0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:41.522441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b889163-57fa-4067-b1af-3990125df0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:41.524201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b889163-57fa-4067-b1af-3990125df0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:41.528610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b889163-57fa-4067-b1af-3990125df0e4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:41.583368 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3514/7053] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:41 2022] POST /identity/v3/users => generated 289 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:41.583368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b889163-57fa-4067-b1af-3990125df0e4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:41.588994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3b889163-57fa-4067-b1af-3990125df0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:41.590165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9201d7f-2ad2-46ca-a94f-7b601d21b43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:41.591655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9201d7f-2ad2-46ca-a94f-7b601d21b43c service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:41.629361 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3540/7054] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:41.642697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9201d7f-2ad2-46ca-a94f-7b601d21b43c service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:41.643758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b889163-57fa-4067-b1af-3990125df0e4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:41.671993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:41.672653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:41.676179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:41.676179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] PATH_INFO: `/v3/users/1f813c08bb964120bdc798f73976b0b0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:41.681463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f813c08bb964120bdc798f73976b0b0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:41.683929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:41.706369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9201d7f-2ad2-46ca-a94f-7b601d21b43c service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:41.725474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc37ef-c3d0-499a-8ac4-a25c0ee943e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:41.728110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc37ef-c3d0-499a-8ac4-a25c0ee943e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:41.729130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc37ef-c3d0-499a-8ac4-a25c0ee943e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:41.732183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc37ef-c3d0-499a-8ac4-a25c0ee943e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:41.736211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc37ef-c3d0-499a-8ac4-a25c0ee943e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:41.740652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc37ef-c3d0-499a-8ac4-a25c0ee943e9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:41.802341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:41.851798 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3541/7055] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:41.854800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc37ef-c3d0-499a-8ac4-a25c0ee943e9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:41.870339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f813c08bb964120bdc798f73976b0b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:41.890178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f813c08bb964120bdc798f73976b0b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:41.894467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc37ef-c3d0-499a-8ac4-a25c0ee943e9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:41.904360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70da2b-f91e-47f3-ad31-f42d531beae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:41.904763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70da2b-f91e-47f3-ad31-f42d531beae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:41.906277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70da2b-f91e-47f3-ad31-f42d531beae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:41.908109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70da2b-f91e-47f3-ad31-f42d531beae3 admin admin] PATH_INFO: `/v3/projects/307e96bc20e2463f95b6a4030898e6e5/users/74cc9c688ff24472a3e2e814b7c35b49/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:41.936763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f813c08bb964120bdc798f73976b0b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:41.944405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70da2b-f91e-47f3-ad31-f42d531beae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307e96bc20e2463f95b6a4030898e6e5, user_id=74cc9c688ff24472a3e2e814b7c35b49, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:41.949678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70da2b-f91e-47f3-ad31-f42d531beae3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:41.962609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f813c08bb964120bdc798f73976b0b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:41.963478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f813c08bb964120bdc798f73976b0b0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:41.977545 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3515/7056] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:41 2022] DELETE /identity/v3/users/1f813c08bb964120bdc798f73976b0b0 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:41.992079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:41.994385 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3542/7057] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:41 2022] PUT /identity/v3/projects/307e96bc20e2463f95b6a4030898e6e5/users/74cc9c688ff24472a3e2e814b7c35b49/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:41.999090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:42.122089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70da2b-f91e-47f3-ad31-f42d531beae3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:42.127498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8f70da2b-f91e-47f3-ad31-f42d531beae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:42.166987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746bfe-e3b7-4186-8721-4636c6f62bac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:42.181200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:42.350694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7781bf-b764-4ad9-9da2-c771f81642dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:42.351566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7781bf-b764-4ad9-9da2-c771f81642dc admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:42.352123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7781bf-b764-4ad9-9da2-c771f81642dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:42.352484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7781bf-b764-4ad9-9da2-c771f81642dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:42.353237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7781bf-b764-4ad9-9da2-c771f81642dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:42.361963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7781bf-b764-4ad9-9da2-c771f81642dc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:42.385055 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3516/7058] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:42.388610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7781bf-b764-4ad9-9da2-c771f81642dc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:42.445008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7781bf-b764-4ad9-9da2-c771f81642dc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:42.468965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0165d7-87d1-4840-8449-630f21af1235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:42.470237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0165d7-87d1-4840-8449-630f21af1235 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:42.470985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0165d7-87d1-4840-8449-630f21af1235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:42.472263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0165d7-87d1-4840-8449-630f21af1235 admin admin] PATH_INFO: `/v3/projects/307e96bc20e2463f95b6a4030898e6e5/users/74cc9c688ff24472a3e2e814b7c35b49/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:42.476231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0165d7-87d1-4840-8449-630f21af1235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307e96bc20e2463f95b6a4030898e6e5, user_id=74cc9c688ff24472a3e2e814b7c35b49, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:42.496248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70da2b-f91e-47f3-ad31-f42d531beae3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:42.500810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0165d7-87d1-4840-8449-630f21af1235 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:42.509671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:42.510370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:42.510647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:42.510926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] PATH_INFO: `/v3/users/dcef355530b5463993382be32194a536` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:42.520692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcef355530b5463993382be32194a536)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:42.530023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:42.554562 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3517/7059] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:42 2022] PUT /identity/v3/projects/307e96bc20e2463f95b6a4030898e6e5/users/74cc9c688ff24472a3e2e814b7c35b49/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:42.564754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8658e2-a182-4cf6-804c-84f977127f89 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:42.565183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8658e2-a182-4cf6-804c-84f977127f89 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:42.567687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8658e2-a182-4cf6-804c-84f977127f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:42.654984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2d8658e2-a182-4cf6-804c-84f977127f89 None None] MFA Rules not processed for user `74cc9c688ff24472a3e2e814b7c35b49`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:42.659469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2d8658e2-a182-4cf6-804c-84f977127f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:42.689367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcef355530b5463993382be32194a536'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:42.690050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcef355530b5463993382be32194a536'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:42.706121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcef355530b5463993382be32194a536'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:42.722413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcef355530b5463993382be32194a536'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:42.756458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2cff1472-a9bf-4f6d-b8cb-6a290c9c4a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcef355530b5463993382be32194a536'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:42.772162 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3543/7060] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:42 2022] DELETE /identity/v3/users/dcef355530b5463993382be32194a536 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:42.778811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c22c8e-b3ac-49d2-b8cb-43d57cc3861a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:42.779092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c22c8e-b3ac-49d2-b8cb-43d57cc3861a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:42.779419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c22c8e-b3ac-49d2-b8cb-43d57cc3861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:42.839167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c6c22c8e-b3ac-49d2-b8cb-43d57cc3861a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:42.839167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c6c22c8e-b3ac-49d2-b8cb-43d57cc3861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:42.925559 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3518/7061] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:42.927159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8658e2-a182-4cf6-804c-84f977127f89 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:42.965359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8658e2-a182-4cf6-804c-84f977127f89 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:42.985214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:43.034044 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3544/7062] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:43.096834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c22c8e-b3ac-49d2-b8cb-43d57cc3861a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:43.099618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c6c22c8e-b3ac-49d2-b8cb-43d57cc3861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:43.143637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd1a13-9f33-4c6c-9360-3edcdaf06fa9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:43.144414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd1a13-9f33-4c6c-9360-3edcdaf06fa9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:43.144831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd1a13-9f33-4c6c-9360-3edcdaf06fa9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:43.145198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd1a13-9f33-4c6c-9360-3edcdaf06fa9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:43.150065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd1a13-9f33-4c6c-9360-3edcdaf06fa9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:43.160618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd1a13-9f33-4c6c-9360-3edcdaf06fa9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:43.202569 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3519/7063] 10.222.0.43 () {60 vars in 1150 bytes} [Tue Aug 30 04:46:42 2022] POST /identity/v3/domains => generated 276 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:43.207525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd1a13-9f33-4c6c-9360-3edcdaf06fa9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:43.237247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:43.274295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c22c8e-b3ac-49d2-b8cb-43d57cc3861a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:43.375890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd1a13-9f33-4c6c-9360-3edcdaf06fa9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:43.385837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e978a-26c4-4f3d-bc02-9119528954a2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:43.387257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e978a-26c4-4f3d-bc02-9119528954a2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:43.387899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e978a-26c4-4f3d-bc02-9119528954a2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:43.388531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e978a-26c4-4f3d-bc02-9119528954a2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:43.389683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e978a-26c4-4f3d-bc02-9119528954a2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:43.391670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e978a-26c4-4f3d-bc02-9119528954a2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:43.466188 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3520/7064] 10.222.0.43 () {60 vars in 1150 bytes} [Tue Aug 30 04:46:43 2022] POST /identity/v3/domains => generated 274 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:43.469861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e978a-26c4-4f3d-bc02-9119528954a2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:43.597423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf56ec7-32c9-415b-897e-56bdb419b785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:43.598452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf56ec7-32c9-415b-897e-56bdb419b785 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:43.599001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf56ec7-32c9-415b-897e-56bdb419b785 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:43.599290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf56ec7-32c9-415b-897e-56bdb419b785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:43.771000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e978a-26c4-4f3d-bc02-9119528954a2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:43.796024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d6071-a373-4907-affa-67ada88fab76 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:43.796695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d6071-a373-4907-affa-67ada88fab76 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:43.797137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d6071-a373-4907-affa-67ada88fab76 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:43.797342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d6071-a373-4907-affa-67ada88fab76 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:43.798061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d6071-a373-4907-affa-67ada88fab76 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:43.806713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d6071-a373-4907-affa-67ada88fab76 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:43.867307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf56ec7-32c9-415b-897e-56bdb419b785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:43.868992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf56ec7-32c9-415b-897e-56bdb419b785 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:43.872660 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3521/7065] 10.222.0.43 () {60 vars in 1150 bytes} [Tue Aug 30 04:46:43 2022] POST /identity/v3/domains => generated 276 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:43.873930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d6071-a373-4907-affa-67ada88fab76 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:43.929672 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3545/7066] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 831 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:44.020480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d6071-a373-4907-affa-67ada88fab76 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:44.042949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a2645-fe32-4a1f-86ec-92f19e664a9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:44.043834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2645-fe32-4a1f-86ec-92f19e664a9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:44.044111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2645-fe32-4a1f-86ec-92f19e664a9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:44.044389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a2645-fe32-4a1f-86ec-92f19e664a9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:44.045076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a2645-fe32-4a1f-86ec-92f19e664a9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:44.055099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a2645-fe32-4a1f-86ec-92f19e664a9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:44.140324 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3522/7067] 10.222.0.43 () {60 vars in 1150 bytes} [Tue Aug 30 04:46:43 2022] POST /identity/v3/domains => generated 279 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:44.141693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf56ec7-32c9-415b-897e-56bdb419b785 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:44.159350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf56ec7-32c9-415b-897e-56bdb419b785 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:44.300576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:44.301694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:44.301914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:44.302520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/fc2913027eaf47f09c396540405729ec` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:44.307690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:44.334642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fc2913027eaf47f09c396540405729ec)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:44.340113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:44.435398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a2645-fe32-4a1f-86ec-92f19e664a9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:44.437927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-071a2645-fe32-4a1f-86ec-92f19e664a9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:44.447724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fc2913027eaf47f09c396540405729ec'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.498891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fc2913027eaf47f09c396540405729ec'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.532629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:44.565758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2913027eaf47f09c396540405729ec', 'request_id': 'req-56ef2488-6ec1-4712-86bb-2fb4797edd9f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.587503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2913027eaf47f09c396540405729ec', 'request_id': 'req-56ef2488-6ec1-4712-86bb-2fb4797edd9f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.611060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2913027eaf47f09c396540405729ec', 'request_id': 'req-56ef2488-6ec1-4712-86bb-2fb4797edd9f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.628595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a2645-fe32-4a1f-86ec-92f19e664a9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:44.686430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] The token cache is being invalidate because project fc2913027eaf47f09c396540405729ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:44.686796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.687473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.702006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fc2913027eaf47f09c396540405729ec', 'request_id': 'req-56ef2488-6ec1-4712-86bb-2fb4797edd9f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.702773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fc2913027eaf47f09c396540405729ec', 'request_id': 'req-56ef2488-6ec1-4712-86bb-2fb4797edd9f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.703462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fc2913027eaf47f09c396540405729ec', 'request_id': 'req-56ef2488-6ec1-4712-86bb-2fb4797edd9f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.725628 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3546/7068] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:46:44 2022] DELETE /identity/v3/domains/fc2913027eaf47f09c396540405729ec => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:46:44.729296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:44.734856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:44.803572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:44.803977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:44.804671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:44.804671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] PATH_INFO: `/v3/projects/887b1be921954b80881f4b80e2154f47` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:44.806707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=887b1be921954b80881f4b80e2154f47)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:44.816993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:44.925352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef2488-6ec1-4712-86bb-2fb4797edd9f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:44.932810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6ecd3-7b91-4bdb-808e-0af24242341e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:44.933475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6ecd3-7b91-4bdb-808e-0af24242341e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:44.933755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6ecd3-7b91-4bdb-808e-0af24242341e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:44.934071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6ecd3-7b91-4bdb-808e-0af24242341e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:44.938305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6ecd3-7b91-4bdb-808e-0af24242341e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:44.940164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6ecd3-7b91-4bdb-808e-0af24242341e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:44.966856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887b1be921954b80881f4b80e2154f47', 'request_id': 'req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:44.967583 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3547/7069] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:46:44 2022] POST /identity/v3/domains => generated 249 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:44.969345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acee24-b330-4016-a0ae-aaa2e411f056 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:44.969529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acee24-b330-4016-a0ae-aaa2e411f056 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:44.969814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acee24-b330-4016-a0ae-aaa2e411f056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:44.994432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887b1be921954b80881f4b80e2154f47', 'request_id': 'req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.016066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887b1be921954b80881f4b80e2154f47', 'request_id': 'req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.031711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] The token cache is being invalidate because project 887b1be921954b80881f4b80e2154f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:45.032351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-61acee24-b330-4016-a0ae-aaa2e411f056 None None] MFA Rules not processed for user `4f01992e959c428387d42d346ee9eb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:45.033167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.034346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-61acee24-b330-4016-a0ae-aaa2e411f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:45.034473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.036488 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3523/7070] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:44 2022] DELETE /identity/v3/projects/887b1be921954b80881f4b80e2154f47 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:46:45.039261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:45.041321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:45.118450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:45.211380 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3548/7071] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:45.221438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51d540-81e2-4bbf-9331-5218cd6622bf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:45.221438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51d540-81e2-4bbf-9331-5218cd6622bf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:45.221438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51d540-81e2-4bbf-9331-5218cd6622bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:45.269491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b5ceb-ab57-4b06-9d10-e700fb49bd99 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:45.284806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:45.286479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bf51d540-81e2-4bbf-9331-5218cd6622bf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:45.287900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bf51d540-81e2-4bbf-9331-5218cd6622bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:45.384897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80834a-3b96-4848-816d-98ca3403e672 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:45.385209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80834a-3b96-4848-816d-98ca3403e672 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:45.385486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80834a-3b96-4848-816d-98ca3403e672 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:45.385762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80834a-3b96-4848-816d-98ca3403e672 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/b2cd25dedbcb4702991f11e1eab2423c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:45.412676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80834a-3b96-4848-816d-98ca3403e672 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b2cd25dedbcb4702991f11e1eab2423c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:45.414858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80834a-3b96-4848-816d-98ca3403e672 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:45.467603 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3549/7072] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:45.471775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51d540-81e2-4bbf-9331-5218cd6622bf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:45.473153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bf51d540-81e2-4bbf-9331-5218cd6622bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:45.495863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d80834a-3b96-4848-816d-98ca3403e672 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.496888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d80834a-3b96-4848-816d-98ca3403e672 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.518132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51d540-81e2-4bbf-9331-5218cd6622bf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:45.589171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d80834a-3b96-4848-816d-98ca3403e672 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.592179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d80834a-3b96-4848-816d-98ca3403e672 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.599870 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3524/7073] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:46:45 2022] PATCH /identity/v3/domains/b2cd25dedbcb4702991f11e1eab2423c => generated 250 bytes in 563 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:45.601175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6acc-fc4f-435e-b8d2-836b8ef5e534 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:45.601458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6acc-fc4f-435e-b8d2-836b8ef5e534 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:45.601728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a6acc-fc4f-435e-b8d2-836b8ef5e534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:45.662096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0e0a6acc-fc4f-435e-b8d2-836b8ef5e534 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:45.663389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0e0a6acc-fc4f-435e-b8d2-836b8ef5e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:45.734091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:45.734804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:45.735082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:45.735347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] PATH_INFO: `/v3/projects/b30c11fdb6a6422faf9ea684a6f8bcdd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:45.740287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30c11fdb6a6422faf9ea684a6f8bcdd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:45.742737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:45.812729 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3525/7074] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:45.816153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a6acc-fc4f-435e-b8d2-836b8ef5e534 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:45.816577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0e0a6acc-fc4f-435e-b8d2-836b8ef5e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:45.859863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30c11fdb6a6422faf9ea684a6f8bcdd', 'request_id': 'req-82f3f532-e07a-4d0e-b244-899e78b8e461'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.868438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30c11fdb6a6422faf9ea684a6f8bcdd', 'request_id': 'req-82f3f532-e07a-4d0e-b244-899e78b8e461'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.886459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30c11fdb6a6422faf9ea684a6f8bcdd', 'request_id': 'req-82f3f532-e07a-4d0e-b244-899e78b8e461'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.916525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] The token cache is being invalidate because project b30c11fdb6a6422faf9ea684a6f8bcdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:45.917178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.919088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:45.923918 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3550/7075] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:45 2022] DELETE /identity/v3/projects/b30c11fdb6a6422faf9ea684a6f8bcdd => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:45.925498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:45.932419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:45.946402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:45.972821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a6acc-fc4f-435e-b8d2-836b8ef5e534 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:46.004960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:46.048154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3f532-e07a-4d0e-b244-899e78b8e461 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:46.062219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74d33e-7ded-4327-9e7e-e0960c2fdc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:46.062219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74d33e-7ded-4327-9e7e-e0960c2fdc93 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.062219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74d33e-7ded-4327-9e7e-e0960c2fdc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.062941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74d33e-7ded-4327-9e7e-e0960c2fdc93 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:46.063552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74d33e-7ded-4327-9e7e-e0960c2fdc93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:46.063996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74d33e-7ded-4327-9e7e-e0960c2fdc93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:46.067120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74d33e-7ded-4327-9e7e-e0960c2fdc93 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:46.076359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:46.077025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.077305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.077579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/b2cd25dedbcb4702991f11e1eab2423c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:46.090089 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3551/7076] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:46.091335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74d33e-7ded-4327-9e7e-e0960c2fdc93 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:46.092254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b2cd25dedbcb4702991f11e1eab2423c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:46.093867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5c74d33e-7ded-4327-9e7e-e0960c2fdc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:46.094030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:46.112401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74d33e-7ded-4327-9e7e-e0960c2fdc93 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:46.118036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:46.118901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.119293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.119727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] PATH_INFO: `/v3/users/b0fd682856db49c3a4a5543320a80882` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:46.122203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0fd682856db49c3a4a5543320a80882)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:46.125200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:46.136930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.143685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.230628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0fd682856db49c3a4a5543320a80882'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.231769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0fd682856db49c3a4a5543320a80882'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.232578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c', 'request_id': 'req-197399ef-941b-49a1-924e-eb9ae7bfaff4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.240601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0fd682856db49c3a4a5543320a80882'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.250611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c', 'request_id': 'req-197399ef-941b-49a1-924e-eb9ae7bfaff4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.257038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0fd682856db49c3a4a5543320a80882'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.267006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c', 'request_id': 'req-197399ef-941b-49a1-924e-eb9ae7bfaff4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.281628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0fd682856db49c3a4a5543320a80882'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.289440 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3552/7077] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:46 2022] DELETE /identity/v3/users/b0fd682856db49c3a4a5543320a80882 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:46.290586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:46.292271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:46.294497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] The token cache is being invalidate because project b2cd25dedbcb4702991f11e1eab2423c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:46.294911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.295710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.310559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c', 'request_id': 'req-197399ef-941b-49a1-924e-eb9ae7bfaff4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.312073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c', 'request_id': 'req-197399ef-941b-49a1-924e-eb9ae7bfaff4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.321051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b2cd25dedbcb4702991f11e1eab2423c', 'request_id': 'req-197399ef-941b-49a1-924e-eb9ae7bfaff4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.335646 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3526/7078] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:46:45 2022] DELETE /identity/v3/domains/b2cd25dedbcb4702991f11e1eab2423c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:46.342049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:46.345324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:46.396514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781268fa-14dd-4410-b9ff-6370763bb652 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:46.403016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53ccce-c51f-4f6e-aec2-fda4173755dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:46.403861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ccce-c51f-4f6e-aec2-fda4173755dc admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.404246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ccce-c51f-4f6e-aec2-fda4173755dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.404592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53ccce-c51f-4f6e-aec2-fda4173755dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:46.407210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53ccce-c51f-4f6e-aec2-fda4173755dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:46.409849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53ccce-c51f-4f6e-aec2-fda4173755dc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:46.444765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:46.452290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:46.458228 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3553/7079] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:46 2022] POST /identity/v3/projects => generated 391 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:46.461034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197399ef-941b-49a1-924e-eb9ae7bfaff4 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:46.464128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53ccce-c51f-4f6e-aec2-fda4173755dc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:46.466908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3f53ccce-c51f-4f6e-aec2-fda4173755dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:46.556372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45bc69-1380-4c8f-91f7-85327a1c076c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:46.557311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45bc69-1380-4c8f-91f7-85327a1c076c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.557746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45bc69-1380-4c8f-91f7-85327a1c076c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.558455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45bc69-1380-4c8f-91f7-85327a1c076c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:46.559474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45bc69-1380-4c8f-91f7-85327a1c076c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:46.562282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53ccce-c51f-4f6e-aec2-fda4173755dc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:46.562421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45bc69-1380-4c8f-91f7-85327a1c076c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:46.570254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8509f4e-696d-495f-a32c-9d0bbcb539c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:46.571184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8509f4e-696d-495f-a32c-9d0bbcb539c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.571563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8509f4e-696d-495f-a32c-9d0bbcb539c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.571934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8509f4e-696d-495f-a32c-9d0bbcb539c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:46.573750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8509f4e-696d-495f-a32c-9d0bbcb539c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:46.577832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8509f4e-696d-495f-a32c-9d0bbcb539c0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:46.611284 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3527/7080] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:46:46 2022] POST /identity/v3/domains => generated 277 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:46.612371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45bc69-1380-4c8f-91f7-85327a1c076c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:46.616746 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3554/7081] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:46 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:46.622646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8509f4e-696d-495f-a32c-9d0bbcb539c0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:46.637120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8509f4e-696d-495f-a32c-9d0bbcb539c0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:46.722049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de7fa2-1ad2-43b2-868e-e1bc029e186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:46.723748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7fa2-1ad2-43b2-868e-e1bc029e186c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.724527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7fa2-1ad2-43b2-868e-e1bc029e186c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.725181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34de7fa2-1ad2-43b2-868e-e1bc029e186c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:46.726083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de7fa2-1ad2-43b2-868e-e1bc029e186c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:46.728639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34de7fa2-1ad2-43b2-868e-e1bc029e186c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:46.743908 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3555/7082] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:46.747711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de7fa2-1ad2-43b2-868e-e1bc029e186c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:46.762011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45bc69-1380-4c8f-91f7-85327a1c076c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:46.769798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34de7fa2-1ad2-43b2-868e-e1bc029e186c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:46.774404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:46.775068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.776642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.776902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/a49448297ea04d338b163df424bf2572` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:46.781788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de96e4-26df-419d-86f3-c9e4399f7198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:46.782441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de96e4-26df-419d-86f3-c9e4399f7198 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.782768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de96e4-26df-419d-86f3-c9e4399f7198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.783033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de96e4-26df-419d-86f3-c9e4399f7198 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:46.783681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de96e4-26df-419d-86f3-c9e4399f7198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:46.785288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de96e4-26df-419d-86f3-c9e4399f7198 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:46.803874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a49448297ea04d338b163df424bf2572)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:46.806568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:46.809647 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3556/7083] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:46.814084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de96e4-26df-419d-86f3-c9e4399f7198 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:46.842870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de96e4-26df-419d-86f3-c9e4399f7198 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:46.849722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d72a4-c916-4acd-b926-bf4f6ecd35cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:46.852195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d72a4-c916-4acd-b926-bf4f6ecd35cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.852737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d72a4-c916-4acd-b926-bf4f6ecd35cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.854249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d72a4-c916-4acd-b926-bf4f6ecd35cc admin admin] PATH_INFO: `/v3/projects/c782e080941645e3bfcf12e5421571f3/users/6c76035a59984bcf926332f1b3a63a81/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:46.867525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a49448297ea04d338b163df424bf2572'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.868884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a49448297ea04d338b163df424bf2572'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.900313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d72a4-c916-4acd-b926-bf4f6ecd35cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c782e080941645e3bfcf12e5421571f3, user_id=6c76035a59984bcf926332f1b3a63a81, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:46.904474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d72a4-c916-4acd-b926-bf4f6ecd35cc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:46.916928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a49448297ea04d338b163df424bf2572'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.918193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a49448297ea04d338b163df424bf2572'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:46.921699 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3528/7084] 10.222.0.43 () {60 vars in 1250 bytes} [Tue Aug 30 04:46:46 2022] PATCH /identity/v3/domains/a49448297ea04d338b163df424bf2572 => generated 279 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:46.926127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:46.928959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:46.937299 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3557/7085] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:46 2022] PUT /identity/v3/projects/c782e080941645e3bfcf12e5421571f3/users/6c76035a59984bcf926332f1b3a63a81/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:46.949941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57d962-bec6-4d60-9446-4a3cfa6d9976 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:46.950223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57d962-bec6-4d60-9446-4a3cfa6d9976 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:46.950494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb57d962-bec6-4d60-9446-4a3cfa6d9976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:47.015589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-eb57d962-bec6-4d60-9446-4a3cfa6d9976 None None] MFA Rules not processed for user `6c76035a59984bcf926332f1b3a63a81`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:47.018704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eb57d962-bec6-4d60-9446-4a3cfa6d9976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:47.036981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:47.044025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32f2f8-109d-4335-a291-0d9e99d7d681 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:47.105683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:47.168034 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3558/7086] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:46:47.172662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57d962-bec6-4d60-9446-4a3cfa6d9976 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:47.176009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eb57d962-bec6-4d60-9446-4a3cfa6d9976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:47.200761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fe19b-f831-4b36-b706-9083c8a84f5b tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:47.211284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe19b-f831-4b36-b706-9083c8a84f5b tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:47.211706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe19b-f831-4b36-b706-9083c8a84f5b tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:47.211904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fe19b-f831-4b36-b706-9083c8a84f5b tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/a49448297ea04d338b163df424bf2572` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:47.258676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fe19b-f831-4b36-b706-9083c8a84f5b tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=a49448297ea04d338b163df424bf2572)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:47.260718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724fe19b-f831-4b36-b706-9083c8a84f5b tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:47.265338 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3529/7087] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:46:46 2022] GET /identity/v3/domains/a49448297ea04d338b163df424bf2572 => generated 279 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:47.266631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fe19b-f831-4b36-b706-9083c8a84f5b tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:47.290261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724fe19b-f831-4b36-b706-9083c8a84f5b tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:47.308550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:47.309213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:47.309500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:47.309779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/a49448297ea04d338b163df424bf2572` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:47.311206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a49448297ea04d338b163df424bf2572)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:47.312988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:47.401217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a49448297ea04d338b163df424bf2572'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:47.413638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb57d962-bec6-4d60-9446-4a3cfa6d9976 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:47.418734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a49448297ea04d338b163df424bf2572'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:47.426217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb24ef-3d87-4cfa-86e4-9df24e5c10dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:47.426979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb24ef-3d87-4cfa-86e4-9df24e5c10dc admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:47.427404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb24ef-3d87-4cfa-86e4-9df24e5c10dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:47.428575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb24ef-3d87-4cfa-86e4-9df24e5c10dc admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:47.429563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb24ef-3d87-4cfa-86e4-9df24e5c10dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:47.440905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb24ef-3d87-4cfa-86e4-9df24e5c10dc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:47.513929 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3559/7088] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:47 2022] POST /identity/v3/projects => generated 391 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:47.517812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb24ef-3d87-4cfa-86e4-9df24e5c10dc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:47.536239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a49448297ea04d338b163df424bf2572', 'request_id': 'req-5f251c79-a500-45ca-855a-0073763a5845'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:47.564967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a49448297ea04d338b163df424bf2572', 'request_id': 'req-5f251c79-a500-45ca-855a-0073763a5845'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:47.576301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a49448297ea04d338b163df424bf2572', 'request_id': 'req-5f251c79-a500-45ca-855a-0073763a5845'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:47.597394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] The token cache is being invalidate because project a49448297ea04d338b163df424bf2572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:47.598571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:47.599968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:47.614929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a49448297ea04d338b163df424bf2572', 'request_id': 'req-5f251c79-a500-45ca-855a-0073763a5845'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:47.616515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a49448297ea04d338b163df424bf2572', 'request_id': 'req-5f251c79-a500-45ca-855a-0073763a5845'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:47.623848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a49448297ea04d338b163df424bf2572', 'request_id': 'req-5f251c79-a500-45ca-855a-0073763a5845'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:47.642878 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3530/7089] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:46:47 2022] DELETE /identity/v3/domains/a49448297ea04d338b163df424bf2572 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:47.645716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:47.647935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:47.700334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb24ef-3d87-4cfa-86e4-9df24e5c10dc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:47.802522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:47.839304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f653d-c4f3-4f12-b81a-2f322370160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:47.840468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f653d-c4f3-4f12-b81a-2f322370160f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:47.841661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f653d-c4f3-4f12-b81a-2f322370160f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:47.842102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f653d-c4f3-4f12-b81a-2f322370160f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:47.842876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f653d-c4f3-4f12-b81a-2f322370160f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:47.847235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f653d-c4f3-4f12-b81a-2f322370160f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:47.872554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251c79-a500-45ca-855a-0073763a5845 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:47.890658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daee85-746e-41e4-be22-b1ad11b8459a tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:47.894566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:47.894729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daee85-746e-41e4-be22-b1ad11b8459a tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:47.894961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daee85-746e-41e4-be22-b1ad11b8459a tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:47.895172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daee85-746e-41e4-be22-b1ad11b8459a tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:47.895826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25daee85-746e-41e4-be22-b1ad11b8459a tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:47.905844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25daee85-746e-41e4-be22-b1ad11b8459a tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:47.910462 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3560/7090] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:47 2022] POST /identity/v3/users => generated 302 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:47.911442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f653d-c4f3-4f12-b81a-2f322370160f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:47.913421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6b1f653d-c4f3-4f12-b81a-2f322370160f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:47.935673 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3531/7091] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Aug 30 04:46:47 2022] GET /identity/v3/domains => generated 1344 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:47.936615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daee85-746e-41e4-be22-b1ad11b8459a tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:47.937142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f653d-c4f3-4f12-b81a-2f322370160f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:47.940452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-25daee85-746e-41e4-be22-b1ad11b8459a tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:47.947695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:47.948353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:47.948632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:47.948902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] PATH_INFO: `/v3/projects/6401aaf29fc74a07b448ec7eb85a234b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:47.958931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6401aaf29fc74a07b448ec7eb85a234b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:47.961041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:47.978344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daee85-746e-41e4-be22-b1ad11b8459a tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:47.994643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a10742-65c5-4aa8-b200-df787ce2c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:47.995338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a10742-65c5-4aa8-b200-df787ce2c2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:47.995612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a10742-65c5-4aa8-b200-df787ce2c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:47.995880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a10742-65c5-4aa8-b200-df787ce2c2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:47.996557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a10742-65c5-4aa8-b200-df787ce2c2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:47.998190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a10742-65c5-4aa8-b200-df787ce2c2f8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:48.013811 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3532/7092] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:48.014700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a10742-65c5-4aa8-b200-df787ce2c2f8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.034827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a10742-65c5-4aa8-b200-df787ce2c2f8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:48.052102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6401aaf29fc74a07b448ec7eb85a234b', 'request_id': 'req-6cd2f923-762a-4a0a-aad4-49569ebd833b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:48.063651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6401aaf29fc74a07b448ec7eb85a234b', 'request_id': 'req-6cd2f923-762a-4a0a-aad4-49569ebd833b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:48.075477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6401aaf29fc74a07b448ec7eb85a234b', 'request_id': 'req-6cd2f923-762a-4a0a-aad4-49569ebd833b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:48.105765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] The token cache is being invalidate because project 6401aaf29fc74a07b448ec7eb85a234b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:48.106103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:48.106886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:48.108903 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3561/7093] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:47 2022] DELETE /identity/v3/projects/6401aaf29fc74a07b448ec7eb85a234b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:48.109747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.118999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:48.153973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf3a03-78d6-407a-b619-e108b1afebaf tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:48.154921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3a03-78d6-407a-b619-e108b1afebaf tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.155512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3a03-78d6-407a-b619-e108b1afebaf tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.155978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf3a03-78d6-407a-b619-e108b1afebaf tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/a49448297ea04d338b163df424bf2572` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.165097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf3a03-78d6-407a-b619-e108b1afebaf tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-90cf3a03-78d6-407a-b619-e108b1afebaf tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Could not find domain: a49448297ea04d338b163df424bf2572.: keystone.exception.DomainNotFound: Could not find domain: a49448297ea04d338b163df424bf2572. Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a49448297ea04d338b163df424bf2572. Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:46:48.170797 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:46:48.171992 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a49448297ea04d338b163df424bf2572. Aug 30 04:46:48.172966 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:48.179220 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3533/7094] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:46:48 2022] PATCH /identity/v3/domains/a49448297ea04d338b163df424bf2572 => generated 112 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:46:48.179636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29a95-bc68-48a0-9d69-6bbae840b42e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.179920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29a95-bc68-48a0-9d69-6bbae840b42e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.180195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb29a95-bc68-48a0-9d69-6bbae840b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.212676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ebb29a95-bc68-48a0-9d69-6bbae840b42e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:48.216573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ebb29a95-bc68-48a0-9d69-6bbae840b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:48.224986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2f923-762a-4a0a-aad4-49569ebd833b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:48.230796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf766f-77ce-4b5c-a151-8b2a3a928e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:48.231455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf766f-77ce-4b5c-a151-8b2a3a928e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.231836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf766f-77ce-4b5c-a151-8b2a3a928e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.232207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf766f-77ce-4b5c-a151-8b2a3a928e22 admin admin] PATH_INFO: `/v3/projects/ea52023ca918472587fa528baaf75b4e/users/6321ebfcddf54f5191c4373990461eed/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.233368 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3534/7095] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:48.234785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29a95-bc68-48a0-9d69-6bbae840b42e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.235472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ebb29a95-bc68-48a0-9d69-6bbae840b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:48.252882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb29a95-bc68-48a0-9d69-6bbae840b42e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:48.257774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcca9a8-c359-4c89-a5a8-d1320400fb91 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:48.258200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca9a8-c359-4c89-a5a8-d1320400fb91 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.258478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca9a8-c359-4c89-a5a8-d1320400fb91 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.258748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcca9a8-c359-4c89-a5a8-d1320400fb91 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.259573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcca9a8-c359-4c89-a5a8-d1320400fb91 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:48.261823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcca9a8-c359-4c89-a5a8-d1320400fb91 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:48.269346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf766f-77ce-4b5c-a151-8b2a3a928e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea52023ca918472587fa528baaf75b4e, user_id=6321ebfcddf54f5191c4373990461eed, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:48.272734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf766f-77ce-4b5c-a151-8b2a3a928e22 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:48.288227 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3535/7096] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:46:48 2022] POST /identity/v3/domains => generated 277 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:48.288227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547f93c-4bee-4e9a-b254-16a8b7527102 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.288227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547f93c-4bee-4e9a-b254-16a8b7527102 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.288791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547f93c-4bee-4e9a-b254-16a8b7527102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.294806 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3562/7097] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:48 2022] PUT /identity/v3/projects/ea52023ca918472587fa528baaf75b4e/users/6321ebfcddf54f5191c4373990461eed/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:48.294806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf766f-77ce-4b5c-a151-8b2a3a928e22 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.319043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4547f93c-4bee-4e9a-b254-16a8b7527102 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:48.320529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4547f93c-4bee-4e9a-b254-16a8b7527102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:48.384562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf766f-77ce-4b5c-a151-8b2a3a928e22 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:48.394837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc5a87-1013-416d-9f10-1b8361b3a0a1 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:48.408547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc5a87-1013-416d-9f10-1b8361b3a0a1 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.408547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc5a87-1013-416d-9f10-1b8361b3a0a1 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.408547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc5a87-1013-416d-9f10-1b8361b3a0a1 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.408547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc5a87-1013-416d-9f10-1b8361b3a0a1 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:48.408547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc5a87-1013-416d-9f10-1b8361b3a0a1 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:48.423559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:48.452950 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3536/7098] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:48.455417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547f93c-4bee-4e9a-b254-16a8b7527102 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.463677 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3563/7099] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:48 2022] POST /identity/v3/users => generated 348 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:48.467636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc5a87-1013-416d-9f10-1b8361b3a0a1 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.468501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547f93c-4bee-4e9a-b254-16a8b7527102 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:48.474104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ba9bd-8a94-453c-b5bb-dd43041a41eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:48.474641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ba9bd-8a94-453c-b5bb-dd43041a41eb admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.474913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ba9bd-8a94-453c-b5bb-dd43041a41eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.476571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ba9bd-8a94-453c-b5bb-dd43041a41eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.477423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ba9bd-8a94-453c-b5bb-dd43041a41eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:48.480846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ba9bd-8a94-453c-b5bb-dd43041a41eb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:48.483243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc5a87-1013-416d-9f10-1b8361b3a0a1 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:48.492799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119441d-36f2-42d4-b407-1bce2e10c834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:48.493583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119441d-36f2-42d4-b407-1bce2e10c834 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.494008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119441d-36f2-42d4-b407-1bce2e10c834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.497312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119441d-36f2-42d4-b407-1bce2e10c834 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.497467 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3537/7100] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:48.497568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119441d-36f2-42d4-b407-1bce2e10c834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:48.497659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ba9bd-8a94-453c-b5bb-dd43041a41eb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.497771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119441d-36f2-42d4-b407-1bce2e10c834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:48.498169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4119441d-36f2-42d4-b407-1bce2e10c834 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:48.533977 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3564/7101] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:48.535096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119441d-36f2-42d4-b407-1bce2e10c834 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.541854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ba9bd-8a94-453c-b5bb-dd43041a41eb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:48.551372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119441d-36f2-42d4-b407-1bce2e10c834 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:48.557818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76dcc2-e68b-43c6-b5f1-21d9a71bbb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:48.558868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76dcc2-e68b-43c6-b5f1-21d9a71bbb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.559245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76dcc2-e68b-43c6-b5f1-21d9a71bbb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.559629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76dcc2-e68b-43c6-b5f1-21d9a71bbb1f admin admin] PATH_INFO: `/v3/projects/ea52023ca918472587fa528baaf75b4e/users/6321ebfcddf54f5191c4373990461eed/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.562571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76dcc2-e68b-43c6-b5f1-21d9a71bbb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea52023ca918472587fa528baaf75b4e, user_id=6321ebfcddf54f5191c4373990461eed, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:48.566107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76dcc2-e68b-43c6-b5f1-21d9a71bbb1f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:48.567475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1670871-6b70-4d95-bf09-fbeb44d0a1f9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:48.568113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1670871-6b70-4d95-bf09-fbeb44d0a1f9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.568395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1670871-6b70-4d95-bf09-fbeb44d0a1f9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.568660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1670871-6b70-4d95-bf09-fbeb44d0a1f9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/groups` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.569301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1670871-6b70-4d95-bf09-fbeb44d0a1f9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:48.575840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1670871-6b70-4d95-bf09-fbeb44d0a1f9 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:48.580742 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3565/7102] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:48 2022] PUT /identity/v3/projects/ea52023ca918472587fa528baaf75b4e/users/6321ebfcddf54f5191c4373990461eed/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:48.582064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76dcc2-e68b-43c6-b5f1-21d9a71bbb1f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.622578 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3538/7103] 10.222.0.43 () {60 vars in 1147 bytes} [Tue Aug 30 04:46:48 2022] POST /identity/v3/groups => generated 325 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:48.624021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028486f-38ab-4e57-a10a-2408c3128caa None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.627349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028486f-38ab-4e57-a10a-2408c3128caa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.627697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028486f-38ab-4e57-a10a-2408c3128caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.686450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:48.695348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76dcc2-e68b-43c6-b5f1-21d9a71bbb1f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:48.703508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17569f1a-6402-4e8c-9801-40187c5adc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:48.704142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17569f1a-6402-4e8c-9801-40187c5adc64 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.704419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17569f1a-6402-4e8c-9801-40187c5adc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.704721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17569f1a-6402-4e8c-9801-40187c5adc64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.705432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17569f1a-6402-4e8c-9801-40187c5adc64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:48.707188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3028486f-38ab-4e57-a10a-2408c3128caa None None] MFA Rules not processed for user `6321ebfcddf54f5191c4373990461eed`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:48.709432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17569f1a-6402-4e8c-9801-40187c5adc64 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:48.710289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3028486f-38ab-4e57-a10a-2408c3128caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:48.779170 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3566/7104] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:48 2022] POST /identity/v3/projects => generated 389 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:48.780266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17569f1a-6402-4e8c-9801-40187c5adc64 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.873770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17569f1a-6402-4e8c-9801-40187c5adc64 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:48.881284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:48.882048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:48.882414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:48.882762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/195783a769f64c598eb05a5e321d580b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:48.885337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=195783a769f64c598eb05a5e321d580b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:48.887361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:48.933665 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3539/7105] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:48 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:48.935069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028486f-38ab-4e57-a10a-2408c3128caa None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:48.948734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '195783a769f64c598eb05a5e321d580b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:48.950008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '195783a769f64c598eb05a5e321d580b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:48.957526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028486f-38ab-4e57-a10a-2408c3128caa None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:49.016069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '195783a769f64c598eb05a5e321d580b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:49.017462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '195783a769f64c598eb05a5e321d580b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:49.023208 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3567/7106] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:46:48 2022] PATCH /identity/v3/domains/195783a769f64c598eb05a5e321d580b => generated 278 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:49.024621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:49.029489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:49.050862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:49.117278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68c816-34fa-4ced-9f03-14c55847e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:49.117930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68c816-34fa-4ced-9f03-14c55847e6ce admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:49.118291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68c816-34fa-4ced-9f03-14c55847e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:49.121444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68c816-34fa-4ced-9f03-14c55847e6ce admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:49.122205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68c816-34fa-4ced-9f03-14c55847e6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:49.126267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68c816-34fa-4ced-9f03-14c55847e6ce admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:49.159821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01da7bc-5358-4190-88d3-33e9d711d6a5 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:49.171454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f066b-4dd6-478f-852f-4ce8d899addb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:49.172596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f066b-4dd6-478f-852f-4ce8d899addb service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:49.173077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f066b-4dd6-478f-852f-4ce8d899addb service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:49.173544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f066b-4dd6-478f-852f-4ce8d899addb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:49.181204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4e5f066b-4dd6-478f-852f-4ce8d899addb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:49.200233 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3540/7107] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:48 2022] POST /identity/v3/users => generated 295 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:49.205681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68c816-34fa-4ced-9f03-14c55847e6ce admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:49.211839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4a68c816-34fa-4ced-9f03-14c55847e6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:49.336374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f066b-4dd6-478f-852f-4ce8d899addb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:49.337859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f066b-4dd6-478f-852f-4ce8d899addb service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:49.350148 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3568/7108] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:49.351185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f066b-4dd6-478f-852f-4ce8d899addb service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:49.352514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4e5f066b-4dd6-478f-852f-4ce8d899addb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:49.370962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f066b-4dd6-478f-852f-4ce8d899addb service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:49.375727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899e81-9470-4ced-a03a-ebdb41e475fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:49.376432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899e81-9470-4ced-a03a-ebdb41e475fd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:49.376710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899e81-9470-4ced-a03a-ebdb41e475fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:49.376975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76899e81-9470-4ced-a03a-ebdb41e475fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:49.377627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76899e81-9470-4ced-a03a-ebdb41e475fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:49.379309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76899e81-9470-4ced-a03a-ebdb41e475fd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:49.392796 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3569/7109] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:49.396707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899e81-9470-4ced-a03a-ebdb41e475fd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:49.409240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76899e81-9470-4ced-a03a-ebdb41e475fd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:49.415709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26282f2-35da-4240-9402-e8b691126e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:49.416335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26282f2-35da-4240-9402-e8b691126e56 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:49.416898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26282f2-35da-4240-9402-e8b691126e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:49.416898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26282f2-35da-4240-9402-e8b691126e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:49.417557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26282f2-35da-4240-9402-e8b691126e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:49.419403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26282f2-35da-4240-9402-e8b691126e56 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:49.431712 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3570/7110] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:49.436402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26282f2-35da-4240-9402-e8b691126e56 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:49.442839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68c816-34fa-4ced-9f03-14c55847e6ce admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:49.456573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26282f2-35da-4240-9402-e8b691126e56 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:49.459771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:49.460448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:49.460733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:49.461007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/195783a769f64c598eb05a5e321d580b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:49.463962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87374141-4924-46bb-92c8-e7eefa3347a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:49.465073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374141-4924-46bb-92c8-e7eefa3347a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:49.466779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374141-4924-46bb-92c8-e7eefa3347a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:49.467242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87374141-4924-46bb-92c8-e7eefa3347a5 admin admin] PATH_INFO: `/v3/projects/32866dc65b7a40fa9d0fe576aefb6dd1/users/af32882d940d4070ae86e3310e9e772c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:49.493736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87374141-4924-46bb-92c8-e7eefa3347a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32866dc65b7a40fa9d0fe576aefb6dd1, user_id=af32882d940d4070ae86e3310e9e772c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:49.496139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=195783a769f64c598eb05a5e321d580b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:49.497752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:49.498403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87374141-4924-46bb-92c8-e7eefa3347a5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:49.523585 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3571/7111] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:49 2022] PUT /identity/v3/projects/32866dc65b7a40fa9d0fe576aefb6dd1/users/af32882d940d4070ae86e3310e9e772c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:49.534989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5995f-ccc9-44c1-9ab5-ad56658b39be None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:49.535318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5995f-ccc9-44c1-9ab5-ad56658b39be None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:49.535534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5995f-ccc9-44c1-9ab5-ad56658b39be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:49.566266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '195783a769f64c598eb05a5e321d580b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:49.568069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:49.573655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '195783a769f64c598eb05a5e321d580b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:49.578748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fde5995f-ccc9-44c1-9ab5-ad56658b39be None None] MFA Rules not processed for user `af32882d940d4070ae86e3310e9e772c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:49.580634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fde5995f-ccc9-44c1-9ab5-ad56658b39be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:49.695194 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3572/7112] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:49.696552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5995f-ccc9-44c1-9ab5-ad56658b39be None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:49.705068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:49.816275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5995f-ccc9-44c1-9ab5-ad56658b39be None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:49.822471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231089ffd81c4f4daea2e3b81c968474'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:49.834809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231089ffd81c4f4daea2e3b81c968474'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:49.860251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231089ffd81c4f4daea2e3b81c968474'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:49.891379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231089ffd81c4f4daea2e3b81c968474'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:49.892072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231089ffd81c4f4daea2e3b81c968474'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:49.898362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe08951-ac73-4da3-9791-b86ddcf8f6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:49.899025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe08951-ac73-4da3-9791-b86ddcf8f6cc admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:49.899341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe08951-ac73-4da3-9791-b86ddcf8f6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:49.899683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe08951-ac73-4da3-9791-b86ddcf8f6cc admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:49.900823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe08951-ac73-4da3-9791-b86ddcf8f6cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:49.903033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe08951-ac73-4da3-9791-b86ddcf8f6cc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:49.943338 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3573/7113] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:49 2022] POST /identity/v3/projects => generated 389 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:46:49.948069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe08951-ac73-4da3-9791-b86ddcf8f6cc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:49.950278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9fe08951-ac73-4da3-9791-b86ddcf8f6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:49.989390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195783a769f64c598eb05a5e321d580b', 'request_id': 'req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:50.017848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195783a769f64c598eb05a5e321d580b', 'request_id': 'req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:50.034873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195783a769f64c598eb05a5e321d580b', 'request_id': 'req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:50.055984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe08951-ac73-4da3-9791-b86ddcf8f6cc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.056208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] The token cache is being invalidate because project 195783a769f64c598eb05a5e321d580b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:50.056682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:50.057359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:50.063197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=76,keystone:DELETE=22,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:50.071667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '195783a769f64c598eb05a5e321d580b', 'request_id': 'req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:50.073046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '195783a769f64c598eb05a5e321d580b', 'request_id': 'req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:50.085366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '195783a769f64c598eb05a5e321d580b', 'request_id': 'req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:50.095810 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3541/7114] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:46:49 2022] DELETE /identity/v3/domains/195783a769f64c598eb05a5e321d580b => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:50.100465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.103220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:50.168617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:50.226249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca6de6-1017-4734-8695-86366ab1279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.227703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6de6-1017-4734-8695-86366ab1279c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.227703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6de6-1017-4734-8695-86366ab1279c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.227703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca6de6-1017-4734-8695-86366ab1279c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.230926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca6de6-1017-4734-8695-86366ab1279c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:50.233396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc8e3-2c57-472f-a39a-b07e5ac47e1f tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.240290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca6de6-1017-4734-8695-86366ab1279c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:50.276952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76012b90-b2a5-479c-be68-e04842f41de2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.277847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76012b90-b2a5-479c-be68-e04842f41de2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.278291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76012b90-b2a5-479c-be68-e04842f41de2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.279404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76012b90-b2a5-479c-be68-e04842f41de2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/195783a769f64c598eb05a5e321d580b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.290323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76012b90-b2a5-479c-be68-e04842f41de2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=195783a769f64c598eb05a5e321d580b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:50.294912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76012b90-b2a5-479c-be68-e04842f41de2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:50.321225 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3574/7115] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:46:49 2022] POST /identity/v3/users => generated 301 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:46:50.326200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca6de6-1017-4734-8695-86366ab1279c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.332867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d4ca6de6-1017-4734-8695-86366ab1279c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-76012b90-b2a5-479c-be68-e04842f41de2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Could not find domain: 195783a769f64c598eb05a5e321d580b.: keystone.exception.DomainNotFound: Could not find domain: 195783a769f64c598eb05a5e321d580b. Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 195783a769f64c598eb05a5e321d580b. Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:46:50.341240 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:46:50.342489 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 195783a769f64c598eb05a5e321d580b. Aug 30 04:46:50.343673 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:50.352205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3542/7116] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:46:50 2022] GET /identity/v3/domains/195783a769f64c598eb05a5e321d580b => generated 112 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:46:50.353500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76012b90-b2a5-479c-be68-e04842f41de2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.367813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76012b90-b2a5-479c-be68-e04842f41de2 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.377672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c3cc9-bc12-4228-b978-7650a9bcd35e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.378767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c3cc9-bc12-4228-b978-7650a9bcd35e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.379181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c3cc9-bc12-4228-b978-7650a9bcd35e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.379576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c3cc9-bc12-4228-b978-7650a9bcd35e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/users/231089ffd81c4f4daea2e3b81c968474` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.394119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca6de6-1017-4734-8695-86366ab1279c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.407842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab1793-79ad-4752-b11a-1ef938aed034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.408988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab1793-79ad-4752-b11a-1ef938aed034 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.409173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab1793-79ad-4752-b11a-1ef938aed034 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.411619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c3cc9-bc12-4228-b978-7650a9bcd35e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:get_user(user_id=231089ffd81c4f4daea2e3b81c968474)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:50.414753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c3cc9-bc12-4228-b978-7650a9bcd35e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:50.421742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab1793-79ad-4752-b11a-1ef938aed034 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.424589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab1793-79ad-4752-b11a-1ef938aed034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-472c3cc9-bc12-4228-b978-7650a9bcd35e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Could not find user: 231089ffd81c4f4daea2e3b81c968474.: keystone.exception.UserNotFound: Could not find user: 231089ffd81c4f4daea2e3b81c968474. Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 04:46:50.431784 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:46:50.432976 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 231089ffd81c4f4daea2e3b81c968474. Aug 30 04:46:50.434252 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:50.435133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab1793-79ad-4752-b11a-1ef938aed034 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:50.441568 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3543/7117] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Aug 30 04:46:50 2022] GET /identity/v3/users/231089ffd81c4f4daea2e3b81c968474 => generated 110 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:46:50.445819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c3cc9-bc12-4228-b978-7650a9bcd35e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.458165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c3cc9-bc12-4228-b978-7650a9bcd35e tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.463590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0ec76-ba67-4416-a14c-03788807b9aa tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.464428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0ec76-ba67-4416-a14c-03788807b9aa tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.464718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0ec76-ba67-4416-a14c-03788807b9aa tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.465208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0ec76-ba67-4416-a14c-03788807b9aa tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/groups/6560b9db3f2f4075b395bf884d6fcc9a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.480224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0ec76-ba67-4416-a14c-03788807b9aa tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:get_group(group_id=6560b9db3f2f4075b395bf884d6fcc9a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:50.481440 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-afa0ec76-ba67-4416-a14c-03788807b9aa tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:46:50.481440 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:46:50.481440 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:46:50.482839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0ec76-ba67-4416-a14c-03788807b9aa tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:50.499132 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3575/7118] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:50.506902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab1793-79ad-4752-b11a-1ef938aed034 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-afa0ec76-ba67-4416-a14c-03788807b9aa tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Could not find group: 6560b9db3f2f4075b395bf884d6fcc9a.: keystone.exception.GroupNotFound: Could not find group: 6560b9db3f2f4075b395bf884d6fcc9a. Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 30 04:46:50.515354 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:46:50.516602 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 6560b9db3f2f4075b395bf884d6fcc9a. Aug 30 04:46:50.518203 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:50.524094 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3544/7119] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:50 2022] GET /identity/v3/groups/6560b9db3f2f4075b395bf884d6fcc9a => generated 111 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:46:50.527160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0ec76-ba67-4416-a14c-03788807b9aa tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.544575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab1793-79ad-4752-b11a-1ef938aed034 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.549202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0ec76-ba67-4416-a14c-03788807b9aa tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.562238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d81c0-a556-49cc-9952-5f2c825f3d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.563194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d81c0-a556-49cc-9952-5f2c825f3d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.563364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d81c0-a556-49cc-9952-5f2c825f3d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.563762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d81c0-a556-49cc-9952-5f2c825f3d85 admin admin] PATH_INFO: `/v3/projects/28f1103860874f70b88d066f41efaaf0/users/1f4f9179cdaf49548317e3b9b35429df/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.564886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3549b17-92fd-4bdb-8f63-7f3fdce4332d tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.565855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549b17-92fd-4bdb-8f63-7f3fdce4332d tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.566308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549b17-92fd-4bdb-8f63-7f3fdce4332d tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.567035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549b17-92fd-4bdb-8f63-7f3fdce4332d tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/groups/6560b9db3f2f4075b395bf884d6fcc9a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.588453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3549b17-92fd-4bdb-8f63-7f3fdce4332d tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-c3549b17-92fd-4bdb-8f63-7f3fdce4332d tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Could not find group: 6560b9db3f2f4075b395bf884d6fcc9a.: keystone.exception.GroupNotFound: Could not find group: 6560b9db3f2f4075b395bf884d6fcc9a. Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 30 04:46:50.602152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:46:50.603152 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 6560b9db3f2f4075b395bf884d6fcc9a. Aug 30 04:46:50.605075 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:50.612715 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3545/7120] 10.222.0.43 () {58 vars in 1227 bytes} [Tue Aug 30 04:46:50 2022] DELETE /identity/v3/groups/6560b9db3f2f4075b395bf884d6fcc9a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:46:50.614236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3549b17-92fd-4bdb-8f63-7f3fdce4332d tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.620554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d81c0-a556-49cc-9952-5f2c825f3d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f1103860874f70b88d066f41efaaf0, user_id=1f4f9179cdaf49548317e3b9b35429df, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:50.626371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d81c0-a556-49cc-9952-5f2c825f3d85 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:50.645961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3549b17-92fd-4bdb-8f63-7f3fdce4332d tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.669374 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3576/7121] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:50 2022] PUT /identity/v3/projects/28f1103860874f70b88d066f41efaaf0/users/1f4f9179cdaf49548317e3b9b35429df/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:50.669649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee20d7-700a-4c67-9c88-8cabc6557a73 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.670502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee20d7-700a-4c67-9c88-8cabc6557a73 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.670776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee20d7-700a-4c67-9c88-8cabc6557a73 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.671044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee20d7-700a-4c67-9c88-8cabc6557a73 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/users/231089ffd81c4f4daea2e3b81c968474` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.675054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d81c0-a556-49cc-9952-5f2c825f3d85 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.702020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee20d7-700a-4c67-9c88-8cabc6557a73 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:delete_user(user_id=231089ffd81c4f4daea2e3b81c968474)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:50.706634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee20d7-700a-4c67-9c88-8cabc6557a73 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-49ee20d7-700a-4c67-9c88-8cabc6557a73 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Could not find user: 231089ffd81c4f4daea2e3b81c968474.: keystone.exception.UserNotFound: Could not find user: 231089ffd81c4f4daea2e3b81c968474. Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 30 04:46:50.730962 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:46:50.731985 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 231089ffd81c4f4daea2e3b81c968474. Aug 30 04:46:50.733072 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:50.742429 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3546/7122] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:50 2022] DELETE /identity/v3/users/231089ffd81c4f4daea2e3b81c968474 => generated 110 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:46:50.744006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee20d7-700a-4c67-9c88-8cabc6557a73 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.762895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee20d7-700a-4c67-9c88-8cabc6557a73 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.815342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d81c0-a556-49cc-9952-5f2c825f3d85 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.826070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf982d-e3fc-496f-b88b-2b404de68f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.826848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf982d-e3fc-496f-b88b-2b404de68f98 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.827127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf982d-e3fc-496f-b88b-2b404de68f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.827391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf982d-e3fc-496f-b88b-2b404de68f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.828290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf982d-e3fc-496f-b88b-2b404de68f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:50.831201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf982d-e3fc-496f-b88b-2b404de68f98 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:50.860681 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3577/7123] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:50.865540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf982d-e3fc-496f-b88b-2b404de68f98 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.869274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776360f4-b2b0-4fa3-9cb5-a9fc72240d4c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.872045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776360f4-b2b0-4fa3-9cb5-a9fc72240d4c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.872360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776360f4-b2b0-4fa3-9cb5-a9fc72240d4c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.872643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776360f4-b2b0-4fa3-9cb5-a9fc72240d4c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/195783a769f64c598eb05a5e321d580b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.886577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776360f4-b2b0-4fa3-9cb5-a9fc72240d4c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-776360f4-b2b0-4fa3-9cb5-a9fc72240d4c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Could not find domain: 195783a769f64c598eb05a5e321d580b.: keystone.exception.DomainNotFound: Could not find domain: 195783a769f64c598eb05a5e321d580b. Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 195783a769f64c598eb05a5e321d580b. Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:46:50.893205 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:46:50.894486 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 195783a769f64c598eb05a5e321d580b. Aug 30 04:46:50.895601 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:50.896781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf982d-e3fc-496f-b88b-2b404de68f98 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.905003 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3547/7124] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:46:50 2022] PATCH /identity/v3/domains/195783a769f64c598eb05a5e321d580b => generated 112 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:46:50.906491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776360f4-b2b0-4fa3-9cb5-a9fc72240d4c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:50.917647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce99e07-4005-4fdf-a77e-1716150b3090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.918706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99e07-4005-4fdf-a77e-1716150b3090 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.918989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99e07-4005-4fdf-a77e-1716150b3090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.919260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce99e07-4005-4fdf-a77e-1716150b3090 admin admin] PATH_INFO: `/v3/projects/28f1103860874f70b88d066f41efaaf0/users/1f4f9179cdaf49548317e3b9b35429df/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.921600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776360f4-b2b0-4fa3-9cb5-a9fc72240d4c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:50.929256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce99e07-4005-4fdf-a77e-1716150b3090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28f1103860874f70b88d066f41efaaf0, user_id=1f4f9179cdaf49548317e3b9b35429df, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:50.929567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371fcad-9096-4c6f-807f-dab0967d51eb tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:50.930506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371fcad-9096-4c6f-807f-dab0967d51eb tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:50.931019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371fcad-9096-4c6f-807f-dab0967d51eb tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:50.931526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371fcad-9096-4c6f-807f-dab0967d51eb tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:50.932031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce99e07-4005-4fdf-a77e-1716150b3090 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:50.932730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371fcad-9096-4c6f-807f-dab0967d51eb tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:50.934699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371fcad-9096-4c6f-807f-dab0967d51eb tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:50.965934 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3548/7125] 10.222.0.43 () {58 vars in 1128 bytes} [Tue Aug 30 04:46:50 2022] GET /identity/v3/domains => generated 1344 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:50.973313 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3578/7126] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:46:50 2022] PUT /identity/v3/projects/28f1103860874f70b88d066f41efaaf0/users/1f4f9179cdaf49548317e3b9b35429df/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:51.005342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371fcad-9096-4c6f-807f-dab0967d51eb tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:51.005602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790707e3-2de0-41d4-8089-0fd5a801e472 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:51.005602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790707e3-2de0-41d4-8089-0fd5a801e472 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:51.005602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790707e3-2de0-41d4-8089-0fd5a801e472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:51.032054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371fcad-9096-4c6f-807f-dab0967d51eb tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:51.052236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:51.103846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-790707e3-2de0-41d4-8089-0fd5a801e472 None None] MFA Rules not processed for user `1f4f9179cdaf49548317e3b9b35429df`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:51.105231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-790707e3-2de0-41d4-8089-0fd5a801e472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:51.159074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731b3a6-98a2-47c7-8132-813f75c8a257 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:51.160083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b3a6-98a2-47c7-8132-813f75c8a257 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:51.160471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b3a6-98a2-47c7-8132-813f75c8a257 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:51.161136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731b3a6-98a2-47c7-8132-813f75c8a257 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:51.161616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731b3a6-98a2-47c7-8132-813f75c8a257 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:51.162415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731b3a6-98a2-47c7-8132-813f75c8a257 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:51.164249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731b3a6-98a2-47c7-8132-813f75c8a257 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:51.189459 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3549/7127] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:51 2022] GET /identity/v3/domains?enabled=True => generated 1092 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:46:51.197805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731b3a6-98a2-47c7-8132-813f75c8a257 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:51.221649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731b3a6-98a2-47c7-8132-813f75c8a257 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:51.227146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2defe08-e248-495b-adb3-37398fcac222 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:51.229296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2defe08-e248-495b-adb3-37398fcac222 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:51.229296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2defe08-e248-495b-adb3-37398fcac222 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:51.229296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2defe08-e248-495b-adb3-37398fcac222 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:51.229296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2defe08-e248-495b-adb3-37398fcac222 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-513030493) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:51.229837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2defe08-e248-495b-adb3-37398fcac222 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:51.232355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2defe08-e248-495b-adb3-37398fcac222 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:51.254599 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3550/7128] 10.222.0.43 () {58 vars in 1197 bytes} [Tue Aug 30 04:46:51 2022] GET /identity/v3/domains?name=tempest-test_domain-513030493 => generated 407 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:46:51.256384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2defe08-e248-495b-adb3-37398fcac222 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:51.273191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2defe08-e248-495b-adb3-37398fcac222 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:51.279437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fcaf0-1e09-47ca-ac76-68b8810dc592 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:51.280545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fcaf0-1e09-47ca-ac76-68b8810dc592 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:51.280931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fcaf0-1e09-47ca-ac76-68b8810dc592 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:51.281306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fcaf0-1e09-47ca-ac76-68b8810dc592 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/195783a769f64c598eb05a5e321d580b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:51.305889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fcaf0-1e09-47ca-ac76-68b8810dc592 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-f22fcaf0-1e09-47ca-ac76-68b8810dc592 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Could not find domain: 195783a769f64c598eb05a5e321d580b.: keystone.exception.DomainNotFound: Could not find domain: 195783a769f64c598eb05a5e321d580b. Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 195783a769f64c598eb05a5e321d580b. Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:46:51.308804 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:46:51.309768 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 195783a769f64c598eb05a5e321d580b. Aug 30 04:46:51.311246 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:46:51.316005 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3551/7129] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:46:51 2022] PATCH /identity/v3/domains/195783a769f64c598eb05a5e321d580b => generated 112 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:46:51.317279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fcaf0-1e09-47ca-ac76-68b8810dc592 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:51.332644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fcaf0-1e09-47ca-ac76-68b8810dc592 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:51.338611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee75be-970b-4448-bee7-f7cfde56b9ea tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:51.339311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee75be-970b-4448-bee7-f7cfde56b9ea tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:51.339638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee75be-970b-4448-bee7-f7cfde56b9ea tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:51.339914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee75be-970b-4448-bee7-f7cfde56b9ea tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/777c21b8748c49faabd3a771844f0eb8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:51.342215 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3579/7130] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:51.361478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790707e3-2de0-41d4-8089-0fd5a801e472 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:51.377169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-790707e3-2de0-41d4-8089-0fd5a801e472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:51.403289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:51.406009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee75be-970b-4448-bee7-f7cfde56b9ea tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=777c21b8748c49faabd3a771844f0eb8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:51.408872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee75be-970b-4448-bee7-f7cfde56b9ea tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:51.554508 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3552/7131] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:46:51 2022] PATCH /identity/v3/domains/777c21b8748c49faabd3a771844f0eb8 => generated 276 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:51.555162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790707e3-2de0-41d4-8089-0fd5a801e472 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:51.556300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee75be-970b-4448-bee7-f7cfde56b9ea tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:51.560796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33605f-39eb-4c18-9217-bb7924534ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:51.561735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33605f-39eb-4c18-9217-bb7924534ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:51.561934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33605f-39eb-4c18-9217-bb7924534ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:51.562307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33605f-39eb-4c18-9217-bb7924534ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:51.570338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee75be-970b-4448-bee7-f7cfde56b9ea tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:51.582196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33605f-39eb-4c18-9217-bb7924534ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:51.583460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33605f-39eb-4c18-9217-bb7924534ed6 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:51.587160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:51.588355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:51.588355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:51.588355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/777c21b8748c49faabd3a771844f0eb8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:51.598901 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3580/7132] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:46:51.621279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=777c21b8748c49faabd3a771844f0eb8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:51.625633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:51.673974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '777c21b8748c49faabd3a771844f0eb8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:51.681016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '777c21b8748c49faabd3a771844f0eb8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:51.758481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777c21b8748c49faabd3a771844f0eb8', 'request_id': 'req-a8b91011-bc5d-4407-847a-d3cc052b1452'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:51.774688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777c21b8748c49faabd3a771844f0eb8', 'request_id': 'req-a8b91011-bc5d-4407-847a-d3cc052b1452'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:51.784730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777c21b8748c49faabd3a771844f0eb8', 'request_id': 'req-a8b91011-bc5d-4407-847a-d3cc052b1452'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:51.791336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:51.805362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] The token cache is being invalidate because project 777c21b8748c49faabd3a771844f0eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:51.805743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:51.806688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:51.817669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '777c21b8748c49faabd3a771844f0eb8', 'request_id': 'req-a8b91011-bc5d-4407-847a-d3cc052b1452'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:51.819223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '777c21b8748c49faabd3a771844f0eb8', 'request_id': 'req-a8b91011-bc5d-4407-847a-d3cc052b1452'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:51.825291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '777c21b8748c49faabd3a771844f0eb8', 'request_id': 'req-a8b91011-bc5d-4407-847a-d3cc052b1452'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:51.833838 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3553/7133] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:46:51 2022] DELETE /identity/v3/domains/777c21b8748c49faabd3a771844f0eb8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:46:51.839636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33605f-39eb-4c18-9217-bb7924534ed6 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:51.864564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33605f-39eb-4c18-9217-bb7924534ed6 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:51.974166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:51.976122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:52.102324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:52.105180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:52.107355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:52.108486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/e2e0955f481c4f71ac782728ea2e237e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:52.142295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e2e0955f481c4f71ac782728ea2e237e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:52.144339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:52.198144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.199222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.225890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b91011-bc5d-4407-847a-d3cc052b1452 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:52.248191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.251883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.260197 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3581/7134] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:46:51 2022] PATCH /identity/v3/domains/e2e0955f481c4f71ac782728ea2e237e => generated 275 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:52.262726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:52.264639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:52.350120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:52.350840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:52.351186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:52.351524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] PATH_INFO: `/v3/users/af32882d940d4070ae86e3310e9e772c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:52.352991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af32882d940d4070ae86e3310e9e772c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:52.355133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:52.397375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914926e0-fa37-4e66-b4ce-6b53dc43908c tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:52.411550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:52.412232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:52.412512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:52.412879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/e2e0955f481c4f71ac782728ea2e237e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:52.455966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:52.461819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af32882d940d4070ae86e3310e9e772c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.471613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af32882d940d4070ae86e3310e9e772c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.476718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e2e0955f481c4f71ac782728ea2e237e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:52.478448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:52.509354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af32882d940d4070ae86e3310e9e772c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.516531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=16,keystone:SELECT=83,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:52.537727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af32882d940d4070ae86e3310e9e772c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.539299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-502dae6a-91de-4ac3-a59d-0bff6fecabb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af32882d940d4070ae86e3310e9e772c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.551031 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3554/7135] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:51 2022] DELETE /identity/v3/users/af32882d940d4070ae86e3310e9e772c => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:52.551704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.555608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45d791-747b-4a92-b446-da59627ce971 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:52.556095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45d791-747b-4a92-b446-da59627ce971 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:52.556192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45d791-747b-4a92-b446-da59627ce971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:52.576420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.608960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1c45d791-747b-4a92-b446-da59627ce971 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:52.612546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1c45d791-747b-4a92-b446-da59627ce971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:52.687783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e', 'request_id': 'req-b60d8a9e-70ab-437c-a49c-9ec873d5b427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.711783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e', 'request_id': 'req-b60d8a9e-70ab-437c-a49c-9ec873d5b427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.758883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e', 'request_id': 'req-b60d8a9e-70ab-437c-a49c-9ec873d5b427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.805778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] The token cache is being invalidate because project e2e0955f481c4f71ac782728ea2e237e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:52.811170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.813797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.820553 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3555/7136] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:46:52.820553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45d791-747b-4a92-b446-da59627ce971 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:52.830388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1c45d791-747b-4a92-b446-da59627ce971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:52.854177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e', 'request_id': 'req-b60d8a9e-70ab-437c-a49c-9ec873d5b427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.855856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e', 'request_id': 'req-b60d8a9e-70ab-437c-a49c-9ec873d5b427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.859525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e2e0955f481c4f71ac782728ea2e237e', 'request_id': 'req-b60d8a9e-70ab-437c-a49c-9ec873d5b427'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:52.899906 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3582/7137] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:46:52 2022] DELETE /identity/v3/domains/e2e0955f481c4f71ac782728ea2e237e => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:52.906691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:52.911545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:53.087809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45d791-747b-4a92-b446-da59627ce971 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:53.115308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d8a9e-70ab-437c-a49c-9ec873d5b427 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:53.126036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:53.126965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:53.127261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:53.128375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/20eeb602c2514836b3fd781216337085` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:53.164359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=20eeb602c2514836b3fd781216337085)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:53.166372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:53.214233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '20eeb602c2514836b3fd781216337085'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.215290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '20eeb602c2514836b3fd781216337085'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.273436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:53.286086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '20eeb602c2514836b3fd781216337085'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.287766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '20eeb602c2514836b3fd781216337085'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.303189 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3583/7138] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:46:52 2022] PATCH /identity/v3/domains/20eeb602c2514836b3fd781216337085 => generated 277 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:53.304331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:53.311675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:53.340001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076db41b-6d7d-44d2-b1a8-97455e4d74a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:53.342440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076db41b-6d7d-44d2-b1a8-97455e4d74a6 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:53.342721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076db41b-6d7d-44d2-b1a8-97455e4d74a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:53.342989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076db41b-6d7d-44d2-b1a8-97455e4d74a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:53.348915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-076db41b-6d7d-44d2-b1a8-97455e4d74a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:53.389848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076db41b-6d7d-44d2-b1a8-97455e4d74a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:53.398654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076db41b-6d7d-44d2-b1a8-97455e4d74a6 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:53.442334 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3556/7139] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:53.443557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076db41b-6d7d-44d2-b1a8-97455e4d74a6 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:53.451098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-076db41b-6d7d-44d2-b1a8-97455e4d74a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:53.476354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076db41b-6d7d-44d2-b1a8-97455e4d74a6 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:53.516639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:53.532595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8fc54-1fae-4a14-8417-aa7bd14d0480 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:53.549804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4f32e-adba-440d-8176-2acf9be643b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:53.550917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f32e-adba-440d-8176-2acf9be643b8 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:53.550917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f32e-adba-440d-8176-2acf9be643b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:53.551234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f32e-adba-440d-8176-2acf9be643b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:53.554705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eba4f32e-adba-440d-8176-2acf9be643b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:53.619871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74cc9c688ff24472a3e2e814b7c35b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '307e96bc20e2463f95b6a4030898e6e5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:53.621109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:53.621647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:53.622163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] PATH_INFO: `/v3/domains/20eeb602c2514836b3fd781216337085` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:53.672018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=20eeb602c2514836b3fd781216337085)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:53.673561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:53.742142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4f32e-adba-440d-8176-2acf9be643b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:53.743759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4f32e-adba-440d-8176-2acf9be643b8 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:53.749696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '20eeb602c2514836b3fd781216337085'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.757223 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3584/7140] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:53.757765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '20eeb602c2514836b3fd781216337085'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.848762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20eeb602c2514836b3fd781216337085', 'request_id': 'req-391c4121-62d1-458d-a2a0-d196d8a4fa26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.859661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20eeb602c2514836b3fd781216337085', 'request_id': 'req-391c4121-62d1-458d-a2a0-d196d8a4fa26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.868511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20eeb602c2514836b3fd781216337085', 'request_id': 'req-391c4121-62d1-458d-a2a0-d196d8a4fa26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.887739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] The token cache is being invalidate because project 20eeb602c2514836b3fd781216337085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:53.888147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.888905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.898677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '20eeb602c2514836b3fd781216337085', 'request_id': 'req-391c4121-62d1-458d-a2a0-d196d8a4fa26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.899625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '20eeb602c2514836b3fd781216337085', 'request_id': 'req-391c4121-62d1-458d-a2a0-d196d8a4fa26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.903303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-391c4121-62d1-458d-a2a0-d196d8a4fa26 tempest-DomainsTestJSON-756952354 tempest-DomainsTestJSON-756952354-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '20eeb602c2514836b3fd781216337085', 'request_id': 'req-391c4121-62d1-458d-a2a0-d196d8a4fa26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:53.926676 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3557/7141] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:46:53 2022] DELETE /identity/v3/domains/20eeb602c2514836b3fd781216337085 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:53.939491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4f32e-adba-440d-8176-2acf9be643b8 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:53.951409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eba4f32e-adba-440d-8176-2acf9be643b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:53.976167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4f32e-adba-440d-8176-2acf9be643b8 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:54.120785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:54.124136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:54.124422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:54.124700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] PATH_INFO: `/v3/users/971a57476ed948349c28b32913b897be` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:54.128439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] RBAC: Authorizing `identity:delete_user(user_id=971a57476ed948349c28b32913b897be)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:54.134974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:54.332154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971a57476ed948349c28b32913b897be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:54.337933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971a57476ed948349c28b32913b897be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:54.355684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:54.363407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971a57476ed948349c28b32913b897be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:54.388933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971a57476ed948349c28b32913b897be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:54.421175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971a57476ed948349c28b32913b897be'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:54.441916 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3585/7142] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:53 2022] DELETE /identity/v3/users/971a57476ed948349c28b32913b897be => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:54.444042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354c0e1-997d-447a-9af3-fc7ff159285c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:54.444334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354c0e1-997d-447a-9af3-fc7ff159285c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:54.444610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354c0e1-997d-447a-9af3-fc7ff159285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:54.494848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7354c0e1-997d-447a-9af3-fc7ff159285c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:54.496110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7354c0e1-997d-447a-9af3-fc7ff159285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:54.638121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:54.670184 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3558/7143] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:54.705209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:54.706927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:54.856276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04de5a6-028e-4d14-a15e-e874e688754c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:54.867266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5246ad1-0b21-4a91-aecc-553d6c8be771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:54.868237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246ad1-0b21-4a91-aecc-553d6c8be771 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:54.868777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246ad1-0b21-4a91-aecc-553d6c8be771 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:54.869246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246ad1-0b21-4a91-aecc-553d6c8be771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:54.879861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5246ad1-0b21-4a91-aecc-553d6c8be771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:54.881622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5246ad1-0b21-4a91-aecc-553d6c8be771 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:54.895636 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3586/7144] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:56.076614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354c0e1-997d-447a-9af3-fc7ff159285c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:56.078841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7354c0e1-997d-447a-9af3-fc7ff159285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:56.092622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354c0e1-997d-447a-9af3-fc7ff159285c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:56.098689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:56.099633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:56.100071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:56.101406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] PATH_INFO: `/v3/users/6c76035a59984bcf926332f1b3a63a81` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:56.103354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c76035a59984bcf926332f1b3a63a81)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:56.106776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:56.148416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5246ad1-0b21-4a91-aecc-553d6c8be771 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:56.152381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d5246ad1-0b21-4a91-aecc-553d6c8be771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:56.202183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5246ad1-0b21-4a91-aecc-553d6c8be771 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:56.210532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c76035a59984bcf926332f1b3a63a81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.217515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:56.218195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:56.218468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:56.218995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] PATH_INFO: `/v3/projects/32866dc65b7a40fa9d0fe576aefb6dd1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:56.219671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c76035a59984bcf926332f1b3a63a81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.221603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32866dc65b7a40fa9d0fe576aefb6dd1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:56.223741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:56.253445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c76035a59984bcf926332f1b3a63a81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.285843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c76035a59984bcf926332f1b3a63a81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.286789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d3be4e15-ec45-4f7b-93e8-c86094234bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c76035a59984bcf926332f1b3a63a81'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.303269 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3559/7145] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:56 2022] DELETE /identity/v3/users/6c76035a59984bcf926332f1b3a63a81 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:56.307896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceac934-12d3-4606-8b28-7d72890ce472 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:56.307896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceac934-12d3-4606-8b28-7d72890ce472 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:56.310279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceac934-12d3-4606-8b28-7d72890ce472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:56.357147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5ceac934-12d3-4606-8b28-7d72890ce472 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:56.359338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5ceac934-12d3-4606-8b28-7d72890ce472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:56.360058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32866dc65b7a40fa9d0fe576aefb6dd1', 'request_id': 'req-b06905d1-1dbf-4e38-a896-5c4bfd965736'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.378056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32866dc65b7a40fa9d0fe576aefb6dd1', 'request_id': 'req-b06905d1-1dbf-4e38-a896-5c4bfd965736'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.402658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32866dc65b7a40fa9d0fe576aefb6dd1', 'request_id': 'req-b06905d1-1dbf-4e38-a896-5c4bfd965736'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.431381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] The token cache is being invalidate because project 32866dc65b7a40fa9d0fe576aefb6dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:56.431381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.433317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.435523 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3587/7146] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:56 2022] DELETE /identity/v3/projects/32866dc65b7a40fa9d0fe576aefb6dd1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:56.439337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:56.442140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:56.497042 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3560/7147] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:56.534780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceac934-12d3-4606-8b28-7d72890ce472 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:56.538581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5ceac934-12d3-4606-8b28-7d72890ce472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:56.582634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:56.593548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06905d1-1dbf-4e38-a896-5c4bfd965736 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:56.607141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:56.609773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:56.610182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:56.614375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] PATH_INFO: `/v3/users/1f4f9179cdaf49548317e3b9b35429df` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:56.618834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4f9179cdaf49548317e3b9b35429df)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:56.625291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:56.711146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceac934-12d3-4606-8b28-7d72890ce472 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:56.719339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfee4f-3170-41f5-ad45-42258811dd22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:56.720204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfee4f-3170-41f5-ad45-42258811dd22 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:56.720616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfee4f-3170-41f5-ad45-42258811dd22 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:56.721047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfee4f-3170-41f5-ad45-42258811dd22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:56.739446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfee4f-3170-41f5-ad45-42258811dd22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:56.743233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfee4f-3170-41f5-ad45-42258811dd22 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:56.781237 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3561/7148] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:56.783044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfee4f-3170-41f5-ad45-42258811dd22 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:56.787740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-72dfee4f-3170-41f5-ad45-42258811dd22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:56.819684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4f9179cdaf49548317e3b9b35429df'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.820603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4f9179cdaf49548317e3b9b35429df'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.831732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4f9179cdaf49548317e3b9b35429df'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.849829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4f9179cdaf49548317e3b9b35429df'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.851217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:56.881371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4f9179cdaf49548317e3b9b35429df'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:56.894104 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3588/7149] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:56 2022] DELETE /identity/v3/users/1f4f9179cdaf49548317e3b9b35429df => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:56.895947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:56.898942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:56.987862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfee4f-3170-41f5-ad45-42258811dd22 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:57.027291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998a8d2-573c-4426-b404-19a7f6e5cdab admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:57.034488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:57.038700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:57.039036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:57.039326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] PATH_INFO: `/v3/projects/cb2f36f063ee4249a28d27aca270159d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:57.041013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2f36f063ee4249a28d27aca270159d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:57.043096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:57.130955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2f36f063ee4249a28d27aca270159d', 'request_id': 'req-c2a750cb-11fa-4983-915c-48047a1eefee'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:57.142057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2f36f063ee4249a28d27aca270159d', 'request_id': 'req-c2a750cb-11fa-4983-915c-48047a1eefee'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:57.156995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2f36f063ee4249a28d27aca270159d', 'request_id': 'req-c2a750cb-11fa-4983-915c-48047a1eefee'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:57.163035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2f370-ac28-4eda-9650-d51a9c37b3a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:57.163714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f370-ac28-4eda-9650-d51a9c37b3a6 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:57.163949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f370-ac28-4eda-9650-d51a9c37b3a6 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:57.164223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2f370-ac28-4eda-9650-d51a9c37b3a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:57.166401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-89a2f370-ac28-4eda-9650-d51a9c37b3a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:57.185891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] The token cache is being invalidate because project cb2f36f063ee4249a28d27aca270159d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:57.186166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:57.186900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:57.191369 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3589/7150] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:56 2022] DELETE /identity/v3/projects/cb2f36f063ee4249a28d27aca270159d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:57.192545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2f370-ac28-4eda-9650-d51a9c37b3a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:57.194766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2f370-ac28-4eda-9650-d51a9c37b3a6 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:57.195436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:57.196845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:57.210078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:57.211839 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3562/7151] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:57.369622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a750cb-11fa-4983-915c-48047a1eefee admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:57.392006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:57.393827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:57.394249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:57.394604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] PATH_INFO: `/v3/users/74cc9c688ff24472a3e2e814b7c35b49` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:57.396078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=74cc9c688ff24472a3e2e814b7c35b49)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:57.398386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:57.580216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74cc9c688ff24472a3e2e814b7c35b49'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:57.582058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74cc9c688ff24472a3e2e814b7c35b49'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:57.592993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74cc9c688ff24472a3e2e814b7c35b49'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:57.606558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74cc9c688ff24472a3e2e814b7c35b49'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:57.631954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2f370-ac28-4eda-9650-d51a9c37b3a6 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:57.633575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-89a2f370-ac28-4eda-9650-d51a9c37b3a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:57.639643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74cc9c688ff24472a3e2e814b7c35b49'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:57.667006 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3590/7152] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:57 2022] DELETE /identity/v3/users/74cc9c688ff24472a3e2e814b7c35b49 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:46:57.689919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2f370-ac28-4eda-9650-d51a9c37b3a6 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:57.870252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:57.870916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:57.871193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:57.871464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] PATH_INFO: `/v3/projects/c782e080941645e3bfcf12e5421571f3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:57.872653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c782e080941645e3bfcf12e5421571f3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:57.874819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:57.990426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:57.993058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c782e080941645e3bfcf12e5421571f3', 'request_id': 'req-06188351-87ab-4ad1-88a3-538af91ed9ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.045146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c782e080941645e3bfcf12e5421571f3', 'request_id': 'req-06188351-87ab-4ad1-88a3-538af91ed9ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.066885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c782e080941645e3bfcf12e5421571f3', 'request_id': 'req-06188351-87ab-4ad1-88a3-538af91ed9ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.117714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] The token cache is being invalidate because project c782e080941645e3bfcf12e5421571f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:58.118053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.129977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.145961 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3563/7153] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:57 2022] DELETE /identity/v3/projects/c782e080941645e3bfcf12e5421571f3 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:58.149560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:58.151954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:58.178112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6abe9-6212-4c37-a560-414f33376e5e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:58.317904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:58.319542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:58.319636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:58.319920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] PATH_INFO: `/v3/users/6321ebfcddf54f5191c4373990461eed` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:58.338253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6321ebfcddf54f5191c4373990461eed)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:58.344546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:58.353666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:58.355598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:58.387537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06188351-87ab-4ad1-88a3-538af91ed9ac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:58.403809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:58.405756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:58.407805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:58.408177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] PATH_INFO: `/v3/users/fd2b91ecd6294093a7b8e3813621a5e0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:58.412292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2b91ecd6294093a7b8e3813621a5e0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:58.415435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:58.441330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:58.509366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6321ebfcddf54f5191c4373990461eed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.510544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6321ebfcddf54f5191c4373990461eed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.536215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6321ebfcddf54f5191c4373990461eed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.576902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6321ebfcddf54f5191c4373990461eed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.615958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6321ebfcddf54f5191c4373990461eed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.624985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2b91ecd6294093a7b8e3813621a5e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.632530 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3591/7154] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:58 2022] DELETE /identity/v3/users/6321ebfcddf54f5191c4373990461eed => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:58.664416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:58.667279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2b91ecd6294093a7b8e3813621a5e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.668780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:58.692371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2b91ecd6294093a7b8e3813621a5e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.703155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2b91ecd6294093a7b8e3813621a5e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.705024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c4e49f42-b2a9-4593-9b1e-a2a8e489bc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2b91ecd6294093a7b8e3813621a5e0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:58.739886 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3564/7155] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:46:58 2022] DELETE /identity/v3/users/fd2b91ecd6294093a7b8e3813621a5e0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:58.748014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f615256-daa2-4e4d-a05f-6a649fe10896 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:58.748534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f615256-daa2-4e4d-a05f-6a649fe10896 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:58.748999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f615256-daa2-4e4d-a05f-6a649fe10896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:58.828459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2f615256-daa2-4e4d-a05f-6a649fe10896 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:58.835353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2f615256-daa2-4e4d-a05f-6a649fe10896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:58.864300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc8898-2bf9-4a13-b049-aa390af88945 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:58.977436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:58.980900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:58.981293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:58.982910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] PATH_INFO: `/v3/projects/307e96bc20e2463f95b6a4030898e6e5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:58.986369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=307e96bc20e2463f95b6a4030898e6e5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:58.992243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:59.046980 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3565/7156] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:59.048288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f615256-daa2-4e4d-a05f-6a649fe10896 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:59.052165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2f615256-daa2-4e4d-a05f-6a649fe10896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:59.096631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f615256-daa2-4e4d-a05f-6a649fe10896 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:59.098065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307e96bc20e2463f95b6a4030898e6e5', 'request_id': 'req-7e866f0c-904f-4d5a-ac70-9c99be74f745'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.100502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:59.105775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307e96bc20e2463f95b6a4030898e6e5', 'request_id': 'req-7e866f0c-904f-4d5a-ac70-9c99be74f745'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.117538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307e96bc20e2463f95b6a4030898e6e5', 'request_id': 'req-7e866f0c-904f-4d5a-ac70-9c99be74f745'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.137248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] The token cache is being invalidate because project 307e96bc20e2463f95b6a4030898e6e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:59.137580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.139389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.147047 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3592/7157] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:58 2022] DELETE /identity/v3/projects/307e96bc20e2463f95b6a4030898e6e5 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:59.147362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:59.148753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:59.190573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:59.211956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:59.212900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.213277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.213696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] PATH_INFO: `/v3/projects/28f1103860874f70b88d066f41efaaf0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.215079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28f1103860874f70b88d066f41efaaf0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:59.217588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:59.277035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28f1103860874f70b88d066f41efaaf0', 'request_id': 'req-80b7624b-6c67-4495-a207-564064329256'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.284903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e866f0c-904f-4d5a-ac70-9c99be74f745 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:59.285488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28f1103860874f70b88d066f41efaaf0', 'request_id': 'req-80b7624b-6c67-4495-a207-564064329256'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.300643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28f1103860874f70b88d066f41efaaf0', 'request_id': 'req-80b7624b-6c67-4495-a207-564064329256'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.325178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] The token cache is being invalidate because project 28f1103860874f70b88d066f41efaaf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:59.325478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.329799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.332811 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3566/7158] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:59 2022] DELETE /identity/v3/projects/28f1103860874f70b88d066f41efaaf0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:59.333702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:59.338737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:59.374189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d9dab-c3c5-42e4-95f4-a8ce5d154792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:59.375225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d9dab-c3c5-42e4-95f4-a8ce5d154792 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.375713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d9dab-c3c5-42e4-95f4-a8ce5d154792 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.376346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d9dab-c3c5-42e4-95f4-a8ce5d154792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.378698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eb9d9dab-c3c5-42e4-95f4-a8ce5d154792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:59.463310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d9dab-c3c5-42e4-95f4-a8ce5d154792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:59.465360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d9dab-c3c5-42e4-95f4-a8ce5d154792 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:59.479800 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3593/7159] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:46:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:46:59.482297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01dc6e-bae6-4359-88a4-1ce9d50c1c93 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.482684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01dc6e-bae6-4359-88a4-1ce9d50c1c93 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.483053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01dc6e-bae6-4359-88a4-1ce9d50c1c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.487999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7624b-6c67-4495-a207-564064329256 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:59.494005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:59.494277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.494568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.494841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] PATH_INFO: `/v3/projects/ea52023ca918472587fa528baaf75b4e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.502799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea52023ca918472587fa528baaf75b4e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:59.504866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:59.509466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8b01dc6e-bae6-4359-88a4-1ce9d50c1c93 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:59.511045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8b01dc6e-bae6-4359-88a4-1ce9d50c1c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:59.523641 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3594/7160] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:59.525259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c610-4820-4542-98ff-43f7fc983143 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.525647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c610-4820-4542-98ff-43f7fc983143 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.526195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9c610-4820-4542-98ff-43f7fc983143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.584092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d2a9c610-4820-4542-98ff-43f7fc983143 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:59.588837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d2a9c610-4820-4542-98ff-43f7fc983143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:59.609921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea52023ca918472587fa528baaf75b4e', 'request_id': 'req-f7d41a13-255c-4d63-bf17-a4bf6ab26094'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.622310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea52023ca918472587fa528baaf75b4e', 'request_id': 'req-f7d41a13-255c-4d63-bf17-a4bf6ab26094'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.631757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea52023ca918472587fa528baaf75b4e', 'request_id': 'req-f7d41a13-255c-4d63-bf17-a4bf6ab26094'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.669367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] The token cache is being invalidate because project ea52023ca918472587fa528baaf75b4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:46:59.669771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.670284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f7d41a13-255c-4d63-bf17-a4bf6ab26094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:46:59.670782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:59.673445 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3567/7161] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:46:59 2022] DELETE /identity/v3/projects/ea52023ca918472587fa528baaf75b4e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:46:59.687592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982922e0-334f-45d7-ba15-d4053fb1ffae None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.687873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982922e0-334f-45d7-ba15-d4053fb1ffae None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.688156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982922e0-334f-45d7-ba15-d4053fb1ffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.739360 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3595/7162] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:59.741643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85438390-568b-4afe-8c44-e479fdb3b3d3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.744416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85438390-568b-4afe-8c44-e479fdb3b3d3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.744782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85438390-568b-4afe-8c44-e479fdb3b3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.749731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-982922e0-334f-45d7-ba15-d4053fb1ffae None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:59.752484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-982922e0-334f-45d7-ba15-d4053fb1ffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:59.781974 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3568/7163] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:59.783476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f6394-d92a-4669-91fb-ecfa064f05ef None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.783712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f6394-d92a-4669-91fb-ecfa064f05ef None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.783993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f6394-d92a-4669-91fb-ecfa064f05ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.791942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:59.802620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-85438390-568b-4afe-8c44-e479fdb3b3d3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:59.804209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-85438390-568b-4afe-8c44-e479fdb3b3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:59.813331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-318f6394-d92a-4669-91fb-ecfa064f05ef None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:59.814700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-318f6394-d92a-4669-91fb-ecfa064f05ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:59.833008 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3596/7164] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:59.834044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85438390-568b-4afe-8c44-e479fdb3b3d3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:59.845771 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3569/7165] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:59.846925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93613c63-4e47-47c0-9d41-a105c41b7cb5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.847211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93613c63-4e47-47c0-9d41-a105c41b7cb5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.847487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93613c63-4e47-47c0-9d41-a105c41b7cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.855256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85438390-568b-4afe-8c44-e479fdb3b3d3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:59.865426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f7498-d06c-455d-8d7d-41e6c32a31da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:59.866325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7498-d06c-455d-8d7d-41e6c32a31da admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.866604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7498-d06c-455d-8d7d-41e6c32a31da admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.866947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f7498-d06c-455d-8d7d-41e6c32a31da admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.867642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f7498-d06c-455d-8d7d-41e6c32a31da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:59.868062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f7498-d06c-455d-8d7d-41e6c32a31da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:59.869719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f7498-d06c-455d-8d7d-41e6c32a31da admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:59.888405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-93613c63-4e47-47c0-9d41-a105c41b7cb5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:46:59.889840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-93613c63-4e47-47c0-9d41-a105c41b7cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:46:59.901215 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3597/7166] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:59.902188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f7498-d06c-455d-8d7d-41e6c32a31da admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:59.915187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f7498-d06c-455d-8d7d-41e6c32a31da admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:59.917958 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3570/7167] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:46:59.929928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93613c63-4e47-47c0-9d41-a105c41b7cb5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:59.937390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ead18-20b0-4791-84d3-2c709e1ad9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:59.938049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ead18-20b0-4791-84d3-2c709e1ad9da admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.938331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ead18-20b0-4791-84d3-2c709e1ad9da admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.938708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ead18-20b0-4791-84d3-2c709e1ad9da admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.939380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ead18-20b0-4791-84d3-2c709e1ad9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:46:59.939729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ead18-20b0-4791-84d3-2c709e1ad9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:46:59.941482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ead18-20b0-4791-84d3-2c709e1ad9da admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:46:59.972801 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3598/7168] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:46:59.973781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ead18-20b0-4791-84d3-2c709e1ad9da admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:46:59.976773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93613c63-4e47-47c0-9d41-a105c41b7cb5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:59.993168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcacad-e9e8-45b7-86e5-ea4ae383d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:46:59.993796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcacad-e9e8-45b7-86e5-ea4ae383d8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:46:59.994105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcacad-e9e8-45b7-86e5-ea4ae383d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:46:59.994434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcacad-e9e8-45b7-86e5-ea4ae383d8d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:46:59.994645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ead18-20b0-4791-84d3-2c709e1ad9da admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:46:59.995088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcacad-e9e8-45b7-86e5-ea4ae383d8d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.001819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fcacad-e9e8-45b7-86e5-ea4ae383d8d9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.008666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18adfa-17fb-4aaa-a865-4e6eb8053994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.009302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18adfa-17fb-4aaa-a865-4e6eb8053994 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.009582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18adfa-17fb-4aaa-a865-4e6eb8053994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.010012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18adfa-17fb-4aaa-a865-4e6eb8053994 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.010690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18adfa-17fb-4aaa-a865-4e6eb8053994 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:47:00.011002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18adfa-17fb-4aaa-a865-4e6eb8053994 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.012747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18adfa-17fb-4aaa-a865-4e6eb8053994 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.050222 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3599/7169] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:00.051991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18adfa-17fb-4aaa-a865-4e6eb8053994 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.085090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18adfa-17fb-4aaa-a865-4e6eb8053994 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.090936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e230b-ae38-46f7-afb1-e8e2bd576b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.091670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e230b-ae38-46f7-afb1-e8e2bd576b55 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.091952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e230b-ae38-46f7-afb1-e8e2bd576b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.092226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e230b-ae38-46f7-afb1-e8e2bd576b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.093659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e230b-ae38-46f7-afb1-e8e2bd576b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.096198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e230b-ae38-46f7-afb1-e8e2bd576b55 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.098613 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3571/7170] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:46:59 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:00.101445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcacad-e9e8-45b7-86e5-ea4ae383d8d9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.168469 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3600/7171] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:00 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:00.169856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e230b-ae38-46f7-afb1-e8e2bd576b55 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.355430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcacad-e9e8-45b7-86e5-ea4ae383d8d9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.371435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f419b1-7130-4f64-8cd0-7df1c94a58bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.374163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f419b1-7130-4f64-8cd0-7df1c94a58bb admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.374601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f419b1-7130-4f64-8cd0-7df1c94a58bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.374886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f419b1-7130-4f64-8cd0-7df1c94a58bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.378760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f419b1-7130-4f64-8cd0-7df1c94a58bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.382169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f419b1-7130-4f64-8cd0-7df1c94a58bb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.384505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e230b-ae38-46f7-afb1-e8e2bd576b55 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.411440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb4a2a-0d17-42a9-a399-f98fc4348752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.411883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb4a2a-0d17-42a9-a399-f98fc4348752 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.412163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb4a2a-0d17-42a9-a399-f98fc4348752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.412431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb4a2a-0d17-42a9-a399-f98fc4348752 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.413069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb4a2a-0d17-42a9-a399-f98fc4348752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.419598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb4a2a-0d17-42a9-a399-f98fc4348752 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.455572 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3572/7172] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:00 2022] POST /identity/v3/projects => generated 369 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:00.457697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f419b1-7130-4f64-8cd0-7df1c94a58bb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.479995 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3601/7173] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:00 2022] POST /identity/v3/users => generated 292 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:00.485801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb4a2a-0d17-42a9-a399-f98fc4348752 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.521660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb4a2a-0d17-42a9-a399-f98fc4348752 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.650700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b3fb3-84d7-4368-bb97-25de70ff04f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.651422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b3fb3-84d7-4368-bb97-25de70ff04f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.651746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b3fb3-84d7-4368-bb97-25de70ff04f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.652155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b3fb3-84d7-4368-bb97-25de70ff04f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.652806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b3fb3-84d7-4368-bb97-25de70ff04f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.655444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b3fb3-84d7-4368-bb97-25de70ff04f7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.665776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f419b1-7130-4f64-8cd0-7df1c94a58bb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.668512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:00.698723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fac3ef-46e8-4f3e-ac2e-6fd8b05978fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.699504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fac3ef-46e8-4f3e-ac2e-6fd8b05978fe admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.700298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fac3ef-46e8-4f3e-ac2e-6fd8b05978fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.702192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fac3ef-46e8-4f3e-ac2e-6fd8b05978fe admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.702959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fac3ef-46e8-4f3e-ac2e-6fd8b05978fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.708298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fac3ef-46e8-4f3e-ac2e-6fd8b05978fe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.714919 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3602/7174] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:00 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:00.715915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b3fb3-84d7-4368-bb97-25de70ff04f7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.733381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b3fb3-84d7-4368-bb97-25de70ff04f7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.745246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67881d4a-7455-4406-bd87-c1d7b614e256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.746000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881d4a-7455-4406-bd87-c1d7b614e256 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.746278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881d4a-7455-4406-bd87-c1d7b614e256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.746658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67881d4a-7455-4406-bd87-c1d7b614e256 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.747532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67881d4a-7455-4406-bd87-c1d7b614e256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.749457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67881d4a-7455-4406-bd87-c1d7b614e256 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.752118 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3573/7175] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:00 2022] POST /identity/v3/users => generated 294 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:00.753220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fac3ef-46e8-4f3e-ac2e-6fd8b05978fe admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.774747 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3603/7176] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:00.774747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67881d4a-7455-4406-bd87-c1d7b614e256 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.783780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fac3ef-46e8-4f3e-ac2e-6fd8b05978fe admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.784942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67881d4a-7455-4406-bd87-c1d7b614e256 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.795750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeba7a-54f1-4012-bb4d-ec9df3847e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.796561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeba7a-54f1-4012-bb4d-ec9df3847e51 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.797070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeba7a-54f1-4012-bb4d-ec9df3847e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.798381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbeba7a-54f1-4012-bb4d-ec9df3847e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.799370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbeba7a-54f1-4012-bb4d-ec9df3847e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.801664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbeba7a-54f1-4012-bb4d-ec9df3847e51 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.805218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce81016-dffb-4f74-8d84-45c465f5c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.806065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81016-dffb-4f74-8d84-45c465f5c429 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.806230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81016-dffb-4f74-8d84-45c465f5c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.806490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce81016-dffb-4f74-8d84-45c465f5c429 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.807151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce81016-dffb-4f74-8d84-45c465f5c429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.809425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce81016-dffb-4f74-8d84-45c465f5c429 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.835840 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3604/7177] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:00.836724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeba7a-54f1-4012-bb4d-ec9df3847e51 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.842154 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3574/7178] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:00.842154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce81016-dffb-4f74-8d84-45c465f5c429 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.851981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbeba7a-54f1-4012-bb4d-ec9df3847e51 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.864457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce81016-dffb-4f74-8d84-45c465f5c429 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.872328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdcac3-6e1c-4dc9-9bc9-cb385891f89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.873478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdcac3-6e1c-4dc9-9bc9-cb385891f89a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.873760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdcac3-6e1c-4dc9-9bc9-cb385891f89a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.874061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdcac3-6e1c-4dc9-9bc9-cb385891f89a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.874726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdcac3-6e1c-4dc9-9bc9-cb385891f89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.878170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c97d72-a711-4d46-97a5-27bd96e26dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.878809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c97d72-a711-4d46-97a5-27bd96e26dec admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.879142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c97d72-a711-4d46-97a5-27bd96e26dec admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.879414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c97d72-a711-4d46-97a5-27bd96e26dec admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.880076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c97d72-a711-4d46-97a5-27bd96e26dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.887266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c97d72-a711-4d46-97a5-27bd96e26dec admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.900914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afdcac3-6e1c-4dc9-9bc9-cb385891f89a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.905681 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3575/7179] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:00.906601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c97d72-a711-4d46-97a5-27bd96e26dec admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.930893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c97d72-a711-4d46-97a5-27bd96e26dec admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.937377 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3605/7180] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:00.938258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdcac3-6e1c-4dc9-9bc9-cb385891f89a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:00.960577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdcac3-6e1c-4dc9-9bc9-cb385891f89a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:00.966407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f5afa-21ae-435c-bab6-2587fe92aa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.967042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f5afa-21ae-435c-bab6-2587fe92aa33 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.967321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f5afa-21ae-435c-bab6-2587fe92aa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.967587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f5afa-21ae-435c-bab6-2587fe92aa33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:00.968241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f5afa-21ae-435c-bab6-2587fe92aa33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:00.970917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f5afa-21ae-435c-bab6-2587fe92aa33 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:00.971303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eaf20-f6a5-455b-841a-13af43ac6cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:00.972807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eaf20-f6a5-455b-841a-13af43ac6cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:00.973363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eaf20-f6a5-455b-841a-13af43ac6cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:00.974040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eaf20-f6a5-455b-841a-13af43ac6cbd admin admin] PATH_INFO: `/v3/projects/d03fbb1941d0402ca80e636887a3d384/users/2d6d3a07b0d44e50b85a9132a819d960/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:01.009092 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3576/7181] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:01.009092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f5afa-21ae-435c-bab6-2587fe92aa33 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:01.020527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4eaf20-f6a5-455b-841a-13af43ac6cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d03fbb1941d0402ca80e636887a3d384, user_id=2d6d3a07b0d44e50b85a9132a819d960, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:01.028323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4eaf20-f6a5-455b-841a-13af43ac6cbd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:01.041513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f5afa-21ae-435c-bab6-2587fe92aa33 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:01.066832 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3606/7182] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:00 2022] PUT /identity/v3/projects/d03fbb1941d0402ca80e636887a3d384/users/2d6d3a07b0d44e50b85a9132a819d960/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:01.070128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eaf20-f6a5-455b-841a-13af43ac6cbd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:01.072106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcbe45-7502-4e13-bfb1-74d1d97a3de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:01.073556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcbe45-7502-4e13-bfb1-74d1d97a3de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:01.075117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcbe45-7502-4e13-bfb1-74d1d97a3de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:01.075551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcbe45-7502-4e13-bfb1-74d1d97a3de4 admin admin] PATH_INFO: `/v3/projects/02b36ef3d6e94dc7899391aebf054447/users/e6c856ea002144238cd0e37b4671c4c6/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:01.084329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:01.116178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcbe45-7502-4e13-bfb1-74d1d97a3de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b36ef3d6e94dc7899391aebf054447, user_id=e6c856ea002144238cd0e37b4671c4c6, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:01.119710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcbe45-7502-4e13-bfb1-74d1d97a3de4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:01.151021 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3577/7183] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:01 2022] PUT /identity/v3/projects/02b36ef3d6e94dc7899391aebf054447/users/e6c856ea002144238cd0e37b4671c4c6/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:01.154304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bb250-c2b5-488c-8205-8597aea35710 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:01.155599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bb250-c2b5-488c-8205-8597aea35710 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:01.156031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bb250-c2b5-488c-8205-8597aea35710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:01.214996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-985bb250-c2b5-488c-8205-8597aea35710 None None] MFA Rules not processed for user `2d6d3a07b0d44e50b85a9132a819d960`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:01.219631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-985bb250-c2b5-488c-8205-8597aea35710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:01.254118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eaf20-f6a5-455b-841a-13af43ac6cbd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:01.358172 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3578/7184] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:01.360234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6941d-4bed-4baa-ab01-e94e11c6ee43 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:01.360768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6941d-4bed-4baa-ab01-e94e11c6ee43 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:01.361199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6941d-4bed-4baa-ab01-e94e11c6ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:01.389445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2e470-9200-402f-bc59-1b6ac6a37ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:01.390958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2e470-9200-402f-bc59-1b6ac6a37ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:01.394561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2e470-9200-402f-bc59-1b6ac6a37ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:01.395031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2e470-9200-402f-bc59-1b6ac6a37ba0 admin admin] PATH_INFO: `/v3/projects/d22d16ab7afa47558203f0c43b861d5a/users/e512a01ad9e64f47859cfb0e05d60f69/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:01.420280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-adb6941d-4bed-4baa-ab01-e94e11c6ee43 None None] MFA Rules not processed for user `e6c856ea002144238cd0e37b4671c4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:01.423830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-adb6941d-4bed-4baa-ab01-e94e11c6ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:01.430084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2e470-9200-402f-bc59-1b6ac6a37ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22d16ab7afa47558203f0c43b861d5a, user_id=e512a01ad9e64f47859cfb0e05d60f69, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:01.436734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2e470-9200-402f-bc59-1b6ac6a37ba0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:01.467611 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3607/7185] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:01 2022] PUT /identity/v3/projects/d22d16ab7afa47558203f0c43b861d5a/users/e512a01ad9e64f47859cfb0e05d60f69/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:01.470587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2e470-9200-402f-bc59-1b6ac6a37ba0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:01.472608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bcb2e470-9200-402f-bc59-1b6ac6a37ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:01.541700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:01.584930 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3579/7186] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:01.586778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6941d-4bed-4baa-ab01-e94e11c6ee43 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:01.614491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6941d-4bed-4baa-ab01-e94e11c6ee43 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:01.622452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1ec5a-a65d-4518-ab6e-ba63e17ffcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:01.623090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1ec5a-a65d-4518-ab6e-ba63e17ffcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:01.623367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1ec5a-a65d-4518-ab6e-ba63e17ffcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:01.623644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1ec5a-a65d-4518-ab6e-ba63e17ffcf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:01.625246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2e470-9200-402f-bc59-1b6ac6a37ba0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:01.626778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1ec5a-a65d-4518-ab6e-ba63e17ffcf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:01.630252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d1ec5a-a65d-4518-ab6e-ba63e17ffcf7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:01.639018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:01.639682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:01.639966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:01.640239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] PATH_INFO: `/v3/projects/7a4af66c38794da7bb73cbc900e8876a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:01.642401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4af66c38794da7bb73cbc900e8876a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:01.644394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:01.689892 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3580/7187] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:01 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:01.691360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fdc55-0961-4e82-b43c-86f3a52d6b9b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:01.691645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fdc55-0961-4e82-b43c-86f3a52d6b9b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:01.691914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fdc55-0961-4e82-b43c-86f3a52d6b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:01.751739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4af66c38794da7bb73cbc900e8876a', 'request_id': 'req-315e3b4f-8e60-4461-9bdc-43212730bdbf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:01.756211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-595fdc55-0961-4e82-b43c-86f3a52d6b9b None None] MFA Rules not processed for user `e512a01ad9e64f47859cfb0e05d60f69`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:01.765802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-595fdc55-0961-4e82-b43c-86f3a52d6b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:01.771592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4af66c38794da7bb73cbc900e8876a', 'request_id': 'req-315e3b4f-8e60-4461-9bdc-43212730bdbf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:01.787634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4af66c38794da7bb73cbc900e8876a', 'request_id': 'req-315e3b4f-8e60-4461-9bdc-43212730bdbf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:01.830602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] The token cache is being invalidate because project 7a4af66c38794da7bb73cbc900e8876a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:01.831682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:01.836469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:01.840535 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3608/7188] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:01 2022] DELETE /identity/v3/projects/7a4af66c38794da7bb73cbc900e8876a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:01.841457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:01.848006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:01.866641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:01.935255 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3581/7189] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:01.936186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fdc55-0961-4e82-b43c-86f3a52d6b9b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:01.937712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-595fdc55-0961-4e82-b43c-86f3a52d6b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:02.000526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e3b4f-8e60-4461-9bdc-43212730bdbf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:02.016003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f3d96-4ed5-4459-ae40-bd018b36fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:02.016441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f3d96-4ed5-4459-ae40-bd018b36fb8d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:02.016810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f3d96-4ed5-4459-ae40-bd018b36fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:02.017113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f3d96-4ed5-4459-ae40-bd018b36fb8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:02.017764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f3d96-4ed5-4459-ae40-bd018b36fb8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:02.024075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f3d96-4ed5-4459-ae40-bd018b36fb8d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:02.100876 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3609/7190] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:01 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:02.101968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f3d96-4ed5-4459-ae40-bd018b36fb8d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:02.105761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-570f3d96-4ed5-4459-ae40-bd018b36fb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:02.125617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fdc55-0961-4e82-b43c-86f3a52d6b9b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:02.228693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:02.267012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f3d96-4ed5-4459-ae40-bd018b36fb8d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:02.272989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:02.273726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:02.274114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fb5d5-7979-4cf4-ae48-4c0d00b273b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:02.274267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:02.274567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] PATH_INFO: `/v3/users/11d9a3010edc437bab812d99b7a7bfdd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:02.275315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fb5d5-7979-4cf4-ae48-4c0d00b273b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:02.275834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fb5d5-7979-4cf4-ae48-4c0d00b273b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:02.275950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11d9a3010edc437bab812d99b7a7bfdd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:02.276343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fb5d5-7979-4cf4-ae48-4c0d00b273b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:02.277122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fb5d5-7979-4cf4-ae48-4c0d00b273b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:02.278173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:02.279815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fb5d5-7979-4cf4-ae48-4c0d00b273b9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:02.314848 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3582/7191] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:01 2022] POST /identity/v3/users => generated 300 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:02.317762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fb5d5-7979-4cf4-ae48-4c0d00b273b9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:02.330928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-034fb5d5-7979-4cf4-ae48-4c0d00b273b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:02.370266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11d9a3010edc437bab812d99b7a7bfdd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:02.370941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11d9a3010edc437bab812d99b7a7bfdd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:02.388987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11d9a3010edc437bab812d99b7a7bfdd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:02.404254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11d9a3010edc437bab812d99b7a7bfdd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:02.428886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fb5d5-7979-4cf4-ae48-4c0d00b273b9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:02.436141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11d9a3010edc437bab812d99b7a7bfdd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:02.439065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9003cd-f793-4774-bba8-581c5d9dd86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:02.440087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9003cd-f793-4774-bba8-581c5d9dd86b service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:02.441415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9003cd-f793-4774-bba8-581c5d9dd86b service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:02.441690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9003cd-f793-4774-bba8-581c5d9dd86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:02.448220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3b9003cd-f793-4774-bba8-581c5d9dd86b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:02.451838 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3610/7192] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:02 2022] DELETE /identity/v3/users/11d9a3010edc437bab812d99b7a7bfdd => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:02.452726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:02.455714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:02.517425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:02.600567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9003cd-f793-4774-bba8-581c5d9dd86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:02.602057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9003cd-f793-4774-bba8-581c5d9dd86b service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:02.615316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae14e93-a34a-4052-bdc5-fa3246e5d789 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:02.623981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bd7db-037d-408f-b8ff-6126dc5d1b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:02.624664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bd7db-037d-408f-b8ff-6126dc5d1b59 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:02.625389 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3583/7193] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:02.626456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bd7db-037d-408f-b8ff-6126dc5d1b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:02.626761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bd7db-037d-408f-b8ff-6126dc5d1b59 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:02.627428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bd7db-037d-408f-b8ff-6126dc5d1b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:02.629411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bd7db-037d-408f-b8ff-6126dc5d1b59 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:02.629804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9003cd-f793-4774-bba8-581c5d9dd86b service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:02.633798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3b9003cd-f793-4774-bba8-581c5d9dd86b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:02.659945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9003cd-f793-4774-bba8-581c5d9dd86b service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:02.673859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fba6a-8765-424c-8f9f-8fbfe72942fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:02.675735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fba6a-8765-424c-8f9f-8fbfe72942fa admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:02.676254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fba6a-8765-424c-8f9f-8fbfe72942fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:02.676529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fba6a-8765-424c-8f9f-8fbfe72942fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:02.677300 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3611/7194] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:02 2022] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:02.677939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fba6a-8765-424c-8f9f-8fbfe72942fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:02.679320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bd7db-037d-408f-b8ff-6126dc5d1b59 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:02.681154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fba6a-8765-424c-8f9f-8fbfe72942fa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:02.701526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bd7db-037d-408f-b8ff-6126dc5d1b59 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:02.708766 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3584/7195] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:02.712630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fba6a-8765-424c-8f9f-8fbfe72942fa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:02.713833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6b071-1433-4b99-9e8b-7abb8a93162f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:02.717358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b071-1433-4b99-9e8b-7abb8a93162f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:02.717955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b071-1433-4b99-9e8b-7abb8a93162f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:02.718236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6b071-1433-4b99-9e8b-7abb8a93162f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:02.719543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6b071-1433-4b99-9e8b-7abb8a93162f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:02.723554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6b071-1433-4b99-9e8b-7abb8a93162f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:02.734596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fba6a-8765-424c-8f9f-8fbfe72942fa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:02.745952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d071f-5282-44f5-a7ee-0815ceb84d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:02.746672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d071f-5282-44f5-a7ee-0815ceb84d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:02.746948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d071f-5282-44f5-a7ee-0815ceb84d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:02.747214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d071f-5282-44f5-a7ee-0815ceb84d53 admin admin] PATH_INFO: `/v3/projects/f7df7f7890264174b2ce158ac80782a1/users/9f18147068284e0f85473b5a4aa64c66/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:02.751051 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3612/7196] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:02.755154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6b071-1433-4b99-9e8b-7abb8a93162f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:02.781687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6b071-1433-4b99-9e8b-7abb8a93162f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:02.788131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e9827-7427-41e7-ac19-27930b82a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:02.788713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9827-7427-41e7-ac19-27930b82a08c admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:02.790768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9827-7427-41e7-ac19-27930b82a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:02.791103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e9827-7427-41e7-ac19-27930b82a08c admin admin] PATH_INFO: `/v3/projects/36d6bdf580584b1cae1e3f43adf46318/users/849b5cc233da4829b6b4625f0a36d1bc/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:02.792340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d071f-5282-44f5-a7ee-0815ceb84d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7df7f7890264174b2ce158ac80782a1, user_id=9f18147068284e0f85473b5a4aa64c66, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:02.796557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d071f-5282-44f5-a7ee-0815ceb84d53 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:02.816446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e9827-7427-41e7-ac19-27930b82a08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d6bdf580584b1cae1e3f43adf46318, user_id=849b5cc233da4829b6b4625f0a36d1bc, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:02.820429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e9827-7427-41e7-ac19-27930b82a08c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:02.837733 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3613/7197] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:02 2022] PUT /identity/v3/projects/36d6bdf580584b1cae1e3f43adf46318/users/849b5cc233da4829b6b4625f0a36d1bc/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:02.841506 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3585/7198] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:02 2022] PUT /identity/v3/projects/f7df7f7890264174b2ce158ac80782a1/users/9f18147068284e0f85473b5a4aa64c66/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:02.841958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e9827-7427-41e7-ac19-27930b82a08c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:02.845756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d071f-5282-44f5-a7ee-0815ceb84d53 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:02.864442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:03.016627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e9827-7427-41e7-ac19-27930b82a08c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:03.031806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0995f-a1d9-4a5c-9c16-00c9ae6488c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:03.032841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0995f-a1d9-4a5c-9c16-00c9ae6488c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:03.033347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0995f-a1d9-4a5c-9c16-00c9ae6488c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:03.033469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d071f-5282-44f5-a7ee-0815ceb84d53 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:03.033582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0995f-a1d9-4a5c-9c16-00c9ae6488c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:03.034181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0995f-a1d9-4a5c-9c16-00c9ae6488c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:03.038424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0995f-a1d9-4a5c-9c16-00c9ae6488c6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:03.046626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afa5d-456e-4697-b4d8-c05722ddafb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:03.047453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afa5d-456e-4697-b4d8-c05722ddafb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:03.047896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afa5d-456e-4697-b4d8-c05722ddafb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:03.048271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9afa5d-456e-4697-b4d8-c05722ddafb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:03.052063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9afa5d-456e-4697-b4d8-c05722ddafb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:03.055931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9afa5d-456e-4697-b4d8-c05722ddafb7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:03.065098 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3614/7199] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:03.069705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0995f-a1d9-4a5c-9c16-00c9ae6488c6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:03.086749 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3586/7200] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:03.088342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0995f-a1d9-4a5c-9c16-00c9ae6488c6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:03.091003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afa5d-456e-4697-b4d8-c05722ddafb7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:03.104824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47097c43-99fc-4c44-941b-bdbc490cd7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:03.106318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47097c43-99fc-4c44-941b-bdbc490cd7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:03.106614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47097c43-99fc-4c44-941b-bdbc490cd7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:03.107270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47097c43-99fc-4c44-941b-bdbc490cd7a0 admin admin] PATH_INFO: `/v3/projects/36d6bdf580584b1cae1e3f43adf46318/users/849b5cc233da4829b6b4625f0a36d1bc/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:03.111428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47097c43-99fc-4c44-941b-bdbc490cd7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d6bdf580584b1cae1e3f43adf46318, user_id=849b5cc233da4829b6b4625f0a36d1bc, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:03.113810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9afa5d-456e-4697-b4d8-c05722ddafb7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:03.115088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47097c43-99fc-4c44-941b-bdbc490cd7a0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:03.130576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d02c72-89a3-4d4c-9261-37ccf2f3c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:03.132771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02c72-89a3-4d4c-9261-37ccf2f3c9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:03.133145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02c72-89a3-4d4c-9261-37ccf2f3c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:03.133371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02c72-89a3-4d4c-9261-37ccf2f3c9d8 admin admin] PATH_INFO: `/v3/projects/f7df7f7890264174b2ce158ac80782a1/users/9f18147068284e0f85473b5a4aa64c66/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:03.143709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02c72-89a3-4d4c-9261-37ccf2f3c9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7df7f7890264174b2ce158ac80782a1, user_id=9f18147068284e0f85473b5a4aa64c66, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:03.148429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02c72-89a3-4d4c-9261-37ccf2f3c9d8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:03.152561 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3615/7201] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:03 2022] PUT /identity/v3/projects/36d6bdf580584b1cae1e3f43adf46318/users/849b5cc233da4829b6b4625f0a36d1bc/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:03.163506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c96b1-951c-4cb9-87cc-e03c7793104b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:03.164171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c96b1-951c-4cb9-87cc-e03c7793104b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:03.165042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c96b1-951c-4cb9-87cc-e03c7793104b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:03.184064 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3587/7202] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:03 2022] PUT /identity/v3/projects/f7df7f7890264174b2ce158ac80782a1/users/9f18147068284e0f85473b5a4aa64c66/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:03.196360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3131-03de-410b-aa58-4fd8e8519b5d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:03.196864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3131-03de-410b-aa58-4fd8e8519b5d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:03.197362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd3131-03de-410b-aa58-4fd8e8519b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:03.247424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9e0c96b1-951c-4cb9-87cc-e03c7793104b None None] MFA Rules not processed for user `849b5cc233da4829b6b4625f0a36d1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:03.249671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9e0c96b1-951c-4cb9-87cc-e03c7793104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:03.297215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f2bd3131-03de-410b-aa58-4fd8e8519b5d None None] MFA Rules not processed for user `9f18147068284e0f85473b5a4aa64c66`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:03.298592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f2bd3131-03de-410b-aa58-4fd8e8519b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:03.544499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:03.570443 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3588/7203] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:03.570443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd3131-03de-410b-aa58-4fd8e8519b5d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:03.571095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f2bd3131-03de-410b-aa58-4fd8e8519b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:03.609038 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3616/7204] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:03.612583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c96b1-951c-4cb9-87cc-e03c7793104b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:03.619769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9e0c96b1-951c-4cb9-87cc-e03c7793104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:03.676349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd3131-03de-410b-aa58-4fd8e8519b5d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:03.694271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:03.695063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:03.695350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:03.695625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] PATH_INFO: `/v3/users/2ca94d8c369f450d8465801026d4fc3b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:03.697542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca94d8c369f450d8465801026d4fc3b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:03.699397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:03.781336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c96b1-951c-4cb9-87cc-e03c7793104b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:03.786515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420ab98-5632-4553-ab13-4c5f8d8d1031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:03.787465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420ab98-5632-4553-ab13-4c5f8d8d1031 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:03.787890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420ab98-5632-4553-ab13-4c5f8d8d1031 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:03.789705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420ab98-5632-4553-ab13-4c5f8d8d1031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:03.802667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca94d8c369f450d8465801026d4fc3b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:03.805539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420ab98-5632-4553-ab13-4c5f8d8d1031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:03.807903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420ab98-5632-4553-ab13-4c5f8d8d1031 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:03.820980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca94d8c369f450d8465801026d4fc3b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:03.836295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca94d8c369f450d8465801026d4fc3b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:03.843378 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3617/7205] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:03 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:03.845799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420ab98-5632-4553-ab13-4c5f8d8d1031 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:03.852559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca94d8c369f450d8465801026d4fc3b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:03.853302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-99501cb0-09d5-4bf7-a206-cf87818fe47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca94d8c369f450d8465801026d4fc3b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:03.866322 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3589/7206] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:03 2022] DELETE /identity/v3/users/2ca94d8c369f450d8465801026d4fc3b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:03.867769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aff7b-6168-45d5-864b-7e091faa4b79 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:03.868053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aff7b-6168-45d5-864b-7e091faa4b79 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:03.868325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1aff7b-6168-45d5-864b-7e091faa4b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:03.875151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420ab98-5632-4553-ab13-4c5f8d8d1031 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:03.922378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1e1aff7b-6168-45d5-864b-7e091faa4b79 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:03.924384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1e1aff7b-6168-45d5-864b-7e091faa4b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:03.941516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:03.997066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba3515-e6df-4853-b071-ba3312163d3a tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:03.997744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3515-e6df-4853-b071-ba3312163d3a tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:03.998070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3515-e6df-4853-b071-ba3312163d3a tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:03.998328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba3515-e6df-4853-b071-ba3312163d3a tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:03.999163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba3515-e6df-4853-b071-ba3312163d3a tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:04.000930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eba3515-e6df-4853-b071-ba3312163d3a tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-9eba3515-e6df-4853-b071-ba3312163d3a tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invalid input for field 'name': '' is too short Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: Failed validating 'minLength' in schema['properties']['name']: Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: On instance['name']: Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: Failed validating 'minLength' in schema['properties']['name']: Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: On instance['name']: Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: '' Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise error Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application On instance['name']: Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application '' Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.009827 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 30 04:47:04.011756 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 30 04:47:04.012960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 30 04:47:04.012960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 30 04:47:04.012960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.012960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 30 04:47:04.012960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:47:04.012960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.012960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application On instance['name']: Aug 30 04:47:04.012960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application '' Aug 30 04:47:04.012960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.017130 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3618/7207] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:47:03 2022] POST /identity/v3/domains => generated 283 bytes in 173 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 30 04:47:04.018350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba3515-e6df-4853-b071-ba3312163d3a tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:04.021926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9eba3515-e6df-4853-b071-ba3312163d3a tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:04.039469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba3515-e6df-4853-b071-ba3312163d3a tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:04.044895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bee15-674e-4171-9684-e81be3fdabbc tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:04.045640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bee15-674e-4171-9684-e81be3fdabbc tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:04.045829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bee15-674e-4171-9684-e81be3fdabbc tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:04.046144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bee15-674e-4171-9684-e81be3fdabbc tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:04.046854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bee15-674e-4171-9684-e81be3fdabbc tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:04.049843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bee15-674e-4171-9684-e81be3fdabbc tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-334bee15-674e-4171-9684-e81be3fdabbc tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: Failed validating 'maxLength' in schema['properties']['name']: Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: On instance['name']: Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: Failed validating 'maxLength' in schema['properties']['name']: Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: On instance['name']: Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise error Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:47:04.058460 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application On instance['name']: Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 30 04:47:04.060004 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application On instance['name']: Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 04:47:04.061419 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.066264 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3619/7208] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:47:04 2022] POST /identity/v3/domains => generated 412 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 30 04:47:04.070583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bee15-674e-4171-9684-e81be3fdabbc tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:04.076759 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3590/7209] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:04.089276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aff7b-6168-45d5-864b-7e091faa4b79 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:04.091473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1e1aff7b-6168-45d5-864b-7e091faa4b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:04.100353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bee15-674e-4171-9684-e81be3fdabbc tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:04.110064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e50b-9413-4f2a-9f07-f453229ebb10 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:04.111044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e50b-9413-4f2a-9f07-f453229ebb10 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:04.112746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e50b-9413-4f2a-9f07-f453229ebb10 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:04.113189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e50b-9413-4f2a-9f07-f453229ebb10 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:04.114400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335e50b-9413-4f2a-9f07-f453229ebb10 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:04.118526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335e50b-9413-4f2a-9f07-f453229ebb10 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:04.124233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:04.157762 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3620/7210] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:47:04 2022] POST /identity/v3/domains => generated 276 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:04.158728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e50b-9413-4f2a-9f07-f453229ebb10 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:04.283333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1aff7b-6168-45d5-864b-7e091faa4b79 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:04.372139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e50b-9413-4f2a-9f07-f453229ebb10 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:04.383714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cb046-5f79-40db-bda4-a3e735ba00c6 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:04.384376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cb046-5f79-40db-bda4-a3e735ba00c6 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:04.384650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cb046-5f79-40db-bda4-a3e735ba00c6 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:04.384913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cb046-5f79-40db-bda4-a3e735ba00c6 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains/93210577501e4d9db22b23136c384626` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:04.416902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cb046-5f79-40db-bda4-a3e735ba00c6 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=93210577501e4d9db22b23136c384626)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:04.419111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cb046-5f79-40db-bda4-a3e735ba00c6 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-3e2cb046-5f79-40db-bda4-a3e735ba00c6 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 30 04:47:04.464880 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 30 04:47:04.466213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:47:04.466213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:47:04.466213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 30 04:47:04.466213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 30 04:47:04.466213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 30 04:47:04.466213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 30 04:47:04.466213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 30 04:47:04.466213 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:04.470779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746fe6-a3ba-433c-9a42-71fa2a095e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:04.471409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746fe6-a3ba-433c-9a42-71fa2a095e5d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:04.471686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746fe6-a3ba-433c-9a42-71fa2a095e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:04.471958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746fe6-a3ba-433c-9a42-71fa2a095e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:04.473568 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3621/7211] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:47:04 2022] DELETE /identity/v3/domains/93210577501e4d9db22b23136c384626 => generated 120 bytes in 315 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:47:04.477916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cb046-5f79-40db-bda4-a3e735ba00c6 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:04.519331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cb046-5f79-40db-bda4-a3e735ba00c6 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:04.529682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:04.530375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:04.530668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:04.533351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains/93210577501e4d9db22b23136c384626` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:04.536068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=93210577501e4d9db22b23136c384626)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:04.540831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:04.594166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '93210577501e4d9db22b23136c384626'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:04.596725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '93210577501e4d9db22b23136c384626'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:04.662702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '93210577501e4d9db22b23136c384626'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:04.665077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '93210577501e4d9db22b23136c384626'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:04.670716 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3622/7212] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:47:04 2022] PATCH /identity/v3/domains/93210577501e4d9db22b23136c384626 => generated 277 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:04.675058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:04.693065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:04.705693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49746fe6-a3ba-433c-9a42-71fa2a095e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:04.707228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49746fe6-a3ba-433c-9a42-71fa2a095e5d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:04.745283 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3591/7213] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:04.746222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746fe6-a3ba-433c-9a42-71fa2a095e5d service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:04.783695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746fe6-a3ba-433c-9a42-71fa2a095e5d service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:04.819568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:04.856689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2851856-1db1-4b10-bf3d-bf217bae57cb tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:04.870084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:04.872214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:04.873020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:04.874294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] PATH_INFO: `/v3/projects/8b3500f994ee47bb83a6902adc26e100` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:04.878989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b3500f994ee47bb83a6902adc26e100)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:04.883986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:05.005867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:05.007589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:05.009785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:05.010602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains/93210577501e4d9db22b23136c384626` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:05.013188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b3500f994ee47bb83a6902adc26e100', 'request_id': 'req-1119183c-b246-45ba-8e97-fce15c9ee9cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.020760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b3500f994ee47bb83a6902adc26e100', 'request_id': 'req-1119183c-b246-45ba-8e97-fce15c9ee9cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.046517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b3500f994ee47bb83a6902adc26e100', 'request_id': 'req-1119183c-b246-45ba-8e97-fce15c9ee9cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.050795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=93210577501e4d9db22b23136c384626)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:05.059423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:05.065068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] The token cache is being invalidate because project 8b3500f994ee47bb83a6902adc26e100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:05.065425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.066639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.073400 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3623/7214] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:04 2022] DELETE /identity/v3/projects/8b3500f994ee47bb83a6902adc26e100 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:05.074639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:05.077809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:05.119215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:05.138292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '93210577501e4d9db22b23136c384626'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.149411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '93210577501e4d9db22b23136c384626'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.249303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93210577501e4d9db22b23136c384626', 'request_id': 'req-fe8a8aca-4950-49f7-af15-b133e7202387'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.278331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93210577501e4d9db22b23136c384626', 'request_id': 'req-fe8a8aca-4950-49f7-af15-b133e7202387'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.287473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93210577501e4d9db22b23136c384626', 'request_id': 'req-fe8a8aca-4950-49f7-af15-b133e7202387'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.304043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119183c-b246-45ba-8e97-fce15c9ee9cf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:05.304525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] The token cache is being invalidate because project 93210577501e4d9db22b23136c384626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:05.305695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.306794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.319805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '93210577501e4d9db22b23136c384626', 'request_id': 'req-fe8a8aca-4950-49f7-af15-b133e7202387'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.321452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '93210577501e4d9db22b23136c384626', 'request_id': 'req-fe8a8aca-4950-49f7-af15-b133e7202387'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.327562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8a8aca-4950-49f7-af15-b133e7202387 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '93210577501e4d9db22b23136c384626', 'request_id': 'req-fe8a8aca-4950-49f7-af15-b133e7202387'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.336631 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3592/7215] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:47:04 2022] DELETE /identity/v3/domains/93210577501e4d9db22b23136c384626 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:05.341227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc2681-d83d-4035-9680-035a4690a722 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:05.343030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc2681-d83d-4035-9680-035a4690a722 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:05.343792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc2681-d83d-4035-9680-035a4690a722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:05.395107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1bbc2681-d83d-4035-9680-035a4690a722 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:05.398608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1bbc2681-d83d-4035-9680-035a4690a722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:05.479567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:05.481197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:05.481489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:05.481765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] PATH_INFO: `/v3/users/2d6d3a07b0d44e50b85a9132a819d960` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:05.486633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6d3a07b0d44e50b85a9132a819d960)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:05.488998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:05.503007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3593/7216] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:05.503815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc2681-d83d-4035-9680-035a4690a722 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:05.505213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1bbc2681-d83d-4035-9680-035a4690a722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:05.523663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc2681-d83d-4035-9680-035a4690a722 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:05.530035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:05.530701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:05.531216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:05.533634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] PATH_INFO: `/v3/projects/2f321e89fc6548b0be3d5c9ef008e95b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:05.535014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f321e89fc6548b0be3d5c9ef008e95b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:05.537027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:05.605634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:05.628423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f321e89fc6548b0be3d5c9ef008e95b', 'request_id': 'req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.643080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:05.656456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f321e89fc6548b0be3d5c9ef008e95b', 'request_id': 'req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.659369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6d3a07b0d44e50b85a9132a819d960'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.663426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6d3a07b0d44e50b85a9132a819d960'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.666230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f321e89fc6548b0be3d5c9ef008e95b', 'request_id': 'req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.675387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6d3a07b0d44e50b85a9132a819d960'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.692527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] The token cache is being invalidate because project 2f321e89fc6548b0be3d5c9ef008e95b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:05.692880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.694618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.700935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3594/7217] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:05 2022] DELETE /identity/v3/projects/2f321e89fc6548b0be3d5c9ef008e95b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:05.700935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:05.702168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6d3a07b0d44e50b85a9132a819d960'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.704604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:05.734065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8f3ab414-abbf-4648-b731-decbca108275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6d3a07b0d44e50b85a9132a819d960'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:05.754222 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3624/7218] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:05 2022] DELETE /identity/v3/users/2d6d3a07b0d44e50b85a9132a819d960 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:05.756757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cf069-a1fe-4787-8828-d42bfb445331 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:05.759023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cf069-a1fe-4787-8828-d42bfb445331 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:05.759380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cf069-a1fe-4787-8828-d42bfb445331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:05.817018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-411cf069-a1fe-4787-8828-d42bfb445331 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:05.820831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-411cf069-a1fe-4787-8828-d42bfb445331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:05.900104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d64e7d-5e41-4dfd-bdb4-87034ce2942b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:05.997287 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3625/7219] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:05.997863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8417b-4677-4a7d-b82f-5bb05a665fb3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:05.997863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8417b-4677-4a7d-b82f-5bb05a665fb3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:05.998173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8417b-4677-4a7d-b82f-5bb05a665fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.052566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14054c13-8cdf-41e9-9852-eb5edf06bd05 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.053854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054c13-8cdf-41e9-9852-eb5edf06bd05 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.054564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054c13-8cdf-41e9-9852-eb5edf06bd05 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.054858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14054c13-8cdf-41e9-9852-eb5edf06bd05 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains/d115f4a24f6b4918adb69395a163a5ff` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.055574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-bba8417b-4677-4a7d-b82f-5bb05a665fb3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:06.058593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bba8417b-4677-4a7d-b82f-5bb05a665fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:06.071330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14054c13-8cdf-41e9-9852-eb5edf06bd05 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:47:06.096857 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3626/7220] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:06.098455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d7893-ee44-4031-b6e1-f9a366aa42e8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.098740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d7893-ee44-4031-b6e1-f9a366aa42e8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.099011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d7893-ee44-4031-b6e1-f9a366aa42e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-14054c13-8cdf-41e9-9852-eb5edf06bd05 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Could not find domain: d115f4a24f6b4918adb69395a163a5ff.: keystone.exception.DomainNotFound: Could not find domain: d115f4a24f6b4918adb69395a163a5ff. Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d115f4a24f6b4918adb69395a163a5ff. Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:06.099583 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:47:06.100615 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:47:06.101604 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d115f4a24f6b4918adb69395a163a5ff. Aug 30 04:47:06.102839 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:06.107391 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3595/7221] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:47:05 2022] DELETE /identity/v3/domains/d115f4a24f6b4918adb69395a163a5ff => generated 112 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:47:06.108372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14054c13-8cdf-41e9-9852-eb5edf06bd05 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.137336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14054c13-8cdf-41e9-9852-eb5edf06bd05 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:06.144341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-270d7893-ee44-4031-b6e1-f9a366aa42e8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:06.148313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-270d7893-ee44-4031-b6e1-f9a366aa42e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:06.151095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c025d-b818-4ca0-952f-5e33e05daf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.151742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c025d-b818-4ca0-952f-5e33e05daf0e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.152081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c025d-b818-4ca0-952f-5e33e05daf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.152354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c025d-b818-4ca0-952f-5e33e05daf0e admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.153018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c025d-b818-4ca0-952f-5e33e05daf0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:47:06.153318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c025d-b818-4ca0-952f-5e33e05daf0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:06.155780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c025d-b818-4ca0-952f-5e33e05daf0e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:06.184602 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3627/7222] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:06.187871 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3596/7223] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:06.192088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1037dc-f9a2-47df-aacf-656571cc68cf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.192382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1037dc-f9a2-47df-aacf-656571cc68cf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.192662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1037dc-f9a2-47df-aacf-656571cc68cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.196898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d7893-ee44-4031-b6e1-f9a366aa42e8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.200341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-270d7893-ee44-4031-b6e1-f9a366aa42e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:06.237273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0c1037dc-f9a2-47df-aacf-656571cc68cf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:06.238744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d7893-ee44-4031-b6e1-f9a366aa42e8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:06.238911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0c1037dc-f9a2-47df-aacf-656571cc68cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:06.248130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0a411-1580-467a-bc91-87da79c9dfc1 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.249003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0a411-1580-467a-bc91-87da79c9dfc1 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.249614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0a411-1580-467a-bc91-87da79c9dfc1 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.250078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b0a411-1580-467a-bc91-87da79c9dfc1 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.251076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0a411-1580-467a-bc91-87da79c9dfc1 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:06.263811 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3597/7224] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:06.263811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1037dc-f9a2-47df-aacf-656571cc68cf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.264444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b0a411-1580-467a-bc91-87da79c9dfc1 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:06.283281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1037dc-f9a2-47df-aacf-656571cc68cf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:06.294620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d38f0e-a658-422a-87a9-70db282d4784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.295269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d38f0e-a658-422a-87a9-70db282d4784 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.295558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d38f0e-a658-422a-87a9-70db282d4784 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.295832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d38f0e-a658-422a-87a9-70db282d4784 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.297266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d38f0e-a658-422a-87a9-70db282d4784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:06.303609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d38f0e-a658-422a-87a9-70db282d4784 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:06.311078 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3628/7225] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:47:06 2022] POST /identity/v3/domains => generated 253 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:06.312457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0a411-1580-467a-bc91-87da79c9dfc1 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.318905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f5b0a411-1580-467a-bc91-87da79c9dfc1 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:06.370555 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3598/7226] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:06 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:06.371642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d38f0e-a658-422a-87a9-70db282d4784 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.511469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:06.541374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d38f0e-a658-422a-87a9-70db282d4784 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:06.546634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b0a411-1580-467a-bc91-87da79c9dfc1 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:06.550961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d42223-f41f-451b-893f-183caf34cf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.551607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d42223-f41f-451b-893f-183caf34cf44 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.551882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d42223-f41f-451b-893f-183caf34cf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.552153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d42223-f41f-451b-893f-183caf34cf44 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.552821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d42223-f41f-451b-893f-183caf34cf44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:47:06.553124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d42223-f41f-451b-893f-183caf34cf44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:06.559317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d42223-f41f-451b-893f-183caf34cf44 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:06.602959 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3599/7227] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:06.609451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d42223-f41f-451b-893f-183caf34cf44 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.654437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:06.686779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7767f30-b26a-476a-9378-4487823b9b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.687477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7767f30-b26a-476a-9378-4487823b9b1b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.687719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7767f30-b26a-476a-9378-4487823b9b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.687948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7767f30-b26a-476a-9378-4487823b9b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.711530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7767f30-b26a-476a-9378-4487823b9b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:06.713235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7767f30-b26a-476a-9378-4487823b9b1b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:06.737726 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3629/7228] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:06.739092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7767f30-b26a-476a-9378-4487823b9b1b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.772632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7767f30-b26a-476a-9378-4487823b9b1b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:06.781306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41c0d-23d1-4cad-93e5-0536df07747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.781962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41c0d-23d1-4cad-93e5-0536df07747a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.782302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41c0d-23d1-4cad-93e5-0536df07747a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.782578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b41c0d-23d1-4cad-93e5-0536df07747a admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.783524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b41c0d-23d1-4cad-93e5-0536df07747a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:06.785606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b41c0d-23d1-4cad-93e5-0536df07747a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:06.787022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d42223-f41f-451b-893f-183caf34cf44 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:06.799296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d1671-14c6-4efc-b04c-30d408b15455 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.804252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1671-14c6-4efc-b04c-30d408b15455 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.804843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1671-14c6-4efc-b04c-30d408b15455 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.805032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d1671-14c6-4efc-b04c-30d408b15455 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.806500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d1671-14c6-4efc-b04c-30d408b15455 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:06.808249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d1671-14c6-4efc-b04c-30d408b15455 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:06.835594 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3630/7229] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:06 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:06.836224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41c0d-23d1-4cad-93e5-0536df07747a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.836904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.sql.core [None req-b48d1671-14c6-4efc-b04c-30d408b15455 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-2103277507' for key 'project.ixu_project_name_domain_id'") Aug 30 04:47:06.836904 n-d-820368-36 devstack@keystone.service[82099]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 04:47:06.836904 n-d-820368-36 devstack@keystone.service[82099]: [parameters: {'id': 'b0cc2a5b243e418fbfa3c7b1408e33cb', 'name': 'tempest-domain-dup-2103277507', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 30 04:47:06.836904 n-d-820368-36 devstack@keystone.service[82099]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82099) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-b48d1671-14c6-4efc-b04c-30d408b15455 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2103277507.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2103277507. Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:47:06.849686 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application result.read() Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-2103277507' for key 'project.ixu_project_name_domain_id'") Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 04:47:06.850868 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application yield resource Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application next(self.gen) Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise self.value Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application session.commit() Aug 30 04:47:06.852234 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.session.flush() Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application compat.raise_( Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:47:06.853511 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 04:47:06.854757 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application conn.query(q) Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application result.read() Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:47:06.855800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-2103277507' for key 'project.ixu_project_name_domain_id'") Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [parameters: {'id': 'b0cc2a5b243e418fbfa3c7b1408e33cb', 'name': 'tempest-domain-dup-2103277507', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:06.857038 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-2103277507. Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:06.859000 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2103277507. Aug 30 04:47:06.860515 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:06.866813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b41c0d-23d1-4cad-93e5-0536df07747a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:06.867288 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3600/7230] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Aug 30 04:47:06 2022] POST /identity/v3/domains => generated 212 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:47:06.868449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d1671-14c6-4efc-b04c-30d408b15455 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.882115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c6681-8db0-4ff0-8db3-3ff80f8c8dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.883301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c6681-8db0-4ff0-8db3-3ff80f8c8dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.883587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c6681-8db0-4ff0-8db3-3ff80f8c8dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.883885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c6681-8db0-4ff0-8db3-3ff80f8c8dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.884549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c6681-8db0-4ff0-8db3-3ff80f8c8dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:06.890435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c6681-8db0-4ff0-8db3-3ff80f8c8dd5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:06.899220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d1671-14c6-4efc-b04c-30d408b15455 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:06.909003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d61956-d162-40a6-9a92-a38d6d97cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.909754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61956-d162-40a6-9a92-a38d6d97cdcd admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:06.910217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61956-d162-40a6-9a92-a38d6d97cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:06.910604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61956-d162-40a6-9a92-a38d6d97cdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:06.911372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d61956-d162-40a6-9a92-a38d6d97cdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:06.913189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d61956-d162-40a6-9a92-a38d6d97cdcd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:06.940751 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3601/7231] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:06.941863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d61956-d162-40a6-9a92-a38d6d97cdcd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.975138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d61956-d162-40a6-9a92-a38d6d97cdcd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:06.996630 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3631/7232] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:06 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:06.996630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c6681-8db0-4ff0-8db3-3ff80f8c8dd5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:06.998107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:06.999672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:07.000186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:07.000947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains/405b2151f64240e0809770c8f217074d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:07.039128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=405b2151f64240e0809770c8f217074d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:07.044792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:07.100431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '405b2151f64240e0809770c8f217074d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:07.102586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '405b2151f64240e0809770c8f217074d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:07.153444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '405b2151f64240e0809770c8f217074d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:07.154371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '405b2151f64240e0809770c8f217074d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:07.164876 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3602/7233] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:47:06 2022] PATCH /identity/v3/domains/405b2151f64240e0809770c8f217074d => generated 254 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:07.165789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:07.168297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:07.190731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c6681-8db0-4ff0-8db3-3ff80f8c8dd5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:07.329180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05910546-d325-4148-b5ce-bdcf4fe1e39b tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:07.340279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45918000-a5c9-47bd-9fad-874d3d017507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:07.341059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45918000-a5c9-47bd-9fad-874d3d017507 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:07.341338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45918000-a5c9-47bd-9fad-874d3d017507 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:07.341612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45918000-a5c9-47bd-9fad-874d3d017507 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:07.342445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45918000-a5c9-47bd-9fad-874d3d017507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:07.349742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45918000-a5c9-47bd-9fad-874d3d017507 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:07.389040 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3603/7234] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:07 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:07.390008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45918000-a5c9-47bd-9fad-874d3d017507 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:07.398050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-45918000-a5c9-47bd-9fad-874d3d017507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:07.401683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13b94a-86b8-4095-a08d-ec18b2cc94a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:07.402943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b94a-86b8-4095-a08d-ec18b2cc94a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:07.403430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b94a-86b8-4095-a08d-ec18b2cc94a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:07.403902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13b94a-86b8-4095-a08d-ec18b2cc94a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:07.404778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13b94a-86b8-4095-a08d-ec18b2cc94a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:07.407728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13b94a-86b8-4095-a08d-ec18b2cc94a7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:07.415125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:07.446430 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3632/7235] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:07.447535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13b94a-86b8-4095-a08d-ec18b2cc94a7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:07.490391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13b94a-86b8-4095-a08d-ec18b2cc94a7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:07.506390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50a691-a41b-4669-9a60-4faa7b8e11c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:07.507205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50a691-a41b-4669-9a60-4faa7b8e11c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:07.507582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50a691-a41b-4669-9a60-4faa7b8e11c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:07.507944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50a691-a41b-4669-9a60-4faa7b8e11c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:07.508979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50a691-a41b-4669-9a60-4faa7b8e11c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:07.513289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50a691-a41b-4669-9a60-4faa7b8e11c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:07.545381 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3633/7236] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:07.545381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50a691-a41b-4669-9a60-4faa7b8e11c9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:07.550744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8c50a691-a41b-4669-9a60-4faa7b8e11c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:07.593778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50a691-a41b-4669-9a60-4faa7b8e11c9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:07.603308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c045d-1acb-4bf2-8f63-f638727efc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:07.604265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c045d-1acb-4bf2-8f63-f638727efc75 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:07.604391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45918000-a5c9-47bd-9fad-874d3d017507 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:07.604807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c045d-1acb-4bf2-8f63-f638727efc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:07.605267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c045d-1acb-4bf2-8f63-f638727efc75 admin admin] PATH_INFO: `/v3/projects/710a7453647447728ab3f0a6be2424af/users/c5c51e9e601a4ef985e5d3a7557db3ef/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:07.624141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:07.624983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:07.626602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:07.626981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains/405b2151f64240e0809770c8f217074d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:07.659838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c045d-1acb-4bf2-8f63-f638727efc75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710a7453647447728ab3f0a6be2424af, user_id=c5c51e9e601a4ef985e5d3a7557db3ef, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:07.663740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c045d-1acb-4bf2-8f63-f638727efc75 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:07.665840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=405b2151f64240e0809770c8f217074d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:07.667350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:07.699142 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3634/7237] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:07 2022] PUT /identity/v3/projects/710a7453647447728ab3f0a6be2424af/users/c5c51e9e601a4ef985e5d3a7557db3ef/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:07.700005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c045d-1acb-4bf2-8f63-f638727efc75 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:07.722576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:07.740988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '405b2151f64240e0809770c8f217074d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:07.760114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '405b2151f64240e0809770c8f217074d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:07.909824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c045d-1acb-4bf2-8f63-f638727efc75 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:07.936155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '405b2151f64240e0809770c8f217074d', 'request_id': 'req-cdd0e88e-bb14-4470-858f-847910468d8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:07.980068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '405b2151f64240e0809770c8f217074d', 'request_id': 'req-cdd0e88e-bb14-4470-858f-847910468d8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:07.992932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '405b2151f64240e0809770c8f217074d', 'request_id': 'req-cdd0e88e-bb14-4470-858f-847910468d8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.028029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] The token cache is being invalidate because project 405b2151f64240e0809770c8f217074d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:08.032963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.035212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.069816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '405b2151f64240e0809770c8f217074d', 'request_id': 'req-cdd0e88e-bb14-4470-858f-847910468d8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.070818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '405b2151f64240e0809770c8f217074d', 'request_id': 'req-cdd0e88e-bb14-4470-858f-847910468d8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.075761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cdd0e88e-bb14-4470-858f-847910468d8c tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '405b2151f64240e0809770c8f217074d', 'request_id': 'req-cdd0e88e-bb14-4470-858f-847910468d8c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.095304 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3604/7238] 10.222.0.43 () {58 vars in 1230 bytes} [Tue Aug 30 04:47:07 2022] DELETE /identity/v3/domains/405b2151f64240e0809770c8f217074d => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:08.108460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ba07-fcdc-4bf3-9198-b1904c60429f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:08.109040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ba07-fcdc-4bf3-9198-b1904c60429f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:08.109040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83ba07-fcdc-4bf3-9198-b1904c60429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:08.122933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a029b-2195-4743-9098-85312c83aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:08.123723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a029b-2195-4743-9098-85312c83aab7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:08.124100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a029b-2195-4743-9098-85312c83aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:08.124482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a029b-2195-4743-9098-85312c83aab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:08.125394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a029b-2195-4743-9098-85312c83aab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:08.127220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a029b-2195-4743-9098-85312c83aab7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:08.154888 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3635/7239] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:08.156878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a029b-2195-4743-9098-85312c83aab7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:08.165421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a59a029b-2195-4743-9098-85312c83aab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:08.195372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ad83ba07-fcdc-4bf3-9198-b1904c60429f None None] MFA Rules not processed for user `c5c51e9e601a4ef985e5d3a7557db3ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:08.196559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a029b-2195-4743-9098-85312c83aab7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:08.206104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ad83ba07-fcdc-4bf3-9198-b1904c60429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:08.212902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:08.213790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:08.214180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:08.214542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] PATH_INFO: `/v3/projects/d03fbb1941d0402ca80e636887a3d384` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:08.217937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d03fbb1941d0402ca80e636887a3d384)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:08.220905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:08.288019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:08.376385 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3605/7240] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:08.377522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83ba07-fcdc-4bf3-9198-b1904c60429f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:08.381046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ad83ba07-fcdc-4bf3-9198-b1904c60429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:08.392166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd03fbb1941d0402ca80e636887a3d384', 'request_id': 'req-c4a4c793-6005-4a29-9d65-d6cdc265e231'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.403983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd03fbb1941d0402ca80e636887a3d384', 'request_id': 'req-c4a4c793-6005-4a29-9d65-d6cdc265e231'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.427524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd03fbb1941d0402ca80e636887a3d384', 'request_id': 'req-c4a4c793-6005-4a29-9d65-d6cdc265e231'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.447549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] The token cache is being invalidate because project d03fbb1941d0402ca80e636887a3d384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:08.447919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.448547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:08.450268 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3636/7241] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:08 2022] DELETE /identity/v3/projects/d03fbb1941d0402ca80e636887a3d384 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:08.451098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:08.454684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:08.534629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:08.559112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83ba07-fcdc-4bf3-9198-b1904c60429f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:08.611972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c793-6005-4a29-9d65-d6cdc265e231 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:08.644604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9532ec6-b344-4df5-9fb9-55ae3da6bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:08.645320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9532ec6-b344-4df5-9fb9-55ae3da6bf1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:08.645595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9532ec6-b344-4df5-9fb9-55ae3da6bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:08.645890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9532ec6-b344-4df5-9fb9-55ae3da6bf1e admin admin] PATH_INFO: `/v3/projects/4baaefb6631f4ab19d40336b5c3c73e0/users/d8c622d475cd40b490f495d595485777/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:08.696786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9532ec6-b344-4df5-9fb9-55ae3da6bf1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4baaefb6631f4ab19d40336b5c3c73e0, user_id=d8c622d475cd40b490f495d595485777, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:08.699630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9532ec6-b344-4df5-9fb9-55ae3da6bf1e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:08.748529 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3637/7242] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:08 2022] PUT /identity/v3/projects/4baaefb6631f4ab19d40336b5c3c73e0/users/d8c622d475cd40b490f495d595485777/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:08.749582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9532ec6-b344-4df5-9fb9-55ae3da6bf1e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:08.759501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a9532ec6-b344-4df5-9fb9-55ae3da6bf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:08.777496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f137e-311e-4e9c-ad51-21e720884604 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '849b5cc233da4829b6b4625f0a36d1bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36d6bdf580584b1cae1e3f43adf46318', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:08.778246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f137e-311e-4e9c-ad51-21e720884604 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:08.779238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f137e-311e-4e9c-ad51-21e720884604 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:08.779525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f137e-311e-4e9c-ad51-21e720884604 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] PATH_INFO: `/v3/domains/93210577501e4d9db22b23136c384626` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:08.789731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f137e-311e-4e9c-ad51-21e720884604 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-4d2f137e-311e-4e9c-ad51-21e720884604 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Could not find domain: 93210577501e4d9db22b23136c384626.: keystone.exception.DomainNotFound: Could not find domain: 93210577501e4d9db22b23136c384626. Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 93210577501e4d9db22b23136c384626. Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:08.795111 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:47:08.796257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application with Lock( Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._enter() Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.creator() Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application created_value = creator( Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 04:47:08.797397 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 93210577501e4d9db22b23136c384626. Aug 30 04:47:08.799247 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:08.801714 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3606/7243] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Aug 30 04:47:08 2022] PATCH /identity/v3/domains/93210577501e4d9db22b23136c384626 => generated 112 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:47:08.802817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f137e-311e-4e9c-ad51-21e720884604 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:08.804576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4d2f137e-311e-4e9c-ad51-21e720884604 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:08.834765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f137e-311e-4e9c-ad51-21e720884604 tempest-DomainsNegativeTestJSON-1710610841 tempest-DomainsNegativeTestJSON-1710610841-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:08.937987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9532ec6-b344-4df5-9fb9-55ae3da6bf1e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:08.951362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:08.951584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f592db0-3e59-4a56-8a0e-0272ffc1227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:08.952242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f592db0-3e59-4a56-8a0e-0272ffc1227c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:08.953324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f592db0-3e59-4a56-8a0e-0272ffc1227c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:08.953721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f592db0-3e59-4a56-8a0e-0272ffc1227c admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:08.956200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f592db0-3e59-4a56-8a0e-0272ffc1227c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:08.961996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f592db0-3e59-4a56-8a0e-0272ffc1227c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:08.971502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:08.971798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:08.972084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] PATH_INFO: `/v3/users/9f18147068284e0f85473b5a4aa64c66` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:08.978266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f18147068284e0f85473b5a4aa64c66)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:08.993426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:09.035724 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3638/7244] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:08 2022] POST /identity/v3/projects => generated 379 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:09.042659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caca95-30c4-42f1-97a8-c0730f6e25b8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:09.044307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caca95-30c4-42f1-97a8-c0730f6e25b8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:09.044735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72caca95-30c4-42f1-97a8-c0730f6e25b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:09.062417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:09.126250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-72caca95-30c4-42f1-97a8-c0730f6e25b8 None None] MFA Rules not processed for user `d8c622d475cd40b490f495d595485777`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:09.128242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-72caca95-30c4-42f1-97a8-c0730f6e25b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:09.141548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f18147068284e0f85473b5a4aa64c66'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:09.156299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f18147068284e0f85473b5a4aa64c66'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:09.188937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f18147068284e0f85473b5a4aa64c66'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:09.206952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f18147068284e0f85473b5a4aa64c66'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:09.207461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f18147068284e0f85473b5a4aa64c66'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:09.218113 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3607/7245] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:08 2022] DELETE /identity/v3/users/9f18147068284e0f85473b5a4aa64c66 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:09.219735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:09.223879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:09.291130 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3639/7246] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:09.296031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caca95-30c4-42f1-97a8-c0730f6e25b8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:09.296780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-72caca95-30c4-42f1-97a8-c0730f6e25b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:09.375307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ffe9c-1d1f-4ea6-8f06-48f9c76a8f2a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:09.384089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:09.384986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:09.385539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:09.386009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] PATH_INFO: `/v3/users/e6c856ea002144238cd0e37b4671c4c6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:09.386372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:09.388337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c856ea002144238cd0e37b4671c4c6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:09.390815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:09.422595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72caca95-30c4-42f1-97a8-c0730f6e25b8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:09.428254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38069135-43d9-4e19-9155-35ccbd2cda47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:09.428900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38069135-43d9-4e19-9155-35ccbd2cda47 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:09.429179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38069135-43d9-4e19-9155-35ccbd2cda47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:09.429536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38069135-43d9-4e19-9155-35ccbd2cda47 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:09.430124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38069135-43d9-4e19-9155-35ccbd2cda47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:09.432616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38069135-43d9-4e19-9155-35ccbd2cda47 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:09.464920 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3640/7247] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:09 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:09.465809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38069135-43d9-4e19-9155-35ccbd2cda47 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:09.468466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-38069135-43d9-4e19-9155-35ccbd2cda47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:09.486974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c856ea002144238cd0e37b4671c4c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:09.500872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c856ea002144238cd0e37b4671c4c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:09.529421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c856ea002144238cd0e37b4671c4c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:09.557950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c856ea002144238cd0e37b4671c4c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:09.558607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c856ea002144238cd0e37b4671c4c6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:09.561429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38069135-43d9-4e19-9155-35ccbd2cda47 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:09.566997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ca269-7a9b-4d31-ab5f-6c6b52d5cda1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:09.567639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca269-7a9b-4d31-ab5f-6c6b52d5cda1 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:09.567919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca269-7a9b-4d31-ab5f-6c6b52d5cda1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:09.568188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ca269-7a9b-4d31-ab5f-6c6b52d5cda1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:09.569063 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3608/7248] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:09 2022] DELETE /identity/v3/users/e6c856ea002144238cd0e37b4671c4c6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:09.570203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:09.573643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f63ca269-7a9b-4d31-ab5f-6c6b52d5cda1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:09.574003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:09.625959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:09.655048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ca269-7a9b-4d31-ab5f-6c6b52d5cda1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:09.656277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ca269-7a9b-4d31-ab5f-6c6b52d5cda1 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:09.667711 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3641/7249] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:09.669128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307cd54-ab47-420e-964d-c71842710d05 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:09.669334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307cd54-ab47-420e-964d-c71842710d05 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:09.669587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307cd54-ab47-420e-964d-c71842710d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:09.702966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1307cd54-ab47-420e-964d-c71842710d05 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:09.704811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1307cd54-ab47-420e-964d-c71842710d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:09.744350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd826155-a091-41b9-8aa7-ad47a0662716 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:09.757514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ddb03-75aa-4cb9-aaa7-f1964adc78e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:09.758217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ddb03-75aa-4cb9-aaa7-f1964adc78e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:09.758503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ddb03-75aa-4cb9-aaa7-f1964adc78e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:09.758828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ddb03-75aa-4cb9-aaa7-f1964adc78e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:09.759491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ddb03-75aa-4cb9-aaa7-f1964adc78e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:09.765165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ddb03-75aa-4cb9-aaa7-f1964adc78e5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:09.781554 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3642/7250] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:09.792914 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3609/7251] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:09.794146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307cd54-ab47-420e-964d-c71842710d05 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:09.801703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ddb03-75aa-4cb9-aaa7-f1964adc78e5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:09.804876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-507ddb03-75aa-4cb9-aaa7-f1964adc78e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:09.812821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307cd54-ab47-420e-964d-c71842710d05 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:09.829143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d13df5-8b52-453b-81f0-721e0bc95498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:09.830130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13df5-8b52-453b-81f0-721e0bc95498 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:09.830558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13df5-8b52-453b-81f0-721e0bc95498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:09.830869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d13df5-8b52-453b-81f0-721e0bc95498 admin admin] PATH_INFO: `/v3/projects/6d0e100694fb4123b543b2b9b739e918/users/ef8aa98c42df4bfcad3515369c316478/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:09.872913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d13df5-8b52-453b-81f0-721e0bc95498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0e100694fb4123b543b2b9b739e918, user_id=ef8aa98c42df4bfcad3515369c316478, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:09.892731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d13df5-8b52-453b-81f0-721e0bc95498 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:09.896902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ddb03-75aa-4cb9-aaa7-f1964adc78e5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:09.901952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:09.911800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462355d2-98ab-4942-acf9-5c76a9c42e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:09.912413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462355d2-98ab-4942-acf9-5c76a9c42e00 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:09.912741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462355d2-98ab-4942-acf9-5c76a9c42e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:09.912955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462355d2-98ab-4942-acf9-5c76a9c42e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:09.929214 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3643/7252] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:09 2022] PUT /identity/v3/projects/6d0e100694fb4123b543b2b9b739e918/users/ef8aa98c42df4bfcad3515369c316478/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:09.932636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d13df5-8b52-453b-81f0-721e0bc95498 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:09.936694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d2d13df5-8b52-453b-81f0-721e0bc95498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:09.944567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462355d2-98ab-4942-acf9-5c76a9c42e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:09.946443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462355d2-98ab-4942-acf9-5c76a9c42e00 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:09.966329 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3610/7253] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:09.967392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462355d2-98ab-4942-acf9-5c76a9c42e00 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:09.988059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462355d2-98ab-4942-acf9-5c76a9c42e00 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:10.029629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d13df5-8b52-453b-81f0-721e0bc95498 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:10.036389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:10.037173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:10.037510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:10.037844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] PATH_INFO: `/v3/projects/f7df7f7890264174b2ce158ac80782a1` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:10.039975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7df7f7890264174b2ce158ac80782a1)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:10.042288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:10.108763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7df7f7890264174b2ce158ac80782a1', 'request_id': 'req-5b6c950c-08a2-44e4-90a8-8eb6bb829994'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:10.111888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76b3e0-6f12-4aef-87da-98134f8b09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:10.112528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76b3e0-6f12-4aef-87da-98134f8b09a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:10.112859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76b3e0-6f12-4aef-87da-98134f8b09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:10.113524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76b3e0-6f12-4aef-87da-98134f8b09a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:10.114360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76b3e0-6f12-4aef-87da-98134f8b09a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:10.116151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76b3e0-6f12-4aef-87da-98134f8b09a1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:10.118724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7df7f7890264174b2ce158ac80782a1', 'request_id': 'req-5b6c950c-08a2-44e4-90a8-8eb6bb829994'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:10.142990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7df7f7890264174b2ce158ac80782a1', 'request_id': 'req-5b6c950c-08a2-44e4-90a8-8eb6bb829994'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:10.151907 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3611/7254] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:10.152855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76b3e0-6f12-4aef-87da-98134f8b09a1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:10.179084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76b3e0-6f12-4aef-87da-98134f8b09a1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:10.182331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] The token cache is being invalidate because project f7df7f7890264174b2ce158ac80782a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:10.182624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:10.186093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5b6c950c-08a2-44e4-90a8-8eb6bb829994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:10.191456 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3644/7255] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:09 2022] DELETE /identity/v3/projects/f7df7f7890264174b2ce158ac80782a1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:10.195833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9714-c265-49d1-a6d3-cf406988d590 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:10.196047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9714-c265-49d1-a6d3-cf406988d590 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:10.196309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e9714-c265-49d1-a6d3-cf406988d590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:10.279807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-976e9714-c265-49d1-a6d3-cf406988d590 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:10.281106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-976e9714-c265-49d1-a6d3-cf406988d590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:10.293973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:10.314730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4318564-8399-4f6d-969b-0710444486d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:10.315389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318564-8399-4f6d-969b-0710444486d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:10.315687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318564-8399-4f6d-969b-0710444486d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:10.315950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4318564-8399-4f6d-969b-0710444486d8 admin admin] PATH_INFO: `/v3/projects/6d0e100694fb4123b543b2b9b739e918/users/ef8aa98c42df4bfcad3515369c316478/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:10.318056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4318564-8399-4f6d-969b-0710444486d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d0e100694fb4123b543b2b9b739e918, user_id=ef8aa98c42df4bfcad3515369c316478, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:10.320903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4318564-8399-4f6d-969b-0710444486d8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:10.355270 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3612/7256] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:10 2022] PUT /identity/v3/projects/6d0e100694fb4123b543b2b9b739e918/users/ef8aa98c42df4bfcad3515369c316478/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:10.360400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db56563-9a8b-4bb7-86ac-ec66baf98f40 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:10.360400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db56563-9a8b-4bb7-86ac-ec66baf98f40 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:10.360762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db56563-9a8b-4bb7-86ac-ec66baf98f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:10.403733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5db56563-9a8b-4bb7-86ac-ec66baf98f40 None None] MFA Rules not processed for user `ef8aa98c42df4bfcad3515369c316478`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:10.404963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5db56563-9a8b-4bb7-86ac-ec66baf98f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:10.428858 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3645/7257] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:10.432035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686a65b-f595-482f-9186-be9eded9eef1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:10.432485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686a65b-f595-482f-9186-be9eded9eef1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:10.432944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686a65b-f595-482f-9186-be9eded9eef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:10.481895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7686a65b-f595-482f-9186-be9eded9eef1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:10.483773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7686a65b-f595-482f-9186-be9eded9eef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:10.534931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:10.583276 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3613/7258] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:10.584325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db56563-9a8b-4bb7-86ac-ec66baf98f40 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:10.585569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5db56563-9a8b-4bb7-86ac-ec66baf98f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:10.686031 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3646/7259] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:10.686964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686a65b-f595-482f-9186-be9eded9eef1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:10.691138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7686a65b-f595-482f-9186-be9eded9eef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:10.728264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db56563-9a8b-4bb7-86ac-ec66baf98f40 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:10.739316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:10.740167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:10.740545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:10.741539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] PATH_INFO: `/v3/projects/02b36ef3d6e94dc7899391aebf054447` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:10.743788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b36ef3d6e94dc7899391aebf054447)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:10.746849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:10.787067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686a65b-f595-482f-9186-be9eded9eef1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:10.791342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f12f44-831f-4038-9c01-8f903d68caf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:10.791972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12f44-831f-4038-9c01-8f903d68caf4 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:10.792521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12f44-831f-4038-9c01-8f903d68caf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:10.792799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f12f44-831f-4038-9c01-8f903d68caf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:10.795633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c7f12f44-831f-4038-9c01-8f903d68caf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:10.821188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b36ef3d6e94dc7899391aebf054447', 'request_id': 'req-10985661-7cb9-4a83-91c9-7e63017b6efe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:10.833939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b36ef3d6e94dc7899391aebf054447', 'request_id': 'req-10985661-7cb9-4a83-91c9-7e63017b6efe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:10.843937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b36ef3d6e94dc7899391aebf054447', 'request_id': 'req-10985661-7cb9-4a83-91c9-7e63017b6efe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:10.863771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] The token cache is being invalidate because project 02b36ef3d6e94dc7899391aebf054447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:10.864233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:10.864986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:10.866973 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3614/7260] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:10 2022] DELETE /identity/v3/projects/02b36ef3d6e94dc7899391aebf054447 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:10.868569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:10.871677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:10.872364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f12f44-831f-4038-9c01-8f903d68caf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:10.874174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f12f44-831f-4038-9c01-8f903d68caf4 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:10.879167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:10.887088 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3647/7261] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:10.887991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f12f44-831f-4038-9c01-8f903d68caf4 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:10.903776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f12f44-831f-4038-9c01-8f903d68caf4 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:10.970201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:10.970986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:10.971266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:10.971634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] PATH_INFO: `/v3/users/849b5cc233da4829b6b4625f0a36d1bc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:10.972941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] RBAC: Authorizing `identity:delete_user(user_id=849b5cc233da4829b6b4625f0a36d1bc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:10.975582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:11.004147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:11.018926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10985661-7cb9-4a83-91c9-7e63017b6efe admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:11.027094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beb2c5-c5ab-41a2-b367-b3c081a0aba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:11.028672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beb2c5-c5ab-41a2-b367-b3c081a0aba8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:11.029857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beb2c5-c5ab-41a2-b367-b3c081a0aba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:11.030298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beb2c5-c5ab-41a2-b367-b3c081a0aba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:11.031471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beb2c5-c5ab-41a2-b367-b3c081a0aba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:47:11.032223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beb2c5-c5ab-41a2-b367-b3c081a0aba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:11.035017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beb2c5-c5ab-41a2-b367-b3c081a0aba8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:11.068914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849b5cc233da4829b6b4625f0a36d1bc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:11.069342 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3615/7262] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:11.073494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849b5cc233da4829b6b4625f0a36d1bc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:11.074065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beb2c5-c5ab-41a2-b367-b3c081a0aba8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:11.087208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849b5cc233da4829b6b4625f0a36d1bc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:11.091140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beb2c5-c5ab-41a2-b367-b3c081a0aba8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:11.100527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548ad7b-46fb-4b3e-87b5-cb4d6a5ae924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:11.102151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ad7b-46fb-4b3e-87b5-cb4d6a5ae924 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:11.102992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ad7b-46fb-4b3e-87b5-cb4d6a5ae924 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:11.103443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548ad7b-46fb-4b3e-87b5-cb4d6a5ae924 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:11.104325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548ad7b-46fb-4b3e-87b5-cb4d6a5ae924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:11.108311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548ad7b-46fb-4b3e-87b5-cb4d6a5ae924 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:11.111984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849b5cc233da4829b6b4625f0a36d1bc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:11.136026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849b5cc233da4829b6b4625f0a36d1bc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:11.153220 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3648/7263] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:10 2022] DELETE /identity/v3/users/849b5cc233da4829b6b4625f0a36d1bc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:11.176579 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3616/7264] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:11 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:47:11.180600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:11.183562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:11.468115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907aa704-37b9-4f5a-82ce-3022d5ad392e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:11.613625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95f83c-8339-4995-8021-1de48bf0b33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:11.614401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95f83c-8339-4995-8021-1de48bf0b33f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:11.614983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95f83c-8339-4995-8021-1de48bf0b33f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:11.615384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95f83c-8339-4995-8021-1de48bf0b33f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:11.618090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95f83c-8339-4995-8021-1de48bf0b33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:11.622588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95f83c-8339-4995-8021-1de48bf0b33f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:11.682069 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3649/7265] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:11 2022] POST /identity/v3/users => generated 286 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:11.686366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548ad7b-46fb-4b3e-87b5-cb4d6a5ae924 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:11.707378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548ad7b-46fb-4b3e-87b5-cb4d6a5ae924 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:11.719544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa10db-90fe-4232-96d9-97954ed98c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:11.720924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa10db-90fe-4232-96d9-97954ed98c7e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:11.721441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa10db-90fe-4232-96d9-97954ed98c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:11.721948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa10db-90fe-4232-96d9-97954ed98c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:11.723063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa10db-90fe-4232-96d9-97954ed98c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:11.725403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa10db-90fe-4232-96d9-97954ed98c7e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:11.749807 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3617/7266] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:11.753443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95f83c-8339-4995-8021-1de48bf0b33f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:11.766063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95f83c-8339-4995-8021-1de48bf0b33f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:11.780294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406a13e-42c2-4708-a94c-bd287746b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:11.781183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a13e-42c2-4708-a94c-bd287746b897 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:11.781558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a13e-42c2-4708-a94c-bd287746b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:11.782277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406a13e-42c2-4708-a94c-bd287746b897 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:11.782945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406a13e-42c2-4708-a94c-bd287746b897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:11.785021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406a13e-42c2-4708-a94c-bd287746b897 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:11.802325 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3650/7267] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:11.807180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa10db-90fe-4232-96d9-97954ed98c7e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:11.819950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa10db-90fe-4232-96d9-97954ed98c7e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:11.827265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd35c12-a63f-4ef2-bb7e-544411ca3917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:11.827773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35c12-a63f-4ef2-bb7e-544411ca3917 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:11.828931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35c12-a63f-4ef2-bb7e-544411ca3917 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:11.829341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd35c12-a63f-4ef2-bb7e-544411ca3917 admin admin] PATH_INFO: `/v3/projects/a3da650486f4405f9f20b6a0b9fb5942/users/a1cb273c9f0a400b9ac32560bfde34bd/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:11.870662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd35c12-a63f-4ef2-bb7e-544411ca3917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3da650486f4405f9f20b6a0b9fb5942, user_id=a1cb273c9f0a400b9ac32560bfde34bd, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:11.875812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd35c12-a63f-4ef2-bb7e-544411ca3917 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:11.910786 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3618/7268] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:11 2022] PUT /identity/v3/projects/a3da650486f4405f9f20b6a0b9fb5942/users/a1cb273c9f0a400b9ac32560bfde34bd/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:11.924050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b043c05-93fd-406a-8ffa-5961939a89d4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:11.924668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b043c05-93fd-406a-8ffa-5961939a89d4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:11.925847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b043c05-93fd-406a-8ffa-5961939a89d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:11.974479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7b043c05-93fd-406a-8ffa-5961939a89d4 None None] MFA Rules not processed for user `a1cb273c9f0a400b9ac32560bfde34bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:11.975945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7b043c05-93fd-406a-8ffa-5961939a89d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:11.996504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:12.071121 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3651/7269] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:12.083853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd35c12-a63f-4ef2-bb7e-544411ca3917 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:12.085791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-efd35c12-a63f-4ef2-bb7e-544411ca3917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:12.181197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd35c12-a63f-4ef2-bb7e-544411ca3917 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:12.187410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59f439-53a1-4ce6-93b0-6434cf290b98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:12.188503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59f439-53a1-4ce6-93b0-6434cf290b98 service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:12.190110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59f439-53a1-4ce6-93b0-6434cf290b98 service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:12.190632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59f439-53a1-4ce6-93b0-6434cf290b98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:12.206529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59f439-53a1-4ce6-93b0-6434cf290b98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:12.208830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59f439-53a1-4ce6-93b0-6434cf290b98 service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:12.280240 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3619/7270] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:12.908377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b043c05-93fd-406a-8ffa-5961939a89d4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:12.910742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7b043c05-93fd-406a-8ffa-5961939a89d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:13.043894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b043c05-93fd-406a-8ffa-5961939a89d4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:13.051335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:13.052052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:13.052331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:13.052602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] PATH_INFO: `/v3/projects/36d6bdf580584b1cae1e3f43adf46318` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:13.054840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d6bdf580584b1cae1e3f43adf46318)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:13.056659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:13.178542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d6bdf580584b1cae1e3f43adf46318', 'request_id': 'req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:13.198445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d6bdf580584b1cae1e3f43adf46318', 'request_id': 'req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:13.229863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d6bdf580584b1cae1e3f43adf46318', 'request_id': 'req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:13.263006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] The token cache is being invalidate because project 36d6bdf580584b1cae1e3f43adf46318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:13.263578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:13.264711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c55fad25-1cb0-4d23-8ff3-bfeeef4988f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:13.273223 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3652/7271] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:12 2022] DELETE /identity/v3/projects/36d6bdf580584b1cae1e3f43adf46318 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:13.277462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b050ab-cd58-470d-bc84-f4360ed7309b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:13.279109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b050ab-cd58-470d-bc84-f4360ed7309b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:13.279109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b050ab-cd58-470d-bc84-f4360ed7309b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:13.349282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c7b050ab-cd58-470d-bc84-f4360ed7309b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:13.350833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c7b050ab-cd58-470d-bc84-f4360ed7309b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:13.419697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:13.452984 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3620/7272] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:13.463034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3d454-b94d-4794-a9df-e571c23b298f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:13.464183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3d454-b94d-4794-a9df-e571c23b298f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:13.464635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3d454-b94d-4794-a9df-e571c23b298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:13.522595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b5c3d454-b94d-4794-a9df-e571c23b298f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:13.526378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b5c3d454-b94d-4794-a9df-e571c23b298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:13.547101 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3653/7273] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:13.548480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b050ab-cd58-470d-bc84-f4360ed7309b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:13.569501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b050ab-cd58-470d-bc84-f4360ed7309b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:13.640788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29098ccc-4fdc-45a6-8919-c70255da887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:13.654411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29098ccc-4fdc-45a6-8919-c70255da887a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:13.655058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29098ccc-4fdc-45a6-8919-c70255da887a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:13.658038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29098ccc-4fdc-45a6-8919-c70255da887a admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:13.661509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29098ccc-4fdc-45a6-8919-c70255da887a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:47:13.663610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29098ccc-4fdc-45a6-8919-c70255da887a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:13.668227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29098ccc-4fdc-45a6-8919-c70255da887a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:13.710616 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3621/7274] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:47:13.712571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3d454-b94d-4794-a9df-e571c23b298f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:13.731581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3d454-b94d-4794-a9df-e571c23b298f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:13.741485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4b89-d7dc-4007-966a-8c77e9e2d303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:13.742263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4b89-d7dc-4007-966a-8c77e9e2d303 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:13.742602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4b89-d7dc-4007-966a-8c77e9e2d303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:13.742939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4b89-d7dc-4007-966a-8c77e9e2d303 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:13.745237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea4b89-d7dc-4007-966a-8c77e9e2d303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:13.754920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea4b89-d7dc-4007-966a-8c77e9e2d303 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:13.799050 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3654/7275] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:13 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:47:13.803829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29098ccc-4fdc-45a6-8919-c70255da887a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:13.832562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29098ccc-4fdc-45a6-8919-c70255da887a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:14.040991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00ac5e-602a-4020-b8cf-8d87fea16a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:14.041634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00ac5e-602a-4020-b8cf-8d87fea16a8e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:14.041931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00ac5e-602a-4020-b8cf-8d87fea16a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:14.042203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00ac5e-602a-4020-b8cf-8d87fea16a8e admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:14.042842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00ac5e-602a-4020-b8cf-8d87fea16a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:14.045919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00ac5e-602a-4020-b8cf-8d87fea16a8e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:14.103450 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3622/7276] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:13 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:14.107719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4b89-d7dc-4007-966a-8c77e9e2d303 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:14.122461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4b89-d7dc-4007-966a-8c77e9e2d303 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:14.142472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941dad4-97a9-402a-87d0-437cddbd39ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:14.143112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941dad4-97a9-402a-87d0-437cddbd39ea admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:14.143388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941dad4-97a9-402a-87d0-437cddbd39ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:14.143651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941dad4-97a9-402a-87d0-437cddbd39ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:14.144301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941dad4-97a9-402a-87d0-437cddbd39ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:14.145929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941dad4-97a9-402a-87d0-437cddbd39ea admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:14.165515 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3655/7277] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:14.169766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00ac5e-602a-4020-b8cf-8d87fea16a8e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:14.206624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00ac5e-602a-4020-b8cf-8d87fea16a8e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:14.234576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f3cfe-124d-465d-9934-e2000838893e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:14.235253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f3cfe-124d-465d-9934-e2000838893e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:14.235539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f3cfe-124d-465d-9934-e2000838893e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:14.239500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f3cfe-124d-465d-9934-e2000838893e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:14.240250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f3cfe-124d-465d-9934-e2000838893e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:14.259637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f3cfe-124d-465d-9934-e2000838893e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:14.284792 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3623/7278] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:14.289574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941dad4-97a9-402a-87d0-437cddbd39ea admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:14.299964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941dad4-97a9-402a-87d0-437cddbd39ea admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:14.316793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4309256-bb99-4be5-adf6-9c53b886ba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:14.317484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4309256-bb99-4be5-adf6-9c53b886ba00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:14.317766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4309256-bb99-4be5-adf6-9c53b886ba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:14.318064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4309256-bb99-4be5-adf6-9c53b886ba00 admin admin] PATH_INFO: `/v3/projects/1df2b43f0f3a4732b61cb526b6564cdd/users/a485f5e454204d8eab8ae3ae074e92c3/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:14.328120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:14.374740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4309256-bb99-4be5-adf6-9c53b886ba00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df2b43f0f3a4732b61cb526b6564cdd, user_id=a485f5e454204d8eab8ae3ae074e92c3, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:14.378188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4309256-bb99-4be5-adf6-9c53b886ba00 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:14.403407 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3656/7279] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:14 2022] PUT /identity/v3/projects/1df2b43f0f3a4732b61cb526b6564cdd/users/a485f5e454204d8eab8ae3ae074e92c3/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:14.413886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94e425-f038-41f9-b89a-14f817391494 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:14.414167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94e425-f038-41f9-b89a-14f817391494 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:14.414438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94e425-f038-41f9-b89a-14f817391494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:14.482513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4e94e425-f038-41f9-b89a-14f817391494 None None] MFA Rules not processed for user `a485f5e454204d8eab8ae3ae074e92c3`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:14.483758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4e94e425-f038-41f9-b89a-14f817391494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:14.708372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3624/7280] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:14.713111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4309256-bb99-4be5-adf6-9c53b886ba00 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:14.943377 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4309256-bb99-4be5-adf6-9c53b886ba00 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:14.962850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bf724-13b9-4342-9f4e-3646c83f45e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:14.966952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bf724-13b9-4342-9f4e-3646c83f45e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:14.969373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bf724-13b9-4342-9f4e-3646c83f45e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:14.969939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67bf724-13b9-4342-9f4e-3646c83f45e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:14.981850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bf724-13b9-4342-9f4e-3646c83f45e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:14.985299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67bf724-13b9-4342-9f4e-3646c83f45e8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:15.062923 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3657/7281] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:14 2022] POST /identity/v3/projects => generated 371 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:15.066882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94e425-f038-41f9-b89a-14f817391494 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:15.085402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94e425-f038-41f9-b89a-14f817391494 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:15.161014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:15.216454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739978ab-90a4-4838-928a-189c250fedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:15.217179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739978ab-90a4-4838-928a-189c250fedf9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:15.217554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739978ab-90a4-4838-928a-189c250fedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:15.217942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739978ab-90a4-4838-928a-189c250fedf9 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:15.218717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739978ab-90a4-4838-928a-189c250fedf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:15.221063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739978ab-90a4-4838-928a-189c250fedf9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:15.284365 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3625/7282] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:15 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:15.288728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bf724-13b9-4342-9f4e-3646c83f45e8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:15.310042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67bf724-13b9-4342-9f4e-3646c83f45e8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:15.325454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d56062-1ec9-49c9-917e-8030225315fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:15.326282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56062-1ec9-49c9-917e-8030225315fd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:15.326585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56062-1ec9-49c9-917e-8030225315fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:15.326951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d56062-1ec9-49c9-917e-8030225315fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:15.327714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d56062-1ec9-49c9-917e-8030225315fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:15.329837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d56062-1ec9-49c9-917e-8030225315fd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:15.357704 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3658/7283] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:15.365275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739978ab-90a4-4838-928a-189c250fedf9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:15.388643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739978ab-90a4-4838-928a-189c250fedf9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:15.407503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496c554-2617-4e96-a3e3-691de18f9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:15.409121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496c554-2617-4e96-a3e3-691de18f9c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:15.410228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496c554-2617-4e96-a3e3-691de18f9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:15.411297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496c554-2617-4e96-a3e3-691de18f9c2c admin admin] PATH_INFO: `/v3/projects/91faca5500e6449197d554389a1bf28d/users/5d80e3a28de04d219552e9bc16e5b92e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:15.454212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496c554-2617-4e96-a3e3-691de18f9c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=91faca5500e6449197d554389a1bf28d, user_id=5d80e3a28de04d219552e9bc16e5b92e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:15.459125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496c554-2617-4e96-a3e3-691de18f9c2c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:15.490247 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3626/7284] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:15 2022] PUT /identity/v3/projects/91faca5500e6449197d554389a1bf28d/users/5d80e3a28de04d219552e9bc16e5b92e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:15.494283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d56062-1ec9-49c9-917e-8030225315fd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:15.515452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d56062-1ec9-49c9-917e-8030225315fd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:15.650732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0a917-68d4-4f8f-a3f8-23c8a957ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:15.651475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0a917-68d4-4f8f-a3f8-23c8a957ddcb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:15.651748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0a917-68d4-4f8f-a3f8-23c8a957ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:15.652022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0a917-68d4-4f8f-a3f8-23c8a957ddcb admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:15.652689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0a917-68d4-4f8f-a3f8-23c8a957ddcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:15.654772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0a917-68d4-4f8f-a3f8-23c8a957ddcb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:15.698553 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3659/7285] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:15.702105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496c554-2617-4e96-a3e3-691de18f9c2c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:15.724909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496c554-2617-4e96-a3e3-691de18f9c2c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:15.732097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47cf49-162b-4d67-ab9d-406aada6931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:15.733754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47cf49-162b-4d67-ab9d-406aada6931e admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:15.750058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47cf49-162b-4d67-ab9d-406aada6931e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:15.750548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47cf49-162b-4d67-ab9d-406aada6931e admin admin] PATH_INFO: `/v3/projects/91faca5500e6449197d554389a1bf28d/users/5d80e3a28de04d219552e9bc16e5b92e/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:15.758835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47cf49-162b-4d67-ab9d-406aada6931e admin admin] RBAC: Authorizing `identity:create_grant(project_id=91faca5500e6449197d554389a1bf28d, user_id=5d80e3a28de04d219552e9bc16e5b92e, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:15.761669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47cf49-162b-4d67-ab9d-406aada6931e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:15.797157 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3627/7286] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:15 2022] PUT /identity/v3/projects/91faca5500e6449197d554389a1bf28d/users/5d80e3a28de04d219552e9bc16e5b92e/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:15.808829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548efdd3-2faf-40b4-9a2e-32fe80e8cbbe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:15.809319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548efdd3-2faf-40b4-9a2e-32fe80e8cbbe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:15.809606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548efdd3-2faf-40b4-9a2e-32fe80e8cbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:15.901192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-548efdd3-2faf-40b4-9a2e-32fe80e8cbbe None None] MFA Rules not processed for user `5d80e3a28de04d219552e9bc16e5b92e`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:15.903342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-548efdd3-2faf-40b4-9a2e-32fe80e8cbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:16.030273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:16.120450 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3660/7287] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:16.121736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47cf49-162b-4d67-ab9d-406aada6931e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:16.143310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47cf49-162b-4d67-ab9d-406aada6931e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:16.155345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b689dd-f4f9-4e9b-b497-130d5f7af4dd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:16.156170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b689dd-f4f9-4e9b-b497-130d5f7af4dd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:16.156550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b689dd-f4f9-4e9b-b497-130d5f7af4dd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:16.157192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b689dd-f4f9-4e9b-b497-130d5f7af4dd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:16.158373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b689dd-f4f9-4e9b-b497-130d5f7af4dd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:16.172276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b689dd-f4f9-4e9b-b497-130d5f7af4dd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:16.211267 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3628/7288] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:16 2022] POST /identity/v3/services => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:16.220705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548efdd3-2faf-40b4-9a2e-32fe80e8cbbe None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:16.250323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548efdd3-2faf-40b4-9a2e-32fe80e8cbbe None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:16.304478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089c99c-6b48-446d-913e-f25aa85da42a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:16.305532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089c99c-6b48-446d-913e-f25aa85da42a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:16.306070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089c99c-6b48-446d-913e-f25aa85da42a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:16.306572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089c99c-6b48-446d-913e-f25aa85da42a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:16.307967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089c99c-6b48-446d-913e-f25aa85da42a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:16.309343 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-0089c99c-6b48-446d-913e-f25aa85da42a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:47:16.309343 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:47:16.309343 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:47:16.314749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089c99c-6b48-446d-913e-f25aa85da42a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:16.350820 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3661/7289] 10.222.0.43 () {60 vars in 1213 bytes} [Tue Aug 30 04:47:16 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:16.355751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b689dd-f4f9-4e9b-b497-130d5f7af4dd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:16.384081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b689dd-f4f9-4e9b-b497-130d5f7af4dd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:16.400042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9ca2c-086a-414c-a98f-ce6af3d52dd0 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:16.401810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9ca2c-086a-414c-a98f-ce6af3d52dd0 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:16.403783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9ca2c-086a-414c-a98f-ce6af3d52dd0 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:16.404411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9ca2c-086a-414c-a98f-ce6af3d52dd0 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:16.410936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9ca2c-086a-414c-a98f-ce6af3d52dd0 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:16.417908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9ca2c-086a-414c-a98f-ce6af3d52dd0 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:16.500157 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3629/7290] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:16 2022] POST /identity/v3/services => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:47:16.501742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089c99c-6b48-446d-913e-f25aa85da42a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:16.526802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089c99c-6b48-446d-913e-f25aa85da42a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:16.615641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86a19f-45a0-4c2f-9e5a-28dff618634e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:16.619623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86a19f-45a0-4c2f-9e5a-28dff618634e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:16.621105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86a19f-45a0-4c2f-9e5a-28dff618634e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:16.621519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86a19f-45a0-4c2f-9e5a-28dff618634e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:16.624366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86a19f-45a0-4c2f-9e5a-28dff618634e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:16.629290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86a19f-45a0-4c2f-9e5a-28dff618634e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:16.677187 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3662/7291] 10.222.0.43 () {60 vars in 1213 bytes} [Tue Aug 30 04:47:16 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:16.681373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9ca2c-086a-414c-a98f-ce6af3d52dd0 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:16.711328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9ca2c-086a-414c-a98f-ce6af3d52dd0 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:16.743344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcadcf-2ee1-47c5-9957-5ef259001da9 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:16.744131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcadcf-2ee1-47c5-9957-5ef259001da9 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:16.744448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcadcf-2ee1-47c5-9957-5ef259001da9 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:16.744754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fcadcf-2ee1-47c5-9957-5ef259001da9 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:16.747815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcadcf-2ee1-47c5-9957-5ef259001da9 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:16.749038 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-76fcadcf-2ee1-47c5-9957-5ef259001da9 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:47:16.749038 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:47:16.749038 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:47:16.750016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fcadcf-2ee1-47c5-9957-5ef259001da9 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:16.796147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86a19f-45a0-4c2f-9e5a-28dff618634e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:16.805946 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3630/7292] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Aug 30 04:47:16 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 766 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:16.833289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86a19f-45a0-4c2f-9e5a-28dff618634e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:16.852974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997d6e7-5e1f-4167-8303-eea302d50396 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:16.854120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997d6e7-5e1f-4167-8303-eea302d50396 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:16.854403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997d6e7-5e1f-4167-8303-eea302d50396 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:16.854674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997d6e7-5e1f-4167-8303-eea302d50396 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/7aaa6b0a680d4c739a58ef311b37b084` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:16.855281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997d6e7-5e1f-4167-8303-eea302d50396 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=7aaa6b0a680d4c739a58ef311b37b084)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:16.856384 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-c997d6e7-5e1f-4167-8303-eea302d50396 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:47:16.856384 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:47:16.856384 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:47:16.857242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997d6e7-5e1f-4167-8303-eea302d50396 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:16.896039 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3663/7293] 10.222.0.43 () {58 vars in 1290 bytes} [Tue Aug 30 04:47:16 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/7aaa6b0a680d4c739a58ef311b37b084 => generated 334 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:16.900340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcadcf-2ee1-47c5-9957-5ef259001da9 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:16.940688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fcadcf-2ee1-47c5-9957-5ef259001da9 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:16.967939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bbb6d-43b7-45c2-b3c0-67e1fee54f54 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:16.969574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bbb6d-43b7-45c2-b3c0-67e1fee54f54 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:16.969959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bbb6d-43b7-45c2-b3c0-67e1fee54f54 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:16.970368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bbb6d-43b7-45c2-b3c0-67e1fee54f54 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/7aaa6b0a680d4c739a58ef311b37b084` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:16.971156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bbb6d-43b7-45c2-b3c0-67e1fee54f54 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=7aaa6b0a680d4c739a58ef311b37b084)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:16.993839 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-911bbb6d-43b7-45c2-b3c0-67e1fee54f54 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:47:16.993839 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:47:16.993839 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:47:16.994873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bbb6d-43b7-45c2-b3c0-67e1fee54f54 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:17.034169 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3631/7294] 10.222.0.43 () {58 vars in 1291 bytes} [Tue Aug 30 04:47:16 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/7aaa6b0a680d4c739a58ef311b37b084 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 30 04:47:17.038444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997d6e7-5e1f-4167-8303-eea302d50396 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:17.059328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997d6e7-5e1f-4167-8303-eea302d50396 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:17.090444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fc0f2-e47a-41dc-aad3-73bc3215443a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:17.091188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fc0f2-e47a-41dc-aad3-73bc3215443a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:17.091675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fc0f2-e47a-41dc-aad3-73bc3215443a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:17.091963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fc0f2-e47a-41dc-aad3-73bc3215443a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/7aaa6b0a680d4c739a58ef311b37b084` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:17.092666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fc0f2-e47a-41dc-aad3-73bc3215443a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=7aaa6b0a680d4c739a58ef311b37b084)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:17.093816 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-c13fc0f2-e47a-41dc-aad3-73bc3215443a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:47:17.093816 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(msg) Aug 30 04:47:17.093816 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:47:17.100120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fc0f2-e47a-41dc-aad3-73bc3215443a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:17.138986 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3664/7295] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Aug 30 04:47:17 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/7aaa6b0a680d4c739a58ef311b37b084 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:17.143076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bbb6d-43b7-45c2-b3c0-67e1fee54f54 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:17.159966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bbb6d-43b7-45c2-b3c0-67e1fee54f54 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:17.181530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce8123-c649-443d-bdb2-f48abb7f4b1d tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:17.182342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce8123-c649-443d-bdb2-f48abb7f4b1d tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:17.182630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce8123-c649-443d-bdb2-f48abb7f4b1d tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:17.185112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce8123-c649-443d-bdb2-f48abb7f4b1d tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:17.185977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce8123-c649-443d-bdb2-f48abb7f4b1d tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:17.187904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efce8123-c649-443d-bdb2-f48abb7f4b1d tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:17.220644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fc0f2-e47a-41dc-aad3-73bc3215443a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:17.222036 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3632/7296] 10.222.0.43 () {58 vars in 1191 bytes} [Tue Aug 30 04:47:17 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:47:17.237051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fc0f2-e47a-41dc-aad3-73bc3215443a tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:17.249050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce922567-2379-4d01-b507-c7b179f0f2bd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:17.249904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce922567-2379-4d01-b507-c7b179f0f2bd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:17.250810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce922567-2379-4d01-b507-c7b179f0f2bd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:17.251218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce922567-2379-4d01-b507-c7b179f0f2bd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/7aaa6b0a680d4c739a58ef311b37b084` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:17.252280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce922567-2379-4d01-b507-c7b179f0f2bd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=7aaa6b0a680d4c739a58ef311b37b084)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:17.254065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce922567-2379-4d01-b507-c7b179f0f2bd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-ce922567-2379-4d01-b507-c7b179f0f2bd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Could not find Endpoint Group: 7aaa6b0a680d4c739a58ef311b37b084.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 7aaa6b0a680d4c739a58ef311b37b084. Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 30 04:47:17.290522 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 30 04:47:17.291663 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 30 04:47:17.291663 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 30 04:47:17.291663 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 30 04:47:17.291663 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 30 04:47:17.291663 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 7aaa6b0a680d4c739a58ef311b37b084. Aug 30 04:47:17.291663 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:17.297042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce8123-c649-443d-bdb2-f48abb7f4b1d tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:17.305911 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3665/7297] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Aug 30 04:47:17 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/7aaa6b0a680d4c739a58ef311b37b084 => generated 120 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:47:17.318680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce8123-c649-443d-bdb2-f48abb7f4b1d tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:17.358375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cba22a-95c2-483c-b207-64f0515ec563 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:17.359119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cba22a-95c2-483c-b207-64f0515ec563 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:17.359504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cba22a-95c2-483c-b207-64f0515ec563 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:17.360340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cba22a-95c2-483c-b207-64f0515ec563 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/services/4cb2d97eea4840f685b79dfe24fb72dd` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:17.361032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cba22a-95c2-483c-b207-64f0515ec563 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4cb2d97eea4840f685b79dfe24fb72dd)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:17.363315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cba22a-95c2-483c-b207-64f0515ec563 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:17.525010 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3633/7298] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:17 2022] DELETE /identity/v3/services/4cb2d97eea4840f685b79dfe24fb72dd => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:17.535032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce922567-2379-4d01-b507-c7b179f0f2bd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:17.552416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce922567-2379-4d01-b507-c7b179f0f2bd tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:17.707233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000bed9-a7cd-4bae-ae06-01cd57de998e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:17.713106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000bed9-a7cd-4bae-ae06-01cd57de998e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:17.713555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000bed9-a7cd-4bae-ae06-01cd57de998e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:17.713844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000bed9-a7cd-4bae-ae06-01cd57de998e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:17.714783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000bed9-a7cd-4bae-ae06-01cd57de998e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:17.716746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000bed9-a7cd-4bae-ae06-01cd57de998e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:17.801580 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3666/7299] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:17 2022] POST /identity/v3/services => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:17.806465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cba22a-95c2-483c-b207-64f0515ec563 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:17.823855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cba22a-95c2-483c-b207-64f0515ec563 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:17.866753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d042035-2669-4639-a0db-e08b1eb37a0c tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:17.869076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d042035-2669-4639-a0db-e08b1eb37a0c tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:17.869521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d042035-2669-4639-a0db-e08b1eb37a0c tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:17.870587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d042035-2669-4639-a0db-e08b1eb37a0c tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:17.872857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d042035-2669-4639-a0db-e08b1eb37a0c tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:17.876998 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-3d042035-2669-4639-a0db-e08b1eb37a0c tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:47:17.876998 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:47:17.876998 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:47:17.879789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d042035-2669-4639-a0db-e08b1eb37a0c tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:17.914655 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3634/7300] 10.222.0.43 () {60 vars in 1213 bytes} [Tue Aug 30 04:47:17 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:17.916249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000bed9-a7cd-4bae-ae06-01cd57de998e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:17.940632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000bed9-a7cd-4bae-ae06-01cd57de998e tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:17.961263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8aaac-59bb-4716-8312-5eb6a4f5e8fb tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:17.962301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8aaac-59bb-4716-8312-5eb6a4f5e8fb tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:17.962760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8aaac-59bb-4716-8312-5eb6a4f5e8fb tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:17.968827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8aaac-59bb-4716-8312-5eb6a4f5e8fb tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/services` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:17.970658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8aaac-59bb-4716-8312-5eb6a4f5e8fb tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:17.979124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab8aaac-59bb-4716-8312-5eb6a4f5e8fb tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:18.029732 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3667/7301] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:17 2022] POST /identity/v3/services => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:18.031605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d042035-2669-4639-a0db-e08b1eb37a0c tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:18.045135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d042035-2669-4639-a0db-e08b1eb37a0c tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:18.083601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e0e3-20b7-4657-bb8a-676fd68a43ac tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:18.084608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e0e3-20b7-4657-bb8a-676fd68a43ac tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:18.085061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e0e3-20b7-4657-bb8a-676fd68a43ac tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:18.085484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e0e3-20b7-4657-bb8a-676fd68a43ac tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/046047fbc5914746937dd652f16413b6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:18.086357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63e0e3-20b7-4657-bb8a-676fd68a43ac tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=046047fbc5914746937dd652f16413b6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:18.087394 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-8d63e0e3-20b7-4657-bb8a-676fd68a43ac tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:47:18.087394 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:47:18.087394 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:47:18.088302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63e0e3-20b7-4657-bb8a-676fd68a43ac tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:18.132917 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3635/7302] 10.222.0.43 () {60 vars in 1313 bytes} [Tue Aug 30 04:47:18 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/046047fbc5914746937dd652f16413b6 => generated 335 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:18.145241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8aaac-59bb-4716-8312-5eb6a4f5e8fb tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:18.183447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8aaac-59bb-4716-8312-5eb6a4f5e8fb tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:18.205345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1613837-65b3-4e42-943d-ffeb92c11cd8 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:18.206218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1613837-65b3-4e42-943d-ffeb92c11cd8 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:18.206618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1613837-65b3-4e42-943d-ffeb92c11cd8 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:18.206899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1613837-65b3-4e42-943d-ffeb92c11cd8 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/services/04700c6f0903478a91340645abfc999a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:18.207531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1613837-65b3-4e42-943d-ffeb92c11cd8 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:delete_service(service_id=04700c6f0903478a91340645abfc999a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:18.209244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1613837-65b3-4e42-943d-ffeb92c11cd8 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:18.267945 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3668/7303] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:18 2022] DELETE /identity/v3/services/04700c6f0903478a91340645abfc999a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:18.271350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e0e3-20b7-4657-bb8a-676fd68a43ac tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:18.312370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e0e3-20b7-4657-bb8a-676fd68a43ac tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:18.380954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d4311-ba9a-4ce0-951b-08cecd429eb1 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:18.381992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d4311-ba9a-4ce0-951b-08cecd429eb1 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:18.382432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d4311-ba9a-4ce0-951b-08cecd429eb1 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:18.382869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d4311-ba9a-4ce0-951b-08cecd429eb1 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/046047fbc5914746937dd652f16413b6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:18.383767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d4311-ba9a-4ce0-951b-08cecd429eb1 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=046047fbc5914746937dd652f16413b6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:18.385597 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-717d4311-ba9a-4ce0-951b-08cecd429eb1 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:47:18.385597 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:47:18.385597 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:47:18.387011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d4311-ba9a-4ce0-951b-08cecd429eb1 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:18.409384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1613837-65b3-4e42-943d-ffeb92c11cd8 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:18.410403 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3636/7304] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Aug 30 04:47:18 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/046047fbc5914746937dd652f16413b6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:18.431945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1613837-65b3-4e42-943d-ffeb92c11cd8 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:18.442735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188bf4c-104a-4874-b904-59e8405bf50f tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:18.444570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188bf4c-104a-4874-b904-59e8405bf50f tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:18.445715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188bf4c-104a-4874-b904-59e8405bf50f tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:18.446854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1188bf4c-104a-4874-b904-59e8405bf50f tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/services/785c246014094a8db3c1e7802277307f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:18.450325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188bf4c-104a-4874-b904-59e8405bf50f tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:delete_service(service_id=785c246014094a8db3c1e7802277307f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:18.452675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1188bf4c-104a-4874-b904-59e8405bf50f tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:18.525066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d4311-ba9a-4ce0-951b-08cecd429eb1 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:18.529982 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3669/7305] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:18 2022] DELETE /identity/v3/services/785c246014094a8db3c1e7802277307f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:18.558415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d4311-ba9a-4ce0-951b-08cecd429eb1 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:18.633425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:INSERT=8,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:18.647969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5d25d-f0cf-4cfd-b092-8e665bd82272 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:18.649519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d25d-f0cf-4cfd-b092-8e665bd82272 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:18.652988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d25d-f0cf-4cfd-b092-8e665bd82272 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:18.654240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d25d-f0cf-4cfd-b092-8e665bd82272 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f171fe1c7da641028212b82986904e5d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:18.661263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5d25d-f0cf-4cfd-b092-8e665bd82272 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f171fe1c7da641028212b82986904e5d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:18.664038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5d25d-f0cf-4cfd-b092-8e665bd82272 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:18.683139 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3637/7306] 10.222.0.43 () {58 vars in 1293 bytes} [Tue Aug 30 04:47:18 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f171fe1c7da641028212b82986904e5d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:18.687780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188bf4c-104a-4874-b904-59e8405bf50f tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:18.713855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1188bf4c-104a-4874-b904-59e8405bf50f tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:18.727468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5d25d-f0cf-4cfd-b092-8e665bd82272 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:18.732995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3ae5d25d-f0cf-4cfd-b092-8e665bd82272 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:18.755253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f30e20-7be0-4c35-84fa-4e44b3b1ac87 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d80e3a28de04d219552e9bc16e5b92e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '91faca5500e6449197d554389a1bf28d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:18.760482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f30e20-7be0-4c35-84fa-4e44b3b1ac87 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:18.760748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f30e20-7be0-4c35-84fa-4e44b3b1ac87 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:18.761837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f30e20-7be0-4c35-84fa-4e44b3b1ac87 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] PATH_INFO: `/v3/services/167d9d725a5240209e5db79a860bc9f5` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:18.765603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f30e20-7be0-4c35-84fa-4e44b3b1ac87 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorizing `identity:delete_service(service_id=167d9d725a5240209e5db79a860bc9f5)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:18.780167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f30e20-7be0-4c35-84fa-4e44b3b1ac87 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:18.855719 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3670/7307] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:18 2022] DELETE /identity/v3/services/167d9d725a5240209e5db79a860bc9f5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:18.860868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f30e20-7be0-4c35-84fa-4e44b3b1ac87 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:19.050160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:19.088056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5d25d-f0cf-4cfd-b092-8e665bd82272 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:19.133007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193743a1-2cc6-4d38-9ea3-b7944d4f2ea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:19.133756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193743a1-2cc6-4d38-9ea3-b7944d4f2ea9 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:19.133982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193743a1-2cc6-4d38-9ea3-b7944d4f2ea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:19.134318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193743a1-2cc6-4d38-9ea3-b7944d4f2ea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:19.147683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-193743a1-2cc6-4d38-9ea3-b7944d4f2ea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:19.239434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f30e20-7be0-4c35-84fa-4e44b3b1ac87 tempest-EndPointGroupsTest-739067663 tempest-EndPointGroupsTest-739067663-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:19.262389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:19.263063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:19.263340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:19.266312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] PATH_INFO: `/v3/users/a485f5e454204d8eab8ae3ae074e92c3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:19.273515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a485f5e454204d8eab8ae3ae074e92c3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:19.276033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:19.424949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193743a1-2cc6-4d38-9ea3-b7944d4f2ea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:19.427023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193743a1-2cc6-4d38-9ea3-b7944d4f2ea9 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:19.433778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a485f5e454204d8eab8ae3ae074e92c3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:19.435255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a485f5e454204d8eab8ae3ae074e92c3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:19.473903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a485f5e454204d8eab8ae3ae074e92c3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:19.504521 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3638/7308] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:19.506742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a485f5e454204d8eab8ae3ae074e92c3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:19.546245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a485f5e454204d8eab8ae3ae074e92c3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:19.556305 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3671/7309] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:18 2022] DELETE /identity/v3/users/a485f5e454204d8eab8ae3ae074e92c3 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:19.560689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157d282-1ddd-4808-910e-3f311a5980a1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:19.561490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157d282-1ddd-4808-910e-3f311a5980a1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:19.562049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157d282-1ddd-4808-910e-3f311a5980a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:19.610992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f157d282-1ddd-4808-910e-3f311a5980a1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:19.612376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f157d282-1ddd-4808-910e-3f311a5980a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:19.856351 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3639/7310] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:20.263520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:20.268239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:20.460936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7dcfc-fc8e-4195-97e6-bbb75237a3a2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:20.482091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b29707-131d-4cb9-895b-028f5e7bb5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:20.483021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b29707-131d-4cb9-895b-028f5e7bb5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:20.483341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b29707-131d-4cb9-895b-028f5e7bb5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:20.483636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b29707-131d-4cb9-895b-028f5e7bb5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:20.520243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b29707-131d-4cb9-895b-028f5e7bb5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:20.522357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b29707-131d-4cb9-895b-028f5e7bb5b2 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:20.583701 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3672/7311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:21.070445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157d282-1ddd-4808-910e-3f311a5980a1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:21.075791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f157d282-1ddd-4808-910e-3f311a5980a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:21.139477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:21.430674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157d282-1ddd-4808-910e-3f311a5980a1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:21.447743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f29171-a619-4d14-8306-22834a11a310 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:21.448389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f29171-a619-4d14-8306-22834a11a310 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:21.448843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f29171-a619-4d14-8306-22834a11a310 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:21.449259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f29171-a619-4d14-8306-22834a11a310 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:21.453176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a3f29171-a619-4d14-8306-22834a11a310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:21.480393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f29171-a619-4d14-8306-22834a11a310 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:21.484165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f29171-a619-4d14-8306-22834a11a310 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:21.521427 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3640/7312] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:23.200341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462863eb-890b-44b5-bb85-c8d18edb0dea None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:23.200835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462863eb-890b-44b5-bb85-c8d18edb0dea None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:23.201007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462863eb-890b-44b5-bb85-c8d18edb0dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:23.266227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-462863eb-890b-44b5-bb85-c8d18edb0dea None None] MFA Rules not processed for user `4f01992e959c428387d42d346ee9eb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:23.268085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-462863eb-890b-44b5-bb85-c8d18edb0dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:23.318954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:23.456491 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3673/7313] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:23.474037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f29171-a619-4d14-8306-22834a11a310 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:23.475404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a3f29171-a619-4d14-8306-22834a11a310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:23.512035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f29171-a619-4d14-8306-22834a11a310 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:23.542639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:23.544208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:23.544346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:23.545628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] PATH_INFO: `/v3/projects/1df2b43f0f3a4732b61cb526b6564cdd` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:23.551225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df2b43f0f3a4732b61cb526b6564cdd)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:23.552577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:23.766820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df2b43f0f3a4732b61cb526b6564cdd', 'request_id': 'req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:23.784998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df2b43f0f3a4732b61cb526b6564cdd', 'request_id': 'req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:23.807747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df2b43f0f3a4732b61cb526b6564cdd', 'request_id': 'req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:23.845560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] The token cache is being invalidate because project 1df2b43f0f3a4732b61cb526b6564cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:23.845851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:23.846771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:23.854260 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3641/7314] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:23 2022] DELETE /identity/v3/projects/1df2b43f0f3a4732b61cb526b6564cdd => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:23.858308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462863eb-890b-44b5-bb85-c8d18edb0dea None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:23.887417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462863eb-890b-44b5-bb85-c8d18edb0dea None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:24.084330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:24.085013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:24.085276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:24.085544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] PATH_INFO: `/v3/users/5d80e3a28de04d219552e9bc16e5b92e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:24.105859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d80e3a28de04d219552e9bc16e5b92e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:24.106195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:24.312436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d80e3a28de04d219552e9bc16e5b92e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:24.313243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d80e3a28de04d219552e9bc16e5b92e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:24.335343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d80e3a28de04d219552e9bc16e5b92e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:24.367814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d80e3a28de04d219552e9bc16e5b92e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:24.419798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d80e3a28de04d219552e9bc16e5b92e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:24.440786 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3674/7315] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:23 2022] DELETE /identity/v3/users/5d80e3a28de04d219552e9bc16e5b92e => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:25.284230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:25.285745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:25.485422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4834f-7d61-4d5f-9fdc-dad0ff01c61c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:25.561445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:25.615350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c45816-15d7-44a0-bae6-d85ba0bc8e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:25.617518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c45816-15d7-44a0-bae6-d85ba0bc8e38 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:25.619501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c45816-15d7-44a0-bae6-d85ba0bc8e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:25.619805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c45816-15d7-44a0-bae6-d85ba0bc8e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:25.622923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d0c45816-15d7-44a0-bae6-d85ba0bc8e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:25.651869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c45816-15d7-44a0-bae6-d85ba0bc8e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:25.653685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c45816-15d7-44a0-bae6-d85ba0bc8e38 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:25.667858 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3642/7316] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:26.960727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:26.962829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:27.097633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:27.123145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d66b97-d429-4eaa-81e4-405da7e78f00 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:27.138160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:27.139003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:27.139366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:27.139735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] PATH_INFO: `/v3/projects/91faca5500e6449197d554389a1bf28d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:27.144722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91faca5500e6449197d554389a1bf28d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:27.155278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:27.270041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91faca5500e6449197d554389a1bf28d', 'request_id': 'req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:27.277454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91faca5500e6449197d554389a1bf28d', 'request_id': 'req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:27.299539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91faca5500e6449197d554389a1bf28d', 'request_id': 'req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:27.323122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] The token cache is being invalidate because project 91faca5500e6449197d554389a1bf28d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:27.323306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:27.323957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-413ec3fa-697d-47a3-8cb2-9a1b73dbd622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:27.325744 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3675/7317] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:26 2022] DELETE /identity/v3/projects/91faca5500e6449197d554389a1bf28d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:27.331056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f2c2f-8468-414b-98dd-a0db2d65340d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:27.331924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f2c2f-8468-414b-98dd-a0db2d65340d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:27.332368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f2c2f-8468-414b-98dd-a0db2d65340d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:27.387650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c83f2c2f-8468-414b-98dd-a0db2d65340d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:27.390914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c83f2c2f-8468-414b-98dd-a0db2d65340d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:27.631411 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3643/7318] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:27.633239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c467-e981-4cab-8b2c-077a0215c9aa None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:27.633602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c467-e981-4cab-8b2c-077a0215c9aa None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:27.634025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c467-e981-4cab-8b2c-077a0215c9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:27.695952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2917c467-e981-4cab-8b2c-077a0215c9aa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:27.698675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2917c467-e981-4cab-8b2c-077a0215c9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:27.725508 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3676/7319] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:27.730174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f2c2f-8468-414b-98dd-a0db2d65340d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:27.755939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f2c2f-8468-414b-98dd-a0db2d65340d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:27.772193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386a27-9506-4c37-8a07-71658e8ebada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:27.773258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386a27-9506-4c37-8a07-71658e8ebada admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:27.774487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386a27-9506-4c37-8a07-71658e8ebada admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:27.775103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386a27-9506-4c37-8a07-71658e8ebada admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:27.776356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386a27-9506-4c37-8a07-71658e8ebada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:47:27.783344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386a27-9506-4c37-8a07-71658e8ebada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:27.788708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386a27-9506-4c37-8a07-71658e8ebada admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:27.938671 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3644/7320] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:27.943306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c467-e981-4cab-8b2c-077a0215c9aa None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:27.954257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c467-e981-4cab-8b2c-077a0215c9aa None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:27.983736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524a900-2c3b-45c1-8580-444d867e0f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:27.984603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524a900-2c3b-45c1-8580-444d867e0f54 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:27.986851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524a900-2c3b-45c1-8580-444d867e0f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:27.987194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524a900-2c3b-45c1-8580-444d867e0f54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:27.988262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524a900-2c3b-45c1-8580-444d867e0f54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:27.991455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524a900-2c3b-45c1-8580-444d867e0f54 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:28.079303 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3677/7321] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:27 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:28.080736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386a27-9506-4c37-8a07-71658e8ebada admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:28.098749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386a27-9506-4c37-8a07-71658e8ebada admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:28.279212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a956e8-72ba-45c3-a52d-f75940eee54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:28.279848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a956e8-72ba-45c3-a52d-f75940eee54b admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:28.280168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a956e8-72ba-45c3-a52d-f75940eee54b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:28.280456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a956e8-72ba-45c3-a52d-f75940eee54b admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:28.281103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a956e8-72ba-45c3-a52d-f75940eee54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:28.283409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a956e8-72ba-45c3-a52d-f75940eee54b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:28.375923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524a900-2c3b-45c1-8580-444d867e0f54 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:28.394649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524a900-2c3b-45c1-8580-444d867e0f54 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:28.396784 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3645/7322] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:28 2022] POST /identity/v3/users => generated 294 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:28.417649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473a4fb-46b7-422e-98dc-5ce13a9da363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:28.418609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473a4fb-46b7-422e-98dc-5ce13a9da363 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:28.419084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473a4fb-46b7-422e-98dc-5ce13a9da363 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:28.419536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473a4fb-46b7-422e-98dc-5ce13a9da363 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:28.420448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473a4fb-46b7-422e-98dc-5ce13a9da363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:28.422249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473a4fb-46b7-422e-98dc-5ce13a9da363 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:28.455457 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3678/7323] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:28.459783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a956e8-72ba-45c3-a52d-f75940eee54b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:28.472643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a956e8-72ba-45c3-a52d-f75940eee54b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:28.481448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ab775-9467-4387-b0a6-82038cda8298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:28.482443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ab775-9467-4387-b0a6-82038cda8298 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:28.482726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ab775-9467-4387-b0a6-82038cda8298 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:28.482997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ab775-9467-4387-b0a6-82038cda8298 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:28.483899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ab775-9467-4387-b0a6-82038cda8298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:28.488540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ab775-9467-4387-b0a6-82038cda8298 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:28.522475 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3646/7324] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:28.523771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473a4fb-46b7-422e-98dc-5ce13a9da363 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:28.558450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473a4fb-46b7-422e-98dc-5ce13a9da363 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:28.565806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4d624-f9f4-487c-9109-139d7ce87638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:28.566911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4d624-f9f4-487c-9109-139d7ce87638 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:28.567398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4d624-f9f4-487c-9109-139d7ce87638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:28.567899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4d624-f9f4-487c-9109-139d7ce87638 admin admin] PATH_INFO: `/v3/projects/be4badad468444c3b8faad2f09c59c3c/users/365db7501516488a9626ea500d1b2350/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:28.606394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4d624-f9f4-487c-9109-139d7ce87638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4badad468444c3b8faad2f09c59c3c, user_id=365db7501516488a9626ea500d1b2350, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:28.609673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a4d624-f9f4-487c-9109-139d7ce87638 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:28.647424 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3679/7325] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:28 2022] PUT /identity/v3/projects/be4badad468444c3b8faad2f09c59c3c/users/365db7501516488a9626ea500d1b2350/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:28.659198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7093033-03f9-4468-b2c4-00d704e77a25 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:28.659577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7093033-03f9-4468-b2c4-00d704e77a25 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:28.659774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7093033-03f9-4468-b2c4-00d704e77a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:28.726462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e7093033-03f9-4468-b2c4-00d704e77a25 None None] MFA Rules not processed for user `365db7501516488a9626ea500d1b2350`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:28.727008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e7093033-03f9-4468-b2c4-00d704e77a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:28.806885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:28.913965 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3647/7326] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:28.914447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4d624-f9f4-487c-9109-139d7ce87638 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:29.072795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a4d624-f9f4-487c-9109-139d7ce87638 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:29.090449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e66e9-554b-4bf2-8a12-902c94638ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:29.091512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e66e9-554b-4bf2-8a12-902c94638ccd admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:29.093072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e66e9-554b-4bf2-8a12-902c94638ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:29.094701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e66e9-554b-4bf2-8a12-902c94638ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:29.096163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e66e9-554b-4bf2-8a12-902c94638ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:29.100184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24e66e9-554b-4bf2-8a12-902c94638ccd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:29.150269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:29.181070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7093033-03f9-4468-b2c4-00d704e77a25 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:29.204916 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3680/7327] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:28 2022] POST /identity/v3/projects => generated 387 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:29.247794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7093033-03f9-4468-b2c4-00d704e77a25 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:29.435093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f1256-d611-4c18-9a22-7a0e0e8c76b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:29.436031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f1256-d611-4c18-9a22-7a0e0e8c76b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:29.436161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f1256-d611-4c18-9a22-7a0e0e8c76b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:29.436453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f1256-d611-4c18-9a22-7a0e0e8c76b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:29.437195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f1256-d611-4c18-9a22-7a0e0e8c76b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:29.462076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f1256-d611-4c18-9a22-7a0e0e8c76b0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:29.536378 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3648/7328] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:29 2022] POST /identity/v3/users => generated 300 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:29.539541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e66e9-554b-4bf2-8a12-902c94638ccd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:29.552943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e66e9-554b-4bf2-8a12-902c94638ccd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:29.584944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb127ec-091d-410e-9984-c01d4cc002d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:29.585570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb127ec-091d-410e-9984-c01d4cc002d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:29.586037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb127ec-091d-410e-9984-c01d4cc002d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:29.586265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb127ec-091d-410e-9984-c01d4cc002d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:29.586842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb127ec-091d-410e-9984-c01d4cc002d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:29.600608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f1256-d611-4c18-9a22-7a0e0e8c76b0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:29.602252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb127ec-091d-410e-9984-c01d4cc002d5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:29.602453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-341f1256-d611-4c18-9a22-7a0e0e8c76b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:29.627858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f1256-d611-4c18-9a22-7a0e0e8c76b0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:29.664501 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3681/7329] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:29.669525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb127ec-091d-410e-9984-c01d4cc002d5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:29.671877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:29.672950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:29.673902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:29.674201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] PATH_INFO: `/v3/users/d8c622d475cd40b490f495d595485777` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:29.678659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c622d475cd40b490f495d595485777)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:29.680971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:29.702492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb127ec-091d-410e-9984-c01d4cc002d5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:29.734826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb2d6e-e631-4d7a-a601-8c2760e8419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:29.738265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb2d6e-e631-4d7a-a601-8c2760e8419c admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:29.743588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb2d6e-e631-4d7a-a601-8c2760e8419c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:29.745539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb2d6e-e631-4d7a-a601-8c2760e8419c admin admin] PATH_INFO: `/v3/projects/6c1c94b3e6454cdb982a2eadc802602c/users/11dd5a5acb2c498daefa3ef48682c2d8/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:29.830635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb2d6e-e631-4d7a-a601-8c2760e8419c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1c94b3e6454cdb982a2eadc802602c, user_id=11dd5a5acb2c498daefa3ef48682c2d8, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:29.837750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb2d6e-e631-4d7a-a601-8c2760e8419c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:29.912009 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3682/7330] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:29 2022] PUT /identity/v3/projects/6c1c94b3e6454cdb982a2eadc802602c/users/11dd5a5acb2c498daefa3ef48682c2d8/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:29.914997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c622d475cd40b490f495d595485777'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:29.916688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb2d6e-e631-4d7a-a601-8c2760e8419c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:29.952771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c622d475cd40b490f495d595485777'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:29.979483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c622d475cd40b490f495d595485777'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:30.002332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c622d475cd40b490f495d595485777'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:30.003135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-18114da9-bd2d-4e86-8082-96c29582ba08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c622d475cd40b490f495d595485777'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:30.011179 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3649/7331] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:29 2022] DELETE /identity/v3/users/d8c622d475cd40b490f495d595485777 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:30.015912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc1a69-6cfe-4b3a-8e60-b45b969a0f06 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:30.016652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc1a69-6cfe-4b3a-8e60-b45b969a0f06 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:30.017110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc1a69-6cfe-4b3a-8e60-b45b969a0f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:30.068892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b9fc1a69-6cfe-4b3a-8e60-b45b969a0f06 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:30.070508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b9fc1a69-6cfe-4b3a-8e60-b45b969a0f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:30.108851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb2d6e-e631-4d7a-a601-8c2760e8419c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:30.163220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:30.277441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c8126-b5eb-4127-8da7-7282a6a3c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:30.278276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8126-b5eb-4127-8da7-7282a6a3c5fc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:30.278901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8126-b5eb-4127-8da7-7282a6a3c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:30.279419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8126-b5eb-4127-8da7-7282a6a3c5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:30.281156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c8126-b5eb-4127-8da7-7282a6a3c5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:30.283411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c8126-b5eb-4127-8da7-7282a6a3c5fc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:30.293341 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3650/7332] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:30.319180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3683/7333] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:30.328939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc1a69-6cfe-4b3a-8e60-b45b969a0f06 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:30.330559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b9fc1a69-6cfe-4b3a-8e60-b45b969a0f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:30.334661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c8126-b5eb-4127-8da7-7282a6a3c5fc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:30.341016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-773c8126-b5eb-4127-8da7-7282a6a3c5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:30.357310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc1a69-6cfe-4b3a-8e60-b45b969a0f06 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:30.387188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9677b-a4af-414f-80aa-21e90c122aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:30.387565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9677b-a4af-414f-80aa-21e90c122aac admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:30.387804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9677b-a4af-414f-80aa-21e90c122aac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:30.388071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9677b-a4af-414f-80aa-21e90c122aac admin admin] PATH_INFO: `/v3/projects/6c1c94b3e6454cdb982a2eadc802602c/users/11dd5a5acb2c498daefa3ef48682c2d8/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:30.394731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9677b-a4af-414f-80aa-21e90c122aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1c94b3e6454cdb982a2eadc802602c, user_id=11dd5a5acb2c498daefa3ef48682c2d8, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:30.397651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9677b-a4af-414f-80aa-21e90c122aac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:30.457479 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3651/7334] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:30 2022] PUT /identity/v3/projects/6c1c94b3e6454cdb982a2eadc802602c/users/11dd5a5acb2c498daefa3ef48682c2d8/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:30.475497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed278-7f14-44d3-a886-236ec6009e2c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:30.475780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed278-7f14-44d3-a886-236ec6009e2c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:30.483741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ed278-7f14-44d3-a886-236ec6009e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:30.578534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c8126-b5eb-4127-8da7-7282a6a3c5fc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:30.624197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-908ed278-7f14-44d3-a886-236ec6009e2c None None] MFA Rules not processed for user `11dd5a5acb2c498daefa3ef48682c2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:30.627293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-908ed278-7f14-44d3-a886-236ec6009e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:30.627948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:30.729296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f327ee8-c64e-4c8d-b2c3-374abe47a86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:30.730058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f327ee8-c64e-4c8d-b2c3-374abe47a86e service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:30.732216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f327ee8-c64e-4c8d-b2c3-374abe47a86e service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:30.732635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f327ee8-c64e-4c8d-b2c3-374abe47a86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:30.841808 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3652/7335] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:30.847604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed278-7f14-44d3-a886-236ec6009e2c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:30.888357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ed278-7f14-44d3-a886-236ec6009e2c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:30.906672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4d122-977d-4ff7-9067-5538ffd649ab tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11dd5a5acb2c498daefa3ef48682c2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c1c94b3e6454cdb982a2eadc802602c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:30.910803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4d122-977d-4ff7-9067-5538ffd649ab tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:30.911863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4d122-977d-4ff7-9067-5538ffd649ab tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:30.913066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4d122-977d-4ff7-9067-5538ffd649ab tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:30.915652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4d122-977d-4ff7-9067-5538ffd649ab tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:30.921972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4d122-977d-4ff7-9067-5538ffd649ab tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:30.934428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f327ee8-c64e-4c8d-b2c3-374abe47a86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:30.938896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f327ee8-c64e-4c8d-b2c3-374abe47a86e service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:31.010389 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3684/7336] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:31.059847 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3653/7337] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:30 2022] POST /identity/v3/projects => generated 360 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:31.065228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f327ee8-c64e-4c8d-b2c3-374abe47a86e service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:31.109050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f327ee8-c64e-4c8d-b2c3-374abe47a86e service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:31.391938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3a43c-df6f-4aa6-8e83-e56d60b400b0 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11dd5a5acb2c498daefa3ef48682c2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c1c94b3e6454cdb982a2eadc802602c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:31.408907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a43c-df6f-4aa6-8e83-e56d60b400b0 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:31.414376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a43c-df6f-4aa6-8e83-e56d60b400b0 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:31.416362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a43c-df6f-4aa6-8e83-e56d60b400b0 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] PATH_INFO: `/v3/projects/52391040f65945a1bad3fe001077cb9d/tags/tempest-tag-483324370` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:31.424468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3a43c-df6f-4aa6-8e83-e56d60b400b0 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=52391040f65945a1bad3fe001077cb9d, value=tempest-tag-483324370)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:31.433242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3a43c-df6f-4aa6-8e83-e56d60b400b0 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:31.655371 n-d-820368-36 devstack@keystone.service[82098]: WARNING py.warnings [None req-8ff3a43c-df6f-4aa6-8e83-e56d60b400b0 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-483324370. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:47:31.655371 n-d-820368-36 devstack@keystone.service[82098]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:47:31.655371 n-d-820368-36 devstack@keystone.service[82098]: Aug 30 04:47:31.678450 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3685/7338] 10.222.0.43 () {60 vars in 1330 bytes} [Tue Aug 30 04:47:31 2022] PUT /identity/v3/projects/52391040f65945a1bad3fe001077cb9d/tags/tempest-tag-483324370 => generated 0 bytes in 614 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Aug 30 04:47:31.687759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4d122-977d-4ff7-9067-5538ffd649ab tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:31.711099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4d122-977d-4ff7-9067-5538ffd649ab tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:31.726755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d208502-f5df-4826-903f-a68fbcd0dd1b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11dd5a5acb2c498daefa3ef48682c2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c1c94b3e6454cdb982a2eadc802602c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:31.727484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d208502-f5df-4826-903f-a68fbcd0dd1b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:31.728007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d208502-f5df-4826-903f-a68fbcd0dd1b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:31.728551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d208502-f5df-4826-903f-a68fbcd0dd1b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] PATH_INFO: `/v3/projects/52391040f65945a1bad3fe001077cb9d/tags/tempest-tag-483324370` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:31.750255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3a43c-df6f-4aa6-8e83-e56d60b400b0 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:31.752421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8ff3a43c-df6f-4aa6-8e83-e56d60b400b0 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:31.766778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d208502-f5df-4826-903f-a68fbcd0dd1b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=52391040f65945a1bad3fe001077cb9d, value=tempest-tag-483324370)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:31.769354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d208502-f5df-4826-903f-a68fbcd0dd1b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:31.803617 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3654/7339] 10.222.0.43 () {58 vars in 1311 bytes} [Tue Aug 30 04:47:31 2022] GET /identity/v3/projects/52391040f65945a1bad3fe001077cb9d/tags/tempest-tag-483324370 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:31.808341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d208502-f5df-4826-903f-a68fbcd0dd1b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:31.833701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d208502-f5df-4826-903f-a68fbcd0dd1b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:31.844871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12cf5f-beaa-4f9d-8131-bbe8172e4503 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11dd5a5acb2c498daefa3ef48682c2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c1c94b3e6454cdb982a2eadc802602c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:31.845709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12cf5f-beaa-4f9d-8131-bbe8172e4503 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:31.846129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12cf5f-beaa-4f9d-8131-bbe8172e4503 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:31.848151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12cf5f-beaa-4f9d-8131-bbe8172e4503 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] PATH_INFO: `/v3/projects/52391040f65945a1bad3fe001077cb9d/tags` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:31.852195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12cf5f-beaa-4f9d-8131-bbe8172e4503 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=52391040f65945a1bad3fe001077cb9d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:31.857117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12cf5f-beaa-4f9d-8131-bbe8172e4503 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:31.861241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:31.974257 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3655/7340] 10.222.0.43 () {60 vars in 1265 bytes} [Tue Aug 30 04:47:31 2022] PUT /identity/v3/projects/52391040f65945a1bad3fe001077cb9d/tags => generated 142 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:31.978445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12cf5f-beaa-4f9d-8131-bbe8172e4503 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:31.987410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3a43c-df6f-4aa6-8e83-e56d60b400b0 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:32.003331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:32.004452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:32.004767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12cf5f-beaa-4f9d-8131-bbe8172e4503 tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:32.007072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:32.007581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] PATH_INFO: `/v3/projects/4baaefb6631f4ab19d40336b5c3c73e0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:32.010824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4baaefb6631f4ab19d40336b5c3c73e0)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:32.013188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:32.020649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9d349-87a4-4ab1-81a3-5348259e032c tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11dd5a5acb2c498daefa3ef48682c2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c1c94b3e6454cdb982a2eadc802602c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:32.021413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9d349-87a4-4ab1-81a3-5348259e032c tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:32.021784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9d349-87a4-4ab1-81a3-5348259e032c tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:32.022109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9d349-87a4-4ab1-81a3-5348259e032c tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] PATH_INFO: `/v3/projects/52391040f65945a1bad3fe001077cb9d/tags` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:32.078326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9d349-87a4-4ab1-81a3-5348259e032c tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=52391040f65945a1bad3fe001077cb9d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:32.087237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9d349-87a4-4ab1-81a3-5348259e032c tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:32.133106 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3656/7341] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Aug 30 04:47:31 2022] GET /identity/v3/projects/52391040f65945a1bad3fe001077cb9d/tags => generated 142 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:32.141851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9d349-87a4-4ab1-81a3-5348259e032c tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:32.195898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:32.222784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4baaefb6631f4ab19d40336b5c3c73e0', 'request_id': 'req-26948064-fe5e-4cec-a6c4-2d06fab15e34'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:32.244600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9d349-87a4-4ab1-81a3-5348259e032c tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:32.282521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4baaefb6631f4ab19d40336b5c3c73e0', 'request_id': 'req-26948064-fe5e-4cec-a6c4-2d06fab15e34'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:32.304694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4baaefb6631f4ab19d40336b5c3c73e0', 'request_id': 'req-26948064-fe5e-4cec-a6c4-2d06fab15e34'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:32.321818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] The token cache is being invalidate because project 4baaefb6631f4ab19d40336b5c3c73e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:32.322526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:32.323706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-26948064-fe5e-4cec-a6c4-2d06fab15e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:32.329566 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3686/7342] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:31 2022] DELETE /identity/v3/projects/4baaefb6631f4ab19d40336b5c3c73e0 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:32.332443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8391-dc95-4d57-840c-0858d437b343 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:32.333003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8391-dc95-4d57-840c-0858d437b343 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:32.335126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8391-dc95-4d57-840c-0858d437b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:32.360980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-774d8391-dc95-4d57-840c-0858d437b343 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:32.363789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-774d8391-dc95-4d57-840c-0858d437b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:32.648615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d9b87-2e20-4867-b302-689079de803d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11dd5a5acb2c498daefa3ef48682c2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c1c94b3e6454cdb982a2eadc802602c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:32.649379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d9b87-2e20-4867-b302-689079de803d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:32.649664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d9b87-2e20-4867-b302-689079de803d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:32.650067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d9b87-2e20-4867-b302-689079de803d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] PATH_INFO: `/v3/projects/52391040f65945a1bad3fe001077cb9d/tags/tempest-tag-1334698431` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:32.653174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d9b87-2e20-4867-b302-689079de803d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=52391040f65945a1bad3fe001077cb9d, value=tempest-tag-1334698431)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:32.659136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d9b87-2e20-4867-b302-689079de803d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:32.663611 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3687/7343] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:32.765816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2297e9-9cf6-4835-96e8-3c6cc05fb0a8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:32.766186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2297e9-9cf6-4835-96e8-3c6cc05fb0a8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:32.766618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2297e9-9cf6-4835-96e8-3c6cc05fb0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:32.826999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5d2297e9-9cf6-4835-96e8-3c6cc05fb0a8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:32.835118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5d2297e9-9cf6-4835-96e8-3c6cc05fb0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:32.871853 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3688/7344] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:32.878092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2297e9-9cf6-4835-96e8-3c6cc05fb0a8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:32.899674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2297e9-9cf6-4835-96e8-3c6cc05fb0a8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:32.904461 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-7f1d9b87-2e20-4867-b302-689079de803d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1334698431. To ensure interoperability, identifiers should be a valid uuid. Aug 30 04:47:32.904461 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 30 04:47:32.904461 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:47:32.914149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf29f-a0fa-4f63-ab49-78cce7d09304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:32.914931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf29f-a0fa-4f63-ab49-78cce7d09304 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:32.915319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf29f-a0fa-4f63-ab49-78cce7d09304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:32.915691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf29f-a0fa-4f63-ab49-78cce7d09304 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:32.916685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf29f-a0fa-4f63-ab49-78cce7d09304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:47:32.917081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf29f-a0fa-4f63-ab49-78cce7d09304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:32.919148 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3657/7345] 10.222.0.43 () {58 vars in 1317 bytes} [Tue Aug 30 04:47:32 2022] DELETE /identity/v3/projects/52391040f65945a1bad3fe001077cb9d/tags/tempest-tag-1334698431 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:32.922867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf29f-a0fa-4f63-ab49-78cce7d09304 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:32.924077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d9b87-2e20-4867-b302-689079de803d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:32.937162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7f1d9b87-2e20-4867-b302-689079de803d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:32.960725 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3689/7346] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:33.005973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d9b87-2e20-4867-b302-689079de803d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:33.006317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf29f-a0fa-4f63-ab49-78cce7d09304 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:33.024795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50263cfc-fdea-4463-8691-4c630556303d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11dd5a5acb2c498daefa3ef48682c2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c1c94b3e6454cdb982a2eadc802602c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:33.025480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50263cfc-fdea-4463-8691-4c630556303d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:33.025756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50263cfc-fdea-4463-8691-4c630556303d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:33.026042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50263cfc-fdea-4463-8691-4c630556303d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] PATH_INFO: `/v3/projects/52391040f65945a1bad3fe001077cb9d/tags/tempest-tag-1334698431` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:33.074888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf29f-a0fa-4f63-ab49-78cce7d09304 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:33.076026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50263cfc-fdea-4463-8691-4c630556303d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=52391040f65945a1bad3fe001077cb9d, value=tempest-tag-1334698431)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:33.081364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50263cfc-fdea-4463-8691-4c630556303d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:33.106763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2c77d-495d-4f93-a7e5-a2c4b1c3735c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:33.107928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2c77d-495d-4f93-a7e5-a2c4b1c3735c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:33.108944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2c77d-495d-4f93-a7e5-a2c4b1c3735c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:33.109501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2c77d-495d-4f93-a7e5-a2c4b1c3735c admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:33.111320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2c77d-495d-4f93-a7e5-a2c4b1c3735c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:33.117890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2c77d-495d-4f93-a7e5-a2c4b1c3735c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-50263cfc-fdea-4463-8691-4c630556303d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Could not find project tag: tempest-tag-1334698431.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1334698431. Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 30 04:47:33.136895 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 30 04:47:33.138037 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:47:33.138037 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:47:33.138037 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 30 04:47:33.138037 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 30 04:47:33.138037 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1334698431. Aug 30 04:47:33.138037 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:33.138507 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3658/7347] 10.222.0.43 () {58 vars in 1314 bytes} [Tue Aug 30 04:47:32 2022] GET /identity/v3/projects/52391040f65945a1bad3fe001077cb9d/tags/tempest-tag-1334698431 => generated 107 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:47:33.154297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50263cfc-fdea-4463-8691-4c630556303d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:33.193137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50263cfc-fdea-4463-8691-4c630556303d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:33.200538 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3690/7348] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:32 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:33.206638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2c77d-495d-4f93-a7e5-a2c4b1c3735c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:33.310847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:33.391767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05af4ce-34e2-4d3f-8cdc-4fe4dd5c3b6f tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11dd5a5acb2c498daefa3ef48682c2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c1c94b3e6454cdb982a2eadc802602c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:33.393041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05af4ce-34e2-4d3f-8cdc-4fe4dd5c3b6f tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:33.393642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05af4ce-34e2-4d3f-8cdc-4fe4dd5c3b6f tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:33.394241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05af4ce-34e2-4d3f-8cdc-4fe4dd5c3b6f tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] PATH_INFO: `/v3/projects/52391040f65945a1bad3fe001077cb9d/tags` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:33.399999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05af4ce-34e2-4d3f-8cdc-4fe4dd5c3b6f tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=52391040f65945a1bad3fe001077cb9d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:33.403043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05af4ce-34e2-4d3f-8cdc-4fe4dd5c3b6f tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:33.544082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2c77d-495d-4f93-a7e5-a2c4b1c3735c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:33.561295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4910-761c-4e79-a38b-0c29793a8f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:33.561965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4910-761c-4e79-a38b-0c29793a8f1a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:33.562243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4910-761c-4e79-a38b-0c29793a8f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:33.562555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a4910-761c-4e79-a38b-0c29793a8f1a admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:33.563214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a4910-761c-4e79-a38b-0c29793a8f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:33.571467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a4910-761c-4e79-a38b-0c29793a8f1a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:33.623132 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3691/7349] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:33 2022] POST /identity/v3/users => generated 303 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:47:33.627059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4910-761c-4e79-a38b-0c29793a8f1a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:33.661216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a4910-761c-4e79-a38b-0c29793a8f1a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:33.675516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24f663-79a0-4c31-b84c-ab367342e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:33.683010 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3659/7350] 10.222.0.43 () {58 vars in 1248 bytes} [Tue Aug 30 04:47:33 2022] DELETE /identity/v3/projects/52391040f65945a1bad3fe001077cb9d/tags => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:33.687155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24f663-79a0-4c31-b84c-ab367342e4cc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:33.687684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24f663-79a0-4c31-b84c-ab367342e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:33.687988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24f663-79a0-4c31-b84c-ab367342e4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:33.688770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24f663-79a0-4c31-b84c-ab367342e4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:33.690631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24f663-79a0-4c31-b84c-ab367342e4cc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:33.691735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05af4ce-34e2-4d3f-8cdc-4fe4dd5c3b6f tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:33.720681 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3692/7351] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:47:33.728006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24f663-79a0-4c31-b84c-ab367342e4cc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:33.742456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24f663-79a0-4c31-b84c-ab367342e4cc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:33.751564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd51a1-a50b-4c7f-8944-21eef4356d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:33.752157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05af4ce-34e2-4d3f-8cdc-4fe4dd5c3b6f tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:33.752954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd51a1-a50b-4c7f-8944-21eef4356d0b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:33.753623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd51a1-a50b-4c7f-8944-21eef4356d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:33.754120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd51a1-a50b-4c7f-8944-21eef4356d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:33.755067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd51a1-a50b-4c7f-8944-21eef4356d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:33.758078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd51a1-a50b-4c7f-8944-21eef4356d0b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:33.772445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bcd8f-86d3-4137-8210-54716819424d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11dd5a5acb2c498daefa3ef48682c2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c1c94b3e6454cdb982a2eadc802602c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:33.773325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bcd8f-86d3-4137-8210-54716819424d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:33.773752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bcd8f-86d3-4137-8210-54716819424d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:33.774331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bcd8f-86d3-4137-8210-54716819424d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] PATH_INFO: `/v3/projects/52391040f65945a1bad3fe001077cb9d/tags` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:33.774825 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3693/7352] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:47:33.779021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd51a1-a50b-4c7f-8944-21eef4356d0b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:33.793640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd51a1-a50b-4c7f-8944-21eef4356d0b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:33.802238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713f0da-2f48-477d-bcf4-0ecd1b1028f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:33.803213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f0da-2f48-477d-bcf4-0ecd1b1028f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:33.803729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f0da-2f48-477d-bcf4-0ecd1b1028f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:33.804167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713f0da-2f48-477d-bcf4-0ecd1b1028f7 admin admin] PATH_INFO: `/v3/projects/1adb748530e54d3db9273d7b52d5c17c/users/e1d082d32fd944dab6247dcd6fd6f136/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:33.821781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bcd8f-86d3-4137-8210-54716819424d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=52391040f65945a1bad3fe001077cb9d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:33.828613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bcd8f-86d3-4137-8210-54716819424d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:33.838709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:33.853463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713f0da-2f48-477d-bcf4-0ecd1b1028f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1adb748530e54d3db9273d7b52d5c17c, user_id=e1d082d32fd944dab6247dcd6fd6f136, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:33.863214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713f0da-2f48-477d-bcf4-0ecd1b1028f7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:33.908340 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3694/7353] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:33 2022] PUT /identity/v3/projects/1adb748530e54d3db9273d7b52d5c17c/users/e1d082d32fd944dab6247dcd6fd6f136/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:33.914858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b7a5-f8a4-44f4-896f-4d2771299303 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:33.917609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b7a5-f8a4-44f4-896f-4d2771299303 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:33.919240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b7a5-f8a4-44f4-896f-4d2771299303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:33.924954 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3660/7354] 10.222.0.43 () {58 vars in 1245 bytes} [Tue Aug 30 04:47:33 2022] GET /identity/v3/projects/52391040f65945a1bad3fe001077cb9d/tags => generated 66 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 30 04:47:33.927753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bcd8f-86d3-4137-8210-54716819424d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:33.997109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bcd8f-86d3-4137-8210-54716819424d tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:34.100336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c0b8b7a5-f8a4-44f4-896f-4d2771299303 None None] MFA Rules not processed for user `e1d082d32fd944dab6247dcd6fd6f136`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:34.104655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c0b8b7a5-f8a4-44f4-896f-4d2771299303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:34.313963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11dd5a5acb2c498daefa3ef48682c2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c1c94b3e6454cdb982a2eadc802602c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:34.314952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:34.315401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:34.315830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] PATH_INFO: `/v3/projects/52391040f65945a1bad3fe001077cb9d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:34.323948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52391040f65945a1bad3fe001077cb9d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:34.326391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:34.364849 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3695/7355] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:34.369676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8b7a5-f8a4-44f4-896f-4d2771299303 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:34.432267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52391040f65945a1bad3fe001077cb9d', 'request_id': 'req-2801d715-748a-4955-9bb7-0a7248e6b06b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:34.460257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52391040f65945a1bad3fe001077cb9d', 'request_id': 'req-2801d715-748a-4955-9bb7-0a7248e6b06b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:34.477235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52391040f65945a1bad3fe001077cb9d', 'request_id': 'req-2801d715-748a-4955-9bb7-0a7248e6b06b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:34.518350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] The token cache is being invalidate because project 52391040f65945a1bad3fe001077cb9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:34.519358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:34.520135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:34.523100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:34.528894 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3661/7356] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:33 2022] DELETE /identity/v3/projects/52391040f65945a1bad3fe001077cb9d => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:34.546027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:34.561590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:34.568185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8b7a5-f8a4-44f4-896f-4d2771299303 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:34.768036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d8aae-7b35-4140-aeea-2e2a93b7ae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:34.771756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d8aae-7b35-4140-aeea-2e2a93b7ae4d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:34.772056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d8aae-7b35-4140-aeea-2e2a93b7ae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:34.772324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d8aae-7b35-4140-aeea-2e2a93b7ae4d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:34.774052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d8aae-7b35-4140-aeea-2e2a93b7ae4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:34.778264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d8aae-7b35-4140-aeea-2e2a93b7ae4d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:34.849788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801d715-748a-4955-9bb7-0a7248e6b06b tempest-IdentityV3ProjectTagsTest-1849490183 tempest-IdentityV3ProjectTagsTest-1849490183-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:34.858719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:34.859640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:34.859809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:34.861636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] PATH_INFO: `/v3/users/365db7501516488a9626ea500d1b2350` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:34.862266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=365db7501516488a9626ea500d1b2350)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:34.868790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:34.948251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:34.978917 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3696/7357] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:34 2022] POST /identity/v3/projects => generated 403 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:47:34.980477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d8aae-7b35-4140-aeea-2e2a93b7ae4d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:34.986988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-988d8aae-7b35-4140-aeea-2e2a93b7ae4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:35.035827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365db7501516488a9626ea500d1b2350'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:35.072437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365db7501516488a9626ea500d1b2350'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:35.110406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365db7501516488a9626ea500d1b2350'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:35.126087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365db7501516488a9626ea500d1b2350'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:35.130310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1fdd028c-f99f-463b-b1d1-7912a06329d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365db7501516488a9626ea500d1b2350'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:35.165913 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3662/7358] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:34 2022] DELETE /identity/v3/users/365db7501516488a9626ea500d1b2350 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:35.167720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde641e1-c06a-4fae-994e-075484bda1a3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:35.168160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde641e1-c06a-4fae-994e-075484bda1a3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:35.168575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde641e1-c06a-4fae-994e-075484bda1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:35.244357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-dde641e1-c06a-4fae-994e-075484bda1a3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:35.246171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dde641e1-c06a-4fae-994e-075484bda1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:35.251934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d8aae-7b35-4140-aeea-2e2a93b7ae4d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:35.398454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84c4c-dbdb-4dd9-ac11-0c2a190f6adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:35.412202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84c4c-dbdb-4dd9-ac11-0c2a190f6adb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:35.412664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84c4c-dbdb-4dd9-ac11-0c2a190f6adb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:35.412957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc84c4c-dbdb-4dd9-ac11-0c2a190f6adb admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:35.415792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc84c4c-dbdb-4dd9-ac11-0c2a190f6adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:35.419563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc84c4c-dbdb-4dd9-ac11-0c2a190f6adb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:35.484698 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3663/7359] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:35.503665 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3697/7360] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:34 2022] POST /identity/v3/users => generated 308 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:35.508258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde641e1-c06a-4fae-994e-075484bda1a3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:35.510317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dde641e1-c06a-4fae-994e-075484bda1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:35.538353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde641e1-c06a-4fae-994e-075484bda1a3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:35.548076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84c4c-dbdb-4dd9-ac11-0c2a190f6adb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:35.549797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dfc84c4c-dbdb-4dd9-ac11-0c2a190f6adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:35.552033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f47b3-2e95-46aa-9336-863186b3a53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:35.552974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f47b3-2e95-46aa-9336-863186b3a53f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:35.553471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f47b3-2e95-46aa-9336-863186b3a53f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:35.553983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f47b3-2e95-46aa-9336-863186b3a53f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:35.554930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f47b3-2e95-46aa-9336-863186b3a53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:35.556891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f47b3-2e95-46aa-9336-863186b3a53f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:35.588707 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3664/7361] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:35.590043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f47b3-2e95-46aa-9336-863186b3a53f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:35.594026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:35.617437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f47b3-2e95-46aa-9336-863186b3a53f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:35.641800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b7921-dd99-4378-8b36-95a7597056b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:35.642794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b7921-dd99-4378-8b36-95a7597056b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:35.645094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b7921-dd99-4378-8b36-95a7597056b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:35.647536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b7921-dd99-4378-8b36-95a7597056b2 admin admin] PATH_INFO: `/v3/projects/bfd931acfb764bf588d127f6662f980f/users/9300a7e237a24a14b4b8424abc938b28/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:35.724243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b7921-dd99-4378-8b36-95a7597056b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd931acfb764bf588d127f6662f980f, user_id=9300a7e237a24a14b4b8424abc938b28, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:35.739514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b7921-dd99-4378-8b36-95a7597056b2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:35.747322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc84c4c-dbdb-4dd9-ac11-0c2a190f6adb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:35.761206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac672f9-98a4-4d6a-9d9c-552e3d66d0d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:35.761842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac672f9-98a4-4d6a-9d9c-552e3d66d0d4 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:35.762160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac672f9-98a4-4d6a-9d9c-552e3d66d0d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:35.762425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac672f9-98a4-4d6a-9d9c-552e3d66d0d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:35.779175 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3665/7362] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:35 2022] PUT /identity/v3/projects/bfd931acfb764bf588d127f6662f980f/users/9300a7e237a24a14b4b8424abc938b28/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:35.784091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac672f9-98a4-4d6a-9d9c-552e3d66d0d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:35.786234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b7921-dd99-4378-8b36-95a7597056b2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:35.787981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac672f9-98a4-4d6a-9d9c-552e3d66d0d4 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:35.853798 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3698/7363] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:47:35.975655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b7921-dd99-4378-8b36-95a7597056b2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:35.980950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4ea6a-934c-42fc-a1cf-b767ac10ae33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:35.981581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ea6a-934c-42fc-a1cf-b767ac10ae33 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:35.981867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ea6a-934c-42fc-a1cf-b767ac10ae33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:35.982407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ea6a-934c-42fc-a1cf-b767ac10ae33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:35.982881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4ea6a-934c-42fc-a1cf-b767ac10ae33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:35.988552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4ea6a-934c-42fc-a1cf-b767ac10ae33 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:36.004833 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3666/7364] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:36.008896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac672f9-98a4-4d6a-9d9c-552e3d66d0d4 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:36.029192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac672f9-98a4-4d6a-9d9c-552e3d66d0d4 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:36.055601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebae546-1978-4ebc-a3ee-51065d499c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:36.057093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebae546-1978-4ebc-a3ee-51065d499c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:36.059052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebae546-1978-4ebc-a3ee-51065d499c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:36.059577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebae546-1978-4ebc-a3ee-51065d499c07 admin admin] PATH_INFO: `/v3/projects/bfd931acfb764bf588d127f6662f980f/users/9300a7e237a24a14b4b8424abc938b28/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:36.067490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebae546-1978-4ebc-a3ee-51065d499c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd931acfb764bf588d127f6662f980f, user_id=9300a7e237a24a14b4b8424abc938b28, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:36.079124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebae546-1978-4ebc-a3ee-51065d499c07 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:36.108422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3699/7365] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:36 2022] PUT /identity/v3/projects/bfd931acfb764bf588d127f6662f980f/users/9300a7e237a24a14b4b8424abc938b28/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:36.121001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa718-b270-4c69-a1de-a93a70f1fdef None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:36.121403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa718-b270-4c69-a1de-a93a70f1fdef None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:36.121787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa718-b270-4c69-a1de-a93a70f1fdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:36.137567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:36.213321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1c3fa718-b270-4c69-a1de-a93a70f1fdef None None] MFA Rules not processed for user `9300a7e237a24a14b4b8424abc938b28`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:36.215612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1c3fa718-b270-4c69-a1de-a93a70f1fdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:36.422916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebae546-1978-4ebc-a3ee-51065d499c07 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:36.425018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aebae546-1978-4ebc-a3ee-51065d499c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:36.434181 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3667/7366] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:36.613929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebae546-1978-4ebc-a3ee-51065d499c07 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:36.637445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd3c20-9c8f-4872-b7ed-6c383d5398d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:36.638662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd3c20-9c8f-4872-b7ed-6c383d5398d2 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:36.639456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd3c20-9c8f-4872-b7ed-6c383d5398d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:36.639860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd3c20-9c8f-4872-b7ed-6c383d5398d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:36.691789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd3c20-9c8f-4872-b7ed-6c383d5398d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:36.701411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd3c20-9c8f-4872-b7ed-6c383d5398d2 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:36.777729 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3700/7367] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:36 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:47:37.077535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fa718-b270-4c69-a1de-a93a70f1fdef None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:37.315658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fa718-b270-4c69-a1de-a93a70f1fdef None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:37.369837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:37.372523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:37.373550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:37.374717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] PATH_INFO: `/v3/users/e1d082d32fd944dab6247dcd6fd6f136` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:37.379278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d082d32fd944dab6247dcd6fd6f136)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:37.384978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:37.544044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d082d32fd944dab6247dcd6fd6f136'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:37.569909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d082d32fd944dab6247dcd6fd6f136'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:37.597061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d082d32fd944dab6247dcd6fd6f136'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:37.618635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d082d32fd944dab6247dcd6fd6f136'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:37.619994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d082d32fd944dab6247dcd6fd6f136'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:37.631268 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3668/7368] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:37 2022] DELETE /identity/v3/users/e1d082d32fd944dab6247dcd6fd6f136 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:37.633588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f14fa-16c1-4d89-b0ef-5168b163a297 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:37.633588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f14fa-16c1-4d89-b0ef-5168b163a297 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:37.633588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f14fa-16c1-4d89-b0ef-5168b163a297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:37.678378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-096f14fa-16c1-4d89-b0ef-5168b163a297 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:37.679704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-096f14fa-16c1-4d89-b0ef-5168b163a297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:37.806318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:37.807556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:37.838665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:37.984905 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3701/7369] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:38.025981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f14fa-16c1-4d89-b0ef-5168b163a297 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:38.030571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-096f14fa-16c1-4d89-b0ef-5168b163a297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:38.137802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb6cfe-2ce6-488f-a68f-ac0d13974ac0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:38.153602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:38.154593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:38.155154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:38.155598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] PATH_INFO: `/v3/projects/be4badad468444c3b8faad2f09c59c3c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:38.157975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4badad468444c3b8faad2f09c59c3c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:38.160152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:38.248964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f14fa-16c1-4d89-b0ef-5168b163a297 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:38.264445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92902ad-8a9d-48dc-bfd6-990682943532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:38.265083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92902ad-8a9d-48dc-bfd6-990682943532 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:38.265371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92902ad-8a9d-48dc-bfd6-990682943532 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:38.265693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92902ad-8a9d-48dc-bfd6-990682943532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:38.286490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:38.296389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4badad468444c3b8faad2f09c59c3c', 'request_id': 'req-9d828cbf-d5a6-4535-99e0-90109c0fb51f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:38.299277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92902ad-8a9d-48dc-bfd6-990682943532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:38.306195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92902ad-8a9d-48dc-bfd6-990682943532 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:38.335042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4badad468444c3b8faad2f09c59c3c', 'request_id': 'req-9d828cbf-d5a6-4535-99e0-90109c0fb51f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:38.359391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4badad468444c3b8faad2f09c59c3c', 'request_id': 'req-9d828cbf-d5a6-4535-99e0-90109c0fb51f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:38.365673 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3702/7370] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:38.400582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] The token cache is being invalidate because project be4badad468444c3b8faad2f09c59c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:38.400941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:38.401611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:38.405274 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3669/7371] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:37 2022] DELETE /identity/v3/projects/be4badad468444c3b8faad2f09c59c3c => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:38.410126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92902ad-8a9d-48dc-bfd6-990682943532 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:38.434218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92902ad-8a9d-48dc-bfd6-990682943532 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:38.601248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:38.601935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:38.602216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:38.602489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] PATH_INFO: `/v3/users/11dd5a5acb2c498daefa3ef48682c2d8` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:38.603885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11dd5a5acb2c498daefa3ef48682c2d8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:38.608847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:38.744277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11dd5a5acb2c498daefa3ef48682c2d8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:38.744923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11dd5a5acb2c498daefa3ef48682c2d8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:38.780056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11dd5a5acb2c498daefa3ef48682c2d8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:38.798566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11dd5a5acb2c498daefa3ef48682c2d8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:38.830742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11dd5a5acb2c498daefa3ef48682c2d8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:38.852158 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3703/7372] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:38 2022] DELETE /identity/v3/users/11dd5a5acb2c498daefa3ef48682c2d8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:40.212055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:40.214138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:40.263788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:40.267297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:40.282583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d828cbf-d5a6-4535-99e0-90109c0fb51f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:40.440961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3305fe-8499-4497-a960-6e3d7ec1d243 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:40.457985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:40.459058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:40.459578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:40.460077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] PATH_INFO: `/v3/projects/6c1c94b3e6454cdb982a2eadc802602c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:40.463630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1c94b3e6454cdb982a2eadc802602c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:40.466442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:40.504105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:40.565989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:40.565989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:40.566291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:40.567368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] PATH_INFO: `/v3/projects/1adb748530e54d3db9273d7b52d5c17c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:40.572968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1adb748530e54d3db9273d7b52d5c17c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:40.583985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:40.602842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1c94b3e6454cdb982a2eadc802602c', 'request_id': 'req-11eea825-a94b-420e-977e-7d43a119f41f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:40.629490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1c94b3e6454cdb982a2eadc802602c', 'request_id': 'req-11eea825-a94b-420e-977e-7d43a119f41f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:40.663130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1c94b3e6454cdb982a2eadc802602c', 'request_id': 'req-11eea825-a94b-420e-977e-7d43a119f41f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:40.738655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] The token cache is being invalidate because project 6c1c94b3e6454cdb982a2eadc802602c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:40.739239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:40.740785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-11eea825-a94b-420e-977e-7d43a119f41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:40.749540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:40.750614 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3704/7373] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:40 2022] DELETE /identity/v3/projects/6c1c94b3e6454cdb982a2eadc802602c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:40.756350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e461b6-77a2-429a-a852-71323139e7a5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:40.757350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e461b6-77a2-429a-a852-71323139e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:40.758239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e461b6-77a2-429a-a852-71323139e7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:40.768671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1adb748530e54d3db9273d7b52d5c17c', 'request_id': 'req-01bcb93d-05f0-4cc7-8477-03354e0cc371'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:40.792577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1adb748530e54d3db9273d7b52d5c17c', 'request_id': 'req-01bcb93d-05f0-4cc7-8477-03354e0cc371'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:40.804740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1adb748530e54d3db9273d7b52d5c17c', 'request_id': 'req-01bcb93d-05f0-4cc7-8477-03354e0cc371'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:40.833338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] The token cache is being invalidate because project 1adb748530e54d3db9273d7b52d5c17c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:40.833831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-60e461b6-77a2-429a-a852-71323139e7a5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:40.834131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:40.835040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:40.835578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-60e461b6-77a2-429a-a852-71323139e7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:40.837495 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3670/7374] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:40 2022] DELETE /identity/v3/projects/1adb748530e54d3db9273d7b52d5c17c => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:40.841397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:40.843129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:41.020236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcb93d-05f0-4cc7-8477-03354e0cc371 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:41.031383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:41.032184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:41.032463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:41.032781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] PATH_INFO: `/v3/users/9300a7e237a24a14b4b8424abc938b28` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:41.040972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9300a7e237a24a14b4b8424abc938b28)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:41.046607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:41.099423 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3705/7375] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:41.101415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eadf5-4ccc-4606-87f6-57b9396d5a02 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:41.101908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eadf5-4ccc-4606-87f6-57b9396d5a02 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:41.102331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16eadf5-4ccc-4606-87f6-57b9396d5a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:41.153658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9300a7e237a24a14b4b8424abc938b28'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:41.169747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c16eadf5-4ccc-4606-87f6-57b9396d5a02 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:41.172876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c16eadf5-4ccc-4606-87f6-57b9396d5a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:41.174737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9300a7e237a24a14b4b8424abc938b28'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:41.199574 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3706/7376] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:41.203784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16eadf5-4ccc-4606-87f6-57b9396d5a02 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:41.223694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16eadf5-4ccc-4606-87f6-57b9396d5a02 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:41.223937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9300a7e237a24a14b4b8424abc938b28'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:41.239076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9300a7e237a24a14b4b8424abc938b28'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:41.242126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9300a7e237a24a14b4b8424abc938b28'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:41.245149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dc707-4d68-49b6-b7ae-ae6c1f90240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:41.246101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dc707-4d68-49b6-b7ae-ae6c1f90240b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:41.246597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dc707-4d68-49b6-b7ae-ae6c1f90240b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:41.247106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dc707-4d68-49b6-b7ae-ae6c1f90240b admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:41.248563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dc707-4d68-49b6-b7ae-ae6c1f90240b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:47:41.249125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dc707-4d68-49b6-b7ae-ae6c1f90240b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:41.252476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dc707-4d68-49b6-b7ae-ae6c1f90240b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:41.259559 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3671/7377] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:40 2022] DELETE /identity/v3/users/9300a7e237a24a14b4b8424abc938b28 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:41.270770 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3707/7378] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:47:41.275335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:41.277004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:41.367708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:41.407995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d03b4-c47d-47f0-b903-6d1bec1dfa71 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:41.417927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bd0f6-bf29-415e-87dc-28d2c20b5822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:41.420188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bd0f6-bf29-415e-87dc-28d2c20b5822 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:41.420656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bd0f6-bf29-415e-87dc-28d2c20b5822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:41.422425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bd0f6-bf29-415e-87dc-28d2c20b5822 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:41.423383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bd0f6-bf29-415e-87dc-28d2c20b5822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:41.428873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bd0f6-bf29-415e-87dc-28d2c20b5822 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:41.479469 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3672/7379] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:41 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:41.483956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dc707-4d68-49b6-b7ae-ae6c1f90240b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:41.508675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dc707-4d68-49b6-b7ae-ae6c1f90240b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:41.744455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978c443-c88b-4837-a03e-3c4881f5d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:41.747064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978c443-c88b-4837-a03e-3c4881f5d51d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:41.747481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978c443-c88b-4837-a03e-3c4881f5d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:41.748275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978c443-c88b-4837-a03e-3c4881f5d51d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:41.749391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978c443-c88b-4837-a03e-3c4881f5d51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:41.759791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978c443-c88b-4837-a03e-3c4881f5d51d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:41.847664 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3708/7380] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:41 2022] POST /identity/v3/users => generated 284 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:41.849667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bd0f6-bf29-415e-87dc-28d2c20b5822 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:41.871422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bd0f6-bf29-415e-87dc-28d2c20b5822 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:41.886137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cad8a5-a4a7-4364-a848-0762177b4c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:41.887190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cad8a5-a4a7-4364-a848-0762177b4c09 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:41.887591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cad8a5-a4a7-4364-a848-0762177b4c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:41.887764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cad8a5-a4a7-4364-a848-0762177b4c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:41.889960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cad8a5-a4a7-4364-a848-0762177b4c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:41.893078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cad8a5-a4a7-4364-a848-0762177b4c09 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:41.932336 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3673/7381] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:41.936678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978c443-c88b-4837-a03e-3c4881f5d51d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:41.953051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978c443-c88b-4837-a03e-3c4881f5d51d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:41.983780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196bd3de-3f7d-4953-ad3d-dc80bb7bc78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:41.984481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bd3de-3f7d-4953-ad3d-dc80bb7bc78d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:41.984988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bd3de-3f7d-4953-ad3d-dc80bb7bc78d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:41.984988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196bd3de-3f7d-4953-ad3d-dc80bb7bc78d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:41.985657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bd3de-3f7d-4953-ad3d-dc80bb7bc78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:41.990441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196bd3de-3f7d-4953-ad3d-dc80bb7bc78d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:42.042766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cad8a5-a4a7-4364-a848-0762177b4c09 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:42.053513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cad8a5-a4a7-4364-a848-0762177b4c09 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:42.054505 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3709/7382] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:42.074166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d89b-cdf9-4396-9b69-442573d7bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:42.074864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d89b-cdf9-4396-9b69-442573d7bbfd admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:42.075144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d89b-cdf9-4396-9b69-442573d7bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:42.075415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d89b-cdf9-4396-9b69-442573d7bbfd admin admin] PATH_INFO: `/v3/projects/523783246c234ab2b94d51bcfca68bce/users/4fe747bad86e48639f8daef44f647687/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:42.106476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429d89b-cdf9-4396-9b69-442573d7bbfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=523783246c234ab2b94d51bcfca68bce, user_id=4fe747bad86e48639f8daef44f647687, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:42.115773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429d89b-cdf9-4396-9b69-442573d7bbfd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:42.153487 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3674/7383] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:42 2022] PUT /identity/v3/projects/523783246c234ab2b94d51bcfca68bce/users/4fe747bad86e48639f8daef44f647687/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:42.165680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c319c-4cca-4570-af85-27713daed83a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:42.166016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c319c-4cca-4570-af85-27713daed83a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:42.166542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c319c-4cca-4570-af85-27713daed83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:42.175491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:42.244742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9d4c319c-4cca-4570-af85-27713daed83a None None] MFA Rules not processed for user `4fe747bad86e48639f8daef44f647687`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:42.246073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9d4c319c-4cca-4570-af85-27713daed83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:42.426684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d89b-cdf9-4396-9b69-442573d7bbfd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:42.429229 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3710/7384] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:42.566323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d89b-cdf9-4396-9b69-442573d7bbfd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:42.577100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b71c8-be22-4c57-8c09-cb1a053f220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:42.577745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b71c8-be22-4c57-8c09-cb1a053f220f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:42.578109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b71c8-be22-4c57-8c09-cb1a053f220f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:42.578382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b71c8-be22-4c57-8c09-cb1a053f220f admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:42.579130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b71c8-be22-4c57-8c09-cb1a053f220f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:42.581091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b71c8-be22-4c57-8c09-cb1a053f220f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:42.649812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c319c-4cca-4570-af85-27713daed83a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:42.650689 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3675/7385] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:42 2022] POST /identity/v3/projects => generated 369 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:42.672674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c319c-4cca-4570-af85-27713daed83a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:42.815951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f54d32-02dd-4b99-9daf-c6e800cf1ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:42.816855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f54d32-02dd-4b99-9daf-c6e800cf1ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:42.816855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f54d32-02dd-4b99-9daf-c6e800cf1ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:42.817263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f54d32-02dd-4b99-9daf-c6e800cf1ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:42.817768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f54d32-02dd-4b99-9daf-c6e800cf1ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:42.819863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f54d32-02dd-4b99-9daf-c6e800cf1ea0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:42.897333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b71c8-be22-4c57-8c09-cb1a053f220f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:42.898249 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3711/7386] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:42 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:42.919535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b71c8-be22-4c57-8c09-cb1a053f220f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:42.931107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba064d1-e0a4-49b3-b3c8-b2a0daeb0c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:42.936080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba064d1-e0a4-49b3-b3c8-b2a0daeb0c78 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:42.936514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba064d1-e0a4-49b3-b3c8-b2a0daeb0c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:42.936793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba064d1-e0a4-49b3-b3c8-b2a0daeb0c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:42.937602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba064d1-e0a4-49b3-b3c8-b2a0daeb0c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:42.946251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba064d1-e0a4-49b3-b3c8-b2a0daeb0c78 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:42.985189 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3676/7387] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:42.989420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f54d32-02dd-4b99-9daf-c6e800cf1ea0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:43.003355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f54d32-02dd-4b99-9daf-c6e800cf1ea0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:43.022058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fe54d-1355-48e2-b821-6cfc1a003d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:43.022778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fe54d-1355-48e2-b821-6cfc1a003d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:43.023066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fe54d-1355-48e2-b821-6cfc1a003d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:43.023340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fe54d-1355-48e2-b821-6cfc1a003d3f admin admin] PATH_INFO: `/v3/projects/d306022e00b64e4e9b3eb53b8402f580/users/7b9ed3e309e94146aa7d1cd44cdae75f/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:43.076124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fe54d-1355-48e2-b821-6cfc1a003d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d306022e00b64e4e9b3eb53b8402f580, user_id=7b9ed3e309e94146aa7d1cd44cdae75f, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:43.086046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8fe54d-1355-48e2-b821-6cfc1a003d3f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:43.128648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba064d1-e0a4-49b3-b3c8-b2a0daeb0c78 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:43.129090 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3712/7388] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:42 2022] PUT /identity/v3/projects/d306022e00b64e4e9b3eb53b8402f580/users/7b9ed3e309e94146aa7d1cd44cdae75f/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:43.141100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba064d1-e0a4-49b3-b3c8-b2a0daeb0c78 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:43.277644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee39f6c-aef5-4162-a305-7f48257299c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:43.278356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee39f6c-aef5-4162-a305-7f48257299c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:43.279551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee39f6c-aef5-4162-a305-7f48257299c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:43.279551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee39f6c-aef5-4162-a305-7f48257299c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:43.279551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee39f6c-aef5-4162-a305-7f48257299c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:43.286167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee39f6c-aef5-4162-a305-7f48257299c9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:43.320032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fe54d-1355-48e2-b821-6cfc1a003d3f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:43.329272 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3677/7389] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:43.338812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8fe54d-1355-48e2-b821-6cfc1a003d3f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:43.351450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d0f38-84e4-4da2-b49e-70216f76b041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:43.352150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d0f38-84e4-4da2-b49e-70216f76b041 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:43.352427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d0f38-84e4-4da2-b49e-70216f76b041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:43.352700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d0f38-84e4-4da2-b49e-70216f76b041 admin admin] PATH_INFO: `/v3/projects/d306022e00b64e4e9b3eb53b8402f580/users/7b9ed3e309e94146aa7d1cd44cdae75f/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:43.354760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d0f38-84e4-4da2-b49e-70216f76b041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d306022e00b64e4e9b3eb53b8402f580, user_id=7b9ed3e309e94146aa7d1cd44cdae75f, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:43.364879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d0f38-84e4-4da2-b49e-70216f76b041 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:43.399308 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3713/7390] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:43 2022] PUT /identity/v3/projects/d306022e00b64e4e9b3eb53b8402f580/users/7b9ed3e309e94146aa7d1cd44cdae75f/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:43.411605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c733cca-4f65-4ef2-b34c-6a1ade10d233 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:43.411945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c733cca-4f65-4ef2-b34c-6a1ade10d233 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:43.412163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c733cca-4f65-4ef2-b34c-6a1ade10d233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:43.443618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:43.466434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0c733cca-4f65-4ef2-b34c-6a1ade10d233 None None] MFA Rules not processed for user `7b9ed3e309e94146aa7d1cd44cdae75f`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:43.468581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0c733cca-4f65-4ef2-b34c-6a1ade10d233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:43.669775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d0f38-84e4-4da2-b49e-70216f76b041 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:43.672826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d52d0f38-84e4-4da2-b49e-70216f76b041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:43.691111 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3678/7391] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:43.693374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c733cca-4f65-4ef2-b34c-6a1ade10d233 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:43.764788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c733cca-4f65-4ef2-b34c-6a1ade10d233 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:43.790848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb359-3003-4431-84d2-3c8de6e7b495 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:43.793093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb359-3003-4431-84d2-3c8de6e7b495 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:43.793504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb359-3003-4431-84d2-3c8de6e7b495 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:43.793841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fb359-3003-4431-84d2-3c8de6e7b495 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:43.795237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fb359-3003-4431-84d2-3c8de6e7b495 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:43.801585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3fb359-3003-4431-84d2-3c8de6e7b495 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:43.878008 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3679/7392] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:47:43 2022] POST /identity/v3/projects => generated 328 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:43.882532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb359-3003-4431-84d2-3c8de6e7b495 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:43.888025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:43.980273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d0f38-84e4-4da2-b49e-70216f76b041 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:44.112901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fb359-3003-4431-84d2-3c8de6e7b495 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:44.130663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c19af-a43f-4c4a-b3eb-3e19a9a62a6b tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:44.133530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c19af-a43f-4c4a-b3eb-3e19a9a62a6b tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:44.133830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c19af-a43f-4c4a-b3eb-3e19a9a62a6b tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:44.135202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c19af-a43f-4c4a-b3eb-3e19a9a62a6b tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:44.135898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c19af-a43f-4c4a-b3eb-3e19a9a62a6b tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:44.142803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c19af-a43f-4c4a-b3eb-3e19a9a62a6b tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:44.208942 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3680/7393] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:43 2022] POST /identity/v3/users => generated 413 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:44.213284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c19af-a43f-4c4a-b3eb-3e19a9a62a6b tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:44.220349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7d8c19af-a43f-4c4a-b3eb-3e19a9a62a6b tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:44.244435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:44.245114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:44.245386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:44.245659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] PATH_INFO: `/v3/projects/bfd931acfb764bf588d127f6662f980f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:44.250094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd931acfb764bf588d127f6662f980f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:44.252523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:44.260553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c19af-a43f-4c4a-b3eb-3e19a9a62a6b tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:44.271886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:44.274074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:44.274421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:44.274949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] PATH_INFO: `/v3/users/c5c51e9e601a4ef985e5d3a7557db3ef` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:44.280405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c51e9e601a4ef985e5d3a7557db3ef)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:44.285604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:44.428400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c51e9e601a4ef985e5d3a7557db3ef'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:44.453472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd931acfb764bf588d127f6662f980f', 'request_id': 'req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:44.454282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c51e9e601a4ef985e5d3a7557db3ef'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:44.458735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:44.469533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd931acfb764bf588d127f6662f980f', 'request_id': 'req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:44.487615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c51e9e601a4ef985e5d3a7557db3ef'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:44.519759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd931acfb764bf588d127f6662f980f', 'request_id': 'req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:44.520637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c51e9e601a4ef985e5d3a7557db3ef'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:44.521684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c51e9e601a4ef985e5d3a7557db3ef'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:44.537975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] The token cache is being invalidate because project bfd931acfb764bf588d127f6662f980f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:44.537975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:44.538560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6c0fabd8-dd8f-4580-9e74-53ce3e62fc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:44.540168 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3681/7394] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:44 2022] DELETE /identity/v3/users/c5c51e9e601a4ef985e5d3a7557db3ef => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:44.544581 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3714/7395] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:43 2022] DELETE /identity/v3/projects/bfd931acfb764bf588d127f6662f980f => generated 0 bytes in 872 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:44.546118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1b21-ccef-43f7-8bd6-520cad9f6a57 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:44.546394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1b21-ccef-43f7-8bd6-520cad9f6a57 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:44.546731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1b21-ccef-43f7-8bd6-520cad9f6a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:44.547460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:44.555163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:44.599204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-157a1b21-ccef-43f7-8bd6-520cad9f6a57 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:44.602107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-157a1b21-ccef-43f7-8bd6-520cad9f6a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:44.752126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc82e86-621f-4d91-b639-865fe0f401f2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:44.764662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59cb5d-db71-47c4-a56c-7fe5c2247248 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:44.765456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59cb5d-db71-47c4-a56c-7fe5c2247248 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:44.765982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59cb5d-db71-47c4-a56c-7fe5c2247248 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:44.766392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59cb5d-db71-47c4-a56c-7fe5c2247248 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:44.771148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59cb5d-db71-47c4-a56c-7fe5c2247248 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:44.771623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59cb5d-db71-47c4-a56c-7fe5c2247248 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:44.817021 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3682/7396] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:47:44 2022] POST /identity/v3/roles => generated 243 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:44.821480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8045b5-593d-4b6e-8371-72909d73f3c9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:44.821748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8045b5-593d-4b6e-8371-72909d73f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:44.823170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8045b5-593d-4b6e-8371-72909d73f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:44.886958 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3715/7397] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:44.888010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1b21-ccef-43f7-8bd6-520cad9f6a57 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:44.895057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-157a1b21-ccef-43f7-8bd6-520cad9f6a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:44.909381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ed8045b5-593d-4b6e-8371-72909d73f3c9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:44.916180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ed8045b5-593d-4b6e-8371-72909d73f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:44.969091 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3683/7398] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:44.976316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1b21-ccef-43f7-8bd6-520cad9f6a57 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:44.977376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f7a5-cca3-43e7-b435-4809ea2d860d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:44.981722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f7a5-cca3-43e7-b435-4809ea2d860d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:44.982466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f7a5-cca3-43e7-b435-4809ea2d860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:45.004707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff197ac-84d7-45e5-b26c-e1e408147bf3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:45.006072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff197ac-84d7-45e5-b26c-e1e408147bf3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:45.008799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff197ac-84d7-45e5-b26c-e1e408147bf3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:45.010128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff197ac-84d7-45e5-b26c-e1e408147bf3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:45.018346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff197ac-84d7-45e5-b26c-e1e408147bf3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:45.028382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff197ac-84d7-45e5-b26c-e1e408147bf3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:45.072152 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3716/7399] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:47:44 2022] POST /identity/v3/roles => generated 247 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:45.072152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff197ac-84d7-45e5-b26c-e1e408147bf3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:45.076469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fff197ac-84d7-45e5-b26c-e1e408147bf3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:45.090977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fab7f7a5-cca3-43e7-b435-4809ea2d860d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:45.092460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fab7f7a5-cca3-43e7-b435-4809ea2d860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:45.105044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:45.132041 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3684/7400] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:45.132041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f7a5-cca3-43e7-b435-4809ea2d860d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:45.176865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f7a5-cca3-43e7-b435-4809ea2d860d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:45.194057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac46b-371d-48b5-9b23-57bd55143bd7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:45.194900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac46b-371d-48b5-9b23-57bd55143bd7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:45.195903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac46b-371d-48b5-9b23-57bd55143bd7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:45.196853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ac46b-371d-48b5-9b23-57bd55143bd7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/9550b2cce109495e82641bc2eba8f315/users/0d7077fccd454292a321981ef48b0369/roles/b526ac78f74449c0bd65b5f694dd3459` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:45.257345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ac46b-371d-48b5-9b23-57bd55143bd7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9550b2cce109495e82641bc2eba8f315, user_id=0d7077fccd454292a321981ef48b0369, role_id=b526ac78f74449c0bd65b5f694dd3459)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:45.266450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ac46b-371d-48b5-9b23-57bd55143bd7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:45.308358 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3685/7401] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:45 2022] PUT /identity/v3/projects/9550b2cce109495e82641bc2eba8f315/users/0d7077fccd454292a321981ef48b0369/roles/b526ac78f74449c0bd65b5f694dd3459 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:45.313906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac46b-371d-48b5-9b23-57bd55143bd7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:45.380539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff197ac-84d7-45e5-b26c-e1e408147bf3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:45.506467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3c14-ebd9-4411-85d7-04ff6ca2d050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:45.508470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3c14-ebd9-4411-85d7-04ff6ca2d050 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:45.508776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3c14-ebd9-4411-85d7-04ff6ca2d050 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:45.509050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b3c14-ebd9-4411-85d7-04ff6ca2d050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:45.684098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ac46b-371d-48b5-9b23-57bd55143bd7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:45.707382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec759f-b494-4709-bc90-022ed14fb8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:45.708031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec759f-b494-4709-bc90-022ed14fb8ee admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:45.708304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec759f-b494-4709-bc90-022ed14fb8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:45.708568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec759f-b494-4709-bc90-022ed14fb8ee admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:45.719062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec759f-b494-4709-bc90-022ed14fb8ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:47:45.719437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec759f-b494-4709-bc90-022ed14fb8ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:45.721256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec759f-b494-4709-bc90-022ed14fb8ee admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:45.730738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b3c14-ebd9-4411-85d7-04ff6ca2d050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:45.737123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b3c14-ebd9-4411-85d7-04ff6ca2d050 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:45.767110 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3686/7402] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:45.769016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec759f-b494-4709-bc90-022ed14fb8ee admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:45.778725 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3717/7403] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:45.779914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3c14-ebd9-4411-85d7-04ff6ca2d050 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:45.802794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b3c14-ebd9-4411-85d7-04ff6ca2d050 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:45.812403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0811b-7103-4f33-b0c4-7997dc3ac645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:45.815153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0811b-7103-4f33-b0c4-7997dc3ac645 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:45.815665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0811b-7103-4f33-b0c4-7997dc3ac645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:45.816110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0811b-7103-4f33-b0c4-7997dc3ac645 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:45.817076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0811b-7103-4f33-b0c4-7997dc3ac645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:45.820238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0811b-7103-4f33-b0c4-7997dc3ac645 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:45.847838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:45.919095 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3718/7404] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:45 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:45.923766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0811b-7103-4f33-b0c4-7997dc3ac645 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:45.963772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec759f-b494-4709-bc90-022ed14fb8ee admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:46.099199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:46.126322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0811b-7103-4f33-b0c4-7997dc3ac645 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:46.142806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad7a59-fa65-4bb5-9152-1457b8cf4bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:46.145609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad7a59-fa65-4bb5-9152-1457b8cf4bfb admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:46.145956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad7a59-fa65-4bb5-9152-1457b8cf4bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:46.146298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad7a59-fa65-4bb5-9152-1457b8cf4bfb admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:46.146978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad7a59-fa65-4bb5-9152-1457b8cf4bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:46.151620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad7a59-fa65-4bb5-9152-1457b8cf4bfb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:46.211140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a898d-5cc4-40b5-8460-9421643003c4 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:46.215021 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3719/7405] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:45 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:46.215142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a898d-5cc4-40b5-8460-9421643003c4 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:46.215142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a898d-5cc4-40b5-8460-9421643003c4 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:46.215142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a898d-5cc4-40b5-8460-9421643003c4 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/9550b2cce109495e82641bc2eba8f315/users/0d7077fccd454292a321981ef48b0369/roles/5a4781398053475da2726bd73b51dd28` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:46.216686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a898d-5cc4-40b5-8460-9421643003c4 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9550b2cce109495e82641bc2eba8f315, user_id=0d7077fccd454292a321981ef48b0369, role_id=5a4781398053475da2726bd73b51dd28)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:46.216899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad7a59-fa65-4bb5-9152-1457b8cf4bfb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:46.219766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a898d-5cc4-40b5-8460-9421643003c4 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:46.243999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad7a59-fa65-4bb5-9152-1457b8cf4bfb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:46.257818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21286803-66e6-4bf9-8690-efdcdbbf59b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:46.260641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21286803-66e6-4bf9-8690-efdcdbbf59b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:46.261015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21286803-66e6-4bf9-8690-efdcdbbf59b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:46.261303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21286803-66e6-4bf9-8690-efdcdbbf59b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:46.262334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21286803-66e6-4bf9-8690-efdcdbbf59b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:46.269164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21286803-66e6-4bf9-8690-efdcdbbf59b5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:46.275637 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3687/7406] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:45 2022] PUT /identity/v3/projects/9550b2cce109495e82641bc2eba8f315/users/0d7077fccd454292a321981ef48b0369/roles/5a4781398053475da2726bd73b51dd28 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:46.280579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a898d-5cc4-40b5-8460-9421643003c4 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:46.287001 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3720/7407] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:46 2022] GET /identity/v3/roles => generated 1892 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:46.290757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21286803-66e6-4bf9-8690-efdcdbbf59b5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:46.304564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21286803-66e6-4bf9-8690-efdcdbbf59b5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:46.464948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a898d-5cc4-40b5-8460-9421643003c4 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:46.477228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34132c56-9ce4-4350-ab70-a6cd59f3d124 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:46.479327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09ca4c-80cb-4080-ba37-1d52483e609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:46.479887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34132c56-9ce4-4350-ab70-a6cd59f3d124 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:46.480483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34132c56-9ce4-4350-ab70-a6cd59f3d124 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:46.481382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ca4c-80cb-4080-ba37-1d52483e609b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:46.481834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34132c56-9ce4-4350-ab70-a6cd59f3d124 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:46.482921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34132c56-9ce4-4350-ab70-a6cd59f3d124 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:46.483376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ca4c-80cb-4080-ba37-1d52483e609b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:46.483821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09ca4c-80cb-4080-ba37-1d52483e609b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:46.486657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09ca4c-80cb-4080-ba37-1d52483e609b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:46.488527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34132c56-9ce4-4350-ab70-a6cd59f3d124 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:46.489658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09ca4c-80cb-4080-ba37-1d52483e609b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:46.529597 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3721/7408] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:46 2022] GET /identity/v3/roles => generated 1892 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:47:46.534994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09ca4c-80cb-4080-ba37-1d52483e609b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:46.556562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09ca4c-80cb-4080-ba37-1d52483e609b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:46.571742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f71a3-6520-4b86-9f2a-8b91b531e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:46.572000 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3688/7409] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:46 2022] GET /identity/v3/users => generated 8030 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:46.572605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f71a3-6520-4b86-9f2a-8b91b531e7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:46.572889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f71a3-6520-4b86-9f2a-8b91b531e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:46.573164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f71a3-6520-4b86-9f2a-8b91b531e7e3 admin admin] PATH_INFO: `/v3/projects/6d5bbcb86f0f4b57bc982115e7579802/users/0a9edf409f064ddf8a0c0973c7b56040/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:46.576355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee5de7-1d90-4193-ab29-fbb59273663d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:46.577939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee5de7-1d90-4193-ab29-fbb59273663d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:46.579233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee5de7-1d90-4193-ab29-fbb59273663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:46.626810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f71a3-6520-4b86-9f2a-8b91b531e7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5bbcb86f0f4b57bc982115e7579802, user_id=0a9edf409f064ddf8a0c0973c7b56040, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:46.644556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f71a3-6520-4b86-9f2a-8b91b531e7e3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:46.677942 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3722/7410] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:46 2022] PUT /identity/v3/projects/6d5bbcb86f0f4b57bc982115e7579802/users/0a9edf409f064ddf8a0c0973c7b56040/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:46.690620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d44b2-216a-41f7-a884-c9770285403a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:46.690749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d44b2-216a-41f7-a884-c9770285403a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:46.690958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d44b2-216a-41f7-a884-c9770285403a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:46.713662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-64ee5de7-1d90-4193-ab29-fbb59273663d None None] MFA Rules not processed for user `0d7077fccd454292a321981ef48b0369`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:46.719136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-64ee5de7-1d90-4193-ab29-fbb59273663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:46.772645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d54d44b2-216a-41f7-a884-c9770285403a None None] MFA Rules not processed for user `0a9edf409f064ddf8a0c0973c7b56040`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:46.775024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d54d44b2-216a-41f7-a884-c9770285403a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:46.824423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:46.887685 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3689/7411] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:46 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:46.891591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc09f8-670f-4849-a9df-168a4754939a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:46.891888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc09f8-670f-4849-a9df-168a4754939a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:46.892185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc09f8-670f-4849-a9df-168a4754939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:46.940407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-24fc09f8-670f-4849-a9df-168a4754939a None None] MFA Rules not processed for user `0d7077fccd454292a321981ef48b0369`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:46.942674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24fc09f8-670f-4849-a9df-168a4754939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:46.944824 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3723/7412] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:46.948838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d44b2-216a-41f7-a884-c9770285403a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:46.990396 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3690/7413] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:46 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:46.993241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc09f8-670f-4849-a9df-168a4754939a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:47.018083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc09f8-670f-4849-a9df-168a4754939a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:47.032107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15619e0-d80e-4a7b-a5e3-0addceaf6b16 tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d7077fccd454292a321981ef48b0369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9550b2cce109495e82641bc2eba8f315', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1558493039', 'tempest-DelegatedRole-626405309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:47.032808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15619e0-d80e-4a7b-a5e3-0addceaf6b16 tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:47.035545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15619e0-d80e-4a7b-a5e3-0addceaf6b16 tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:47.037228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15619e0-d80e-4a7b-a5e3-0addceaf6b16 tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:47.039423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15619e0-d80e-4a7b-a5e3-0addceaf6b16 tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] RBAC: Authorizing `identity:create_trust()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:47.043953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15619e0-d80e-4a7b-a5e3-0addceaf6b16 tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:47.079484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:47.144902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d44b2-216a-41f7-a884-c9770285403a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:47.151782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2ccf0-0816-474d-83e6-4bc57e046cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:47.152047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2ccf0-0816-474d-83e6-4bc57e046cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:47.152332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2ccf0-0816-474d-83e6-4bc57e046cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:47.152602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2ccf0-0816-474d-83e6-4bc57e046cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:47.154504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2ccf0-0816-474d-83e6-4bc57e046cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:47.160902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2ccf0-0816-474d-83e6-4bc57e046cc2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:47.261411 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3724/7415] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:46 2022] POST /identity/v3/projects => generated 375 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:47.263573 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3691/7414] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Aug 30 04:47:46 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:47.264986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15619e0-d80e-4a7b-a5e3-0addceaf6b16 tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:47.266284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2ccf0-0816-474d-83e6-4bc57e046cc2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:47.427077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15619e0-d80e-4a7b-a5e3-0addceaf6b16 tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:47.438058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2ccf0-0816-474d-83e6-4bc57e046cc2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:47.460731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc9706-918d-4bc9-82d3-0ae273275fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:47.461559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc9706-918d-4bc9-82d3-0ae273275fbd admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:47.462018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc9706-918d-4bc9-82d3-0ae273275fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:47.462468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc9706-918d-4bc9-82d3-0ae273275fbd admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:47.463303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc9706-918d-4bc9-82d3-0ae273275fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:47.465453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc9706-918d-4bc9-82d3-0ae273275fbd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:47.530748 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3725/7416] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:47 2022] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:47.536739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc9706-918d-4bc9-82d3-0ae273275fbd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:47.543690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a4bc9706-918d-4bc9-82d3-0ae273275fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:47.603159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc9706-918d-4bc9-82d3-0ae273275fbd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:47.609731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4094c52-83a8-49c7-af4c-e798a6c2e8fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:47.610284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4094c52-83a8-49c7-af4c-e798a6c2e8fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:47.611898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4094c52-83a8-49c7-af4c-e798a6c2e8fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:47.612611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4094c52-83a8-49c7-af4c-e798a6c2e8fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:47.614476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4094c52-83a8-49c7-af4c-e798a6c2e8fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:47.616827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:47.618279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:47.618982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:47.619406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] PATH_INFO: `/v3/projects/710a7453647447728ab3f0a6be2424af` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:47.623837 n-d-820368-36 devstack@keystone.service[82099]: WARNING py.warnings [None req-a4094c52-83a8-49c7-af4c-e798a6c2e8fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 04:47:47.623837 n-d-820368-36 devstack@keystone.service[82099]: warnings.warn(msg) Aug 30 04:47:47.623837 n-d-820368-36 devstack@keystone.service[82099]: Aug 30 04:47:47.627421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4094c52-83a8-49c7-af4c-e798a6c2e8fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:47.634424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710a7453647447728ab3f0a6be2424af)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:47.637978 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3692/7417] 10.222.0.43 () {58 vars in 1155 bytes} [Tue Aug 30 04:47:47 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:47.639010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4094c52-83a8-49c7-af4c-e798a6c2e8fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:47.647444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:47.654394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4094c52-83a8-49c7-af4c-e798a6c2e8fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:47.659937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058c08-52c3-48fe-88d1-5197fb2c5c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:47.660584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058c08-52c3-48fe-88d1-5197fb2c5c53 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:47.660842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058c08-52c3-48fe-88d1-5197fb2c5c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:47.661110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e058c08-52c3-48fe-88d1-5197fb2c5c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:47.661950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e058c08-52c3-48fe-88d1-5197fb2c5c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:47.664133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e058c08-52c3-48fe-88d1-5197fb2c5c53 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:47.682206 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3693/7418] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:47 2022] GET /identity/v3/roles => generated 1892 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:47.688411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058c08-52c3-48fe-88d1-5197fb2c5c53 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:47.696112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:47.758591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710a7453647447728ab3f0a6be2424af', 'request_id': 'req-4faaab84-b03a-4410-807d-c226682229b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:47.769467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710a7453647447728ab3f0a6be2424af', 'request_id': 'req-4faaab84-b03a-4410-807d-c226682229b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:47.785385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710a7453647447728ab3f0a6be2424af', 'request_id': 'req-4faaab84-b03a-4410-807d-c226682229b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:47.801824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] The token cache is being invalidate because project 710a7453647447728ab3f0a6be2424af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:47.802188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:47.802960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:47.805778 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3726/7419] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:47 2022] DELETE /identity/v3/projects/710a7453647447728ab3f0a6be2424af => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:47.807625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:47.808955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:47.836086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e058c08-52c3-48fe-88d1-5197fb2c5c53 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:47.871843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:47.961906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d7077fccd454292a321981ef48b0369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9550b2cce109495e82641bc2eba8f315', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1558493039', 'tempest-DelegatedRole-626405309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:47.962571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:47.962852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:47.963126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] PATH_INFO: `/v3/OS-TRUST/trusts/4108f88f1bd84e358fa86fbf3dbf0d3d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:47.966931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faaab84-b03a-4410-807d-c226682229b7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:47.987832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] RBAC: Authorizing `identity:delete_trust(trust_id=4108f88f1bd84e358fa86fbf3dbf0d3d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:47.990396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530f581-3e91-468a-823c-285943f5583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:47.991045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530f581-3e91-468a-823c-285943f5583d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:47.991325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530f581-3e91-468a-823c-285943f5583d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:47.991599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530f581-3e91-468a-823c-285943f5583d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:47.992275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530f581-3e91-468a-823c-285943f5583d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:47.994089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530f581-3e91-468a-823c-285943f5583d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:47.995779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:48.022437 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3727/7420] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:47 2022] GET /identity/v3/roles => generated 1892 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:48.023531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530f581-3e91-468a-823c-285943f5583d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:48.029780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a530f581-3e91-468a-823c-285943f5583d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:48.045485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4108f88f1bd84e358fa86fbf3dbf0d3d', 'request_id': 'req-e2842606-1586-4263-889f-57649d69bf9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:48.046587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '4108f88f1bd84e358fa86fbf3dbf0d3d', 'request_id': 'req-e2842606-1586-4263-889f-57649d69bf9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:48.060800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530f581-3e91-468a-823c-285943f5583d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:48.069403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4108f88f1bd84e358fa86fbf3dbf0d3d', 'request_id': 'req-e2842606-1586-4263-889f-57649d69bf9c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:48.075089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:48.076633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:48.076977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:48.077355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] PATH_INFO: `/v3/users/ef8aa98c42df4bfcad3515369c316478` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:48.080206 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3694/7421] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Aug 30 04:47:47 2022] DELETE /identity/v3/OS-TRUST/trusts/4108f88f1bd84e358fa86fbf3dbf0d3d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:48.080828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8aa98c42df4bfcad3515369c316478)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:48.081129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:48.082839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:48.091493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:48.124021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2842606-1586-4263-889f-57649d69bf9c tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:48.135258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06205f-2eb5-4c49-99c5-83bcd4dde41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:48.136084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06205f-2eb5-4c49-99c5-83bcd4dde41f admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:48.136407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06205f-2eb5-4c49-99c5-83bcd4dde41f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:48.136738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06205f-2eb5-4c49-99c5-83bcd4dde41f admin admin] PATH_INFO: `/v3/projects/53eb4b0dff2d48f3a6c872d573ea8e24/users/e10035f5d7814d6b9b98b921e38184e0/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:48.174180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06205f-2eb5-4c49-99c5-83bcd4dde41f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53eb4b0dff2d48f3a6c872d573ea8e24, user_id=e10035f5d7814d6b9b98b921e38184e0, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:48.175066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06205f-2eb5-4c49-99c5-83bcd4dde41f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:48.211486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8aa98c42df4bfcad3515369c316478'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:48.212610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8aa98c42df4bfcad3515369c316478'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:48.220936 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3695/7422] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:48 2022] PUT /identity/v3/projects/53eb4b0dff2d48f3a6c872d573ea8e24/users/e10035f5d7814d6b9b98b921e38184e0/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:48.227217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8aa98c42df4bfcad3515369c316478'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:48.233806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06205f-2eb5-4c49-99c5-83bcd4dde41f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:48.241829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8aa98c42df4bfcad3515369c316478'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:48.251132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7e06205f-2eb5-4c49-99c5-83bcd4dde41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:48.271394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-478871d3-9d42-4808-a2bc-f9649c9f9c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8aa98c42df4bfcad3515369c316478'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:48.288957 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3728/7423] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:48 2022] DELETE /identity/v3/users/ef8aa98c42df4bfcad3515369c316478 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:48.290942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2762472-4692-4c3a-8f06-cbced1787447 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:48.294064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2762472-4692-4c3a-8f06-cbced1787447 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:48.294585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2762472-4692-4c3a-8f06-cbced1787447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:48.379682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d2762472-4692-4c3a-8f06-cbced1787447 None None] MFA Rules not processed for user `e10035f5d7814d6b9b98b921e38184e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:48.381214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d2762472-4692-4c3a-8f06-cbced1787447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:48.428971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06205f-2eb5-4c49-99c5-83bcd4dde41f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:48.445113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:48.474074 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3729/7424] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:48.478372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2762472-4692-4c3a-8f06-cbced1787447 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:48.481274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d2762472-4692-4c3a-8f06-cbced1787447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:48.585566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6499e4-d36f-4c4d-aa2f-c59b10afc40b tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d7077fccd454292a321981ef48b0369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9550b2cce109495e82641bc2eba8f315', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1558493039', 'tempest-DelegatedRole-626405309'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:48.586266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6499e4-d36f-4c4d-aa2f-c59b10afc40b tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:48.586545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6499e4-d36f-4c4d-aa2f-c59b10afc40b tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:48.587292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6499e4-d36f-4c4d-aa2f-c59b10afc40b tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] PATH_INFO: `/v3/OS-TRUST/trusts/4108f88f1bd84e358fa86fbf3dbf0d3d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:48.597206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-fd6499e4-d36f-4c4d-aa2f-c59b10afc40b tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Could not find trust: 4108f88f1bd84e358fa86fbf3dbf0d3d.: keystone.exception.TrustNotFound: Could not find trust: 4108f88f1bd84e358fa86fbf3dbf0d3d. Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 30 04:47:48.648261 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 4108f88f1bd84e358fa86fbf3dbf0d3d. Aug 30 04:47:48.649257 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:48.650127 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3696/7425] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:47:48 2022] GET /identity/v3/OS-TRUST/trusts/4108f88f1bd84e358fa86fbf3dbf0d3d => generated 111 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:47:48.653695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6499e4-d36f-4c4d-aa2f-c59b10afc40b tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:48.655705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fd6499e4-d36f-4c4d-aa2f-c59b10afc40b tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:48.734781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2762472-4692-4c3a-8f06-cbced1787447 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:48.751811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa9f40-2821-46b8-85b2-99574d14ed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:48.752455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa9f40-2821-46b8-85b2-99574d14ed19 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:48.752791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa9f40-2821-46b8-85b2-99574d14ed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:48.753073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa9f40-2821-46b8-85b2-99574d14ed19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:48.754036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa9f40-2821-46b8-85b2-99574d14ed19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:48.755999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aa9f40-2821-46b8-85b2-99574d14ed19 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:48.851379 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3730/7426] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:48 2022] POST /identity/v3/projects => generated 375 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:48.855251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa9f40-2821-46b8-85b2-99574d14ed19 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:48.877262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6499e4-d36f-4c4d-aa2f-c59b10afc40b tempest-TrustsV3TestJSON-291669466 tempest-user-962648393] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:49.007099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa9f40-2821-46b8-85b2-99574d14ed19 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:49.015971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:49.019394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:49.019902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:49.020410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/5a4781398053475da2726bd73b51dd28` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:49.022485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5a4781398053475da2726bd73b51dd28)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:49.025672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:49.027735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7c04c-93eb-4ac2-84f7-8bdf42bdd538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:49.028388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7c04c-93eb-4ac2-84f7-8bdf42bdd538 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:49.028664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7c04c-93eb-4ac2-84f7-8bdf42bdd538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:49.028934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7c04c-93eb-4ac2-84f7-8bdf42bdd538 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:49.029589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7c04c-93eb-4ac2-84f7-8bdf42bdd538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:49.037602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7c04c-93eb-4ac2-84f7-8bdf42bdd538 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:49.088628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role 5a4781398053475da2726bd73b51dd28 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:49.089103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:49.091444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:49.098217 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3697/7427] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:48 2022] DELETE /identity/v3/roles/5a4781398053475da2726bd73b51dd28 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:49.098430 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3731/7428] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:48 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:47:49.106720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7c04c-93eb-4ac2-84f7-8bdf42bdd538 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:49.108754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:49.110417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-00e7c04c-93eb-4ac2-84f7-8bdf42bdd538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:49.126091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:49.148222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7c04c-93eb-4ac2-84f7-8bdf42bdd538 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:49.236934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:49.322589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af400743-ca55-4f5c-aae5-8cae36ec34a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:49.337999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:49.339072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:49.339357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:49.339637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/b526ac78f74449c0bd65b5f694dd3459` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:49.342279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b526ac78f74449c0bd65b5f694dd3459)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:49.344271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:49.356887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b23ae3-5b16-45ea-822b-0eec6b74fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:49.358361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b23ae3-5b16-45ea-822b-0eec6b74fbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:49.358802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b23ae3-5b16-45ea-822b-0eec6b74fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:49.359303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b23ae3-5b16-45ea-822b-0eec6b74fbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:49.360412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b23ae3-5b16-45ea-822b-0eec6b74fbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:49.368530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b23ae3-5b16-45ea-822b-0eec6b74fbd9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:49.390594 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3732/7429] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:49 2022] GET /identity/v3/roles => generated 1654 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:47:49.395734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b23ae3-5b16-45ea-822b-0eec6b74fbd9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:49.409734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b23ae3-5b16-45ea-822b-0eec6b74fbd9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:49.422735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5504cb6-b1d2-45fb-bb6a-82b0b42ead63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:49.423562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5504cb6-b1d2-45fb-bb6a-82b0b42ead63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:49.423840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5504cb6-b1d2-45fb-bb6a-82b0b42ead63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:49.424107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5504cb6-b1d2-45fb-bb6a-82b0b42ead63 admin admin] PATH_INFO: `/v3/projects/9c936b4d09a04cbda81b46dba4fab000/users/a9caa8fe79cf4b7f81b4a3482c961663/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:49.462856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role b526ac78f74449c0bd65b5f694dd3459 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:49.463158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:49.464877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:49.468008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5504cb6-b1d2-45fb-bb6a-82b0b42ead63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c936b4d09a04cbda81b46dba4fab000, user_id=a9caa8fe79cf4b7f81b4a3482c961663, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:49.471076 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3698/7430] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:49 2022] DELETE /identity/v3/roles/b526ac78f74449c0bd65b5f694dd3459 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:49.472101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:49.473019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5504cb6-b1d2-45fb-bb6a-82b0b42ead63 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:49.473658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:49.510335 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3733/7431] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:49 2022] PUT /identity/v3/projects/9c936b4d09a04cbda81b46dba4fab000/users/a9caa8fe79cf4b7f81b4a3482c961663/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:49.514872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5504cb6-b1d2-45fb-bb6a-82b0b42ead63 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:49.516971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b5504cb6-b1d2-45fb-bb6a-82b0b42ead63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:49.596363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:49.679621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf1ee0-0191-4460-98a8-2c47493b72c1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:49.758319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5504cb6-b1d2-45fb-bb6a-82b0b42ead63 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:49.774504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1ae8f-8f81-4696-9acf-77a84d015ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:49.775168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1ae8f-8f81-4696-9acf-77a84d015ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:49.775446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1ae8f-8f81-4696-9acf-77a84d015ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:49.775812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1ae8f-8f81-4696-9acf-77a84d015ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:49.776624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1ae8f-8f81-4696-9acf-77a84d015ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:49.780380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1ae8f-8f81-4696-9acf-77a84d015ca3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:49.823713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:49.824348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:49.824658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:49.824898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users/0d7077fccd454292a321981ef48b0369` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:49.830571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0d7077fccd454292a321981ef48b0369)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:49.832984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:49.834311 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3734/7432] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:49.835334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1ae8f-8f81-4696-9acf-77a84d015ca3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:49.880640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1ae8f-8f81-4696-9acf-77a84d015ca3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:49.914629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89172fc-eb23-475a-b5db-c37d29df2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:49.915408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89172fc-eb23-475a-b5db-c37d29df2097 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:49.916076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89172fc-eb23-475a-b5db-c37d29df2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:49.916076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89172fc-eb23-475a-b5db-c37d29df2097 admin admin] PATH_INFO: `/v3/projects/9c936b4d09a04cbda81b46dba4fab000/users/a9caa8fe79cf4b7f81b4a3482c961663/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:49.922938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89172fc-eb23-475a-b5db-c37d29df2097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c936b4d09a04cbda81b46dba4fab000, user_id=a9caa8fe79cf4b7f81b4a3482c961663, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:49.926274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89172fc-eb23-475a-b5db-c37d29df2097 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:49.964776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:49.970277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7077fccd454292a321981ef48b0369'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:49.970480 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3735/7433] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:49 2022] PUT /identity/v3/projects/9c936b4d09a04cbda81b46dba4fab000/users/a9caa8fe79cf4b7f81b4a3482c961663/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:49.980815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70f439-95bf-4cba-b42b-e317c997a8a7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:49.981245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70f439-95bf-4cba-b42b-e317c997a8a7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:49.981622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70f439-95bf-4cba-b42b-e317c997a8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:49.990918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7077fccd454292a321981ef48b0369'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:50.040054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7077fccd454292a321981ef48b0369'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:50.066549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7077fccd454292a321981ef48b0369'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:50.067371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7077fccd454292a321981ef48b0369'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:50.088560 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3699/7434] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:49 2022] DELETE /identity/v3/users/0d7077fccd454292a321981ef48b0369 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:50.089717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-dd70f439-95bf-4cba-b42b-e317c997a8a7 None None] MFA Rules not processed for user `a9caa8fe79cf4b7f81b4a3482c961663`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:50.091185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dd70f439-95bf-4cba-b42b-e317c997a8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:50.093020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:50.096791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:50.285642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1efb1-f03b-4920-bb66-8ee3046c4426 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:50.313885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:50.318719 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3736/7435] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:50.318877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:50.318877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:50.318877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/9550b2cce109495e82641bc2eba8f315` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:50.318877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9550b2cce109495e82641bc2eba8f315)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:50.326217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:50.330024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70f439-95bf-4cba-b42b-e317c997a8a7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:50.332975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dd70f439-95bf-4cba-b42b-e317c997a8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:50.452029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9550b2cce109495e82641bc2eba8f315', 'request_id': 'req-839e10e8-0178-43e3-9f93-96179103bcf1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:50.471440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9550b2cce109495e82641bc2eba8f315', 'request_id': 'req-839e10e8-0178-43e3-9f93-96179103bcf1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:50.478881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9550b2cce109495e82641bc2eba8f315', 'request_id': 'req-839e10e8-0178-43e3-9f93-96179103bcf1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:50.479863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70f439-95bf-4cba-b42b-e317c997a8a7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:50.503962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] The token cache is being invalidate because project 9550b2cce109495e82641bc2eba8f315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:50.504653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:50.510115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:50.512590 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3700/7436] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:50 2022] DELETE /identity/v3/projects/9550b2cce109495e82641bc2eba8f315 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:50.518555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:50.520331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:50.543807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:50.562558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e141e4-9ca7-4efa-a35a-fdef5364b4e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:50.564119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e141e4-9ca7-4efa-a35a-fdef5364b4e2 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:50.564862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e141e4-9ca7-4efa-a35a-fdef5364b4e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:50.564862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e141e4-9ca7-4efa-a35a-fdef5364b4e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:50.567225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-53e141e4-9ca7-4efa-a35a-fdef5364b4e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:50.618131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:50.643174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e10e8-0178-43e3-9f93-96179103bcf1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:50.654524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e141e4-9ca7-4efa-a35a-fdef5364b4e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:50.656380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e141e4-9ca7-4efa-a35a-fdef5364b4e2 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:50.662573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b66680-e824-465e-bfd6-62d164e48ddc tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:50.663536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b66680-e824-465e-bfd6-62d164e48ddc tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:50.664071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b66680-e824-465e-bfd6-62d164e48ddc tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:50.664575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b66680-e824-465e-bfd6-62d164e48ddc tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:50.666723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b66680-e824-465e-bfd6-62d164e48ddc tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:50.671603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b66680-e824-465e-bfd6-62d164e48ddc tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:50.687756 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3737/7437] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:50.775329 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3701/7438] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:47:50 2022] POST /identity/v3/projects => generated 328 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:50.779312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e141e4-9ca7-4efa-a35a-fdef5364b4e2 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:50.803107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e141e4-9ca7-4efa-a35a-fdef5364b4e2 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:50.991834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee455f-749e-46b0-98de-faa0ae605a94 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:50.991834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee455f-749e-46b0-98de-faa0ae605a94 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:50.992812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee455f-749e-46b0-98de-faa0ae605a94 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:50.992812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee455f-749e-46b0-98de-faa0ae605a94 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:50.994425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee455f-749e-46b0-98de-faa0ae605a94 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:51.008097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee455f-749e-46b0-98de-faa0ae605a94 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:51.076184 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3738/7439] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:50 2022] POST /identity/v3/users => generated 413 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:51.079189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b66680-e824-465e-bfd6-62d164e48ddc tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:51.099436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b66680-e824-465e-bfd6-62d164e48ddc tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:51.118256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8582-cb2c-4229-b68f-1716919d9509 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:51.119575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8582-cb2c-4229-b68f-1716919d9509 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:51.119904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8582-cb2c-4229-b68f-1716919d9509 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:51.120154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8582-cb2c-4229-b68f-1716919d9509 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:51.120878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f8582-cb2c-4229-b68f-1716919d9509 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:51.122612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f8582-cb2c-4229-b68f-1716919d9509 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:51.188736 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3702/7440] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:47:51 2022] POST /identity/v3/roles => generated 244 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:51.190423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee455f-749e-46b0-98de-faa0ae605a94 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:51.236666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee455f-749e-46b0-98de-faa0ae605a94 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:51.268218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eef1d-cb7e-4f8a-a05c-1889bbe29607 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:51.268412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eef1d-cb7e-4f8a-a05c-1889bbe29607 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:51.268652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eef1d-cb7e-4f8a-a05c-1889bbe29607 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:51.268919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eef1d-cb7e-4f8a-a05c-1889bbe29607 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:51.269594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697eef1d-cb7e-4f8a-a05c-1889bbe29607 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:51.272018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697eef1d-cb7e-4f8a-a05c-1889bbe29607 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:51.343502 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3739/7441] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:47:51 2022] POST /identity/v3/roles => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:51.345166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8582-cb2c-4229-b68f-1716919d9509 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:51.362322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8582-cb2c-4229-b68f-1716919d9509 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:51.377317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e804-49bb-4c07-b958-19078ca5b46e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:51.378103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e804-49bb-4c07-b958-19078ca5b46e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:51.378540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e804-49bb-4c07-b958-19078ca5b46e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:51.378954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e804-49bb-4c07-b958-19078ca5b46e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/6a4be10a79734b4a84526c0d5b172d49/users/08f087c6cf344518bc962b58d0c412f8/roles/7ddf4bbe7fbd44c0a6aa7c2a9ee99cec` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:51.397561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eef1d-cb7e-4f8a-a05c-1889bbe29607 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:51.399412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-697eef1d-cb7e-4f8a-a05c-1889bbe29607 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:51.465301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78e804-49bb-4c07-b958-19078ca5b46e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6a4be10a79734b4a84526c0d5b172d49, user_id=08f087c6cf344518bc962b58d0c412f8, role_id=7ddf4bbe7fbd44c0a6aa7c2a9ee99cec)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:51.488207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78e804-49bb-4c07-b958-19078ca5b46e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:51.559305 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3703/7442] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:51 2022] PUT /identity/v3/projects/6a4be10a79734b4a84526c0d5b172d49/users/08f087c6cf344518bc962b58d0c412f8/roles/7ddf4bbe7fbd44c0a6aa7c2a9ee99cec => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:51.568425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e804-49bb-4c07-b958-19078ca5b46e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:51.585541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eef1d-cb7e-4f8a-a05c-1889bbe29607 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:51.616570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:51.726699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:51.728358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:51.728649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:51.731403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] PATH_INFO: `/v3/projects/6d0e100694fb4123b543b2b9b739e918` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:51.733715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d0e100694fb4123b543b2b9b739e918)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:51.736732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:51.757795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e804-49bb-4c07-b958-19078ca5b46e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:51.772552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14790f-6c90-481f-8fc5-16c97ea0bc9d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:51.773385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14790f-6c90-481f-8fc5-16c97ea0bc9d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:51.773804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14790f-6c90-481f-8fc5-16c97ea0bc9d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:51.774439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc14790f-6c90-481f-8fc5-16c97ea0bc9d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/6a4be10a79734b4a84526c0d5b172d49/users/08f087c6cf344518bc962b58d0c412f8/roles/cc53fceff0674adea10c727e31a2df44` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:51.787861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14790f-6c90-481f-8fc5-16c97ea0bc9d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6a4be10a79734b4a84526c0d5b172d49, user_id=08f087c6cf344518bc962b58d0c412f8, role_id=cc53fceff0674adea10c727e31a2df44)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:51.803024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc14790f-6c90-481f-8fc5-16c97ea0bc9d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:51.848492 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3704/7443] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:51 2022] PUT /identity/v3/projects/6a4be10a79734b4a84526c0d5b172d49/users/08f087c6cf344518bc962b58d0c412f8/roles/cc53fceff0674adea10c727e31a2df44 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:51.849543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14790f-6c90-481f-8fc5-16c97ea0bc9d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:51.921899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d0e100694fb4123b543b2b9b739e918', 'request_id': 'req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:51.934495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d0e100694fb4123b543b2b9b739e918', 'request_id': 'req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:51.955653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d0e100694fb4123b543b2b9b739e918', 'request_id': 'req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:51.969840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] The token cache is being invalidate because project 6d0e100694fb4123b543b2b9b739e918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:51.970162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:51.974890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c4bcf21d-e16a-4ddc-a942-9452cb2ce5ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:51.978153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc14790f-6c90-481f-8fc5-16c97ea0bc9d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:51.980294 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3740/7444] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:51 2022] DELETE /identity/v3/projects/6d0e100694fb4123b543b2b9b739e918 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:47:51.985148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1424d-c96b-4a81-b5cb-89feb2dd90c2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:51.985483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1424d-c96b-4a81-b5cb-89feb2dd90c2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:51.985763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1424d-c96b-4a81-b5cb-89feb2dd90c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:52.027914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8af1424d-c96b-4a81-b5cb-89feb2dd90c2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:52.029290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8af1424d-c96b-4a81-b5cb-89feb2dd90c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:52.091516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:52.156961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4f6a5-ef3c-4c2c-8836-78e4b90e4d37 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:52.157997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4f6a5-ef3c-4c2c-8836-78e4b90e4d37 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:52.158685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4f6a5-ef3c-4c2c-8836-78e4b90e4d37 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:52.160619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4f6a5-ef3c-4c2c-8836-78e4b90e4d37 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:52.162068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4f6a5-ef3c-4c2c-8836-78e4b90e4d37 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:52.169209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac4f6a5-ef3c-4c2c-8836-78e4b90e4d37 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:52.192509 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3741/7445] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:52.201928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524102-d646-47c1-b3b5-9700e2c78962 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:52.202221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524102-d646-47c1-b3b5-9700e2c78962 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:52.202497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4524102-d646-47c1-b3b5-9700e2c78962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:52.268610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b4524102-d646-47c1-b3b5-9700e2c78962 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:52.272594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b4524102-d646-47c1-b3b5-9700e2c78962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:52.277593 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3705/7446] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:51 2022] GET /identity/v3/users => generated 8307 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:52.285266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa031c-01d5-4ed0-8bc5-8befe441042a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:52.285576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa031c-01d5-4ed0-8bc5-8befe441042a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:52.285829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa031c-01d5-4ed0-8bc5-8befe441042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:52.302564 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3742/7447] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:52.310928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4524102-d646-47c1-b3b5-9700e2c78962 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:52.340294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4524102-d646-47c1-b3b5-9700e2c78962 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:52.363066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1861d10-f6d9-4f7b-b9c0-577b6f533755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:52.363706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1861d10-f6d9-4f7b-b9c0-577b6f533755 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:52.363982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1861d10-f6d9-4f7b-b9c0-577b6f533755 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:52.364247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1861d10-f6d9-4f7b-b9c0-577b6f533755 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:52.364909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1861d10-f6d9-4f7b-b9c0-577b6f533755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:47:52.365209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1861d10-f6d9-4f7b-b9c0-577b6f533755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:52.372965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1861d10-f6d9-4f7b-b9c0-577b6f533755 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:52.414372 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3743/7448] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:52.417517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-59aa031c-01d5-4ed0-8bc5-8befe441042a None None] MFA Rules not processed for user `08f087c6cf344518bc962b58d0c412f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:52.418608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1861d10-f6d9-4f7b-b9c0-577b6f533755 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:52.422897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-59aa031c-01d5-4ed0-8bc5-8befe441042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:52.454414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1861d10-f6d9-4f7b-b9c0-577b6f533755 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:52.485605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896f73c-71c3-48a1-999b-f55b61b0de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:52.489318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896f73c-71c3-48a1-999b-f55b61b0de48 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:52.489948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896f73c-71c3-48a1-999b-f55b61b0de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:52.490204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896f73c-71c3-48a1-999b-f55b61b0de48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:52.499368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896f73c-71c3-48a1-999b-f55b61b0de48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:52.510200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896f73c-71c3-48a1-999b-f55b61b0de48 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:52.607983 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3744/7449] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:52 2022] POST /identity/v3/projects => generated 377 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:52.609145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896f73c-71c3-48a1-999b-f55b61b0de48 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:52.645153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:52.707683 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3706/7450] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:52 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:52.717422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d6b3-f1c4-427b-905c-2bce8794f10d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:52.717864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d6b3-f1c4-427b-905c-2bce8794f10d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:52.718316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d6b3-f1c4-427b-905c-2bce8794f10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:52.779101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4533d6b3-f1c4-427b-905c-2bce8794f10d None None] MFA Rules not processed for user `08f087c6cf344518bc962b58d0c412f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:52.783557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4533d6b3-f1c4-427b-905c-2bce8794f10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:52.826358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896f73c-71c3-48a1-999b-f55b61b0de48 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:52.833316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fef89-3165-4125-aa51-81d28eaac299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:52.834231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fef89-3165-4125-aa51-81d28eaac299 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:52.834766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fef89-3165-4125-aa51-81d28eaac299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:52.835593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8fef89-3165-4125-aa51-81d28eaac299 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:52.836515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fef89-3165-4125-aa51-81d28eaac299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:52.840468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8fef89-3165-4125-aa51-81d28eaac299 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:52.887465 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3745/7451] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:52 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:52.890997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fef89-3165-4125-aa51-81d28eaac299 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:52.914299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8fef89-3165-4125-aa51-81d28eaac299 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:52.927702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a5fc1-bc87-471c-a337-451816ff4e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:52.929732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5fc1-bc87-471c-a337-451816ff4e01 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:52.931275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5fc1-bc87-471c-a337-451816ff4e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:52.931920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a5fc1-bc87-471c-a337-451816ff4e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:52.933984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a5fc1-bc87-471c-a337-451816ff4e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:52.938057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a5fc1-bc87-471c-a337-451816ff4e01 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:52.967633 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3707/7452] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:52 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:52.968469 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3746/7453] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:52 2022] GET /identity/v3/roles => generated 1892 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:47:52.972704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d6b3-f1c4-427b-905c-2bce8794f10d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:52.974376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a5fc1-bc87-471c-a337-451816ff4e01 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:53.008102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d6b3-f1c4-427b-905c-2bce8794f10d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:53.011134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a5fc1-bc87-471c-a337-451816ff4e01 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:53.023822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e7473-b889-45a6-9df9-43d9e0e90aeb tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f087c6cf344518bc962b58d0c412f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4be10a79734b4a84526c0d5b172d49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-554762120', 'tempest-DelegatedRole-1955128334'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:53.026130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e7473-b889-45a6-9df9-43d9e0e90aeb tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:53.026410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e7473-b889-45a6-9df9-43d9e0e90aeb tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:53.026682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e7473-b889-45a6-9df9-43d9e0e90aeb tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:53.027372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e7473-b889-45a6-9df9-43d9e0e90aeb tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] RBAC: Authorizing `identity:create_trust()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:53.028578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e7473-b889-45a6-9df9-43d9e0e90aeb tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:53.035566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac4f18-f457-441e-9b6f-20885c842881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:53.039905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac4f18-f457-441e-9b6f-20885c842881 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:53.040313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac4f18-f457-441e-9b6f-20885c842881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:53.040594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac4f18-f457-441e-9b6f-20885c842881 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:53.041731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac4f18-f457-441e-9b6f-20885c842881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:53.048945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac4f18-f457-441e-9b6f-20885c842881 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:53.094646 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3747/7454] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:52 2022] GET /identity/v3/roles => generated 1892 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:53.099694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac4f18-f457-441e-9b6f-20885c842881 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:53.142540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac4f18-f457-441e-9b6f-20885c842881 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:53.161827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654e9fa-1d6a-4ff2-a945-e03c748682a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:53.163031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654e9fa-1d6a-4ff2-a945-e03c748682a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:53.163344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654e9fa-1d6a-4ff2-a945-e03c748682a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:53.163707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654e9fa-1d6a-4ff2-a945-e03c748682a0 admin admin] PATH_INFO: `/v3/projects/2f91248afab74b77b8d0da11d028ba8d/users/b767f81f74494ce1a92cd23c48c94abc/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:53.241392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654e9fa-1d6a-4ff2-a945-e03c748682a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f91248afab74b77b8d0da11d028ba8d, user_id=b767f81f74494ce1a92cd23c48c94abc, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:53.256722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654e9fa-1d6a-4ff2-a945-e03c748682a0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:53.300688 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3748/7455] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:53 2022] PUT /identity/v3/projects/2f91248afab74b77b8d0da11d028ba8d/users/b767f81f74494ce1a92cd23c48c94abc/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:53.301196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:53.311954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69eddc-cc31-4e34-8940-7452d5efe0a2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:53.312408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69eddc-cc31-4e34-8940-7452d5efe0a2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:53.312625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69eddc-cc31-4e34-8940-7452d5efe0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:53.353482 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3708/7456] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Aug 30 04:47:52 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:53.357643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e7473-b889-45a6-9df9-43d9e0e90aeb tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:53.393260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e7473-b889-45a6-9df9-43d9e0e90aeb tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:53.422843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7f69eddc-cc31-4e34-8940-7452d5efe0a2 None None] MFA Rules not processed for user `b767f81f74494ce1a92cd23c48c94abc`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:53.424091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7f69eddc-cc31-4e34-8940-7452d5efe0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:53.548890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2c5de-5a6b-4890-92c6-e9f1b6fb9cff tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f087c6cf344518bc962b58d0c412f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4be10a79734b4a84526c0d5b172d49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-554762120', 'tempest-DelegatedRole-1955128334'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:53.549853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2c5de-5a6b-4890-92c6-e9f1b6fb9cff tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:53.550310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2c5de-5a6b-4890-92c6-e9f1b6fb9cff tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:53.550844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2c5de-5a6b-4890-92c6-e9f1b6fb9cff tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:53.551785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2c5de-5a6b-4890-92c6-e9f1b6fb9cff tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:53.553635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2c5de-5a6b-4890-92c6-e9f1b6fb9cff tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:53.561109 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3709/7457] 10.222.0.43 () {58 vars in 1252 bytes} [Tue Aug 30 04:47:53 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=08f087c6cf344518bc962b58d0c412f8 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:53.565170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2c5de-5a6b-4890-92c6-e9f1b6fb9cff tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:53.580715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2c5de-5a6b-4890-92c6-e9f1b6fb9cff tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:53.586590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f087c6cf344518bc962b58d0c412f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4be10a79734b4a84526c0d5b172d49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-554762120', 'tempest-DelegatedRole-1955128334'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:53.587807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:53.588260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:53.588812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] PATH_INFO: `/v3/OS-TRUST/trusts/6b5ae84e0f684ebb9cea944452ee2f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:53.599038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] RBAC: Authorizing `identity:delete_trust(trust_id=6b5ae84e0f684ebb9cea944452ee2f95)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:53.600274 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3749/7458] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:53.601226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69eddc-cc31-4e34-8940-7452d5efe0a2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:53.601611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:53.628982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6b5ae84e0f684ebb9cea944452ee2f95', 'request_id': 'req-b40136d9-07b9-4f3e-9a72-98946fbc2071'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:53.630387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6b5ae84e0f684ebb9cea944452ee2f95', 'request_id': 'req-b40136d9-07b9-4f3e-9a72-98946fbc2071'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:53.653635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6b5ae84e0f684ebb9cea944452ee2f95', 'request_id': 'req-b40136d9-07b9-4f3e-9a72-98946fbc2071'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:53.672935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3710/7459] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Aug 30 04:47:53 2022] DELETE /identity/v3/OS-TRUST/trusts/6b5ae84e0f684ebb9cea944452ee2f95 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:53.676730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:53.680591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:53.698633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40136d9-07b9-4f3e-9a72-98946fbc2071 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:53.703307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cfec0-43d9-40a8-95c2-1e15f366a2e0 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08f087c6cf344518bc962b58d0c412f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a4be10a79734b4a84526c0d5b172d49', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-554762120', 'tempest-DelegatedRole-1955128334'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:53.704651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cfec0-43d9-40a8-95c2-1e15f366a2e0 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:53.704931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cfec0-43d9-40a8-95c2-1e15f366a2e0 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:53.705361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cfec0-43d9-40a8-95c2-1e15f366a2e0 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] PATH_INFO: `/v3/OS-TRUST/trusts/6b5ae84e0f684ebb9cea944452ee2f95` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:53.718530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-928cfec0-43d9-40a8-95c2-1e15f366a2e0 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Could not find trust: 6b5ae84e0f684ebb9cea944452ee2f95.: keystone.exception.TrustNotFound: Could not find trust: 6b5ae84e0f684ebb9cea944452ee2f95. Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 30 04:47:53.726800 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6b5ae84e0f684ebb9cea944452ee2f95. Aug 30 04:47:53.728023 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:53.728955 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3711/7460] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:47:53 2022] GET /identity/v3/OS-TRUST/trusts/6b5ae84e0f684ebb9cea944452ee2f95 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:47:53.734771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cfec0-43d9-40a8-95c2-1e15f366a2e0 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:53.736553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-928cfec0-43d9-40a8-95c2-1e15f366a2e0 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:53.798607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69eddc-cc31-4e34-8940-7452d5efe0a2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:53.816601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09f71b-9582-483f-b61d-e6bdc3de5d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:53.817242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09f71b-9582-483f-b61d-e6bdc3de5d5b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:53.817517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09f71b-9582-483f-b61d-e6bdc3de5d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:53.817786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09f71b-9582-483f-b61d-e6bdc3de5d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:53.818465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09f71b-9582-483f-b61d-e6bdc3de5d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:53.820416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09f71b-9582-483f-b61d-e6bdc3de5d5b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:53.895539 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3750/7461] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:47:53 2022] POST /identity/v3/projects => generated 377 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:53.896670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09f71b-9582-483f-b61d-e6bdc3de5d5b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:53.904840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-be09f71b-9582-483f-b61d-e6bdc3de5d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:53.934778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cfec0-43d9-40a8-95c2-1e15f366a2e0 tempest-TrustsV3TestJSON-953904431 tempest-user-997189406] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:54.025360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=3,keystone:SELECT=95,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:54.042615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:54.043612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:54.044461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:54.045088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/cc53fceff0674adea10c727e31a2df44` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:54.049190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cc53fceff0674adea10c727e31a2df44)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:54.053544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:54.077163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09f71b-9582-483f-b61d-e6bdc3de5d5b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:54.097425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc483c-44b7-4932-bd19-9c2bf01df4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:54.098654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc483c-44b7-4932-bd19-9c2bf01df4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:54.098934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc483c-44b7-4932-bd19-9c2bf01df4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:54.099498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc483c-44b7-4932-bd19-9c2bf01df4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:54.099915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc483c-44b7-4932-bd19-9c2bf01df4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:54.108808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc483c-44b7-4932-bd19-9c2bf01df4c4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:54.141406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role cc53fceff0674adea10c727e31a2df44 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:54.141833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:54.142791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:54.150965 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3712/7462] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:53 2022] DELETE /identity/v3/roles/cc53fceff0674adea10c727e31a2df44 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:54.155140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:54.158885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:54.167548 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3751/7463] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:53 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:47:54.174033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc483c-44b7-4932-bd19-9c2bf01df4c4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:54.175600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f4fc483c-44b7-4932-bd19-9c2bf01df4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:54.213978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc483c-44b7-4932-bd19-9c2bf01df4c4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:54.351062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa9156-2e92-41a7-aceb-56a8e759d028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:54.351735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa9156-2e92-41a7-aceb-56a8e759d028 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:54.351972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa9156-2e92-41a7-aceb-56a8e759d028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:54.352228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa9156-2e92-41a7-aceb-56a8e759d028 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:54.352921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa9156-2e92-41a7-aceb-56a8e759d028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:54.356766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb451d8-55cf-4dd6-aaed-97b66f2ac749 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:54.357967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa9156-2e92-41a7-aceb-56a8e759d028 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:54.382888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:54.383955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:54.384248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:54.384528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/7ddf4bbe7fbd44c0a6aa7c2a9ee99cec` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:54.388064 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3752/7464] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:54 2022] GET /identity/v3/roles => generated 1655 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:47:54.388964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa9156-2e92-41a7-aceb-56a8e759d028 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:54.391215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7ddf4bbe7fbd44c0a6aa7c2a9ee99cec)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:54.392881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:54.403160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa9156-2e92-41a7-aceb-56a8e759d028 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:54.413399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e593f-5af1-4c6d-8602-477bce6fd0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:54.414101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e593f-5af1-4c6d-8602-477bce6fd0c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:54.414375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e593f-5af1-4c6d-8602-477bce6fd0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:54.414645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e593f-5af1-4c6d-8602-477bce6fd0c2 admin admin] PATH_INFO: `/v3/projects/c078617f744e40f883770e2a96175551/users/7de54a791aab44999c499345f55f89b7/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:54.462245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e593f-5af1-4c6d-8602-477bce6fd0c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c078617f744e40f883770e2a96175551, user_id=7de54a791aab44999c499345f55f89b7, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:54.469431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e593f-5af1-4c6d-8602-477bce6fd0c2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:54.489145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role 7ddf4bbe7fbd44c0a6aa7c2a9ee99cec has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:54.489466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:54.490133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:54.495758 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3713/7465] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:54 2022] DELETE /identity/v3/roles/7ddf4bbe7fbd44c0a6aa7c2a9ee99cec => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:54.498032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:54.499738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:54.511896 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3753/7466] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:54 2022] PUT /identity/v3/projects/c078617f744e40f883770e2a96175551/users/7de54a791aab44999c499345f55f89b7/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:54.521493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e593f-5af1-4c6d-8602-477bce6fd0c2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:54.523434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6d4e593f-5af1-4c6d-8602-477bce6fd0c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:54.668276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:54.690710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937875-3759-4b83-9cd8-085f423290b8 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:54.697991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:54.698821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:54.699249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:54.699689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users/08f087c6cf344518bc962b58d0c412f8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:54.701035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_user(user_id=08f087c6cf344518bc962b58d0c412f8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:54.703228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:54.746083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:54.746324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e593f-5af1-4c6d-8602-477bce6fd0c2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:54.794265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f087c6cf344518bc962b58d0c412f8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:54.808842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f087c6cf344518bc962b58d0c412f8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:54.830388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f087c6cf344518bc962b58d0c412f8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:54.852980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f087c6cf344518bc962b58d0c412f8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:54.855554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f087c6cf344518bc962b58d0c412f8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:54.882164 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3714/7467] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:54 2022] DELETE /identity/v3/users/08f087c6cf344518bc962b58d0c412f8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:54.884929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:54.888669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:54.929376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281ca7f-b863-49c4-a45b-1a4f72f9a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:54.930067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281ca7f-b863-49c4-a45b-1a4f72f9a36a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:54.930355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281ca7f-b863-49c4-a45b-1a4f72f9a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:54.930614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c281ca7f-b863-49c4-a45b-1a4f72f9a36a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:54.932213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281ca7f-b863-49c4-a45b-1a4f72f9a36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:54.936746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c281ca7f-b863-49c4-a45b-1a4f72f9a36a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:54.975397 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3754/7468] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:54.978905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281ca7f-b863-49c4-a45b-1a4f72f9a36a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:54.988909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c281ca7f-b863-49c4-a45b-1a4f72f9a36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:55.027859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c281ca7f-b863-49c4-a45b-1a4f72f9a36a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:55.174667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092996b7-5dce-4239-b974-9322ef5ffc7d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:55.190282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:55.191001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:55.196380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:55.196380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/6a4be10a79734b4a84526c0d5b172d49` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:55.198284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a4be10a79734b4a84526c0d5b172d49)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:55.205047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:55.275586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba865a-11e9-4f12-a3e6-98d540fe6806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:55.279130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba865a-11e9-4f12-a3e6-98d540fe6806 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:55.279130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba865a-11e9-4f12-a3e6-98d540fe6806 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:55.280684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba865a-11e9-4f12-a3e6-98d540fe6806 admin admin] PATH_INFO: `/v3/projects/c078617f744e40f883770e2a96175551/users/7de54a791aab44999c499345f55f89b7/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:55.287127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba865a-11e9-4f12-a3e6-98d540fe6806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c078617f744e40f883770e2a96175551, user_id=7de54a791aab44999c499345f55f89b7, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:55.292435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba865a-11e9-4f12-a3e6-98d540fe6806 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:55.316447 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3755/7469] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:54 2022] PUT /identity/v3/projects/c078617f744e40f883770e2a96175551/users/7de54a791aab44999c499345f55f89b7/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:55.317828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba865a-11e9-4f12-a3e6-98d540fe6806 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:55.319812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-54ba865a-11e9-4f12-a3e6-98d540fe6806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:55.410107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4be10a79734b4a84526c0d5b172d49', 'request_id': 'req-d70bc060-7a85-42e9-ae13-2131686c4eec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:55.447143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4be10a79734b4a84526c0d5b172d49', 'request_id': 'req-d70bc060-7a85-42e9-ae13-2131686c4eec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:55.483174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4be10a79734b4a84526c0d5b172d49', 'request_id': 'req-d70bc060-7a85-42e9-ae13-2131686c4eec'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:55.534182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba865a-11e9-4f12-a3e6-98d540fe6806 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:55.547339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] The token cache is being invalidate because project 6a4be10a79734b4a84526c0d5b172d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:55.547548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:55.556962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d70bc060-7a85-42e9-ae13-2131686c4eec tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:55.564487 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3715/7470] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:47:54 2022] DELETE /identity/v3/projects/6a4be10a79734b4a84526c0d5b172d49 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:55.565210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c348fe-986d-451f-9499-6da679b246d5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:55.565504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c348fe-986d-451f-9499-6da679b246d5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:55.565781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c348fe-986d-451f-9499-6da679b246d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:55.599793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:55.678985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-32c348fe-986d-451f-9499-6da679b246d5 None None] MFA Rules not processed for user `7de54a791aab44999c499345f55f89b7`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:55.680264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-32c348fe-986d-451f-9499-6da679b246d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:55.724014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217621d9-de27-4d4f-af04-ad0ff369385a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:55.724832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217621d9-de27-4d4f-af04-ad0ff369385a service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:55.727628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217621d9-de27-4d4f-af04-ad0ff369385a service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:55.728849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217621d9-de27-4d4f-af04-ad0ff369385a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:55.735900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-217621d9-de27-4d4f-af04-ad0ff369385a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:55.780852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:55.926463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217621d9-de27-4d4f-af04-ad0ff369385a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:55.931439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217621d9-de27-4d4f-af04-ad0ff369385a service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:55.957164 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3716/7471] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:55.959334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c348fe-986d-451f-9499-6da679b246d5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:55.961178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-32c348fe-986d-451f-9499-6da679b246d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:55.976694 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3756/7472] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:56.091713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217621d9-de27-4d4f-af04-ad0ff369385a service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:56.093304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-217621d9-de27-4d4f-af04-ad0ff369385a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:56.117296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217621d9-de27-4d4f-af04-ad0ff369385a service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:56.143062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186492a-d299-4588-a886-e0f5d0d1dad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:56.143730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186492a-d299-4588-a886-e0f5d0d1dad6 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:56.144048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186492a-d299-4588-a886-e0f5d0d1dad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:56.146340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186492a-d299-4588-a886-e0f5d0d1dad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:56.153053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7186492a-d299-4588-a886-e0f5d0d1dad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:56.183650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c348fe-986d-451f-9499-6da679b246d5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:56.193545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a103e65-77ad-4c6b-82c4-aa83fd46357e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:56.195315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a103e65-77ad-4c6b-82c4-aa83fd46357e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:56.195602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a103e65-77ad-4c6b-82c4-aa83fd46357e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:56.195951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a103e65-77ad-4c6b-82c4-aa83fd46357e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:56.196521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a103e65-77ad-4c6b-82c4-aa83fd46357e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:56.198875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a103e65-77ad-4c6b-82c4-aa83fd46357e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:56.262934 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3717/7473] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:47:55 2022] POST /identity/v3/projects => generated 328 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:56.267942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a103e65-77ad-4c6b-82c4-aa83fd46357e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:56.421031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186492a-d299-4588-a886-e0f5d0d1dad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:56.430764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186492a-d299-4588-a886-e0f5d0d1dad6 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:56.496268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a103e65-77ad-4c6b-82c4-aa83fd46357e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:56.504788 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3757/7474] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:56.540060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc17ce-6eb3-4b44-ba2e-632203faf9d9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:56.542764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc17ce-6eb3-4b44-ba2e-632203faf9d9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:56.545891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc17ce-6eb3-4b44-ba2e-632203faf9d9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:56.551203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc17ce-6eb3-4b44-ba2e-632203faf9d9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:56.554119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc17ce-6eb3-4b44-ba2e-632203faf9d9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:56.572472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc17ce-6eb3-4b44-ba2e-632203faf9d9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:56.689868 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3718/7475] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:47:56 2022] POST /identity/v3/users => generated 413 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:56.696850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186492a-d299-4588-a886-e0f5d0d1dad6 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:56.731477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186492a-d299-4588-a886-e0f5d0d1dad6 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:56.751537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f184a87-117d-4058-8e12-87dbe453a08c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:56.752923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f184a87-117d-4058-8e12-87dbe453a08c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:56.756330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f184a87-117d-4058-8e12-87dbe453a08c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:56.758317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f184a87-117d-4058-8e12-87dbe453a08c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:56.759851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f184a87-117d-4058-8e12-87dbe453a08c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:56.776248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f184a87-117d-4058-8e12-87dbe453a08c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:56.822240 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3758/7476] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:47:56 2022] POST /identity/v3/roles => generated 243 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:47:56.822850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc17ce-6eb3-4b44-ba2e-632203faf9d9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:56.841376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc17ce-6eb3-4b44-ba2e-632203faf9d9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:56.850524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea101c0-0333-42e9-9d3f-703f0859869c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:56.851732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea101c0-0333-42e9-9d3f-703f0859869c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:56.851732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea101c0-0333-42e9-9d3f-703f0859869c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:56.852518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea101c0-0333-42e9-9d3f-703f0859869c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:56.853475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea101c0-0333-42e9-9d3f-703f0859869c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:56.855530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea101c0-0333-42e9-9d3f-703f0859869c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:56.894734 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3719/7477] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:47:56 2022] POST /identity/v3/roles => generated 247 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:47:56.894988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f184a87-117d-4058-8e12-87dbe453a08c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:56.931092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f184a87-117d-4058-8e12-87dbe453a08c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:56.968553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea7079-24ca-4aaa-9102-9822d4d04bba tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:56.969347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7079-24ca-4aaa-9102-9822d4d04bba tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:56.969644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7079-24ca-4aaa-9102-9822d4d04bba tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:56.969937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7079-24ca-4aaa-9102-9822d4d04bba tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/5f797fb9d22647529a1536d490b76074/users/f5767e4eb4ff424592c92ed45410d473/roles/ed42b8bcfd7f4c9c897ac614da583582` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:57.057927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea7079-24ca-4aaa-9102-9822d4d04bba tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5f797fb9d22647529a1536d490b76074, user_id=f5767e4eb4ff424592c92ed45410d473, role_id=ed42b8bcfd7f4c9c897ac614da583582)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:57.060837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea7079-24ca-4aaa-9102-9822d4d04bba tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:57.110419 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3759/7478] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:56 2022] PUT /identity/v3/projects/5f797fb9d22647529a1536d490b76074/users/f5767e4eb4ff424592c92ed45410d473/roles/ed42b8bcfd7f4c9c897ac614da583582 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:57.114684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea101c0-0333-42e9-9d3f-703f0859869c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:57.142924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea101c0-0333-42e9-9d3f-703f0859869c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:57.182749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:57.368336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69772292-e3b8-425c-b420-7e9b5512e01c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:57.378746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772292-e3b8-425c-b420-7e9b5512e01c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:57.380621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772292-e3b8-425c-b420-7e9b5512e01c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:57.380991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69772292-e3b8-425c-b420-7e9b5512e01c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/5f797fb9d22647529a1536d490b76074/users/f5767e4eb4ff424592c92ed45410d473/roles/b5fb467289234485a73e50e003eab600` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:57.389772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69772292-e3b8-425c-b420-7e9b5512e01c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5f797fb9d22647529a1536d490b76074, user_id=f5767e4eb4ff424592c92ed45410d473, role_id=b5fb467289234485a73e50e003eab600)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:57.394699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69772292-e3b8-425c-b420-7e9b5512e01c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:57.430429 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3720/7479] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:47:57 2022] PUT /identity/v3/projects/5f797fb9d22647529a1536d490b76074/users/f5767e4eb4ff424592c92ed45410d473/roles/b5fb467289234485a73e50e003eab600 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:57.434261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea7079-24ca-4aaa-9102-9822d4d04bba tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:57.449841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea7079-24ca-4aaa-9102-9822d4d04bba tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:57.631506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69772292-e3b8-425c-b420-7e9b5512e01c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:57.633403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-69772292-e3b8-425c-b420-7e9b5512e01c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:57.664595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:57.759982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0da202-44fe-4354-87f9-3295e2b27505 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:57.760535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da202-44fe-4354-87f9-3295e2b27505 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:57.760948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da202-44fe-4354-87f9-3295e2b27505 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:57.761081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0da202-44fe-4354-87f9-3295e2b27505 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:57.766924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0da202-44fe-4354-87f9-3295e2b27505 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:57.770519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0da202-44fe-4354-87f9-3295e2b27505 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:57.776870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69772292-e3b8-425c-b420-7e9b5512e01c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:57.781460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078d0db-8cf7-4c7c-a714-a09f7bc2fe27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:57.782357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078d0db-8cf7-4c7c-a714-a09f7bc2fe27 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:57.783128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078d0db-8cf7-4c7c-a714-a09f7bc2fe27 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:57.783506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078d0db-8cf7-4c7c-a714-a09f7bc2fe27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:57.788754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3078d0db-8cf7-4c7c-a714-a09f7bc2fe27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:57.828284 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3760/7480] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:47:57 2022] GET /identity/v3/users => generated 8873 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:47:57.844218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656cf1-7afd-456e-b441-a885f44d636f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:57.846302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656cf1-7afd-456e-b441-a885f44d636f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:57.846658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656cf1-7afd-456e-b441-a885f44d636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:57.867298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078d0db-8cf7-4c7c-a714-a09f7bc2fe27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:57.868359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078d0db-8cf7-4c7c-a714-a09f7bc2fe27 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:57.897249 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3721/7481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:47:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:47:57.916036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-77656cf1-7afd-456e-b441-a885f44d636f None None] MFA Rules not processed for user `f5767e4eb4ff424592c92ed45410d473`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:57.917697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-77656cf1-7afd-456e-b441-a885f44d636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:58.012084 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3761/7482] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:57 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:47:58.022895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58105bed-e0af-46ad-923c-48fef3660b8c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:58.023378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58105bed-e0af-46ad-923c-48fef3660b8c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:58.023804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58105bed-e0af-46ad-923c-48fef3660b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:58.052011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-58105bed-e0af-46ad-923c-48fef3660b8c None None] MFA Rules not processed for user `f5767e4eb4ff424592c92ed45410d473`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:47:58.055284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-58105bed-e0af-46ad-923c-48fef3660b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:58.070939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77656cf1-7afd-456e-b441-a885f44d636f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:58.080504 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3722/7483] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:47:58 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:47:58.082230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77656cf1-7afd-456e-b441-a885f44d636f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:58.094567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1c203-6185-4640-a62f-83ece43911a7 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5767e4eb4ff424592c92ed45410d473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f797fb9d22647529a1536d490b76074', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-861701839', 'tempest-NotDelegatedRole-1804312209'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:58.094721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1c203-6185-4640-a62f-83ece43911a7 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:58.095002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1c203-6185-4640-a62f-83ece43911a7 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:58.095266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1c203-6185-4640-a62f-83ece43911a7 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:58.095942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1c203-6185-4640-a62f-83ece43911a7 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorizing `identity:create_trust()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:58.097114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1c203-6185-4640-a62f-83ece43911a7 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:58.305609 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3762/7484] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Aug 30 04:47:58 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:47:58.307161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58105bed-e0af-46ad-923c-48fef3660b8c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:58.320159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58105bed-e0af-46ad-923c-48fef3660b8c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:58.346766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a082a2-2039-48c1-80c6-a47e2a1e4cbb tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5767e4eb4ff424592c92ed45410d473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f797fb9d22647529a1536d490b76074', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-861701839', 'tempest-NotDelegatedRole-1804312209'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:58.351517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a082a2-2039-48c1-80c6-a47e2a1e4cbb tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:58.352705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a082a2-2039-48c1-80c6-a47e2a1e4cbb tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:58.354632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a082a2-2039-48c1-80c6-a47e2a1e4cbb tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] PATH_INFO: `/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:58.372251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a082a2-2039-48c1-80c6-a47e2a1e4cbb tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorizing `identity:get_trust(trust_id=fce5f01142064e7787bb50f70bbe0762)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:58.378215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a082a2-2039-48c1-80c6-a47e2a1e4cbb tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:58.400930 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3723/7485] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:47:58 2022] GET /identity/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762 => generated 858 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:58.405526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1c203-6185-4640-a62f-83ece43911a7 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:58.438008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1c203-6185-4640-a62f-83ece43911a7 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:58.453458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a50d9-0df3-420b-ab16-866b0ee04581 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5767e4eb4ff424592c92ed45410d473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f797fb9d22647529a1536d490b76074', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-861701839', 'tempest-NotDelegatedRole-1804312209'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:58.455734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a50d9-0df3-420b-ab16-866b0ee04581 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:58.458774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a50d9-0df3-420b-ab16-866b0ee04581 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:58.459090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a50d9-0df3-420b-ab16-866b0ee04581 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] PATH_INFO: `/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:58.491740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a50d9-0df3-420b-ab16-866b0ee04581 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=fce5f01142064e7787bb50f70bbe0762)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:58.496656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a50d9-0df3-420b-ab16-866b0ee04581 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:58.529022 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3763/7486] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Aug 30 04:47:58 2022] GET /identity/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762/roles => generated 370 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:58.533548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a082a2-2039-48c1-80c6-a47e2a1e4cbb tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:58.550729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a082a2-2039-48c1-80c6-a47e2a1e4cbb tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:58.569788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597e98d-e452-487e-9bb6-d2d37884cb66 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5767e4eb4ff424592c92ed45410d473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f797fb9d22647529a1536d490b76074', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-861701839', 'tempest-NotDelegatedRole-1804312209'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:58.574199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597e98d-e452-487e-9bb6-d2d37884cb66 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:58.575520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597e98d-e452-487e-9bb6-d2d37884cb66 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:58.575904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597e98d-e452-487e-9bb6-d2d37884cb66 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] PATH_INFO: `/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762/roles/ed42b8bcfd7f4c9c897ac614da583582` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:58.603122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597e98d-e452-487e-9bb6-d2d37884cb66 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fce5f01142064e7787bb50f70bbe0762, role_id=ed42b8bcfd7f4c9c897ac614da583582)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:58.609444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597e98d-e452-487e-9bb6-d2d37884cb66 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:58.651154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a50d9-0df3-420b-ab16-866b0ee04581 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:58.651595 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3724/7487] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Aug 30 04:47:58 2022] GET /identity/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762/roles/ed42b8bcfd7f4c9c897ac614da583582 => generated 243 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:47:58.672965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a50d9-0df3-420b-ab16-866b0ee04581 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:58.680146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b52b64-1138-4b03-ad12-beca889d8950 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5767e4eb4ff424592c92ed45410d473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f797fb9d22647529a1536d490b76074', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-861701839', 'tempest-NotDelegatedRole-1804312209'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:58.681211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b52b64-1138-4b03-ad12-beca889d8950 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] REQUEST_METHOD: `HEAD` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:58.682120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b52b64-1138-4b03-ad12-beca889d8950 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:58.682614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b52b64-1138-4b03-ad12-beca889d8950 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] PATH_INFO: `/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762/roles/ed42b8bcfd7f4c9c897ac614da583582` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:58.696789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b52b64-1138-4b03-ad12-beca889d8950 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fce5f01142064e7787bb50f70bbe0762, role_id=ed42b8bcfd7f4c9c897ac614da583582)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:58.699194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b52b64-1138-4b03-ad12-beca889d8950 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:58.712157 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3764/7488] 10.222.0.43 () {58 vars in 1369 bytes} [Tue Aug 30 04:47:58 2022] HEAD /identity/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762/roles/ed42b8bcfd7f4c9c897ac614da583582 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 30 04:47:58.716436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597e98d-e452-487e-9bb6-d2d37884cb66 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:58.731141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597e98d-e452-487e-9bb6-d2d37884cb66 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:58.748671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b635d7c-6a34-4d48-b2aa-5d3dbd8aca80 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5767e4eb4ff424592c92ed45410d473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f797fb9d22647529a1536d490b76074', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-861701839', 'tempest-NotDelegatedRole-1804312209'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:58.753981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b635d7c-6a34-4d48-b2aa-5d3dbd8aca80 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:58.754267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b635d7c-6a34-4d48-b2aa-5d3dbd8aca80 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:58.754542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b635d7c-6a34-4d48-b2aa-5d3dbd8aca80 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] PATH_INFO: `/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762/roles/b5fb467289234485a73e50e003eab600` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:58.782312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b635d7c-6a34-4d48-b2aa-5d3dbd8aca80 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fce5f01142064e7787bb50f70bbe0762, role_id=b5fb467289234485a73e50e003eab600)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:58.790346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b635d7c-6a34-4d48-b2aa-5d3dbd8aca80 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-6b635d7c-6a34-4d48-b2aa-5d3dbd8aca80 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Could not find role: b5fb467289234485a73e50e003eab600.: keystone.exception.RoleNotFound: Could not find role: b5fb467289234485a73e50e003eab600. Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:47:58.826979 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b5fb467289234485a73e50e003eab600. Aug 30 04:47:58.828136 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:47:58.838051 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3725/7489] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Aug 30 04:47:58 2022] GET /identity/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762/roles/b5fb467289234485a73e50e003eab600 => generated 110 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:47:58.839917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b52b64-1138-4b03-ad12-beca889d8950 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:58.856263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b52b64-1138-4b03-ad12-beca889d8950 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:58.867006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336547e-bde9-4000-9ac6-18d051cd7ced tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5767e4eb4ff424592c92ed45410d473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f797fb9d22647529a1536d490b76074', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-861701839', 'tempest-NotDelegatedRole-1804312209'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:58.867965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336547e-bde9-4000-9ac6-18d051cd7ced tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] REQUEST_METHOD: `HEAD` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:58.868252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336547e-bde9-4000-9ac6-18d051cd7ced tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:58.868607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336547e-bde9-4000-9ac6-18d051cd7ced tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] PATH_INFO: `/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762/roles/b5fb467289234485a73e50e003eab600` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:58.876323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:58.888302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336547e-bde9-4000-9ac6-18d051cd7ced tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorizing `identity:get_role_for_trust(trust_id=fce5f01142064e7787bb50f70bbe0762, role_id=b5fb467289234485a73e50e003eab600)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:58.891719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336547e-bde9-4000-9ac6-18d051cd7ced tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-6336547e-bde9-4000-9ac6-18d051cd7ced tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Could not find role: b5fb467289234485a73e50e003eab600.: keystone.exception.RoleNotFound: Could not find role: b5fb467289234485a73e50e003eab600. Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:47:58.913510 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b5fb467289234485a73e50e003eab600. Aug 30 04:47:58.914712 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:58.918852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b635d7c-6a34-4d48-b2aa-5d3dbd8aca80 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:58.922848 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3765/7490] 10.222.0.43 () {58 vars in 1369 bytes} [Tue Aug 30 04:47:58 2022] HEAD /identity/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762/roles/b5fb467289234485a73e50e003eab600 => generated 0 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:47:58.925740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:58.940024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b635d7c-6a34-4d48-b2aa-5d3dbd8aca80 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:58.953052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5767e4eb4ff424592c92ed45410d473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f797fb9d22647529a1536d490b76074', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-861701839', 'tempest-NotDelegatedRole-1804312209'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:58.954049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:58.954489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:58.954760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] PATH_INFO: `/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:58.971026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorizing `identity:delete_trust(trust_id=fce5f01142064e7787bb50f70bbe0762)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:58.972522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:59.051245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'fce5f01142064e7787bb50f70bbe0762', 'request_id': 'req-f382defb-124e-4234-92f1-039a7f23bf8f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:59.054460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'fce5f01142064e7787bb50f70bbe0762', 'request_id': 'req-f382defb-124e-4234-92f1-039a7f23bf8f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:59.088433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'fce5f01142064e7787bb50f70bbe0762', 'request_id': 'req-f382defb-124e-4234-92f1-039a7f23bf8f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:59.107149 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3726/7491] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Aug 30 04:47:58 2022] DELETE /identity/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:59.107347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336547e-bde9-4000-9ac6-18d051cd7ced tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:59.109302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6336547e-bde9-4000-9ac6-18d051cd7ced tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:59.145002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336547e-bde9-4000-9ac6-18d051cd7ced tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:59.162883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6628d7-a8f6-47a1-b50e-264324973686 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5767e4eb4ff424592c92ed45410d473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f797fb9d22647529a1536d490b76074', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-861701839', 'tempest-NotDelegatedRole-1804312209'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:59.178048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6628d7-a8f6-47a1-b50e-264324973686 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:59.179521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6628d7-a8f6-47a1-b50e-264324973686 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:59.180727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6628d7-a8f6-47a1-b50e-264324973686 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] PATH_INFO: `/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-4c6628d7-a8f6-47a1-b50e-264324973686 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Could not find trust: fce5f01142064e7787bb50f70bbe0762.: keystone.exception.TrustNotFound: Could not find trust: fce5f01142064e7787bb50f70bbe0762. Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 30 04:47:59.215498 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: fce5f01142064e7787bb50f70bbe0762. Aug 30 04:47:59.216527 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:47:59.226893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:59.228807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:59.236219 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3766/7492] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:47:59 2022] GET /identity/v3/OS-TRUST/trusts/fce5f01142064e7787bb50f70bbe0762 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:47:59.263518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382defb-124e-4234-92f1-039a7f23bf8f tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:59.274574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:59.275238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:59.275619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:59.275897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/b5fb467289234485a73e50e003eab600` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:59.277687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b5fb467289234485a73e50e003eab600)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:59.280022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:59.400681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role b5fb467289234485a73e50e003eab600 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:59.403566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:59.404660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:59.410231 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3727/7493] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:59 2022] DELETE /identity/v3/roles/b5fb467289234485a73e50e003eab600 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:59.415294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6628d7-a8f6-47a1-b50e-264324973686 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:59.417352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4c6628d7-a8f6-47a1-b50e-264324973686 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:47:59.447032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6628d7-a8f6-47a1-b50e-264324973686 tempest-TrustsV3TestJSON-997070306 tempest-user-721511750] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:59.626075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:59.626826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:59.627207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:59.631623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/ed42b8bcfd7f4c9c897ac614da583582` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:59.635414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ed42b8bcfd7f4c9c897ac614da583582)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:59.637490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:47:59.739818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role ed42b8bcfd7f4c9c897ac614da583582 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:47:59.740260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:59.741940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:47:59.748729 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3767/7494] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:59 2022] DELETE /identity/v3/roles/ed42b8bcfd7f4c9c897ac614da583582 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:47:59.749306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:47:59.771642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e754f-9d02-4560-a27b-bf6979dd0ac7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:47:59.983060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:47:59.983764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:47:59.984109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:47:59.984565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users/f5767e4eb4ff424592c92ed45410d473` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:47:59.985866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f5767e4eb4ff424592c92ed45410d473)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:47:59.988176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:00.109762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5767e4eb4ff424592c92ed45410d473'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:00.130833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5767e4eb4ff424592c92ed45410d473'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:00.174989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5767e4eb4ff424592c92ed45410d473'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:00.196653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5767e4eb4ff424592c92ed45410d473'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:00.197680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5767e4eb4ff424592c92ed45410d473'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:00.204868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:00.220023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3728/7495] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:47:59 2022] DELETE /identity/v3/users/f5767e4eb4ff424592c92ed45410d473 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:00.224651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:00.228600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:00.257805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b4caf-2fee-49a6-8e57-8866bbdbaf38 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:00.553686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:00.553686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:00.553686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:00.554088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/5f797fb9d22647529a1536d490b76074` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:00.556169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5f797fb9d22647529a1536d490b76074)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:00.558779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:00.675519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:UPDATE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:00.679847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f797fb9d22647529a1536d490b76074', 'request_id': 'req-1912ad7e-c92e-48d0-9af1-38ba208bf25c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:00.705612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f797fb9d22647529a1536d490b76074', 'request_id': 'req-1912ad7e-c92e-48d0-9af1-38ba208bf25c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:00.728561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f797fb9d22647529a1536d490b76074', 'request_id': 'req-1912ad7e-c92e-48d0-9af1-38ba208bf25c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:00.751943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] The token cache is being invalidate because project 5f797fb9d22647529a1536d490b76074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:00.754100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:00.755185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:00.767732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:00.769145 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3768/7496] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:00 2022] DELETE /identity/v3/projects/5f797fb9d22647529a1536d490b76074 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:00.770358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:00.798151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c4c94-2591-4dcd-a400-15e154718d57 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:00.943797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7675a13-00fe-493d-a958-a1f5f30b79fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:00.944506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675a13-00fe-493d-a958-a1f5f30b79fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:00.944786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675a13-00fe-493d-a958-a1f5f30b79fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:00.945059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675a13-00fe-493d-a958-a1f5f30b79fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:00.945704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7675a13-00fe-493d-a958-a1f5f30b79fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:00.947695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7675a13-00fe-493d-a958-a1f5f30b79fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:01.056966 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3729/7497] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:48:00 2022] POST /identity/v3/projects => generated 328 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:01.062477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:01.069581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:01.090044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912ad7e-c92e-48d0-9af1-38ba208bf25c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:01.232444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43562dbc-5b9c-4cac-b4a0-93a59c1e17d0 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:01.233131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43562dbc-5b9c-4cac-b4a0-93a59c1e17d0 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:01.234441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43562dbc-5b9c-4cac-b4a0-93a59c1e17d0 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:01.234950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43562dbc-5b9c-4cac-b4a0-93a59c1e17d0 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:01.235892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43562dbc-5b9c-4cac-b4a0-93a59c1e17d0 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:01.245222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43562dbc-5b9c-4cac-b4a0-93a59c1e17d0 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:01.319676 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3769/7498] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:48:01 2022] POST /identity/v3/users => generated 416 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:01.324161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7675a13-00fe-493d-a958-a1f5f30b79fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:01.342546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7675a13-00fe-493d-a958-a1f5f30b79fb tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:01.356556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f5b49-a3ac-4dd4-b033-08c0f0409d1d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:01.357562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f5b49-a3ac-4dd4-b033-08c0f0409d1d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:01.358103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f5b49-a3ac-4dd4-b033-08c0f0409d1d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:01.358621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f5b49-a3ac-4dd4-b033-08c0f0409d1d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:01.359598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f5b49-a3ac-4dd4-b033-08c0f0409d1d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:01.361538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f5b49-a3ac-4dd4-b033-08c0f0409d1d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:01.408841 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3730/7499] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:48:01 2022] POST /identity/v3/roles => generated 243 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:48:01.412214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43562dbc-5b9c-4cac-b4a0-93a59c1e17d0 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:01.435258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43562dbc-5b9c-4cac-b4a0-93a59c1e17d0 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:01.446770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62646a70-855a-41b9-9b0e-ea6891cee7ff tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:01.448596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62646a70-855a-41b9-9b0e-ea6891cee7ff tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:01.449007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62646a70-855a-41b9-9b0e-ea6891cee7ff tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:01.449814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62646a70-855a-41b9-9b0e-ea6891cee7ff tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:01.451924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62646a70-855a-41b9-9b0e-ea6891cee7ff tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:01.456101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62646a70-855a-41b9-9b0e-ea6891cee7ff tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:01.511505 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3770/7500] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:48:01 2022] POST /identity/v3/roles => generated 246 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:48:01.513108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f5b49-a3ac-4dd4-b033-08c0f0409d1d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:01.544991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f5b49-a3ac-4dd4-b033-08c0f0409d1d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:01.558769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396b434-d4dc-4bec-93a6-d2fbe7dffe59 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:01.559558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396b434-d4dc-4bec-93a6-d2fbe7dffe59 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:01.560788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396b434-d4dc-4bec-93a6-d2fbe7dffe59 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:01.563281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396b434-d4dc-4bec-93a6-d2fbe7dffe59 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/d6562e8faa514446b315897c209244bd/users/d5ffa7c5efc546d6b92d3ae616250b59/roles/61997c1d289b48b1951f740de31f0517` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:01.634865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396b434-d4dc-4bec-93a6-d2fbe7dffe59 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d6562e8faa514446b315897c209244bd, user_id=d5ffa7c5efc546d6b92d3ae616250b59, role_id=61997c1d289b48b1951f740de31f0517)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:01.651407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396b434-d4dc-4bec-93a6-d2fbe7dffe59 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:01.719370 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3731/7501] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:01 2022] PUT /identity/v3/projects/d6562e8faa514446b315897c209244bd/users/d5ffa7c5efc546d6b92d3ae616250b59/roles/61997c1d289b48b1951f740de31f0517 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:01.722396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62646a70-855a-41b9-9b0e-ea6891cee7ff tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:01.743089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62646a70-855a-41b9-9b0e-ea6891cee7ff tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:01.922516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75229e19-12f1-42f3-8cc4-a75eebf026b1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:01.923721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75229e19-12f1-42f3-8cc4-a75eebf026b1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:01.924176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75229e19-12f1-42f3-8cc4-a75eebf026b1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:01.924612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75229e19-12f1-42f3-8cc4-a75eebf026b1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/d6562e8faa514446b315897c209244bd/users/d5ffa7c5efc546d6b92d3ae616250b59/roles/f611d190b466483b87a02301cfeac462` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:01.927716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75229e19-12f1-42f3-8cc4-a75eebf026b1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d6562e8faa514446b315897c209244bd, user_id=d5ffa7c5efc546d6b92d3ae616250b59, role_id=f611d190b466483b87a02301cfeac462)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:01.938705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75229e19-12f1-42f3-8cc4-a75eebf026b1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:01.961837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396b434-d4dc-4bec-93a6-d2fbe7dffe59 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:01.963715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a396b434-d4dc-4bec-93a6-d2fbe7dffe59 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:02.011878 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3771/7502] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:01 2022] PUT /identity/v3/projects/d6562e8faa514446b315897c209244bd/users/d5ffa7c5efc546d6b92d3ae616250b59/roles/f611d190b466483b87a02301cfeac462 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:02.017135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75229e19-12f1-42f3-8cc4-a75eebf026b1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:02.192868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:02.232620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75229e19-12f1-42f3-8cc4-a75eebf026b1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:02.257132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e23f72-2045-4519-a114-2edd42d5d1a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:02.259332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e23f72-2045-4519-a114-2edd42d5d1a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:02.259628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e23f72-2045-4519-a114-2edd42d5d1a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:02.261064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e23f72-2045-4519-a114-2edd42d5d1a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:02.261799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e23f72-2045-4519-a114-2edd42d5d1a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:02.292563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e23f72-2045-4519-a114-2edd42d5d1a3 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:02.432644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396b434-d4dc-4bec-93a6-d2fbe7dffe59 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:02.445949 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3772/7503] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:02 2022] GET /identity/v3/users => generated 8876 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:02.449043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef206c5c-6003-47ab-a96c-f5bdc78fa99e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:02.449333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef206c5c-6003-47ab-a96c-f5bdc78fa99e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:02.449613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef206c5c-6003-47ab-a96c-f5bdc78fa99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:02.567713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:02.613143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ef206c5c-6003-47ab-a96c-f5bdc78fa99e None None] MFA Rules not processed for user `d5ffa7c5efc546d6b92d3ae616250b59`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:02.619832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ef206c5c-6003-47ab-a96c-f5bdc78fa99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:02.700053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a34e9-450c-4dc8-bcba-3164f4d1fd2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:02.700860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a34e9-450c-4dc8-bcba-3164f4d1fd2d service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:02.702177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a34e9-450c-4dc8-bcba-3164f4d1fd2d service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:02.704601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a34e9-450c-4dc8-bcba-3164f4d1fd2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:02.710120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-801a34e9-450c-4dc8-bcba-3164f4d1fd2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:02.866522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a34e9-450c-4dc8-bcba-3164f4d1fd2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:02.868668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a34e9-450c-4dc8-bcba-3164f4d1fd2d service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:02.889944 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3773/7504] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:02.893446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebb513-42f8-4593-92cd-4886a758b383 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:02.893742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebb513-42f8-4593-92cd-4886a758b383 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:02.894066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebb513-42f8-4593-92cd-4886a758b383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:02.931495 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3732/7505] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:48:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 970 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:48:02.978468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-14ebb513-42f8-4593-92cd-4886a758b383 None None] MFA Rules not processed for user `d5ffa7c5efc546d6b92d3ae616250b59`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:02.988876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-14ebb513-42f8-4593-92cd-4886a758b383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:03.031757 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3774/7506] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:03.035705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a34e9-450c-4dc8-bcba-3164f4d1fd2d service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:03.055231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a34e9-450c-4dc8-bcba-3164f4d1fd2d service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:03.081466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d575c-1131-46e4-a65d-72de7c87f5a3 tempest-TrustsV3TestJSON-740672345 tempest-user-1221276525] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5ffa7c5efc546d6b92d3ae616250b59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd6562e8faa514446b315897c209244bd', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-994685563', 'tempest-DelegatedRole-962275593'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:03.082148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d575c-1131-46e4-a65d-72de7c87f5a3 tempest-TrustsV3TestJSON-740672345 tempest-user-1221276525] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:03.091282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d575c-1131-46e4-a65d-72de7c87f5a3 tempest-TrustsV3TestJSON-740672345 tempest-user-1221276525] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:03.091613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d575c-1131-46e4-a65d-72de7c87f5a3 tempest-TrustsV3TestJSON-740672345 tempest-user-1221276525] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:03.100775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d575c-1131-46e4-a65d-72de7c87f5a3 tempest-TrustsV3TestJSON-740672345 tempest-user-1221276525] RBAC: Authorizing `identity:create_trust()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:03.107265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d575c-1131-46e4-a65d-72de7c87f5a3 tempest-TrustsV3TestJSON-740672345 tempest-user-1221276525] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-625d575c-1131-46e4-a65d-72de7c87f5a3 tempest-TrustsV3TestJSON-740672345 tempest-user-1221276525] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 30 04:48:03.445867 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 30 04:48:03.447189 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 30 04:48:03.451509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 30 04:48:03.451509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 30 04:48:03.451509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 30 04:48:03.451509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 30 04:48:03.451509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 30 04:48:03.451509 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:03.451509 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3733/7507] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Aug 30 04:48:03 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 413 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 30 04:48:03.453329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebb513-42f8-4593-92cd-4886a758b383 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:03.477015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebb513-42f8-4593-92cd-4886a758b383 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:03.490937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:03.491594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:03.491878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:03.492153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/f611d190b466483b87a02301cfeac462` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:03.495341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f611d190b466483b87a02301cfeac462)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:03.497740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:03.612628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d575c-1131-46e4-a65d-72de7c87f5a3 tempest-TrustsV3TestJSON-740672345 tempest-user-1221276525] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:03.615876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-625d575c-1131-46e4-a65d-72de7c87f5a3 tempest-TrustsV3TestJSON-740672345 tempest-user-1221276525] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:03.618028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role f611d190b466483b87a02301cfeac462 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:03.618328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:03.619021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:03.625713 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3775/7508] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:03 2022] DELETE /identity/v3/roles/f611d190b466483b87a02301cfeac462 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:03.626958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:03.628779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:03.805191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d575c-1131-46e4-a65d-72de7c87f5a3 tempest-TrustsV3TestJSON-740672345 tempest-user-1221276525] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:03.806337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf3846-f98c-4a9b-9079-69cc2dd57a48 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:03.834346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:03.835016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:03.835297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:03.837025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/61997c1d289b48b1951f740de31f0517` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:03.840824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=61997c1d289b48b1951f740de31f0517)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:03.842473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:03.886830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:03.905717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:03.940153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role 61997c1d289b48b1951f740de31f0517 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:03.940509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:03.941180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:03.943065 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3776/7509] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:03 2022] DELETE /identity/v3/roles/61997c1d289b48b1951f740de31f0517 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:03.947024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:03.952952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:03.987888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840ae9-8321-4473-8557-bbff4689ff04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:03.988546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840ae9-8321-4473-8557-bbff4689ff04 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:03.988827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840ae9-8321-4473-8557-bbff4689ff04 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:03.989099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b840ae9-8321-4473-8557-bbff4689ff04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:03.994608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1b840ae9-8321-4473-8557-bbff4689ff04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:04.113502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5973573-d84e-4738-8045-4c56f72b4f8a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:04.129632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:04.131452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:04.132921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:04.133192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users/d5ffa7c5efc546d6b92d3ae616250b59` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:04.136435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d5ffa7c5efc546d6b92d3ae616250b59)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:04.154866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:04.166043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b840ae9-8321-4473-8557-bbff4689ff04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:04.172221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b840ae9-8321-4473-8557-bbff4689ff04 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:04.209395 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3734/7510] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:04.271695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ffa7c5efc546d6b92d3ae616250b59'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:04.276314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ffa7c5efc546d6b92d3ae616250b59'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:04.299997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ffa7c5efc546d6b92d3ae616250b59'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:04.318387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ffa7c5efc546d6b92d3ae616250b59'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:04.394385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ffa7c5efc546d6b92d3ae616250b59'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:04.414831 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3777/7511] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:03 2022] DELETE /identity/v3/users/d5ffa7c5efc546d6b92d3ae616250b59 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:04.418746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840ae9-8321-4473-8557-bbff4689ff04 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:04.453115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b840ae9-8321-4473-8557-bbff4689ff04 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:04.650997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:04.651843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:04.652662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:04.653146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/d6562e8faa514446b315897c209244bd` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:04.658271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d6562e8faa514446b315897c209244bd)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:04.660596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:04.812057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6562e8faa514446b315897c209244bd', 'request_id': 'req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:04.840032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6562e8faa514446b315897c209244bd', 'request_id': 'req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:04.849625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6562e8faa514446b315897c209244bd', 'request_id': 'req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:04.881049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] The token cache is being invalidate because project d6562e8faa514446b315897c209244bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:04.882524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:04.883823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:04.888684 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3735/7512] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:04 2022] DELETE /identity/v3/projects/d6562e8faa514446b315897c209244bd => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:04.897532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:04.899237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:04.930439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbb98e-ba0a-44bd-87bb-ef8fe3f1bf80 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:05.131072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb7968-bc8b-4cb2-9e2e-a9cd4f402ee7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:05.131906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb7968-bc8b-4cb2-9e2e-a9cd4f402ee7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:05.134497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb7968-bc8b-4cb2-9e2e-a9cd4f402ee7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:05.134967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb7968-bc8b-4cb2-9e2e-a9cd4f402ee7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:05.135787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb7968-bc8b-4cb2-9e2e-a9cd4f402ee7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:05.140473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb7968-bc8b-4cb2-9e2e-a9cd4f402ee7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:05.153306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:05.215700 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3778/7513] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:48:04 2022] POST /identity/v3/projects => generated 328 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:05.220158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:05.221200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:05.258221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236ee7a-1546-45bf-b0e6-b48b22a7dea2 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:05.285130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:05.451262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60376d9-d190-4ad6-a6ea-9458112bc251 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:05.453206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60376d9-d190-4ad6-a6ea-9458112bc251 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:05.453499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60376d9-d190-4ad6-a6ea-9458112bc251 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:05.453780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60376d9-d190-4ad6-a6ea-9458112bc251 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:05.454498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60376d9-d190-4ad6-a6ea-9458112bc251 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:05.456449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60376d9-d190-4ad6-a6ea-9458112bc251 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:05.534376 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3736/7514] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:48:05 2022] POST /identity/v3/users => generated 413 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:05.539030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb7968-bc8b-4cb2-9e2e-a9cd4f402ee7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:05.574417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb7968-bc8b-4cb2-9e2e-a9cd4f402ee7 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:05.604610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa37e-f697-49ca-9f38-1a25b2f78362 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:05.605259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa37e-f697-49ca-9f38-1a25b2f78362 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:05.605542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa37e-f697-49ca-9f38-1a25b2f78362 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:05.605813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eaa37e-f697-49ca-9f38-1a25b2f78362 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:05.617104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaa37e-f697-49ca-9f38-1a25b2f78362 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:05.625447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eaa37e-f697-49ca-9f38-1a25b2f78362 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:05.722089 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3779/7515] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:48:05 2022] POST /identity/v3/roles => generated 244 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:05.727348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60376d9-d190-4ad6-a6ea-9458112bc251 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:05.741413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60376d9-d190-4ad6-a6ea-9458112bc251 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:05.763520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f5f85-4100-4cb1-b514-83d00ccab50d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:05.764466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f5f85-4100-4cb1-b514-83d00ccab50d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:05.765247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f5f85-4100-4cb1-b514-83d00ccab50d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:05.765538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f5f85-4100-4cb1-b514-83d00ccab50d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:05.766257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f5f85-4100-4cb1-b514-83d00ccab50d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:05.767906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f5f85-4100-4cb1-b514-83d00ccab50d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:05.823182 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3737/7516] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:48:05 2022] POST /identity/v3/roles => generated 247 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:05.824162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa37e-f697-49ca-9f38-1a25b2f78362 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:05.837534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eaa37e-f697-49ca-9f38-1a25b2f78362 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:05.858558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594e388-c105-4492-b369-de1b01219a22 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:05.858558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594e388-c105-4492-b369-de1b01219a22 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:05.858558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594e388-c105-4492-b369-de1b01219a22 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:05.859387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594e388-c105-4492-b369-de1b01219a22 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/624f035384d34788a4fed0b5c49c748d/users/08d4ccfead3f4df6985e9f7c2ccf1abf/roles/05f00a4cd3294e9ba210461c7a861c52` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:05.902462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594e388-c105-4492-b369-de1b01219a22 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=624f035384d34788a4fed0b5c49c748d, user_id=08d4ccfead3f4df6985e9f7c2ccf1abf, role_id=05f00a4cd3294e9ba210461c7a861c52)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:05.905897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594e388-c105-4492-b369-de1b01219a22 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:05.942401 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3780/7517] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:05 2022] PUT /identity/v3/projects/624f035384d34788a4fed0b5c49c748d/users/08d4ccfead3f4df6985e9f7c2ccf1abf/roles/05f00a4cd3294e9ba210461c7a861c52 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:05.945956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f5f85-4100-4cb1-b514-83d00ccab50d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:05.960714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f5f85-4100-4cb1-b514-83d00ccab50d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:06.106755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccc227-2884-4cc4-8c66-b9cb204a1035 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:06.107385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccc227-2884-4cc4-8c66-b9cb204a1035 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:06.107664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccc227-2884-4cc4-8c66-b9cb204a1035 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:06.107930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccc227-2884-4cc4-8c66-b9cb204a1035 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/624f035384d34788a4fed0b5c49c748d/users/08d4ccfead3f4df6985e9f7c2ccf1abf/roles/2419bd051908456cacfe6c1a8e397737` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:06.110295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccc227-2884-4cc4-8c66-b9cb204a1035 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=624f035384d34788a4fed0b5c49c748d, user_id=08d4ccfead3f4df6985e9f7c2ccf1abf, role_id=2419bd051908456cacfe6c1a8e397737)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:06.113919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ccc227-2884-4cc4-8c66-b9cb204a1035 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:06.156714 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3738/7518] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:05 2022] PUT /identity/v3/projects/624f035384d34788a4fed0b5c49c748d/users/08d4ccfead3f4df6985e9f7c2ccf1abf/roles/2419bd051908456cacfe6c1a8e397737 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:06.160444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594e388-c105-4492-b369-de1b01219a22 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:06.183894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594e388-c105-4492-b369-de1b01219a22 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:06.380015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f791ca5-b858-4393-a80c-61bae1099234 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:06.382402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f791ca5-b858-4393-a80c-61bae1099234 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:06.382691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f791ca5-b858-4393-a80c-61bae1099234 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:06.382968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f791ca5-b858-4393-a80c-61bae1099234 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:06.386337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f791ca5-b858-4393-a80c-61bae1099234 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:06.388876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f791ca5-b858-4393-a80c-61bae1099234 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:06.495425 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3781/7519] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:06 2022] GET /identity/v3/users => generated 8873 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:06.500498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df5e05-be84-4a34-b572-25c0cb7654fd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:06.501986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df5e05-be84-4a34-b572-25c0cb7654fd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:06.503241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df5e05-be84-4a34-b572-25c0cb7654fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:06.560137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-35df5e05-be84-4a34-b572-25c0cb7654fd None None] MFA Rules not processed for user `08d4ccfead3f4df6985e9f7c2ccf1abf`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:06.561693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-35df5e05-be84-4a34-b572-25c0cb7654fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:06.697667 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3739/7520] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:06 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:48:06.705588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f54764-03ad-4a65-bd9e-d71a64929ce6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:06.705902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f54764-03ad-4a65-bd9e-d71a64929ce6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:06.706248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f54764-03ad-4a65-bd9e-d71a64929ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:06.756986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b3f54764-03ad-4a65-bd9e-d71a64929ce6 None None] MFA Rules not processed for user `08d4ccfead3f4df6985e9f7c2ccf1abf`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:06.762154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b3f54764-03ad-4a65-bd9e-d71a64929ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:06.785011 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3782/7521] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:06 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:06.788514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df5e05-be84-4a34-b572-25c0cb7654fd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:06.796386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:06.802945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df5e05-be84-4a34-b572-25c0cb7654fd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:06.837841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc3918-5080-4777-90a0-acff617c8d11 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d4ccfead3f4df6985e9f7c2ccf1abf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624f035384d34788a4fed0b5c49c748d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1566589129', 'tempest-NotDelegatedRole-1897641486'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:06.856073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc3918-5080-4777-90a0-acff617c8d11 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:06.856447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc3918-5080-4777-90a0-acff617c8d11 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:06.856735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc3918-5080-4777-90a0-acff617c8d11 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:06.857471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc3918-5080-4777-90a0-acff617c8d11 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorizing `identity:create_trust()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:06.862482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfc3918-5080-4777-90a0-acff617c8d11 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:07.065028 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3740/7522] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Aug 30 04:48:06 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:07.069342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f54764-03ad-4a65-bd9e-d71a64929ce6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:07.081686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f54764-03ad-4a65-bd9e-d71a64929ce6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:07.109138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e0b67-9505-4459-b5fa-b758a4f4dd03 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d4ccfead3f4df6985e9f7c2ccf1abf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624f035384d34788a4fed0b5c49c748d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1566589129', 'tempest-NotDelegatedRole-1897641486'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:07.109829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e0b67-9505-4459-b5fa-b758a4f4dd03 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:07.110152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e0b67-9505-4459-b5fa-b758a4f4dd03 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:07.112203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e0b67-9505-4459-b5fa-b758a4f4dd03 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] PATH_INFO: `/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:07.136640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e0b67-9505-4459-b5fa-b758a4f4dd03 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorizing `identity:get_trust(trust_id=6ce8cea52d814064ba3933d76374122d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:07.138136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e0b67-9505-4459-b5fa-b758a4f4dd03 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:07.160578 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3783/7523] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:48:07 2022] GET /identity/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d => generated 834 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:07.165410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc3918-5080-4777-90a0-acff617c8d11 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:07.196532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc3918-5080-4777-90a0-acff617c8d11 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:07.212732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea07af6-0b57-46cb-93e8-74231c80bc68 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d4ccfead3f4df6985e9f7c2ccf1abf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624f035384d34788a4fed0b5c49c748d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1566589129', 'tempest-NotDelegatedRole-1897641486'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:07.214138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea07af6-0b57-46cb-93e8-74231c80bc68 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:07.215510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea07af6-0b57-46cb-93e8-74231c80bc68 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:07.216878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea07af6-0b57-46cb-93e8-74231c80bc68 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] PATH_INFO: `/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:07.232703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea07af6-0b57-46cb-93e8-74231c80bc68 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=6ce8cea52d814064ba3933d76374122d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:07.234340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea07af6-0b57-46cb-93e8-74231c80bc68 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:07.244501 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3741/7524] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Aug 30 04:48:07 2022] GET /identity/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d/roles => generated 371 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:07.248834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e0b67-9505-4459-b5fa-b758a4f4dd03 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:07.263184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e0b67-9505-4459-b5fa-b758a4f4dd03 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:07.275660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9971-66d5-4d77-a397-1531fd38534c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d4ccfead3f4df6985e9f7c2ccf1abf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624f035384d34788a4fed0b5c49c748d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1566589129', 'tempest-NotDelegatedRole-1897641486'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:07.276348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9971-66d5-4d77-a397-1531fd38534c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:07.276758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9971-66d5-4d77-a397-1531fd38534c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:07.277033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f9971-66d5-4d77-a397-1531fd38534c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] PATH_INFO: `/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d/roles/05f00a4cd3294e9ba210461c7a861c52` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:07.300490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9971-66d5-4d77-a397-1531fd38534c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6ce8cea52d814064ba3933d76374122d, role_id=05f00a4cd3294e9ba210461c7a861c52)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:07.302316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f9971-66d5-4d77-a397-1531fd38534c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:07.322778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea07af6-0b57-46cb-93e8-74231c80bc68 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:07.324238 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3784/7525] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Aug 30 04:48:07 2022] GET /identity/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d/roles/05f00a4cd3294e9ba210461c7a861c52 => generated 244 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:07.347852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea07af6-0b57-46cb-93e8-74231c80bc68 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:07.375217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ae9e5-2c35-494e-a022-c605c70740ee tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d4ccfead3f4df6985e9f7c2ccf1abf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624f035384d34788a4fed0b5c49c748d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1566589129', 'tempest-NotDelegatedRole-1897641486'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:07.375861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ae9e5-2c35-494e-a022-c605c70740ee tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:07.376146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ae9e5-2c35-494e-a022-c605c70740ee tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:07.376424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ae9e5-2c35-494e-a022-c605c70740ee tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] PATH_INFO: `/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d/roles/05f00a4cd3294e9ba210461c7a861c52` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:07.404372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ae9e5-2c35-494e-a022-c605c70740ee tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6ce8cea52d814064ba3933d76374122d, role_id=05f00a4cd3294e9ba210461c7a861c52)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:07.420431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ae9e5-2c35-494e-a022-c605c70740ee tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:07.461095 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3742/7526] 10.222.0.43 () {58 vars in 1369 bytes} [Tue Aug 30 04:48:07 2022] HEAD /identity/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d/roles/05f00a4cd3294e9ba210461c7a861c52 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 30 04:48:07.465145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9971-66d5-4d77-a397-1531fd38534c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:07.477752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f9971-66d5-4d77-a397-1531fd38534c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:07.492906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545d783-e831-4de7-9565-9d56024a8e6c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d4ccfead3f4df6985e9f7c2ccf1abf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624f035384d34788a4fed0b5c49c748d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1566589129', 'tempest-NotDelegatedRole-1897641486'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:07.493581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d783-e831-4de7-9565-9d56024a8e6c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:07.493853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d783-e831-4de7-9565-9d56024a8e6c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:07.494154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d783-e831-4de7-9565-9d56024a8e6c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] PATH_INFO: `/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d/roles/2419bd051908456cacfe6c1a8e397737` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:07.506902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545d783-e831-4de7-9565-9d56024a8e6c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6ce8cea52d814064ba3933d76374122d, role_id=2419bd051908456cacfe6c1a8e397737)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:07.508378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545d783-e831-4de7-9565-9d56024a8e6c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-f545d783-e831-4de7-9565-9d56024a8e6c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Could not find role: 2419bd051908456cacfe6c1a8e397737.: keystone.exception.RoleNotFound: Could not find role: 2419bd051908456cacfe6c1a8e397737. Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:48:07.537543 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 2419bd051908456cacfe6c1a8e397737. Aug 30 04:48:07.538813 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:48:07.542990 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3785/7527] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Aug 30 04:48:07 2022] GET /identity/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d/roles/2419bd051908456cacfe6c1a8e397737 => generated 110 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:48:07.543781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ae9e5-2c35-494e-a022-c605c70740ee tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:07.566986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ae9e5-2c35-494e-a022-c605c70740ee tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:07.582290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0b4af-4d5e-47e2-96a2-3d5c0c5b8920 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d4ccfead3f4df6985e9f7c2ccf1abf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624f035384d34788a4fed0b5c49c748d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1566589129', 'tempest-NotDelegatedRole-1897641486'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:07.583975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0b4af-4d5e-47e2-96a2-3d5c0c5b8920 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:07.587808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0b4af-4d5e-47e2-96a2-3d5c0c5b8920 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:07.588134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0b4af-4d5e-47e2-96a2-3d5c0c5b8920 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] PATH_INFO: `/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d/roles/2419bd051908456cacfe6c1a8e397737` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:07.615352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0b4af-4d5e-47e2-96a2-3d5c0c5b8920 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorizing `identity:get_role_for_trust(trust_id=6ce8cea52d814064ba3933d76374122d, role_id=2419bd051908456cacfe6c1a8e397737)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:07.620381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0b4af-4d5e-47e2-96a2-3d5c0c5b8920 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-02a0b4af-4d5e-47e2-96a2-3d5c0c5b8920 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Could not find role: 2419bd051908456cacfe6c1a8e397737.: keystone.exception.RoleNotFound: Could not find role: 2419bd051908456cacfe6c1a8e397737. Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:48:07.655050 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 2419bd051908456cacfe6c1a8e397737. Aug 30 04:48:07.656612 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:07.669611 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3743/7528] 10.222.0.43 () {58 vars in 1369 bytes} [Tue Aug 30 04:48:07 2022] HEAD /identity/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d/roles/2419bd051908456cacfe6c1a8e397737 => generated 0 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 30 04:48:07.674136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545d783-e831-4de7-9565-9d56024a8e6c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:07.689683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545d783-e831-4de7-9565-9d56024a8e6c tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:07.719750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d4ccfead3f4df6985e9f7c2ccf1abf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624f035384d34788a4fed0b5c49c748d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1566589129', 'tempest-NotDelegatedRole-1897641486'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:07.720551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:07.720651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:07.720919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] PATH_INFO: `/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:07.733307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorizing `identity:delete_trust(trust_id=6ce8cea52d814064ba3933d76374122d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:07.735146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:07.802932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6ce8cea52d814064ba3933d76374122d', 'request_id': 'req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:07.804146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '6ce8cea52d814064ba3933d76374122d', 'request_id': 'req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:07.828999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '6ce8cea52d814064ba3933d76374122d', 'request_id': 'req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:07.837223 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3786/7529] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Aug 30 04:48:07 2022] DELETE /identity/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:07.842665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0b4af-4d5e-47e2-96a2-3d5c0c5b8920 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:07.845561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-02a0b4af-4d5e-47e2-96a2-3d5c0c5b8920 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:07.882436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0b4af-4d5e-47e2-96a2-3d5c0c5b8920 tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:07.910094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf3e08-038d-4ed0-9781-84e2363b2efe tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d4ccfead3f4df6985e9f7c2ccf1abf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '624f035384d34788a4fed0b5c49c748d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1566589129', 'tempest-NotDelegatedRole-1897641486'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:07.911831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf3e08-038d-4ed0-9781-84e2363b2efe tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:07.912755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf3e08-038d-4ed0-9781-84e2363b2efe tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:07.913365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf3e08-038d-4ed0-9781-84e2363b2efe tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] PATH_INFO: `/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-2cdf3e08-038d-4ed0-9781-84e2363b2efe tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Could not find trust: 6ce8cea52d814064ba3933d76374122d.: keystone.exception.TrustNotFound: Could not find trust: 6ce8cea52d814064ba3933d76374122d. Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 30 04:48:07.952004 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 6ce8cea52d814064ba3933d76374122d. Aug 30 04:48:07.953409 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:07.957901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:07.959315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:07.965404 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3744/7530] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:48:07 2022] GET /identity/v3/OS-TRUST/trusts/6ce8cea52d814064ba3933d76374122d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:48:08.004892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2846ab-598d-4cd1-8e7d-3d3eadbb341b tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:08.010036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d558f60-e885-4f80-a881-637c7159389f tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:08.010700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d558f60-e885-4f80-a881-637c7159389f tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:08.010983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d558f60-e885-4f80-a881-637c7159389f tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:08.011333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d558f60-e885-4f80-a881-637c7159389f tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/2419bd051908456cacfe6c1a8e397737` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:08.012953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d558f60-e885-4f80-a881-637c7159389f tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2419bd051908456cacfe6c1a8e397737)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:08.025667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d558f60-e885-4f80-a881-637c7159389f tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:08.036783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:08.149486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d558f60-e885-4f80-a881-637c7159389f tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role 2419bd051908456cacfe6c1a8e397737 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:08.150110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d558f60-e885-4f80-a881-637c7159389f tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:08.151128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5d558f60-e885-4f80-a881-637c7159389f tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:08.163079 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3787/7531] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:07 2022] DELETE /identity/v3/roles/2419bd051908456cacfe6c1a8e397737 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:08.169390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf3e08-038d-4ed0-9781-84e2363b2efe tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:08.182590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2cdf3e08-038d-4ed0-9781-84e2363b2efe tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:08.269063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf3e08-038d-4ed0-9781-84e2363b2efe tempest-TrustsV3TestJSON-910874929 tempest-user-424306107] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:08.371964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cedbd-d2c9-4c62-ae9e-e3b7e3c065b1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:08.372247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cedbd-d2c9-4c62-ae9e-e3b7e3c065b1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:08.372518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cedbd-d2c9-4c62-ae9e-e3b7e3c065b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:08.459807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:08.460471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:08.460748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:08.461017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/05f00a4cd3294e9ba210461c7a861c52` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:08.464675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=05f00a4cd3294e9ba210461c7a861c52)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:08.469861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:08.532728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c92cedbd-d2c9-4c62-ae9e-e3b7e3c065b1 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:08.535052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c92cedbd-d2c9-4c62-ae9e-e3b7e3c065b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:08.666458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:08.690616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role 05f00a4cd3294e9ba210461c7a861c52 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:08.691092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:08.692755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:08.698473 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3745/7532] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:08 2022] DELETE /identity/v3/roles/05f00a4cd3294e9ba210461c7a861c52 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:08.703326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:08.714234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:08.784845 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3788/7533] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:48:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:48:08.863124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cedbd-d2c9-4c62-ae9e-e3b7e3c065b1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:08.864782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c92cedbd-d2c9-4c62-ae9e-e3b7e3c065b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:08.945664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dc8bd-8aef-40d4-92ee-27dfbd43e141 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:08.973340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:08.975602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:08.976568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:08.978461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users/08d4ccfead3f4df6985e9f7c2ccf1abf` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:08.981348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_user(user_id=08d4ccfead3f4df6985e9f7c2ccf1abf)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:08.991683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:09.059957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cedbd-d2c9-4c62-ae9e-e3b7e3c065b1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:09.177254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:09.205481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d4ccfead3f4df6985e9f7c2ccf1abf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:09.216344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d4ccfead3f4df6985e9f7c2ccf1abf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:09.240465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d4ccfead3f4df6985e9f7c2ccf1abf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:09.253962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d4ccfead3f4df6985e9f7c2ccf1abf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:09.255010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d4ccfead3f4df6985e9f7c2ccf1abf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:09.269803 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3746/7534] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:08 2022] DELETE /identity/v3/users/08d4ccfead3f4df6985e9f7c2ccf1abf => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:09.277505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:09.277748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c27e5-4fc1-4502-8b16-135a8f70ba3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:09.282087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c27e5-4fc1-4502-8b16-135a8f70ba3b service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:09.282382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c27e5-4fc1-4502-8b16-135a8f70ba3b service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:09.285168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c27e5-4fc1-4502-8b16-135a8f70ba3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:09.287531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:09.292206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fc5c27e5-4fc1-4502-8b16-135a8f70ba3b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:09.439766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c27e5-4fc1-4502-8b16-135a8f70ba3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:09.443366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c27e5-4fc1-4502-8b16-135a8f70ba3b service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:09.478181 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3789/7535] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:48:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:48:09.537776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f1f5a-43ca-485f-87e4-d361ea14d802 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:09.552152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:09.552829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:09.553107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:09.553378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/624f035384d34788a4fed0b5c49c748d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:09.555114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_project(project_id=624f035384d34788a4fed0b5c49c748d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:09.559577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:09.647576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:09.807639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '624f035384d34788a4fed0b5c49c748d', 'request_id': 'req-66628047-edf7-4087-a38f-16c173322f35'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:09.860148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '624f035384d34788a4fed0b5c49c748d', 'request_id': 'req-66628047-edf7-4087-a38f-16c173322f35'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:09.894209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '624f035384d34788a4fed0b5c49c748d', 'request_id': 'req-66628047-edf7-4087-a38f-16c173322f35'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:09.980990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] The token cache is being invalidate because project 624f035384d34788a4fed0b5c49c748d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:09.981287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:09.987421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:09.997060 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3747/7536] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:09 2022] DELETE /identity/v3/projects/624f035384d34788a4fed0b5c49c748d => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:10.003178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c27e5-4fc1-4502-8b16-135a8f70ba3b service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:10.027650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c27e5-4fc1-4502-8b16-135a8f70ba3b service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:10.257029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e8982-defb-470b-aad5-1020272e9b8e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:10.257989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e8982-defb-470b-aad5-1020272e9b8e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:10.258393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e8982-defb-470b-aad5-1020272e9b8e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:10.259962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e8982-defb-470b-aad5-1020272e9b8e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:10.260737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e8982-defb-470b-aad5-1020272e9b8e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:10.266763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e8982-defb-470b-aad5-1020272e9b8e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:10.372727 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3790/7537] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Aug 30 04:48:10 2022] POST /identity/v3/projects => generated 328 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:10.375558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:10.382899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:10.419826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66628047-edf7-4087-a38f-16c173322f35 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:10.614652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd18955-8a3a-443e-a53e-6d62805840c6 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:10.622074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd18955-8a3a-443e-a53e-6d62805840c6 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:10.623685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd18955-8a3a-443e-a53e-6d62805840c6 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:10.628185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd18955-8a3a-443e-a53e-6d62805840c6 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:10.634935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd18955-8a3a-443e-a53e-6d62805840c6 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:10.639745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd18955-8a3a-443e-a53e-6d62805840c6 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:10.756867 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3748/7538] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:48:10 2022] POST /identity/v3/users => generated 416 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:10.764195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e8982-defb-470b-aad5-1020272e9b8e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:10.804902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e8982-defb-470b-aad5-1020272e9b8e tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:10.823199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7caae-5ef1-4d53-ab26-785f8e5fe81c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:10.823840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7caae-5ef1-4d53-ab26-785f8e5fe81c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:10.824116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7caae-5ef1-4d53-ab26-785f8e5fe81c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:10.824386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7caae-5ef1-4d53-ab26-785f8e5fe81c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:10.825064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7caae-5ef1-4d53-ab26-785f8e5fe81c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:10.826717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7caae-5ef1-4d53-ab26-785f8e5fe81c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:10.890021 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3791/7539] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:48:10 2022] POST /identity/v3/roles => generated 244 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:10.894548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd18955-8a3a-443e-a53e-6d62805840c6 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:10.918708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd18955-8a3a-443e-a53e-6d62805840c6 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:10.946252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3b84-7734-4739-9bdf-459c79082185 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:10.946906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3b84-7734-4739-9bdf-459c79082185 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:10.950174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3b84-7734-4739-9bdf-459c79082185 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:10.950498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3b84-7734-4739-9bdf-459c79082185 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:10.951229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f3b84-7734-4739-9bdf-459c79082185 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:10.962348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f3b84-7734-4739-9bdf-459c79082185 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:11.047480 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3749/7540] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Aug 30 04:48:10 2022] POST /identity/v3/roles => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:11.048950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7caae-5ef1-4d53-ab26-785f8e5fe81c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:11.063134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7caae-5ef1-4d53-ab26-785f8e5fe81c tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:11.159504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73668eb0-c064-4fac-bc34-d8447720ca8d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:11.167822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668eb0-c064-4fac-bc34-d8447720ca8d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:11.170126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668eb0-c064-4fac-bc34-d8447720ca8d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:11.175242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73668eb0-c064-4fac-bc34-d8447720ca8d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/bd4daa10725b40d1b6deee0805a18358/users/d2cacc9102e5497d8565aef5c595d596/roles/f9136412329e45b6a2323652317ad375` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:11.310063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73668eb0-c064-4fac-bc34-d8447720ca8d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bd4daa10725b40d1b6deee0805a18358, user_id=d2cacc9102e5497d8565aef5c595d596, role_id=f9136412329e45b6a2323652317ad375)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:11.324121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73668eb0-c064-4fac-bc34-d8447720ca8d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:11.401443 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3792/7541] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:11 2022] PUT /identity/v3/projects/bd4daa10725b40d1b6deee0805a18358/users/d2cacc9102e5497d8565aef5c595d596/roles/f9136412329e45b6a2323652317ad375 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:11.401804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3b84-7734-4739-9bdf-459c79082185 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:11.419927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3b84-7734-4739-9bdf-459c79082185 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:11.808494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb43b1-13d5-422b-b47c-3cafa87aecc9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:11.815405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb43b1-13d5-422b-b47c-3cafa87aecc9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:11.815707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb43b1-13d5-422b-b47c-3cafa87aecc9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:11.815991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb43b1-13d5-422b-b47c-3cafa87aecc9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/bd4daa10725b40d1b6deee0805a18358/users/d2cacc9102e5497d8565aef5c595d596/roles/03abaea5bf324145b59508c78b7c7ac9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:11.827553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb43b1-13d5-422b-b47c-3cafa87aecc9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bd4daa10725b40d1b6deee0805a18358, user_id=d2cacc9102e5497d8565aef5c595d596, role_id=03abaea5bf324145b59508c78b7c7ac9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:11.843222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb43b1-13d5-422b-b47c-3cafa87aecc9 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:11.903097 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3750/7542] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:11 2022] PUT /identity/v3/projects/bd4daa10725b40d1b6deee0805a18358/users/d2cacc9102e5497d8565aef5c595d596/roles/03abaea5bf324145b59508c78b7c7ac9 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:11.904593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73668eb0-c064-4fac-bc34-d8447720ca8d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:11.923223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73668eb0-c064-4fac-bc34-d8447720ca8d tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:12.036404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:12.118589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb61c7-340a-474c-b078-1ba5ca5af06a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:12.119594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb61c7-340a-474c-b078-1ba5ca5af06a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:12.122459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb61c7-340a-474c-b078-1ba5ca5af06a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:12.122915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb61c7-340a-474c-b078-1ba5ca5af06a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:12.123769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb61c7-340a-474c-b078-1ba5ca5af06a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:12.126213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb61c7-340a-474c-b078-1ba5ca5af06a tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:12.222961 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3793/7543] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:11 2022] GET /identity/v3/users => generated 8876 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:12.228891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74644-fffd-4e74-b2f8-6feb71c64573 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:12.229440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74644-fffd-4e74-b2f8-6feb71c64573 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:12.229850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74644-fffd-4e74-b2f8-6feb71c64573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:12.325389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:12.362978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-31b74644-fffd-4e74-b2f8-6feb71c64573 None None] MFA Rules not processed for user `d2cacc9102e5497d8565aef5c595d596`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:12.364498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-31b74644-fffd-4e74-b2f8-6feb71c64573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:12.690675 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3751/7544] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:12 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:12.691553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd3396-691f-4db7-8b71-b44942370c51 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:12.692576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd3396-691f-4db7-8b71-b44942370c51 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:12.693020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd3396-691f-4db7-8b71-b44942370c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:12.746994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-88cd3396-691f-4db7-8b71-b44942370c51 None None] MFA Rules not processed for user `d2cacc9102e5497d8565aef5c595d596`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:12.752222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-88cd3396-691f-4db7-8b71-b44942370c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:12.800645 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3794/7545] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:12 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:48:12.801994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74644-fffd-4e74-b2f8-6feb71c64573 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:12.814766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74644-fffd-4e74-b2f8-6feb71c64573 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:12.848459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4bda4-b8d7-41aa-80d6-892573ecd6b6 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cacc9102e5497d8565aef5c595d596', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4daa10725b40d1b6deee0805a18358', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1420498332', 'tempest-DelegatedRole-1000062158'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:12.849162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4bda4-b8d7-41aa-80d6-892573ecd6b6 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:12.849371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4bda4-b8d7-41aa-80d6-892573ecd6b6 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:12.857282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4bda4-b8d7-41aa-80d6-892573ecd6b6 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:12.864106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4bda4-b8d7-41aa-80d6-892573ecd6b6 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorizing `identity:create_trust()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:12.875063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4bda4-b8d7-41aa-80d6-892573ecd6b6 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:13.328715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd3396-691f-4db7-8b71-b44942370c51 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:13.329724 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3752/7546] 10.222.0.43 () {60 vars in 1174 bytes} [Tue Aug 30 04:48:12 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 528 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:13.353524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd3396-691f-4db7-8b71-b44942370c51 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:13.379801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7c77-71d4-4b10-9ec0-ff8978022b34 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cacc9102e5497d8565aef5c595d596', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4daa10725b40d1b6deee0805a18358', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1420498332', 'tempest-DelegatedRole-1000062158'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:13.390610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7c77-71d4-4b10-9ec0-ff8978022b34 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:13.390610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7c77-71d4-4b10-9ec0-ff8978022b34 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:13.390832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7c77-71d4-4b10-9ec0-ff8978022b34 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] PATH_INFO: `/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:13.423543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa7c77-71d4-4b10-9ec0-ff8978022b34 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorizing `identity:get_trust(trust_id=b2b697ef333c4f23a4fc425a5b757107)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:13.425027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa7c77-71d4-4b10-9ec0-ff8978022b34 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:13.488577 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3795/7547] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:48:13 2022] GET /identity/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107 => generated 835 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:13.492008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4bda4-b8d7-41aa-80d6-892573ecd6b6 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:13.505845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4bda4-b8d7-41aa-80d6-892573ecd6b6 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:13.536180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c1247-d057-45b7-9595-ae462070cb79 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cacc9102e5497d8565aef5c595d596', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4daa10725b40d1b6deee0805a18358', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1420498332', 'tempest-DelegatedRole-1000062158'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:13.536883 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c1247-d057-45b7-9595-ae462070cb79 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:13.546551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c1247-d057-45b7-9595-ae462070cb79 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:13.546976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c1247-d057-45b7-9595-ae462070cb79 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] PATH_INFO: `/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:13.575763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c1247-d057-45b7-9595-ae462070cb79 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=b2b697ef333c4f23a4fc425a5b757107)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:13.577338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c1247-d057-45b7-9595-ae462070cb79 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:13.591681 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3753/7548] 10.222.0.43 () {58 vars in 1269 bytes} [Tue Aug 30 04:48:13 2022] GET /identity/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107/roles => generated 371 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:13.600407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7c77-71d4-4b10-9ec0-ff8978022b34 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:13.636651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7c77-71d4-4b10-9ec0-ff8978022b34 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:13.663678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ac45e-a9d4-472f-9103-139bc46763ea tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cacc9102e5497d8565aef5c595d596', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4daa10725b40d1b6deee0805a18358', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1420498332', 'tempest-DelegatedRole-1000062158'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:13.669137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ac45e-a9d4-472f-9103-139bc46763ea tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:13.671110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ac45e-a9d4-472f-9103-139bc46763ea tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:13.671790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ac45e-a9d4-472f-9103-139bc46763ea tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] PATH_INFO: `/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107/roles/f9136412329e45b6a2323652317ad375` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:13.710887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ac45e-a9d4-472f-9103-139bc46763ea tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b2b697ef333c4f23a4fc425a5b757107, role_id=f9136412329e45b6a2323652317ad375)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:13.714083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ac45e-a9d4-472f-9103-139bc46763ea tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:13.750247 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3796/7549] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Aug 30 04:48:13 2022] GET /identity/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107/roles/f9136412329e45b6a2323652317ad375 => generated 244 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:13.758514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c1247-d057-45b7-9595-ae462070cb79 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:13.785596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c1247-d057-45b7-9595-ae462070cb79 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:13.800679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2caca1-d3a8-41b2-a0d1-3ac0a6db12a7 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cacc9102e5497d8565aef5c595d596', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4daa10725b40d1b6deee0805a18358', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1420498332', 'tempest-DelegatedRole-1000062158'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:13.800811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2caca1-d3a8-41b2-a0d1-3ac0a6db12a7 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:13.801249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2caca1-d3a8-41b2-a0d1-3ac0a6db12a7 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:13.802543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2caca1-d3a8-41b2-a0d1-3ac0a6db12a7 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] PATH_INFO: `/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107/roles/f9136412329e45b6a2323652317ad375` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:13.819180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2caca1-d3a8-41b2-a0d1-3ac0a6db12a7 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b2b697ef333c4f23a4fc425a5b757107, role_id=f9136412329e45b6a2323652317ad375)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:13.842373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2caca1-d3a8-41b2-a0d1-3ac0a6db12a7 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:13.900611 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3754/7550] 10.222.0.43 () {58 vars in 1369 bytes} [Tue Aug 30 04:48:13 2022] HEAD /identity/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107/roles/f9136412329e45b6a2323652317ad375 => generated 0 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 30 04:48:13.901785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ac45e-a9d4-472f-9103-139bc46763ea tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:13.916483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ac45e-a9d4-472f-9103-139bc46763ea tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:13.933181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fea5f-bbd1-4c1d-9414-0c809d3f5e5b tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cacc9102e5497d8565aef5c595d596', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4daa10725b40d1b6deee0805a18358', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1420498332', 'tempest-DelegatedRole-1000062158'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:13.933898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fea5f-bbd1-4c1d-9414-0c809d3f5e5b tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:13.934185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fea5f-bbd1-4c1d-9414-0c809d3f5e5b tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:13.934495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355fea5f-bbd1-4c1d-9414-0c809d3f5e5b tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] PATH_INFO: `/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107/roles/03abaea5bf324145b59508c78b7c7ac9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:13.972142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fea5f-bbd1-4c1d-9414-0c809d3f5e5b tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b2b697ef333c4f23a4fc425a5b757107, role_id=03abaea5bf324145b59508c78b7c7ac9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:13.974731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355fea5f-bbd1-4c1d-9414-0c809d3f5e5b tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-355fea5f-bbd1-4c1d-9414-0c809d3f5e5b tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Could not find role: 03abaea5bf324145b59508c78b7c7ac9.: keystone.exception.RoleNotFound: Could not find role: 03abaea5bf324145b59508c78b7c7ac9. Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:48:13.987732 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 03abaea5bf324145b59508c78b7c7ac9. Aug 30 04:48:13.988805 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:48:13.999250 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3797/7551] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Aug 30 04:48:13 2022] GET /identity/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107/roles/03abaea5bf324145b59508c78b7c7ac9 => generated 110 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:48:14.001582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2caca1-d3a8-41b2-a0d1-3ac0a6db12a7 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:14.022942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2caca1-d3a8-41b2-a0d1-3ac0a6db12a7 tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:14.044822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2ce68-8692-4f9c-8520-b836f2d368ff tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cacc9102e5497d8565aef5c595d596', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4daa10725b40d1b6deee0805a18358', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1420498332', 'tempest-DelegatedRole-1000062158'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:14.045763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2ce68-8692-4f9c-8520-b836f2d368ff tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] REQUEST_METHOD: `HEAD` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:14.046233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2ce68-8692-4f9c-8520-b836f2d368ff tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:14.046677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2ce68-8692-4f9c-8520-b836f2d368ff tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] PATH_INFO: `/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107/roles/03abaea5bf324145b59508c78b7c7ac9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:14.066255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2ce68-8692-4f9c-8520-b836f2d368ff tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b2b697ef333c4f23a4fc425a5b757107, role_id=03abaea5bf324145b59508c78b7c7ac9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:14.068763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2ce68-8692-4f9c-8520-b836f2d368ff tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-dee2ce68-8692-4f9c-8520-b836f2d368ff tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Could not find role: 03abaea5bf324145b59508c78b7c7ac9.: keystone.exception.RoleNotFound: Could not find role: 03abaea5bf324145b59508c78b7c7ac9. Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 04:48:14.110551 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 03abaea5bf324145b59508c78b7c7ac9. Aug 30 04:48:14.112215 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:14.129906 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3755/7552] 10.222.0.43 () {58 vars in 1369 bytes} [Tue Aug 30 04:48:13 2022] HEAD /identity/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107/roles/03abaea5bf324145b59508c78b7c7ac9 => generated 0 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 30 04:48:14.131215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fea5f-bbd1-4c1d-9414-0c809d3f5e5b tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:14.167048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355fea5f-bbd1-4c1d-9414-0c809d3f5e5b tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:14.180911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cacc9102e5497d8565aef5c595d596', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4daa10725b40d1b6deee0805a18358', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1420498332', 'tempest-DelegatedRole-1000062158'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:14.185658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:14.201471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:14.201837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] PATH_INFO: `/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:14.243892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorizing `identity:delete_trust(trust_id=b2b697ef333c4f23a4fc425a5b757107)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:14.247596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:14.313627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b2b697ef333c4f23a4fc425a5b757107', 'request_id': 'req-c0ffc586-3529-4879-aad6-45cb900ae4fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:14.314943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b2b697ef333c4f23a4fc425a5b757107', 'request_id': 'req-c0ffc586-3529-4879-aad6-45cb900ae4fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:14.333153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b2b697ef333c4f23a4fc425a5b757107', 'request_id': 'req-c0ffc586-3529-4879-aad6-45cb900ae4fa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:14.343967 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3798/7553] 10.222.0.43 () {58 vars in 1254 bytes} [Tue Aug 30 04:48:14 2022] DELETE /identity/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:14.345153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2ce68-8692-4f9c-8520-b836f2d368ff tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:14.346914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dee2ce68-8692-4f9c-8520-b836f2d368ff tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:14.381431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2ce68-8692-4f9c-8520-b836f2d368ff tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:14.409582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971345-5e5a-43aa-857f-b3ed5e9fec3a tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2cacc9102e5497d8565aef5c595d596', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4daa10725b40d1b6deee0805a18358', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1420498332', 'tempest-DelegatedRole-1000062158'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:14.411638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971345-5e5a-43aa-857f-b3ed5e9fec3a tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:14.411938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971345-5e5a-43aa-857f-b3ed5e9fec3a tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:14.412203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d971345-5e5a-43aa-857f-b3ed5e9fec3a tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] PATH_INFO: `/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-2d971345-5e5a-43aa-857f-b3ed5e9fec3a tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Could not find trust: b2b697ef333c4f23a4fc425a5b757107.: keystone.exception.TrustNotFound: Could not find trust: b2b697ef333c4f23a4fc425a5b757107. Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 30 04:48:14.436841 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b2b697ef333c4f23a4fc425a5b757107. Aug 30 04:48:14.438015 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:14.463045 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3756/7554] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Aug 30 04:48:14 2022] GET /identity/v3/OS-TRUST/trusts/b2b697ef333c4f23a4fc425a5b757107 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 30 04:48:14.463687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:14.465699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:14.508320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffc586-3529-4879-aad6-45cb900ae4fa tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:14.522532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:14.523195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:14.523476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:14.523755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/03abaea5bf324145b59508c78b7c7ac9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:14.528696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=03abaea5bf324145b59508c78b7c7ac9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:14.529712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:14.697216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role 03abaea5bf324145b59508c78b7c7ac9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:14.697512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:14.698207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:14.706505 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3799/7555] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:14 2022] DELETE /identity/v3/roles/03abaea5bf324145b59508c78b7c7ac9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:14.709448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971345-5e5a-43aa-857f-b3ed5e9fec3a tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:14.718551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2d971345-5e5a-43aa-857f-b3ed5e9fec3a tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:14.761962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d971345-5e5a-43aa-857f-b3ed5e9fec3a tempest-TrustsV3TestJSON-484416214 tempest-user-1997492934] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:14.840710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:15.076556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:15.079727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:15.080141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:15.080486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/roles/f9136412329e45b6a2323652317ad375` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:15.083886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f9136412329e45b6a2323652317ad375)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:15.088273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:15.238264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invalidating the token cache because role f9136412329e45b6a2323652317ad375 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:15.238755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:15.239972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:15.254379 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3757/7556] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:14 2022] DELETE /identity/v3/roles/f9136412329e45b6a2323652317ad375 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:15.258230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:15.272845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3836a-0ba3-4588-89d1-8f4bd9a52d96 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:15.473263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:15.539710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:15.543056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:15.544297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:15.548484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/users/d2cacc9102e5497d8565aef5c595d596` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:15.552889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d2cacc9102e5497d8565aef5c595d596)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:15.558716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:15.677148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2cacc9102e5497d8565aef5c595d596'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:15.678116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2cacc9102e5497d8565aef5c595d596'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:15.688793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2cacc9102e5497d8565aef5c595d596'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:15.719670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2cacc9102e5497d8565aef5c595d596'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:15.758385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2cacc9102e5497d8565aef5c595d596'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:15.778348 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3800/7557] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:15 2022] DELETE /identity/v3/users/d2cacc9102e5497d8565aef5c595d596 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:15.780273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:15.783683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:15.862438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b9541-63ab-479d-b006-98670e52fc91 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:16.175112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b9ed3e309e94146aa7d1cd44cdae75f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd306022e00b64e4e9b3eb53b8402f580', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:16.175791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:16.176078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:16.181892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] PATH_INFO: `/v3/projects/bd4daa10725b40d1b6deee0805a18358` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:16.188470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd4daa10725b40d1b6deee0805a18358)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:16.205233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:16.400107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4daa10725b40d1b6deee0805a18358', 'request_id': 'req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:16.427080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4daa10725b40d1b6deee0805a18358', 'request_id': 'req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:16.453930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4daa10725b40d1b6deee0805a18358', 'request_id': 'req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:16.529797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] The token cache is being invalidate because project bd4daa10725b40d1b6deee0805a18358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:16.530492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:16.538508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:16.552553 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3758/7558] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:15 2022] DELETE /identity/v3/projects/bd4daa10725b40d1b6deee0805a18358 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:16.561092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:16.568609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:16.813640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590ef2e-65e6-4559-baa7-8e616eee2ec1 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:16.969585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:16.970624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:16.971081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:17.002152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] PATH_INFO: `/v3/users/4fe747bad86e48639f8daef44f647687` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:17.003868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe747bad86e48639f8daef44f647687)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:17.009416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:17.037130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:17.125198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:17.128209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:17.157328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee8a2a4-ca9f-4964-92de-2b24d2b53f26 tempest-TrustsV3TestJSON-1157260429 tempest-TrustsV3TestJSON-1157260429-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:17.170651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:17.171737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:17.172247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:17.172740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] PATH_INFO: `/v3/users/0a9edf409f064ddf8a0c0973c7b56040` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:17.174291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9edf409f064ddf8a0c0973c7b56040)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:17.180486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:17.197589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:17.209418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe747bad86e48639f8daef44f647687'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:17.214131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe747bad86e48639f8daef44f647687'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:17.228262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe747bad86e48639f8daef44f647687'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:17.248987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe747bad86e48639f8daef44f647687'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:17.298683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-420aac55-40c4-485e-916d-285f9459c5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe747bad86e48639f8daef44f647687'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:17.323339 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3801/7559] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:16 2022] DELETE /identity/v3/users/4fe747bad86e48639f8daef44f647687 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:17.332003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487b756-a9b8-47b4-bc28-c5bf78e476ae None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:17.333001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487b756-a9b8-47b4-bc28-c5bf78e476ae None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:17.333584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9edf409f064ddf8a0c0973c7b56040'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:17.335247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487b756-a9b8-47b4-bc28-c5bf78e476ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:17.358536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9edf409f064ddf8a0c0973c7b56040'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:17.391203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7487b756-a9b8-47b4-bc28-c5bf78e476ae None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:17.396838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7487b756-a9b8-47b4-bc28-c5bf78e476ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:17.398515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9edf409f064ddf8a0c0973c7b56040'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:17.426795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9edf409f064ddf8a0c0973c7b56040'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:17.428640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-41b851f2-a314-418b-a8bf-b4c3369aa1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9edf409f064ddf8a0c0973c7b56040'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:17.451029 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3759/7560] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:17 2022] DELETE /identity/v3/users/0a9edf409f064ddf8a0c0973c7b56040 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:17.456698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad25f7-88cf-424f-864a-04b65dd86711 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:17.458795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad25f7-88cf-424f-864a-04b65dd86711 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:17.461768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad25f7-88cf-424f-864a-04b65dd86711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:17.569295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b7ad25f7-88cf-424f-864a-04b65dd86711 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:17.573724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b7ad25f7-88cf-424f-864a-04b65dd86711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:17.694694 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3802/7561] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:17.708408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487b756-a9b8-47b4-bc28-c5bf78e476ae None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:17.709643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7487b756-a9b8-47b4-bc28-c5bf78e476ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:17.785924 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3760/7562] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:17.796542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad25f7-88cf-424f-864a-04b65dd86711 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:17.798432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b7ad25f7-88cf-424f-864a-04b65dd86711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:18.035254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad25f7-88cf-424f-864a-04b65dd86711 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:18.051221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96482311-ec9d-43db-8607-92344f7f9803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:18.052039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482311-ec9d-43db-8607-92344f7f9803 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:18.052422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482311-ec9d-43db-8607-92344f7f9803 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:18.052805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96482311-ec9d-43db-8607-92344f7f9803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:18.067436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487b756-a9b8-47b4-bc28-c5bf78e476ae None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:18.088049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96482311-ec9d-43db-8607-92344f7f9803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:18.089533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96482311-ec9d-43db-8607-92344f7f9803 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:18.090612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f9094-00c4-45c2-b2ea-6f82fb17b9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:18.091264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f9094-00c4-45c2-b2ea-6f82fb17b9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:18.091655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f9094-00c4-45c2-b2ea-6f82fb17b9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:18.091820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f9094-00c4-45c2-b2ea-6f82fb17b9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:18.122268 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3761/7563] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:18.156024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f9094-00c4-45c2-b2ea-6f82fb17b9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:18.161473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f9094-00c4-45c2-b2ea-6f82fb17b9c0 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:18.211033 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3803/7564] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:20.765818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96482311-ec9d-43db-8607-92344f7f9803 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:20.767439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-96482311-ec9d-43db-8607-92344f7f9803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:20.810437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96482311-ec9d-43db-8607-92344f7f9803 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:20.838855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:20.840619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:20.844159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:20.845044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] PATH_INFO: `/v3/projects/523783246c234ab2b94d51bcfca68bce` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:20.850116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523783246c234ab2b94d51bcfca68bce)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:20.861950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:20.995425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:21.072078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523783246c234ab2b94d51bcfca68bce', 'request_id': 'req-e782431f-d49c-4683-bde9-18799a61cf20'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:21.109289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523783246c234ab2b94d51bcfca68bce', 'request_id': 'req-e782431f-d49c-4683-bde9-18799a61cf20'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:21.124378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523783246c234ab2b94d51bcfca68bce', 'request_id': 'req-e782431f-d49c-4683-bde9-18799a61cf20'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:21.152388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] The token cache is being invalidate because project 523783246c234ab2b94d51bcfca68bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:21.152959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:21.155348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:21.158671 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3762/7565] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:20 2022] DELETE /identity/v3/projects/523783246c234ab2b94d51bcfca68bce => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:21.162725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f9094-00c4-45c2-b2ea-6f82fb17b9c0 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:21.178355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f9094-00c4-45c2-b2ea-6f82fb17b9c0 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:21.380953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:21.520060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:21.524115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:21.524397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:21.524672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] PATH_INFO: `/v3/users/7b9ed3e309e94146aa7d1cd44cdae75f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:21.530726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9ed3e309e94146aa7d1cd44cdae75f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:21.549937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:21.933249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9ed3e309e94146aa7d1cd44cdae75f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:21.935282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9ed3e309e94146aa7d1cd44cdae75f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:22.041990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9ed3e309e94146aa7d1cd44cdae75f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:22.066624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9ed3e309e94146aa7d1cd44cdae75f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:22.076259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:22.078782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:22.115992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782431f-d49c-4683-bde9-18799a61cf20 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:22.120640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9ed3e309e94146aa7d1cd44cdae75f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:22.136741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:22.162225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:22.162943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:22.163566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] PATH_INFO: `/v3/projects/6d5bbcb86f0f4b57bc982115e7579802` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:22.168279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5bbcb86f0f4b57bc982115e7579802)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:22.189531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:22.190673 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3804/7566] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:21 2022] DELETE /identity/v3/users/7b9ed3e309e94146aa7d1cd44cdae75f => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:22.409859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5bbcb86f0f4b57bc982115e7579802', 'request_id': 'req-09165ccd-bd49-4ced-837f-e643183e1c0a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:22.438640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5bbcb86f0f4b57bc982115e7579802', 'request_id': 'req-09165ccd-bd49-4ced-837f-e643183e1c0a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:22.448506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5bbcb86f0f4b57bc982115e7579802', 'request_id': 'req-09165ccd-bd49-4ced-837f-e643183e1c0a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:22.510488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] The token cache is being invalidate because project 6d5bbcb86f0f4b57bc982115e7579802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:22.513831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:22.517232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:22.527164 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3763/7567] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:22 2022] DELETE /identity/v3/projects/6d5bbcb86f0f4b57bc982115e7579802 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:22.531638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:22.533560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:22.809230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebb6d9-8924-421c-8a30-4e4e51cd1735 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:23.162850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:23.163521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:23.163803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:23.164084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] PATH_INFO: `/v3/users/e10035f5d7814d6b9b98b921e38184e0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:23.174447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e10035f5d7814d6b9b98b921e38184e0)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:23.176392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:23.178253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:23.477600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e10035f5d7814d6b9b98b921e38184e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:23.480403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e10035f5d7814d6b9b98b921e38184e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:23.538889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e10035f5d7814d6b9b98b921e38184e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:23.588075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e10035f5d7814d6b9b98b921e38184e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:23.602227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:23.603739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:23.663243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09165ccd-bd49-4ced-837f-e643183e1c0a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:23.664746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d9761edc-0af3-41d2-94d2-b54e412dba45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e10035f5d7814d6b9b98b921e38184e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:23.684885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:23.685725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:23.689428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:23.689706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] PATH_INFO: `/v3/projects/d306022e00b64e4e9b3eb53b8402f580` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:23.694123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d306022e00b64e4e9b3eb53b8402f580)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:23.694989 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3805/7568] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:22 2022] DELETE /identity/v3/users/e10035f5d7814d6b9b98b921e38184e0 => generated 0 bytes in 1164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:23.705707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:23.981823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd306022e00b64e4e9b3eb53b8402f580', 'request_id': 'req-8c7a790e-ca87-43fe-8485-c1d076393c15'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:24.073288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd306022e00b64e4e9b3eb53b8402f580', 'request_id': 'req-8c7a790e-ca87-43fe-8485-c1d076393c15'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:24.114634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd306022e00b64e4e9b3eb53b8402f580', 'request_id': 'req-8c7a790e-ca87-43fe-8485-c1d076393c15'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:24.158531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] The token cache is being invalidate because project d306022e00b64e4e9b3eb53b8402f580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:24.159286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:24.163260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8c7a790e-ca87-43fe-8485-c1d076393c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:24.170143 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3764/7569] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:23 2022] DELETE /identity/v3/projects/d306022e00b64e4e9b3eb53b8402f580 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:24.175219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b127-bbed-4190-a061-6353fcdec520 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:24.175636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b127-bbed-4190-a061-6353fcdec520 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:24.176018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b127-bbed-4190-a061-6353fcdec520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:24.210922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9701b127-bbed-4190-a061-6353fcdec520 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:24.218478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9701b127-bbed-4190-a061-6353fcdec520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:24.391335 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3806/7570] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:48:24.399482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67968-69d6-4863-8ea2-588375d237b7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:24.400057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67968-69d6-4863-8ea2-588375d237b7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:24.400552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a67968-69d6-4863-8ea2-588375d237b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:24.457420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d2a67968-69d6-4863-8ea2-588375d237b7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:24.465811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d2a67968-69d6-4863-8ea2-588375d237b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:24.510766 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3765/7571] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:24.512004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701b127-bbed-4190-a061-6353fcdec520 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:24.530375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701b127-bbed-4190-a061-6353fcdec520 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:24.542096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daef47-1f24-4774-89de-8708983c6299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:24.543139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daef47-1f24-4774-89de-8708983c6299 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:24.543694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daef47-1f24-4774-89de-8708983c6299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:24.544207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daef47-1f24-4774-89de-8708983c6299 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:24.545126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09daef47-1f24-4774-89de-8708983c6299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:48:24.546204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09daef47-1f24-4774-89de-8708983c6299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:24.548099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09daef47-1f24-4774-89de-8708983c6299 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:24.580106 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3807/7572] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:24.584219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a67968-69d6-4863-8ea2-588375d237b7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:24.599867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a67968-69d6-4863-8ea2-588375d237b7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:24.606260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f6fa0-5dfd-4138-95d8-055a66ccb951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:24.607726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f6fa0-5dfd-4138-95d8-055a66ccb951 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:24.608321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f6fa0-5dfd-4138-95d8-055a66ccb951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:24.608987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f6fa0-5dfd-4138-95d8-055a66ccb951 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:24.609946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f6fa0-5dfd-4138-95d8-055a66ccb951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:24.612931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f6fa0-5dfd-4138-95d8-055a66ccb951 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:24.632819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=78,keystone:DELETE=19,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:24.669550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daef47-1f24-4774-89de-8708983c6299 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:24.671692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-09daef47-1f24-4774-89de-8708983c6299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:24.697936 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3766/7573] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:48:24 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:24.702944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f6fa0-5dfd-4138-95d8-055a66ccb951 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:24.721130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daef47-1f24-4774-89de-8708983c6299 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:24.909539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f6fa0-5dfd-4138-95d8-055a66ccb951 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:24.917084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:24.917918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:24.918434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:24.920021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] PATH_INFO: `/v3/projects/53eb4b0dff2d48f3a6c872d573ea8e24` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:24.923909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53eb4b0dff2d48f3a6c872d573ea8e24)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:24.925067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a9641-caf1-4e5b-ab96-25d2438f25b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:24.927224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:24.929115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a9641-caf1-4e5b-ab96-25d2438f25b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:24.929627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a9641-caf1-4e5b-ab96-25d2438f25b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:24.932460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a9641-caf1-4e5b-ab96-25d2438f25b1 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:24.934298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a9641-caf1-4e5b-ab96-25d2438f25b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:24.945453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a9641-caf1-4e5b-ab96-25d2438f25b1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:24.963730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:25.011638 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3767/7574] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:48:24 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:25.014749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a9641-caf1-4e5b-ab96-25d2438f25b1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:25.042775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a9641-caf1-4e5b-ab96-25d2438f25b1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:25.072646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53eb4b0dff2d48f3a6c872d573ea8e24', 'request_id': 'req-c011c720-cba4-4728-8140-230159ebfe0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:25.084647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53eb4b0dff2d48f3a6c872d573ea8e24', 'request_id': 'req-c011c720-cba4-4728-8140-230159ebfe0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:25.094817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53eb4b0dff2d48f3a6c872d573ea8e24', 'request_id': 'req-c011c720-cba4-4728-8140-230159ebfe0d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:25.109438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] The token cache is being invalidate because project 53eb4b0dff2d48f3a6c872d573ea8e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:25.109758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:25.110947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:25.116247 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3808/7575] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:24 2022] DELETE /identity/v3/projects/53eb4b0dff2d48f3a6c872d573ea8e24 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:25.118014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:25.119984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:25.204393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c0de7-0af6-40f5-be89-62b0f6f79663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:25.204945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c0de7-0af6-40f5-be89-62b0f6f79663 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:25.205225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c0de7-0af6-40f5-be89-62b0f6f79663 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:25.205494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c0de7-0af6-40f5-be89-62b0f6f79663 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:25.206213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c0de7-0af6-40f5-be89-62b0f6f79663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:25.207877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c0de7-0af6-40f5-be89-62b0f6f79663 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:25.248225 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3768/7576] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:25.249293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c0de7-0af6-40f5-be89-62b0f6f79663 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:25.258068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-238c0de7-0af6-40f5-be89-62b0f6f79663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:25.276997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011c720-cba4-4728-8140-230159ebfe0d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:25.288082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:25.294853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:25.297624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:25.298066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] PATH_INFO: `/v3/users/a9caa8fe79cf4b7f81b4a3482c961663` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:25.300086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9caa8fe79cf4b7f81b4a3482c961663)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:25.305580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:25.311559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c0de7-0af6-40f5-be89-62b0f6f79663 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:25.339068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353150eb-8af0-4345-8c84-63882f149072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:25.346170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353150eb-8af0-4345-8c84-63882f149072 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:25.346536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353150eb-8af0-4345-8c84-63882f149072 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:25.346810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353150eb-8af0-4345-8c84-63882f149072 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:25.350814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353150eb-8af0-4345-8c84-63882f149072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:25.358323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353150eb-8af0-4345-8c84-63882f149072 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:25.380511 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3769/7577] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:25.387065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353150eb-8af0-4345-8c84-63882f149072 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:25.409221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353150eb-8af0-4345-8c84-63882f149072 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:25.431154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3f807-6cd2-4211-8da8-3c237507bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:25.435059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3f807-6cd2-4211-8da8-3c237507bbba admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:25.440926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3f807-6cd2-4211-8da8-3c237507bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:25.441207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3f807-6cd2-4211-8da8-3c237507bbba admin admin] PATH_INFO: `/v3/projects/b0c9247018094eaa9f40cc51d208035e/users/947f9973058d454fae9e3fd58232a70b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:25.475383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9caa8fe79cf4b7f81b4a3482c961663'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:25.478294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9caa8fe79cf4b7f81b4a3482c961663'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:25.499383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9caa8fe79cf4b7f81b4a3482c961663'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:25.524295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9caa8fe79cf4b7f81b4a3482c961663'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:25.539709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3f807-6cd2-4211-8da8-3c237507bbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c9247018094eaa9f40cc51d208035e, user_id=947f9973058d454fae9e3fd58232a70b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:25.576792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3f807-6cd2-4211-8da8-3c237507bbba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:25.584691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eb7a9503-0d5d-4c1e-a05c-9abaaa9b6b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9caa8fe79cf4b7f81b4a3482c961663'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:25.603767 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3809/7578] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:25 2022] DELETE /identity/v3/users/a9caa8fe79cf4b7f81b4a3482c961663 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:25.629567 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3770/7579] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:25 2022] PUT /identity/v3/projects/b0c9247018094eaa9f40cc51d208035e/users/947f9973058d454fae9e3fd58232a70b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:25.640681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dccc08-2087-4f56-907b-10e71854b218 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:25.644790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dccc08-2087-4f56-907b-10e71854b218 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:25.645119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dccc08-2087-4f56-907b-10e71854b218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:25.762226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-27dccc08-2087-4f56-907b-10e71854b218 None None] MFA Rules not processed for user `947f9973058d454fae9e3fd58232a70b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:25.771523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-27dccc08-2087-4f56-907b-10e71854b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:25.794837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:26.144498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3f807-6cd2-4211-8da8-3c237507bbba admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:26.145048 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3810/7580] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:26.221521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3f807-6cd2-4211-8da8-3c237507bbba admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:26.262915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea15cc4-2493-43da-b8bf-c05a15681956 tempest-DefaultDomainTestJSON-138680343 tempest-DefaultDomainTestJSON-138680343-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f9973058d454fae9e3fd58232a70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0c9247018094eaa9f40cc51d208035e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:26.271097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15cc4-2493-43da-b8bf-c05a15681956 tempest-DefaultDomainTestJSON-138680343 tempest-DefaultDomainTestJSON-138680343-project] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:26.271462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15cc4-2493-43da-b8bf-c05a15681956 tempest-DefaultDomainTestJSON-138680343 tempest-DefaultDomainTestJSON-138680343-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:26.271685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea15cc4-2493-43da-b8bf-c05a15681956 tempest-DefaultDomainTestJSON-138680343 tempest-DefaultDomainTestJSON-138680343-project] PATH_INFO: `/v3/domains/default` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:26.276599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea15cc4-2493-43da-b8bf-c05a15681956 tempest-DefaultDomainTestJSON-138680343 tempest-DefaultDomainTestJSON-138680343-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:26.278399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea15cc4-2493-43da-b8bf-c05a15681956 tempest-DefaultDomainTestJSON-138680343 tempest-DefaultDomainTestJSON-138680343-project] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:26.288440 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3771/7581] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Aug 30 04:48:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:26.292271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dccc08-2087-4f56-907b-10e71854b218 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:26.294176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-27dccc08-2087-4f56-907b-10e71854b218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:26.402075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dccc08-2087-4f56-907b-10e71854b218 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:26.408878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:26.411441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:26.412029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:26.412957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] PATH_INFO: `/v3/users/947f9973058d454fae9e3fd58232a70b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:26.415736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=947f9973058d454fae9e3fd58232a70b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:26.425411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:26.509197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947f9973058d454fae9e3fd58232a70b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:26.510484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947f9973058d454fae9e3fd58232a70b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:26.523964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947f9973058d454fae9e3fd58232a70b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:26.537728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947f9973058d454fae9e3fd58232a70b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:26.557082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947f9973058d454fae9e3fd58232a70b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:26.577485 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3811/7582] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:26 2022] DELETE /identity/v3/users/947f9973058d454fae9e3fd58232a70b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:26.579955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e44f9-ef45-48ed-ae4f-059b51f62740 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:26.580397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e44f9-ef45-48ed-ae4f-059b51f62740 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:26.580726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e44f9-ef45-48ed-ae4f-059b51f62740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:26.665669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6d2e44f9-ef45-48ed-ae4f-059b51f62740 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:26.672489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6d2e44f9-ef45-48ed-ae4f-059b51f62740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:26.758718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:26.852844 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3772/7583] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:26.865150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:26.866976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:27.016458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:27.175855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cd40-d333-45a2-a601-20de8a744ddf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:27.186785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bfd90-dc62-4ebd-b2e1-22052baac932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:27.187735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bfd90-dc62-4ebd-b2e1-22052baac932 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:27.188021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bfd90-dc62-4ebd-b2e1-22052baac932 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:27.188293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bfd90-dc62-4ebd-b2e1-22052baac932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:27.207262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bfd90-dc62-4ebd-b2e1-22052baac932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:27.208727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bfd90-dc62-4ebd-b2e1-22052baac932 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:27.230193 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3812/7584] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:27.810609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e44f9-ef45-48ed-ae4f-059b51f62740 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:27.812869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6d2e44f9-ef45-48ed-ae4f-059b51f62740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:27.863371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e44f9-ef45-48ed-ae4f-059b51f62740 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:27.892805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:27.893480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:27.893760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:27.899051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] PATH_INFO: `/v3/projects/b0c9247018094eaa9f40cc51d208035e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:27.905011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c9247018094eaa9f40cc51d208035e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:27.915455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:28.148344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c9247018094eaa9f40cc51d208035e', 'request_id': 'req-44c57223-532f-4b78-a5d0-acdf465cd5a5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:28.165722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c9247018094eaa9f40cc51d208035e', 'request_id': 'req-44c57223-532f-4b78-a5d0-acdf465cd5a5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:28.180955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c9247018094eaa9f40cc51d208035e', 'request_id': 'req-44c57223-532f-4b78-a5d0-acdf465cd5a5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:28.195203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] The token cache is being invalidate because project b0c9247018094eaa9f40cc51d208035e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:28.195532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:28.196192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-44c57223-532f-4b78-a5d0-acdf465cd5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:28.201408 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3773/7585] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:27 2022] DELETE /identity/v3/projects/b0c9247018094eaa9f40cc51d208035e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:28.207666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4cf85-fe04-4f5e-abd1-b4752a67f4f3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:28.207666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4cf85-fe04-4f5e-abd1-b4752a67f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:28.208350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4cf85-fe04-4f5e-abd1-b4752a67f4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:28.275280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-03c4cf85-fe04-4f5e-abd1-b4752a67f4f3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:28.277715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-03c4cf85-fe04-4f5e-abd1-b4752a67f4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:28.418209 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3813/7586] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:28.426858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86364eb0-e387-40e1-b70e-347addc3dcc5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:28.427304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86364eb0-e387-40e1-b70e-347addc3dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:28.427672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86364eb0-e387-40e1-b70e-347addc3dcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:28.467089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-86364eb0-e387-40e1-b70e-347addc3dcc5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:28.469037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-86364eb0-e387-40e1-b70e-347addc3dcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:28.499415 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3774/7587] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:28.503807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4cf85-fe04-4f5e-abd1-b4752a67f4f3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:28.515130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4cf85-fe04-4f5e-abd1-b4752a67f4f3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:28.539507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3063-8935-4313-bc14-e37fbf9a557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:28.542074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3063-8935-4313-bc14-e37fbf9a557a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:28.542489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3063-8935-4313-bc14-e37fbf9a557a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:28.545382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c3063-8935-4313-bc14-e37fbf9a557a admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:28.546254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c3063-8935-4313-bc14-e37fbf9a557a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:48:28.549323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c3063-8935-4313-bc14-e37fbf9a557a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:28.551222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c3063-8935-4313-bc14-e37fbf9a557a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:28.619901 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3814/7588] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:28.621719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86364eb0-e387-40e1-b70e-347addc3dcc5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:28.632546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86364eb0-e387-40e1-b70e-347addc3dcc5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:28.657229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cfd70-24f4-4a6b-9a6a-7343cf840bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:28.659575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cfd70-24f4-4a6b-9a6a-7343cf840bad admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:28.660032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cfd70-24f4-4a6b-9a6a-7343cf840bad admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:28.660484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cfd70-24f4-4a6b-9a6a-7343cf840bad admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:28.663789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cfd70-24f4-4a6b-9a6a-7343cf840bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:28.667203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5cfd70-24f4-4a6b-9a6a-7343cf840bad admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:28.730756 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3775/7589] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:48:28 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:28.731642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3063-8935-4313-bc14-e37fbf9a557a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:28.749915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c3063-8935-4313-bc14-e37fbf9a557a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:28.898391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e75b83-bad1-4ecf-a34c-609a85dcf75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:28.899137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75b83-bad1-4ecf-a34c-609a85dcf75f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:28.899512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75b83-bad1-4ecf-a34c-609a85dcf75f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:28.899881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e75b83-bad1-4ecf-a34c-609a85dcf75f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:28.900742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e75b83-bad1-4ecf-a34c-609a85dcf75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:28.902932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e75b83-bad1-4ecf-a34c-609a85dcf75f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:28.975788 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3815/7590] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:48:28 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:28.980109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cfd70-24f4-4a6b-9a6a-7343cf840bad admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:28.998385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5cfd70-24f4-4a6b-9a6a-7343cf840bad admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:29.011740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd8d68-fd24-4850-871d-10acb26e7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:29.012382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd8d68-fd24-4850-871d-10acb26e7c48 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:29.012715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd8d68-fd24-4850-871d-10acb26e7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:29.022827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfd8d68-fd24-4850-871d-10acb26e7c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:29.023985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd8d68-fd24-4850-871d-10acb26e7c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:29.025663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfd8d68-fd24-4850-871d-10acb26e7c48 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:29.062816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e75b83-bad1-4ecf-a34c-609a85dcf75f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:29.063055 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3776/7591] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:29.124677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e75b83-bad1-4ecf-a34c-609a85dcf75f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:29.160544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5da76b-7d0f-4bd0-9ada-e792c164bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:29.162186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5da76b-7d0f-4bd0-9ada-e792c164bd88 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:29.163797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5da76b-7d0f-4bd0-9ada-e792c164bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:29.165868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5da76b-7d0f-4bd0-9ada-e792c164bd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:29.166792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5da76b-7d0f-4bd0-9ada-e792c164bd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:29.177350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5da76b-7d0f-4bd0-9ada-e792c164bd88 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:29.192982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd8d68-fd24-4850-871d-10acb26e7c48 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:29.194709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9bfd8d68-fd24-4850-871d-10acb26e7c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:29.219885 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3816/7592] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:29.223073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5da76b-7d0f-4bd0-9ada-e792c164bd88 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:29.231262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfd8d68-fd24-4850-871d-10acb26e7c48 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:29.257260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:29.260639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:29.260952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:29.261229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] PATH_INFO: `/v3/projects/9c936b4d09a04cbda81b46dba4fab000` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:29.263057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c936b4d09a04cbda81b46dba4fab000)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:29.265240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:29.271634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5da76b-7d0f-4bd0-9ada-e792c164bd88 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:29.299215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3530e-22b6-467c-9d24-fe85ad529638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:29.300302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3530e-22b6-467c-9d24-fe85ad529638 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:29.304950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3530e-22b6-467c-9d24-fe85ad529638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:29.305764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3530e-22b6-467c-9d24-fe85ad529638 admin admin] PATH_INFO: `/v3/projects/66af965de1b848e88cfc26dcc1e0eb5a/users/33cb865953334ef9bfcea5f7de72db07/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:29.375299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3530e-22b6-467c-9d24-fe85ad529638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66af965de1b848e88cfc26dcc1e0eb5a, user_id=33cb865953334ef9bfcea5f7de72db07, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:29.388167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3530e-22b6-467c-9d24-fe85ad529638 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:29.431150 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3817/7593] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:29 2022] PUT /identity/v3/projects/66af965de1b848e88cfc26dcc1e0eb5a/users/33cb865953334ef9bfcea5f7de72db07/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:29.444660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa498e5f-bba5-4797-882d-4c3a288c917c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:29.444941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa498e5f-bba5-4797-882d-4c3a288c917c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:29.445217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa498e5f-bba5-4797-882d-4c3a288c917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:29.487444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:29.512726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fa498e5f-bba5-4797-882d-4c3a288c917c None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:29.514329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fa498e5f-bba5-4797-882d-4c3a288c917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:29.520105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c936b4d09a04cbda81b46dba4fab000', 'request_id': 'req-445df8b3-4413-4efe-a8a6-2b222067b1ab'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:29.571306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c936b4d09a04cbda81b46dba4fab000', 'request_id': 'req-445df8b3-4413-4efe-a8a6-2b222067b1ab'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:29.599769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c936b4d09a04cbda81b46dba4fab000', 'request_id': 'req-445df8b3-4413-4efe-a8a6-2b222067b1ab'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:29.629637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] The token cache is being invalidate because project 9c936b4d09a04cbda81b46dba4fab000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:29.631194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:29.635133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-445df8b3-4413-4efe-a8a6-2b222067b1ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:29.637952 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3777/7594] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:29 2022] DELETE /identity/v3/projects/9c936b4d09a04cbda81b46dba4fab000 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:29.642914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a026d51-5d15-426a-acd5-5a1067534e50 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:29.643196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a026d51-5d15-426a-acd5-5a1067534e50 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:29.643469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a026d51-5d15-426a-acd5-5a1067534e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:29.698720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:29.714559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4a026d51-5d15-426a-acd5-5a1067534e50 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:29.716077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4a026d51-5d15-426a-acd5-5a1067534e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:29.857676 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3818/7595] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:29.858695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa498e5f-bba5-4797-882d-4c3a288c917c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:29.873609 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3778/7596] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:29.881397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8676-3e27-4ddf-a512-d31524da51de None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:29.882075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8676-3e27-4ddf-a512-d31524da51de None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:29.882501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c8676-3e27-4ddf-a512-d31524da51de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:29.912579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa498e5f-bba5-4797-882d-4c3a288c917c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:29.928894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-580c8676-3e27-4ddf-a512-d31524da51de None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:29.933127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-580c8676-3e27-4ddf-a512-d31524da51de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:29.956008 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3779/7597] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:48:29.957303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe230d1-83e0-457d-9eda-230217a7b0a9 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:29.958842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8676-3e27-4ddf-a512-d31524da51de None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:29.962109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe230d1-83e0-457d-9eda-230217a7b0a9 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:29.965688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe230d1-83e0-457d-9eda-230217a7b0a9 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:29.966925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe230d1-83e0-457d-9eda-230217a7b0a9 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:29.976452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c8676-3e27-4ddf-a512-d31524da51de None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:29.998663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa7d5f-a6d9-40fc-8397-871eb4d89d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:29.999388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa7d5f-a6d9-40fc-8397-871eb4d89d87 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:30.000290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa7d5f-a6d9-40fc-8397-871eb4d89d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:30.000716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa7d5f-a6d9-40fc-8397-871eb4d89d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:30.002028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa7d5f-a6d9-40fc-8397-871eb4d89d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:48:30.002508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa7d5f-a6d9-40fc-8397-871eb4d89d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:30.005943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa7d5f-a6d9-40fc-8397-871eb4d89d87 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:30.064812 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3780/7598] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:30.067469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa7d5f-a6d9-40fc-8397-871eb4d89d87 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:30.099076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa7d5f-a6d9-40fc-8397-871eb4d89d87 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:30.119162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8ead-a023-4bbe-af3d-0d115fdf03e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:30.119716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8ead-a023-4bbe-af3d-0d115fdf03e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:30.119995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8ead-a023-4bbe-af3d-0d115fdf03e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:30.120265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8ead-a023-4bbe-af3d-0d115fdf03e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:30.120907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec8ead-a023-4bbe-af3d-0d115fdf03e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:30.122891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec8ead-a023-4bbe-af3d-0d115fdf03e7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:30.169009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1fe230d1-83e0-457d-9eda-230217a7b0a9 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:30.204563 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3819/7599] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:29 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:30.231355 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3781/7600] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:48:30 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:30.237415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe230d1-83e0-457d-9eda-230217a7b0a9 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:30.277390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe230d1-83e0-457d-9eda-230217a7b0a9 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:30.605973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0547017-030d-45de-a14d-4c922734396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:30.606645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0547017-030d-45de-a14d-4c922734396c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:30.606928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0547017-030d-45de-a14d-4c922734396c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:30.607199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0547017-030d-45de-a14d-4c922734396c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:30.617164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0547017-030d-45de-a14d-4c922734396c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:30.621971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0547017-030d-45de-a14d-4c922734396c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:30.726258 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3820/7601] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:48:30 2022] POST /identity/v3/users => generated 288 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:30.727552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8ead-a023-4bbe-af3d-0d115fdf03e7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:30.741816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8ead-a023-4bbe-af3d-0d115fdf03e7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:30.778612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05721c1e-9a4b-45d6-988b-6c5c295658ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:30.779257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05721c1e-9a4b-45d6-988b-6c5c295658ea admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:30.779541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05721c1e-9a4b-45d6-988b-6c5c295658ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:30.779907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05721c1e-9a4b-45d6-988b-6c5c295658ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:30.780750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05721c1e-9a4b-45d6-988b-6c5c295658ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:30.791231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05721c1e-9a4b-45d6-988b-6c5c295658ea admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:30.818459 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3782/7602] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:30.822210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0547017-030d-45de-a14d-4c922734396c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:30.842239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0547017-030d-45de-a14d-4c922734396c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:30.852460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d62b8-b1af-4a48-a7ef-c4e69da177ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:30.853169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d62b8-b1af-4a48-a7ef-c4e69da177ab admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:30.853457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d62b8-b1af-4a48-a7ef-c4e69da177ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:30.853728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d62b8-b1af-4a48-a7ef-c4e69da177ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:30.854456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d62b8-b1af-4a48-a7ef-c4e69da177ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:30.858247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d62b8-b1af-4a48-a7ef-c4e69da177ab admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:30.888348 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3821/7603] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:48:30.888570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05721c1e-9a4b-45d6-988b-6c5c295658ea admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:30.906529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05721c1e-9a4b-45d6-988b-6c5c295658ea admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:30.911469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527605a-d95b-4874-8fdd-cf507d182938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:30.912321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527605a-d95b-4874-8fdd-cf507d182938 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:30.912657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527605a-d95b-4874-8fdd-cf507d182938 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:30.913122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527605a-d95b-4874-8fdd-cf507d182938 admin admin] PATH_INFO: `/v3/projects/031e23f91c9e4f68822423ecb65e3b16/users/f89a6da82f9649798cce2ee71a9950e0/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:30.938799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527605a-d95b-4874-8fdd-cf507d182938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=031e23f91c9e4f68822423ecb65e3b16, user_id=f89a6da82f9649798cce2ee71a9950e0, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:30.941909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527605a-d95b-4874-8fdd-cf507d182938 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:30.969927 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3783/7604] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:30 2022] PUT /identity/v3/projects/031e23f91c9e4f68822423ecb65e3b16/users/f89a6da82f9649798cce2ee71a9950e0/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:30.973839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d33a4-c807-429a-8f3b-d1ae84dff79b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:30.973839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d33a4-c807-429a-8f3b-d1ae84dff79b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:30.974427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d33a4-c807-429a-8f3b-d1ae84dff79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:31.031753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5d5d33a4-c807-429a-8f3b-d1ae84dff79b None None] MFA Rules not processed for user `f89a6da82f9649798cce2ee71a9950e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:31.036596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5d5d33a4-c807-429a-8f3b-d1ae84dff79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:31.147250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:31.153805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527605a-d95b-4874-8fdd-cf507d182938 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:31.155651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0527605a-d95b-4874-8fdd-cf507d182938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:31.246947 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3822/7605] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:31.249304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57427880-4c81-4f1b-bf72-c96c9b745f22 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:31.249973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57427880-4c81-4f1b-bf72-c96c9b745f22 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:31.259435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57427880-4c81-4f1b-bf72-c96c9b745f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:31.288143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-57427880-4c81-4f1b-bf72-c96c9b745f22 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:31.289741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-57427880-4c81-4f1b-bf72-c96c9b745f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:31.293276 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3823/7606] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:31 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:31.298813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57427880-4c81-4f1b-bf72-c96c9b745f22 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:31.300497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-57427880-4c81-4f1b-bf72-c96c9b745f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:31.384944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57427880-4c81-4f1b-bf72-c96c9b745f22 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:31.394409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527605a-d95b-4874-8fdd-cf507d182938 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:31.400905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efec53b-08af-4048-9633-1feab9235ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:31.401857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efec53b-08af-4048-9633-1feab9235ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:31.402569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efec53b-08af-4048-9633-1feab9235ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:31.402680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efec53b-08af-4048-9633-1feab9235ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:31.409333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:31.410057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:31.410434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:31.410716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] PATH_INFO: `/v3/users/e512a01ad9e64f47859cfb0e05d60f69` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:31.415374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] RBAC: Authorizing `identity:delete_user(user_id=e512a01ad9e64f47859cfb0e05d60f69)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:31.417718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:31.419915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efec53b-08af-4048-9633-1feab9235ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:31.421837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efec53b-08af-4048-9633-1feab9235ed1 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:31.477755 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3824/7607] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:31.481777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b708-e078-4ec7-9268-e56416ad37fe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:31.492633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b708-e078-4ec7-9268-e56416ad37fe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:31.493325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b708-e078-4ec7-9268-e56416ad37fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:31.545366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:31.589384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e512a01ad9e64f47859cfb0e05d60f69'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:31.598974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-92a6b708-e078-4ec7-9268-e56416ad37fe None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:31.600199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-92a6b708-e078-4ec7-9268-e56416ad37fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:31.607708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e512a01ad9e64f47859cfb0e05d60f69'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:31.648215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e512a01ad9e64f47859cfb0e05d60f69'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:31.676361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e512a01ad9e64f47859cfb0e05d60f69'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:31.677686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-4a199a1b-69bd-44f7-ad10-97e9901c05df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e512a01ad9e64f47859cfb0e05d60f69'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:31.691455 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3784/7608] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:31 2022] DELETE /identity/v3/users/e512a01ad9e64f47859cfb0e05d60f69 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:31.692697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81669086-b2df-47f6-85e7-907d91915484 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:31.692986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81669086-b2df-47f6-85e7-907d91915484 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:31.693318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81669086-b2df-47f6-85e7-907d91915484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:31.749128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-81669086-b2df-47f6-85e7-907d91915484 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:31.755163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-81669086-b2df-47f6-85e7-907d91915484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:31.842951 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3825/7609] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:31.844651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6b708-e078-4ec7-9268-e56416ad37fe None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:31.884717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6b708-e078-4ec7-9268-e56416ad37fe None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:31.927243 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3785/7610] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:31.939095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81669086-b2df-47f6-85e7-907d91915484 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:31.940835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-81669086-b2df-47f6-85e7-907d91915484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:32.097318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81669086-b2df-47f6-85e7-907d91915484 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:32.120871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881d27-f647-4812-b87d-c3d6eea0bce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:32.121519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881d27-f647-4812-b87d-c3d6eea0bce0 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:32.121797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881d27-f647-4812-b87d-c3d6eea0bce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:32.122089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25881d27-f647-4812-b87d-c3d6eea0bce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:32.134566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc2a1-735a-4a0c-ba10-a54c4f0c9ca3 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:32.140872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc2a1-735a-4a0c-ba10-a54c4f0c9ca3 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:32.142775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc2a1-735a-4a0c-ba10-a54c4f0c9ca3 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:32.143133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffc2a1-735a-4a0c-ba10-a54c4f0c9ca3 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:32.143330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881d27-f647-4812-b87d-c3d6eea0bce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:32.146965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25881d27-f647-4812-b87d-c3d6eea0bce0 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:32.172114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3786/7611] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-40ffc2a1-735a-4a0c-ba10-a54c4f0c9ca3 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:48:32.335444 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 30 04:48:32.336951 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 04:48:32.341340 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3826/7612] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:31 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 188 bytes in 498 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 30 04:48:32.345775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881d27-f647-4812-b87d-c3d6eea0bce0 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:32.359714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25881d27-f647-4812-b87d-c3d6eea0bce0 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:32.386671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d28629-7e57-41f7-9cc6-70d3d13dbb8e tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:32.387529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d28629-7e57-41f7-9cc6-70d3d13dbb8e tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:32.387908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d28629-7e57-41f7-9cc6-70d3d13dbb8e tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:32.388270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d28629-7e57-41f7-9cc6-70d3d13dbb8e tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-71d28629-7e57-41f7-9cc6-70d3d13dbb8e tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:48:32.498069 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 30 04:48:32.499425 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:32.505702 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3787/7613] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:32 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 188 bytes in 161 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 30 04:48:32.510820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc2a1-735a-4a0c-ba10-a54c4f0c9ca3 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:32.518134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:32.524280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffc2a1-735a-4a0c-ba10-a54c4f0c9ca3 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:32.570885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00d677-9847-4ab6-9131-dc05ae4fc3bb tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:32.572465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d677-9847-4ab6-9131-dc05ae4fc3bb tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:32.572913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d677-9847-4ab6-9131-dc05ae4fc3bb tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:32.573330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00d677-9847-4ab6-9131-dc05ae4fc3bb tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:32.738798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d28629-7e57-41f7-9cc6-70d3d13dbb8e tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:32.740704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-71d28629-7e57-41f7-9cc6-70d3d13dbb8e tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:32.744071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0b00d677-9847-4ab6-9131-dc05ae4fc3bb tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:32.784520 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3827/7614] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:32 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:32.788280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d28629-7e57-41f7-9cc6-70d3d13dbb8e tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:32.808792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:32.809466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:32.809738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:32.810046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] PATH_INFO: `/v3/projects/d22d16ab7afa47558203f0c43b861d5a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:32.818042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22d16ab7afa47558203f0c43b861d5a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:32.820032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:32.908755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:32.969180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22d16ab7afa47558203f0c43b861d5a', 'request_id': 'req-913320c0-7d1b-4358-857f-2be33f8a563c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:33.003355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22d16ab7afa47558203f0c43b861d5a', 'request_id': 'req-913320c0-7d1b-4358-857f-2be33f8a563c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:33.041190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22d16ab7afa47558203f0c43b861d5a', 'request_id': 'req-913320c0-7d1b-4358-857f-2be33f8a563c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:33.084649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] The token cache is being invalidate because project d22d16ab7afa47558203f0c43b861d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:33.085221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:33.092064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-913320c0-7d1b-4358-857f-2be33f8a563c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:33.105416 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3788/7615] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:32 2022] DELETE /identity/v3/projects/d22d16ab7afa47558203f0c43b861d5a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:33.112011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a34e-bb38-4e6c-9415-05efdde03c34 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:33.112155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a34e-bb38-4e6c-9415-05efdde03c34 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:33.112356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10a34e-bb38-4e6c-9415-05efdde03c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:33.169651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0c10a34e-bb38-4e6c-9415-05efdde03c34 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:33.175676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0c10a34e-bb38-4e6c-9415-05efdde03c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:33.318892 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3828/7616] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:33.333479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e22962-5a7e-4084-94ef-12fbcb3a4ac9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:33.334487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e22962-5a7e-4084-94ef-12fbcb3a4ac9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:33.334919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e22962-5a7e-4084-94ef-12fbcb3a4ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:33.434936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-61e22962-5a7e-4084-94ef-12fbcb3a4ac9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:33.440367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-61e22962-5a7e-4084-94ef-12fbcb3a4ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:33.475489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10a34e-bb38-4e6c-9415-05efdde03c34 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:33.476302 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3789/7617] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:33.512568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10a34e-bb38-4e6c-9415-05efdde03c34 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:33.542490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9191402-3665-4d50-8e7d-0f5d4efcc831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:33.543132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191402-3665-4d50-8e7d-0f5d4efcc831 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:33.543408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191402-3665-4d50-8e7d-0f5d4efcc831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:33.543681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191402-3665-4d50-8e7d-0f5d4efcc831 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:33.544346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9191402-3665-4d50-8e7d-0f5d4efcc831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:48:33.544940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9191402-3665-4d50-8e7d-0f5d4efcc831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:33.547874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9191402-3665-4d50-8e7d-0f5d4efcc831 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:33.603894 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3829/7618] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:48:33.608526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e22962-5a7e-4084-94ef-12fbcb3a4ac9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:33.645037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e22962-5a7e-4084-94ef-12fbcb3a4ac9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:33.659498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452871d9-5031-498c-936e-d57ebfedd990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:33.660363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452871d9-5031-498c-936e-d57ebfedd990 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:33.663197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452871d9-5031-498c-936e-d57ebfedd990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:33.663585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452871d9-5031-498c-936e-d57ebfedd990 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:33.664353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452871d9-5031-498c-936e-d57ebfedd990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:33.666488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452871d9-5031-498c-936e-d57ebfedd990 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:33.782351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9191402-3665-4d50-8e7d-0f5d4efcc831 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:33.785917 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3790/7619] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:48:33 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:33.791273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418b368-cb70-4b10-a77f-d1b749f055f9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:33.791558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418b368-cb70-4b10-a77f-d1b749f055f9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:33.791834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418b368-cb70-4b10-a77f-d1b749f055f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:33.799806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9191402-3665-4d50-8e7d-0f5d4efcc831 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:33.931240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e418b368-cb70-4b10-a77f-d1b749f055f9 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:33.932483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e418b368-cb70-4b10-a77f-d1b749f055f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:33.964973 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3791/7620] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:33 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:33.975871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064a1e0-f638-4bae-9536-1c9dca8c53f4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:33.976188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064a1e0-f638-4bae-9536-1c9dca8c53f4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:33.976463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064a1e0-f638-4bae-9536-1c9dca8c53f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:34.025104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cb22c-6aad-467f-a142-2e0db0dc44bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:34.025942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb22c-6aad-467f-a142-2e0db0dc44bf admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:34.026365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb22c-6aad-467f-a142-2e0db0dc44bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:34.026731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cb22c-6aad-467f-a142-2e0db0dc44bf admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:34.027484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cb22c-6aad-467f-a142-2e0db0dc44bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:34.029578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cb22c-6aad-467f-a142-2e0db0dc44bf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:34.069444 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3830/7621] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:48:33 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:48:34.074654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cb22c-6aad-467f-a142-2e0db0dc44bf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:34.074873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b064a1e0-f638-4bae-9536-1c9dca8c53f4 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:34.079092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b064a1e0-f638-4bae-9536-1c9dca8c53f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:34.097057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cb22c-6aad-467f-a142-2e0db0dc44bf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:34.108631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8f8c4-ce7d-4420-a080-e8fa47455777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:34.113297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f8c4-ce7d-4420-a080-e8fa47455777 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:34.113738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f8c4-ce7d-4420-a080-e8fa47455777 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:34.114129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f8c4-ce7d-4420-a080-e8fa47455777 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:34.115072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8f8c4-ce7d-4420-a080-e8fa47455777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:34.119137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8f8c4-ce7d-4420-a080-e8fa47455777 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:34.150870 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3831/7622] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:34.154776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8f8c4-ce7d-4420-a080-e8fa47455777 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:34.180691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8f8c4-ce7d-4420-a080-e8fa47455777 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:34.194045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde390e7-aa55-499f-999f-03bbd0eda4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:34.195424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde390e7-aa55-499f-999f-03bbd0eda4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:34.195424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde390e7-aa55-499f-999f-03bbd0eda4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:34.198161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde390e7-aa55-499f-999f-03bbd0eda4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:34.199780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde390e7-aa55-499f-999f-03bbd0eda4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:34.202707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde390e7-aa55-499f-999f-03bbd0eda4e9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:34.220468 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3792/7623] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:34.227374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064a1e0-f638-4bae-9536-1c9dca8c53f4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:34.233742 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3832/7624] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:34.236744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde390e7-aa55-499f-999f-03bbd0eda4e9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:34.248416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064a1e0-f638-4bae-9536-1c9dca8c53f4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:34.259771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde390e7-aa55-499f-999f-03bbd0eda4e9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:34.260637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092121f5-5fa0-42a9-9580-b2081c689146 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:34.261431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092121f5-5fa0-42a9-9580-b2081c689146 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:34.262377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092121f5-5fa0-42a9-9580-b2081c689146 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:34.262758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092121f5-5fa0-42a9-9580-b2081c689146 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:34.272526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76c63c-2cad-40d1-a8e4-45cddaede8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:34.273352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c63c-2cad-40d1-a8e4-45cddaede8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:34.273728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c63c-2cad-40d1-a8e4-45cddaede8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:34.274188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c63c-2cad-40d1-a8e4-45cddaede8b8 admin admin] PATH_INFO: `/v3/projects/8d00025ae6ef466ba248ec13cb602d9c/users/39bca3fbaa494b45bd49b6a0b28a55a7/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:34.316870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76c63c-2cad-40d1-a8e4-45cddaede8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d00025ae6ef466ba248ec13cb602d9c, user_id=39bca3fbaa494b45bd49b6a0b28a55a7, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:34.326839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76c63c-2cad-40d1-a8e4-45cddaede8b8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:34.378396 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3833/7625] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:34 2022] PUT /identity/v3/projects/8d00025ae6ef466ba248ec13cb602d9c/users/39bca3fbaa494b45bd49b6a0b28a55a7/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:34.390442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138010a-146a-47a3-bba2-26b538063954 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:34.390735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138010a-146a-47a3-bba2-26b538063954 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:34.391011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138010a-146a-47a3-bba2-26b538063954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:34.395703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-092121f5-5fa0-42a9-9580-b2081c689146 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:34.424019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:34.429444 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3793/7626] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:34 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:34.489837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d138010a-146a-47a3-bba2-26b538063954 None None] MFA Rules not processed for user `39bca3fbaa494b45bd49b6a0b28a55a7`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:34.491760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d138010a-146a-47a3-bba2-26b538063954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:34.723658 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3834/7627] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:48:34.737626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092121f5-5fa0-42a9-9580-b2081c689146 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:34.739898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-092121f5-5fa0-42a9-9580-b2081c689146 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:34.936739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=8,keystone:SELECT=87,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:34.963306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092121f5-5fa0-42a9-9580-b2081c689146 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:35.202563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57a2bf-dd86-4ec4-bded-42f6abbe3797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:35.204448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57a2bf-dd86-4ec4-bded-42f6abbe3797 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:35.204879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57a2bf-dd86-4ec4-bded-42f6abbe3797 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:35.205960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57a2bf-dd86-4ec4-bded-42f6abbe3797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:35.244859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57a2bf-dd86-4ec4-bded-42f6abbe3797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:35.249281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57a2bf-dd86-4ec4-bded-42f6abbe3797 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:35.284323 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3794/7628] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:35.435364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16b878-a73e-4b2c-86e9-4f886f3b93d8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:35.436098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16b878-a73e-4b2c-86e9-4f886f3b93d8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:35.436595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16b878-a73e-4b2c-86e9-4f886f3b93d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:35.504783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7e16b878-a73e-4b2c-86e9-4f886f3b93d8 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:35.506087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e16b878-a73e-4b2c-86e9-4f886f3b93d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:35.536908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194778-c2b7-464e-9e57-8913f1a7a550 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:35.538103 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3835/7629] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:35 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:35.538346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194778-c2b7-464e-9e57-8913f1a7a550 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:35.538728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d194778-c2b7-464e-9e57-8913f1a7a550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:35.585102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2d194778-c2b7-464e-9e57-8913f1a7a550 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:35.588767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2d194778-c2b7-464e-9e57-8913f1a7a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:35.813402 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3795/7630] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:35.817610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16b878-a73e-4b2c-86e9-4f886f3b93d8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:35.834045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16b878-a73e-4b2c-86e9-4f886f3b93d8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:35.840855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3453ccc-d4cb-466d-86ec-f7327c28fd48 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:35.841635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453ccc-d4cb-466d-86ec-f7327c28fd48 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:35.842302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453ccc-d4cb-466d-86ec-f7327c28fd48 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:35.843127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453ccc-d4cb-466d-86ec-f7327c28fd48 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:36.040860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88a057-3fde-4dfa-88ea-4e6e9b9291c1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:36.040860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88a057-3fde-4dfa-88ea-4e6e9b9291c1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:36.040860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88a057-3fde-4dfa-88ea-4e6e9b9291c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:36.071569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3453ccc-d4cb-466d-86ec-f7327c28fd48 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:36.122211 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3836/7631] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:35 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:36.127359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6e88a057-3fde-4dfa-88ea-4e6e9b9291c1 None None] MFA Rules not processed for user `f89a6da82f9649798cce2ee71a9950e0`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:36.128875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6e88a057-3fde-4dfa-88ea-4e6e9b9291c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:36.308492 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3796/7632] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:48:37.128750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686f197-5b69-41f6-ad1b-6308c056dfe5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:37.129408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686f197-5b69-41f6-ad1b-6308c056dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:37.129408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686f197-5b69-41f6-ad1b-6308c056dfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:37.165253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0686f197-5b69-41f6-ad1b-6308c056dfe5 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:37.169452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0686f197-5b69-41f6-ad1b-6308c056dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:37.181021 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3837/7633] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:37 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:37.185743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bff36-0181-4cf2-b5c4-2952c6843e7b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:37.186350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bff36-0181-4cf2-b5c4-2952c6843e7b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:37.186350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bff36-0181-4cf2-b5c4-2952c6843e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:37.248374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b56bff36-0181-4cf2-b5c4-2952c6843e7b None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:37.249719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b56bff36-0181-4cf2-b5c4-2952c6843e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:37.289162 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3797/7634] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:37.289813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686f197-5b69-41f6-ad1b-6308c056dfe5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:37.315433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686f197-5b69-41f6-ad1b-6308c056dfe5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:37.331869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba935e-67d0-40b4-9c74-7e5af9b29a9a tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:37.338488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba935e-67d0-40b4-9c74-7e5af9b29a9a tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:37.341089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba935e-67d0-40b4-9c74-7e5af9b29a9a tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:37.341408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba935e-67d0-40b4-9c74-7e5af9b29a9a tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:37.605964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-95ba935e-67d0-40b4-9c74-7e5af9b29a9a tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:37.652973 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3838/7635] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:37 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:38.663740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755744aa-9118-4e54-ad3c-ac6b0f54aab1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:38.668221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755744aa-9118-4e54-ad3c-ac6b0f54aab1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:38.668811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755744aa-9118-4e54-ad3c-ac6b0f54aab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:38.763603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-755744aa-9118-4e54-ad3c-ac6b0f54aab1 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:38.778204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-755744aa-9118-4e54-ad3c-ac6b0f54aab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:38.797357 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3798/7636] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:38 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:39.798565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324829b-ec74-4740-aec4-273d6009ad9f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:39.799179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324829b-ec74-4740-aec4-273d6009ad9f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:39.799179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324829b-ec74-4740-aec4-273d6009ad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:39.893672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3324829b-ec74-4740-aec4-273d6009ad9f None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:39.904758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3324829b-ec74-4740-aec4-273d6009ad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:39.927783 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3839/7637] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:39.934440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40eccd-d6e9-49f8-b138-543b40a7ac59 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:39.934984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40eccd-d6e9-49f8-b138-543b40a7ac59 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:39.934984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40eccd-d6e9-49f8-b138-543b40a7ac59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:39.985400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ef40eccd-d6e9-49f8-b138-543b40a7ac59 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:39.996574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ef40eccd-d6e9-49f8-b138-543b40a7ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:40.011174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835224a-f816-4c0a-aa42-8c6e6b287475 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:40.012080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835224a-f816-4c0a-aa42-8c6e6b287475 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:40.012403 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3799/7638] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:39 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:40.012988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835224a-f816-4c0a-aa42-8c6e6b287475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:40.162784 n-d-820368-36 devstack@keystone.service[82098]: WARNING keystone.server.flask.application [None req-3835224a-f816-4c0a-aa42-8c6e6b287475 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 30 04:48:40.164379 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3840/7639] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:40 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 154 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 30 04:48:40.169188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e809057-fbc5-4d1e-96f1-faf4d73dc92f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:40.169708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e809057-fbc5-4d1e-96f1-faf4d73dc92f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:40.170265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e809057-fbc5-4d1e-96f1-faf4d73dc92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:40.318717 n-d-820368-36 devstack@keystone.service[82099]: WARNING keystone.server.flask.application [None req-9e809057-fbc5-4d1e-96f1-faf4d73dc92f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 30 04:48:40.336572 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3800/7640] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:40 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 168 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 30 04:48:40.350193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855f546-8fd1-4b05-b0ea-75701e88d653 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:40.350193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855f546-8fd1-4b05-b0ea-75701e88d653 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:40.350193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855f546-8fd1-4b05-b0ea-75701e88d653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:40.460544 n-d-820368-36 devstack@keystone.service[82098]: WARNING keystone.server.flask.application [None req-1855f546-8fd1-4b05-b0ea-75701e88d653 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 30 04:48:40.503909 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3841/7641] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:40 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 164 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 30 04:48:40.543088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e809057-fbc5-4d1e-96f1-faf4d73dc92f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:40.598539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e809057-fbc5-4d1e-96f1-faf4d73dc92f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:40.610306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea9a67-4cb0-4989-8ae6-d59532e9e650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:40.611167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea9a67-4cb0-4989-8ae6-d59532e9e650 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:40.623314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea9a67-4cb0-4989-8ae6-d59532e9e650 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:40.624396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea9a67-4cb0-4989-8ae6-d59532e9e650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:40.637623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fea9a67-4cb0-4989-8ae6-d59532e9e650 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:40.759421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:41.078122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea9a67-4cb0-4989-8ae6-d59532e9e650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:41.104282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea9a67-4cb0-4989-8ae6-d59532e9e650 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:41.227399 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3801/7642] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:44.993858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855f546-8fd1-4b05-b0ea-75701e88d653 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:44.996927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1855f546-8fd1-4b05-b0ea-75701e88d653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:45.147898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:UPDATE=3,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:45.255809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855f546-8fd1-4b05-b0ea-75701e88d653 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:45.268610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:45.269534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:45.269810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:45.270117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] PATH_INFO: `/v3/users/a1cb273c9f0a400b9ac32560bfde34bd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:45.273225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1cb273c9f0a400b9ac32560bfde34bd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:45.275610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:45.404842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1cb273c9f0a400b9ac32560bfde34bd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:45.406722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1cb273c9f0a400b9ac32560bfde34bd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:45.424780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1cb273c9f0a400b9ac32560bfde34bd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:45.457382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1cb273c9f0a400b9ac32560bfde34bd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:45.599027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1cb273c9f0a400b9ac32560bfde34bd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:45.625162 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3842/7643] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:44 2022] DELETE /identity/v3/users/a1cb273c9f0a400b9ac32560bfde34bd => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:45.626747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0add6-7d82-43f8-931e-dab28332249d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:45.627302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0add6-7d82-43f8-931e-dab28332249d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:45.627302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0add6-7d82-43f8-931e-dab28332249d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:45.822522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7ad0add6-7d82-43f8-931e-dab28332249d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:45.824408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ad0add6-7d82-43f8-931e-dab28332249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:45.957555 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3802/7644] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:46.132287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:46.133819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:46.411682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2696ec6-4bcc-4b73-afd2-526c9c72c2be admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:46.432158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afed18-2ff6-4415-9cf9-3c6500412aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:46.432923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afed18-2ff6-4415-9cf9-3c6500412aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:46.433324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afed18-2ff6-4415-9cf9-3c6500412aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:46.433694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afed18-2ff6-4415-9cf9-3c6500412aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:46.460667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afed18-2ff6-4415-9cf9-3c6500412aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:46.471035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afed18-2ff6-4415-9cf9-3c6500412aa4 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:46.535176 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3843/7645] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:49.371560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0add6-7d82-43f8-931e-dab28332249d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:49.374111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ad0add6-7d82-43f8-931e-dab28332249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:49.400806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0add6-7d82-43f8-931e-dab28332249d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:49.420286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:49.434620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:49.439076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:49.442226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] PATH_INFO: `/v3/projects/a3da650486f4405f9f20b6a0b9fb5942` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:49.449554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3da650486f4405f9f20b6a0b9fb5942)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:49.459898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:49.630561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3da650486f4405f9f20b6a0b9fb5942', 'request_id': 'req-3dad2bbf-0441-4897-9c42-619d3e2b546e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:49.673558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3da650486f4405f9f20b6a0b9fb5942', 'request_id': 'req-3dad2bbf-0441-4897-9c42-619d3e2b546e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:49.714805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3da650486f4405f9f20b6a0b9fb5942', 'request_id': 'req-3dad2bbf-0441-4897-9c42-619d3e2b546e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:49.733781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] The token cache is being invalidate because project a3da650486f4405f9f20b6a0b9fb5942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:48:49.734186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:49.735093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3dad2bbf-0441-4897-9c42-619d3e2b546e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:49.740991 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3803/7646] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:48:49 2022] DELETE /identity/v3/projects/a3da650486f4405f9f20b6a0b9fb5942 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:49.744375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64c9a7-d8f5-4ad8-9fae-d1c51723c37e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:49.744375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64c9a7-d8f5-4ad8-9fae-d1c51723c37e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:49.744375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64c9a7-d8f5-4ad8-9fae-d1c51723c37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:49.799263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8a64c9a7-d8f5-4ad8-9fae-d1c51723c37e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:49.800426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8a64c9a7-d8f5-4ad8-9fae-d1c51723c37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:49.926786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:49.988201 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3844/7647] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:49.997764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d7959-a44e-4a89-a99d-cb8f8e232b92 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:49.998605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d7959-a44e-4a89-a99d-cb8f8e232b92 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:50.000646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d7959-a44e-4a89-a99d-cb8f8e232b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:50.038962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ed5d7959-a44e-4a89-a99d-cb8f8e232b92 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:50.042119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ed5d7959-a44e-4a89-a99d-cb8f8e232b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:50.055687 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3804/7648] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:50.056169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64c9a7-d8f5-4ad8-9fae-d1c51723c37e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:50.072091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64c9a7-d8f5-4ad8-9fae-d1c51723c37e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:50.088306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb89bc-22f4-47e5-8c93-75b4c83431cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:50.095415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb89bc-22f4-47e5-8c93-75b4c83431cf admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:50.096189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb89bc-22f4-47e5-8c93-75b4c83431cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:50.097032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb89bc-22f4-47e5-8c93-75b4c83431cf admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:50.097915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb89bc-22f4-47e5-8c93-75b4c83431cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:48:50.098389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb89bc-22f4-47e5-8c93-75b4c83431cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:50.100239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb89bc-22f4-47e5-8c93-75b4c83431cf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:50.150732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d7959-a44e-4a89-a99d-cb8f8e232b92 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:50.157989 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3845/7649] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:48:50.166593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d7959-a44e-4a89-a99d-cb8f8e232b92 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:50.183369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eac3d6-3150-49d2-9694-09ec4eccb473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:50.184245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac3d6-3150-49d2-9694-09ec4eccb473 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:50.188431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac3d6-3150-49d2-9694-09ec4eccb473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:50.189364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eac3d6-3150-49d2-9694-09ec4eccb473 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:50.191344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eac3d6-3150-49d2-9694-09ec4eccb473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:50.194685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eac3d6-3150-49d2-9694-09ec4eccb473 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:50.211751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:50.266401 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3805/7650] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:48:50 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:48:50.267266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb89bc-22f4-47e5-8c93-75b4c83431cf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:50.281695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb89bc-22f4-47e5-8c93-75b4c83431cf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:50.464691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee010d40-d425-43fc-90bc-c5722835c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:50.465329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee010d40-d425-43fc-90bc-c5722835c68a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:50.465603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee010d40-d425-43fc-90bc-c5722835c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:50.465868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee010d40-d425-43fc-90bc-c5722835c68a admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:50.466524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee010d40-d425-43fc-90bc-c5722835c68a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:50.480074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee010d40-d425-43fc-90bc-c5722835c68a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:50.552524 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3846/7651] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:48:50 2022] POST /identity/v3/users => generated 282 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:48:50.555721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eac3d6-3150-49d2-9694-09ec4eccb473 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:50.578445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eac3d6-3150-49d2-9694-09ec4eccb473 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:50.592556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0699f-2407-4107-b54f-5855374c7277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:50.594441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0699f-2407-4107-b54f-5855374c7277 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:50.594825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0699f-2407-4107-b54f-5855374c7277 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:50.596063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0699f-2407-4107-b54f-5855374c7277 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:50.598455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0699f-2407-4107-b54f-5855374c7277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:50.600323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0699f-2407-4107-b54f-5855374c7277 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:50.616404 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3806/7652] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:50.620679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee010d40-d425-43fc-90bc-c5722835c68a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:50.640849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee010d40-d425-43fc-90bc-c5722835c68a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:50.685265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf72892-a70e-4ff3-86b8-ac3818655770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:50.687056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf72892-a70e-4ff3-86b8-ac3818655770 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:50.687605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf72892-a70e-4ff3-86b8-ac3818655770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:50.688977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf72892-a70e-4ff3-86b8-ac3818655770 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:50.691369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf72892-a70e-4ff3-86b8-ac3818655770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:50.694663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf72892-a70e-4ff3-86b8-ac3818655770 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:50.744443 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3847/7653] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:48:50.746556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0699f-2407-4107-b54f-5855374c7277 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:50.770316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0699f-2407-4107-b54f-5855374c7277 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:50.782587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a4ebd-d45b-49cb-ae13-e32e8fb3963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:50.784052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a4ebd-d45b-49cb-ae13-e32e8fb3963c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:50.785555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a4ebd-d45b-49cb-ae13-e32e8fb3963c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:50.786681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a4ebd-d45b-49cb-ae13-e32e8fb3963c admin admin] PATH_INFO: `/v3/projects/923ca69f4a494dca90be3b19de79ae29/users/613234db3d184ce68ba08339f64a75b5/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:50.823597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a4ebd-d45b-49cb-ae13-e32e8fb3963c admin admin] RBAC: Authorizing `identity:create_grant(project_id=923ca69f4a494dca90be3b19de79ae29, user_id=613234db3d184ce68ba08339f64a75b5, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:50.827829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a4ebd-d45b-49cb-ae13-e32e8fb3963c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:50.889100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6552cf-20ca-41d4-8d71-ef3fc2fac010 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:50.889378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6552cf-20ca-41d4-8d71-ef3fc2fac010 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:50.889831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6552cf-20ca-41d4-8d71-ef3fc2fac010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:50.893527 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3807/7654] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:48:50 2022] PUT /identity/v3/projects/923ca69f4a494dca90be3b19de79ae29/users/613234db3d184ce68ba08339f64a75b5/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:50.976612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5f6552cf-20ca-41d4-8d71-ef3fc2fac010 None None] MFA Rules not processed for user `613234db3d184ce68ba08339f64a75b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:50.980561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5f6552cf-20ca-41d4-8d71-ef3fc2fac010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:51.274476 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3848/7655] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:51.291804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a4ebd-d45b-49cb-ae13-e32e8fb3963c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:51.298285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fc8a4ebd-d45b-49cb-ae13-e32e8fb3963c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:51.520381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932c321-7572-48c9-8e68-d77516746216 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:51.520695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932c321-7572-48c9-8e68-d77516746216 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:51.521309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932c321-7572-48c9-8e68-d77516746216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:51.588677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a4ebd-d45b-49cb-ae13-e32e8fb3963c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:51.594995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e334f-2fe8-4acb-8663-b827180ee2cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:51.597990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e334f-2fe8-4acb-8663-b827180ee2cd service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:51.597990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e334f-2fe8-4acb-8663-b827180ee2cd service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:51.597990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e334f-2fe8-4acb-8663-b827180ee2cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:51.661294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e334f-2fe8-4acb-8663-b827180ee2cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:51.667759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e334f-2fe8-4acb-8663-b827180ee2cd service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:51.734336 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3808/7656] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:51.752765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e932c321-7572-48c9-8e68-d77516746216 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:51.754098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e932c321-7572-48c9-8e68-d77516746216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:51.779486 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3849/7657] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:51 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:51.784983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e334f-2fe8-4acb-8663-b827180ee2cd service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:51.786861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-033e334f-2fe8-4acb-8663-b827180ee2cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:52.055283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e334f-2fe8-4acb-8663-b827180ee2cd service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:52.078754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e93f9f-29a6-4abd-b013-af40b31c2951 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:52.080658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93f9f-29a6-4abd-b013-af40b31c2951 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:52.082708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93f9f-29a6-4abd-b013-af40b31c2951 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:52.084628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e93f9f-29a6-4abd-b013-af40b31c2951 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:52.285939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-46e93f9f-29a6-4abd-b013-af40b31c2951 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:52.318187 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3809/7658] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:51 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:53.319958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fea14-bf6d-4999-99ef-66a6d69f86a7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:53.320885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fea14-bf6d-4999-99ef-66a6d69f86a7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:53.321339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fea14-bf6d-4999-99ef-66a6d69f86a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:53.444984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-887fea14-bf6d-4999-99ef-66a6d69f86a7 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:53.453584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-887fea14-bf6d-4999-99ef-66a6d69f86a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:53.481629 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3850/7659] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:53 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:53.485766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28b44-02d2-4523-8e9e-b2a90c75b376 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:53.486339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28b44-02d2-4523-8e9e-b2a90c75b376 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:53.486339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a28b44-02d2-4523-8e9e-b2a90c75b376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application [None req-f4a28b44-02d2-4523-8e9e-b2a90c75b376 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 30 04:48:53.548916 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:48:53.550441 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 30 04:48:53.551704 n-d-820368-36 devstack@keystone.service[82099]: ERROR keystone.server.flask.application Aug 30 04:48:53.570246 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3810/7660] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:53 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 04:48:53.575045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d8b0d-7274-4717-a297-be04948554e4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:53.575414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d8b0d-7274-4717-a297-be04948554e4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:53.575755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5d8b0d-7274-4717-a297-be04948554e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:53.692629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:53.712961 n-d-820368-36 devstack@keystone.service[82098]: WARNING keystone.server.flask.application [None req-2f5d8b0d-7274-4717-a297-be04948554e4 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 30 04:48:53.721267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d6bd8-9e2e-4d72-b8d2-f45454b86144 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:53.721550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d6bd8-9e2e-4d72-b8d2-f45454b86144 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:53.721920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d6bd8-9e2e-4d72-b8d2-f45454b86144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:53.722083 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3851/7661] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:53 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 148 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 30 04:48:53.899507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a06d6bd8-9e2e-4d72-b8d2-f45454b86144 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:53.905192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a06d6bd8-9e2e-4d72-b8d2-f45454b86144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:53.950743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d8b0d-7274-4717-a297-be04948554e4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:53.961966 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3811/7662] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:53.979062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5d8b0d-7274-4717-a297-be04948554e4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:54.009734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72845c-97b0-4cc1-8860-11ae5ad199a8 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:54.012896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72845c-97b0-4cc1-8860-11ae5ad199a8 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:54.017300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72845c-97b0-4cc1-8860-11ae5ad199a8 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:54.019489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72845c-97b0-4cc1-8860-11ae5ad199a8 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:54.171559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1f72845c-97b0-4cc1-8860-11ae5ad199a8 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:54.190062 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3852/7663] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:53 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:55.193928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc624-ed38-4e27-8eb8-8540d1c7a11f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:55.194549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc624-ed38-4e27-8eb8-8540d1c7a11f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:55.194549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc624-ed38-4e27-8eb8-8540d1c7a11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:55.231667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2b2dc624-ed38-4e27-8eb8-8540d1c7a11f None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:55.233271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2b2dc624-ed38-4e27-8eb8-8540d1c7a11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:55.242885 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3812/7664] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:55 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:55.247429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcdfcf-20fa-4ec6-937f-16af9f599977 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:55.248606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcdfcf-20fa-4ec6-937f-16af9f599977 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:55.249034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcdfcf-20fa-4ec6-937f-16af9f599977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:55.290146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4cbcdfcf-20fa-4ec6-937f-16af9f599977 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:55.302741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4cbcdfcf-20fa-4ec6-937f-16af9f599977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:55.334408 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3853/7665] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:55.337105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dc624-ed38-4e27-8eb8-8540d1c7a11f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:55.358749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dc624-ed38-4e27-8eb8-8540d1c7a11f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:55.376412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc8e52-4426-4003-9214-b2cef33b6c85 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:55.377101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc8e52-4426-4003-9214-b2cef33b6c85 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:55.377387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc8e52-4426-4003-9214-b2cef33b6c85 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:55.377662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc8e52-4426-4003-9214-b2cef33b6c85 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:55.398494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:UPDATE=2,keystone:DELETE=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:55.521980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d1bc8e52-4426-4003-9214-b2cef33b6c85 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:55.539706 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3813/7666] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:55 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:56.546256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7368-b152-4a00-9dcc-b267889d163d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:56.546956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7368-b152-4a00-9dcc-b267889d163d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:56.547124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b7368-b152-4a00-9dcc-b267889d163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:56.604669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f22b7368-b152-4a00-9dcc-b267889d163d None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:56.609774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f22b7368-b152-4a00-9dcc-b267889d163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:56.619874 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3854/7667] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:56 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:56.625686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65167-1189-41f6-a746-ead08146b59d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:56.626244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65167-1189-41f6-a746-ead08146b59d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:56.626358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b65167-1189-41f6-a746-ead08146b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:56.699085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-44b65167-1189-41f6-a746-ead08146b59d None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:56.700400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-44b65167-1189-41f6-a746-ead08146b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:56.731663 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3814/7668] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:48:56.736809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b7368-b152-4a00-9dcc-b267889d163d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:56.755955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b7368-b152-4a00-9dcc-b267889d163d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:56.776467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3478c-7c2f-4402-be17-e97b03b0fb07 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33cb865953334ef9bfcea5f7de72db07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66af965de1b848e88cfc26dcc1e0eb5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:56.777144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3478c-7c2f-4402-be17-e97b03b0fb07 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:56.777424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3478c-7c2f-4402-be17-e97b03b0fb07 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:56.777694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3478c-7c2f-4402-be17-e97b03b0fb07 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07/password` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:56.950072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-95f3478c-7c2f-4402-be17-e97b03b0fb07 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:56.977253 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3855/7669] 10.222.0.43 () {60 vars in 1269 bytes} [Tue Aug 30 04:48:56 2022] POST /identity/v3/users/33cb865953334ef9bfcea5f7de72db07/password => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:48:57.982553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae8e9-bba4-4cc8-97fd-acfcd7a154f9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:57.983054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae8e9-bba4-4cc8-97fd-acfcd7a154f9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:57.983236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bae8e9-bba4-4cc8-97fd-acfcd7a154f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:58.050255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-12bae8e9-bba4-4cc8-97fd-acfcd7a154f9 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:58.051811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-12bae8e9-bba4-4cc8-97fd-acfcd7a154f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:58.066367 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3815/7670] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:57 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:58.238611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3478c-7c2f-4402-be17-e97b03b0fb07 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:58.241049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-95f3478c-7c2f-4402-be17-e97b03b0fb07 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:58.534479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3478c-7c2f-4402-be17-e97b03b0fb07 tempest-IdentityV3UsersTest-933202252 tempest-IdentityV3UsersTest-933202252-project] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:58.580009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843c4dd-ed86-4c63-8838-bab84918ea24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:58.588876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843c4dd-ed86-4c63-8838-bab84918ea24 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:58.589749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843c4dd-ed86-4c63-8838-bab84918ea24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:58.591195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843c4dd-ed86-4c63-8838-bab84918ea24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:58.613849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e843c4dd-ed86-4c63-8838-bab84918ea24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:59.071301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190b2a-53c2-4893-8a2c-35031c37bd79 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:59.073226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190b2a-53c2-4893-8a2c-35031c37bd79 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:59.073719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55190b2a-53c2-4893-8a2c-35031c37bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:59.111387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843c4dd-ed86-4c63-8838-bab84918ea24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:59.112788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843c4dd-ed86-4c63-8838-bab84918ea24 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:59.150705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-55190b2a-53c2-4893-8a2c-35031c37bd79 None None] MFA Rules not processed for user `33cb865953334ef9bfcea5f7de72db07`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:59.154784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-55190b2a-53c2-4893-8a2c-35031c37bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:59.182105 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3856/7671] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:48:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 946 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:48:59.189905 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3816/7672] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:48:59.196998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843c4dd-ed86-4c63-8838-bab84918ea24 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:48:59.199327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e843c4dd-ed86-4c63-8838-bab84918ea24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:59.294323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:59.492928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843c4dd-ed86-4c63-8838-bab84918ea24 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:48:59.565570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:48:59.566095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:59.571736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:59.572073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] PATH_INFO: `/v3/users/33cb865953334ef9bfcea5f7de72db07` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:59.577731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cb865953334ef9bfcea5f7de72db07)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:48:59.587142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:48:59.714522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:59.716164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:59.730455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:59.750830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:59.780971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cb865953334ef9bfcea5f7de72db07'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:48:59.796903 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3857/7673] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:48:59 2022] DELETE /identity/v3/users/33cb865953334ef9bfcea5f7de72db07 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:48:59.801627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34d86-8157-4230-ad8d-40c579ab95eb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:48:59.801961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34d86-8157-4230-ad8d-40c579ab95eb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:48:59.802244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf34d86-8157-4230-ad8d-40c579ab95eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:48:59.850639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4cf34d86-8157-4230-ad8d-40c579ab95eb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:48:59.852990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4cf34d86-8157-4230-ad8d-40c579ab95eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:48:59.953332 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3817/7674] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:00.046644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:00.048784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:00.225115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0861d2-e622-4389-ab29-0bad31844cc5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:00.245213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054c53c-937c-4c58-a6bf-c6f8096c6c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:00.330792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054c53c-937c-4c58-a6bf-c6f8096c6c5d service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:00.331768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054c53c-937c-4c58-a6bf-c6f8096c6c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:00.332475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054c53c-937c-4c58-a6bf-c6f8096c6c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:00.365162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054c53c-937c-4c58-a6bf-c6f8096c6c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:00.369323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b054c53c-937c-4c58-a6bf-c6f8096c6c5d service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:00.409107 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3858/7675] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:02.071021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf34d86-8157-4230-ad8d-40c579ab95eb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:02.072610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4cf34d86-8157-4230-ad8d-40c579ab95eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:02.094953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf34d86-8157-4230-ad8d-40c579ab95eb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:02.112350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:02.113077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:02.114158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:02.114790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] PATH_INFO: `/v3/projects/66af965de1b848e88cfc26dcc1e0eb5a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:02.118700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66af965de1b848e88cfc26dcc1e0eb5a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:02.138056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:02.286636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66af965de1b848e88cfc26dcc1e0eb5a', 'request_id': 'req-56ef7c98-ca7d-4dff-9462-fe9179edbd14'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:02.314957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66af965de1b848e88cfc26dcc1e0eb5a', 'request_id': 'req-56ef7c98-ca7d-4dff-9462-fe9179edbd14'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:02.344680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66af965de1b848e88cfc26dcc1e0eb5a', 'request_id': 'req-56ef7c98-ca7d-4dff-9462-fe9179edbd14'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:02.391354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] The token cache is being invalidate because project 66af965de1b848e88cfc26dcc1e0eb5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:49:02.391676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:02.394582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-56ef7c98-ca7d-4dff-9462-fe9179edbd14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:02.404729 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3818/7676] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:49:02 2022] DELETE /identity/v3/projects/66af965de1b848e88cfc26dcc1e0eb5a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:02.407022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6144ac-b1ec-4ab1-b6aa-940db14b0497 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:02.407554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6144ac-b1ec-4ab1-b6aa-940db14b0497 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:02.407554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6144ac-b1ec-4ab1-b6aa-940db14b0497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:02.501308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-aa6144ac-b1ec-4ab1-b6aa-940db14b0497 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:02.502718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aa6144ac-b1ec-4ab1-b6aa-940db14b0497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:02.644881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:02.695610 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3859/7677] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:02.704195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ff0f-85e3-4283-a09f-7af0650313d4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:02.704560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ff0f-85e3-4283-a09f-7af0650313d4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:02.704876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ff0f-85e3-4283-a09f-7af0650313d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:02.746210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6096ff0f-85e3-4283-a09f-7af0650313d4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:02.751700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6096ff0f-85e3-4283-a09f-7af0650313d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:02.770338 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3819/7678] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:02.774993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6144ac-b1ec-4ab1-b6aa-940db14b0497 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:02.790217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6144ac-b1ec-4ab1-b6aa-940db14b0497 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:02.802112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622d035-a976-460f-a005-debeda721a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:02.802757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622d035-a976-460f-a005-debeda721a3d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:02.803032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622d035-a976-460f-a005-debeda721a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:02.803301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622d035-a976-460f-a005-debeda721a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:02.803969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622d035-a976-460f-a005-debeda721a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:49:02.804269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622d035-a976-460f-a005-debeda721a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:02.805993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622d035-a976-460f-a005-debeda721a3d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:02.847325 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3860/7679] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:49:02.849054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096ff0f-85e3-4283-a09f-7af0650313d4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:02.860836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096ff0f-85e3-4283-a09f-7af0650313d4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:02.882694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c6038-a39e-4d00-b9d3-feff4d8a349e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:02.883515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c6038-a39e-4d00-b9d3-feff4d8a349e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:02.883808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c6038-a39e-4d00-b9d3-feff4d8a349e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:02.884077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c6038-a39e-4d00-b9d3-feff4d8a349e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:02.884738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c6038-a39e-4d00-b9d3-feff4d8a349e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:02.887716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c6038-a39e-4d00-b9d3-feff4d8a349e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:02.957056 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3820/7680] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:02 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:02.958357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622d035-a976-460f-a005-debeda721a3d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:02.981299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622d035-a976-460f-a005-debeda721a3d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:03.199407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce27fe9-ecb1-4552-83cc-1b21b53f3db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:03.199819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce27fe9-ecb1-4552-83cc-1b21b53f3db1 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:03.200095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce27fe9-ecb1-4552-83cc-1b21b53f3db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:03.200367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce27fe9-ecb1-4552-83cc-1b21b53f3db1 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:03.201065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce27fe9-ecb1-4552-83cc-1b21b53f3db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:03.207382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce27fe9-ecb1-4552-83cc-1b21b53f3db1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:03.251984 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3861/7681] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:02 2022] POST /identity/v3/users => generated 300 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:49:03.254559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c6038-a39e-4d00-b9d3-feff4d8a349e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:03.283186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c6038-a39e-4d00-b9d3-feff4d8a349e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:03.293723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab229d33-8716-4be7-a6ea-32cff6733fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:03.294927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab229d33-8716-4be7-a6ea-32cff6733fef admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:03.296196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab229d33-8716-4be7-a6ea-32cff6733fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:03.296657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab229d33-8716-4be7-a6ea-32cff6733fef admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:03.298654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab229d33-8716-4be7-a6ea-32cff6733fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:03.301227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab229d33-8716-4be7-a6ea-32cff6733fef admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:03.313906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:03.336762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce27fe9-ecb1-4552-83cc-1b21b53f3db1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:03.349034 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3821/7682] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:03.380590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce27fe9-ecb1-4552-83cc-1b21b53f3db1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:03.407764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a0399-cc8e-4016-82a8-eba5b7fb35ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:03.409641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a0399-cc8e-4016-82a8-eba5b7fb35ee admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:03.412881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a0399-cc8e-4016-82a8-eba5b7fb35ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:03.413365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a0399-cc8e-4016-82a8-eba5b7fb35ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:03.414314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a0399-cc8e-4016-82a8-eba5b7fb35ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:03.418154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a0399-cc8e-4016-82a8-eba5b7fb35ee admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:03.469310 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3862/7683] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:03.473971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab229d33-8716-4be7-a6ea-32cff6733fef admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:03.491072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab229d33-8716-4be7-a6ea-32cff6733fef admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:03.510631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ed3db-ad12-4e4c-ae39-a17344b770d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:03.511354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ed3db-ad12-4e4c-ae39-a17344b770d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:03.514912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ed3db-ad12-4e4c-ae39-a17344b770d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:03.515256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ed3db-ad12-4e4c-ae39-a17344b770d3 admin admin] PATH_INFO: `/v3/projects/0ef9fb1ef66741dca09fd5f987e0e18d/users/749ffb0f059c4145bb5f513617bf05f2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:03.562325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ed3db-ad12-4e4c-ae39-a17344b770d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef9fb1ef66741dca09fd5f987e0e18d, user_id=749ffb0f059c4145bb5f513617bf05f2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:03.567278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ed3db-ad12-4e4c-ae39-a17344b770d3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:03.647369 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3822/7684] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:03 2022] PUT /identity/v3/projects/0ef9fb1ef66741dca09fd5f987e0e18d/users/749ffb0f059c4145bb5f513617bf05f2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:03.760008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aea1f4-a05c-42c1-9825-1f570f9f251b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:03.760807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aea1f4-a05c-42c1-9825-1f570f9f251b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:03.761207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aea1f4-a05c-42c1-9825-1f570f9f251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:03.858530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f6aea1f4-a05c-42c1-9825-1f570f9f251b None None] MFA Rules not processed for user `749ffb0f059c4145bb5f513617bf05f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:03.859809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f6aea1f4-a05c-42c1-9825-1f570f9f251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:04.176038 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3863/7685] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:03 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:04.180211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ed3db-ad12-4e4c-ae39-a17344b770d3 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:04.367605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aea1f4-a05c-42c1-9825-1f570f9f251b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:04.369357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f6aea1f4-a05c-42c1-9825-1f570f9f251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:04.391172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ed3db-ad12-4e4c-ae39-a17344b770d3 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:04.403856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054593c-1502-4c2c-9012-b49491f1f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:04.404966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054593c-1502-4c2c-9012-b49491f1f11d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:04.405397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054593c-1502-4c2c-9012-b49491f1f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:04.405841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054593c-1502-4c2c-9012-b49491f1f11d admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:04.406671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054593c-1502-4c2c-9012-b49491f1f11d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:04.408213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aea1f4-a05c-42c1-9825-1f570f9f251b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:04.412697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3054593c-1502-4c2c-9012-b49491f1f11d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:04.430604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:04.431417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:04.431800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:04.433961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] PATH_INFO: `/v3/users/b767f81f74494ce1a92cd23c48c94abc` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:04.438302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b767f81f74494ce1a92cd23c48c94abc)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:04.442233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:04.503305 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3823/7686] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:04 2022] POST /identity/v3/projects => generated 397 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:04.508410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054593c-1502-4c2c-9012-b49491f1f11d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:04.556467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:04.582987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b767f81f74494ce1a92cd23c48c94abc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:04.585328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b767f81f74494ce1a92cd23c48c94abc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:04.613463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b767f81f74494ce1a92cd23c48c94abc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:04.644210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b767f81f74494ce1a92cd23c48c94abc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:04.685271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-083b3f73-bdd3-4d10-ab7e-c263a9da3731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b767f81f74494ce1a92cd23c48c94abc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:04.702692 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3864/7687] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:49:04 2022] DELETE /identity/v3/users/b767f81f74494ce1a92cd23c48c94abc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:04.711704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aec230-b971-44f5-8c5f-be54ce869418 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:04.717091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aec230-b971-44f5-8c5f-be54ce869418 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:04.718298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aec230-b971-44f5-8c5f-be54ce869418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:04.816459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-15aec230-b971-44f5-8c5f-be54ce869418 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:04.817853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-15aec230-b971-44f5-8c5f-be54ce869418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:04.841497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054593c-1502-4c2c-9012-b49491f1f11d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:05.100850 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3865/7688] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:05.147906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e75d0-641b-4f86-81fd-f334d5682662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:05.148663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e75d0-641b-4f86-81fd-f334d5682662 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:05.148945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e75d0-641b-4f86-81fd-f334d5682662 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:05.149473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747e75d0-641b-4f86-81fd-f334d5682662 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:05.150045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e75d0-641b-4f86-81fd-f334d5682662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:05.151330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aec230-b971-44f5-8c5f-be54ce869418 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:05.152112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747e75d0-641b-4f86-81fd-f334d5682662 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:05.153211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-15aec230-b971-44f5-8c5f-be54ce869418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:05.189537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:05.234956 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3824/7689] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:04 2022] POST /identity/v3/users => generated 305 bytes in 718 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:05.237060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e75d0-641b-4f86-81fd-f334d5682662 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:05.238830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-747e75d0-641b-4f86-81fd-f334d5682662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:05.283995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747e75d0-641b-4f86-81fd-f334d5682662 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:05.321293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd968439-0970-4dea-b4b4-d3348a1eb5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:05.321988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd968439-0970-4dea-b4b4-d3348a1eb5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:05.322363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd968439-0970-4dea-b4b4-d3348a1eb5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:05.322635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd968439-0970-4dea-b4b4-d3348a1eb5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:05.323954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd968439-0970-4dea-b4b4-d3348a1eb5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:05.332504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd968439-0970-4dea-b4b4-d3348a1eb5d1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:05.357177 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3825/7690] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:49:05.359930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd968439-0970-4dea-b4b4-d3348a1eb5d1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:05.399935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd968439-0970-4dea-b4b4-d3348a1eb5d1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:05.412726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cef98c-203f-41a1-9a55-172ae299f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:05.413986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef98c-203f-41a1-9a55-172ae299f5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:05.414482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef98c-203f-41a1-9a55-172ae299f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:05.414967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cef98c-203f-41a1-9a55-172ae299f5b8 admin admin] PATH_INFO: `/v3/projects/d4d43ee2b34343238287744e660c44ee/users/3a6a1a6f61e84c47b42e33edfa485dbc/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:05.460447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aec230-b971-44f5-8c5f-be54ce869418 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:05.463193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cef98c-203f-41a1-9a55-172ae299f5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d43ee2b34343238287744e660c44ee, user_id=3a6a1a6f61e84c47b42e33edfa485dbc, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:05.468900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cef98c-203f-41a1-9a55-172ae299f5b8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:05.485508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be3354-1385-47a2-a2c0-31a4f41b72cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:05.486194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be3354-1385-47a2-a2c0-31a4f41b72cd service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:05.486471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be3354-1385-47a2-a2c0-31a4f41b72cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:05.486745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be3354-1385-47a2-a2c0-31a4f41b72cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:05.503111 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3826/7691] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:05 2022] PUT /identity/v3/projects/d4d43ee2b34343238287744e660c44ee/users/3a6a1a6f61e84c47b42e33edfa485dbc/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:05.506794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cef98c-203f-41a1-9a55-172ae299f5b8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:05.533781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be3354-1385-47a2-a2c0-31a4f41b72cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:05.535293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be3354-1385-47a2-a2c0-31a4f41b72cd service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:05.584321 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3866/7692] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:05.658718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cef98c-203f-41a1-9a55-172ae299f5b8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:05.684112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59818e86-adb7-4554-8ea2-91bede553737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:05.685241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59818e86-adb7-4554-8ea2-91bede553737 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:05.685888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59818e86-adb7-4554-8ea2-91bede553737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:05.686400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59818e86-adb7-4554-8ea2-91bede553737 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:05.687300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59818e86-adb7-4554-8ea2-91bede553737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:05.691543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59818e86-adb7-4554-8ea2-91bede553737 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:05.725169 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3827/7693] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:49:05.729365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be3354-1385-47a2-a2c0-31a4f41b72cd service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:05.756243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be3354-1385-47a2-a2c0-31a4f41b72cd service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:05.769325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26296b-5196-41dd-8bce-ae48298ee6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:05.769889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26296b-5196-41dd-8bce-ae48298ee6be admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:05.770205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26296b-5196-41dd-8bce-ae48298ee6be admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:05.770479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26296b-5196-41dd-8bce-ae48298ee6be admin admin] PATH_INFO: `/v3/projects/d4d43ee2b34343238287744e660c44ee/users/3a6a1a6f61e84c47b42e33edfa485dbc/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:05.782688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26296b-5196-41dd-8bce-ae48298ee6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4d43ee2b34343238287744e660c44ee, user_id=3a6a1a6f61e84c47b42e33edfa485dbc, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:05.791376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26296b-5196-41dd-8bce-ae48298ee6be admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:05.838675 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3867/7694] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:05 2022] PUT /identity/v3/projects/d4d43ee2b34343238287744e660c44ee/users/3a6a1a6f61e84c47b42e33edfa485dbc/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:49:05.851079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada5f94-d132-4985-a320-acf2659d98b0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:05.851753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada5f94-d132-4985-a320-acf2659d98b0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:05.852277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada5f94-d132-4985-a320-acf2659d98b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:05.952409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7ada5f94-d132-4985-a320-acf2659d98b0 None None] MFA Rules not processed for user `3a6a1a6f61e84c47b42e33edfa485dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:05.953728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ada5f94-d132-4985-a320-acf2659d98b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:06.169478 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3828/7695] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:05 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:06.288811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26296b-5196-41dd-8bce-ae48298ee6be admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:06.449933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:06.522136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26296b-5196-41dd-8bce-ae48298ee6be admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:06.539669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090ea5-ecc3-49fe-89ef-14057413c894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:06.545516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090ea5-ecc3-49fe-89ef-14057413c894 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:06.549199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090ea5-ecc3-49fe-89ef-14057413c894 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:06.549756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090ea5-ecc3-49fe-89ef-14057413c894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:06.561334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cc090ea5-ecc3-49fe-89ef-14057413c894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:06.799923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc090ea5-ecc3-49fe-89ef-14057413c894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:06.802352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc090ea5-ecc3-49fe-89ef-14057413c894 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:06.839629 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3868/7696] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:07.888630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada5f94-d132-4985-a320-acf2659d98b0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:07.890382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ada5f94-d132-4985-a320-acf2659d98b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:07.999242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:08.081441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada5f94-d132-4985-a320-acf2659d98b0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:08.094532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:08.095214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:08.095495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:08.095920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] PATH_INFO: `/v3/projects/2f91248afab74b77b8d0da11d028ba8d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:08.098236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f91248afab74b77b8d0da11d028ba8d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:08.100219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:08.174257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f91248afab74b77b8d0da11d028ba8d', 'request_id': 'req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:08.192454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f91248afab74b77b8d0da11d028ba8d', 'request_id': 'req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:08.221331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f91248afab74b77b8d0da11d028ba8d', 'request_id': 'req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:08.246367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] The token cache is being invalidate because project 2f91248afab74b77b8d0da11d028ba8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:49:08.247448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:08.248047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:08.251763 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3829/7697] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:49:07 2022] DELETE /identity/v3/projects/2f91248afab74b77b8d0da11d028ba8d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:08.255543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090ea5-ecc3-49fe-89ef-14057413c894 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:08.277960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090ea5-ecc3-49fe-89ef-14057413c894 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:08.461256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:08.464328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:08.465012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:08.465012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] PATH_INFO: `/v3/users/7de54a791aab44999c499345f55f89b7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:08.466696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de54a791aab44999c499345f55f89b7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:08.469359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:08.624013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de54a791aab44999c499345f55f89b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:08.625538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de54a791aab44999c499345f55f89b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:08.666058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de54a791aab44999c499345f55f89b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:08.696299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de54a791aab44999c499345f55f89b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:08.753693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de54a791aab44999c499345f55f89b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:08.820228 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3869/7698] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:49:08 2022] DELETE /identity/v3/users/7de54a791aab44999c499345f55f89b7 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:09.928333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:09.930115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:10.216509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897be47e-b3f3-4f2d-90f5-32e18e68c0d2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:10.446195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396ca9d-9ecb-440a-90af-67b6375aab33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:10.447241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ca9d-9ecb-440a-90af-67b6375aab33 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:10.448244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ca9d-9ecb-440a-90af-67b6375aab33 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:10.450082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ca9d-9ecb-440a-90af-67b6375aab33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:10.457142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f396ca9d-9ecb-440a-90af-67b6375aab33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:10.468940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:10.796835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396ca9d-9ecb-440a-90af-67b6375aab33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:10.799736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396ca9d-9ecb-440a-90af-67b6375aab33 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:10.871901 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3830/7699] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:09 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 944 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:10.929340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:10.931101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:10.979912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:11.290026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1e997-dece-459e-9a25-3411632c5cda admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:11.316128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:11.317595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:11.317911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:11.318191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] PATH_INFO: `/v3/projects/c078617f744e40f883770e2a96175551` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:11.323732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c078617f744e40f883770e2a96175551)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:11.328459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:11.653099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c078617f744e40f883770e2a96175551', 'request_id': 'req-55990ce3-2d81-46f2-bca8-4998e67a78ca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:11.704697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c078617f744e40f883770e2a96175551', 'request_id': 'req-55990ce3-2d81-46f2-bca8-4998e67a78ca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:11.768309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c078617f744e40f883770e2a96175551', 'request_id': 'req-55990ce3-2d81-46f2-bca8-4998e67a78ca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:11.810778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] The token cache is being invalidate because project c078617f744e40f883770e2a96175551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:49:11.811171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:11.827916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-55990ce3-2d81-46f2-bca8-4998e67a78ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:11.829512 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3870/7700] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:49:10 2022] DELETE /identity/v3/projects/c078617f744e40f883770e2a96175551 => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:11.834869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d5ae9-d507-49de-b985-126fabd10809 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:11.835414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d5ae9-d507-49de-b985-126fabd10809 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:11.835539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d5ae9-d507-49de-b985-126fabd10809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:11.945026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-339d5ae9-d507-49de-b985-126fabd10809 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:11.958756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-339d5ae9-d507-49de-b985-126fabd10809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:12.239439 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3831/7701] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:12.247583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21312b-8a72-49e8-a7e3-5b7e3decfd35 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:12.248228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21312b-8a72-49e8-a7e3-5b7e3decfd35 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:12.250372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21312b-8a72-49e8-a7e3-5b7e3decfd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:12.317060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3b21312b-8a72-49e8-a7e3-5b7e3decfd35 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:12.322655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3b21312b-8a72-49e8-a7e3-5b7e3decfd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:12.383461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d5ae9-d507-49de-b985-126fabd10809 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:12.412808 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3871/7702] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:12.416289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d5ae9-d507-49de-b985-126fabd10809 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:12.463603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec915984-43f7-40b8-9180-43947a498607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:12.470621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec915984-43f7-40b8-9180-43947a498607 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:12.479111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec915984-43f7-40b8-9180-43947a498607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:12.480202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec915984-43f7-40b8-9180-43947a498607 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:12.481212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec915984-43f7-40b8-9180-43947a498607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:49:12.482078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec915984-43f7-40b8-9180-43947a498607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:12.492275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec915984-43f7-40b8-9180-43947a498607 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:12.578060 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3832/7703] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:49:12.584452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21312b-8a72-49e8-a7e3-5b7e3decfd35 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:12.613311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21312b-8a72-49e8-a7e3-5b7e3decfd35 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:12.626546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c060dd-85c9-4529-9d62-cba9930d0d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:12.630554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c060dd-85c9-4529-9d62-cba9930d0d08 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:12.631070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c060dd-85c9-4529-9d62-cba9930d0d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:12.631549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c060dd-85c9-4529-9d62-cba9930d0d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:12.632433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c060dd-85c9-4529-9d62-cba9930d0d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:12.640762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c060dd-85c9-4529-9d62-cba9930d0d08 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:12.743991 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3872/7704] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:12 2022] POST /identity/v3/projects => generated 401 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:12.748156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec915984-43f7-40b8-9180-43947a498607 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:12.767341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec915984-43f7-40b8-9180-43947a498607 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:13.032075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c24d70-fa41-4ab5-9226-6d2690c049a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:13.037607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c24d70-fa41-4ab5-9226-6d2690c049a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:13.038015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c24d70-fa41-4ab5-9226-6d2690c049a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:13.038530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c24d70-fa41-4ab5-9226-6d2690c049a9 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:13.039435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c24d70-fa41-4ab5-9226-6d2690c049a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:13.041724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c24d70-fa41-4ab5-9226-6d2690c049a9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:13.101477 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3833/7705] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:12 2022] POST /identity/v3/users => generated 301 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:49:13.105721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c060dd-85c9-4529-9d62-cba9930d0d08 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:13.124276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c060dd-85c9-4529-9d62-cba9930d0d08 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:13.138886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c317428-f241-4b54-bf55-3e329a7bce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:13.139640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c317428-f241-4b54-bf55-3e329a7bce7f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:13.140081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c317428-f241-4b54-bf55-3e329a7bce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:13.140460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c317428-f241-4b54-bf55-3e329a7bce7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:13.141238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c317428-f241-4b54-bf55-3e329a7bce7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:13.143023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c317428-f241-4b54-bf55-3e329a7bce7f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:13.183563 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3873/7706] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:13.188552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c24d70-fa41-4ab5-9226-6d2690c049a9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:13.205151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c24d70-fa41-4ab5-9226-6d2690c049a9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:13.217962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93934483-9e27-4ddb-b7ba-85c7d47f5a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:13.219017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93934483-9e27-4ddb-b7ba-85c7d47f5a07 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:13.219584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93934483-9e27-4ddb-b7ba-85c7d47f5a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:13.220091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93934483-9e27-4ddb-b7ba-85c7d47f5a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:13.220980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93934483-9e27-4ddb-b7ba-85c7d47f5a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:13.222930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93934483-9e27-4ddb-b7ba-85c7d47f5a07 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:13.253790 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3834/7707] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:13.257822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c317428-f241-4b54-bf55-3e329a7bce7f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:13.271430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c317428-f241-4b54-bf55-3e329a7bce7f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:13.287764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61135ca-f6f5-42c7-bd0b-16cfcbea7cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:13.288897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61135ca-f6f5-42c7-bd0b-16cfcbea7cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:13.289662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61135ca-f6f5-42c7-bd0b-16cfcbea7cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:13.290262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61135ca-f6f5-42c7-bd0b-16cfcbea7cdf admin admin] PATH_INFO: `/v3/projects/3c972d04ce71430185507330a69baeb5/users/ad4f4617262449dd86c6139a8de386fe/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:13.309118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61135ca-f6f5-42c7-bd0b-16cfcbea7cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c972d04ce71430185507330a69baeb5, user_id=ad4f4617262449dd86c6139a8de386fe, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:13.315380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61135ca-f6f5-42c7-bd0b-16cfcbea7cdf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:13.351537 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3874/7708] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:13 2022] PUT /identity/v3/projects/3c972d04ce71430185507330a69baeb5/users/ad4f4617262449dd86c6139a8de386fe/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:49:13.364635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50236c7-3f9b-4811-8d75-9ad29173b247 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:13.365091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50236c7-3f9b-4811-8d75-9ad29173b247 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:13.365456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50236c7-3f9b-4811-8d75-9ad29173b247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:13.388160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:13.430541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d50236c7-3f9b-4811-8d75-9ad29173b247 None None] MFA Rules not processed for user `ad4f4617262449dd86c6139a8de386fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:13.432589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d50236c7-3f9b-4811-8d75-9ad29173b247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:13.736691 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3835/7709] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:13.741241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61135ca-f6f5-42c7-bd0b-16cfcbea7cdf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:13.902699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:13.966792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61135ca-f6f5-42c7-bd0b-16cfcbea7cdf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:13.982798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259f270-d965-4fed-959a-9c643c378b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:13.983444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f270-d965-4fed-959a-9c643c378b40 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:13.983732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f270-d965-4fed-959a-9c643c378b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:13.983983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f270-d965-4fed-959a-9c643c378b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:13.984626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259f270-d965-4fed-959a-9c643c378b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:13.993268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259f270-d965-4fed-959a-9c643c378b40 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:14.085807 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3875/7710] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:13 2022] POST /identity/v3/projects => generated 401 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:14.086701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50236c7-3f9b-4811-8d75-9ad29173b247 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:14.103978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50236c7-3f9b-4811-8d75-9ad29173b247 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:14.256749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735969c-15a7-4e9d-bf22-b9b85ed584a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:14.259359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735969c-15a7-4e9d-bf22-b9b85ed584a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:14.260093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735969c-15a7-4e9d-bf22-b9b85ed584a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:14.261209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735969c-15a7-4e9d-bf22-b9b85ed584a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:14.264792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735969c-15a7-4e9d-bf22-b9b85ed584a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:14.269764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735969c-15a7-4e9d-bf22-b9b85ed584a0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:14.327461 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3836/7711] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:14 2022] POST /identity/v3/users => generated 307 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:14.331579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259f270-d965-4fed-959a-9c643c378b40 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:14.345024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259f270-d965-4fed-959a-9c643c378b40 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:14.358130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058cd20-201e-44ea-915d-8c1057f620c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:14.359012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058cd20-201e-44ea-915d-8c1057f620c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:14.359286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058cd20-201e-44ea-915d-8c1057f620c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:14.359562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058cd20-201e-44ea-915d-8c1057f620c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:14.360622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058cd20-201e-44ea-915d-8c1057f620c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:14.364839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058cd20-201e-44ea-915d-8c1057f620c8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:14.393903 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3876/7712] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:14.398831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735969c-15a7-4e9d-bf22-b9b85ed584a0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:14.414926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735969c-15a7-4e9d-bf22-b9b85ed584a0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:14.433555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583733d-f618-41ae-912f-a6829ba621eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:14.434996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583733d-f618-41ae-912f-a6829ba621eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:14.435495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583733d-f618-41ae-912f-a6829ba621eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:14.435588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583733d-f618-41ae-912f-a6829ba621eb admin admin] PATH_INFO: `/v3/projects/eb7cd90e27f9481098ccec6177b61c3f/users/f9aee2b3b32e45bfb761831019b59ab8/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:14.495938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583733d-f618-41ae-912f-a6829ba621eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7cd90e27f9481098ccec6177b61c3f, user_id=f9aee2b3b32e45bfb761831019b59ab8, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:14.500641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583733d-f618-41ae-912f-a6829ba621eb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:14.533539 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3837/7713] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:14 2022] PUT /identity/v3/projects/eb7cd90e27f9481098ccec6177b61c3f/users/f9aee2b3b32e45bfb761831019b59ab8/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:14.537389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058cd20-201e-44ea-915d-8c1057f620c8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:14.551855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058cd20-201e-44ea-915d-8c1057f620c8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:14.741195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d0db0-8973-4ab2-b3f9-23c7e177a80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:14.746356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d0db0-8973-4ab2-b3f9-23c7e177a80d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:14.746527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d0db0-8973-4ab2-b3f9-23c7e177a80d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:14.749318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d0db0-8973-4ab2-b3f9-23c7e177a80d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:14.750225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d0db0-8973-4ab2-b3f9-23c7e177a80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:14.754779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d0db0-8973-4ab2-b3f9-23c7e177a80d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:14.806315 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3877/7714] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:14.807796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583733d-f618-41ae-912f-a6829ba621eb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:14.849983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583733d-f618-41ae-912f-a6829ba621eb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:14.864998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596964d0-1254-4ce3-bb44-64b76aca4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:14.866702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596964d0-1254-4ce3-bb44-64b76aca4ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:14.866986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596964d0-1254-4ce3-bb44-64b76aca4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:14.867262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596964d0-1254-4ce3-bb44-64b76aca4ec4 admin admin] PATH_INFO: `/v3/projects/eb7cd90e27f9481098ccec6177b61c3f/users/f9aee2b3b32e45bfb761831019b59ab8/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:14.874519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596964d0-1254-4ce3-bb44-64b76aca4ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7cd90e27f9481098ccec6177b61c3f, user_id=f9aee2b3b32e45bfb761831019b59ab8, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:14.880461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596964d0-1254-4ce3-bb44-64b76aca4ec4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:14.944010 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3838/7715] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:14 2022] PUT /identity/v3/projects/eb7cd90e27f9481098ccec6177b61c3f/users/f9aee2b3b32e45bfb761831019b59ab8/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:14.956789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b649-5a6a-4ec1-930e-5848e60fd32a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:14.957158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b649-5a6a-4ec1-930e-5848e60fd32a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:14.957339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3b649-5a6a-4ec1-930e-5848e60fd32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:15.058858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a8e3b649-5a6a-4ec1-930e-5848e60fd32a None None] MFA Rules not processed for user `f9aee2b3b32e45bfb761831019b59ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:15.060371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a8e3b649-5a6a-4ec1-930e-5848e60fd32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:15.217015 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3878/7716] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:14 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:15.231385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596964d0-1254-4ce3-bb44-64b76aca4ec4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:15.234409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-596964d0-1254-4ce3-bb44-64b76aca4ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:15.423613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:15.435279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596964d0-1254-4ce3-bb44-64b76aca4ec4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:15.443693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eab7d2-d5e5-4df3-af07-9eb58ebc1619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:15.444607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab7d2-d5e5-4df3-af07-9eb58ebc1619 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:15.445044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab7d2-d5e5-4df3-af07-9eb58ebc1619 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:15.445469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eab7d2-d5e5-4df3-af07-9eb58ebc1619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:15.477106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eab7d2-d5e5-4df3-af07-9eb58ebc1619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:15.478990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eab7d2-d5e5-4df3-af07-9eb58ebc1619 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:15.529583 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3839/7717] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:15 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:15.714978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b649-5a6a-4ec1-930e-5848e60fd32a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:15.741263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3b649-5a6a-4ec1-930e-5848e60fd32a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:15.753231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b975468-2d30-4f8c-b884-a63e25f66e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:15.753972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b975468-2d30-4f8c-b884-a63e25f66e5a service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:15.754490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b975468-2d30-4f8c-b884-a63e25f66e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:15.754911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b975468-2d30-4f8c-b884-a63e25f66e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:15.832510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:15.928127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b975468-2d30-4f8c-b884-a63e25f66e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:15.930260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b975468-2d30-4f8c-b884-a63e25f66e5a service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:15.980422 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3879/7718] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:15 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:16.231900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80589b40-e0e1-49bb-838f-7fff0c963d42 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:16.232381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80589b40-e0e1-49bb-838f-7fff0c963d42 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:16.232489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80589b40-e0e1-49bb-838f-7fff0c963d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:16.264047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-80589b40-e0e1-49bb-838f-7fff0c963d42 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:16.268330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-80589b40-e0e1-49bb-838f-7fff0c963d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:16.376939 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3840/7719] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:49:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:16.391586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b975468-2d30-4f8c-b884-a63e25f66e5a service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:16.397190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3b975468-2d30-4f8c-b884-a63e25f66e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:16.611147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b975468-2d30-4f8c-b884-a63e25f66e5a service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:16.625170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2334d-523b-46ae-a609-f777c3f50acc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:16.626795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2334d-523b-46ae-a609-f777c3f50acc service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:16.627083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2334d-523b-46ae-a609-f777c3f50acc service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:16.627336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2334d-523b-46ae-a609-f777c3f50acc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:16.647557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2334d-523b-46ae-a609-f777c3f50acc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:16.649307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2334d-523b-46ae-a609-f777c3f50acc service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:16.679094 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3880/7720] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:49:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:49:17.284799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76342711-2739-4808-a997-a84bd4e6b094 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:17.285373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76342711-2739-4808-a997-a84bd4e6b094 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:17.285535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76342711-2739-4808-a997-a84bd4e6b094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:17.334690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-76342711-2739-4808-a997-a84bd4e6b094 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:17.338215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-76342711-2739-4808-a997-a84bd4e6b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:17.370309 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3841/7721] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:49:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:49:17.380300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2334d-523b-46ae-a609-f777c3f50acc service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:17.403135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2334d-523b-46ae-a609-f777c3f50acc service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:17.441484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ca8d5-7ebb-4ce6-a09c-0944694ac686 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:17.442233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca8d5-7ebb-4ce6-a09c-0944694ac686 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:17.442811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca8d5-7ebb-4ce6-a09c-0944694ac686 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:17.443349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ca8d5-7ebb-4ce6-a09c-0944694ac686 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:17.495547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ca8d5-7ebb-4ce6-a09c-0944694ac686 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:17.507501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ca8d5-7ebb-4ce6-a09c-0944694ac686 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:17.550159 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3881/7722] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:49:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:49:18.787807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bcb44-129f-4fe7-b597-43e203f50751 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:18.788234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bcb44-129f-4fe7-b597-43e203f50751 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:18.788354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bcb44-129f-4fe7-b597-43e203f50751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:18.845520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-727bcb44-129f-4fe7-b597-43e203f50751 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:18.847274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-727bcb44-129f-4fe7-b597-43e203f50751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:18.879099 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3842/7723] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:49:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:18.896669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ca8d5-7ebb-4ce6-a09c-0944694ac686 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:18.917511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ca8d5-7ebb-4ce6-a09c-0944694ac686 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:18.939424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25b979-5575-4afa-8d49-3e2654ba66d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:18.940495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25b979-5575-4afa-8d49-3e2654ba66d1 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:18.940986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25b979-5575-4afa-8d49-3e2654ba66d1 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:18.941479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25b979-5575-4afa-8d49-3e2654ba66d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:18.959371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25b979-5575-4afa-8d49-3e2654ba66d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:18.965737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25b979-5575-4afa-8d49-3e2654ba66d1 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:18.989675 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3882/7724] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:49:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:49:19.600491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74cb1-02b2-4c14-a828-214c4216e09a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:19.600785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74cb1-02b2-4c14-a828-214c4216e09a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:19.601060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74cb1-02b2-4c14-a828-214c4216e09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:19.652534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-11a74cb1-02b2-4c14-a828-214c4216e09a None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:19.655265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-11a74cb1-02b2-4c14-a828-214c4216e09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:19.677098 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3843/7725] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:49:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:19.693228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25b979-5575-4afa-8d49-3e2654ba66d1 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:19.726475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25b979-5575-4afa-8d49-3e2654ba66d1 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:19.732839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d24d2f-b14c-490f-91f6-fe62e0294f42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:19.734438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d24d2f-b14c-490f-91f6-fe62e0294f42 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:19.735260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d24d2f-b14c-490f-91f6-fe62e0294f42 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:19.735687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d24d2f-b14c-490f-91f6-fe62e0294f42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:19.746365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d24d2f-b14c-490f-91f6-fe62e0294f42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:19.748696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d24d2f-b14c-490f-91f6-fe62e0294f42 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:19.773048 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3883/7726] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:49:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:49:20.380147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80294a7b-0c18-4f44-9466-935fe47c85f6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:20.380700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80294a7b-0c18-4f44-9466-935fe47c85f6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:20.381051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80294a7b-0c18-4f44-9466-935fe47c85f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:20.430509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-80294a7b-0c18-4f44-9466-935fe47c85f6 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:20.433275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-80294a7b-0c18-4f44-9466-935fe47c85f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:20.457266 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3844/7727] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:49:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:20.471141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d24d2f-b14c-490f-91f6-fe62e0294f42 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:20.514598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d24d2f-b14c-490f-91f6-fe62e0294f42 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:20.530583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00481f-b5bb-4795-84ff-57d07fe76279 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:20.532640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00481f-b5bb-4795-84ff-57d07fe76279 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:20.533271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00481f-b5bb-4795-84ff-57d07fe76279 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:20.533775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00481f-b5bb-4795-84ff-57d07fe76279 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:20.547592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00481f-b5bb-4795-84ff-57d07fe76279 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:20.549701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00481f-b5bb-4795-84ff-57d07fe76279 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:20.561629 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3884/7728] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:49:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:49:23.819382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80294a7b-0c18-4f44-9466-935fe47c85f6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:23.821492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-80294a7b-0c18-4f44-9466-935fe47c85f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:24.219725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80294a7b-0c18-4f44-9466-935fe47c85f6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:24.252423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc5f4a-7769-4b87-90b8-709d813096da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:24.257916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc5f4a-7769-4b87-90b8-709d813096da service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:24.258418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc5f4a-7769-4b87-90b8-709d813096da service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:24.258845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc5f4a-7769-4b87-90b8-709d813096da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:24.264527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8cfc5f4a-7769-4b87-90b8-709d813096da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:24.301457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc5f4a-7769-4b87-90b8-709d813096da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:24.306620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc5f4a-7769-4b87-90b8-709d813096da service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:24.374103 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3845/7729] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:49:27.410638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00481f-b5bb-4795-84ff-57d07fe76279 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:27.412735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c00481f-b5bb-4795-84ff-57d07fe76279 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:27.587970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00481f-b5bb-4795-84ff-57d07fe76279 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:27.601009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:27.601979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:27.602414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:27.602866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] PATH_INFO: `/v3/users/4f01992e959c428387d42d346ee9eb8c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:27.604232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f01992e959c428387d42d346ee9eb8c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:27.606520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:27.630746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:27.727224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f01992e959c428387d42d346ee9eb8c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:27.727922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f01992e959c428387d42d346ee9eb8c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:27.755698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f01992e959c428387d42d346ee9eb8c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:27.773675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f01992e959c428387d42d346ee9eb8c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:27.804436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f01992e959c428387d42d346ee9eb8c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:27.827208 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3885/7730] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:49:27 2022] DELETE /identity/v3/users/4f01992e959c428387d42d346ee9eb8c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:28.933858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc5f4a-7769-4b87-90b8-709d813096da service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:28.954111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc5f4a-7769-4b87-90b8-709d813096da service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:28.974588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:28.976813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:29.187031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6888691-fa51-4ee5-92ce-76a73d43c0b3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:29.240350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:29.242611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:29.244871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:29.246109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] PATH_INFO: `/v3/users/ad4f4617262449dd86c6139a8de386fe` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:29.250077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4f4617262449dd86c6139a8de386fe)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:29.257591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:29.262958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:29.263857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:29.264287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:29.264708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] PATH_INFO: `/v3/projects/12108e74029f4046bbd67d232a8f1aaf` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:29.266140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12108e74029f4046bbd67d232a8f1aaf)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:29.268577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:29.270730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:29.384473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12108e74029f4046bbd67d232a8f1aaf', 'request_id': 'req-90862727-5f02-4d29-a2a6-6364ed755042'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:29.404427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12108e74029f4046bbd67d232a8f1aaf', 'request_id': 'req-90862727-5f02-4d29-a2a6-6364ed755042'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:29.404783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4f4617262449dd86c6139a8de386fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:29.406228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4f4617262449dd86c6139a8de386fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:29.415257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12108e74029f4046bbd67d232a8f1aaf', 'request_id': 'req-90862727-5f02-4d29-a2a6-6364ed755042'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:29.430818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4f4617262449dd86c6139a8de386fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:29.443096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] The token cache is being invalidate because project 12108e74029f4046bbd67d232a8f1aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:49:29.443096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:29.445219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-90862727-5f02-4d29-a2a6-6364ed755042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:29.451928 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3846/7731] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:49:28 2022] DELETE /identity/v3/projects/12108e74029f4046bbd67d232a8f1aaf => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:29.459851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e3e8c-c5c7-49cf-b9bb-a818f910f035 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:29.460587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e3e8c-c5c7-49cf-b9bb-a818f910f035 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:29.461018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e3e8c-c5c7-49cf-b9bb-a818f910f035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:29.461855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4f4617262449dd86c6139a8de386fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:29.490463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-eac86b60-d76b-4b5a-80f7-aebae9197271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4f4617262449dd86c6139a8de386fe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:29.515999 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3886/7732] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:49:28 2022] DELETE /identity/v3/users/ad4f4617262449dd86c6139a8de386fe => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:49:29.517211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b68e3e8c-c5c7-49cf-b9bb-a818f910f035 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:29.520151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b68e3e8c-c5c7-49cf-b9bb-a818f910f035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:29.522671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a900659-aa79-4fe6-91ce-a8d4cec60672 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:29.522958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a900659-aa79-4fe6-91ce-a8d4cec60672 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:29.523223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a900659-aa79-4fe6-91ce-a8d4cec60672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:29.569565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:29.590008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9a900659-aa79-4fe6-91ce-a8d4cec60672 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:29.591626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9a900659-aa79-4fe6-91ce-a8d4cec60672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:29.726449 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3847/7733] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:29.737976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7af411-b5bd-42f6-b0bf-41b3bd48cb18 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:29.738506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7af411-b5bd-42f6-b0bf-41b3bd48cb18 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:29.738924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7af411-b5bd-42f6-b0bf-41b3bd48cb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:29.769418 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3887/7734] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:29.814691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8f7af411-b5bd-42f6-b0bf-41b3bd48cb18 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:29.815764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a900659-aa79-4fe6-91ce-a8d4cec60672 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:29.816038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8f7af411-b5bd-42f6-b0bf-41b3bd48cb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:29.817231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9a900659-aa79-4fe6-91ce-a8d4cec60672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:29.835276 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3848/7735] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:29.836480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7af411-b5bd-42f6-b0bf-41b3bd48cb18 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:29.851924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7af411-b5bd-42f6-b0bf-41b3bd48cb18 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:29.866348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a693af-f57b-4e8a-8de3-3fa954e82f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:29.866991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a693af-f57b-4e8a-8de3-3fa954e82f75 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:29.867268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a693af-f57b-4e8a-8de3-3fa954e82f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:29.867538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a693af-f57b-4e8a-8de3-3fa954e82f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:29.868615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a693af-f57b-4e8a-8de3-3fa954e82f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:49:29.868985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a693af-f57b-4e8a-8de3-3fa954e82f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:29.872236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a693af-f57b-4e8a-8de3-3fa954e82f75 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:29.901307 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3849/7736] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:49:29.902517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a693af-f57b-4e8a-8de3-3fa954e82f75 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:29.927237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a693af-f57b-4e8a-8de3-3fa954e82f75 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:29.942564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383eb9e-36a3-47c3-80b3-995ecc2adb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:29.943199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383eb9e-36a3-47c3-80b3-995ecc2adb17 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:29.944330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383eb9e-36a3-47c3-80b3-995ecc2adb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:29.944634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383eb9e-36a3-47c3-80b3-995ecc2adb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:29.945334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383eb9e-36a3-47c3-80b3-995ecc2adb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:29.948378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383eb9e-36a3-47c3-80b3-995ecc2adb17 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:29.974035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a900659-aa79-4fe6-91ce-a8d4cec60672 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:29.982937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98bbde-5811-4ec6-a156-3c6eab9248c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:29.984753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98bbde-5811-4ec6-a156-3c6eab9248c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:29.985358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98bbde-5811-4ec6-a156-3c6eab9248c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:29.985789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98bbde-5811-4ec6-a156-3c6eab9248c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:30.008716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98bbde-5811-4ec6-a156-3c6eab9248c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:30.010646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98bbde-5811-4ec6-a156-3c6eab9248c1 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:30.042454 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3888/7737] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:49:30.044896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98bbde-5811-4ec6-a156-3c6eab9248c1 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:30.050247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5b98bbde-5811-4ec6-a156-3c6eab9248c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:30.057412 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3850/7738] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:29 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:30.060149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383eb9e-36a3-47c3-80b3-995ecc2adb17 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:30.085050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98bbde-5811-4ec6-a156-3c6eab9248c1 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:30.202679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:30.203489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:30.203868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:30.204238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] PATH_INFO: `/v3/users/f89a6da82f9649798cce2ee71a9950e0` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:30.205843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f89a6da82f9649798cce2ee71a9950e0)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:30.211007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:30.223930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:30.259540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383eb9e-36a3-47c3-80b3-995ecc2adb17 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:30.272607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658335f-d8cf-4f99-bd7a-3f7911c035dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:30.273250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658335f-d8cf-4f99-bd7a-3f7911c035dd admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:30.273526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658335f-d8cf-4f99-bd7a-3f7911c035dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:30.273793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658335f-d8cf-4f99-bd7a-3f7911c035dd admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:30.274861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658335f-d8cf-4f99-bd7a-3f7911c035dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:30.279310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658335f-d8cf-4f99-bd7a-3f7911c035dd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:30.327107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f89a6da82f9649798cce2ee71a9950e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:30.327852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f89a6da82f9649798cce2ee71a9950e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:30.333526 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3851/7739] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:30 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:30.334529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658335f-d8cf-4f99-bd7a-3f7911c035dd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:30.345172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:30.351974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f89a6da82f9649798cce2ee71a9950e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:30.360990 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658335f-d8cf-4f99-bd7a-3f7911c035dd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:30.375689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db68aa-3342-4fa8-ab3b-5eb47a9488a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:30.378241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db68aa-3342-4fa8-ab3b-5eb47a9488a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:30.378874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db68aa-3342-4fa8-ab3b-5eb47a9488a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:30.379154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db68aa-3342-4fa8-ab3b-5eb47a9488a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:30.380814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f89a6da82f9649798cce2ee71a9950e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:30.382113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db68aa-3342-4fa8-ab3b-5eb47a9488a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:30.385585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db68aa-3342-4fa8-ab3b-5eb47a9488a2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:30.412038 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3852/7740] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:30.417925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db68aa-3342-4fa8-ab3b-5eb47a9488a2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:30.425119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1f5fd6da-9df6-4b7e-abf5-80d5fadaa11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f89a6da82f9649798cce2ee71a9950e0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:30.441100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db68aa-3342-4fa8-ab3b-5eb47a9488a2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:30.447259 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3889/7741] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:49:30 2022] DELETE /identity/v3/users/f89a6da82f9649798cce2ee71a9950e0 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:30.452209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceec7bf-269c-4397-af91-15c2ae24c68e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:30.452544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceec7bf-269c-4397-af91-15c2ae24c68e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:30.457254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceec7bf-269c-4397-af91-15c2ae24c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:30.507205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1ceec7bf-269c-4397-af91-15c2ae24c68e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:30.508461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1ceec7bf-269c-4397-af91-15c2ae24c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:30.633223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914383a-cced-4468-afb3-ebd783173ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:30.643974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914383a-cced-4468-afb3-ebd783173ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:30.644225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914383a-cced-4468-afb3-ebd783173ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:30.646229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914383a-cced-4468-afb3-ebd783173ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:30.646229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914383a-cced-4468-afb3-ebd783173ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:30.649687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914383a-cced-4468-afb3-ebd783173ef4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:30.674589 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3890/7742] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:30.701828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceec7bf-269c-4397-af91-15c2ae24c68e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:30.703459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1ceec7bf-269c-4397-af91-15c2ae24c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:30.707885 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3853/7743] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:30.709110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914383a-cced-4468-afb3-ebd783173ef4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:30.718817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1914383a-cced-4468-afb3-ebd783173ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:30.723587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceec7bf-269c-4397-af91-15c2ae24c68e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:30.742295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200a817-e7bc-45cc-92bc-90783debc58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:30.743025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200a817-e7bc-45cc-92bc-90783debc58f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:30.743304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200a817-e7bc-45cc-92bc-90783debc58f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:30.743571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200a817-e7bc-45cc-92bc-90783debc58f admin admin] PATH_INFO: `/v3/projects/3eb6ce389f92430183e8a4cf3cb64a76/users/75b1bde02d1e4d2796ab58bdd342282f/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:30.798969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200a817-e7bc-45cc-92bc-90783debc58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb6ce389f92430183e8a4cf3cb64a76, user_id=75b1bde02d1e4d2796ab58bdd342282f, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:30.811020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200a817-e7bc-45cc-92bc-90783debc58f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:30.845395 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3891/7744] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:30 2022] PUT /identity/v3/projects/3eb6ce389f92430183e8a4cf3cb64a76/users/75b1bde02d1e4d2796ab58bdd342282f/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:49:30.851346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf3186-e2ef-48b6-8401-c09168b45110 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:30.851631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf3186-e2ef-48b6-8401-c09168b45110 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:30.851899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf3186-e2ef-48b6-8401-c09168b45110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:30.867563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914383a-cced-4468-afb3-ebd783173ef4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:30.918401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-39bf3186-e2ef-48b6-8401-c09168b45110 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:30.922093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-39bf3186-e2ef-48b6-8401-c09168b45110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:30.992022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37daec8-b53a-47a5-bb20-44732427189e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:30.993362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37daec8-b53a-47a5-bb20-44732427189e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:30.994864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37daec8-b53a-47a5-bb20-44732427189e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:30.994864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37daec8-b53a-47a5-bb20-44732427189e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:31.071985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:31.109270 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3892/7745] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:31.142073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37daec8-b53a-47a5-bb20-44732427189e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:31.142242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf3186-e2ef-48b6-8401-c09168b45110 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:31.146864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37daec8-b53a-47a5-bb20-44732427189e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:31.160069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf3186-e2ef-48b6-8401-c09168b45110 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:31.166315 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3854/7746] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:31.167953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf63c3-43f5-4f54-9abe-a9c06bd19db9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:31.168878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf63c3-43f5-4f54-9abe-a9c06bd19db9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:31.169239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf63c3-43f5-4f54-9abe-a9c06bd19db9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:31.169503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf63c3-43f5-4f54-9abe-a9c06bd19db9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:31.200325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf63c3-43f5-4f54-9abe-a9c06bd19db9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:31.202114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf63c3-43f5-4f54-9abe-a9c06bd19db9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:31.225628 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3893/7747] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:31.736109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37daec8-b53a-47a5-bb20-44732427189e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:31.737626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c37daec8-b53a-47a5-bb20-44732427189e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:31.766533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37daec8-b53a-47a5-bb20-44732427189e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:31.785428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:31.786203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:31.786479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:31.786748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] PATH_INFO: `/v3/projects/3c972d04ce71430185507330a69baeb5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:31.792548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c972d04ce71430185507330a69baeb5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:31.796479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:31.984043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf63c3-43f5-4f54-9abe-a9c06bd19db9 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:31.985770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-97bf63c3-43f5-4f54-9abe-a9c06bd19db9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:31.994829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c972d04ce71430185507330a69baeb5', 'request_id': 'req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:32.040480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf63c3-43f5-4f54-9abe-a9c06bd19db9 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:32.041413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c972d04ce71430185507330a69baeb5', 'request_id': 'req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:32.082898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c972d04ce71430185507330a69baeb5', 'request_id': 'req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:32.143596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] The token cache is being invalidate because project 3c972d04ce71430185507330a69baeb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:49:32.149973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:32.149973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:32.149973 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3855/7748] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:49:31 2022] DELETE /identity/v3/projects/3c972d04ce71430185507330a69baeb5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:32.151539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:32.154468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:32.188170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:32.358710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:32.359781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:32.360056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:32.360324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] PATH_INFO: `/v3/projects/031e23f91c9e4f68822423ecb65e3b16` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:32.363606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=031e23f91c9e4f68822423ecb65e3b16)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:32.366320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:32.534247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031e23f91c9e4f68822423ecb65e3b16', 'request_id': 'req-4c6c1e38-fb1f-4d8f-a356-10c976040770'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:32.546590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031e23f91c9e4f68822423ecb65e3b16', 'request_id': 'req-4c6c1e38-fb1f-4d8f-a356-10c976040770'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:32.553631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192dc1ff-a1d6-4f36-9066-8be9f2c8fcee admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:32.573724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031e23f91c9e4f68822423ecb65e3b16', 'request_id': 'req-4c6c1e38-fb1f-4d8f-a356-10c976040770'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:32.586455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] The token cache is being invalidate because project 031e23f91c9e4f68822423ecb65e3b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:49:32.586750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:32.589769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:32.606778 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3894/7749] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:49:31 2022] DELETE /identity/v3/projects/031e23f91c9e4f68822423ecb65e3b16 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:49:32.915662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:32.916355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:32.921158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:32.921562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] PATH_INFO: `/v3/users/f9aee2b3b32e45bfb761831019b59ab8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:32.924461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9aee2b3b32e45bfb761831019b59ab8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:32.928812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:32.943239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:33.125081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9aee2b3b32e45bfb761831019b59ab8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:33.158172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9aee2b3b32e45bfb761831019b59ab8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:33.214015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9aee2b3b32e45bfb761831019b59ab8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:33.239506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9aee2b3b32e45bfb761831019b59ab8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:33.240330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbc7797c-20c5-4ce9-ab5b-9850f2d60ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9aee2b3b32e45bfb761831019b59ab8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:33.257119 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3856/7750] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:49:32 2022] DELETE /identity/v3/users/f9aee2b3b32e45bfb761831019b59ab8 => generated 0 bytes in 1106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:34.144760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:34.150658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:34.188690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c1e38-fb1f-4d8f-a356-10c976040770 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:34.480614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:34.481353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:34.481624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:34.481917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] PATH_INFO: `/v3/projects/eb7cd90e27f9481098ccec6177b61c3f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:34.487166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7cd90e27f9481098ccec6177b61c3f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:34.489182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:34.661482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7cd90e27f9481098ccec6177b61c3f', 'request_id': 'req-059230ef-029a-4d18-8eb5-fbf556fb92d0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:34.691310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7cd90e27f9481098ccec6177b61c3f', 'request_id': 'req-059230ef-029a-4d18-8eb5-fbf556fb92d0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:34.716074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7cd90e27f9481098ccec6177b61c3f', 'request_id': 'req-059230ef-029a-4d18-8eb5-fbf556fb92d0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:34.732522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:34.748600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] The token cache is being invalidate because project eb7cd90e27f9481098ccec6177b61c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:49:34.750533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:34.752151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-059230ef-029a-4d18-8eb5-fbf556fb92d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:34.760782 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3895/7751] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:49:34 2022] DELETE /identity/v3/projects/eb7cd90e27f9481098ccec6177b61c3f => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:34.762558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a77d15-2ec8-4e0c-a844-51ce282ec931 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:34.763180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a77d15-2ec8-4e0c-a844-51ce282ec931 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:34.763180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a77d15-2ec8-4e0c-a844-51ce282ec931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:34.819288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e8a77d15-2ec8-4e0c-a844-51ce282ec931 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:34.820556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e8a77d15-2ec8-4e0c-a844-51ce282ec931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:35.063647 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3857/7752] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:35.071705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2a7b1-f6c2-4636-a5a0-c4534325dda3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:35.072239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2a7b1-f6c2-4636-a5a0-c4534325dda3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:35.072605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2a7b1-f6c2-4636-a5a0-c4534325dda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:35.127476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d6e2a7b1-f6c2-4636-a5a0-c4534325dda3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:35.128782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d6e2a7b1-f6c2-4636-a5a0-c4534325dda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:35.155583 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3896/7753] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:35.158108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a77d15-2ec8-4e0c-a844-51ce282ec931 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:35.187291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a77d15-2ec8-4e0c-a844-51ce282ec931 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:35.208554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da7d77-72ee-4edf-9827-fcbd6d85c7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:35.209008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7d77-72ee-4edf-9827-fcbd6d85c7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:35.209285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7d77-72ee-4edf-9827-fcbd6d85c7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:35.209554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7d77-72ee-4edf-9827-fcbd6d85c7c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:35.219672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da7d77-72ee-4edf-9827-fcbd6d85c7c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:49:35.220055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da7d77-72ee-4edf-9827-fcbd6d85c7c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:35.221782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da7d77-72ee-4edf-9827-fcbd6d85c7c6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:35.293561 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3858/7754] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:49:35.298519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2a7b1-f6c2-4636-a5a0-c4534325dda3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:35.313453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2a7b1-f6c2-4636-a5a0-c4534325dda3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:35.332345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7726ebe-775b-4f74-b199-9007d7d8bfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:35.333047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7726ebe-775b-4f74-b199-9007d7d8bfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:35.333325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7726ebe-775b-4f74-b199-9007d7d8bfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:35.333593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7726ebe-775b-4f74-b199-9007d7d8bfe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:35.334289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7726ebe-775b-4f74-b199-9007d7d8bfe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:35.341792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7726ebe-775b-4f74-b199-9007d7d8bfe2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:35.437161 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3897/7755] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:35 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:35.438257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da7d77-72ee-4edf-9827-fcbd6d85c7c6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:35.457612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da7d77-72ee-4edf-9827-fcbd6d85c7c6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:35.650647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085eaa6-5d71-46cf-9077-7e314e2a96c9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:35.650930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085eaa6-5d71-46cf-9077-7e314e2a96c9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:35.651652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085eaa6-5d71-46cf-9077-7e314e2a96c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:35.716980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8085eaa6-5d71-46cf-9077-7e314e2a96c9 None None] MFA Rules not processed for user `75b1bde02d1e4d2796ab58bdd342282f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:35.718465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8085eaa6-5d71-46cf-9077-7e314e2a96c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:35.772414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4e1fe-1d06-46c0-b310-9c80be2b106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:35.774165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4e1fe-1d06-46c0-b310-9c80be2b106f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:35.774607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4e1fe-1d06-46c0-b310-9c80be2b106f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:35.775040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4e1fe-1d06-46c0-b310-9c80be2b106f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:35.805234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4e1fe-1d06-46c0-b310-9c80be2b106f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:35.813474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4e1fe-1d06-46c0-b310-9c80be2b106f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:35.871738 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3898/7756] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:35.876456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085eaa6-5d71-46cf-9077-7e314e2a96c9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:35.879298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8085eaa6-5d71-46cf-9077-7e314e2a96c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:35.883961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:35.909644 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3859/7757] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:35 2022] POST /identity/v3/users => generated 291 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:35.910992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4e1fe-1d06-46c0-b310-9c80be2b106f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:35.923274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085eaa6-5d71-46cf-9077-7e314e2a96c9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:35.939421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4fcce-e05c-4288-9e0c-d102fedeaa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:35.942681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4fcce-e05c-4288-9e0c-d102fedeaa5c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:35.943562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4fcce-e05c-4288-9e0c-d102fedeaa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:35.943984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4fcce-e05c-4288-9e0c-d102fedeaa5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:35.944208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4e1fe-1d06-46c0-b310-9c80be2b106f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:35.956447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4fcce-e05c-4288-9e0c-d102fedeaa5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:35.970582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4fcce-e05c-4288-9e0c-d102fedeaa5c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:35.974589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3403e07-484b-4531-8b22-5d8a4c3cc770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:35.977365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3403e07-484b-4531-8b22-5d8a4c3cc770 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:35.978780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3403e07-484b-4531-8b22-5d8a4c3cc770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:35.979218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3403e07-484b-4531-8b22-5d8a4c3cc770 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:35.981498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3403e07-484b-4531-8b22-5d8a4c3cc770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:35.986146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3403e07-484b-4531-8b22-5d8a4c3cc770 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:36.020880 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3860/7758] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:36.024090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3403e07-484b-4531-8b22-5d8a4c3cc770 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:36.060950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3403e07-484b-4531-8b22-5d8a4c3cc770 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:36.076636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05481a4f-462d-4186-81da-32cda6a3e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:36.077478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05481a4f-462d-4186-81da-32cda6a3e9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:36.077767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05481a4f-462d-4186-81da-32cda6a3e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:36.078069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05481a4f-462d-4186-81da-32cda6a3e9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:36.078738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05481a4f-462d-4186-81da-32cda6a3e9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:36.080465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05481a4f-462d-4186-81da-32cda6a3e9b0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:36.118363 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3861/7759] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:36.119398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05481a4f-462d-4186-81da-32cda6a3e9b0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:36.123727 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3899/7760] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:35 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:36.129602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4fcce-e05c-4288-9e0c-d102fedeaa5c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:36.161887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05481a4f-462d-4186-81da-32cda6a3e9b0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:36.267491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4fcce-e05c-4288-9e0c-d102fedeaa5c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:36.280658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43eeb9f-c9e8-459f-bccf-01b89ce18dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:36.281339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43eeb9f-c9e8-459f-bccf-01b89ce18dad admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:36.281671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43eeb9f-c9e8-459f-bccf-01b89ce18dad admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:36.282166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43eeb9f-c9e8-459f-bccf-01b89ce18dad admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:36.284378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43eeb9f-c9e8-459f-bccf-01b89ce18dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:36.287679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43eeb9f-c9e8-459f-bccf-01b89ce18dad admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:36.317593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10605683-9c2e-47f6-952f-c24f83f9638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:36.318410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10605683-9c2e-47f6-952f-c24f83f9638b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:36.318909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10605683-9c2e-47f6-952f-c24f83f9638b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:36.319197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10605683-9c2e-47f6-952f-c24f83f9638b admin admin] PATH_INFO: `/v3/projects/46e503e83e684e26b7bcf8be8350c555/users/aefebb31be1344388e4a9c3874c6e243/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:36.337293 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3900/7761] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:36 2022] POST /identity/v3/users => generated 296 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:36.341982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43eeb9f-c9e8-459f-bccf-01b89ce18dad admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:36.368370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10605683-9c2e-47f6-952f-c24f83f9638b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e503e83e684e26b7bcf8be8350c555, user_id=aefebb31be1344388e4a9c3874c6e243, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:36.374747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43eeb9f-c9e8-459f-bccf-01b89ce18dad admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:36.378160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10605683-9c2e-47f6-952f-c24f83f9638b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:36.387783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd3ac-5388-49d7-92ab-e055032e74c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:36.388698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd3ac-5388-49d7-92ab-e055032e74c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:36.390109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd3ac-5388-49d7-92ab-e055032e74c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:36.390534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648dd3ac-5388-49d7-92ab-e055032e74c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:36.393324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dd3ac-5388-49d7-92ab-e055032e74c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:36.395739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648dd3ac-5388-49d7-92ab-e055032e74c8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:36.412900 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3862/7762] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:36 2022] PUT /identity/v3/projects/46e503e83e684e26b7bcf8be8350c555/users/aefebb31be1344388e4a9c3874c6e243/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:36.428432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250c3be-9bc8-4319-a78d-216a230e3abf None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:36.431759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250c3be-9bc8-4319-a78d-216a230e3abf None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:36.432128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250c3be-9bc8-4319-a78d-216a230e3abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:36.476500 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3901/7763] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:36.479608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd3ac-5388-49d7-92ab-e055032e74c8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:36.547390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1250c3be-9bc8-4319-a78d-216a230e3abf None None] MFA Rules not processed for user `aefebb31be1344388e4a9c3874c6e243`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:36.548740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648dd3ac-5388-49d7-92ab-e055032e74c8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:36.555672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1250c3be-9bc8-4319-a78d-216a230e3abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:36.582850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:36.702830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef10acf-b02f-483d-af64-f82c9555b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:36.705702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef10acf-b02f-483d-af64-f82c9555b5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:36.707303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef10acf-b02f-483d-af64-f82c9555b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:36.708102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef10acf-b02f-483d-af64-f82c9555b5f8 admin admin] PATH_INFO: `/v3/projects/2bfab75fd6ba4508bb41f798ebe8403b/users/f0f513e4d2e2419eacc5212d844c4e70/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:36.752416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef10acf-b02f-483d-af64-f82c9555b5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bfab75fd6ba4508bb41f798ebe8403b, user_id=f0f513e4d2e2419eacc5212d844c4e70, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:36.755391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef10acf-b02f-483d-af64-f82c9555b5f8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:36.784941 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3902/7764] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:36 2022] PUT /identity/v3/projects/2bfab75fd6ba4508bb41f798ebe8403b/users/f0f513e4d2e2419eacc5212d844c4e70/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:36.791887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef10acf-b02f-483d-af64-f82c9555b5f8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:36.886711 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3863/7765] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:36.891454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250c3be-9bc8-4319-a78d-216a230e3abf None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:36.920053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250c3be-9bc8-4319-a78d-216a230e3abf None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:37.030565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef10acf-b02f-483d-af64-f82c9555b5f8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:37.036303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:37.049541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4770f0-fd9c-4aa3-abf2-b6d9035fb809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:37.050863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4770f0-fd9c-4aa3-abf2-b6d9035fb809 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:37.051356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4770f0-fd9c-4aa3-abf2-b6d9035fb809 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:37.051722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4770f0-fd9c-4aa3-abf2-b6d9035fb809 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:37.052553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4770f0-fd9c-4aa3-abf2-b6d9035fb809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:37.054344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4770f0-fd9c-4aa3-abf2-b6d9035fb809 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:37.067616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f4f75-9db9-46d9-a9a6-fb15c7620b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:37.068616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f4f75-9db9-46d9-a9a6-fb15c7620b32 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:37.069039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f4f75-9db9-46d9-a9a6-fb15c7620b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:37.069445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f4f75-9db9-46d9-a9a6-fb15c7620b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:37.070488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f4f75-9db9-46d9-a9a6-fb15c7620b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:37.076795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f4f75-9db9-46d9-a9a6-fb15c7620b32 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:37.087314 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3903/7766] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:37.107632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4770f0-fd9c-4aa3-abf2-b6d9035fb809 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:37.137556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4770f0-fd9c-4aa3-abf2-b6d9035fb809 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:37.148149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18341cd0-476e-4089-9a8e-5a84b4d3459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:37.148833 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3864/7767] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:36 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:37.152061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18341cd0-476e-4089-9a8e-5a84b4d3459a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:37.152061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18341cd0-476e-4089-9a8e-5a84b4d3459a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:37.152061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18341cd0-476e-4089-9a8e-5a84b4d3459a admin admin] PATH_INFO: `/v3/projects/2bfab75fd6ba4508bb41f798ebe8403b/users/f0f513e4d2e2419eacc5212d844c4e70/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:37.152061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18341cd0-476e-4089-9a8e-5a84b4d3459a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bfab75fd6ba4508bb41f798ebe8403b, user_id=f0f513e4d2e2419eacc5212d844c4e70, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:37.155825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18341cd0-476e-4089-9a8e-5a84b4d3459a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:37.171246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f4f75-9db9-46d9-a9a6-fb15c7620b32 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:37.248817 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3904/7768] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:37 2022] PUT /identity/v3/projects/2bfab75fd6ba4508bb41f798ebe8403b/users/f0f513e4d2e2419eacc5212d844c4e70/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:37.420587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f4f75-9db9-46d9-a9a6-fb15c7620b32 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:37.588217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3204b-602b-488d-928c-93e52aba8ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:37.588964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3204b-602b-488d-928c-93e52aba8ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:37.589313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3204b-602b-488d-928c-93e52aba8ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:37.589801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3204b-602b-488d-928c-93e52aba8ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:37.590729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3204b-602b-488d-928c-93e52aba8ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:37.593820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3204b-602b-488d-928c-93e52aba8ed0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:37.672195 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3865/7769] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:37 2022] POST /identity/v3/users => generated 298 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:37.676601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18341cd0-476e-4089-9a8e-5a84b4d3459a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:37.706665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18341cd0-476e-4089-9a8e-5a84b4d3459a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:37.720310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fdd9f-4846-4610-af4d-10a3096511b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:37.720952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fdd9f-4846-4610-af4d-10a3096511b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:37.721230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fdd9f-4846-4610-af4d-10a3096511b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:37.721501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fdd9f-4846-4610-af4d-10a3096511b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:37.722527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fdd9f-4846-4610-af4d-10a3096511b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:37.724352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fdd9f-4846-4610-af4d-10a3096511b8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:37.775486 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3905/7770] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:37.779601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3204b-602b-488d-928c-93e52aba8ed0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:37.796941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3204b-602b-488d-928c-93e52aba8ed0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:37.812735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f09b1-c9cf-40f4-9fd1-d3d5705da96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:37.813362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f09b1-c9cf-40f4-9fd1-d3d5705da96a admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:37.813638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f09b1-c9cf-40f4-9fd1-d3d5705da96a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:37.813919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f09b1-c9cf-40f4-9fd1-d3d5705da96a admin admin] PATH_INFO: `/v3/projects/efcc33c31dd64e81bf8eb2193da54892/users/aa08210ec3aa4e0582840471c63121d2/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:37.847035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f09b1-c9cf-40f4-9fd1-d3d5705da96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcc33c31dd64e81bf8eb2193da54892, user_id=aa08210ec3aa4e0582840471c63121d2, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:37.852172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f09b1-c9cf-40f4-9fd1-d3d5705da96a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:37.890730 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3866/7771] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:37 2022] PUT /identity/v3/projects/efcc33c31dd64e81bf8eb2193da54892/users/aa08210ec3aa4e0582840471c63121d2/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:37.894755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fdd9f-4846-4610-af4d-10a3096511b8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:37.930083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fdd9f-4846-4610-af4d-10a3096511b8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:38.137935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7ed35-d12f-4490-92e5-ec658a7d8cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:38.140287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ed35-d12f-4490-92e5-ec658a7d8cfa admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:38.140287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ed35-d12f-4490-92e5-ec658a7d8cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:38.140287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7ed35-d12f-4490-92e5-ec658a7d8cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:38.140614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7ed35-d12f-4490-92e5-ec658a7d8cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:38.142142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7ed35-d12f-4490-92e5-ec658a7d8cfa admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:38.165230 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3906/7772] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:49:38.174413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f09b1-c9cf-40f4-9fd1-d3d5705da96a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:38.208165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f09b1-c9cf-40f4-9fd1-d3d5705da96a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:38.222202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9dc5-6544-4232-81d6-5aafcc62acb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:38.225466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9dc5-6544-4232-81d6-5aafcc62acb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:38.225466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9dc5-6544-4232-81d6-5aafcc62acb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:38.225466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9dc5-6544-4232-81d6-5aafcc62acb5 admin admin] PATH_INFO: `/v3/projects/efcc33c31dd64e81bf8eb2193da54892/users/aa08210ec3aa4e0582840471c63121d2/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:38.225466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd9dc5-6544-4232-81d6-5aafcc62acb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcc33c31dd64e81bf8eb2193da54892, user_id=aa08210ec3aa4e0582840471c63121d2, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:38.227997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd9dc5-6544-4232-81d6-5aafcc62acb5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:38.286402 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3867/7773] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:38 2022] PUT /identity/v3/projects/efcc33c31dd64e81bf8eb2193da54892/users/aa08210ec3aa4e0582840471c63121d2/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:38.289132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fab6a-fb7a-4160-a426-cc3ebe50ecf4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:38.289132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fab6a-fb7a-4160-a426-cc3ebe50ecf4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:38.289132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262fab6a-fb7a-4160-a426-cc3ebe50ecf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:38.297220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:38.356125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-262fab6a-fb7a-4160-a426-cc3ebe50ecf4 None None] MFA Rules not processed for user `aa08210ec3aa4e0582840471c63121d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:38.359931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-262fab6a-fb7a-4160-a426-cc3ebe50ecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:38.584632 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3907/7774] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:38.598659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9dc5-6544-4232-81d6-5aafcc62acb5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:38.602640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-93dd9dc5-6544-4232-81d6-5aafcc62acb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:38.676590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:38.726633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9dc5-6544-4232-81d6-5aafcc62acb5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:38.739450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636fb11-638a-4173-8201-3054eaa9bc46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:38.740077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636fb11-638a-4173-8201-3054eaa9bc46 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:38.740365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636fb11-638a-4173-8201-3054eaa9bc46 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:38.740617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636fb11-638a-4173-8201-3054eaa9bc46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:38.812398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636fb11-638a-4173-8201-3054eaa9bc46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:38.814837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636fb11-638a-4173-8201-3054eaa9bc46 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:38.829426 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3868/7775] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:38.861243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fab6a-fb7a-4160-a426-cc3ebe50ecf4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:38.863712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-262fab6a-fb7a-4160-a426-cc3ebe50ecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:38.976876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262fab6a-fb7a-4160-a426-cc3ebe50ecf4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:38.991299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:38.991964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:38.992236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:38.992496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] PATH_INFO: `/v3/users/39bca3fbaa494b45bd49b6a0b28a55a7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:38.993964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bca3fbaa494b45bd49b6a0b28a55a7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:39.002530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:39.135327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bca3fbaa494b45bd49b6a0b28a55a7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:39.136147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bca3fbaa494b45bd49b6a0b28a55a7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:39.155493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bca3fbaa494b45bd49b6a0b28a55a7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:39.199624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bca3fbaa494b45bd49b6a0b28a55a7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:39.226143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bca3fbaa494b45bd49b6a0b28a55a7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:39.238086 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3908/7776] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:49:38 2022] DELETE /identity/v3/users/39bca3fbaa494b45bd49b6a0b28a55a7 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:39.241956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530286-e5c3-4dc3-ae27-e67fcf98a690 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:39.243438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530286-e5c3-4dc3-ae27-e67fcf98a690 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:39.243719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a530286-e5c3-4dc3-ae27-e67fcf98a690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:39.301157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9a530286-e5c3-4dc3-ae27-e67fcf98a690 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:39.302462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9a530286-e5c3-4dc3-ae27-e67fcf98a690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:39.347705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:39.349496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:39.377948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:39.495007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3869/7777] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:39.514236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a681b-8000-413e-9392-4dba2262fba9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:39.522151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530286-e5c3-4dc3-ae27-e67fcf98a690 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:39.523870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9a530286-e5c3-4dc3-ae27-e67fcf98a690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:39.541461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:39.543066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:39.553085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:39.553814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] PATH_INFO: `/v3/users/749ffb0f059c4145bb5f513617bf05f2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:39.558256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=749ffb0f059c4145bb5f513617bf05f2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:39.567289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:39.790383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749ffb0f059c4145bb5f513617bf05f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:39.791438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749ffb0f059c4145bb5f513617bf05f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:39.792296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a530286-e5c3-4dc3-ae27-e67fcf98a690 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:39.813331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749ffb0f059c4145bb5f513617bf05f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:39.818446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69670a-a857-4e5f-a9a0-d11186db5b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:39.820734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69670a-a857-4e5f-a9a0-d11186db5b25 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:39.821377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69670a-a857-4e5f-a9a0-d11186db5b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:39.822198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69670a-a857-4e5f-a9a0-d11186db5b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:39.826593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749ffb0f059c4145bb5f513617bf05f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:39.849630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69670a-a857-4e5f-a9a0-d11186db5b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:39.854199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69670a-a857-4e5f-a9a0-d11186db5b25 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:39.855180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-54685cd1-94f4-464a-ae74-2b99fac62e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749ffb0f059c4145bb5f513617bf05f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:39.875234 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3909/7778] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:49:39 2022] DELETE /identity/v3/users/749ffb0f059c4145bb5f513617bf05f2 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:39.878110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae2b8-e548-4981-a42b-5f00f7d6698e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:39.878110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae2b8-e548-4981-a42b-5f00f7d6698e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:39.882198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feae2b8-e548-4981-a42b-5f00f7d6698e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:39.927819 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3870/7779] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:49:39.942326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5feae2b8-e548-4981-a42b-5f00f7d6698e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:39.944927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5feae2b8-e548-4981-a42b-5f00f7d6698e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:40.103853 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3910/7780] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:40.185611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69670a-a857-4e5f-a9a0-d11186db5b25 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:40.192965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-db69670a-a857-4e5f-a9a0-d11186db5b25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:40.230454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69670a-a857-4e5f-a9a0-d11186db5b25 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:40.320505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:40.383780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5052271-2fe9-4e4a-a26c-92dc95047b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:40.384686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5052271-2fe9-4e4a-a26c-92dc95047b91 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:40.384686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5052271-2fe9-4e4a-a26c-92dc95047b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:40.384912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5052271-2fe9-4e4a-a26c-92dc95047b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:40.412224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5052271-2fe9-4e4a-a26c-92dc95047b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:40.416322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5052271-2fe9-4e4a-a26c-92dc95047b91 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:40.446385 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3871/7781] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:40.784969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feae2b8-e548-4981-a42b-5f00f7d6698e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:40.788345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5feae2b8-e548-4981-a42b-5f00f7d6698e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:40.816608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feae2b8-e548-4981-a42b-5f00f7d6698e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:40.838064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:40.838992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:40.839242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:40.839601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] PATH_INFO: `/v3/projects/8d00025ae6ef466ba248ec13cb602d9c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:40.842278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d00025ae6ef466ba248ec13cb602d9c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:40.844394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:40.953042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:41.103682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d00025ae6ef466ba248ec13cb602d9c', 'request_id': 'req-12dd759c-7c51-46b8-a256-2da039998fed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:41.140191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d00025ae6ef466ba248ec13cb602d9c', 'request_id': 'req-12dd759c-7c51-46b8-a256-2da039998fed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:41.168211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d00025ae6ef466ba248ec13cb602d9c', 'request_id': 'req-12dd759c-7c51-46b8-a256-2da039998fed'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:41.192912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] The token cache is being invalidate because project 8d00025ae6ef466ba248ec13cb602d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:49:41.193255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:41.194145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:41.203436 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3911/7782] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:49:40 2022] DELETE /identity/v3/projects/8d00025ae6ef466ba248ec13cb602d9c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:41.206549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d6a71-9cde-4f84-9b1d-c6940d061d03 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:41.206936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d6a71-9cde-4f84-9b1d-c6940d061d03 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:41.207329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d6a71-9cde-4f84-9b1d-c6940d061d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:41.242920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:41.244678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:41.297271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c24d6a71-9cde-4f84-9b1d-c6940d061d03 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:41.298574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c24d6a71-9cde-4f84-9b1d-c6940d061d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:41.450916 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3872/7783] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:41.460937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e84f29-173f-4818-b78c-d2585fdc8301 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:41.461661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e84f29-173f-4818-b78c-d2585fdc8301 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:41.462676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e84f29-173f-4818-b78c-d2585fdc8301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:41.523796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd759c-7c51-46b8-a256-2da039998fed admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:41.525816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a8e84f29-173f-4818-b78c-d2585fdc8301 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:41.531156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a8e84f29-173f-4818-b78c-d2585fdc8301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:41.539319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:41.540062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:41.540411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:41.540767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] PATH_INFO: `/v3/projects/0ef9fb1ef66741dca09fd5f987e0e18d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:41.546951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef9fb1ef66741dca09fd5f987e0e18d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:41.553855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:41.581381 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3873/7784] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:49:41.582982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c767-a62b-4283-a771-c79ac4b2d501 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:41.583275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c767-a62b-4283-a771-c79ac4b2d501 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:41.584083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0c767-a62b-4283-a771-c79ac4b2d501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:41.665985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef9fb1ef66741dca09fd5f987e0e18d', 'request_id': 'req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:41.681188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e3a0c767-a62b-4283-a771-c79ac4b2d501 None None] MFA Rules not processed for user `f0f513e4d2e2419eacc5212d844c4e70`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:41.682524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e3a0c767-a62b-4283-a771-c79ac4b2d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:41.687139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef9fb1ef66741dca09fd5f987e0e18d', 'request_id': 'req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:41.705254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef9fb1ef66741dca09fd5f987e0e18d', 'request_id': 'req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:41.752581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] The token cache is being invalidate because project 0ef9fb1ef66741dca09fd5f987e0e18d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:49:41.752928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:41.757959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:41.762616 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3912/7785] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:49:41 2022] DELETE /identity/v3/projects/0ef9fb1ef66741dca09fd5f987e0e18d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:49:41.764840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:41.766278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:41.950050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:41.966853 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3874/7786] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:41.967835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0c767-a62b-4283-a771-c79ac4b2d501 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:41.976225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e3a0c767-a62b-4283-a771-c79ac4b2d501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:42.035164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404ed5f-dc9b-41d5-879c-79e5f4e85b28 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:42.048324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3efde1-3e62-4284-8e9c-d2b05f948624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:42.051451 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3efde1-3e62-4284-8e9c-d2b05f948624 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:42.051762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3efde1-3e62-4284-8e9c-d2b05f948624 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:42.053121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3efde1-3e62-4284-8e9c-d2b05f948624 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:42.054552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3efde1-3e62-4284-8e9c-d2b05f948624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:49:42.057489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3efde1-3e62-4284-8e9c-d2b05f948624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:42.059040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3efde1-3e62-4284-8e9c-d2b05f948624 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:42.089964 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3913/7787] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:49:42.099665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585b05e-52fe-4aa6-bd8d-5c5e4fdf3fc0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:42.102078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585b05e-52fe-4aa6-bd8d-5c5e4fdf3fc0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:42.102417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585b05e-52fe-4aa6-bd8d-5c5e4fdf3fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:42.159203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:42.188893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8585b05e-52fe-4aa6-bd8d-5c5e4fdf3fc0 None None] MFA Rules not processed for user `75b1bde02d1e4d2796ab58bdd342282f`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:42.191837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8585b05e-52fe-4aa6-bd8d-5c5e4fdf3fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:42.194150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0c767-a62b-4283-a771-c79ac4b2d501 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:42.207277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:42.208097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:42.209024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:42.210138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] PATH_INFO: `/v3/users/3a6a1a6f61e84c47b42e33edfa485dbc` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:42.213003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a6a1a6f61e84c47b42e33edfa485dbc)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:42.220568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:42.364912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a6a1a6f61e84c47b42e33edfa485dbc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:42.381618 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3914/7788] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:42.384952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585b05e-52fe-4aa6-bd8d-5c5e4fdf3fc0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:42.395504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a6a1a6f61e84c47b42e33edfa485dbc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:42.415092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585b05e-52fe-4aa6-bd8d-5c5e4fdf3fc0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:42.423893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb21f0-a1a2-46a8-9089-ce68ca2d8a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:42.424681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb21f0-a1a2-46a8-9089-ce68ca2d8a44 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:42.425049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb21f0-a1a2-46a8-9089-ce68ca2d8a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:42.425580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb21f0-a1a2-46a8-9089-ce68ca2d8a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:42.426374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb21f0-a1a2-46a8-9089-ce68ca2d8a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:42.429339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb21f0-a1a2-46a8-9089-ce68ca2d8a44 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:42.454784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a6a1a6f61e84c47b42e33edfa485dbc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:42.476388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a6a1a6f61e84c47b42e33edfa485dbc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:42.477116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a6a1a6f61e84c47b42e33edfa485dbc'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:42.497094 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3875/7789] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:49:41 2022] DELETE /identity/v3/users/3a6a1a6f61e84c47b42e33edfa485dbc => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:42.501140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:42.505119 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3915/7790] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:42 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:42.508947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:42.509073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb21f0-a1a2-46a8-9089-ce68ca2d8a44 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:42.509786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7acb21f0-a1a2-46a8-9089-ce68ca2d8a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:42.664360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb21f0-a1a2-46a8-9089-ce68ca2d8a44 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:42.686034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88938c12-86cd-41f2-a8ab-4dc8baed700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:42.686034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88938c12-86cd-41f2-a8ab-4dc8baed700e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:42.686034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88938c12-86cd-41f2-a8ab-4dc8baed700e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:42.686034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88938c12-86cd-41f2-a8ab-4dc8baed700e admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:42.686579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88938c12-86cd-41f2-a8ab-4dc8baed700e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:42.686579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88938c12-86cd-41f2-a8ab-4dc8baed700e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:42.789211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a84d9-5f30-4259-9bc0-a48d47d23d31 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:42.839316 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3916/7791] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:42 2022] POST /identity/v3/users => generated 292 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:42.846443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88938c12-86cd-41f2-a8ab-4dc8baed700e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:42.875330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88938c12-86cd-41f2-a8ab-4dc8baed700e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:42.886186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f266fe1-9445-4512-99b2-fd6ceb6be92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:42.887939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266fe1-9445-4512-99b2-fd6ceb6be92d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:42.890489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266fe1-9445-4512-99b2-fd6ceb6be92d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:42.891104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f266fe1-9445-4512-99b2-fd6ceb6be92d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:42.892028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f266fe1-9445-4512-99b2-fd6ceb6be92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:42.897255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f266fe1-9445-4512-99b2-fd6ceb6be92d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:42.937265 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3917/7792] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:49:42.938323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f266fe1-9445-4512-99b2-fd6ceb6be92d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:42.959670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f266fe1-9445-4512-99b2-fd6ceb6be92d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:42.979854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c5872-5b8e-40d7-8ee3-3ea7653ec39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:42.980734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c5872-5b8e-40d7-8ee3-3ea7653ec39c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:42.981091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c5872-5b8e-40d7-8ee3-3ea7653ec39c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:42.981397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c5872-5b8e-40d7-8ee3-3ea7653ec39c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:42.983789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c5872-5b8e-40d7-8ee3-3ea7653ec39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:42.985275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2807377-b398-4fca-b182-bad109a5725b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:42.988465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c5872-5b8e-40d7-8ee3-3ea7653ec39c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:42.989358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2807377-b398-4fca-b182-bad109a5725b service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:42.990210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2807377-b398-4fca-b182-bad109a5725b service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:42.991688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2807377-b398-4fca-b182-bad109a5725b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:42.999043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a2807377-b398-4fca-b182-bad109a5725b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:43.018710 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3918/7793] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:43.019697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c5872-5b8e-40d7-8ee3-3ea7653ec39c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:43.029191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:43.038478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-599c5872-5b8e-40d7-8ee3-3ea7653ec39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:43.071162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c5872-5b8e-40d7-8ee3-3ea7653ec39c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:43.087278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:43.087937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:43.091577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:43.091577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] PATH_INFO: `/v3/projects/d4d43ee2b34343238287744e660c44ee` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:43.091577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4d43ee2b34343238287744e660c44ee)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:43.092776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:43.236432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:43.245972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2807377-b398-4fca-b182-bad109a5725b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:43.249548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2807377-b398-4fca-b182-bad109a5725b service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:43.273279 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3876/7794] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:43.278343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2807377-b398-4fca-b182-bad109a5725b service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:43.295045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2807377-b398-4fca-b182-bad109a5725b service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:43.303643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4d43ee2b34343238287744e660c44ee', 'request_id': 'req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:43.316991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4d43ee2b34343238287744e660c44ee', 'request_id': 'req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:43.351108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4d43ee2b34343238287744e660c44ee', 'request_id': 'req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:43.384815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] The token cache is being invalidate because project d4d43ee2b34343238287744e660c44ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:49:43.385213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:43.386811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5dbb9ece-fb02-46e9-a79a-300b5ee8917e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:49:43.402442 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3919/7795] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:49:43 2022] DELETE /identity/v3/projects/d4d43ee2b34343238287744e660c44ee => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:43.402442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4f53b-46d9-40b3-96cb-c32cfbc38618 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:43.402442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4f53b-46d9-40b3-96cb-c32cfbc38618 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:43.402442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4f53b-46d9-40b3-96cb-c32cfbc38618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:43.453005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-94b4f53b-46d9-40b3-96cb-c32cfbc38618 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:43.454192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-94b4f53b-46d9-40b3-96cb-c32cfbc38618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:43.463088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72593802-d309-4195-9245-838113995e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:43.468328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593802-d309-4195-9245-838113995e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:43.468328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593802-d309-4195-9245-838113995e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:43.468825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593802-d309-4195-9245-838113995e1b admin admin] PATH_INFO: `/v3/projects/1c057cb009994eadbbe08d588aa97c15/users/1e772674a49d4a62a09f158195c37cf5/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:43.483554 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3920/7796] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:43.485394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05cad-b898-4cd9-ab73-4b6359592910 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:43.485640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05cad-b898-4cd9-ab73-4b6359592910 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:43.486011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf05cad-b898-4cd9-ab73-4b6359592910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:43.505427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72593802-d309-4195-9245-838113995e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c057cb009994eadbbe08d588aa97c15, user_id=1e772674a49d4a62a09f158195c37cf5, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:43.508979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72593802-d309-4195-9245-838113995e1b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:43.521271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6cf05cad-b898-4cd9-ab73-4b6359592910 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:43.522554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6cf05cad-b898-4cd9-ab73-4b6359592910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:43.532136 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3877/7797] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:43 2022] PUT /identity/v3/projects/1c057cb009994eadbbe08d588aa97c15/users/1e772674a49d4a62a09f158195c37cf5/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:43.541903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8bea8-90ff-42d1-b67d-8e3984083262 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:43.543007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8bea8-90ff-42d1-b67d-8e3984083262 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:43.543007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8bea8-90ff-42d1-b67d-8e3984083262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:43.608077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-79a8bea8-90ff-42d1-b67d-8e3984083262 None None] MFA Rules not processed for user `1e772674a49d4a62a09f158195c37cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:43.609698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-79a8bea8-90ff-42d1-b67d-8e3984083262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:43.670647 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3921/7798] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:49:43.688753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf05cad-b898-4cd9-ab73-4b6359592910 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:43.724566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf05cad-b898-4cd9-ab73-4b6359592910 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:43.737154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb442d70-8c8e-4a36-93f0-3e6847c18541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:43.738184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb442d70-8c8e-4a36-93f0-3e6847c18541 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:43.738805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb442d70-8c8e-4a36-93f0-3e6847c18541 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:43.739299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb442d70-8c8e-4a36-93f0-3e6847c18541 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:43.740263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb442d70-8c8e-4a36-93f0-3e6847c18541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:49:43.740762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb442d70-8c8e-4a36-93f0-3e6847c18541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:43.742649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb442d70-8c8e-4a36-93f0-3e6847c18541 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:43.795259 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3878/7799] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:49:43.795863 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3922/7800] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:49:43.796403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8bea8-90ff-42d1-b67d-8e3984083262 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:43.805864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb442d70-8c8e-4a36-93f0-3e6847c18541 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:43.813151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fb442d70-8c8e-4a36-93f0-3e6847c18541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:43.821172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8bea8-90ff-42d1-b67d-8e3984083262 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:43.831464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05ae06-fd20-41cc-83c8-063a3b0f74c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:43.832098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05ae06-fd20-41cc-83c8-063a3b0f74c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:43.832374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05ae06-fd20-41cc-83c8-063a3b0f74c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:43.832641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05ae06-fd20-41cc-83c8-063a3b0f74c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:43.833291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05ae06-fd20-41cc-83c8-063a3b0f74c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:43.835283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05ae06-fd20-41cc-83c8-063a3b0f74c0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:43.881679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:43.902608 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3879/7801] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:43 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:43.903922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05ae06-fd20-41cc-83c8-063a3b0f74c0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:43.905091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb442d70-8c8e-4a36-93f0-3e6847c18541 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:43.992481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:44.021293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48103221-5272-4942-af56-db3e638c9b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:44.021729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48103221-5272-4942-af56-db3e638c9b35 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:44.022762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48103221-5272-4942-af56-db3e638c9b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:44.023038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48103221-5272-4942-af56-db3e638c9b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:44.055682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05ae06-fd20-41cc-83c8-063a3b0f74c0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:44.069956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be7206-3e8e-4d1e-870c-9f73fc2bfff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:44.071023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be7206-3e8e-4d1e-870c-9f73fc2bfff5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:44.071506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be7206-3e8e-4d1e-870c-9f73fc2bfff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:44.071924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be7206-3e8e-4d1e-870c-9f73fc2bfff5 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:44.073091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be7206-3e8e-4d1e-870c-9f73fc2bfff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:44.079010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be7206-3e8e-4d1e-870c-9f73fc2bfff5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:44.133613 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3880/7802] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:43 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:49:44.138282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be7206-3e8e-4d1e-870c-9f73fc2bfff5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:44.159190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be7206-3e8e-4d1e-870c-9f73fc2bfff5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:44.162156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48103221-5272-4942-af56-db3e638c9b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:44.163840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48103221-5272-4942-af56-db3e638c9b35 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:44.174708 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3923/7803] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:44.178436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cc655-3adf-43ad-86d8-bb788ac5b463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:44.179456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cc655-3adf-43ad-86d8-bb788ac5b463 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:44.180321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cc655-3adf-43ad-86d8-bb788ac5b463 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:44.180915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2cc655-3adf-43ad-86d8-bb788ac5b463 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:44.186266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cc655-3adf-43ad-86d8-bb788ac5b463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:44.188109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2cc655-3adf-43ad-86d8-bb788ac5b463 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:44.214311 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3881/7804] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:44.216904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48103221-5272-4942-af56-db3e638c9b35 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:44.238919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48103221-5272-4942-af56-db3e638c9b35 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:44.251197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56a96c-c269-4c6e-a181-52e384f1380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:44.252468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56a96c-c269-4c6e-a181-52e384f1380e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:44.253310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56a96c-c269-4c6e-a181-52e384f1380e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:44.253583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56a96c-c269-4c6e-a181-52e384f1380e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:44.256454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56a96c-c269-4c6e-a181-52e384f1380e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:44.262078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56a96c-c269-4c6e-a181-52e384f1380e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:44.300482 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3924/7805] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:49:44.302305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cc655-3adf-43ad-86d8-bb788ac5b463 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:44.318093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2cc655-3adf-43ad-86d8-bb788ac5b463 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:44.329622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9667eb-302c-4ede-8285-846b0977ad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:44.330591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9667eb-302c-4ede-8285-846b0977ad90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:44.330870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9667eb-302c-4ede-8285-846b0977ad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:44.331145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9667eb-302c-4ede-8285-846b0977ad90 admin admin] PATH_INFO: `/v3/projects/4a9e289795dc4e7ea81a32907ead30fa/users/17fa25bae5af4ce9883ffd983e9186a2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:44.369096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9667eb-302c-4ede-8285-846b0977ad90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9e289795dc4e7ea81a32907ead30fa, user_id=17fa25bae5af4ce9883ffd983e9186a2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:44.377808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9667eb-302c-4ede-8285-846b0977ad90 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:44.404967 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3882/7806] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:44 2022] PUT /identity/v3/projects/4a9e289795dc4e7ea81a32907ead30fa/users/17fa25bae5af4ce9883ffd983e9186a2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:44.415797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33b28-0e1b-4f3d-956d-aceaaa856e00 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:44.416152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33b28-0e1b-4f3d-956d-aceaaa856e00 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:44.416471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33b28-0e1b-4f3d-956d-aceaaa856e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:44.487177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c5b33b28-0e1b-4f3d-956d-aceaaa856e00 None None] MFA Rules not processed for user `17fa25bae5af4ce9883ffd983e9186a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:44.497800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c5b33b28-0e1b-4f3d-956d-aceaaa856e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:44.664078 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3925/7807] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:44.669360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9667eb-302c-4ede-8285-846b0977ad90 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:44.763642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9667eb-302c-4ede-8285-846b0977ad90 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:44.768927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d47f1-f536-4411-9944-5553fdbb8670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:44.769410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d47f1-f536-4411-9944-5553fdbb8670 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:44.769743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d47f1-f536-4411-9944-5553fdbb8670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:44.770110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d47f1-f536-4411-9944-5553fdbb8670 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:44.771526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d47f1-f536-4411-9944-5553fdbb8670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:44.773864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d47f1-f536-4411-9944-5553fdbb8670 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:44.866378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33b28-0e1b-4f3d-956d-aceaaa856e00 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:44.875866 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3883/7808] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:49:44 2022] POST /identity/v3/projects => generated 369 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:44.886722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33b28-0e1b-4f3d-956d-aceaaa856e00 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:45.126449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4b684-ebc4-4798-9ac1-4836f03696f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:45.127576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4b684-ebc4-4798-9ac1-4836f03696f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:45.128276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4b684-ebc4-4798-9ac1-4836f03696f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:45.128785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4b684-ebc4-4798-9ac1-4836f03696f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:45.129848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4b684-ebc4-4798-9ac1-4836f03696f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:45.132197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4b684-ebc4-4798-9ac1-4836f03696f9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:45.179134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d47f1-f536-4411-9944-5553fdbb8670 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:45.187699 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3926/7809] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:49:44 2022] POST /identity/v3/users => generated 291 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:49:45.195802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d47f1-f536-4411-9944-5553fdbb8670 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:45.206198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe354f5-ee7a-4a79-bbc0-e959d9bfdaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:45.207097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe354f5-ee7a-4a79-bbc0-e959d9bfdaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:45.207653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe354f5-ee7a-4a79-bbc0-e959d9bfdaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:45.208022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe354f5-ee7a-4a79-bbc0-e959d9bfdaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:45.208944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe354f5-ee7a-4a79-bbc0-e959d9bfdaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:45.212444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe354f5-ee7a-4a79-bbc0-e959d9bfdaf4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:45.239195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4b684-ebc4-4798-9ac1-4836f03696f9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:45.251968 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3884/7810] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:45.253430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4b684-ebc4-4798-9ac1-4836f03696f9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:45.259136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40382982-8545-40be-a675-284dada910ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:45.259904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382982-8545-40be-a675-284dada910ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:45.260472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382982-8545-40be-a675-284dada910ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:45.260760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40382982-8545-40be-a675-284dada910ae admin admin] PATH_INFO: `/v3/projects/b0752f121cae4149957369c1af6ae1f5/users/98382c92d15c4f5fb8dfb8d4e0dae380/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:45.265093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:45.306181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40382982-8545-40be-a675-284dada910ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0752f121cae4149957369c1af6ae1f5, user_id=98382c92d15c4f5fb8dfb8d4e0dae380, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:45.309283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40382982-8545-40be-a675-284dada910ae admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:45.347013 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3927/7811] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:45 2022] PUT /identity/v3/projects/b0752f121cae4149957369c1af6ae1f5/users/98382c92d15c4f5fb8dfb8d4e0dae380/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:45.351866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe354f5-ee7a-4a79-bbc0-e959d9bfdaf4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:45.372215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe354f5-ee7a-4a79-bbc0-e959d9bfdaf4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:45.405779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:45.570562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6500187-2033-46e0-a0ee-10348f673d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:45.575412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6500187-2033-46e0-a0ee-10348f673d78 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:45.576112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6500187-2033-46e0-a0ee-10348f673d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:45.580447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6500187-2033-46e0-a0ee-10348f673d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:45.583045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6500187-2033-46e0-a0ee-10348f673d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:45.593387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6500187-2033-46e0-a0ee-10348f673d78 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:45.626251 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3885/7812] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:49:45.629927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40382982-8545-40be-a675-284dada910ae admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:45.652542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40382982-8545-40be-a675-284dada910ae admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:45.671550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76677ca-cdaf-4e1a-b2b9-8346a7779a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:45.672785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76677ca-cdaf-4e1a-b2b9-8346a7779a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:45.674759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76677ca-cdaf-4e1a-b2b9-8346a7779a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:45.676463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76677ca-cdaf-4e1a-b2b9-8346a7779a7f admin admin] PATH_INFO: `/v3/projects/b0752f121cae4149957369c1af6ae1f5/users/98382c92d15c4f5fb8dfb8d4e0dae380/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:45.725018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76677ca-cdaf-4e1a-b2b9-8346a7779a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0752f121cae4149957369c1af6ae1f5, user_id=98382c92d15c4f5fb8dfb8d4e0dae380, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:45.729609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76677ca-cdaf-4e1a-b2b9-8346a7779a7f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:45.779563 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3928/7813] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:49:45 2022] PUT /identity/v3/projects/b0752f121cae4149957369c1af6ae1f5/users/98382c92d15c4f5fb8dfb8d4e0dae380/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:49:45.790491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f9e7e-9652-4a3d-8ea3-595a95ac5ce0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:45.792185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f9e7e-9652-4a3d-8ea3-595a95ac5ce0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:45.792185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f9e7e-9652-4a3d-8ea3-595a95ac5ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:45.899929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-711f9e7e-9652-4a3d-8ea3-595a95ac5ce0 None None] MFA Rules not processed for user `98382c92d15c4f5fb8dfb8d4e0dae380`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:49:45.901340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-711f9e7e-9652-4a3d-8ea3-595a95ac5ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:46.065718 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3886/7814] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:49:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:49:46.112941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76677ca-cdaf-4e1a-b2b9-8346a7779a7f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:46.116517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b76677ca-cdaf-4e1a-b2b9-8346a7779a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:46.272887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76677ca-cdaf-4e1a-b2b9-8346a7779a7f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:46.280560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6957cd-29b0-47f7-b348-13d6b4950783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:46.281520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6957cd-29b0-47f7-b348-13d6b4950783 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:46.281933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6957cd-29b0-47f7-b348-13d6b4950783 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:46.282215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6957cd-29b0-47f7-b348-13d6b4950783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:46.312088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6957cd-29b0-47f7-b348-13d6b4950783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:46.314416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6957cd-29b0-47f7-b348-13d6b4950783 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:46.341494 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3929/7815] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:49.406772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f9e7e-9652-4a3d-8ea3-595a95ac5ce0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:49.408753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-711f9e7e-9652-4a3d-8ea3-595a95ac5ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:49.518657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f9e7e-9652-4a3d-8ea3-595a95ac5ce0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:49.522647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc041c9d-998a-40cc-a372-1e17b33af96c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:49.523279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041c9d-998a-40cc-a372-1e17b33af96c service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:49.523560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041c9d-998a-40cc-a372-1e17b33af96c service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:49.523832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041c9d-998a-40cc-a372-1e17b33af96c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:49.526181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dc041c9d-998a-40cc-a372-1e17b33af96c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:49.660214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:49.666238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc041c9d-998a-40cc-a372-1e17b33af96c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:49.671630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc041c9d-998a-40cc-a372-1e17b33af96c service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:49.702612 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3887/7816] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:55.127552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6957cd-29b0-47f7-b348-13d6b4950783 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:55.146689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6957cd-29b0-47f7-b348-13d6b4950783 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:55.161982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6ab6b-c5c3-40e1-a3db-b8e72e13c894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:55.162546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6ab6b-c5c3-40e1-a3db-b8e72e13c894 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:55.162827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6ab6b-c5c3-40e1-a3db-b8e72e13c894 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:55.163098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6ab6b-c5c3-40e1-a3db-b8e72e13c894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:55.175056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7be6ab6b-c5c3-40e1-a3db-b8e72e13c894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:55.221278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6ab6b-c5c3-40e1-a3db-b8e72e13c894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:55.222797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6ab6b-c5c3-40e1-a3db-b8e72e13c894 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:55.253628 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3930/7817] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:49:57.052307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc041c9d-998a-40cc-a372-1e17b33af96c service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:49:57.054152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dc041c9d-998a-40cc-a372-1e17b33af96c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:57.373081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc041c9d-998a-40cc-a372-1e17b33af96c service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:49:57.390333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a83d4-feb6-4be2-ba73-9b5066de5fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:49:57.390981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a83d4-feb6-4be2-ba73-9b5066de5fc2 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:49:57.391261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a83d4-feb6-4be2-ba73-9b5066de5fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:49:57.391533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a83d4-feb6-4be2-ba73-9b5066de5fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:49:57.403198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d72a83d4-feb6-4be2-ba73-9b5066de5fc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:49:57.436114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a83d4-feb6-4be2-ba73-9b5066de5fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:49:57.438872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a83d4-feb6-4be2-ba73-9b5066de5fc2 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:49:57.478128 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3888/7818] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:49:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:50:04.964934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6ab6b-c5c3-40e1-a3db-b8e72e13c894 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:04.985859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6ab6b-c5c3-40e1-a3db-b8e72e13c894 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:05.023505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a7908-6e79-4edd-8811-824338076963 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98382c92d15c4f5fb8dfb8d4e0dae380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0752f121cae4149957369c1af6ae1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:05.030196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a7908-6e79-4edd-8811-824338076963 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:05.030196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a7908-6e79-4edd-8811-824338076963 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:05.030196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a7908-6e79-4edd-8811-824338076963 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:05.042317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a7908-6e79-4edd-8811-824338076963 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:50:05.042768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a7908-6e79-4edd-8811-824338076963 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:05.071667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a7908-6e79-4edd-8811-824338076963 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:05.150565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a83d4-feb6-4be2-ba73-9b5066de5fc2 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:05.151132 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3931/7819] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:50:05.174707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a83d4-feb6-4be2-ba73-9b5066de5fc2 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:05.183283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8ba6-145b-42ff-b4dd-02705fa543e1 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98382c92d15c4f5fb8dfb8d4e0dae380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0752f121cae4149957369c1af6ae1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:05.184284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8ba6-145b-42ff-b4dd-02705fa543e1 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:05.184782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8ba6-145b-42ff-b4dd-02705fa543e1 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:05.185321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f8ba6-145b-42ff-b4dd-02705fa543e1 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:05.186314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f8ba6-145b-42ff-b4dd-02705fa543e1 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:05.190037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f8ba6-145b-42ff-b4dd-02705fa543e1 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:05.234998 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3889/7820] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:50:05 2022] POST /identity/v3/projects => generated 348 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:50:05.239267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a7908-6e79-4edd-8811-824338076963 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:05.260813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a7908-6e79-4edd-8811-824338076963 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:05.414408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eaba0-42a8-4cad-90b9-2f000c18dc6d tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98382c92d15c4f5fb8dfb8d4e0dae380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0752f121cae4149957369c1af6ae1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:05.415281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eaba0-42a8-4cad-90b9-2f000c18dc6d tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:05.415569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eaba0-42a8-4cad-90b9-2f000c18dc6d tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:05.415846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854eaba0-42a8-4cad-90b9-2f000c18dc6d tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:05.416511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eaba0-42a8-4cad-90b9-2f000c18dc6d tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:50:05.416858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eaba0-42a8-4cad-90b9-2f000c18dc6d tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:05.420729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854eaba0-42a8-4cad-90b9-2f000c18dc6d tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:05.475365 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3932/7821] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:50:06.239609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8ba6-145b-42ff-b4dd-02705fa543e1 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:06.257719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f8ba6-145b-42ff-b4dd-02705fa543e1 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:06.266434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98382c92d15c4f5fb8dfb8d4e0dae380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0752f121cae4149957369c1af6ae1f5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:06.267436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:06.268434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:06.269185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] PATH_INFO: `/v3/projects/8d79d38cadfc4bd6b002f75063e657db` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:06.271708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8d79d38cadfc4bd6b002f75063e657db)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:06.276575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:06.419149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d79d38cadfc4bd6b002f75063e657db', 'request_id': 'req-69607675-e78a-4c23-a441-f9d525912991'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:06.432255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d79d38cadfc4bd6b002f75063e657db', 'request_id': 'req-69607675-e78a-4c23-a441-f9d525912991'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:06.450355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d79d38cadfc4bd6b002f75063e657db', 'request_id': 'req-69607675-e78a-4c23-a441-f9d525912991'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:06.470672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] The token cache is being invalidate because project 8d79d38cadfc4bd6b002f75063e657db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:50:06.471356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:06.478640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:06.486998 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3890/7822] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:50:06 2022] DELETE /identity/v3/projects/8d79d38cadfc4bd6b002f75063e657db => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:06.499955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eaba0-42a8-4cad-90b9-2f000c18dc6d tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:06.503688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-854eaba0-42a8-4cad-90b9-2f000c18dc6d tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:06.522033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:06.530777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:06.650251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:06.675446 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:06.696341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69607675-e78a-4c23-a441-f9d525912991 tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:06.704860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:06.705553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:06.705826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:06.706140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] PATH_INFO: `/v3/users/1e772674a49d4a62a09f158195c37cf5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:06.709917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e772674a49d4a62a09f158195c37cf5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:06.711911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:06.712973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854eaba0-42a8-4cad-90b9-2f000c18dc6d tempest-RoutersAdminTest-2093954258 tempest-RoutersAdminTest-2093954258-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:06.838499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e772674a49d4a62a09f158195c37cf5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:06.854092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e772674a49d4a62a09f158195c37cf5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:06.874700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca577c-b050-44f4-a59a-e0d58205abd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:06.875351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca577c-b050-44f4-a59a-e0d58205abd9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:06.875629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca577c-b050-44f4-a59a-e0d58205abd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:06.875908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca577c-b050-44f4-a59a-e0d58205abd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:06.885556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e772674a49d4a62a09f158195c37cf5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:06.886853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b3ca577c-b050-44f4-a59a-e0d58205abd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:06.898671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e772674a49d4a62a09f158195c37cf5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:06.899320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc0c823f-937a-4f63-945b-c5343825fbd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e772674a49d4a62a09f158195c37cf5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:06.914187 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3891/7823] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:50:06 2022] DELETE /identity/v3/users/1e772674a49d4a62a09f158195c37cf5 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:06.916311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8684-3494-495e-aa10-aa1adb81e099 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:06.916474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8684-3494-495e-aa10-aa1adb81e099 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:06.916719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe8684-3494-495e-aa10-aa1adb81e099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:06.960504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7dbe8684-3494-495e-aa10-aa1adb81e099 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:06.964065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7dbe8684-3494-495e-aa10-aa1adb81e099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:07.024341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca577c-b050-44f4-a59a-e0d58205abd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:07.026412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca577c-b050-44f4-a59a-e0d58205abd9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:07.046290 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3933/7824] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:50:07.096342 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3892/7825] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:50:07.172594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca577c-b050-44f4-a59a-e0d58205abd9 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:07.192348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca577c-b050-44f4-a59a-e0d58205abd9 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:07.362090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46321866-ab20-4597-a047-8063d50d6bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:07.362867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321866-ab20-4597-a047-8063d50d6bab service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:07.365528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321866-ab20-4597-a047-8063d50d6bab service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:07.365967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46321866-ab20-4597-a047-8063d50d6bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:07.395067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321866-ab20-4597-a047-8063d50d6bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:07.397318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46321866-ab20-4597-a047-8063d50d6bab service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:07.438431 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3934/7826] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:50:08.146350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe8684-3494-495e-aa10-aa1adb81e099 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:08.148592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7dbe8684-3494-495e-aa10-aa1adb81e099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:08.191439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbe8684-3494-495e-aa10-aa1adb81e099 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:08.214547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:08.215738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:08.216173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:08.216609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] PATH_INFO: `/v3/projects/1c057cb009994eadbbe08d588aa97c15` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:08.223063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c057cb009994eadbbe08d588aa97c15)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:08.229512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:08.351346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c057cb009994eadbbe08d588aa97c15', 'request_id': 'req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:08.364547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c057cb009994eadbbe08d588aa97c15', 'request_id': 'req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:08.365957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:08.379293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c057cb009994eadbbe08d588aa97c15', 'request_id': 'req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:08.422994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] The token cache is being invalidate because project 1c057cb009994eadbbe08d588aa97c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:50:08.424551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:08.427625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-116cd97b-ba13-4b73-a3c9-28d63c40ae8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:08.438826 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3893/7827] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:50:08 2022] DELETE /identity/v3/projects/1c057cb009994eadbbe08d588aa97c15 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:08.445169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268caa0-2299-4129-9b93-2a00fb98b959 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:08.445750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268caa0-2299-4129-9b93-2a00fb98b959 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:08.445750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268caa0-2299-4129-9b93-2a00fb98b959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:08.499388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5268caa0-2299-4129-9b93-2a00fb98b959 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:08.504975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5268caa0-2299-4129-9b93-2a00fb98b959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:08.662613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:08.732291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05493092-a4f0-4058-a027-d5db2462440f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:08.732654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05493092-a4f0-4058-a027-d5db2462440f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:08.732983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05493092-a4f0-4058-a027-d5db2462440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:08.749894 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3935/7828] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:08.773578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-05493092-a4f0-4058-a027-d5db2462440f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:08.774689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-05493092-a4f0-4058-a027-d5db2462440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:08.802700 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3894/7829] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:50:08.807657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268caa0-2299-4129-9b93-2a00fb98b959 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:08.820772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268caa0-2299-4129-9b93-2a00fb98b959 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:08.840088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fe955-e468-464e-a067-a44d8acf06bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:08.840751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fe955-e468-464e-a067-a44d8acf06bc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:08.841029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fe955-e468-464e-a067-a44d8acf06bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:08.841299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fe955-e468-464e-a067-a44d8acf06bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:08.841991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fe955-e468-464e-a067-a44d8acf06bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:50:08.842294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fe955-e468-464e-a067-a44d8acf06bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:08.851453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fe955-e468-464e-a067-a44d8acf06bc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:08.897964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05493092-a4f0-4058-a027-d5db2462440f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:08.902659 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3936/7830] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:50:08.909388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05493092-a4f0-4058-a027-d5db2462440f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:08.914515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4f80f-4ebd-43c6-965b-9e000047758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:08.915146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4f80f-4ebd-43c6-965b-9e000047758c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:08.915427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4f80f-4ebd-43c6-965b-9e000047758c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:08.915700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4f80f-4ebd-43c6-965b-9e000047758c admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:08.916358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4f80f-4ebd-43c6-965b-9e000047758c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:08.920021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4f80f-4ebd-43c6-965b-9e000047758c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:09.026708 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3895/7831] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:50:08 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:50:09.028865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fe955-e468-464e-a067-a44d8acf06bc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:09.047902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fe955-e468-464e-a067-a44d8acf06bc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:09.198813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7cbc6-ea56-4831-9bfb-68ca30fdab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:09.199603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7cbc6-ea56-4831-9bfb-68ca30fdab38 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:09.199990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7cbc6-ea56-4831-9bfb-68ca30fdab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:09.200133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7cbc6-ea56-4831-9bfb-68ca30fdab38 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:09.200794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7cbc6-ea56-4831-9bfb-68ca30fdab38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:09.207345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7cbc6-ea56-4831-9bfb-68ca30fdab38 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:09.257325 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3937/7832] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:50:09 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:50:09.262084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4f80f-4ebd-43c6-965b-9e000047758c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:09.278576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4f80f-4ebd-43c6-965b-9e000047758c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:09.289987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493b99e-6985-4c6d-8dc8-59e2967db9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:09.292677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b99e-6985-4c6d-8dc8-59e2967db9ac admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:09.293126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b99e-6985-4c6d-8dc8-59e2967db9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:09.294511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493b99e-6985-4c6d-8dc8-59e2967db9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:09.295356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493b99e-6985-4c6d-8dc8-59e2967db9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:09.298357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493b99e-6985-4c6d-8dc8-59e2967db9ac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:09.329502 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3896/7833] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:50:09.331056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7cbc6-ea56-4831-9bfb-68ca30fdab38 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:09.347313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7cbc6-ea56-4831-9bfb-68ca30fdab38 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:09.356800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b3cbd-e500-442f-89ea-49e679fcfc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:09.357866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b3cbd-e500-442f-89ea-49e679fcfc7c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:09.359595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b3cbd-e500-442f-89ea-49e679fcfc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:09.360189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b3cbd-e500-442f-89ea-49e679fcfc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:09.362887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b3cbd-e500-442f-89ea-49e679fcfc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:09.366913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b3cbd-e500-442f-89ea-49e679fcfc7c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:09.397018 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3938/7834] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:50:09.397629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493b99e-6985-4c6d-8dc8-59e2967db9ac admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:09.423544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493b99e-6985-4c6d-8dc8-59e2967db9ac admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:09.440609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52776b7-fb9e-4c44-999a-52bb88e9d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:09.441412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52776b7-fb9e-4c44-999a-52bb88e9d0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:09.441784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52776b7-fb9e-4c44-999a-52bb88e9d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:09.442579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52776b7-fb9e-4c44-999a-52bb88e9d0b2 admin admin] PATH_INFO: `/v3/projects/42c3cecab01f407c8017d3a6503fcf0c/users/1587b6210bc145afb393b63cd43b011d/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:09.490839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52776b7-fb9e-4c44-999a-52bb88e9d0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c3cecab01f407c8017d3a6503fcf0c, user_id=1587b6210bc145afb393b63cd43b011d, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:09.493856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52776b7-fb9e-4c44-999a-52bb88e9d0b2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:09.518391 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3897/7835] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:50:09 2022] PUT /identity/v3/projects/42c3cecab01f407c8017d3a6503fcf0c/users/1587b6210bc145afb393b63cd43b011d/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:50:09.529185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efa7e2-7bd2-452a-8ed9-b842bebb1fa5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:09.529781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efa7e2-7bd2-452a-8ed9-b842bebb1fa5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:09.529781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90efa7e2-7bd2-452a-8ed9-b842bebb1fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:09.592247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52776b7-fb9e-4c44-999a-52bb88e9d0b2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:09.594081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a52776b7-fb9e-4c44-999a-52bb88e9d0b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:09.606905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-90efa7e2-7bd2-452a-8ed9-b842bebb1fa5 None None] MFA Rules not processed for user `1587b6210bc145afb393b63cd43b011d`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:09.609371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-90efa7e2-7bd2-452a-8ed9-b842bebb1fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:09.766375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52776b7-fb9e-4c44-999a-52bb88e9d0b2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:09.791206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:09.791206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:09.791206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:09.791206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] PATH_INFO: `/v3/users/aefebb31be1344388e4a9c3874c6e243` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:09.791783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aefebb31be1344388e4a9c3874c6e243)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:09.791783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:09.802898 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3939/7836] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:09.807898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efa7e2-7bd2-452a-8ed9-b842bebb1fa5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:09.843271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90efa7e2-7bd2-452a-8ed9-b842bebb1fa5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:09.856726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69440a-2c0e-4706-bbc1-7627d3818ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:09.860590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69440a-2c0e-4706-bbc1-7627d3818ede admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:09.863414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69440a-2c0e-4706-bbc1-7627d3818ede admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:09.863711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69440a-2c0e-4706-bbc1-7627d3818ede admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:09.867450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69440a-2c0e-4706-bbc1-7627d3818ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:09.872426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69440a-2c0e-4706-bbc1-7627d3818ede admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:09.921170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aefebb31be1344388e4a9c3874c6e243'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:09.937958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aefebb31be1344388e4a9c3874c6e243'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:09.969241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aefebb31be1344388e4a9c3874c6e243'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:09.979144 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3940/7837] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:50:09 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:50:09.980179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69440a-2c0e-4706-bbc1-7627d3818ede admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:09.986503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aefebb31be1344388e4a9c3874c6e243'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:09.988369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e8774f76-3cdb-4c69-9712-0d8fab0a62fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aefebb31be1344388e4a9c3874c6e243'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:09.991090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:09.999672 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3898/7838] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:50:09 2022] DELETE /identity/v3/users/aefebb31be1344388e4a9c3874c6e243 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:50:10.006037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf999cf6-dea3-4328-a679-227a30315f68 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:10.006037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf999cf6-dea3-4328-a679-227a30315f68 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:10.006375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf999cf6-dea3-4328-a679-227a30315f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:10.091018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bf999cf6-dea3-4328-a679-227a30315f68 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:10.095799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bf999cf6-dea3-4328-a679-227a30315f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:10.099847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:10.193270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69440a-2c0e-4706-bbc1-7627d3818ede admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:10.250395 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3899/7839] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:10.264242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf999cf6-dea3-4328-a679-227a30315f68 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:10.265891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bf999cf6-dea3-4328-a679-227a30315f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:10.295219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d2b5e-21b2-425b-985b-3760d8d12752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:10.295890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d2b5e-21b2-425b-985b-3760d8d12752 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:10.296163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d2b5e-21b2-425b-985b-3760d8d12752 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:10.296433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d2b5e-21b2-425b-985b-3760d8d12752 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:10.297186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d2b5e-21b2-425b-985b-3760d8d12752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:10.300494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d2b5e-21b2-425b-985b-3760d8d12752 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:10.332378 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3941/7840] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:50:09 2022] POST /identity/v3/users => generated 292 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:50:10.339425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d2b5e-21b2-425b-985b-3760d8d12752 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:10.343607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8c5d2b5e-21b2-425b-985b-3760d8d12752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:10.366264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf999cf6-dea3-4328-a679-227a30315f68 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:10.370975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d2b5e-21b2-425b-985b-3760d8d12752 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:10.375880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f8ab6-0e11-403a-a385-1f3663b8a1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:10.378182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f8ab6-0e11-403a-a385-1f3663b8a1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:10.378467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f8ab6-0e11-403a-a385-1f3663b8a1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:10.378741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f8ab6-0e11-403a-a385-1f3663b8a1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:10.386518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582e174-615b-48a9-bc6f-41860daa21f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:10.387749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582e174-615b-48a9-bc6f-41860daa21f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:10.388048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582e174-615b-48a9-bc6f-41860daa21f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:10.388311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582e174-615b-48a9-bc6f-41860daa21f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:10.388977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582e174-615b-48a9-bc6f-41860daa21f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:10.398413 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582e174-615b-48a9-bc6f-41860daa21f3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:10.410230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f8ab6-0e11-403a-a385-1f3663b8a1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:10.412675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f8ab6-0e11-403a-a385-1f3663b8a1a1 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:10.414848 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3942/7841] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:50:10.419047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582e174-615b-48a9-bc6f-41860daa21f3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:10.432029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582e174-615b-48a9-bc6f-41860daa21f3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:10.441273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69afa64-10a1-4175-9961-bb93991eb453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:10.441984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69afa64-10a1-4175-9961-bb93991eb453 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:10.442271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69afa64-10a1-4175-9961-bb93991eb453 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:10.442533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69afa64-10a1-4175-9961-bb93991eb453 admin admin] PATH_INFO: `/v3/projects/ac906f96fd294c0b87dfcdbf1ca8f089/users/cf64b66b910043b2b4fbd2611f67c9b2/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:10.444606 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3900/7842] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:50:10.471577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69afa64-10a1-4175-9961-bb93991eb453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac906f96fd294c0b87dfcdbf1ca8f089, user_id=cf64b66b910043b2b4fbd2611f67c9b2, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:10.474861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69afa64-10a1-4175-9961-bb93991eb453 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:10.517491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f8ab6-0e11-403a-a385-1f3663b8a1a1 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:10.517636 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3943/7843] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:50:10 2022] PUT /identity/v3/projects/ac906f96fd294c0b87dfcdbf1ca8f089/users/cf64b66b910043b2b4fbd2611f67c9b2/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:10.531859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f8ab6-0e11-403a-a385-1f3663b8a1a1 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:10.715562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904fe76-cd08-4ef8-9553-4c00f0222ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:10.716305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904fe76-cd08-4ef8-9553-4c00f0222ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:10.716586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904fe76-cd08-4ef8-9553-4c00f0222ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:10.718088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904fe76-cd08-4ef8-9553-4c00f0222ac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:10.718858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904fe76-cd08-4ef8-9553-4c00f0222ac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:10.723879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904fe76-cd08-4ef8-9553-4c00f0222ac4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:10.752680 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3901/7844] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:50:10.758901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69afa64-10a1-4175-9961-bb93991eb453 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:10.775764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69afa64-10a1-4175-9961-bb93991eb453 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:10.791486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad673b-ae8f-4521-a236-3280adfe970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:10.793450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad673b-ae8f-4521-a236-3280adfe970e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:10.794058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad673b-ae8f-4521-a236-3280adfe970e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:10.794414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad673b-ae8f-4521-a236-3280adfe970e admin admin] PATH_INFO: `/v3/projects/ac906f96fd294c0b87dfcdbf1ca8f089/users/cf64b66b910043b2b4fbd2611f67c9b2/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:10.810254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad673b-ae8f-4521-a236-3280adfe970e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac906f96fd294c0b87dfcdbf1ca8f089, user_id=cf64b66b910043b2b4fbd2611f67c9b2, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:10.815890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad673b-ae8f-4521-a236-3280adfe970e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:10.859972 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3944/7845] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:50:10 2022] PUT /identity/v3/projects/ac906f96fd294c0b87dfcdbf1ca8f089/users/cf64b66b910043b2b4fbd2611f67c9b2/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:50:10.862875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec95f6f-a2ac-4b59-87d3-7412b5f10f7c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:10.863305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec95f6f-a2ac-4b59-87d3-7412b5f10f7c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:10.863864 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec95f6f-a2ac-4b59-87d3-7412b5f10f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:10.931254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1ec95f6f-a2ac-4b59-87d3-7412b5f10f7c None None] MFA Rules not processed for user `cf64b66b910043b2b4fbd2611f67c9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:10.934284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ec95f6f-a2ac-4b59-87d3-7412b5f10f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:11.032733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:11.132616 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3902/7846] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:50:11.140583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad673b-ae8f-4521-a236-3280adfe970e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:11.143074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a8ad673b-ae8f-4521-a236-3280adfe970e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:11.224095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec95f6f-a2ac-4b59-87d3-7412b5f10f7c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:11.225973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ec95f6f-a2ac-4b59-87d3-7412b5f10f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:11.328406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad673b-ae8f-4521-a236-3280adfe970e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:11.343130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4eb1d-5fd5-4719-be03-755689cb0dd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:11.344169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4eb1d-5fd5-4719-be03-755689cb0dd5 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:11.344632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4eb1d-5fd5-4719-be03-755689cb0dd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:11.348805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4eb1d-5fd5-4719-be03-755689cb0dd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:11.380522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4eb1d-5fd5-4719-be03-755689cb0dd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:11.383372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4eb1d-5fd5-4719-be03-755689cb0dd5 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:11.419658 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3945/7847] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:50:11.435534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec95f6f-a2ac-4b59-87d3-7412b5f10f7c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:11.450714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:11.451305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:11.451587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:11.451862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] PATH_INFO: `/v3/projects/46e503e83e684e26b7bcf8be8350c555` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:11.455765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e503e83e684e26b7bcf8be8350c555)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:11.457898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:11.581799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4eb1d-5fd5-4719-be03-755689cb0dd5 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:11.583881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8dc4eb1d-5fd5-4719-be03-755689cb0dd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:11.595189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e503e83e684e26b7bcf8be8350c555', 'request_id': 'req-fb4c5854-8648-41bd-be23-495a1a7efbe0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:11.614524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e503e83e684e26b7bcf8be8350c555', 'request_id': 'req-fb4c5854-8648-41bd-be23-495a1a7efbe0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:11.628193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e503e83e684e26b7bcf8be8350c555', 'request_id': 'req-fb4c5854-8648-41bd-be23-495a1a7efbe0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:11.656507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4eb1d-5fd5-4719-be03-755689cb0dd5 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:11.661482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] The token cache is being invalidate because project 46e503e83e684e26b7bcf8be8350c555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:50:11.662133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:11.663119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:11.665354 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3903/7848] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:50:11 2022] DELETE /identity/v3/projects/46e503e83e684e26b7bcf8be8350c555 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:11.669149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:11.673009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:11.708498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:11.791668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:11.805707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c5854-8648-41bd-be23-495a1a7efbe0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:11.819983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:11.821785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:11.822090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:11.823260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] PATH_INFO: `/v3/users/aa08210ec3aa4e0582840471c63121d2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:11.824303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab2218-7abb-4788-8201-e4cd6f79a421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:11.826200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab2218-7abb-4788-8201-e4cd6f79a421 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:11.827064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab2218-7abb-4788-8201-e4cd6f79a421 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:11.827344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa08210ec3aa4e0582840471c63121d2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:11.828481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab2218-7abb-4788-8201-e4cd6f79a421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:11.831957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:11.835465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a0ab2218-7abb-4788-8201-e4cd6f79a421 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:11.954267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa08210ec3aa4e0582840471c63121d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:11.975171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa08210ec3aa4e0582840471c63121d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:12.008399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa08210ec3aa4e0582840471c63121d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:12.015465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab2218-7abb-4788-8201-e4cd6f79a421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:12.018322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab2218-7abb-4788-8201-e4cd6f79a421 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:12.028527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa08210ec3aa4e0582840471c63121d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:12.030413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa08210ec3aa4e0582840471c63121d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:12.046675 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3904/7849] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:50:11 2022] DELETE /identity/v3/users/aa08210ec3aa4e0582840471c63121d2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:12.052158 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3946/7850] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:50:13.599050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:13.604071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:13.790742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e5ea4-390a-4628-bdf9-05f374e92d0c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:13.806305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:13.806305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:13.806305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:13.806305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] PATH_INFO: `/v3/projects/efcc33c31dd64e81bf8eb2193da54892` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:13.807831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcc33c31dd64e81bf8eb2193da54892)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:13.811473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:13.976474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcc33c31dd64e81bf8eb2193da54892', 'request_id': 'req-52a53527-e073-4321-9458-ef00b9e6fc72'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:13.999954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcc33c31dd64e81bf8eb2193da54892', 'request_id': 'req-52a53527-e073-4321-9458-ef00b9e6fc72'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:14.020695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcc33c31dd64e81bf8eb2193da54892', 'request_id': 'req-52a53527-e073-4321-9458-ef00b9e6fc72'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:14.060116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] The token cache is being invalidate because project efcc33c31dd64e81bf8eb2193da54892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:50:14.060413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:14.063010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-52a53527-e073-4321-9458-ef00b9e6fc72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:14.073606 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3905/7851] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:50:13 2022] DELETE /identity/v3/projects/efcc33c31dd64e81bf8eb2193da54892 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:14.076172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f5d70-4efd-43c4-a9c0-63952d7c057d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:14.076739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f5d70-4efd-43c4-a9c0-63952d7c057d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:14.077016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f5d70-4efd-43c4-a9c0-63952d7c057d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:14.117640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c59f5d70-4efd-43c4-a9c0-63952d7c057d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:14.122263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c59f5d70-4efd-43c4-a9c0-63952d7c057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:14.312033 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3947/7852] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:14.323438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e469-69c9-4cad-af29-d173ecf9e257 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:14.324298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e469-69c9-4cad-af29-d173ecf9e257 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:14.324751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1e469-69c9-4cad-af29-d173ecf9e257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:14.340508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:14.374905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1ed1e469-69c9-4cad-af29-d173ecf9e257 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:14.378100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ed1e469-69c9-4cad-af29-d173ecf9e257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:14.412074 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3906/7853] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:14.416725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f5d70-4efd-43c4-a9c0-63952d7c057d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:14.432123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f5d70-4efd-43c4-a9c0-63952d7c057d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:14.439196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e3950-1a24-4109-b187-c393bd9297ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:14.440514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e3950-1a24-4109-b187-c393bd9297ef admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:14.440946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e3950-1a24-4109-b187-c393bd9297ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:14.441375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e3950-1a24-4109-b187-c393bd9297ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:14.442688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e3950-1a24-4109-b187-c393bd9297ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:50:14.443147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e3950-1a24-4109-b187-c393bd9297ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:14.445342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e3950-1a24-4109-b187-c393bd9297ef admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:14.459191 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3948/7854] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:50:14.463709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1e469-69c9-4cad-af29-d173ecf9e257 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:14.479022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1e469-69c9-4cad-af29-d173ecf9e257 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:14.488386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c083d8a-546b-459e-aebe-eafcca8321d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:14.488650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083d8a-546b-459e-aebe-eafcca8321d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:14.488937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083d8a-546b-459e-aebe-eafcca8321d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:14.489425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c083d8a-546b-459e-aebe-eafcca8321d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:14.490130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c083d8a-546b-459e-aebe-eafcca8321d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:14.496424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c083d8a-546b-459e-aebe-eafcca8321d1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:14.543457 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3907/7855] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:50:14 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:50:14.547926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e3950-1a24-4109-b187-c393bd9297ef admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:14.568538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e3950-1a24-4109-b187-c393bd9297ef admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:14.749119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e4cc8-8822-4a29-bd86-9a0e5f4082fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:14.752113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4cc8-8822-4a29-bd86-9a0e5f4082fc admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:14.753993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4cc8-8822-4a29-bd86-9a0e5f4082fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:14.755018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e4cc8-8822-4a29-bd86-9a0e5f4082fc admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:14.759114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e4cc8-8822-4a29-bd86-9a0e5f4082fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:14.767767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e4cc8-8822-4a29-bd86-9a0e5f4082fc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:14.784565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:14.813929 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3949/7856] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:50:14 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:50:14.818301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c083d8a-546b-459e-aebe-eafcca8321d1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:14.835292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c083d8a-546b-459e-aebe-eafcca8321d1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:14.844489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69180f-20aa-4a09-86ad-f7d9e19d258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:14.845134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69180f-20aa-4a09-86ad-f7d9e19d258d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:14.845416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69180f-20aa-4a09-86ad-f7d9e19d258d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:14.845686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69180f-20aa-4a09-86ad-f7d9e19d258d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:14.846967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69180f-20aa-4a09-86ad-f7d9e19d258d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:14.848863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69180f-20aa-4a09-86ad-f7d9e19d258d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:14.868379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e4cc8-8822-4a29-bd86-9a0e5f4082fc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:14.877027 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3908/7857] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:50:14.881598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e4cc8-8822-4a29-bd86-9a0e5f4082fc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:14.887787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1088e9c-96f5-428d-aa79-e90e202b8793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:14.888661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088e9c-96f5-428d-aa79-e90e202b8793 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:14.889421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088e9c-96f5-428d-aa79-e90e202b8793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:14.889791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1088e9c-96f5-428d-aa79-e90e202b8793 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:14.890602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1088e9c-96f5-428d-aa79-e90e202b8793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:14.892875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1088e9c-96f5-428d-aa79-e90e202b8793 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:14.942376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69180f-20aa-4a09-86ad-f7d9e19d258d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:14.958175 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3950/7858] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:50:14.963196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69180f-20aa-4a09-86ad-f7d9e19d258d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:14.982852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124b42c-4059-4516-9b61-10933917deba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:14.985214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124b42c-4059-4516-9b61-10933917deba admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:14.985639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124b42c-4059-4516-9b61-10933917deba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:14.986042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124b42c-4059-4516-9b61-10933917deba admin admin] PATH_INFO: `/v3/projects/02443558bbe14c90aebbfe58b7cd67b7/users/4da1dacc0e67492b81dad89f183b62e3/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:15.014327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124b42c-4059-4516-9b61-10933917deba admin admin] RBAC: Authorizing `identity:create_grant(project_id=02443558bbe14c90aebbfe58b7cd67b7, user_id=4da1dacc0e67492b81dad89f183b62e3, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:15.020213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124b42c-4059-4516-9b61-10933917deba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:15.066723 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3909/7859] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:50:14 2022] PUT /identity/v3/projects/02443558bbe14c90aebbfe58b7cd67b7/users/4da1dacc0e67492b81dad89f183b62e3/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:15.080997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375b0bf-fe35-42bc-a060-767886e5eabf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:15.081702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375b0bf-fe35-42bc-a060-767886e5eabf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:15.081702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375b0bf-fe35-42bc-a060-767886e5eabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:15.134032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4375b0bf-fe35-42bc-a060-767886e5eabf None None] MFA Rules not processed for user `4da1dacc0e67492b81dad89f183b62e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:15.135624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4375b0bf-fe35-42bc-a060-767886e5eabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:15.307261 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3951/7860] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:15.318035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124b42c-4059-4516-9b61-10933917deba admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:15.319802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4124b42c-4059-4516-9b61-10933917deba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:15.458872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124b42c-4059-4516-9b61-10933917deba admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:15.465786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf676fec-e64e-491b-8b3c-25dd0232f879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:15.466482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676fec-e64e-491b-8b3c-25dd0232f879 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:15.467008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676fec-e64e-491b-8b3c-25dd0232f879 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:15.467280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676fec-e64e-491b-8b3c-25dd0232f879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:15.480582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf676fec-e64e-491b-8b3c-25dd0232f879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:15.484456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf676fec-e64e-491b-8b3c-25dd0232f879 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:15.501501 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3910/7861] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:50:15.530382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375b0bf-fe35-42bc-a060-767886e5eabf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:15.774857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375b0bf-fe35-42bc-a060-767886e5eabf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:15.796332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:15.797865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:15.798388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:15.798881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] PATH_INFO: `/v3/users/4da1dacc0e67492b81dad89f183b62e3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:15.801077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da1dacc0e67492b81dad89f183b62e3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:15.803917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:15.894016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da1dacc0e67492b81dad89f183b62e3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:15.894924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da1dacc0e67492b81dad89f183b62e3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:15.907294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da1dacc0e67492b81dad89f183b62e3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:15.922204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da1dacc0e67492b81dad89f183b62e3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:15.952450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:15.976726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da1dacc0e67492b81dad89f183b62e3'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:16.005893 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3952/7862] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:50:15 2022] DELETE /identity/v3/users/4da1dacc0e67492b81dad89f183b62e3 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:16.012222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299e19-663e-4030-a292-43c67f46d7ee None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:16.012757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299e19-663e-4030-a292-43c67f46d7ee None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:16.012757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85299e19-663e-4030-a292-43c67f46d7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:16.071556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-85299e19-663e-4030-a292-43c67f46d7ee None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:16.073689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-85299e19-663e-4030-a292-43c67f46d7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:16.224931 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3911/7863] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:16.242637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:16.244258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:16.398372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2251e8a-162a-4d6f-b349-f5726bf7e5d3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:16.408372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb43ae-abec-4760-b109-f90206d4f412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:16.410412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb43ae-abec-4760-b109-f90206d4f412 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:16.411005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb43ae-abec-4760-b109-f90206d4f412 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:16.411448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb43ae-abec-4760-b109-f90206d4f412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:16.441304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb43ae-abec-4760-b109-f90206d4f412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:16.444017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb43ae-abec-4760-b109-f90206d4f412 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:16.465312 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3953/7864] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:50:17.413650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299e19-663e-4030-a292-43c67f46d7ee None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:17.415925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-85299e19-663e-4030-a292-43c67f46d7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:17.430335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85299e19-663e-4030-a292-43c67f46d7ee None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:17.437965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:17.438893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:17.439599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:17.440038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] PATH_INFO: `/v3/projects/02443558bbe14c90aebbfe58b7cd67b7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:17.441609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=02443558bbe14c90aebbfe58b7cd67b7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:17.443755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:17.521438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:17.541255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02443558bbe14c90aebbfe58b7cd67b7', 'request_id': 'req-06fbd894-651d-4f64-9d4c-1d1335ca9cca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:17.574258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02443558bbe14c90aebbfe58b7cd67b7', 'request_id': 'req-06fbd894-651d-4f64-9d4c-1d1335ca9cca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:17.588381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02443558bbe14c90aebbfe58b7cd67b7', 'request_id': 'req-06fbd894-651d-4f64-9d4c-1d1335ca9cca'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:17.633930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] The token cache is being invalidate because project 02443558bbe14c90aebbfe58b7cd67b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:50:17.646211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:17.648709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-06fbd894-651d-4f64-9d4c-1d1335ca9cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:17.655705 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3912/7865] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:50:17 2022] DELETE /identity/v3/projects/02443558bbe14c90aebbfe58b7cd67b7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:17.661910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6263b-cfe1-4fb8-8819-1d2e598615bf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:17.662459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6263b-cfe1-4fb8-8819-1d2e598615bf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:17.662459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6263b-cfe1-4fb8-8819-1d2e598615bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:17.702653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4af6263b-cfe1-4fb8-8819-1d2e598615bf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:17.703719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4af6263b-cfe1-4fb8-8819-1d2e598615bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:17.815577 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3954/7866] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:17.823784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec310fae-3d1e-4ea6-be77-b8e11a4353d7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:17.825096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec310fae-3d1e-4ea6-be77-b8e11a4353d7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:17.825292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec310fae-3d1e-4ea6-be77-b8e11a4353d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:17.881491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ec310fae-3d1e-4ea6-be77-b8e11a4353d7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:17.885690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ec310fae-3d1e-4ea6-be77-b8e11a4353d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:17.912361 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3913/7867] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:17.916363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6263b-cfe1-4fb8-8819-1d2e598615bf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:17.930272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6263b-cfe1-4fb8-8819-1d2e598615bf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:17.953405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3284840-e105-405d-b773-10d328cdb7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:17.954112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3284840-e105-405d-b773-10d328cdb7cb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:17.956375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3284840-e105-405d-b773-10d328cdb7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:17.956677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3284840-e105-405d-b773-10d328cdb7cb admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:17.957371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3284840-e105-405d-b773-10d328cdb7cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:50:17.957698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3284840-e105-405d-b773-10d328cdb7cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:17.964157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3284840-e105-405d-b773-10d328cdb7cb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:17.985239 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3955/7868] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:50:17.987092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec310fae-3d1e-4ea6-be77-b8e11a4353d7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:18.011216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec310fae-3d1e-4ea6-be77-b8e11a4353d7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:18.019839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f906f-0238-4bf7-ae41-cd9eef49df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:18.020834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f906f-0238-4bf7-ae41-cd9eef49df16 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:18.021192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f906f-0238-4bf7-ae41-cd9eef49df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:18.021523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40f906f-0238-4bf7-ae41-cd9eef49df16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:18.022762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f906f-0238-4bf7-ae41-cd9eef49df16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:18.025151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40f906f-0238-4bf7-ae41-cd9eef49df16 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:18.076774 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3914/7869] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:50:17 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:50:18.080613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3284840-e105-405d-b773-10d328cdb7cb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:18.093169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3284840-e105-405d-b773-10d328cdb7cb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:18.317987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788717ca-c8db-43ca-82ee-6931861c62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:18.318621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788717ca-c8db-43ca-82ee-6931861c62b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:18.318947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788717ca-c8db-43ca-82ee-6931861c62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:18.319315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788717ca-c8db-43ca-82ee-6931861c62b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:18.321091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788717ca-c8db-43ca-82ee-6931861c62b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:18.327466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788717ca-c8db-43ca-82ee-6931861c62b6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:18.398261 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3956/7870] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:50:18 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:50:18.398950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f906f-0238-4bf7-ae41-cd9eef49df16 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:18.411921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40f906f-0238-4bf7-ae41-cd9eef49df16 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:18.419689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c111301-f608-49ed-817a-04c939c73d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:18.421204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c111301-f608-49ed-817a-04c939c73d31 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:18.421650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c111301-f608-49ed-817a-04c939c73d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:18.422134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c111301-f608-49ed-817a-04c939c73d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:18.425128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c111301-f608-49ed-817a-04c939c73d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:18.427309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c111301-f608-49ed-817a-04c939c73d31 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:18.444691 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3915/7871] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:50:18.448633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788717ca-c8db-43ca-82ee-6931861c62b6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:18.469977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788717ca-c8db-43ca-82ee-6931861c62b6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:18.483764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4e641-806f-4fa7-be54-bb4ef80bf6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:18.484674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4e641-806f-4fa7-be54-bb4ef80bf6cb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:18.487127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4e641-806f-4fa7-be54-bb4ef80bf6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:18.487567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4e641-806f-4fa7-be54-bb4ef80bf6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:18.488268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4e641-806f-4fa7-be54-bb4ef80bf6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:18.490018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4e641-806f-4fa7-be54-bb4ef80bf6cb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:18.495663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:18.526894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c111301-f608-49ed-817a-04c939c73d31 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:18.535183 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3957/7872] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:50:18.544598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c111301-f608-49ed-817a-04c939c73d31 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:18.556338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf24a7-2cac-4105-8b0d-4c7cad9a311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:18.561555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf24a7-2cac-4105-8b0d-4c7cad9a311b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:18.561917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf24a7-2cac-4105-8b0d-4c7cad9a311b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:18.562212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf24a7-2cac-4105-8b0d-4c7cad9a311b admin admin] PATH_INFO: `/v3/projects/bcdb8eb979be43528d3996d9115a3a43/users/8b614e3b45bb4e81afd8905e2228d9f3/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:18.606450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf24a7-2cac-4105-8b0d-4c7cad9a311b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdb8eb979be43528d3996d9115a3a43, user_id=8b614e3b45bb4e81afd8905e2228d9f3, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:18.637925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf24a7-2cac-4105-8b0d-4c7cad9a311b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:18.687665 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3916/7873] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:50:18 2022] PUT /identity/v3/projects/bcdb8eb979be43528d3996d9115a3a43/users/8b614e3b45bb4e81afd8905e2228d9f3/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:50:18.700504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eef09f-545e-4545-8141-5712eff2c1e4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:18.701640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eef09f-545e-4545-8141-5712eff2c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:18.702314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eef09f-545e-4545-8141-5712eff2c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:18.768042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-59eef09f-545e-4545-8141-5712eff2c1e4 None None] MFA Rules not processed for user `8b614e3b45bb4e81afd8905e2228d9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:18.769509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-59eef09f-545e-4545-8141-5712eff2c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:18.881512 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3958/7874] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:18.892779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf24a7-2cac-4105-8b0d-4c7cad9a311b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:18.894584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-80cf24a7-2cac-4105-8b0d-4c7cad9a311b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:19.019139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf24a7-2cac-4105-8b0d-4c7cad9a311b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:19.044515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15932-908b-490f-9947-4dbafaf00fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:19.047013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15932-908b-490f-9947-4dbafaf00fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:19.048160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15932-908b-490f-9947-4dbafaf00fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:19.048929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15932-908b-490f-9947-4dbafaf00fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:19.111062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e15932-908b-490f-9947-4dbafaf00fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:19.118421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e15932-908b-490f-9947-4dbafaf00fa5 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:19.146007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3917/7875] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:50:28.876829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=34 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:29.130758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:36.395242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eef09f-545e-4545-8141-5712eff2c1e4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:36.397902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-59eef09f-545e-4545-8141-5712eff2c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:36.666352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eef09f-545e-4545-8141-5712eff2c1e4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:36.677232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:36.696576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:36.696576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:36.696576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] PATH_INFO: `/v3/users/75b1bde02d1e4d2796ab58bdd342282f` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:36.696576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b1bde02d1e4d2796ab58bdd342282f)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:36.698524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:36.843761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b1bde02d1e4d2796ab58bdd342282f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:36.844936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b1bde02d1e4d2796ab58bdd342282f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:36.863933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b1bde02d1e4d2796ab58bdd342282f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:36.887102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b1bde02d1e4d2796ab58bdd342282f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:36.955044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b1bde02d1e4d2796ab58bdd342282f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:36.979859 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3959/7876] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:50:36 2022] DELETE /identity/v3/users/75b1bde02d1e4d2796ab58bdd342282f => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:38.182391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15932-908b-490f-9947-4dbafaf00fa5 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:38.220933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15932-908b-490f-9947-4dbafaf00fa5 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:38.433249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:38.434151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:38.434438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:38.434711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] PATH_INFO: `/v3/projects/3eb6ce389f92430183e8a4cf3cb64a76` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:38.436335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb6ce389f92430183e8a4cf3cb64a76)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:38.440095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:38.534261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb6ce389f92430183e8a4cf3cb64a76', 'request_id': 'req-aba9dbcf-adf7-4f83-881f-552093086edf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:38.553310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb6ce389f92430183e8a4cf3cb64a76', 'request_id': 'req-aba9dbcf-adf7-4f83-881f-552093086edf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:38.566931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb6ce389f92430183e8a4cf3cb64a76', 'request_id': 'req-aba9dbcf-adf7-4f83-881f-552093086edf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:38.597495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] The token cache is being invalidate because project 3eb6ce389f92430183e8a4cf3cb64a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:50:38.598044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:38.600014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:38.602669 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3918/7877] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:50:38 2022] DELETE /identity/v3/projects/3eb6ce389f92430183e8a4cf3cb64a76 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:38.606879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:38.610227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:38.643231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45aa8c-6c7d-47fd-90a0-13f0c604acfc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:38.843444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:38.844121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:38.844399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:38.845334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] PATH_INFO: `/v3/users/f0f513e4d2e2419eacc5212d844c4e70` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:38.862659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f513e4d2e2419eacc5212d844c4e70)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:38.870128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:38.936532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:39.026942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f513e4d2e2419eacc5212d844c4e70'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:39.031587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f513e4d2e2419eacc5212d844c4e70'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:39.061226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f513e4d2e2419eacc5212d844c4e70'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:39.095703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f513e4d2e2419eacc5212d844c4e70'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:39.152947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f513e4d2e2419eacc5212d844c4e70'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:39.171841 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3960/7878] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:50:38 2022] DELETE /identity/v3/users/f0f513e4d2e2419eacc5212d844c4e70 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:39.592900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:39.594366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:39.625850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9dbcf-adf7-4f83-881f-552093086edf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:39.771431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:39.772377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:39.772836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:39.773452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] PATH_INFO: `/v3/projects/2bfab75fd6ba4508bb41f798ebe8403b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:39.775510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bfab75fd6ba4508bb41f798ebe8403b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:39.778652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:39.828416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:39.849656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bfab75fd6ba4508bb41f798ebe8403b', 'request_id': 'req-43021fe1-ef13-4710-8dc3-729d69aa1cb6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:39.861784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bfab75fd6ba4508bb41f798ebe8403b', 'request_id': 'req-43021fe1-ef13-4710-8dc3-729d69aa1cb6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:39.883389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bfab75fd6ba4508bb41f798ebe8403b', 'request_id': 'req-43021fe1-ef13-4710-8dc3-729d69aa1cb6'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:39.916228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] The token cache is being invalidate because project 2bfab75fd6ba4508bb41f798ebe8403b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:50:39.917142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:39.918523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-43021fe1-ef13-4710-8dc3-729d69aa1cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:39.922891 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3919/7879] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:50:39 2022] DELETE /identity/v3/projects/2bfab75fd6ba4508bb41f798ebe8403b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:49.163846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:49.906295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:51.627258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:51.629173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:51.670059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5361a9a-7412-4deb-b7d2-7a0ee10a6ee3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:51.821285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:51.824754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:51.825148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:51.826935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] PATH_INFO: `/v3/users/76c80315753e46ff91c0d4696e4a2007` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:51.831724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c80315753e46ff91c0d4696e4a2007)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:51.835210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:51.988524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c80315753e46ff91c0d4696e4a2007'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:51.991638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c80315753e46ff91c0d4696e4a2007'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:52.019280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c80315753e46ff91c0d4696e4a2007'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:52.042550 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c80315753e46ff91c0d4696e4a2007'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:52.068379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c80315753e46ff91c0d4696e4a2007'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:52.080669 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3961/7880] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:50:51 2022] DELETE /identity/v3/users/76c80315753e46ff91c0d4696e4a2007 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:52.086279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6300-68aa-4b49-acc5-08809b3961c9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:52.086860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6300-68aa-4b49-acc5-08809b3961c9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:52.087124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c6300-68aa-4b49-acc5-08809b3961c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:52.124288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-377c6300-68aa-4b49-acc5-08809b3961c9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:52.126780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-377c6300-68aa-4b49-acc5-08809b3961c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:52.311771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:52.313285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:52.332451 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3920/7881] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:52.419512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6ee34-6561-419d-b6c5-b3625e667e45 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:52.425242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe601e3-8748-4d60-9420-fc4c954408e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:52.425907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe601e3-8748-4d60-9420-fc4c954408e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:52.426177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe601e3-8748-4d60-9420-fc4c954408e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:52.426586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe601e3-8748-4d60-9420-fc4c954408e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:52.439065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe601e3-8748-4d60-9420-fc4c954408e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:52.440541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe601e3-8748-4d60-9420-fc4c954408e5 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:52.470467 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3962/7882] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:50:52.805184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6300-68aa-4b49-acc5-08809b3961c9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:52.806654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-377c6300-68aa-4b49-acc5-08809b3961c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:52.843741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c6300-68aa-4b49-acc5-08809b3961c9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:52.878548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:52.879520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:52.882239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:52.882757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] PATH_INFO: `/v3/projects/6eedbd0bbdfd4314aefe85410771d571` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:52.884510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eedbd0bbdfd4314aefe85410771d571)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:52.890840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:52.994986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eedbd0bbdfd4314aefe85410771d571', 'request_id': 'req-da98189f-6836-4855-969b-9dad0edadb32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:53.008329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eedbd0bbdfd4314aefe85410771d571', 'request_id': 'req-da98189f-6836-4855-969b-9dad0edadb32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:53.020816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eedbd0bbdfd4314aefe85410771d571', 'request_id': 'req-da98189f-6836-4855-969b-9dad0edadb32'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:53.052713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] The token cache is being invalidate because project 6eedbd0bbdfd4314aefe85410771d571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:50:53.055877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:53.058481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-da98189f-6836-4855-969b-9dad0edadb32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:53.068404 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3921/7883] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:50:52 2022] DELETE /identity/v3/projects/6eedbd0bbdfd4314aefe85410771d571 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:53.071429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c07bb-6da6-4dbc-ae38-70853f170c99 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:53.072522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c07bb-6da6-4dbc-ae38-70853f170c99 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:53.072981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c07bb-6da6-4dbc-ae38-70853f170c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:53.113351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7d1c07bb-6da6-4dbc-ae38-70853f170c99 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:53.117802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7d1c07bb-6da6-4dbc-ae38-70853f170c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:53.162443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:53.273821 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3963/7884] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:53.275153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa0af8-167d-4e02-bd85-76687b589365 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:53.275682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa0af8-167d-4e02-bd85-76687b589365 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:53.275851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa0af8-167d-4e02-bd85-76687b589365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:53.314938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0faa0af8-167d-4e02-bd85-76687b589365 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:53.316092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0faa0af8-167d-4e02-bd85-76687b589365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:53.337228 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3922/7885] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:53.338824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c07bb-6da6-4dbc-ae38-70853f170c99 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:53.354831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c07bb-6da6-4dbc-ae38-70853f170c99 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:53.379007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c46fa1-5d54-420a-9408-d872a82662bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:53.379650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c46fa1-5d54-420a-9408-d872a82662bb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:53.379933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c46fa1-5d54-420a-9408-d872a82662bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:53.380182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c46fa1-5d54-420a-9408-d872a82662bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:53.380839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c46fa1-5d54-420a-9408-d872a82662bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:50:53.381137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c46fa1-5d54-420a-9408-d872a82662bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:53.395078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c46fa1-5d54-420a-9408-d872a82662bb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:53.443389 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3964/7886] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:50:53.445460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa0af8-167d-4e02-bd85-76687b589365 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:53.472302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa0af8-167d-4e02-bd85-76687b589365 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:53.493969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171c70b-966d-4005-8ddd-9b74311fe6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:53.494594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171c70b-966d-4005-8ddd-9b74311fe6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:53.494927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171c70b-966d-4005-8ddd-9b74311fe6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:53.495341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171c70b-966d-4005-8ddd-9b74311fe6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:53.495894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171c70b-966d-4005-8ddd-9b74311fe6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:53.497847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171c70b-966d-4005-8ddd-9b74311fe6b6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:53.588752 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3923/7887] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:50:53 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:50:53.592293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c46fa1-5d54-420a-9408-d872a82662bb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:53.605193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c46fa1-5d54-420a-9408-d872a82662bb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:53.720858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4921e19-1d7a-4c57-9ee8-c555fc84558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:53.721853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4921e19-1d7a-4c57-9ee8-c555fc84558f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:53.722372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4921e19-1d7a-4c57-9ee8-c555fc84558f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:53.723818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4921e19-1d7a-4c57-9ee8-c555fc84558f admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:53.724735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4921e19-1d7a-4c57-9ee8-c555fc84558f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:53.727391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4921e19-1d7a-4c57-9ee8-c555fc84558f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:53.762494 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3965/7888] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:50:53 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:50:53.762920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171c70b-966d-4005-8ddd-9b74311fe6b6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:53.777334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171c70b-966d-4005-8ddd-9b74311fe6b6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:53.786272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8318aaf-4d34-48f7-a74c-aab0c7176849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:53.788388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318aaf-4d34-48f7-a74c-aab0c7176849 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:53.788908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318aaf-4d34-48f7-a74c-aab0c7176849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:53.789552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318aaf-4d34-48f7-a74c-aab0c7176849 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:53.790512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8318aaf-4d34-48f7-a74c-aab0c7176849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:53.792972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8318aaf-4d34-48f7-a74c-aab0c7176849 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:53.812182 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3924/7889] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:50:53.812643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4921e19-1d7a-4c57-9ee8-c555fc84558f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:53.826889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4921e19-1d7a-4c57-9ee8-c555fc84558f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:53.832260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068e550-91be-424d-bd36-96a2fa91e35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:53.833213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068e550-91be-424d-bd36-96a2fa91e35c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:53.833518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068e550-91be-424d-bd36-96a2fa91e35c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:53.834400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068e550-91be-424d-bd36-96a2fa91e35c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:53.835194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068e550-91be-424d-bd36-96a2fa91e35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:53.837149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e068e550-91be-424d-bd36-96a2fa91e35c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:53.904474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8318aaf-4d34-48f7-a74c-aab0c7176849 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:53.904644 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3966/7890] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:50:53.920762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8318aaf-4d34-48f7-a74c-aab0c7176849 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:53.926967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a408e5-b9a9-45cb-956d-eae28ac7bc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:53.927661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a408e5-b9a9-45cb-956d-eae28ac7bc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:53.927933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a408e5-b9a9-45cb-956d-eae28ac7bc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:53.928208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a408e5-b9a9-45cb-956d-eae28ac7bc05 admin admin] PATH_INFO: `/v3/projects/c67d5cfa719349a08d84238845808164/users/acfdc526b14a480a94e323d5967e00f2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:53.992703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a408e5-b9a9-45cb-956d-eae28ac7bc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67d5cfa719349a08d84238845808164, user_id=acfdc526b14a480a94e323d5967e00f2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:53.992703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a408e5-b9a9-45cb-956d-eae28ac7bc05 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:54.011630 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3925/7891] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:50:53 2022] PUT /identity/v3/projects/c67d5cfa719349a08d84238845808164/users/acfdc526b14a480a94e323d5967e00f2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:50:54.023698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf6b59-230a-4cd5-9a39-9d795d6b266f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:54.030488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf6b59-230a-4cd5-9a39-9d795d6b266f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:54.031010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf6b59-230a-4cd5-9a39-9d795d6b266f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:54.122802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0bcf6b59-230a-4cd5-9a39-9d795d6b266f None None] MFA Rules not processed for user `acfdc526b14a480a94e323d5967e00f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:54.124407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0bcf6b59-230a-4cd5-9a39-9d795d6b266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:54.289053 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3967/7892] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:54.303493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a408e5-b9a9-45cb-956d-eae28ac7bc05 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:54.308097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d3a408e5-b9a9-45cb-956d-eae28ac7bc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:54.352269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:54.452155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a408e5-b9a9-45cb-956d-eae28ac7bc05 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:54.464751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff327e0-b73f-4cf9-afe1-ba37bfa44e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:54.465515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff327e0-b73f-4cf9-afe1-ba37bfa44e33 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:54.465890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff327e0-b73f-4cf9-afe1-ba37bfa44e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:54.466246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff327e0-b73f-4cf9-afe1-ba37bfa44e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:54.498430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff327e0-b73f-4cf9-afe1-ba37bfa44e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:54.500634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff327e0-b73f-4cf9-afe1-ba37bfa44e33 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:54.524638 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3926/7893] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:50:55.703688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf6b59-230a-4cd5-9a39-9d795d6b266f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:55.749176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:55.873496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf6b59-230a-4cd5-9a39-9d795d6b266f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:55.884331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:55.885325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:55.885905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:55.886333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] PATH_INFO: `/v3/users/acfdc526b14a480a94e323d5967e00f2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:55.888966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acfdc526b14a480a94e323d5967e00f2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:55.894920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:56.035594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acfdc526b14a480a94e323d5967e00f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:56.036555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acfdc526b14a480a94e323d5967e00f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:56.048959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acfdc526b14a480a94e323d5967e00f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:56.067096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acfdc526b14a480a94e323d5967e00f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:56.096791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acfdc526b14a480a94e323d5967e00f2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:56.111431 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3968/7894] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:50:55 2022] DELETE /identity/v3/users/acfdc526b14a480a94e323d5967e00f2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:56.116071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc783ff-5d49-4dda-87e6-16f82687e2a5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:56.116616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc783ff-5d49-4dda-87e6-16f82687e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:56.116733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc783ff-5d49-4dda-87e6-16f82687e2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:56.163763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8dc783ff-5d49-4dda-87e6-16f82687e2a5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:56.167260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8dc783ff-5d49-4dda-87e6-16f82687e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:56.302871 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3927/7895] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:56.309941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:56.311709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:56.406668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86055a28-eb01-4e69-9a42-11c761df8381 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:56.410485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d12b3-7590-4d48-b5f9-44af5c3da70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:56.411110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d12b3-7590-4d48-b5f9-44af5c3da70d service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:56.412293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d12b3-7590-4d48-b5f9-44af5c3da70d service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:56.412573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d12b3-7590-4d48-b5f9-44af5c3da70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:56.423915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d12b3-7590-4d48-b5f9-44af5c3da70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:56.425848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d12b3-7590-4d48-b5f9-44af5c3da70d service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:56.438793 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3969/7896] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:50:57.143122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc783ff-5d49-4dda-87e6-16f82687e2a5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:57.145149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8dc783ff-5d49-4dda-87e6-16f82687e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:57.163829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc783ff-5d49-4dda-87e6-16f82687e2a5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:57.192182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:57.193163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:57.193753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:57.194128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] PATH_INFO: `/v3/projects/c67d5cfa719349a08d84238845808164` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:57.195959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67d5cfa719349a08d84238845808164)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:57.199908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:57.279195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67d5cfa719349a08d84238845808164', 'request_id': 'req-0a508d19-3f8f-404b-a016-f2cefeb4e468'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:57.301616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67d5cfa719349a08d84238845808164', 'request_id': 'req-0a508d19-3f8f-404b-a016-f2cefeb4e468'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:57.324223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67d5cfa719349a08d84238845808164', 'request_id': 'req-0a508d19-3f8f-404b-a016-f2cefeb4e468'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:57.362137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] The token cache is being invalidate because project c67d5cfa719349a08d84238845808164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:50:57.362821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:57.363761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0a508d19-3f8f-404b-a016-f2cefeb4e468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:50:57.367080 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3928/7897] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:50:57 2022] DELETE /identity/v3/projects/c67d5cfa719349a08d84238845808164 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:57.371746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55473ca-9fef-4e10-9f1a-0d6cb5c26b11 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:57.372810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55473ca-9fef-4e10-9f1a-0d6cb5c26b11 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:57.373232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55473ca-9fef-4e10-9f1a-0d6cb5c26b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:57.396390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f55473ca-9fef-4e10-9f1a-0d6cb5c26b11 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:57.398070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f55473ca-9fef-4e10-9f1a-0d6cb5c26b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:57.439761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:57.492119 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3970/7898] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:50:57.500239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c486aa-63f1-408d-a75c-a0f98e9d76ec None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:57.500847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c486aa-63f1-408d-a75c-a0f98e9d76ec None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:57.501349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c486aa-63f1-408d-a75c-a0f98e9d76ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:57.535748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-53c486aa-63f1-408d-a75c-a0f98e9d76ec None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:57.536934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-53c486aa-63f1-408d-a75c-a0f98e9d76ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:57.557308 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3929/7899] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:50:57.563068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55473ca-9fef-4e10-9f1a-0d6cb5c26b11 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:57.577987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55473ca-9fef-4e10-9f1a-0d6cb5c26b11 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:57.592808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8670-12b4-4745-8aaa-86c305ee1ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:57.593834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8670-12b4-4745-8aaa-86c305ee1ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:57.594364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8670-12b4-4745-8aaa-86c305ee1ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:57.594843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8670-12b4-4745-8aaa-86c305ee1ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:57.595722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8670-12b4-4745-8aaa-86c305ee1ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:50:57.596514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8670-12b4-4745-8aaa-86c305ee1ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:57.598331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8670-12b4-4745-8aaa-86c305ee1ea3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:57.632196 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3971/7900] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:50:57.636597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c486aa-63f1-408d-a75c-a0f98e9d76ec None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:57.650984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c486aa-63f1-408d-a75c-a0f98e9d76ec None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:57.658577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75825-62af-4833-9f26-6e534afb2f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:57.662364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75825-62af-4833-9f26-6e534afb2f3e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:57.662949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75825-62af-4833-9f26-6e534afb2f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:57.663645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a75825-62af-4833-9f26-6e534afb2f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:57.675417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a75825-62af-4833-9f26-6e534afb2f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:57.680349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a75825-62af-4833-9f26-6e534afb2f3e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:57.780241 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3930/7901] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:50:57 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:50:57.789323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8670-12b4-4745-8aaa-86c305ee1ea3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:57.859050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8670-12b4-4745-8aaa-86c305ee1ea3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:58.071462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd62d5-8643-41a1-9e24-3ab2f62c4e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:58.072086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd62d5-8643-41a1-9e24-3ab2f62c4e6e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:58.072487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd62d5-8643-41a1-9e24-3ab2f62c4e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:58.072905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd62d5-8643-41a1-9e24-3ab2f62c4e6e admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:58.074469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd62d5-8643-41a1-9e24-3ab2f62c4e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:58.078907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd62d5-8643-41a1-9e24-3ab2f62c4e6e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:58.140417 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3972/7902] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:50:57 2022] POST /identity/v3/users => generated 288 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:50:58.146840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75825-62af-4833-9f26-6e534afb2f3e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:58.167404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a75825-62af-4833-9f26-6e534afb2f3e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:58.179571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf90971-899d-439d-aa11-f011c10d11d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:58.179571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf90971-899d-439d-aa11-f011c10d11d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:58.179571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf90971-899d-439d-aa11-f011c10d11d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:58.179571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf90971-899d-439d-aa11-f011c10d11d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:58.192326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf90971-899d-439d-aa11-f011c10d11d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:58.194185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf90971-899d-439d-aa11-f011c10d11d1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:58.230219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd62d5-8643-41a1-9e24-3ab2f62c4e6e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:58.237413 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3931/7903] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:50:58.248852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd62d5-8643-41a1-9e24-3ab2f62c4e6e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:58.263698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b981a-fdd5-4b92-9e7d-c4fbebbc6dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:58.264467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b981a-fdd5-4b92-9e7d-c4fbebbc6dce admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:58.264742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b981a-fdd5-4b92-9e7d-c4fbebbc6dce admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:58.265011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b981a-fdd5-4b92-9e7d-c4fbebbc6dce admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:58.266556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b981a-fdd5-4b92-9e7d-c4fbebbc6dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:58.268521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b981a-fdd5-4b92-9e7d-c4fbebbc6dce admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:58.304995 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3973/7904] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:50:58.307361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf90971-899d-439d-aa11-f011c10d11d1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:58.329752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf90971-899d-439d-aa11-f011c10d11d1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:58.346640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c3e69-82ca-4a12-91c9-ed74a46ac735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:58.347456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c3e69-82ca-4a12-91c9-ed74a46ac735 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:58.347964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c3e69-82ca-4a12-91c9-ed74a46ac735 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:58.348801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c3e69-82ca-4a12-91c9-ed74a46ac735 admin admin] PATH_INFO: `/v3/projects/0f86d0aac8fb48808c14d61fec2ee790/users/dc6468b9657946219261b20acc019941/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:58.355213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:58.404783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c3e69-82ca-4a12-91c9-ed74a46ac735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f86d0aac8fb48808c14d61fec2ee790, user_id=dc6468b9657946219261b20acc019941, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:58.407532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c3e69-82ca-4a12-91c9-ed74a46ac735 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:58.493840 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3932/7905] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:50:58 2022] PUT /identity/v3/projects/0f86d0aac8fb48808c14d61fec2ee790/users/dc6468b9657946219261b20acc019941/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:50:58.498471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f29ae-7e0a-42d8-9488-ffe05b13fedb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:58.498975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f29ae-7e0a-42d8-9488-ffe05b13fedb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:58.499082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f29ae-7e0a-42d8-9488-ffe05b13fedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:58.606195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-948f29ae-7e0a-42d8-9488-ffe05b13fedb None None] MFA Rules not processed for user `dc6468b9657946219261b20acc019941`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:50:58.606842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-948f29ae-7e0a-42d8-9488-ffe05b13fedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:58.866126 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3974/7906] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:50:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:50:58.877531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c3e69-82ca-4a12-91c9-ed74a46ac735 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:50:58.879815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-466c3e69-82ca-4a12-91c9-ed74a46ac735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:50:59.006701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c3e69-82ca-4a12-91c9-ed74a46ac735 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:50:59.017225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375cf78e-7e77-48a4-8b68-107da5188373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:50:59.018044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf78e-7e77-48a4-8b68-107da5188373 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:50:59.018896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf78e-7e77-48a4-8b68-107da5188373 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:50:59.018896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375cf78e-7e77-48a4-8b68-107da5188373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:50:59.066754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cf78e-7e77-48a4-8b68-107da5188373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:50:59.072200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375cf78e-7e77-48a4-8b68-107da5188373 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:50:59.097589 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3933/7907] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:50:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:50:59.963870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f29ae-7e0a-42d8-9488-ffe05b13fedb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:00.057923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:00.140185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f29ae-7e0a-42d8-9488-ffe05b13fedb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:00.156548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:00.157615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:00.164494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:00.165032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] PATH_INFO: `/v3/users/dc6468b9657946219261b20acc019941` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:00.168259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6468b9657946219261b20acc019941)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:00.173648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:00.346160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6468b9657946219261b20acc019941'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:00.347299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6468b9657946219261b20acc019941'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:00.377145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6468b9657946219261b20acc019941'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:00.417570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6468b9657946219261b20acc019941'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:00.470294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6468b9657946219261b20acc019941'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:00.498012 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3975/7908] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:50:59 2022] DELETE /identity/v3/users/dc6468b9657946219261b20acc019941 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:00.509927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae7079-855e-41b9-a5f9-9c793570b297 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:00.509927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae7079-855e-41b9-a5f9-9c793570b297 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:00.509927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae7079-855e-41b9-a5f9-9c793570b297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:00.536110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a0ae7079-855e-41b9-a5f9-9c793570b297 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:00.537469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a0ae7079-855e-41b9-a5f9-9c793570b297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:00.755532 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3934/7909] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:00.766117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:00.767899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:00.937106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb3d77-d335-46aa-8433-85bd38ed20b9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:00.951124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06b2d3-18d9-4270-8c89-e7557f394664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:00.952299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b2d3-18d9-4270-8c89-e7557f394664 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:00.952784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b2d3-18d9-4270-8c89-e7557f394664 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:00.953223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b2d3-18d9-4270-8c89-e7557f394664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:00.968166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06b2d3-18d9-4270-8c89-e7557f394664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:00.973177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06b2d3-18d9-4270-8c89-e7557f394664 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:01.013388 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3976/7910] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:01.881362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae7079-855e-41b9-a5f9-9c793570b297 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:01.882877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a0ae7079-855e-41b9-a5f9-9c793570b297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:01.902223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae7079-855e-41b9-a5f9-9c793570b297 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:01.934830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:01.935415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:01.936037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:01.936180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] PATH_INFO: `/v3/projects/0f86d0aac8fb48808c14d61fec2ee790` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:01.937704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f86d0aac8fb48808c14d61fec2ee790)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:01.940235 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:02.072029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f86d0aac8fb48808c14d61fec2ee790', 'request_id': 'req-a057ad32-76af-48ba-8fd9-7590bfdc33ab'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:02.091055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f86d0aac8fb48808c14d61fec2ee790', 'request_id': 'req-a057ad32-76af-48ba-8fd9-7590bfdc33ab'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:02.100629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f86d0aac8fb48808c14d61fec2ee790', 'request_id': 'req-a057ad32-76af-48ba-8fd9-7590bfdc33ab'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:02.130448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] The token cache is being invalidate because project 0f86d0aac8fb48808c14d61fec2ee790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:02.130834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:02.131877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a057ad32-76af-48ba-8fd9-7590bfdc33ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:02.138155 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3935/7911] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:01 2022] DELETE /identity/v3/projects/0f86d0aac8fb48808c14d61fec2ee790 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:02.149311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8547e56-e787-41e4-bf83-5ebe1ec1a8c6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:02.150725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8547e56-e787-41e4-bf83-5ebe1ec1a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:02.151169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8547e56-e787-41e4-bf83-5ebe1ec1a8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:02.191540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d8547e56-e787-41e4-bf83-5ebe1ec1a8c6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:02.192980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d8547e56-e787-41e4-bf83-5ebe1ec1a8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:02.688871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:02.710739 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3977/7912] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 567 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:02.712274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0c44f-2ab7-46b6-bed1-b57d5943a628 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:02.713072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0c44f-2ab7-46b6-bed1-b57d5943a628 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:02.713280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0c44f-2ab7-46b6-bed1-b57d5943a628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:02.779660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a4b0c44f-2ab7-46b6-bed1-b57d5943a628 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:02.786401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a4b0c44f-2ab7-46b6-bed1-b57d5943a628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:02.832210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8547e56-e787-41e4-bf83-5ebe1ec1a8c6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:02.840059 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3936/7913] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:02.848942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8547e56-e787-41e4-bf83-5ebe1ec1a8c6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:02.860349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639c249-5acb-47a1-be5c-31bddcad91c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:02.860980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639c249-5acb-47a1-be5c-31bddcad91c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:02.861254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639c249-5acb-47a1-be5c-31bddcad91c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:02.861516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639c249-5acb-47a1-be5c-31bddcad91c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:02.862207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639c249-5acb-47a1-be5c-31bddcad91c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:51:02.865899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639c249-5acb-47a1-be5c-31bddcad91c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:02.867545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639c249-5acb-47a1-be5c-31bddcad91c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:02.915910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0c44f-2ab7-46b6-bed1-b57d5943a628 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:02.921657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:02.928201 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3978/7914] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:51:02.928591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0c44f-2ab7-46b6-bed1-b57d5943a628 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:02.935480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f4132-a8a1-4b11-81ff-80edafafacee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:02.936116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f4132-a8a1-4b11-81ff-80edafafacee admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:02.936989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f4132-a8a1-4b11-81ff-80edafafacee admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:02.936989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f4132-a8a1-4b11-81ff-80edafafacee admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:02.937463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f4132-a8a1-4b11-81ff-80edafafacee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:02.940292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f4132-a8a1-4b11-81ff-80edafafacee admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:02.991951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639c249-5acb-47a1-be5c-31bddcad91c9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:03.000792 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3937/7915] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:02 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:03.004828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639c249-5acb-47a1-be5c-31bddcad91c9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:03.162743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca26ca-86df-4502-bb27-5d3ef9977053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:03.164060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca26ca-86df-4502-bb27-5d3ef9977053 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:03.164497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca26ca-86df-4502-bb27-5d3ef9977053 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:03.165076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca26ca-86df-4502-bb27-5d3ef9977053 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:03.165605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca26ca-86df-4502-bb27-5d3ef9977053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:03.170532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca26ca-86df-4502-bb27-5d3ef9977053 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:03.235467 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3979/7916] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:02 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:03.239836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f4132-a8a1-4b11-81ff-80edafafacee admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:03.256940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f4132-a8a1-4b11-81ff-80edafafacee admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:03.271422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03b542-00ed-47b2-8244-c3ed1a9ed640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:03.272618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b542-00ed-47b2-8244-c3ed1a9ed640 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:03.273686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b542-00ed-47b2-8244-c3ed1a9ed640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:03.274213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03b542-00ed-47b2-8244-c3ed1a9ed640 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:03.280016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03b542-00ed-47b2-8244-c3ed1a9ed640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:03.282161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03b542-00ed-47b2-8244-c3ed1a9ed640 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:03.313488 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3938/7917] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:03.317360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca26ca-86df-4502-bb27-5d3ef9977053 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:03.336263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca26ca-86df-4502-bb27-5d3ef9977053 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:03.350072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8be7d2-7c90-4620-a62a-122e228d5a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:03.350712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8be7d2-7c90-4620-a62a-122e228d5a6d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:03.351430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8be7d2-7c90-4620-a62a-122e228d5a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:03.351708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8be7d2-7c90-4620-a62a-122e228d5a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:03.352364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8be7d2-7c90-4620-a62a-122e228d5a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:03.354094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8be7d2-7c90-4620-a62a-122e228d5a6d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:03.390083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03b542-00ed-47b2-8244-c3ed1a9ed640 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:03.396043 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3980/7918] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:03.407871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03b542-00ed-47b2-8244-c3ed1a9ed640 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:03.420263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345813b-3e3f-4687-8aa2-b17836e589e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:03.421076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345813b-3e3f-4687-8aa2-b17836e589e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:03.421620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345813b-3e3f-4687-8aa2-b17836e589e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:03.422048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345813b-3e3f-4687-8aa2-b17836e589e7 admin admin] PATH_INFO: `/v3/projects/d8c6b290711241a3a58ca8a30b4f766a/users/edd501ed5af345a99d8cce122e7df29b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:03.448236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345813b-3e3f-4687-8aa2-b17836e589e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c6b290711241a3a58ca8a30b4f766a, user_id=edd501ed5af345a99d8cce122e7df29b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:03.451106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345813b-3e3f-4687-8aa2-b17836e589e7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:03.480125 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3939/7919] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:03 2022] PUT /identity/v3/projects/d8c6b290711241a3a58ca8a30b4f766a/users/edd501ed5af345a99d8cce122e7df29b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:03.491125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02026-e5f5-43d3-9c01-67ade24abc97 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:03.491510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02026-e5f5-43d3-9c01-67ade24abc97 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:03.494157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02026-e5f5-43d3-9c01-67ade24abc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:03.585255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-23c02026-e5f5-43d3-9c01-67ade24abc97 None None] MFA Rules not processed for user `edd501ed5af345a99d8cce122e7df29b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:03.585255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-23c02026-e5f5-43d3-9c01-67ade24abc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:03.715487 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3981/7920] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:03.720142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345813b-3e3f-4687-8aa2-b17836e589e7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:03.837382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345813b-3e3f-4687-8aa2-b17836e589e7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:03.843334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e619b0-7a28-41b5-ba2c-59ba84dc6a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:03.843707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e619b0-7a28-41b5-ba2c-59ba84dc6a17 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:03.844222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e619b0-7a28-41b5-ba2c-59ba84dc6a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:03.844222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e619b0-7a28-41b5-ba2c-59ba84dc6a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:03.844800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e619b0-7a28-41b5-ba2c-59ba84dc6a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:03.846892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e619b0-7a28-41b5-ba2c-59ba84dc6a17 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:03.885699 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3940/7921] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:03 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:03.890173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02026-e5f5-43d3-9c01-67ade24abc97 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:03.912842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02026-e5f5-43d3-9c01-67ade24abc97 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:04.044922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:04.055449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aba4ad-77d8-463f-8cec-16d36f664d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:04.056204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aba4ad-77d8-463f-8cec-16d36f664d6c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:04.057183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aba4ad-77d8-463f-8cec-16d36f664d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:04.057529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aba4ad-77d8-463f-8cec-16d36f664d6c admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:04.058215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aba4ad-77d8-463f-8cec-16d36f664d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:04.060185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aba4ad-77d8-463f-8cec-16d36f664d6c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:04.090189 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3982/7922] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:03 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:04.097701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e619b0-7a28-41b5-ba2c-59ba84dc6a17 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:04.107687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e619b0-7a28-41b5-ba2c-59ba84dc6a17 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:04.112505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096c41d-0f17-4228-90c8-e3e79395c38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:04.113201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c41d-0f17-4228-90c8-e3e79395c38b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:04.113544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c41d-0f17-4228-90c8-e3e79395c38b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:04.115823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096c41d-0f17-4228-90c8-e3e79395c38b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:04.115823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096c41d-0f17-4228-90c8-e3e79395c38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:04.119685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096c41d-0f17-4228-90c8-e3e79395c38b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:04.136407 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3941/7923] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:04.142445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aba4ad-77d8-463f-8cec-16d36f664d6c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:04.165515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aba4ad-77d8-463f-8cec-16d36f664d6c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:04.176922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a5c36-9485-43a4-b3bd-9e03f549e68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:04.177966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a5c36-9485-43a4-b3bd-9e03f549e68b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:04.178500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a5c36-9485-43a4-b3bd-9e03f549e68b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:04.178964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a5c36-9485-43a4-b3bd-9e03f549e68b admin admin] PATH_INFO: `/v3/projects/b56896db9a7b40f0a36ff5d50cc7fd11/users/b8ce3a4091d1402da6b5405d564a3ad1/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:04.219194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a5c36-9485-43a4-b3bd-9e03f549e68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56896db9a7b40f0a36ff5d50cc7fd11, user_id=b8ce3a4091d1402da6b5405d564a3ad1, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:04.228581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a5c36-9485-43a4-b3bd-9e03f549e68b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:04.251532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096c41d-0f17-4228-90c8-e3e79395c38b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:04.252316 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3983/7924] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:04 2022] PUT /identity/v3/projects/b56896db9a7b40f0a36ff5d50cc7fd11/users/b8ce3a4091d1402da6b5405d564a3ad1/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:04.263413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096c41d-0f17-4228-90c8-e3e79395c38b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:04.355893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cf8f9-8205-425a-a701-ef9668962d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:04.357310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cf8f9-8205-425a-a701-ef9668962d56 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:04.357752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cf8f9-8205-425a-a701-ef9668962d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:04.358214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cf8f9-8205-425a-a701-ef9668962d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:04.359054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cf8f9-8205-425a-a701-ef9668962d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:04.361349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cf8f9-8205-425a-a701-ef9668962d56 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:04.384493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a5c36-9485-43a4-b3bd-9e03f549e68b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:04.385461 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3942/7925] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:04.411440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a5c36-9485-43a4-b3bd-9e03f549e68b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:04.418197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df23ab7-b201-4b5f-9976-912c5d83571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:04.419116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df23ab7-b201-4b5f-9976-912c5d83571c admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:04.419226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df23ab7-b201-4b5f-9976-912c5d83571c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:04.419461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df23ab7-b201-4b5f-9976-912c5d83571c admin admin] PATH_INFO: `/v3/projects/b56896db9a7b40f0a36ff5d50cc7fd11/users/b8ce3a4091d1402da6b5405d564a3ad1/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:04.421538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df23ab7-b201-4b5f-9976-912c5d83571c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b56896db9a7b40f0a36ff5d50cc7fd11, user_id=b8ce3a4091d1402da6b5405d564a3ad1, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:04.424947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df23ab7-b201-4b5f-9976-912c5d83571c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:04.444759 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3984/7926] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:04 2022] PUT /identity/v3/projects/b56896db9a7b40f0a36ff5d50cc7fd11/users/b8ce3a4091d1402da6b5405d564a3ad1/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:04.452553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e826fc-f62c-4413-8389-91ac06ca5761 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:04.452868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e826fc-f62c-4413-8389-91ac06ca5761 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:04.453112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e826fc-f62c-4413-8389-91ac06ca5761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:04.496625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b7e826fc-f62c-4413-8389-91ac06ca5761 None None] MFA Rules not processed for user `b8ce3a4091d1402da6b5405d564a3ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:04.500830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b7e826fc-f62c-4413-8389-91ac06ca5761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:04.505746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:04.582128 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3943/7927] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:04.598881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df23ab7-b201-4b5f-9976-912c5d83571c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:04.600740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0df23ab7-b201-4b5f-9976-912c5d83571c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:04.704364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df23ab7-b201-4b5f-9976-912c5d83571c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:04.708366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f7460-b684-4072-b896-858856f76398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:04.709375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f7460-b684-4072-b896-858856f76398 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:04.709726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f7460-b684-4072-b896-858856f76398 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:04.710363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f7460-b684-4072-b896-858856f76398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:04.792886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f7460-b684-4072-b896-858856f76398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:04.794534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f7460-b684-4072-b896-858856f76398 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:04.805551 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3985/7928] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:07.670775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e826fc-f62c-4413-8389-91ac06ca5761 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:07.695103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e826fc-f62c-4413-8389-91ac06ca5761 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:07.702505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aa623-82cf-4ceb-ad75-46dfb0be00aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:07.703144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aa623-82cf-4ceb-ad75-46dfb0be00aa service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:07.703426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aa623-82cf-4ceb-ad75-46dfb0be00aa service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:07.703693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aa623-82cf-4ceb-ad75-46dfb0be00aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:07.726683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724aa623-82cf-4ceb-ad75-46dfb0be00aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:07.730847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724aa623-82cf-4ceb-ad75-46dfb0be00aa service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:07.759306 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3944/7929] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:08.905723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f7460-b684-4072-b896-858856f76398 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:08.907760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9c1f7460-b684-4072-b896-858856f76398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:09.025929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f7460-b684-4072-b896-858856f76398 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:09.031999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:09.033049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:09.033494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:09.033963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] PATH_INFO: `/v3/users/17fa25bae5af4ce9883ffd983e9186a2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:09.035285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fa25bae5af4ce9883ffd983e9186a2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:09.037541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:09.039969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:09.160386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fa25bae5af4ce9883ffd983e9186a2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:09.164232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fa25bae5af4ce9883ffd983e9186a2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:09.179486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fa25bae5af4ce9883ffd983e9186a2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:09.201166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fa25bae5af4ce9883ffd983e9186a2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:09.224062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fa25bae5af4ce9883ffd983e9186a2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:09.246871 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3986/7930] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:51:08 2022] DELETE /identity/v3/users/17fa25bae5af4ce9883ffd983e9186a2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:09.251252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f92507-0f75-4cd1-9a98-dd1b0520b639 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:09.251777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f92507-0f75-4cd1-9a98-dd1b0520b639 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:09.252124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f92507-0f75-4cd1-9a98-dd1b0520b639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:09.284651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-24f92507-0f75-4cd1-9a98-dd1b0520b639 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:09.286330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24f92507-0f75-4cd1-9a98-dd1b0520b639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:09.435996 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3945/7931] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:09.447720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:09.449358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:09.584740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb2604-1738-4788-bf7f-df5e033429d0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:09.602565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7baa-c867-431f-9667-085286adc3c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:09.605997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7baa-c867-431f-9667-085286adc3c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:09.607646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7baa-c867-431f-9667-085286adc3c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:09.611510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7baa-c867-431f-9667-085286adc3c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:09.665961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c7baa-c867-431f-9667-085286adc3c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:09.668918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c7baa-c867-431f-9667-085286adc3c3 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:09.710114 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3987/7932] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:10.418900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f92507-0f75-4cd1-9a98-dd1b0520b639 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:10.420473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24f92507-0f75-4cd1-9a98-dd1b0520b639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:10.456381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f92507-0f75-4cd1-9a98-dd1b0520b639 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:10.483113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:10.503631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:10.508102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:10.508102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] PATH_INFO: `/v3/projects/4a9e289795dc4e7ea81a32907ead30fa` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:10.515492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9e289795dc4e7ea81a32907ead30fa)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:10.515492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:10.676912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9e289795dc4e7ea81a32907ead30fa', 'request_id': 'req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:10.698787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9e289795dc4e7ea81a32907ead30fa', 'request_id': 'req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:10.706141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9e289795dc4e7ea81a32907ead30fa', 'request_id': 'req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:10.729904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] The token cache is being invalidate because project 4a9e289795dc4e7ea81a32907ead30fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:10.730361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:10.742440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:10.744247 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3946/7933] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:10 2022] DELETE /identity/v3/projects/4a9e289795dc4e7ea81a32907ead30fa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:10.748289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7baa-c867-431f-9667-085286adc3c3 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:10.763289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7baa-c867-431f-9667-085286adc3c3 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:10.840157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:10.841925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:10.886712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:10.897216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:10.898813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:10.899093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:10.899366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] PATH_INFO: `/v3/users/98382c92d15c4f5fb8dfb8d4e0dae380` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:10.903818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=98382c92d15c4f5fb8dfb8d4e0dae380)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:10.906150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:10.958583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:11.011719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98382c92d15c4f5fb8dfb8d4e0dae380'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.012687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98382c92d15c4f5fb8dfb8d4e0dae380'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.033635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d7b9c-1bf8-41eb-8bae-2e4ee2c2ca98 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:11.035187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98382c92d15c4f5fb8dfb8d4e0dae380'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.039887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:11.041095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:11.041695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:11.042387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] PATH_INFO: `/v3/users/613234db3d184ce68ba08339f64a75b5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:11.046480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98382c92d15c4f5fb8dfb8d4e0dae380'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.046987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=613234db3d184ce68ba08339f64a75b5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:11.049552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:11.070240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c477d9dd-70f2-4573-b975-c2e6ad5414ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98382c92d15c4f5fb8dfb8d4e0dae380'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.082651 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3988/7934] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:51:10 2022] DELETE /identity/v3/users/98382c92d15c4f5fb8dfb8d4e0dae380 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:11.164389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '613234db3d184ce68ba08339f64a75b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.192135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '613234db3d184ce68ba08339f64a75b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.222804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '613234db3d184ce68ba08339f64a75b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.243164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '613234db3d184ce68ba08339f64a75b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.244126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '613234db3d184ce68ba08339f64a75b5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.251055 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3947/7935] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:51:10 2022] DELETE /identity/v3/users/613234db3d184ce68ba08339f64a75b5 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:51:11.256428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591face2-b6d9-4f54-a572-bd1da7f0c344 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:11.256720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591face2-b6d9-4f54-a572-bd1da7f0c344 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:11.257008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591face2-b6d9-4f54-a572-bd1da7f0c344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:11.293746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-591face2-b6d9-4f54-a572-bd1da7f0c344 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:11.296747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-591face2-b6d9-4f54-a572-bd1da7f0c344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:11.382400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:11.384163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:11.437261 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3989/7936] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:11.447970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591face2-b6d9-4f54-a572-bd1da7f0c344 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:11.449417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-591face2-b6d9-4f54-a572-bd1da7f0c344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:11.547383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44213d-95ed-4272-9b6f-a7a2a4a0b9d2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:11.560378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:11.561700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:11.562014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:11.562289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] PATH_INFO: `/v3/projects/b0752f121cae4149957369c1af6ae1f5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:11.565257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0752f121cae4149957369c1af6ae1f5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:11.570030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:11.593821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591face2-b6d9-4f54-a572-bd1da7f0c344 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:11.604061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4af778-cb9e-41b4-b445-f4d32b1b3438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:11.604757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4af778-cb9e-41b4-b445-f4d32b1b3438 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:11.605036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4af778-cb9e-41b4-b445-f4d32b1b3438 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:11.605306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4af778-cb9e-41b4-b445-f4d32b1b3438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:11.623394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4af778-cb9e-41b4-b445-f4d32b1b3438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:11.626577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4af778-cb9e-41b4-b445-f4d32b1b3438 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:11.649845 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3990/7937] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:51:11.672604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:11.707736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0752f121cae4149957369c1af6ae1f5', 'request_id': 'req-e6c5ff8a-884a-4ae2-a038-eeee902713b4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.727706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0752f121cae4149957369c1af6ae1f5', 'request_id': 'req-e6c5ff8a-884a-4ae2-a038-eeee902713b4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.737910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0752f121cae4149957369c1af6ae1f5', 'request_id': 'req-e6c5ff8a-884a-4ae2-a038-eeee902713b4'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.792711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] The token cache is being invalidate because project b0752f121cae4149957369c1af6ae1f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:11.793072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.797326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e6c5ff8a-884a-4ae2-a038-eeee902713b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:11.807741 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3948/7938] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:11 2022] DELETE /identity/v3/projects/b0752f121cae4149957369c1af6ae1f5 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:11.809503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12fd9a-9379-4b9c-bc48-052a683e6e60 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:11.809994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12fd9a-9379-4b9c-bc48-052a683e6e60 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:11.810097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12fd9a-9379-4b9c-bc48-052a683e6e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:11.846098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9d12fd9a-9379-4b9c-bc48-052a683e6e60 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:11.847504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9d12fd9a-9379-4b9c-bc48-052a683e6e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:11.931739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:11.981971 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3991/7939] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:11.989860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a03c65-2ff3-4d83-9a19-57765eaea5d4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:11.990078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a03c65-2ff3-4d83-9a19-57765eaea5d4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:11.990337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a03c65-2ff3-4d83-9a19-57765eaea5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:12.031631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-21a03c65-2ff3-4d83-9a19-57765eaea5d4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:12.043440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-21a03c65-2ff3-4d83-9a19-57765eaea5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:12.055226 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3949/7940] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:12.056279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12fd9a-9379-4b9c-bc48-052a683e6e60 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:12.073606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12fd9a-9379-4b9c-bc48-052a683e6e60 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:12.088500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197053ce-6d00-4e05-852d-395797151426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:12.089549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197053ce-6d00-4e05-852d-395797151426 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:12.090102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197053ce-6d00-4e05-852d-395797151426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:12.090540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197053ce-6d00-4e05-852d-395797151426 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:12.091595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197053ce-6d00-4e05-852d-395797151426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:51:12.092435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197053ce-6d00-4e05-852d-395797151426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:12.101083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197053ce-6d00-4e05-852d-395797151426 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:12.140437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a03c65-2ff3-4d83-9a19-57765eaea5d4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:12.151492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a03c65-2ff3-4d83-9a19-57765eaea5d4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:12.152380 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3992/7941] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:51:12.160401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df89e2-b7b2-4df1-9588-76d3e14e5795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:12.161030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df89e2-b7b2-4df1-9588-76d3e14e5795 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:12.161311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df89e2-b7b2-4df1-9588-76d3e14e5795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:12.161582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df89e2-b7b2-4df1-9588-76d3e14e5795 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:12.162254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df89e2-b7b2-4df1-9588-76d3e14e5795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:12.164218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df89e2-b7b2-4df1-9588-76d3e14e5795 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:12.226959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197053ce-6d00-4e05-852d-395797151426 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:12.234335 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3950/7942] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:12 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:51:12.264251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197053ce-6d00-4e05-852d-395797151426 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:12.359252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df89e2-b7b2-4df1-9588-76d3e14e5795 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:12.360784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-44df89e2-b7b2-4df1-9588-76d3e14e5795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:12.434171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f30dc-150b-4aac-b65c-9d812c545836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:12.435620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f30dc-150b-4aac-b65c-9d812c545836 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:12.437688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f30dc-150b-4aac-b65c-9d812c545836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:12.438068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f30dc-150b-4aac-b65c-9d812c545836 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:12.438807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f30dc-150b-4aac-b65c-9d812c545836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:12.442886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f30dc-150b-4aac-b65c-9d812c545836 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:12.495919 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3993/7943] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:12 2022] POST /identity/v3/users => generated 284 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:51:12.498344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f30dc-150b-4aac-b65c-9d812c545836 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:12.519470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f30dc-150b-4aac-b65c-9d812c545836 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:12.530431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe844812-7731-4571-b6d3-86c7321ed910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:12.532508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df89e2-b7b2-4df1-9588-76d3e14e5795 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:12.533166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe844812-7731-4571-b6d3-86c7321ed910 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:12.533505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe844812-7731-4571-b6d3-86c7321ed910 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:12.533845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe844812-7731-4571-b6d3-86c7321ed910 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:12.535281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe844812-7731-4571-b6d3-86c7321ed910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:12.538851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe844812-7731-4571-b6d3-86c7321ed910 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:12.543062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:12.544045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:12.545369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:12.548854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] PATH_INFO: `/v3/projects/923ca69f4a494dca90be3b19de79ae29` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:12.551722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923ca69f4a494dca90be3b19de79ae29)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:12.554135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:12.562741 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3994/7944] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:12.569422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe844812-7731-4571-b6d3-86c7321ed910 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:12.587076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe844812-7731-4571-b6d3-86c7321ed910 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:12.602651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abd754-ae0c-4369-8b39-c084fca6599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:12.605073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abd754-ae0c-4369-8b39-c084fca6599c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:12.605417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abd754-ae0c-4369-8b39-c084fca6599c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:12.605779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abd754-ae0c-4369-8b39-c084fca6599c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:12.607354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abd754-ae0c-4369-8b39-c084fca6599c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:12.612297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abd754-ae0c-4369-8b39-c084fca6599c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:12.649169 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3995/7945] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:12.662889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abd754-ae0c-4369-8b39-c084fca6599c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:12.687353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923ca69f4a494dca90be3b19de79ae29', 'request_id': 'req-51ee7e58-4603-4a22-9991-96a977cf9387'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:12.690754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abd754-ae0c-4369-8b39-c084fca6599c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:12.706817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923ca69f4a494dca90be3b19de79ae29', 'request_id': 'req-51ee7e58-4603-4a22-9991-96a977cf9387'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:12.717086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923ca69f4a494dca90be3b19de79ae29', 'request_id': 'req-51ee7e58-4603-4a22-9991-96a977cf9387'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:12.735081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] The token cache is being invalidate because project 923ca69f4a494dca90be3b19de79ae29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:12.735469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:12.736084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-51ee7e58-4603-4a22-9991-96a977cf9387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:12.737927 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3951/7946] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:12 2022] DELETE /identity/v3/projects/923ca69f4a494dca90be3b19de79ae29 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:12.743308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2ef21-777b-49b2-b83a-7ed832564101 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:12.743597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2ef21-777b-49b2-b83a-7ed832564101 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:12.743992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2ef21-777b-49b2-b83a-7ed832564101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:12.792212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-64e2ef21-777b-49b2-b83a-7ed832564101 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:12.794730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-64e2ef21-777b-49b2-b83a-7ed832564101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:12.847127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:12.940310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8f793-fcb9-47ff-968b-77731158bcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:12.941009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8f793-fcb9-47ff-968b-77731158bcda admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:12.941283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8f793-fcb9-47ff-968b-77731158bcda admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:12.941549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8f793-fcb9-47ff-968b-77731158bcda admin admin] PATH_INFO: `/v3/projects/9b263fef3ef3462d8ee98d2eb048b406/users/d98ace2d706c4a40b7aad280e153f2ac/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:13.004770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8f793-fcb9-47ff-968b-77731158bcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b263fef3ef3462d8ee98d2eb048b406, user_id=d98ace2d706c4a40b7aad280e153f2ac, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:13.007490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8f793-fcb9-47ff-968b-77731158bcda admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:13.020444 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3952/7947] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:51:13.029487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7de6f-ed42-4d6d-a583-85f1885f514b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:13.029769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7de6f-ed42-4d6d-a583-85f1885f514b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:13.030062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7de6f-ed42-4d6d-a583-85f1885f514b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:13.062676 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3996/7948] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:12 2022] PUT /identity/v3/projects/9b263fef3ef3462d8ee98d2eb048b406/users/d98ace2d706c4a40b7aad280e153f2ac/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:13.076834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606accd1-2845-49f2-989a-34585d58afe6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:13.077337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606accd1-2845-49f2-989a-34585d58afe6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:13.077777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606accd1-2845-49f2-989a-34585d58afe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:13.095584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-19d7de6f-ed42-4d6d-a583-85f1885f514b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:13.096799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-19d7de6f-ed42-4d6d-a583-85f1885f514b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:13.165387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-606accd1-2845-49f2-989a-34585d58afe6 None None] MFA Rules not processed for user `d98ace2d706c4a40b7aad280e153f2ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:13.196327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-606accd1-2845-49f2-989a-34585d58afe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:13.241012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:13.292243 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3953/7949] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:13.300869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7de6f-ed42-4d6d-a583-85f1885f514b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:13.322443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7de6f-ed42-4d6d-a583-85f1885f514b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:13.330227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0320df-b159-428a-b530-0533e8f20623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:13.331202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0320df-b159-428a-b530-0533e8f20623 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:13.331571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0320df-b159-428a-b530-0533e8f20623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:13.331970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0320df-b159-428a-b530-0533e8f20623 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:13.332847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0320df-b159-428a-b530-0533e8f20623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:51:13.333369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0320df-b159-428a-b530-0533e8f20623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:13.335788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0320df-b159-428a-b530-0533e8f20623 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:13.354834 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3954/7950] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:51:13.359101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0320df-b159-428a-b530-0533e8f20623 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:13.383515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0320df-b159-428a-b530-0533e8f20623 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:13.401447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd3138-2ca5-4ab0-b35f-4d58b9a78d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:13.402103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3138-2ca5-4ab0-b35f-4d58b9a78d16 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:13.402562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3138-2ca5-4ab0-b35f-4d58b9a78d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:13.402829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd3138-2ca5-4ab0-b35f-4d58b9a78d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:13.403490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd3138-2ca5-4ab0-b35f-4d58b9a78d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:13.406196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd3138-2ca5-4ab0-b35f-4d58b9a78d16 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:13.430622 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3997/7951] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:13.441781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606accd1-2845-49f2-989a-34585d58afe6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:13.444386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-606accd1-2845-49f2-989a-34585d58afe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:13.448056 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3955/7952] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:13 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:51:13.453975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd3138-2ca5-4ab0-b35f-4d58b9a78d16 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:13.593140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606accd1-2845-49f2-989a-34585d58afe6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:13.607880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd3138-2ca5-4ab0-b35f-4d58b9a78d16 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:13.619432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea9214-5a1c-4eb7-bf28-a63d45a7e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:13.620314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea9214-5a1c-4eb7-bf28-a63d45a7e8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:13.621590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea9214-5a1c-4eb7-bf28-a63d45a7e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:13.622229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea9214-5a1c-4eb7-bf28-a63d45a7e8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:13.626472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea9214-5a1c-4eb7-bf28-a63d45a7e8d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:13.628544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea9214-5a1c-4eb7-bf28-a63d45a7e8d6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:13.689157 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3956/7953] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:13 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:13.706015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea9214-5a1c-4eb7-bf28-a63d45a7e8d6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:13.713268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ceb2-5907-4a4f-8882-63fa3967c806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:13.713823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ceb2-5907-4a4f-8882-63fa3967c806 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:13.714134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ceb2-5907-4a4f-8882-63fa3967c806 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:13.714401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ceb2-5907-4a4f-8882-63fa3967c806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:13.736271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea9214-5a1c-4eb7-bf28-a63d45a7e8d6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:13.743242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422347ad-a269-420d-a156-1980e400ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:13.745094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422347ad-a269-420d-a156-1980e400ba6a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:13.745905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422347ad-a269-420d-a156-1980e400ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:13.746428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422347ad-a269-420d-a156-1980e400ba6a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:13.747564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422347ad-a269-420d-a156-1980e400ba6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:13.749667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422347ad-a269-420d-a156-1980e400ba6a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:13.766056 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3957/7954] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:13.767211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422347ad-a269-420d-a156-1980e400ba6a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:13.816282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422347ad-a269-420d-a156-1980e400ba6a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:13.824716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f4dcaf-51eb-49ec-a4d7-681592451350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:13.825571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4dcaf-51eb-49ec-a4d7-681592451350 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:13.826054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4dcaf-51eb-49ec-a4d7-681592451350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:13.826482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4dcaf-51eb-49ec-a4d7-681592451350 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:13.827375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4dcaf-51eb-49ec-a4d7-681592451350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:13.827869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037ceb2-5907-4a4f-8882-63fa3967c806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:13.829584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037ceb2-5907-4a4f-8882-63fa3967c806 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:13.830366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f4dcaf-51eb-49ec-a4d7-681592451350 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:13.832305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:13.843787 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3998/7955] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:14.164598 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3958/7956] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:14.168986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ceb2-5907-4a4f-8882-63fa3967c806 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:14.184410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ceb2-5907-4a4f-8882-63fa3967c806 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:14.192024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d47abf-38de-4547-8038-78173193a1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:14.192900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d47abf-38de-4547-8038-78173193a1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:14.193256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d47abf-38de-4547-8038-78173193a1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:14.193597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d47abf-38de-4547-8038-78173193a1fd admin admin] PATH_INFO: `/v3/projects/bbbce923e1ea4fc9b1e528241cb16d0e/users/dfbbe60c10ee4f8d8fd85208b77bbfc4/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:14.225724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d47abf-38de-4547-8038-78173193a1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbce923e1ea4fc9b1e528241cb16d0e, user_id=dfbbe60c10ee4f8d8fd85208b77bbfc4, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:14.229425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d47abf-38de-4547-8038-78173193a1fd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:14.247708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:14.255559 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 3999/7957] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:14 2022] PUT /identity/v3/projects/bbbce923e1ea4fc9b1e528241cb16d0e/users/dfbbe60c10ee4f8d8fd85208b77bbfc4/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:14.260702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552dd9-290b-482b-b1b7-222d52d771ff None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:14.260984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552dd9-290b-482b-b1b7-222d52d771ff None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:14.261344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e552dd9-290b-482b-b1b7-222d52d771ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:14.297223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1e552dd9-290b-482b-b1b7-222d52d771ff None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:14.299501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1e552dd9-290b-482b-b1b7-222d52d771ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:14.478088 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3959/7958] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:14.488604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d47abf-38de-4547-8038-78173193a1fd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:14.625563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d47abf-38de-4547-8038-78173193a1fd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:14.642814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae68679-900c-44b6-b46f-6eef2d19d1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:14.645303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae68679-900c-44b6-b46f-6eef2d19d1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:14.645655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae68679-900c-44b6-b46f-6eef2d19d1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:14.653389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae68679-900c-44b6-b46f-6eef2d19d1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:14.671172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae68679-900c-44b6-b46f-6eef2d19d1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:14.672769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae68679-900c-44b6-b46f-6eef2d19d1e5 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:14.709279 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4000/7959] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:17.923396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e552dd9-290b-482b-b1b7-222d52d771ff None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:17.925188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1e552dd9-290b-482b-b1b7-222d52d771ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:17.957418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e552dd9-290b-482b-b1b7-222d52d771ff None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:17.986275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:17.987046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:17.987326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:17.987615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] PATH_INFO: `/v3/users/8b614e3b45bb4e81afd8905e2228d9f3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:18.005109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b614e3b45bb4e81afd8905e2228d9f3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:18.013685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:18.196407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b614e3b45bb4e81afd8905e2228d9f3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:18.221456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b614e3b45bb4e81afd8905e2228d9f3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:18.251597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b614e3b45bb4e81afd8905e2228d9f3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:18.267895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b614e3b45bb4e81afd8905e2228d9f3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:18.268644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b614e3b45bb4e81afd8905e2228d9f3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:18.291909 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3960/7960] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:51:17 2022] DELETE /identity/v3/users/8b614e3b45bb4e81afd8905e2228d9f3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:18.296366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c42a-cdd9-449d-8a05-67b173edbfc3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:18.296938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c42a-cdd9-449d-8a05-67b173edbfc3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:18.296938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c42a-cdd9-449d-8a05-67b173edbfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:18.348578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b700c42a-cdd9-449d-8a05-67b173edbfc3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:18.352158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b700c42a-cdd9-449d-8a05-67b173edbfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:18.517296 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4001/7961] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:51:18.548205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:18.549776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:18.742963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f72e005-0517-43ae-8ef7-db43319a20b4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:18.746910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288bd72-53bb-4955-a580-7863239f7aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:18.747860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288bd72-53bb-4955-a580-7863239f7aad service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:18.748236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288bd72-53bb-4955-a580-7863239f7aad service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:18.748597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288bd72-53bb-4955-a580-7863239f7aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:18.772958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288bd72-53bb-4955-a580-7863239f7aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:18.774640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2288bd72-53bb-4955-a580-7863239f7aad service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:18.798337 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3961/7962] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:20.455116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c42a-cdd9-449d-8a05-67b173edbfc3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:20.456757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b700c42a-cdd9-449d-8a05-67b173edbfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:20.493773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c42a-cdd9-449d-8a05-67b173edbfc3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:20.511601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:20.512297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:20.512581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:20.512856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] PATH_INFO: `/v3/users/edd501ed5af345a99d8cce122e7df29b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:20.515606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd501ed5af345a99d8cce122e7df29b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:20.518340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:20.699667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd501ed5af345a99d8cce122e7df29b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:20.700441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd501ed5af345a99d8cce122e7df29b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:20.719324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd501ed5af345a99d8cce122e7df29b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:20.744738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd501ed5af345a99d8cce122e7df29b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:20.773101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd501ed5af345a99d8cce122e7df29b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:20.805759 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4002/7963] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:51:20 2022] DELETE /identity/v3/users/edd501ed5af345a99d8cce122e7df29b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:51:20.810283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44ed56-3e25-4785-a852-048d2064ba8d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:20.810822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44ed56-3e25-4785-a852-048d2064ba8d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:20.810822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44ed56-3e25-4785-a852-048d2064ba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:20.859955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2c44ed56-3e25-4785-a852-048d2064ba8d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:20.860353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:20.863243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:20.871549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2c44ed56-3e25-4785-a852-048d2064ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:20.891403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:20.919089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:21.028696 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3962/7964] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:21.055996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44ed56-3e25-4785-a852-048d2064ba8d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:21.058185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2c44ed56-3e25-4785-a852-048d2064ba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:21.063889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7546dae-0e0e-41d0-b946-51431c9d9786 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:21.083691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:21.084364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:21.084641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:21.084915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] PATH_INFO: `/v3/projects/bcdb8eb979be43528d3996d9115a3a43` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:21.103008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdb8eb979be43528d3996d9115a3a43)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:21.105670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:21.193952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44ed56-3e25-4785-a852-048d2064ba8d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:21.216270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261161f-2321-4eb2-bab2-07d486329b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:21.216905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261161f-2321-4eb2-bab2-07d486329b38 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:21.217179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261161f-2321-4eb2-bab2-07d486329b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:21.217447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261161f-2321-4eb2-bab2-07d486329b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:21.251944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261161f-2321-4eb2-bab2-07d486329b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:21.257144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6261161f-2321-4eb2-bab2-07d486329b38 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:21.265647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdb8eb979be43528d3996d9115a3a43', 'request_id': 'req-4baa649e-163a-4ecc-980c-5ff416b1b2c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:21.275479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdb8eb979be43528d3996d9115a3a43', 'request_id': 'req-4baa649e-163a-4ecc-980c-5ff416b1b2c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:21.287518 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3963/7965] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:21.297903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdb8eb979be43528d3996d9115a3a43', 'request_id': 'req-4baa649e-163a-4ecc-980c-5ff416b1b2c5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:21.311808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] The token cache is being invalidate because project bcdb8eb979be43528d3996d9115a3a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:21.312203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:21.313020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4baa649e-163a-4ecc-980c-5ff416b1b2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:21.315035 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4003/7966] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:20 2022] DELETE /identity/v3/projects/bcdb8eb979be43528d3996d9115a3a43 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:21.326032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845902df-fbd2-449b-9924-bfd31b6cbe72 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:21.326703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845902df-fbd2-449b-9924-bfd31b6cbe72 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:21.327182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845902df-fbd2-449b-9924-bfd31b6cbe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:21.387103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-845902df-fbd2-449b-9924-bfd31b6cbe72 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:21.388664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-845902df-fbd2-449b-9924-bfd31b6cbe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:21.545131 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3964/7967] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:21.546671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef3bd2-bda8-434f-b429-6af13bddb1f7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:21.546671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef3bd2-bda8-434f-b429-6af13bddb1f7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:21.547690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef3bd2-bda8-434f-b429-6af13bddb1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:21.608016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-53ef3bd2-bda8-434f-b429-6af13bddb1f7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:21.609419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-53ef3bd2-bda8-434f-b429-6af13bddb1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:21.690436 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4004/7968] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:51:21.691437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845902df-fbd2-449b-9924-bfd31b6cbe72 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:21.705330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845902df-fbd2-449b-9924-bfd31b6cbe72 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:21.733375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e8d18-25cc-47c2-8bb6-b5999689f11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:21.734065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e8d18-25cc-47c2-8bb6-b5999689f11a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:21.736225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e8d18-25cc-47c2-8bb6-b5999689f11a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:21.736518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e8d18-25cc-47c2-8bb6-b5999689f11a admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:21.740626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e8d18-25cc-47c2-8bb6-b5999689f11a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:51:21.740989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e8d18-25cc-47c2-8bb6-b5999689f11a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:21.744473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e8d18-25cc-47c2-8bb6-b5999689f11a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:21.780753 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3965/7969] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:51:21.785029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef3bd2-bda8-434f-b429-6af13bddb1f7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:21.807253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef3bd2-bda8-434f-b429-6af13bddb1f7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:21.827559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7993879-56a0-4841-b951-c1c1a03fa2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:21.828585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7993879-56a0-4841-b951-c1c1a03fa2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:21.829086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7993879-56a0-4841-b951-c1c1a03fa2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:21.829577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7993879-56a0-4841-b951-c1c1a03fa2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:21.830875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7993879-56a0-4841-b951-c1c1a03fa2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:21.836299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7993879-56a0-4841-b951-c1c1a03fa2e7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:21.928442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e8d18-25cc-47c2-8bb6-b5999689f11a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:21.930188 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4005/7970] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:21 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:21.949054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e8d18-25cc-47c2-8bb6-b5999689f11a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:22.115314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:22.247316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56138e2e-7ba9-419c-bf1d-3a5cacc506db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:22.263582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56138e2e-7ba9-419c-bf1d-3a5cacc506db admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:22.264462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56138e2e-7ba9-419c-bf1d-3a5cacc506db admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:22.264983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56138e2e-7ba9-419c-bf1d-3a5cacc506db admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:22.267281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56138e2e-7ba9-419c-bf1d-3a5cacc506db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:22.271865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56138e2e-7ba9-419c-bf1d-3a5cacc506db admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:22.335019 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3966/7971] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:21 2022] POST /identity/v3/users => generated 290 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:22.338497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7993879-56a0-4841-b951-c1c1a03fa2e7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:22.354704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7993879-56a0-4841-b951-c1c1a03fa2e7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:22.370206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8b574-2013-48ae-bf71-24d70f76767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:22.371139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8b574-2013-48ae-bf71-24d70f76767e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:22.371545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8b574-2013-48ae-bf71-24d70f76767e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:22.373365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8b574-2013-48ae-bf71-24d70f76767e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:22.373894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8b574-2013-48ae-bf71-24d70f76767e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:22.379648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8b574-2013-48ae-bf71-24d70f76767e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:22.402333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56138e2e-7ba9-419c-bf1d-3a5cacc506db admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:22.405722 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4006/7972] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:22.414863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56138e2e-7ba9-419c-bf1d-3a5cacc506db admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:22.440767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861b002-2387-4951-9e67-9d752d9de6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:22.441455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861b002-2387-4951-9e67-9d752d9de6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:22.441733 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861b002-2387-4951-9e67-9d752d9de6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:22.443251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861b002-2387-4951-9e67-9d752d9de6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:22.445144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861b002-2387-4951-9e67-9d752d9de6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:22.450562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861b002-2387-4951-9e67-9d752d9de6f9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:22.483280 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3967/7973] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:22.486925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8b574-2013-48ae-bf71-24d70f76767e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:22.498613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8b574-2013-48ae-bf71-24d70f76767e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:22.527177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7535ff5-f2a0-4707-9eb5-9ca763019cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:22.528043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7535ff5-f2a0-4707-9eb5-9ca763019cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:22.528444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7535ff5-f2a0-4707-9eb5-9ca763019cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:22.528820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7535ff5-f2a0-4707-9eb5-9ca763019cb9 admin admin] PATH_INFO: `/v3/projects/6be3717d6d9b4fe98b06dda885d558dd/users/9c86031fbd964a74873f5306aae03490/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:22.587162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7535ff5-f2a0-4707-9eb5-9ca763019cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be3717d6d9b4fe98b06dda885d558dd, user_id=9c86031fbd964a74873f5306aae03490, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:22.590266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7535ff5-f2a0-4707-9eb5-9ca763019cb9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:22.630658 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4007/7974] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:22 2022] PUT /identity/v3/projects/6be3717d6d9b4fe98b06dda885d558dd/users/9c86031fbd964a74873f5306aae03490/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:22.650414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dfe58-4481-41f7-b56f-841eb02892e5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:22.651005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dfe58-4481-41f7-b56f-841eb02892e5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:22.651518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471dfe58-4481-41f7-b56f-841eb02892e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:22.708228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-471dfe58-4481-41f7-b56f-841eb02892e5 None None] MFA Rules not processed for user `9c86031fbd964a74873f5306aae03490`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:22.709673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-471dfe58-4481-41f7-b56f-841eb02892e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:22.812072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7535ff5-f2a0-4707-9eb5-9ca763019cb9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:22.816793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b7535ff5-f2a0-4707-9eb5-9ca763019cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:22.917476 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3968/7975] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:22.930020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dfe58-4481-41f7-b56f-841eb02892e5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:22.932086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-471dfe58-4481-41f7-b56f-841eb02892e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:22.962642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:23.049144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7535ff5-f2a0-4707-9eb5-9ca763019cb9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:23.053687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471dfe58-4481-41f7-b56f-841eb02892e5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:23.062337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ec58c-b111-4a38-a64c-fc2ea3ec6263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:23.063131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ec58c-b111-4a38-a64c-fc2ea3ec6263 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:23.063562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ec58c-b111-4a38-a64c-fc2ea3ec6263 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:23.065775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ec58c-b111-4a38-a64c-fc2ea3ec6263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:23.073296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:23.074258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:23.075097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:23.078566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] PATH_INFO: `/v3/projects/d8c6b290711241a3a58ca8a30b4f766a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:23.082714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c6b290711241a3a58ca8a30b4f766a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:23.092824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:23.095470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ec58c-b111-4a38-a64c-fc2ea3ec6263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:23.097127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ec58c-b111-4a38-a64c-fc2ea3ec6263 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:23.123245 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3969/7976] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:51:23.309228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c6b290711241a3a58ca8a30b4f766a', 'request_id': 'req-60619899-c7ab-47de-a1ef-47dacf42fee0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:23.326963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c6b290711241a3a58ca8a30b4f766a', 'request_id': 'req-60619899-c7ab-47de-a1ef-47dacf42fee0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:23.355099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c6b290711241a3a58ca8a30b4f766a', 'request_id': 'req-60619899-c7ab-47de-a1ef-47dacf42fee0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:23.376010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] The token cache is being invalidate because project d8c6b290711241a3a58ca8a30b4f766a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:23.376010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:23.377403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:23.387527 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4008/7977] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:22 2022] DELETE /identity/v3/projects/d8c6b290711241a3a58ca8a30b4f766a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:51:23.388460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ec58c-b111-4a38-a64c-fc2ea3ec6263 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:23.407781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ec58c-b111-4a38-a64c-fc2ea3ec6263 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:23.688110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:23.736067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:23.739406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:23.743758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:23.745261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] PATH_INFO: `/v3/users/b8ce3a4091d1402da6b5405d564a3ad1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:23.752753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ce3a4091d1402da6b5405d564a3ad1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:23.762291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:23.910853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ce3a4091d1402da6b5405d564a3ad1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:23.952879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ce3a4091d1402da6b5405d564a3ad1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:24.026248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ce3a4091d1402da6b5405d564a3ad1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:24.068306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ce3a4091d1402da6b5405d564a3ad1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:24.068959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0ee7c49d-2b48-4a03-a7b0-c23608924f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ce3a4091d1402da6b5405d564a3ad1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:24.103923 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3970/7978] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:51:23 2022] DELETE /identity/v3/users/b8ce3a4091d1402da6b5405d564a3ad1 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:51:25.431957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:25.434291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:25.465431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60619899-c7ab-47de-a1ef-47dacf42fee0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:25.694893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:25.697403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:25.697403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:25.697403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] PATH_INFO: `/v3/projects/b56896db9a7b40f0a36ff5d50cc7fd11` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:25.697403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b56896db9a7b40f0a36ff5d50cc7fd11)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:25.699430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:25.937515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b56896db9a7b40f0a36ff5d50cc7fd11', 'request_id': 'req-82eb7800-9e37-4620-9b7e-30fb9929110a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:25.956649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b56896db9a7b40f0a36ff5d50cc7fd11', 'request_id': 'req-82eb7800-9e37-4620-9b7e-30fb9929110a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:25.987269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b56896db9a7b40f0a36ff5d50cc7fd11', 'request_id': 'req-82eb7800-9e37-4620-9b7e-30fb9929110a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:25.998408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:26.014599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] The token cache is being invalidate because project b56896db9a7b40f0a36ff5d50cc7fd11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:26.014959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:26.022405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-82eb7800-9e37-4620-9b7e-30fb9929110a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:26.024448 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4009/7979] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:25 2022] DELETE /identity/v3/projects/b56896db9a7b40f0a36ff5d50cc7fd11 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:26.029495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4e3d6-9b29-4d45-b666-677e98b9c14e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:26.030147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4e3d6-9b29-4d45-b666-677e98b9c14e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:26.030147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4e3d6-9b29-4d45-b666-677e98b9c14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:26.086085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-79e4e3d6-9b29-4d45-b666-677e98b9c14e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:26.087859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-79e4e3d6-9b29-4d45-b666-677e98b9c14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:26.248354 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3971/7980] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:26.253640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9d12f-9c70-4eaf-b205-9544ac67fd0d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:26.254060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9d12f-9c70-4eaf-b205-9544ac67fd0d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:26.254197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9d12f-9c70-4eaf-b205-9544ac67fd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:26.312724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-38c9d12f-9c70-4eaf-b205-9544ac67fd0d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:26.314015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-38c9d12f-9c70-4eaf-b205-9544ac67fd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:26.335106 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4010/7981] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:26.339703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4e3d6-9b29-4d45-b666-677e98b9c14e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:26.357136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4e3d6-9b29-4d45-b666-677e98b9c14e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:26.369758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e40f9-0c07-45fe-993e-0c632e09efa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:26.370846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e40f9-0c07-45fe-993e-0c632e09efa8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:26.372128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e40f9-0c07-45fe-993e-0c632e09efa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:26.374644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e40f9-0c07-45fe-993e-0c632e09efa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:26.375506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e40f9-0c07-45fe-993e-0c632e09efa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:51:26.375691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e40f9-0c07-45fe-993e-0c632e09efa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:26.377399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e40f9-0c07-45fe-993e-0c632e09efa8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:26.427476 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3972/7982] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:51:26.432428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9d12f-9c70-4eaf-b205-9544ac67fd0d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:26.476228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9d12f-9c70-4eaf-b205-9544ac67fd0d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:26.504004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db88465-0077-4712-b0d2-8bfa75b665e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:26.504004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db88465-0077-4712-b0d2-8bfa75b665e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:26.504004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db88465-0077-4712-b0d2-8bfa75b665e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:26.504004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db88465-0077-4712-b0d2-8bfa75b665e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:26.510418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db88465-0077-4712-b0d2-8bfa75b665e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:26.512496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db88465-0077-4712-b0d2-8bfa75b665e9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:26.595410 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4011/7983] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:26 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:26.596629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e40f9-0c07-45fe-993e-0c632e09efa8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:26.619737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e40f9-0c07-45fe-993e-0c632e09efa8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:26.754762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977894-0e35-48ea-986d-448af6c66377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:26.755724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977894-0e35-48ea-986d-448af6c66377 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:26.756278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977894-0e35-48ea-986d-448af6c66377 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:26.756765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977894-0e35-48ea-986d-448af6c66377 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:26.757640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b977894-0e35-48ea-986d-448af6c66377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:26.769084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b977894-0e35-48ea-986d-448af6c66377 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:26.781919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:26.820116 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3973/7984] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:26 2022] POST /identity/v3/users => generated 296 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:26.824295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db88465-0077-4712-b0d2-8bfa75b665e9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:26.843708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db88465-0077-4712-b0d2-8bfa75b665e9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:26.865782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411be6ca-4a31-4d8b-8dec-4f07056e86ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:26.866464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411be6ca-4a31-4d8b-8dec-4f07056e86ed admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:26.866743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411be6ca-4a31-4d8b-8dec-4f07056e86ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:26.867011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411be6ca-4a31-4d8b-8dec-4f07056e86ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:26.867837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411be6ca-4a31-4d8b-8dec-4f07056e86ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:26.872026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411be6ca-4a31-4d8b-8dec-4f07056e86ed admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:26.911641 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4012/7985] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:26.917632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977894-0e35-48ea-986d-448af6c66377 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:26.942610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977894-0e35-48ea-986d-448af6c66377 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:26.966826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049ab0f-a510-407e-b7ef-97f81df69b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:26.970109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049ab0f-a510-407e-b7ef-97f81df69b6d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:26.971751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049ab0f-a510-407e-b7ef-97f81df69b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:26.972038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049ab0f-a510-407e-b7ef-97f81df69b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:26.972750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049ab0f-a510-407e-b7ef-97f81df69b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:26.979521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049ab0f-a510-407e-b7ef-97f81df69b6d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:27.004824 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3974/7986] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:27.005740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411be6ca-4a31-4d8b-8dec-4f07056e86ed admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:27.023532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411be6ca-4a31-4d8b-8dec-4f07056e86ed admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:27.042111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1fc354-fd05-44bd-ad0b-88cae78f228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:27.042805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc354-fd05-44bd-ad0b-88cae78f228a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:27.043090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc354-fd05-44bd-ad0b-88cae78f228a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:27.043364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc354-fd05-44bd-ad0b-88cae78f228a admin admin] PATH_INFO: `/v3/projects/d7f9c4df38ed4734811e61fdac4c87f3/users/d802d05f05e2481ea17205da1eda6ea9/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:27.075768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fc354-fd05-44bd-ad0b-88cae78f228a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f9c4df38ed4734811e61fdac4c87f3, user_id=d802d05f05e2481ea17205da1eda6ea9, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:27.078537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1fc354-fd05-44bd-ad0b-88cae78f228a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:27.090920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec6542-93cb-4583-a853-a6bf8ffb7807 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:27.091656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec6542-93cb-4583-a853-a6bf8ffb7807 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:27.092160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec6542-93cb-4583-a853-a6bf8ffb7807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:27.107340 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4013/7987] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:27 2022] PUT /identity/v3/projects/d7f9c4df38ed4734811e61fdac4c87f3/users/d802d05f05e2481ea17205da1eda6ea9/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:27.119826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f80a2-49e4-4c97-ba60-a289764a636e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:27.120114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f80a2-49e4-4c97-ba60-a289764a636e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:27.120388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f80a2-49e4-4c97-ba60-a289764a636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:27.175513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a7ec6542-93cb-4583-a853-a6bf8ffb7807 None None] MFA Rules not processed for user `dfbbe60c10ee4f8d8fd85208b77bbfc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:27.179631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a7ec6542-93cb-4583-a853-a6bf8ffb7807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:27.205082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8b3f80a2-49e4-4c97-ba60-a289764a636e None None] MFA Rules not processed for user `d802d05f05e2481ea17205da1eda6ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:27.207328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8b3f80a2-49e4-4c97-ba60-a289764a636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:27.380316 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3975/7988] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:27.385199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec6542-93cb-4583-a853-a6bf8ffb7807 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:27.386588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a7ec6542-93cb-4583-a853-a6bf8ffb7807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:27.426863 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4014/7989] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:27.428445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f80a2-49e4-4c97-ba60-a289764a636e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:27.555568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec6542-93cb-4583-a853-a6bf8ffb7807 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:27.572851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e20552-284f-4342-89a0-37eab5c903d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:27.574702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e20552-284f-4342-89a0-37eab5c903d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:27.577866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e20552-284f-4342-89a0-37eab5c903d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:27.578191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e20552-284f-4342-89a0-37eab5c903d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:27.578914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e20552-284f-4342-89a0-37eab5c903d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:27.584096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e20552-284f-4342-89a0-37eab5c903d8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:27.596132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f80a2-49e4-4c97-ba60-a289764a636e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:27.622917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de41fef-2acf-45cf-b36f-cef5992ab472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:27.623569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de41fef-2acf-45cf-b36f-cef5992ab472 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:27.623843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de41fef-2acf-45cf-b36f-cef5992ab472 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:27.624107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de41fef-2acf-45cf-b36f-cef5992ab472 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:27.624741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de41fef-2acf-45cf-b36f-cef5992ab472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:27.628740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de41fef-2acf-45cf-b36f-cef5992ab472 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:27.685793 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3976/7990] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:27 2022] POST /identity/v3/projects => generated 373 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:27.691553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e20552-284f-4342-89a0-37eab5c903d8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:27.722255 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4015/7991] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:27 2022] POST /identity/v3/projects => generated 393 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:27.730421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de41fef-2acf-45cf-b36f-cef5992ab472 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:27.780639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:27.815181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:27.847702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e20552-284f-4342-89a0-37eab5c903d8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:27.979484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de41fef-2acf-45cf-b36f-cef5992ab472 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:28.002059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8747d-72a0-427a-bc58-0aaf80f68acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:28.002711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8747d-72a0-427a-bc58-0aaf80f68acc admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:28.002984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8747d-72a0-427a-bc58-0aaf80f68acc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:28.003299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8747d-72a0-427a-bc58-0aaf80f68acc admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:28.003953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8747d-72a0-427a-bc58-0aaf80f68acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:28.011210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8747d-72a0-427a-bc58-0aaf80f68acc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:28.051694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52176e94-fbf3-412c-8a9d-515f2e91c3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:28.052563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176e94-fbf3-412c-8a9d-515f2e91c3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:28.053029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176e94-fbf3-412c-8a9d-515f2e91c3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:28.053499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176e94-fbf3-412c-8a9d-515f2e91c3d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:28.054629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52176e94-fbf3-412c-8a9d-515f2e91c3d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:28.057054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52176e94-fbf3-412c-8a9d-515f2e91c3d5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:28.106520 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3977/7992] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:27 2022] POST /identity/v3/users => generated 293 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:28.111469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52176e94-fbf3-412c-8a9d-515f2e91c3d5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:28.117123 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4016/7993] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:27 2022] POST /identity/v3/users => generated 303 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:28.122688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-52176e94-fbf3-412c-8a9d-515f2e91c3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:28.123011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8747d-72a0-427a-bc58-0aaf80f68acc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:28.147787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8747d-72a0-427a-bc58-0aaf80f68acc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:28.165724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266089-e85f-4f5a-84fd-9c898d8b5aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:28.166461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266089-e85f-4f5a-84fd-9c898d8b5aae admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:28.166849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266089-e85f-4f5a-84fd-9c898d8b5aae admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:28.167188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3266089-e85f-4f5a-84fd-9c898d8b5aae admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:28.167979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3266089-e85f-4f5a-84fd-9c898d8b5aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:28.170827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3266089-e85f-4f5a-84fd-9c898d8b5aae admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:28.204212 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4017/7994] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:28.208391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266089-e85f-4f5a-84fd-9c898d8b5aae admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:28.241140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3266089-e85f-4f5a-84fd-9c898d8b5aae admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:28.260277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c122c9-f9d5-4ff5-94eb-d0795f360d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:28.261172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c122c9-f9d5-4ff5-94eb-d0795f360d19 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:28.262604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c122c9-f9d5-4ff5-94eb-d0795f360d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:28.262987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c122c9-f9d5-4ff5-94eb-d0795f360d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:28.265146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c122c9-f9d5-4ff5-94eb-d0795f360d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:28.266973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c122c9-f9d5-4ff5-94eb-d0795f360d19 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:28.288256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52176e94-fbf3-412c-8a9d-515f2e91c3d5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:28.318089 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4018/7995] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:28.320120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7955b8-abb4-4642-828e-392e7cc06aea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:28.320307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c122c9-f9d5-4ff5-94eb-d0795f360d19 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:28.321582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7955b8-abb4-4642-828e-392e7cc06aea service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:28.322549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7955b8-abb4-4642-828e-392e7cc06aea service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:28.327237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7955b8-abb4-4642-828e-392e7cc06aea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:28.332356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3b7955b8-abb4-4642-828e-392e7cc06aea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:28.351433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c122c9-f9d5-4ff5-94eb-d0795f360d19 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:28.381670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de8220-5f96-47eb-8b5e-5789ef96491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:28.382394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8220-5f96-47eb-8b5e-5789ef96491b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:28.382669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8220-5f96-47eb-8b5e-5789ef96491b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:28.382956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8220-5f96-47eb-8b5e-5789ef96491b admin admin] PATH_INFO: `/v3/projects/c70b46691a6a43e6905bb5cac95c975b/users/44ecebb2aa1347a1a216032f983d87f1/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:28.475143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de8220-5f96-47eb-8b5e-5789ef96491b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70b46691a6a43e6905bb5cac95c975b, user_id=44ecebb2aa1347a1a216032f983d87f1, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:28.476487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7955b8-abb4-4642-828e-392e7cc06aea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:28.478331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de8220-5f96-47eb-8b5e-5789ef96491b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:28.480020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7955b8-abb4-4642-828e-392e7cc06aea service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:28.524069 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4019/7996] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:28 2022] PUT /identity/v3/projects/c70b46691a6a43e6905bb5cac95c975b/users/44ecebb2aa1347a1a216032f983d87f1/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:28.524069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de8220-5f96-47eb-8b5e-5789ef96491b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:28.534794 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3978/7997] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:28.535555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7955b8-abb4-4642-828e-392e7cc06aea service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:28.561179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7955b8-abb4-4642-828e-392e7cc06aea service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:28.665499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:28.710406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de8220-5f96-47eb-8b5e-5789ef96491b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:28.722423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac63c2e-467e-4b42-b17b-5f2b82392e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:28.723111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac63c2e-467e-4b42-b17b-5f2b82392e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:28.723535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac63c2e-467e-4b42-b17b-5f2b82392e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:28.723804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac63c2e-467e-4b42-b17b-5f2b82392e23 admin admin] PATH_INFO: `/v3/projects/774f387fbfc2464ab45cf691fd8efde6/users/9407f853680f42c08fc130c50e4feafb/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:28.746960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e128-5d32-4b2f-a2c1-da891319b964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:28.747602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e128-5d32-4b2f-a2c1-da891319b964 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:28.747863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e128-5d32-4b2f-a2c1-da891319b964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:28.748124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777e128-5d32-4b2f-a2c1-da891319b964 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:28.748868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777e128-5d32-4b2f-a2c1-da891319b964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:28.759843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac63c2e-467e-4b42-b17b-5f2b82392e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774f387fbfc2464ab45cf691fd8efde6, user_id=9407f853680f42c08fc130c50e4feafb, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:28.764283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac63c2e-467e-4b42-b17b-5f2b82392e23 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:28.765027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777e128-5d32-4b2f-a2c1-da891319b964 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:28.795072 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3979/7998] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:28.802783 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4020/7999] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:28 2022] PUT /identity/v3/projects/774f387fbfc2464ab45cf691fd8efde6/users/9407f853680f42c08fc130c50e4feafb/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:28.806779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e128-5d32-4b2f-a2c1-da891319b964 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:28.807387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac63c2e-467e-4b42-b17b-5f2b82392e23 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:28.826263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777e128-5d32-4b2f-a2c1-da891319b964 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:28.909917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:28.941154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e7b75-3c80-493a-a301-f572fe6e93db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:28.941828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e7b75-3c80-493a-a301-f572fe6e93db admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:28.942155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e7b75-3c80-493a-a301-f572fe6e93db admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:28.942419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e7b75-3c80-493a-a301-f572fe6e93db admin admin] PATH_INFO: `/v3/projects/c70b46691a6a43e6905bb5cac95c975b/users/44ecebb2aa1347a1a216032f983d87f1/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:28.954115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac63c2e-467e-4b42-b17b-5f2b82392e23 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:28.955453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e7b75-3c80-493a-a301-f572fe6e93db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70b46691a6a43e6905bb5cac95c975b, user_id=44ecebb2aa1347a1a216032f983d87f1, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:28.958156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e7b75-3c80-493a-a301-f572fe6e93db admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:28.974645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4f826-2b07-449e-a1bf-3d9b900378a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:28.975685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f826-2b07-449e-a1bf-3d9b900378a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:28.976215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f826-2b07-449e-a1bf-3d9b900378a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:28.976722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4f826-2b07-449e-a1bf-3d9b900378a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:28.977674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4f826-2b07-449e-a1bf-3d9b900378a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:28.979764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4f826-2b07-449e-a1bf-3d9b900378a4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:28.982153 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3980/8000] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:28 2022] PUT /identity/v3/projects/c70b46691a6a43e6905bb5cac95c975b/users/44ecebb2aa1347a1a216032f983d87f1/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:29.005398 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4021/8001] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:29.007452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e7b75-3c80-493a-a301-f572fe6e93db admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:29.198646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e7b75-3c80-493a-a301-f572fe6e93db admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:29.212986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9ede-7677-4754-b9f5-9448e3c42d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:29.213987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9ede-7677-4754-b9f5-9448e3c42d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:29.214276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9ede-7677-4754-b9f5-9448e3c42d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:29.214561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a9ede-7677-4754-b9f5-9448e3c42d43 admin admin] PATH_INFO: `/v3/projects/774f387fbfc2464ab45cf691fd8efde6/users/9407f853680f42c08fc130c50e4feafb/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:29.233052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a9ede-7677-4754-b9f5-9448e3c42d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=774f387fbfc2464ab45cf691fd8efde6, user_id=9407f853680f42c08fc130c50e4feafb, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:29.240324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a9ede-7677-4754-b9f5-9448e3c42d43 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:29.284013 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3981/8002] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:29 2022] PUT /identity/v3/projects/774f387fbfc2464ab45cf691fd8efde6/users/9407f853680f42c08fc130c50e4feafb/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:29.295281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605f4f-0e1f-4d93-a785-430f843050e8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:29.295557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605f4f-0e1f-4d93-a785-430f843050e8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:29.295826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19605f4f-0e1f-4d93-a785-430f843050e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:29.360087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-19605f4f-0e1f-4d93-a785-430f843050e8 None None] MFA Rules not processed for user `9407f853680f42c08fc130c50e4feafb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:29.361432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-19605f4f-0e1f-4d93-a785-430f843050e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:29.564946 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4022/8003] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:29.576698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9ede-7677-4754-b9f5-9448e3c42d43 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:29.579624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f0a9ede-7677-4754-b9f5-9448e3c42d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:29.701865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a9ede-7677-4754-b9f5-9448e3c42d43 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:29.711612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313f979-edec-49e2-a528-1e98900a2f67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:29.712696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313f979-edec-49e2-a528-1e98900a2f67 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:29.713047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313f979-edec-49e2-a528-1e98900a2f67 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:29.713424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313f979-edec-49e2-a528-1e98900a2f67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:29.750569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313f979-edec-49e2-a528-1e98900a2f67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:29.752325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313f979-edec-49e2-a528-1e98900a2f67 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:29.770005 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3982/8004] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:29 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:29.905319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19605f4f-0e1f-4d93-a785-430f843050e8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:29.923426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19605f4f-0e1f-4d93-a785-430f843050e8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:29.931517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e04a48-0d57-4252-bb87-794fa69148da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:29.932532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e04a48-0d57-4252-bb87-794fa69148da service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:29.932985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e04a48-0d57-4252-bb87-794fa69148da service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:29.933456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e04a48-0d57-4252-bb87-794fa69148da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:30.016080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e04a48-0d57-4252-bb87-794fa69148da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:30.017606 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e04a48-0d57-4252-bb87-794fa69148da service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:30.048587 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4023/8005] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:39.762122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:40.023977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=74 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:40.340813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc3cc5-318a-4944-9cf6-1d8506666089 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:40.341284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc3cc5-318a-4944-9cf6-1d8506666089 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:40.341784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc3cc5-318a-4944-9cf6-1d8506666089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:40.408467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-abbc3cc5-318a-4944-9cf6-1d8506666089 None None] MFA Rules not processed for user `44ecebb2aa1347a1a216032f983d87f1`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:40.410118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-abbc3cc5-318a-4944-9cf6-1d8506666089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:40.517847 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3983/8006] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:40.533539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e04a48-0d57-4252-bb87-794fa69148da service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:40.535727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-83e04a48-0d57-4252-bb87-794fa69148da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:40.882370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e04a48-0d57-4252-bb87-794fa69148da service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:40.907973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409182d-7452-4791-85e9-1089c80ac46d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:40.912705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409182d-7452-4791-85e9-1089c80ac46d service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:40.913036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409182d-7452-4791-85e9-1089c80ac46d service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:40.913994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409182d-7452-4791-85e9-1089c80ac46d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:41.088870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc3cc5-318a-4944-9cf6-1d8506666089 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:41.164410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409182d-7452-4791-85e9-1089c80ac46d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:41.171365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409182d-7452-4791-85e9-1089c80ac46d service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:41.196015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc3cc5-318a-4944-9cf6-1d8506666089 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:41.208430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:41.209089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:41.209362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:41.209626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] PATH_INFO: `/v3/users/d802d05f05e2481ea17205da1eda6ea9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:41.213262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d802d05f05e2481ea17205da1eda6ea9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:41.215427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:41.224851 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4024/8007] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:41.369754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd802d05f05e2481ea17205da1eda6ea9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:41.397657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd802d05f05e2481ea17205da1eda6ea9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:41.461715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd802d05f05e2481ea17205da1eda6ea9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:41.486403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd802d05f05e2481ea17205da1eda6ea9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:41.488076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd802d05f05e2481ea17205da1eda6ea9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:41.490117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:41.517332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cc220-78e0-49a1-9a9e-34cabbb1c5ee None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:41.518036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cc220-78e0-49a1-9a9e-34cabbb1c5ee None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:41.518351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24cc220-78e0-49a1-9a9e-34cabbb1c5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:41.521292 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3984/8008] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:51:41 2022] DELETE /identity/v3/users/d802d05f05e2481ea17205da1eda6ea9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:41.572666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c24cc220-78e0-49a1-9a9e-34cabbb1c5ee None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:41.580083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c24cc220-78e0-49a1-9a9e-34cabbb1c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:41.809656 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4025/8009] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:41.903789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:41.905257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:42.126671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f85af9-37e7-4705-9fab-6ff9c4d86268 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:42.144856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a638478-cd5e-4249-9ffc-f494c2e5c16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:42.146131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a638478-cd5e-4249-9ffc-f494c2e5c16c service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:42.146131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a638478-cd5e-4249-9ffc-f494c2e5c16c service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:42.146131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a638478-cd5e-4249-9ffc-f494c2e5c16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:42.194467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a638478-cd5e-4249-9ffc-f494c2e5c16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:42.197618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a638478-cd5e-4249-9ffc-f494c2e5c16c service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:42.263353 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3985/8010] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:43.562645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cc220-78e0-49a1-9a9e-34cabbb1c5ee None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:43.564201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c24cc220-78e0-49a1-9a9e-34cabbb1c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:43.613665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24cc220-78e0-49a1-9a9e-34cabbb1c5ee None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:43.629364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:43.631146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:43.631590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:43.632102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] PATH_INFO: `/v3/projects/d7f9c4df38ed4734811e61fdac4c87f3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:43.636254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f9c4df38ed4734811e61fdac4c87f3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:43.638484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:43.716766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:43.832790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f9c4df38ed4734811e61fdac4c87f3', 'request_id': 'req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:43.853340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f9c4df38ed4734811e61fdac4c87f3', 'request_id': 'req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:43.881217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f9c4df38ed4734811e61fdac4c87f3', 'request_id': 'req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:43.923337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] The token cache is being invalidate because project d7f9c4df38ed4734811e61fdac4c87f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:43.923885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:43.924868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:43.926964 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4026/8011] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:43 2022] DELETE /identity/v3/projects/d7f9c4df38ed4734811e61fdac4c87f3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:43.932696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a638478-cd5e-4249-9ffc-f494c2e5c16c service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:43.950278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a638478-cd5e-4249-9ffc-f494c2e5c16c service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:44.123099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:44.123752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:44.126002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:44.126915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] PATH_INFO: `/v3/users/9407f853680f42c08fc130c50e4feafb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:44.129201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9407f853680f42c08fc130c50e4feafb)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:44.134288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:44.291462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9407f853680f42c08fc130c50e4feafb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:44.333001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9407f853680f42c08fc130c50e4feafb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:44.364666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9407f853680f42c08fc130c50e4feafb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:44.409107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9407f853680f42c08fc130c50e4feafb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:44.410699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9407f853680f42c08fc130c50e4feafb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:44.428283 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3986/8012] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:51:43 2022] DELETE /identity/v3/users/9407f853680f42c08fc130c50e4feafb => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:44.441784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:44.444329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:44.625662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:44.628063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:44.701222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:44.721395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6fd0-45a5-4b67-9479-b06f2cdc1d35 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:44.905321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988151b-6bf2-436a-9c6c-7ce166c2be6b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:44.923959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b6b32-6a62-40c9-ac9c-f7e0ff75530f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:44.924852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b6b32-6a62-40c9-ac9c-f7e0ff75530f service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:44.925237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b6b32-6a62-40c9-ac9c-f7e0ff75530f service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:44.925606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b6b32-6a62-40c9-ac9c-f7e0ff75530f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:44.928763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fa8b6b32-6a62-40c9-ac9c-f7e0ff75530f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:44.934563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb1251-93b1-4119-8144-2d7e9dc143ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:44.936932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1251-93b1-4119-8144-2d7e9dc143ca service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:44.937228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1251-93b1-4119-8144-2d7e9dc143ca service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:44.937497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb1251-93b1-4119-8144-2d7e9dc143ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:44.946131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-73cb1251-93b1-4119-8144-2d7e9dc143ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:44.967418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b6b32-6a62-40c9-ac9c-f7e0ff75530f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:44.969572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b6b32-6a62-40c9-ac9c-f7e0ff75530f service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:45.035319 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3987/8013] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:45.147441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:45.191510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb1251-93b1-4119-8144-2d7e9dc143ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:45.192934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb1251-93b1-4119-8144-2d7e9dc143ca service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:45.227667 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4027/8014] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:51:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:51:45.518373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2047b6-cf6f-48fe-8d7f-f34100ea1ba2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:45.518744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2047b6-cf6f-48fe-8d7f-f34100ea1ba2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:45.519088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2047b6-cf6f-48fe-8d7f-f34100ea1ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:45.557986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5e2047b6-cf6f-48fe-8d7f-f34100ea1ba2 None None] MFA Rules not processed for user `dfbbe60c10ee4f8d8fd85208b77bbfc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:45.559314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5e2047b6-cf6f-48fe-8d7f-f34100ea1ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:45.676872 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3988/8015] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:45.951303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb1251-93b1-4119-8144-2d7e9dc143ca service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:45.958954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-73cb1251-93b1-4119-8144-2d7e9dc143ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:46.149067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb1251-93b1-4119-8144-2d7e9dc143ca service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:46.157312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:46.158172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:46.158450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:46.158717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] PATH_INFO: `/v3/projects/774f387fbfc2464ab45cf691fd8efde6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:46.166877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=774f387fbfc2464ab45cf691fd8efde6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:46.168836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:46.292860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774f387fbfc2464ab45cf691fd8efde6', 'request_id': 'req-9538a393-58e9-41e1-90ea-a07b283c0aa0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:46.310308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774f387fbfc2464ab45cf691fd8efde6', 'request_id': 'req-9538a393-58e9-41e1-90ea-a07b283c0aa0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:46.333822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774f387fbfc2464ab45cf691fd8efde6', 'request_id': 'req-9538a393-58e9-41e1-90ea-a07b283c0aa0'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:46.352210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] The token cache is being invalidate because project 774f387fbfc2464ab45cf691fd8efde6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:46.352884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:46.354003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9538a393-58e9-41e1-90ea-a07b283c0aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:46.357154 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4028/8016] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:45 2022] DELETE /identity/v3/projects/774f387fbfc2464ab45cf691fd8efde6 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:46.362455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456158b-2d60-4f1e-8576-ab8503cbddc4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:46.362968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456158b-2d60-4f1e-8576-ab8503cbddc4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:46.363337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456158b-2d60-4f1e-8576-ab8503cbddc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:46.475750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6456158b-2d60-4f1e-8576-ab8503cbddc4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:46.477809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6456158b-2d60-4f1e-8576-ab8503cbddc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:46.669049 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3989/8017] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:46.670747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54641239-768c-4fce-aecd-88d7d58f9980 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:46.670990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54641239-768c-4fce-aecd-88d7d58f9980 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:46.671259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54641239-768c-4fce-aecd-88d7d58f9980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:46.708537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-54641239-768c-4fce-aecd-88d7d58f9980 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:46.721329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-54641239-768c-4fce-aecd-88d7d58f9980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:46.742203 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4029/8018] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:46.746799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456158b-2d60-4f1e-8576-ab8503cbddc4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:46.759754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456158b-2d60-4f1e-8576-ab8503cbddc4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:46.779687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2994-6617-44d9-8a7b-7a429ef9a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:46.781103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2994-6617-44d9-8a7b-7a429ef9a882 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:46.781386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2994-6617-44d9-8a7b-7a429ef9a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:46.781654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b2994-6617-44d9-8a7b-7a429ef9a882 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:46.782341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2994-6617-44d9-8a7b-7a429ef9a882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:51:46.782635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2994-6617-44d9-8a7b-7a429ef9a882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:46.788503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b2994-6617-44d9-8a7b-7a429ef9a882 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:46.816471 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3990/8019] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:51:46.817754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54641239-768c-4fce-aecd-88d7d58f9980 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:46.833097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54641239-768c-4fce-aecd-88d7d58f9980 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:46.851241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983786c-78c7-407f-a2e4-7fd9faf5206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:46.851241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983786c-78c7-407f-a2e4-7fd9faf5206e admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:46.851241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983786c-78c7-407f-a2e4-7fd9faf5206e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:46.851241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983786c-78c7-407f-a2e4-7fd9faf5206e admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:46.851692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983786c-78c7-407f-a2e4-7fd9faf5206e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:46.851692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983786c-78c7-407f-a2e4-7fd9faf5206e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:46.912197 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4030/8020] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:46 2022] POST /identity/v3/projects => generated 407 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:46.913361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2994-6617-44d9-8a7b-7a429ef9a882 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:46.933895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b2994-6617-44d9-8a7b-7a429ef9a882 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:47.033201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:47.134767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078dcec-f581-4b55-b6a7-3426b4b2798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:47.135398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078dcec-f581-4b55-b6a7-3426b4b2798f admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:47.135672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078dcec-f581-4b55-b6a7-3426b4b2798f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:47.135938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078dcec-f581-4b55-b6a7-3426b4b2798f admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:47.136587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078dcec-f581-4b55-b6a7-3426b4b2798f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:47.144625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078dcec-f581-4b55-b6a7-3426b4b2798f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:47.216616 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3991/8021] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:46 2022] POST /identity/v3/users => generated 304 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:47.217823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983786c-78c7-407f-a2e4-7fd9faf5206e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:47.238750 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983786c-78c7-407f-a2e4-7fd9faf5206e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:47.248063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace7c89-8c33-42d6-bc84-d31215709ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:47.248999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace7c89-8c33-42d6-bc84-d31215709ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:47.250308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace7c89-8c33-42d6-bc84-d31215709ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:47.250889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace7c89-8c33-42d6-bc84-d31215709ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:47.252028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace7c89-8c33-42d6-bc84-d31215709ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:47.291462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace7c89-8c33-42d6-bc84-d31215709ef2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:47.319921 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4031/8022] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:51:47.330509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078dcec-f581-4b55-b6a7-3426b4b2798f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:47.343238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078dcec-f581-4b55-b6a7-3426b4b2798f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:47.375684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4617d55-5972-46e7-9bac-64842b9610d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:47.378519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617d55-5972-46e7-9bac-64842b9610d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:47.379071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617d55-5972-46e7-9bac-64842b9610d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:47.379346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4617d55-5972-46e7-9bac-64842b9610d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:47.380168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4617d55-5972-46e7-9bac-64842b9610d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:47.392739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4617d55-5972-46e7-9bac-64842b9610d9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:47.444416 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3992/8023] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:51:47.445836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace7c89-8c33-42d6-bc84-d31215709ef2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:47.470044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace7c89-8c33-42d6-bc84-d31215709ef2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:47.481201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7a91d-d017-4476-ad14-d1373a8763fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:47.482192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7a91d-d017-4476-ad14-d1373a8763fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:47.488115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7a91d-d017-4476-ad14-d1373a8763fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:47.490517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7a91d-d017-4476-ad14-d1373a8763fe admin admin] PATH_INFO: `/v3/projects/52fe984e6f9443d78840be01cb9c6381/users/6e0e8ba698c94dea89eed235783eb420/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:47.561815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7a91d-d017-4476-ad14-d1373a8763fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fe984e6f9443d78840be01cb9c6381, user_id=6e0e8ba698c94dea89eed235783eb420, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:47.564601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7a91d-d017-4476-ad14-d1373a8763fe admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:47.604240 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4032/8024] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:47 2022] PUT /identity/v3/projects/52fe984e6f9443d78840be01cb9c6381/users/6e0e8ba698c94dea89eed235783eb420/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:47.741068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b794-5fd2-4725-86ed-b416c0508e7f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:47.741347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b794-5fd2-4725-86ed-b416c0508e7f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:47.741621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242b794-5fd2-4725-86ed-b416c0508e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:47.830742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8242b794-5fd2-4725-86ed-b416c0508e7f None None] MFA Rules not processed for user `6e0e8ba698c94dea89eed235783eb420`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:47.831932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8242b794-5fd2-4725-86ed-b416c0508e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:48.016120 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3993/8025] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:47 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:48.019158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7a91d-d017-4476-ad14-d1373a8763fe admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:48.056997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:48.127817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7a91d-d017-4476-ad14-d1373a8763fe admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:48.133899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afb1a4-9249-4bd6-a50a-dd2d238b2113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:48.134602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afb1a4-9249-4bd6-a50a-dd2d238b2113 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:48.134888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afb1a4-9249-4bd6-a50a-dd2d238b2113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:48.135315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afb1a4-9249-4bd6-a50a-dd2d238b2113 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:48.136007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afb1a4-9249-4bd6-a50a-dd2d238b2113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:48.138079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afb1a4-9249-4bd6-a50a-dd2d238b2113 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:48.227692 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4033/8026] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:48 2022] POST /identity/v3/projects => generated 409 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:51:48.232285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242b794-5fd2-4725-86ed-b416c0508e7f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:48.252905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242b794-5fd2-4725-86ed-b416c0508e7f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:48.352808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939563d-b3e7-4e2e-9b5d-1c2fab40899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:48.353925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939563d-b3e7-4e2e-9b5d-1c2fab40899a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:48.354314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939563d-b3e7-4e2e-9b5d-1c2fab40899a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:48.354870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939563d-b3e7-4e2e-9b5d-1c2fab40899a admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:48.357033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939563d-b3e7-4e2e-9b5d-1c2fab40899a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:48.358357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939563d-b3e7-4e2e-9b5d-1c2fab40899a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:48.396881 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3994/8027] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:48 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:48.398979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afb1a4-9249-4bd6-a50a-dd2d238b2113 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:48.485849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afb1a4-9249-4bd6-a50a-dd2d238b2113 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:48.499770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1abfda-a255-46fd-9df4-1e33c4d88217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:48.503115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1abfda-a255-46fd-9df4-1e33c4d88217 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:48.504029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1abfda-a255-46fd-9df4-1e33c4d88217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:48.504537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1abfda-a255-46fd-9df4-1e33c4d88217 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:48.505813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1abfda-a255-46fd-9df4-1e33c4d88217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:48.508170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1abfda-a255-46fd-9df4-1e33c4d88217 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:48.522238 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4034/8028] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:48.526504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939563d-b3e7-4e2e-9b5d-1c2fab40899a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:48.573806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939563d-b3e7-4e2e-9b5d-1c2fab40899a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:48.590009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff3cf-08f1-4e32-bc9f-7924fb6fdd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:48.591905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff3cf-08f1-4e32-bc9f-7924fb6fdd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:48.593107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff3cf-08f1-4e32-bc9f-7924fb6fdd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:48.594715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff3cf-08f1-4e32-bc9f-7924fb6fdd4b admin admin] PATH_INFO: `/v3/projects/36bcc791229f43a68d28aeba76be5d4d/users/680fee713cb345029ba2bbdf73edb2ba/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:48.629937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:48.642680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeff3cf-08f1-4e32-bc9f-7924fb6fdd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bcc791229f43a68d28aeba76be5d4d, user_id=680fee713cb345029ba2bbdf73edb2ba, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:48.648533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeff3cf-08f1-4e32-bc9f-7924fb6fdd4b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:48.679402 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3995/8029] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:48 2022] PUT /identity/v3/projects/36bcc791229f43a68d28aeba76be5d4d/users/680fee713cb345029ba2bbdf73edb2ba/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:48.683765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1abfda-a255-46fd-9df4-1e33c4d88217 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:48.699929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1abfda-a255-46fd-9df4-1e33c4d88217 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:48.851438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff3cf-08f1-4e32-bc9f-7924fb6fdd4b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:48.859238 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9eeff3cf-08f1-4e32-bc9f-7924fb6fdd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:48.881712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ebabb-af8a-4a92-af51-77868ce5334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:48.886214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ebabb-af8a-4a92-af51-77868ce5334b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:48.886619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ebabb-af8a-4a92-af51-77868ce5334b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:48.886857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ebabb-af8a-4a92-af51-77868ce5334b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:48.887499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ebabb-af8a-4a92-af51-77868ce5334b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:48.927607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ebabb-af8a-4a92-af51-77868ce5334b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:48.951603 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4035/8030] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:48.952910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ebabb-af8a-4a92-af51-77868ce5334b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:48.976681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ebabb-af8a-4a92-af51-77868ce5334b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:48.987471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cfa0a-1ba7-4e7b-b31c-06a5e12b9711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:48.988273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cfa0a-1ba7-4e7b-b31c-06a5e12b9711 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:48.988652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cfa0a-1ba7-4e7b-b31c-06a5e12b9711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:48.989023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cfa0a-1ba7-4e7b-b31c-06a5e12b9711 admin admin] PATH_INFO: `/v3/projects/36bcc791229f43a68d28aeba76be5d4d/users/680fee713cb345029ba2bbdf73edb2ba/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:48.996376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cfa0a-1ba7-4e7b-b31c-06a5e12b9711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36bcc791229f43a68d28aeba76be5d4d, user_id=680fee713cb345029ba2bbdf73edb2ba, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:49.000072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566cfa0a-1ba7-4e7b-b31c-06a5e12b9711 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:49.038164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4036/8031] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:48 2022] PUT /identity/v3/projects/36bcc791229f43a68d28aeba76be5d4d/users/680fee713cb345029ba2bbdf73edb2ba/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:51:49.050848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6f862-6a18-42a9-abf6-9618e086c468 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:49.051148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6f862-6a18-42a9-abf6-9618e086c468 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:49.051691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6f862-6a18-42a9-abf6-9618e086c468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:49.137479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff3cf-08f1-4e32-bc9f-7924fb6fdd4b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:49.143580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-61e6f862-6a18-42a9-abf6-9618e086c468 None None] MFA Rules not processed for user `680fee713cb345029ba2bbdf73edb2ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:49.144829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-61e6f862-6a18-42a9-abf6-9618e086c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:49.251190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:49.272458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5c080-3e6c-4f54-9d7c-fb47aecc33d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:49.276456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5c080-3e6c-4f54-9d7c-fb47aecc33d3 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:49.276748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5c080-3e6c-4f54-9d7c-fb47aecc33d3 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:49.278229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5c080-3e6c-4f54-9d7c-fb47aecc33d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:49.284552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bda5c080-3e6c-4f54-9d7c-fb47aecc33d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:49.306177 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4037/8032] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:49 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:49.307042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6f862-6a18-42a9-abf6-9618e086c468 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:49.319263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-61e6f862-6a18-42a9-abf6-9618e086c468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:49.328621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5c080-3e6c-4f54-9d7c-fb47aecc33d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:49.332582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5c080-3e6c-4f54-9d7c-fb47aecc33d3 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:49.368567 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3996/8033] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:51:49.489249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6f862-6a18-42a9-abf6-9618e086c468 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:49.501205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118df425-7283-4059-bc92-8b8291b9b1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:49.502130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118df425-7283-4059-bc92-8b8291b9b1cd service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:49.502584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118df425-7283-4059-bc92-8b8291b9b1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:49.503034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118df425-7283-4059-bc92-8b8291b9b1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:49.536131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118df425-7283-4059-bc92-8b8291b9b1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:49.542914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118df425-7283-4059-bc92-8b8291b9b1cd service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:49.577201 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4038/8034] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:49 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:50.005057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5c080-3e6c-4f54-9d7c-fb47aecc33d3 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:50.027395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5c080-3e6c-4f54-9d7c-fb47aecc33d3 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:50.031712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fb4ef-cafd-456f-bd8a-d4f787fa3ad1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:50.032340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fb4ef-cafd-456f-bd8a-d4f787fa3ad1 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:50.032617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fb4ef-cafd-456f-bd8a-d4f787fa3ad1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:50.032886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fb4ef-cafd-456f-bd8a-d4f787fa3ad1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:50.171866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fb4ef-cafd-456f-bd8a-d4f787fa3ad1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:50.178415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fb4ef-cafd-456f-bd8a-d4f787fa3ad1 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:50.198485 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3997/8035] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:50 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:54.189804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118df425-7283-4059-bc92-8b8291b9b1cd service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:54.191359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-118df425-7283-4059-bc92-8b8291b9b1cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:54.434855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118df425-7283-4059-bc92-8b8291b9b1cd service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:54.457821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c8a17-2184-4587-bc83-21db10fa8e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:54.459182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c8a17-2184-4587-bc83-21db10fa8e94 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:54.462315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c8a17-2184-4587-bc83-21db10fa8e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:54.462800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c8a17-2184-4587-bc83-21db10fa8e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:54.465620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fb4ef-cafd-456f-bd8a-d4f787fa3ad1 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:54.466280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0e8c8a17-2184-4587-bc83-21db10fa8e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:54.467178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2e7fb4ef-cafd-456f-bd8a-d4f787fa3ad1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:54.482375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c8a17-2184-4587-bc83-21db10fa8e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:54.484259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c8a17-2184-4587-bc83-21db10fa8e94 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:54.499010 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4039/8036] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:54.519007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:54.626920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fb4ef-cafd-456f-bd8a-d4f787fa3ad1 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:54.647729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:54.649207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:54.651398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:54.651897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] PATH_INFO: `/v3/users/1587b6210bc145afb393b63cd43b011d` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:54.656877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1587b6210bc145afb393b63cd43b011d)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:54.659638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:54.766897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1587b6210bc145afb393b63cd43b011d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:54.782659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1587b6210bc145afb393b63cd43b011d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:54.815622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1587b6210bc145afb393b63cd43b011d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:54.831204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1587b6210bc145afb393b63cd43b011d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:54.832433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1587b6210bc145afb393b63cd43b011d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:54.842459 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3998/8037] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:51:54 2022] DELETE /identity/v3/users/1587b6210bc145afb393b63cd43b011d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:51:54.847892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce57548-4c62-4125-9b1c-d38763a534f9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:54.848468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce57548-4c62-4125-9b1c-d38763a534f9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:54.848956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce57548-4c62-4125-9b1c-d38763a534f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:54.911781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-fce57548-4c62-4125-9b1c-d38763a534f9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:54.922839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fce57548-4c62-4125-9b1c-d38763a534f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:55.219969 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4040/8038] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:51:55.263071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:55.265756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:55.522058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a4900-f8ce-49b9-b29e-cc372e10930a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:55.534805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec46c41-d0b5-4591-bbed-2bbd22f893ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:55.535911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46c41-d0b5-4591-bbed-2bbd22f893ab service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:55.536224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46c41-d0b5-4591-bbed-2bbd22f893ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:55.536465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46c41-d0b5-4591-bbed-2bbd22f893ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:55.556327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec46c41-d0b5-4591-bbed-2bbd22f893ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:55.558538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec46c41-d0b5-4591-bbed-2bbd22f893ab service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:55.581386 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 3999/8039] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:51:57.593661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce57548-4c62-4125-9b1c-d38763a534f9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:57.595228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fce57548-4c62-4125-9b1c-d38763a534f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:57.618044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce57548-4c62-4125-9b1c-d38763a534f9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:57.630053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:57.630726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:57.631006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:57.631281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] PATH_INFO: `/v3/projects/42c3cecab01f407c8017d3a6503fcf0c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:57.633101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c3cecab01f407c8017d3a6503fcf0c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:57.641002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:57.684835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:57.710937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c3cecab01f407c8017d3a6503fcf0c', 'request_id': 'req-051def4e-1cb1-4725-9440-7b7c0c20c3a6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:57.718016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c3cecab01f407c8017d3a6503fcf0c', 'request_id': 'req-051def4e-1cb1-4725-9440-7b7c0c20c3a6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:57.728001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c3cecab01f407c8017d3a6503fcf0c', 'request_id': 'req-051def4e-1cb1-4725-9440-7b7c0c20c3a6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:57.740231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] The token cache is being invalidate because project 42c3cecab01f407c8017d3a6503fcf0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:57.740522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:57.741216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:57.743584 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4041/8040] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:57 2022] DELETE /identity/v3/projects/42c3cecab01f407c8017d3a6503fcf0c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:57.747538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec46c41-d0b5-4591-bbed-2bbd22f893ab service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:57.759465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec46c41-d0b5-4591-bbed-2bbd22f893ab service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:57.816912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:57.843329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:57.844258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:57.845034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:57.845549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] PATH_INFO: `/v3/users/cf64b66b910043b2b4fbd2611f67c9b2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:57.847472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf64b66b910043b2b4fbd2611f67c9b2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:57.849806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:57.931586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf64b66b910043b2b4fbd2611f67c9b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:57.943727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf64b66b910043b2b4fbd2611f67c9b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:57.964820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf64b66b910043b2b4fbd2611f67c9b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:57.977694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf64b66b910043b2b4fbd2611f67c9b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:57.978840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c1a0d2-729d-4493-be68-0dd07545f089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf64b66b910043b2b4fbd2611f67c9b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:57.988585 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4000/8041] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:51:57 2022] DELETE /identity/v3/users/cf64b66b910043b2b4fbd2611f67c9b2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:58.418244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:58.419673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:58.448259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051def4e-1cb1-4725-9440-7b7c0c20c3a6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:58.538228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:58.539510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:58.540063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:58.540518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] PATH_INFO: `/v3/projects/ac906f96fd294c0b87dfcdbf1ca8f089` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:58.545747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac906f96fd294c0b87dfcdbf1ca8f089)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:58.548256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:58.659476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac906f96fd294c0b87dfcdbf1ca8f089', 'request_id': 'req-0670e226-cb76-4aed-88ef-9e019152cd3a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:58.681826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac906f96fd294c0b87dfcdbf1ca8f089', 'request_id': 'req-0670e226-cb76-4aed-88ef-9e019152cd3a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:58.716956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac906f96fd294c0b87dfcdbf1ca8f089', 'request_id': 'req-0670e226-cb76-4aed-88ef-9e019152cd3a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:58.755570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] The token cache is being invalidate because project ac906f96fd294c0b87dfcdbf1ca8f089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:51:58.758139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:58.761567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0670e226-cb76-4aed-88ef-9e019152cd3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:51:58.765038 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4042/8042] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:51:58 2022] DELETE /identity/v3/projects/ac906f96fd294c0b87dfcdbf1ca8f089 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:51:58.770596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa0c36-7f39-4b6a-ab9b-e0e5656b125e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:58.771468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa0c36-7f39-4b6a-ab9b-e0e5656b125e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:58.771915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa0c36-7f39-4b6a-ab9b-e0e5656b125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:58.818122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-24fa0c36-7f39-4b6a-ab9b-e0e5656b125e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:58.820734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-24fa0c36-7f39-4b6a-ab9b-e0e5656b125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:58.933920 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4001/8043] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:59.048844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b759dc-34a1-4ee0-8c91-fd06a1d816ca None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:59.049439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b759dc-34a1-4ee0-8c91-fd06a1d816ca None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:59.049960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b759dc-34a1-4ee0-8c91-fd06a1d816ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:59.094928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e6b759dc-34a1-4ee0-8c91-fd06a1d816ca None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:59.096166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e6b759dc-34a1-4ee0-8c91-fd06a1d816ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:51:59.112125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4043/8044] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:51:59.116331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa0c36-7f39-4b6a-ab9b-e0e5656b125e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:59.135818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa0c36-7f39-4b6a-ab9b-e0e5656b125e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:59.150920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b05b-b836-4b6d-994b-e011fea4b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:59.151741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b05b-b836-4b6d-994b-e011fea4b8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:59.151741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b05b-b836-4b6d-994b-e011fea4b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:59.152018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b05b-b836-4b6d-994b-e011fea4b8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:59.153309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b05b-b836-4b6d-994b-e011fea4b8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:51:59.153635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b05b-b836-4b6d-994b-e011fea4b8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:59.155396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b05b-b836-4b6d-994b-e011fea4b8b9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:59.207270 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4002/8045] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:51:59.211216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b759dc-34a1-4ee0-8c91-fd06a1d816ca None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:59.234046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b759dc-34a1-4ee0-8c91-fd06a1d816ca None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:59.285475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e3931-8127-44b8-ac97-73b83e360333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:59.286859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e3931-8127-44b8-ac97-73b83e360333 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:59.287360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e3931-8127-44b8-ac97-73b83e360333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:59.287823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e3931-8127-44b8-ac97-73b83e360333 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:59.288670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e3931-8127-44b8-ac97-73b83e360333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:59.291141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19e3931-8127-44b8-ac97-73b83e360333 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:59.349211 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4044/8046] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:51:59 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:51:59.353434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b05b-b836-4b6d-994b-e011fea4b8b9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:59.380526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b05b-b836-4b6d-994b-e011fea4b8b9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:59.469422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:59.511297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427351d7-710b-4a39-868e-d2a1da832bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:59.513839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427351d7-710b-4a39-868e-d2a1da832bca admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:59.514356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427351d7-710b-4a39-868e-d2a1da832bca admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:59.514870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427351d7-710b-4a39-868e-d2a1da832bca admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:59.517882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427351d7-710b-4a39-868e-d2a1da832bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:59.521743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427351d7-710b-4a39-868e-d2a1da832bca admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:59.573739 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4003/8047] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:51:59 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:51:59.578102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e3931-8127-44b8-ac97-73b83e360333 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:59.618257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e3931-8127-44b8-ac97-73b83e360333 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:59.630452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea72d4-40d5-42ac-b6a3-503973a1ecb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:59.633384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea72d4-40d5-42ac-b6a3-503973a1ecb2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:59.634532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea72d4-40d5-42ac-b6a3-503973a1ecb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:59.635054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea72d4-40d5-42ac-b6a3-503973a1ecb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:59.637495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea72d4-40d5-42ac-b6a3-503973a1ecb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:59.641700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea72d4-40d5-42ac-b6a3-503973a1ecb2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:59.684179 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4045/8048] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:51:59.695859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427351d7-710b-4a39-868e-d2a1da832bca admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:59.723687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427351d7-710b-4a39-868e-d2a1da832bca admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:59.730092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a3269e-a033-49c1-abb3-5457f5cc454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:59.731273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3269e-a033-49c1-abb3-5457f5cc454f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:59.731721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3269e-a033-49c1-abb3-5457f5cc454f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:59.732165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a3269e-a033-49c1-abb3-5457f5cc454f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:59.733100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3269e-a033-49c1-abb3-5457f5cc454f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:59.735556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a3269e-a033-49c1-abb3-5457f5cc454f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:59.752790 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4004/8049] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:51:59.754039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea72d4-40d5-42ac-b6a3-503973a1ecb2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:51:59.765119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:59.771453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea72d4-40d5-42ac-b6a3-503973a1ecb2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:51:59.786342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cf49d-12fa-4c77-b265-9ac579dfeb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:51:59.787487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf49d-12fa-4c77-b265-9ac579dfeb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:59.788994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf49d-12fa-4c77-b265-9ac579dfeb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:59.790171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cf49d-12fa-4c77-b265-9ac579dfeb63 admin admin] PATH_INFO: `/v3/projects/121dcad722534f59a50fa7dfade558c5/users/d425cd178e2a4ebbaa5a6512743f64db/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:59.839575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cf49d-12fa-4c77-b265-9ac579dfeb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=121dcad722534f59a50fa7dfade558c5, user_id=d425cd178e2a4ebbaa5a6512743f64db, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:51:59.842922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cf49d-12fa-4c77-b265-9ac579dfeb63 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:51:59.875456 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4046/8050] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:51:59 2022] PUT /identity/v3/projects/121dcad722534f59a50fa7dfade558c5/users/d425cd178e2a4ebbaa5a6512743f64db/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:51:59.885714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca411-585b-4490-a6c5-0c9325df440c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:51:59.886263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca411-585b-4490-a6c5-0c9325df440c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:51:59.886428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ca411-585b-4490-a6c5-0c9325df440c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:51:59.946317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-674ca411-585b-4490-a6c5-0c9325df440c None None] MFA Rules not processed for user `d425cd178e2a4ebbaa5a6512743f64db`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:51:59.950885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-674ca411-585b-4490-a6c5-0c9325df440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:00.141338 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4005/8051] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:51:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:00.144439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cf49d-12fa-4c77-b265-9ac579dfeb63 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:00.379313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cf49d-12fa-4c77-b265-9ac579dfeb63 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:00.396316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f1c87-6cd3-416d-939b-4de2139e8aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:00.397250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f1c87-6cd3-416d-939b-4de2139e8aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:00.397610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f1c87-6cd3-416d-939b-4de2139e8aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:00.397973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f1c87-6cd3-416d-939b-4de2139e8aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:00.398749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f1c87-6cd3-416d-939b-4de2139e8aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:00.404064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f1c87-6cd3-416d-939b-4de2139e8aa1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:00.495534 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4047/8052] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:00 2022] POST /identity/v3/projects => generated 365 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:00.499603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca411-585b-4490-a6c5-0c9325df440c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:00.518492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ca411-585b-4490-a6c5-0c9325df440c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:00.658259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f1c87-6cd3-416d-939b-4de2139e8aa1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:00.660202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7d5f1c87-6cd3-416d-939b-4de2139e8aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:00.735999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783d656-6ab4-44a9-ad81-f719e0200a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:00.736639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783d656-6ab4-44a9-ad81-f719e0200a75 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:00.736914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783d656-6ab4-44a9-ad81-f719e0200a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:00.737186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783d656-6ab4-44a9-ad81-f719e0200a75 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:00.749497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783d656-6ab4-44a9-ad81-f719e0200a75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:00.755644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f783d656-6ab4-44a9-ad81-f719e0200a75 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:00.801060 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4006/8053] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:00 2022] POST /identity/v3/users => generated 289 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:52:00.807396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783d656-6ab4-44a9-ad81-f719e0200a75 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:00.821455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783d656-6ab4-44a9-ad81-f719e0200a75 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:00.840540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9003-edd6-4714-94f9-b0ea13d9f23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:00.844091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9003-edd6-4714-94f9-b0ea13d9f23b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:00.844556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9003-edd6-4714-94f9-b0ea13d9f23b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:00.845016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e9003-edd6-4714-94f9-b0ea13d9f23b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:00.846812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e9003-edd6-4714-94f9-b0ea13d9f23b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:00.851704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e9003-edd6-4714-94f9-b0ea13d9f23b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:00.879299 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4007/8054] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:00.886985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9003-edd6-4714-94f9-b0ea13d9f23b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:00.900167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e9003-edd6-4714-94f9-b0ea13d9f23b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:00.906613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac44d7-cb80-4a80-b0fb-725e62fb9082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:00.907828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac44d7-cb80-4a80-b0fb-725e62fb9082 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:00.908284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac44d7-cb80-4a80-b0fb-725e62fb9082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:00.908710 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac44d7-cb80-4a80-b0fb-725e62fb9082 admin admin] PATH_INFO: `/v3/projects/ba1fb6b32d414cb8969cda0cbe1582ac/users/9668af7aefa248cabf394443f04b5d51/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:00.952440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f1c87-6cd3-416d-939b-4de2139e8aa1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:00.958881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac44d7-cb80-4a80-b0fb-725e62fb9082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1fb6b32d414cb8969cda0cbe1582ac, user_id=9668af7aefa248cabf394443f04b5d51, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:00.963038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac44d7-cb80-4a80-b0fb-725e62fb9082 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:00.971511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1670bf4-2b27-40bc-8971-7e2f642d5631 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:00.972336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1670bf4-2b27-40bc-8971-7e2f642d5631 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:00.972746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1670bf4-2b27-40bc-8971-7e2f642d5631 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:00.973060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1670bf4-2b27-40bc-8971-7e2f642d5631 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:00.983882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d1670bf4-2b27-40bc-8971-7e2f642d5631 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:00.992059 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4008/8055] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:00 2022] PUT /identity/v3/projects/ba1fb6b32d414cb8969cda0cbe1582ac/users/9668af7aefa248cabf394443f04b5d51/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:00.996303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac44d7-cb80-4a80-b0fb-725e62fb9082 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:01.013574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:01.014114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1670bf4-2b27-40bc-8971-7e2f642d5631 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:01.017214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1670bf4-2b27-40bc-8971-7e2f642d5631 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:01.034884 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4048/8056] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:01.211069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac44d7-cb80-4a80-b0fb-725e62fb9082 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:01.246354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cf1c1-15a9-4f05-aaec-1e4a42225e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:01.247173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cf1c1-15a9-4f05-aaec-1e4a42225e06 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:01.247560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cf1c1-15a9-4f05-aaec-1e4a42225e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:01.247936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cf1c1-15a9-4f05-aaec-1e4a42225e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:01.249453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cf1c1-15a9-4f05-aaec-1e4a42225e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:01.256098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cf1c1-15a9-4f05-aaec-1e4a42225e06 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:01.276210 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4009/8057] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:52:01.280450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1670bf4-2b27-40bc-8971-7e2f642d5631 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:01.297333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1670bf4-2b27-40bc-8971-7e2f642d5631 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:01.302602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55503646-a636-4f80-a290-c05cbef9bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:01.303387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55503646-a636-4f80-a290-c05cbef9bcfd admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:01.303770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55503646-a636-4f80-a290-c05cbef9bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:01.304233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55503646-a636-4f80-a290-c05cbef9bcfd admin admin] PATH_INFO: `/v3/projects/ba1fb6b32d414cb8969cda0cbe1582ac/users/9668af7aefa248cabf394443f04b5d51/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:01.307425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55503646-a636-4f80-a290-c05cbef9bcfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1fb6b32d414cb8969cda0cbe1582ac, user_id=9668af7aefa248cabf394443f04b5d51, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:01.310250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55503646-a636-4f80-a290-c05cbef9bcfd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:01.322698 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4049/8058] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:01 2022] PUT /identity/v3/projects/ba1fb6b32d414cb8969cda0cbe1582ac/users/9668af7aefa248cabf394443f04b5d51/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:01.332551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcae2e-acc9-452c-8e15-392c1ce81757 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:01.332838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcae2e-acc9-452c-8e15-392c1ce81757 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:01.333104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcae2e-acc9-452c-8e15-392c1ce81757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:01.399341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0dfcae2e-acc9-452c-8e15-392c1ce81757 None None] MFA Rules not processed for user `9668af7aefa248cabf394443f04b5d51`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:01.400637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0dfcae2e-acc9-452c-8e15-392c1ce81757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:01.609320 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4010/8059] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:01.629499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55503646-a636-4f80-a290-c05cbef9bcfd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:01.631236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-55503646-a636-4f80-a290-c05cbef9bcfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:01.741729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:01.829222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55503646-a636-4f80-a290-c05cbef9bcfd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:01.833130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad400663-a689-4f57-a8a4-8c5750c08e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:01.833990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400663-a689-4f57-a8a4-8c5750c08e67 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:01.837025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400663-a689-4f57-a8a4-8c5750c08e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:01.837584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400663-a689-4f57-a8a4-8c5750c08e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:01.856334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad400663-a689-4f57-a8a4-8c5750c08e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:01.866061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad400663-a689-4f57-a8a4-8c5750c08e67 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:01.901536 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4050/8060] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:02.045920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcae2e-acc9-452c-8e15-392c1ce81757 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:02.049746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0dfcae2e-acc9-452c-8e15-392c1ce81757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:02.071208 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcae2e-acc9-452c-8e15-392c1ce81757 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:02.076717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b7c4-2958-4ac1-8097-97c9bdd55307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:02.077850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b7c4-2958-4ac1-8097-97c9bdd55307 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:02.078454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b7c4-2958-4ac1-8097-97c9bdd55307 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:02.078731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348b7c4-2958-4ac1-8097-97c9bdd55307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:02.247056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348b7c4-2958-4ac1-8097-97c9bdd55307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:02.249146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c348b7c4-2958-4ac1-8097-97c9bdd55307 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:02.264763 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4011/8061] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:02.337362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad400663-a689-4f57-a8a4-8c5750c08e67 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:02.340216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ad400663-a689-4f57-a8a4-8c5750c08e67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:02.632212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad400663-a689-4f57-a8a4-8c5750c08e67 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:02.649428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba22df-5ec3-4914-a5e4-f875046837c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:02.650163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba22df-5ec3-4914-a5e4-f875046837c6 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:02.650496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba22df-5ec3-4914-a5e4-f875046837c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:02.650757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba22df-5ec3-4914-a5e4-f875046837c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:02.657457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-41ba22df-5ec3-4914-a5e4-f875046837c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:02.721077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba22df-5ec3-4914-a5e4-f875046837c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:02.723842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba22df-5ec3-4914-a5e4-f875046837c6 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:02.761162 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4051/8062] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:05.803211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b7c4-2958-4ac1-8097-97c9bdd55307 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:05.866328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:05.966273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348b7c4-2958-4ac1-8097-97c9bdd55307 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:05.983908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:05.984564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:05.984889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:05.985087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] PATH_INFO: `/v3/users/d425cd178e2a4ebbaa5a6512743f64db` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:05.986473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d425cd178e2a4ebbaa5a6512743f64db)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:05.988416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:06.099098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd425cd178e2a4ebbaa5a6512743f64db'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:06.111078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd425cd178e2a4ebbaa5a6512743f64db'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:06.128079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd425cd178e2a4ebbaa5a6512743f64db'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:06.142959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd425cd178e2a4ebbaa5a6512743f64db'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:06.143973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd425cd178e2a4ebbaa5a6512743f64db'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:06.152702 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4012/8063] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:05 2022] DELETE /identity/v3/users/d425cd178e2a4ebbaa5a6512743f64db => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:06.158198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c127036-1cc3-462e-929e-be48a49447b4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:06.159169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c127036-1cc3-462e-929e-be48a49447b4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:06.159778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c127036-1cc3-462e-929e-be48a49447b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:06.196835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1c127036-1cc3-462e-929e-be48a49447b4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:06.198124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1c127036-1cc3-462e-929e-be48a49447b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:06.371950 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4052/8064] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:06.378695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:06.380118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:06.507778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5a060-4bcd-4b17-a715-30ccf76af4b1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:06.513726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01132c-47c9-4d94-8f77-ec7fc017b1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:06.514022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01132c-47c9-4d94-8f77-ec7fc017b1ef service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:06.514455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01132c-47c9-4d94-8f77-ec7fc017b1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:06.514732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01132c-47c9-4d94-8f77-ec7fc017b1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:06.541014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01132c-47c9-4d94-8f77-ec7fc017b1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:06.542547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01132c-47c9-4d94-8f77-ec7fc017b1ef service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:06.557028 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4013/8065] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:06.721238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c127036-1cc3-462e-929e-be48a49447b4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:06.763933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c127036-1cc3-462e-929e-be48a49447b4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:06.782455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a3bd8-0418-4d48-81bd-1559313ff0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:06.784195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a3bd8-0418-4d48-81bd-1559313ff0cd service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:06.784473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a3bd8-0418-4d48-81bd-1559313ff0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:06.784741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a3bd8-0418-4d48-81bd-1559313ff0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:06.794039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c7a3bd8-0418-4d48-81bd-1559313ff0cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:06.982982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:07.074584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a3bd8-0418-4d48-81bd-1559313ff0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:07.076140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7a3bd8-0418-4d48-81bd-1559313ff0cd service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:07.112655 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4053/8066] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:07.652609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01132c-47c9-4d94-8f77-ec7fc017b1ef service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:07.654115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9e01132c-47c9-4d94-8f77-ec7fc017b1ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:07.686805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01132c-47c9-4d94-8f77-ec7fc017b1ef service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:07.702455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:07.703116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:07.703396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:07.703669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] PATH_INFO: `/v3/projects/121dcad722534f59a50fa7dfade558c5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:07.704815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=121dcad722534f59a50fa7dfade558c5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:07.706782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:07.833237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:07.847250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '121dcad722534f59a50fa7dfade558c5', 'request_id': 'req-9525f4a3-85d2-44b2-b8be-93d529695f12'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:07.866705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '121dcad722534f59a50fa7dfade558c5', 'request_id': 'req-9525f4a3-85d2-44b2-b8be-93d529695f12'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:07.874456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '121dcad722534f59a50fa7dfade558c5', 'request_id': 'req-9525f4a3-85d2-44b2-b8be-93d529695f12'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:07.896885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] The token cache is being invalidate because project 121dcad722534f59a50fa7dfade558c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:07.897321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:07.899694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:07.908334 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4014/8067] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:07 2022] DELETE /identity/v3/projects/121dcad722534f59a50fa7dfade558c5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:07.912366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a3bd8-0418-4d48-81bd-1559313ff0cd service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:07.929289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a3bd8-0418-4d48-81bd-1559313ff0cd service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:08.096219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:08.097652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:08.097951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:08.098223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] PATH_INFO: `/v3/users/9668af7aefa248cabf394443f04b5d51` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:08.099453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9668af7aefa248cabf394443f04b5d51)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:08.101997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:08.218616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9668af7aefa248cabf394443f04b5d51'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:08.219529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9668af7aefa248cabf394443f04b5d51'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:08.228628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9668af7aefa248cabf394443f04b5d51'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:08.246605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9668af7aefa248cabf394443f04b5d51'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:08.280368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b333ee5d-c6d4-4561-b95a-4897f288fe6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9668af7aefa248cabf394443f04b5d51'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:08.298721 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4054/8068] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:07 2022] DELETE /identity/v3/users/9668af7aefa248cabf394443f04b5d51 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:08.395272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:08.397128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:08.424823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525f4a3-85d2-44b2-b8be-93d529695f12 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:08.548371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:08.550688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:08.551574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:08.552428 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] PATH_INFO: `/v3/users/6e0e8ba698c94dea89eed235783eb420` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:08.555133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e0e8ba698c94dea89eed235783eb420)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:08.557592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:08.655383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e0e8ba698c94dea89eed235783eb420'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:08.676572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e0e8ba698c94dea89eed235783eb420'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:08.719330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e0e8ba698c94dea89eed235783eb420'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:08.737910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e0e8ba698c94dea89eed235783eb420'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:08.738450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e0e8ba698c94dea89eed235783eb420'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:08.752187 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4015/8069] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:08 2022] DELETE /identity/v3/users/6e0e8ba698c94dea89eed235783eb420 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:08.753675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9581-145c-4f8b-9732-4b6431012176 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:08.754067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9581-145c-4f8b-9732-4b6431012176 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:08.754340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9581-145c-4f8b-9732-4b6431012176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:08.809391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e7ab9581-145c-4f8b-9732-4b6431012176 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:08.813777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e7ab9581-145c-4f8b-9732-4b6431012176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:08.943923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:08.976533 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4055/8070] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:52:09.236476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:09.238036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:09.295539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab9581-145c-4f8b-9732-4b6431012176 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:09.297684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e7ab9581-145c-4f8b-9732-4b6431012176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:09.321207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab9581-145c-4f8b-9732-4b6431012176 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:09.333665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:09.334763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:09.334763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:09.335034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] PATH_INFO: `/v3/projects/ba1fb6b32d414cb8969cda0cbe1582ac` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:09.340084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1fb6b32d414cb8969cda0cbe1582ac)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:09.342074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:09.359742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:09.376072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facfbf6-2bbe-4e1d-b245-f443ddb03163 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:09.389284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943fee9-5035-467f-8bf2-cd0f84fa2bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:09.389987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943fee9-5035-467f-8bf2-cd0f84fa2bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:09.390266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943fee9-5035-467f-8bf2-cd0f84fa2bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:09.390542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943fee9-5035-467f-8bf2-cd0f84fa2bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:09.408044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943fee9-5035-467f-8bf2-cd0f84fa2bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:09.409512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943fee9-5035-467f-8bf2-cd0f84fa2bc7 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:09.438594 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4016/8071] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:09.507453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1fb6b32d414cb8969cda0cbe1582ac', 'request_id': 'req-0b3c940c-febe-40fe-8950-c706950eb522'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:09.524818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1fb6b32d414cb8969cda0cbe1582ac', 'request_id': 'req-0b3c940c-febe-40fe-8950-c706950eb522'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:09.545359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1fb6b32d414cb8969cda0cbe1582ac', 'request_id': 'req-0b3c940c-febe-40fe-8950-c706950eb522'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:09.627988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] The token cache is being invalidate because project ba1fb6b32d414cb8969cda0cbe1582ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:09.628799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:09.629941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0b3c940c-febe-40fe-8950-c706950eb522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:09.639751 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4056/8072] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:09 2022] DELETE /identity/v3/projects/ba1fb6b32d414cb8969cda0cbe1582ac => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:52:09.641533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c196-41c1-4070-999e-cc041fb8981d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:09.641953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c196-41c1-4070-999e-cc041fb8981d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:09.642231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88c196-41c1-4070-999e-cc041fb8981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:09.689237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1f88c196-41c1-4070-999e-cc041fb8981d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:09.690915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1f88c196-41c1-4070-999e-cc041fb8981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:09.838269 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4017/8073] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:52:09.844941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321b2ff-1e62-4088-be28-6e7cca8c53f5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:09.845432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321b2ff-1e62-4088-be28-6e7cca8c53f5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:09.845979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321b2ff-1e62-4088-be28-6e7cca8c53f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:09.874832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a321b2ff-1e62-4088-be28-6e7cca8c53f5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:09.878067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a321b2ff-1e62-4088-be28-6e7cca8c53f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:09.901020 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4057/8074] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:09.905598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c196-41c1-4070-999e-cc041fb8981d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:09.931849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88c196-41c1-4070-999e-cc041fb8981d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:09.942974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f869c90-1b69-4742-aa25-5a55011cd8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:09.943919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869c90-1b69-4742-aa25-5a55011cd8da admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:09.944466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869c90-1b69-4742-aa25-5a55011cd8da admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:09.944678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f869c90-1b69-4742-aa25-5a55011cd8da admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:09.946291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f869c90-1b69-4742-aa25-5a55011cd8da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:52:09.946831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f869c90-1b69-4742-aa25-5a55011cd8da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:09.948785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f869c90-1b69-4742-aa25-5a55011cd8da admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:09.973945 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4018/8075] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:52:09.977779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321b2ff-1e62-4088-be28-6e7cca8c53f5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:09.994684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321b2ff-1e62-4088-be28-6e7cca8c53f5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:10.003067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c80f5-10f7-455f-ba80-2de8d48c1db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:10.003811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c80f5-10f7-455f-ba80-2de8d48c1db5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:10.004181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c80f5-10f7-455f-ba80-2de8d48c1db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:10.004541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c80f5-10f7-455f-ba80-2de8d48c1db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:10.005296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c80f5-10f7-455f-ba80-2de8d48c1db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:10.013139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c80f5-10f7-455f-ba80-2de8d48c1db5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:10.096793 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4058/8076] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:09 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:52:10.097638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f869c90-1b69-4742-aa25-5a55011cd8da admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:10.118512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f869c90-1b69-4742-aa25-5a55011cd8da admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:10.249703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11804c2-bb0d-4cbf-9b2b-32f643845bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:10.250656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11804c2-bb0d-4cbf-9b2b-32f643845bbd admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:10.251417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11804c2-bb0d-4cbf-9b2b-32f643845bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:10.252003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11804c2-bb0d-4cbf-9b2b-32f643845bbd admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:10.252886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11804c2-bb0d-4cbf-9b2b-32f643845bbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:10.255386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11804c2-bb0d-4cbf-9b2b-32f643845bbd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:10.306821 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4019/8077] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:10 2022] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:52:10.310675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c80f5-10f7-455f-ba80-2de8d48c1db5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:10.327415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c80f5-10f7-455f-ba80-2de8d48c1db5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:10.342562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd90f5-2ec5-424a-bfe0-d2c0dba6102f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:10.343359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd90f5-2ec5-424a-bfe0-d2c0dba6102f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:10.343775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd90f5-2ec5-424a-bfe0-d2c0dba6102f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:10.344225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd90f5-2ec5-424a-bfe0-d2c0dba6102f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:10.344981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd90f5-2ec5-424a-bfe0-d2c0dba6102f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:10.349046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd90f5-2ec5-424a-bfe0-d2c0dba6102f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:10.375122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11804c2-bb0d-4cbf-9b2b-32f643845bbd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:10.376434 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4059/8078] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:10.390295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11804c2-bb0d-4cbf-9b2b-32f643845bbd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:10.405191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524a967-86a2-4989-9665-3e27e5dc2b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:10.408838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a967-86a2-4989-9665-3e27e5dc2b79 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:10.409231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a967-86a2-4989-9665-3e27e5dc2b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:10.410231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524a967-86a2-4989-9665-3e27e5dc2b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:10.410658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524a967-86a2-4989-9665-3e27e5dc2b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:10.412927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524a967-86a2-4989-9665-3e27e5dc2b79 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:10.444631 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4020/8079] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:10.446266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd90f5-2ec5-424a-bfe0-d2c0dba6102f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:10.460426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd90f5-2ec5-424a-bfe0-d2c0dba6102f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:10.477255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939536b-f83d-4879-9340-eafadbe9f927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:10.477533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939536b-f83d-4879-9340-eafadbe9f927 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:10.477951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939536b-f83d-4879-9340-eafadbe9f927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:10.478345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939536b-f83d-4879-9340-eafadbe9f927 admin admin] PATH_INFO: `/v3/projects/12355ea39d6f49b796b3a731c5ba1d81/users/108a21fda6c047b8acfa48ca1d606735/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:10.510035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939536b-f83d-4879-9340-eafadbe9f927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12355ea39d6f49b796b3a731c5ba1d81, user_id=108a21fda6c047b8acfa48ca1d606735, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:10.513229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939536b-f83d-4879-9340-eafadbe9f927 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:10.606301 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4060/8080] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:10 2022] PUT /identity/v3/projects/12355ea39d6f49b796b3a731c5ba1d81/users/108a21fda6c047b8acfa48ca1d606735/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:52:10.617308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8396ef-7f76-4380-b677-342e78e860c8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:10.617622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8396ef-7f76-4380-b677-342e78e860c8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:10.617859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8396ef-7f76-4380-b677-342e78e860c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:10.700389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8e8396ef-7f76-4380-b677-342e78e860c8 None None] MFA Rules not processed for user `108a21fda6c047b8acfa48ca1d606735`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:10.701636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8e8396ef-7f76-4380-b677-342e78e860c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:10.802953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:10.855758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939536b-f83d-4879-9340-eafadbe9f927 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:10.865264 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4021/8081] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:10.979124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8396ef-7f76-4380-b677-342e78e860c8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:10.980874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8e8396ef-7f76-4380-b677-342e78e860c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:11.024813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939536b-f83d-4879-9340-eafadbe9f927 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:11.078997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff1df0-df5b-4ff7-ae62-b4ce3e7dcbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:11.079630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff1df0-df5b-4ff7-ae62-b4ce3e7dcbc9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:11.080246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff1df0-df5b-4ff7-ae62-b4ce3e7dcbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:11.080690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff1df0-df5b-4ff7-ae62-b4ce3e7dcbc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:11.082145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff1df0-df5b-4ff7-ae62-b4ce3e7dcbc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:11.086674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff1df0-df5b-4ff7-ae62-b4ce3e7dcbc9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:11.149586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8396ef-7f76-4380-b677-342e78e860c8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:11.159931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:11.161219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:11.161704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:11.162546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] PATH_INFO: `/v3/projects/52fe984e6f9443d78840be01cb9c6381` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:11.179334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:11.186621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fe984e6f9443d78840be01cb9c6381)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:11.191606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:11.205202 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4061/8082] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:10 2022] POST /identity/v3/projects => generated 367 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:52:11.206525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff1df0-df5b-4ff7-ae62-b4ce3e7dcbc9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:11.215871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0dff1df0-df5b-4ff7-ae62-b4ce3e7dcbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:11.313305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fe984e6f9443d78840be01cb9c6381', 'request_id': 'req-ed1f9dd2-f5f5-4269-8677-9bba7b991237'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:11.335080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fe984e6f9443d78840be01cb9c6381', 'request_id': 'req-ed1f9dd2-f5f5-4269-8677-9bba7b991237'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:11.343878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fe984e6f9443d78840be01cb9c6381', 'request_id': 'req-ed1f9dd2-f5f5-4269-8677-9bba7b991237'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:11.384749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] The token cache is being invalidate because project 52fe984e6f9443d78840be01cb9c6381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:11.384993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:11.386953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:11.392989 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4022/8083] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:10 2022] DELETE /identity/v3/projects/52fe984e6f9443d78840be01cb9c6381 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:52:11.393828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:11.399436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:11.424953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff1df0-df5b-4ff7-ae62-b4ce3e7dcbc9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:11.533818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f9dd2-f5f5-4269-8677-9bba7b991237 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:11.556157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b1547-875d-4cef-8263-715d4c198a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:11.575746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b1547-875d-4cef-8263-715d4c198a21 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:11.576069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b1547-875d-4cef-8263-715d4c198a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:11.578126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b1547-875d-4cef-8263-715d4c198a21 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:11.578992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b1547-875d-4cef-8263-715d4c198a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:11.585833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b1547-875d-4cef-8263-715d4c198a21 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:11.629977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ed144-a6b7-4b01-864a-626343f57584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:11.630623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ed144-a6b7-4b01-864a-626343f57584 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:11.630898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ed144-a6b7-4b01-864a-626343f57584 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:11.631202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ed144-a6b7-4b01-864a-626343f57584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:11.636941 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4023/8084] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:11 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:11.638224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b1547-875d-4cef-8263-715d4c198a21 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:11.640341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-978ed144-a6b7-4b01-864a-626343f57584 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:11.643078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-241b1547-875d-4cef-8263-715d4c198a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:11.660279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:11.667568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b1547-875d-4cef-8263-715d4c198a21 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:11.669692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ed144-a6b7-4b01-864a-626343f57584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:11.675953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:11.676157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ed144-a6b7-4b01-864a-626343f57584 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:11.677860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:11.678417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:11.679102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] PATH_INFO: `/v3/users/680fee713cb345029ba2bbdf73edb2ba` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:11.680716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=680fee713cb345029ba2bbdf73edb2ba)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:11.683150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:11.701124 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4062/8085] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:11.702015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ed144-a6b7-4b01-864a-626343f57584 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:11.727609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ed144-a6b7-4b01-864a-626343f57584 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:11.742592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a505ae4-e083-46d3-84bc-ad852c80b603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:11.743385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a505ae4-e083-46d3-84bc-ad852c80b603 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:11.743657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a505ae4-e083-46d3-84bc-ad852c80b603 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:11.743940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a505ae4-e083-46d3-84bc-ad852c80b603 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:11.744586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a505ae4-e083-46d3-84bc-ad852c80b603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:11.746301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a505ae4-e083-46d3-84bc-ad852c80b603 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:11.775378 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4063/8086] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:11.776291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a505ae4-e083-46d3-84bc-ad852c80b603 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:11.784359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680fee713cb345029ba2bbdf73edb2ba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:11.797648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680fee713cb345029ba2bbdf73edb2ba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:11.799682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a505ae4-e083-46d3-84bc-ad852c80b603 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:11.812582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680fee713cb345029ba2bbdf73edb2ba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:11.815387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6c971-984e-422f-9f58-654fe050a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:11.816320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c971-984e-422f-9f58-654fe050a4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:11.816320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c971-984e-422f-9f58-654fe050a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:11.816639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6c971-984e-422f-9f58-654fe050a4b8 admin admin] PATH_INFO: `/v3/projects/76b3ac4a927c40248425ba8ebf5be9d5/users/df44068c8ec143a6b5979096643f3a7d/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:11.836353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680fee713cb345029ba2bbdf73edb2ba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:11.837827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680fee713cb345029ba2bbdf73edb2ba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:11.852734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6c971-984e-422f-9f58-654fe050a4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b3ac4a927c40248425ba8ebf5be9d5, user_id=df44068c8ec143a6b5979096643f3a7d, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:11.856441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6c971-984e-422f-9f58-654fe050a4b8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:11.863724 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4024/8087] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:11 2022] DELETE /identity/v3/users/680fee713cb345029ba2bbdf73edb2ba => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:11.885482 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4064/8088] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:11 2022] PUT /identity/v3/projects/76b3ac4a927c40248425ba8ebf5be9d5/users/df44068c8ec143a6b5979096643f3a7d/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:11.889642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:11.892310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:12.074169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f93555-d11b-4276-afa5-24d2eec02f94 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:12.221556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696ac36-c8d7-4ddd-8fd7-eb130c38326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:12.224647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ac36-c8d7-4ddd-8fd7-eb130c38326f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:12.225042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ac36-c8d7-4ddd-8fd7-eb130c38326f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:12.226130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ac36-c8d7-4ddd-8fd7-eb130c38326f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:12.230590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696ac36-c8d7-4ddd-8fd7-eb130c38326f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:12.242120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696ac36-c8d7-4ddd-8fd7-eb130c38326f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:12.275059 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4025/8089] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:12.279435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6c971-984e-422f-9f58-654fe050a4b8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:12.298008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6c971-984e-422f-9f58-654fe050a4b8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:12.306519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec74bc-82b0-4a17-b76e-bea8f10a11a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:12.307532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec74bc-82b0-4a17-b76e-bea8f10a11a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:12.308015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec74bc-82b0-4a17-b76e-bea8f10a11a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:12.308452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec74bc-82b0-4a17-b76e-bea8f10a11a3 admin admin] PATH_INFO: `/v3/projects/76b3ac4a927c40248425ba8ebf5be9d5/users/df44068c8ec143a6b5979096643f3a7d/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:12.318002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec74bc-82b0-4a17-b76e-bea8f10a11a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b3ac4a927c40248425ba8ebf5be9d5, user_id=df44068c8ec143a6b5979096643f3a7d, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:12.318002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec74bc-82b0-4a17-b76e-bea8f10a11a3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:12.330596 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4065/8090] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:12 2022] PUT /identity/v3/projects/76b3ac4a927c40248425ba8ebf5be9d5/users/df44068c8ec143a6b5979096643f3a7d/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:12.343199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a978e7-9a4e-4e69-9d12-68db6c8863e3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:12.343487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a978e7-9a4e-4e69-9d12-68db6c8863e3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:12.343812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a978e7-9a4e-4e69-9d12-68db6c8863e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:12.412055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-13a978e7-9a4e-4e69-9d12-68db6c8863e3 None None] MFA Rules not processed for user `df44068c8ec143a6b5979096643f3a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:12.413618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-13a978e7-9a4e-4e69-9d12-68db6c8863e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:12.428526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:12.588379 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4026/8091] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:12.595698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec74bc-82b0-4a17-b76e-bea8f10a11a3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:12.602819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c6ec74bc-82b0-4a17-b76e-bea8f10a11a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:12.702711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:12.748754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec74bc-82b0-4a17-b76e-bea8f10a11a3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:12.757716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431590c-a22f-4dc3-a9dc-bb1ffe3a4148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:12.758471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431590c-a22f-4dc3-a9dc-bb1ffe3a4148 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:12.766355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431590c-a22f-4dc3-a9dc-bb1ffe3a4148 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:12.768333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431590c-a22f-4dc3-a9dc-bb1ffe3a4148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:12.823255 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431590c-a22f-4dc3-a9dc-bb1ffe3a4148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:12.826220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431590c-a22f-4dc3-a9dc-bb1ffe3a4148 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:12.873960 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4066/8092] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:12.960669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a978e7-9a4e-4e69-9d12-68db6c8863e3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:12.963245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-13a978e7-9a4e-4e69-9d12-68db6c8863e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:12.993622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a978e7-9a4e-4e69-9d12-68db6c8863e3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:13.008092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154f29a-d159-4a88-b962-367d0d84308f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:13.009071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154f29a-d159-4a88-b962-367d0d84308f service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:13.009535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154f29a-d159-4a88-b962-367d0d84308f service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:13.010162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154f29a-d159-4a88-b962-367d0d84308f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:13.014171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2154f29a-d159-4a88-b962-367d0d84308f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:13.163989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154f29a-d159-4a88-b962-367d0d84308f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:13.166092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154f29a-d159-4a88-b962-367d0d84308f service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:13.204332 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4027/8093] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:13.231664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431590c-a22f-4dc3-a9dc-bb1ffe3a4148 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:13.237317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0431590c-a22f-4dc3-a9dc-bb1ffe3a4148 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:13.412766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431590c-a22f-4dc3-a9dc-bb1ffe3a4148 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:13.425811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:13.426501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:13.426778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:13.427048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] PATH_INFO: `/v3/projects/36bcc791229f43a68d28aeba76be5d4d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:13.432381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36bcc791229f43a68d28aeba76be5d4d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:13.432381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:13.554481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36bcc791229f43a68d28aeba76be5d4d', 'request_id': 'req-34e0fc82-51b3-454a-9f83-839280969314'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:13.580381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36bcc791229f43a68d28aeba76be5d4d', 'request_id': 'req-34e0fc82-51b3-454a-9f83-839280969314'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:13.601553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36bcc791229f43a68d28aeba76be5d4d', 'request_id': 'req-34e0fc82-51b3-454a-9f83-839280969314'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:13.631085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] The token cache is being invalidate because project 36bcc791229f43a68d28aeba76be5d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:13.631388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:13.636995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-34e0fc82-51b3-454a-9f83-839280969314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:13.641356 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4067/8094] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:13 2022] DELETE /identity/v3/projects/36bcc791229f43a68d28aeba76be5d4d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:13.649930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3169bb3-5851-4bd7-a83a-ca35959c99aa None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:13.650230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3169bb3-5851-4bd7-a83a-ca35959c99aa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:13.650458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3169bb3-5851-4bd7-a83a-ca35959c99aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:13.691125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b3169bb3-5851-4bd7-a83a-ca35959c99aa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:13.692443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b3169bb3-5851-4bd7-a83a-ca35959c99aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:13.782359 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4028/8095] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:13.783997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d2368-1219-41b8-a3d4-2bc664801b0a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:13.784360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d2368-1219-41b8-a3d4-2bc664801b0a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:13.785240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d2368-1219-41b8-a3d4-2bc664801b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:13.827489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f30d2368-1219-41b8-a3d4-2bc664801b0a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:13.831403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f30d2368-1219-41b8-a3d4-2bc664801b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:13.856173 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4068/8096] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:13.858531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3169bb3-5851-4bd7-a83a-ca35959c99aa None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:13.871992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3169bb3-5851-4bd7-a83a-ca35959c99aa None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:13.887133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7ed1a-bd1c-4ddd-9132-fd6b33c92057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:13.888168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7ed1a-bd1c-4ddd-9132-fd6b33c92057 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:13.888168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7ed1a-bd1c-4ddd-9132-fd6b33c92057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:13.888688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7ed1a-bd1c-4ddd-9132-fd6b33c92057 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:13.889905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7ed1a-bd1c-4ddd-9132-fd6b33c92057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:52:13.892291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7ed1a-bd1c-4ddd-9132-fd6b33c92057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:13.894123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7ed1a-bd1c-4ddd-9132-fd6b33c92057 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:13.924703 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4029/8097] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:52:13.929421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d2368-1219-41b8-a3d4-2bc664801b0a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:13.940666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d2368-1219-41b8-a3d4-2bc664801b0a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:13.947497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6edea-6dc6-4931-a131-820ab4e26470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:13.948205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6edea-6dc6-4931-a131-820ab4e26470 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:13.948599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6edea-6dc6-4931-a131-820ab4e26470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:13.949704 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6edea-6dc6-4931-a131-820ab4e26470 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:13.950516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6edea-6dc6-4931-a131-820ab4e26470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:13.953195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6edea-6dc6-4931-a131-820ab4e26470 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:14.000559 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4069/8098] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:13 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:14.004490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7ed1a-bd1c-4ddd-9132-fd6b33c92057 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:14.015483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7ed1a-bd1c-4ddd-9132-fd6b33c92057 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:14.062076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:14.103292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacc778-0448-4810-a01f-351891a92b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:14.103929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacc778-0448-4810-a01f-351891a92b5e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:14.104201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacc778-0448-4810-a01f-351891a92b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:14.104465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacc778-0448-4810-a01f-351891a92b5e admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:14.105485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacc778-0448-4810-a01f-351891a92b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:14.107556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacc778-0448-4810-a01f-351891a92b5e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:14.136075 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4030/8099] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:14 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:14.137306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6edea-6dc6-4931-a131-820ab4e26470 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:14.151551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6edea-6dc6-4931-a131-820ab4e26470 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:14.162388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51925df-d743-444c-9a8b-8cc235f1610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:14.163512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51925df-d743-444c-9a8b-8cc235f1610d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:14.163823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51925df-d743-444c-9a8b-8cc235f1610d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:14.164762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51925df-d743-444c-9a8b-8cc235f1610d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:14.165345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51925df-d743-444c-9a8b-8cc235f1610d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:14.167793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51925df-d743-444c-9a8b-8cc235f1610d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:14.185156 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4070/8100] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:14.186469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacc778-0448-4810-a01f-351891a92b5e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:14.202532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacc778-0448-4810-a01f-351891a92b5e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:14.208231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d830a-be61-4de1-aeba-4021695c202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:14.209123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d830a-be61-4de1-aeba-4021695c202b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:14.209404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d830a-be61-4de1-aeba-4021695c202b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:14.209674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d830a-be61-4de1-aeba-4021695c202b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:14.210372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d830a-be61-4de1-aeba-4021695c202b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:14.212312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d830a-be61-4de1-aeba-4021695c202b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:14.228438 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4031/8101] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:14.233072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51925df-d743-444c-9a8b-8cc235f1610d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:14.244728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51925df-d743-444c-9a8b-8cc235f1610d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:14.250048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cf194-3809-4782-a85d-cf90314dab57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:14.251322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cf194-3809-4782-a85d-cf90314dab57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:14.251780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cf194-3809-4782-a85d-cf90314dab57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:14.252322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cf194-3809-4782-a85d-cf90314dab57 admin admin] PATH_INFO: `/v3/projects/4c8711d1fa3844308bc9a805ec56931a/users/7cc9a14732c94c9abee5821469c68bb2/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:14.269428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cf194-3809-4782-a85d-cf90314dab57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8711d1fa3844308bc9a805ec56931a, user_id=7cc9a14732c94c9abee5821469c68bb2, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:14.272855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cf194-3809-4782-a85d-cf90314dab57 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:14.301721 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4071/8102] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:14 2022] PUT /identity/v3/projects/4c8711d1fa3844308bc9a805ec56931a/users/7cc9a14732c94c9abee5821469c68bb2/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:52:14.314203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42de8b-6088-4d47-a4b8-f40e00ddb2e4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:14.314460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42de8b-6088-4d47-a4b8-f40e00ddb2e4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:14.314796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42de8b-6088-4d47-a4b8-f40e00ddb2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:14.344995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ff42de8b-6088-4d47-a4b8-f40e00ddb2e4 None None] MFA Rules not processed for user `7cc9a14732c94c9abee5821469c68bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:14.346247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ff42de8b-6088-4d47-a4b8-f40e00ddb2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:14.455916 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4032/8103] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:14.460685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cf194-3809-4782-a85d-cf90314dab57 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:14.472899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:14.576498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cf194-3809-4782-a85d-cf90314dab57 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:14.583503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf3354-7735-4809-b26f-0366b12b3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:14.584237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf3354-7735-4809-b26f-0366b12b3567 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:14.584585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf3354-7735-4809-b26f-0366b12b3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:14.584950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf3354-7735-4809-b26f-0366b12b3567 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:14.586137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf3354-7735-4809-b26f-0366b12b3567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:14.588337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf3354-7735-4809-b26f-0366b12b3567 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:14.645045 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4072/8104] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:14 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:52:14.646393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42de8b-6088-4d47-a4b8-f40e00ddb2e4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:14.663203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42de8b-6088-4d47-a4b8-f40e00ddb2e4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:14.735093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569d2bb-4515-4b1c-80a1-a768111d4214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:14.735732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569d2bb-4515-4b1c-80a1-a768111d4214 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:14.736128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569d2bb-4515-4b1c-80a1-a768111d4214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:14.736409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569d2bb-4515-4b1c-80a1-a768111d4214 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:14.737114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569d2bb-4515-4b1c-80a1-a768111d4214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:14.739304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2569d2bb-4515-4b1c-80a1-a768111d4214 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:14.773937 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4033/8105] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:14 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:52:14.777100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf3354-7735-4809-b26f-0366b12b3567 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:14.788038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf3354-7735-4809-b26f-0366b12b3567 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:14.793357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7b4cd-7743-461f-8854-55a01454ee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:14.794023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b4cd-7743-461f-8854-55a01454ee1d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:14.794293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b4cd-7743-461f-8854-55a01454ee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:14.794555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7b4cd-7743-461f-8854-55a01454ee1d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:14.795193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7b4cd-7743-461f-8854-55a01454ee1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:14.796879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7b4cd-7743-461f-8854-55a01454ee1d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:14.809309 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4073/8106] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:14.813575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569d2bb-4515-4b1c-80a1-a768111d4214 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:14.824717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569d2bb-4515-4b1c-80a1-a768111d4214 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:14.829726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44a80d-a6e1-4045-bbdb-3e3c4b4cc180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:14.830903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44a80d-a6e1-4045-bbdb-3e3c4b4cc180 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:14.831279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44a80d-a6e1-4045-bbdb-3e3c4b4cc180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:14.831646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44a80d-a6e1-4045-bbdb-3e3c4b4cc180 admin admin] PATH_INFO: `/v3/projects/1555634a43554416829655e8d575534c/users/d373fe959ff54aad910eb75343332378/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:14.860269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44a80d-a6e1-4045-bbdb-3e3c4b4cc180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1555634a43554416829655e8d575534c, user_id=d373fe959ff54aad910eb75343332378, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:14.863694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44a80d-a6e1-4045-bbdb-3e3c4b4cc180 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:14.885359 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4034/8107] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:14 2022] PUT /identity/v3/projects/1555634a43554416829655e8d575534c/users/d373fe959ff54aad910eb75343332378/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:14.889587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7b4cd-7743-461f-8854-55a01454ee1d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:14.901209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7b4cd-7743-461f-8854-55a01454ee1d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:14.984974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8fa78-3861-41ab-a992-bb9ce10a33b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:14.985666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8fa78-3861-41ab-a992-bb9ce10a33b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:14.986029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8fa78-3861-41ab-a992-bb9ce10a33b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:14.986362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8fa78-3861-41ab-a992-bb9ce10a33b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:14.987070 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8fa78-3861-41ab-a992-bb9ce10a33b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:14.988719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8fa78-3861-41ab-a992-bb9ce10a33b1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:15.001028 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4074/8108] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:15.005008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44a80d-a6e1-4045-bbdb-3e3c4b4cc180 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:15.036773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:15.043183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44a80d-a6e1-4045-bbdb-3e3c4b4cc180 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:15.051285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a96838-2b3d-4f40-a614-761c4047fcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:15.052263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a96838-2b3d-4f40-a614-761c4047fcab admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:15.052493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a96838-2b3d-4f40-a614-761c4047fcab admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:15.052768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a96838-2b3d-4f40-a614-761c4047fcab admin admin] PATH_INFO: `/v3/projects/1555634a43554416829655e8d575534c/users/d373fe959ff54aad910eb75343332378/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:15.055236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a96838-2b3d-4f40-a614-761c4047fcab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1555634a43554416829655e8d575534c, user_id=d373fe959ff54aad910eb75343332378, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:15.061059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a96838-2b3d-4f40-a614-761c4047fcab admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:15.118124 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4035/8109] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:15 2022] PUT /identity/v3/projects/1555634a43554416829655e8d575534c/users/d373fe959ff54aad910eb75343332378/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:52:15.120951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624c810-29ba-4f85-9715-1088c5451b1c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:15.121296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624c810-29ba-4f85-9715-1088c5451b1c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:15.121633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624c810-29ba-4f85-9715-1088c5451b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:15.167306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8624c810-29ba-4f85-9715-1088c5451b1c None None] MFA Rules not processed for user `d373fe959ff54aad910eb75343332378`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:15.168682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8624c810-29ba-4f85-9715-1088c5451b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:15.252197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:15.272160 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4075/8110] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:52:15.294901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a96838-2b3d-4f40-a614-761c4047fcab admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:15.297792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-17a96838-2b3d-4f40-a614-761c4047fcab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:15.428780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a96838-2b3d-4f40-a614-761c4047fcab admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:15.434584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c558e-e58c-4768-a780-e33b9f129f7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:15.446921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c558e-e58c-4768-a780-e33b9f129f7a service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:15.446921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c558e-e58c-4768-a780-e33b9f129f7a service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:15.447180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c558e-e58c-4768-a780-e33b9f129f7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:15.608693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c558e-e58c-4768-a780-e33b9f129f7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:15.610156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c558e-e58c-4768-a780-e33b9f129f7a service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:15.625611 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4036/8111] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:17.693231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624c810-29ba-4f85-9715-1088c5451b1c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:17.695564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8624c810-29ba-4f85-9715-1088c5451b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:17.823714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624c810-29ba-4f85-9715-1088c5451b1c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:17.828775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:17.829617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:17.830104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:17.830281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] PATH_INFO: `/v3/users/108a21fda6c047b8acfa48ca1d606735` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:17.831686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] RBAC: Authorizing `identity:delete_user(user_id=108a21fda6c047b8acfa48ca1d606735)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:17.833224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:17.921686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108a21fda6c047b8acfa48ca1d606735'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:17.922608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108a21fda6c047b8acfa48ca1d606735'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:17.932356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108a21fda6c047b8acfa48ca1d606735'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:17.946995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108a21fda6c047b8acfa48ca1d606735'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:17.969589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108a21fda6c047b8acfa48ca1d606735'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:17.982160 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4076/8112] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:17 2022] DELETE /identity/v3/users/108a21fda6c047b8acfa48ca1d606735 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:17.983460 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1429-f28b-4e51-8df3-ee93dfa6c451 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:17.983975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1429-f28b-4e51-8df3-ee93dfa6c451 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:17.984147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1429-f28b-4e51-8df3-ee93dfa6c451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:18.032185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-419c1429-f28b-4e51-8df3-ee93dfa6c451 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:18.033714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-419c1429-f28b-4e51-8df3-ee93dfa6c451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:18.115809 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4037/8113] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:18.126552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:18.131616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:18.253382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e816ec7-6958-4eac-a061-b54a03db972e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:18.265386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322f1b4-213d-4f5c-ae6b-eab491219897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:18.266047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322f1b4-213d-4f5c-ae6b-eab491219897 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:18.266322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322f1b4-213d-4f5c-ae6b-eab491219897 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:18.266588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322f1b4-213d-4f5c-ae6b-eab491219897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:18.280930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322f1b4-213d-4f5c-ae6b-eab491219897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:18.282762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322f1b4-213d-4f5c-ae6b-eab491219897 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:18.304864 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4077/8114] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:52:19.203279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c1429-f28b-4e51-8df3-ee93dfa6c451 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:19.205253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-419c1429-f28b-4e51-8df3-ee93dfa6c451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:19.243894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c1429-f28b-4e51-8df3-ee93dfa6c451 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:19.256992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:19.258059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:19.258506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:19.258944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] PATH_INFO: `/v3/projects/12355ea39d6f49b796b3a731c5ba1d81` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:19.260364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12355ea39d6f49b796b3a731c5ba1d81)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:19.262787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:19.398405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:19.406413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12355ea39d6f49b796b3a731c5ba1d81', 'request_id': 'req-e7dfbad3-13c9-4a73-a38c-5e0550842a36'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:19.435087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12355ea39d6f49b796b3a731c5ba1d81', 'request_id': 'req-e7dfbad3-13c9-4a73-a38c-5e0550842a36'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:19.444294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12355ea39d6f49b796b3a731c5ba1d81', 'request_id': 'req-e7dfbad3-13c9-4a73-a38c-5e0550842a36'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:19.481821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] The token cache is being invalidate because project 12355ea39d6f49b796b3a731c5ba1d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:19.482246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:19.483377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:19.484947 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4038/8115] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:19 2022] DELETE /identity/v3/projects/12355ea39d6f49b796b3a731c5ba1d81 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:19.489267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322f1b4-213d-4f5c-ae6b-eab491219897 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:19.505439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322f1b4-213d-4f5c-ae6b-eab491219897 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:19.535714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:19.598495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:19.599496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:19.599874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:19.600483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] PATH_INFO: `/v3/users/df44068c8ec143a6b5979096643f3a7d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:19.602479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df44068c8ec143a6b5979096643f3a7d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:19.605306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:19.672972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df44068c8ec143a6b5979096643f3a7d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:19.673768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df44068c8ec143a6b5979096643f3a7d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:19.687254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df44068c8ec143a6b5979096643f3a7d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:19.707618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df44068c8ec143a6b5979096643f3a7d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:19.725233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-40f67324-e2d3-42b8-a82d-611b08ec2c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df44068c8ec143a6b5979096643f3a7d'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:19.737975 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4078/8116] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:19 2022] DELETE /identity/v3/users/df44068c8ec143a6b5979096643f3a7d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:21.027804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:21.029966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:21.052670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfbad3-13c9-4a73-a38c-5e0550842a36 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:21.128826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:21.129930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:21.130376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:21.130890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] PATH_INFO: `/v3/projects/76b3ac4a927c40248425ba8ebf5be9d5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:21.132547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b3ac4a927c40248425ba8ebf5be9d5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:21.135338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:21.259224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b3ac4a927c40248425ba8ebf5be9d5', 'request_id': 'req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:21.283337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b3ac4a927c40248425ba8ebf5be9d5', 'request_id': 'req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:21.295021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b3ac4a927c40248425ba8ebf5be9d5', 'request_id': 'req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:21.362739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] The token cache is being invalidate because project 76b3ac4a927c40248425ba8ebf5be9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:21.365020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:21.365020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-13a8a7c1-4ad5-4e7f-9b5d-3ae45dc6b5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:21.366766 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4039/8117] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:21 2022] DELETE /identity/v3/projects/76b3ac4a927c40248425ba8ebf5be9d5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:21.371712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75059-52d4-4186-b681-eb32ff241eef None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:21.372562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75059-52d4-4186-b681-eb32ff241eef None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:21.373153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75059-52d4-4186-b681-eb32ff241eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:21.435559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-59d75059-52d4-4186-b681-eb32ff241eef None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:21.436290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-59d75059-52d4-4186-b681-eb32ff241eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:21.624736 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4079/8118] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:21.626530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d3589-4e2e-4d36-bbec-2fe3e1a59fc1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:21.626820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d3589-4e2e-4d36-bbec-2fe3e1a59fc1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:21.627093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d3589-4e2e-4d36-bbec-2fe3e1a59fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:21.771216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ae9d3589-4e2e-4d36-bbec-2fe3e1a59fc1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:21.772759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ae9d3589-4e2e-4d36-bbec-2fe3e1a59fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:21.849635 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4040/8119] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:21.850875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d75059-52d4-4186-b681-eb32ff241eef None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:21.868582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d75059-52d4-4186-b681-eb32ff241eef None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:21.898293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016b5fb-988e-48c4-9464-78d9a2f00331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:21.898293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016b5fb-988e-48c4-9464-78d9a2f00331 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:21.898293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016b5fb-988e-48c4-9464-78d9a2f00331 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:21.898293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016b5fb-988e-48c4-9464-78d9a2f00331 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:21.899210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016b5fb-988e-48c4-9464-78d9a2f00331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:52:21.899210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016b5fb-988e-48c4-9464-78d9a2f00331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:21.899210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016b5fb-988e-48c4-9464-78d9a2f00331 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:21.940318 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4080/8120] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:52:21.944854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d3589-4e2e-4d36-bbec-2fe3e1a59fc1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:21.964354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d3589-4e2e-4d36-bbec-2fe3e1a59fc1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:21.992268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861a87-195b-4ec8-873e-fe971f738bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:21.992834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861a87-195b-4ec8-873e-fe971f738bcd admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:21.993116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861a87-195b-4ec8-873e-fe971f738bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:21.993386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861a87-195b-4ec8-873e-fe971f738bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:21.994069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861a87-195b-4ec8-873e-fe971f738bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:21.996018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861a87-195b-4ec8-873e-fe971f738bcd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:22.125941 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4041/8121] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:21 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:22.129695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016b5fb-988e-48c4-9464-78d9a2f00331 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:22.143487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016b5fb-988e-48c4-9464-78d9a2f00331 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:22.201258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:22.399178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55d196-be97-4417-b6b3-bfdfebb7f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:22.399803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55d196-be97-4417-b6b3-bfdfebb7f9cd admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:22.400089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55d196-be97-4417-b6b3-bfdfebb7f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:22.400360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55d196-be97-4417-b6b3-bfdfebb7f9cd admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:22.406493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55d196-be97-4417-b6b3-bfdfebb7f9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:22.416316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55d196-be97-4417-b6b3-bfdfebb7f9cd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:22.474609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861a87-195b-4ec8-873e-fe971f738bcd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:22.474850 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4081/8122] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:22 2022] POST /identity/v3/users => generated 291 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:22.488281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861a87-195b-4ec8-873e-fe971f738bcd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:22.524506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa804f3e-f376-4ad3-be13-491b87c2ab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:22.525146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa804f3e-f376-4ad3-be13-491b87c2ab0a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:22.525425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa804f3e-f376-4ad3-be13-491b87c2ab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:22.525694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa804f3e-f376-4ad3-be13-491b87c2ab0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:22.526443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa804f3e-f376-4ad3-be13-491b87c2ab0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:22.528086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa804f3e-f376-4ad3-be13-491b87c2ab0a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:22.557324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:22.577083 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4042/8123] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:22.578581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55d196-be97-4417-b6b3-bfdfebb7f9cd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:22.625910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55d196-be97-4417-b6b3-bfdfebb7f9cd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:22.660004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89517c-b23f-4d16-993f-abf05e51959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:22.667620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89517c-b23f-4d16-993f-abf05e51959b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:22.668027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89517c-b23f-4d16-993f-abf05e51959b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:22.668314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89517c-b23f-4d16-993f-abf05e51959b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:22.669036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89517c-b23f-4d16-993f-abf05e51959b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:22.672444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c89517c-b23f-4d16-993f-abf05e51959b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:22.712565 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4082/8124] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:22.717092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa804f3e-f376-4ad3-be13-491b87c2ab0a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:22.768142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa804f3e-f376-4ad3-be13-491b87c2ab0a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:22.793918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3741819-72d8-45d0-bdd3-e77b71e5674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:22.798918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3741819-72d8-45d0-bdd3-e77b71e5674d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:22.799392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3741819-72d8-45d0-bdd3-e77b71e5674d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:22.799788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3741819-72d8-45d0-bdd3-e77b71e5674d admin admin] PATH_INFO: `/v3/projects/87ea71ce9dd14d93ab31da6849cd59e3/users/773a103c15214ea887cc0b1a274ae11b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:22.857707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3741819-72d8-45d0-bdd3-e77b71e5674d admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ea71ce9dd14d93ab31da6849cd59e3, user_id=773a103c15214ea887cc0b1a274ae11b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:22.860702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3741819-72d8-45d0-bdd3-e77b71e5674d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:22.900265 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4043/8125] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:22 2022] PUT /identity/v3/projects/87ea71ce9dd14d93ab31da6849cd59e3/users/773a103c15214ea887cc0b1a274ae11b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:22.910503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a31a2-6423-4ae9-8f46-ba3c699b64e3 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:22.911592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a31a2-6423-4ae9-8f46-ba3c699b64e3 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:22.912009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a31a2-6423-4ae9-8f46-ba3c699b64e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:23.017399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-812a31a2-6423-4ae9-8f46-ba3c699b64e3 None None] MFA Rules not processed for user `773a103c15214ea887cc0b1a274ae11b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:23.018690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-812a31a2-6423-4ae9-8f46-ba3c699b64e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:23.189499 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4083/8126] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:23.190789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3741819-72d8-45d0-bdd3-e77b71e5674d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:23.308711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3741819-72d8-45d0-bdd3-e77b71e5674d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:23.314341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67466c77-f115-410d-89a0-528a0156b5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:23.315283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466c77-f115-410d-89a0-528a0156b5fa admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:23.315628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466c77-f115-410d-89a0-528a0156b5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:23.315965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466c77-f115-410d-89a0-528a0156b5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:23.316688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67466c77-f115-410d-89a0-528a0156b5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:23.319093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67466c77-f115-410d-89a0-528a0156b5fa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:23.364587 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4044/8127] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:23 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:23.368870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a31a2-6423-4ae9-8f46-ba3c699b64e3 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:23.386414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a31a2-6423-4ae9-8f46-ba3c699b64e3 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:23.527502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c086297-6078-4af7-9011-947a2a9ff6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:23.528329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c086297-6078-4af7-9011-947a2a9ff6ce admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:23.528864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c086297-6078-4af7-9011-947a2a9ff6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:23.529147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c086297-6078-4af7-9011-947a2a9ff6ce admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:23.529794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c086297-6078-4af7-9011-947a2a9ff6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:23.531775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c086297-6078-4af7-9011-947a2a9ff6ce admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:23.571576 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4084/8128] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:23 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:23.572628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67466c77-f115-410d-89a0-528a0156b5fa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:23.590716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67466c77-f115-410d-89a0-528a0156b5fa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:23.638487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd125bf2-4aae-402f-bd12-92d869e89272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:23.646807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125bf2-4aae-402f-bd12-92d869e89272 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:23.647046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125bf2-4aae-402f-bd12-92d869e89272 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:23.647330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd125bf2-4aae-402f-bd12-92d869e89272 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:23.648134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd125bf2-4aae-402f-bd12-92d869e89272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:23.649915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd125bf2-4aae-402f-bd12-92d869e89272 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:23.708073 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4045/8129] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:23.710501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c086297-6078-4af7-9011-947a2a9ff6ce admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:23.724945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c086297-6078-4af7-9011-947a2a9ff6ce admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:23.739549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec976e-b3ec-4858-8d47-23aad793be22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:23.740241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec976e-b3ec-4858-8d47-23aad793be22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:23.740713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec976e-b3ec-4858-8d47-23aad793be22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:23.740987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec976e-b3ec-4858-8d47-23aad793be22 admin admin] PATH_INFO: `/v3/projects/731e8edb557f4d46a2f8ec486308e8c3/users/ad04936f2bfc42c9b8d09dbcfa76b974/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:23.770048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec976e-b3ec-4858-8d47-23aad793be22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731e8edb557f4d46a2f8ec486308e8c3, user_id=ad04936f2bfc42c9b8d09dbcfa76b974, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:23.772991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec976e-b3ec-4858-8d47-23aad793be22 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:23.804705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd125bf2-4aae-402f-bd12-92d869e89272 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:23.806037 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4085/8130] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:23 2022] PUT /identity/v3/projects/731e8edb557f4d46a2f8ec486308e8c3/users/ad04936f2bfc42c9b8d09dbcfa76b974/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:23.831312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd125bf2-4aae-402f-bd12-92d869e89272 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:23.960534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599be22-1fd6-4751-8e05-a2f53106addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:23.961252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599be22-1fd6-4751-8e05-a2f53106addd admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:23.961591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599be22-1fd6-4751-8e05-a2f53106addd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:23.962079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599be22-1fd6-4751-8e05-a2f53106addd admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:23.962633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599be22-1fd6-4751-8e05-a2f53106addd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:23.964389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599be22-1fd6-4751-8e05-a2f53106addd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:23.993240 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4046/8131] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:52:23.997002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec976e-b3ec-4858-8d47-23aad793be22 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:24.004696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:24.015790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec976e-b3ec-4858-8d47-23aad793be22 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:24.024902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90d0b2-3469-46c6-a423-4ea889fbfa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:24.025596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90d0b2-3469-46c6-a423-4ea889fbfa9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:24.025916 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90d0b2-3469-46c6-a423-4ea889fbfa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:24.034779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90d0b2-3469-46c6-a423-4ea889fbfa9b admin admin] PATH_INFO: `/v3/projects/731e8edb557f4d46a2f8ec486308e8c3/users/ad04936f2bfc42c9b8d09dbcfa76b974/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:24.038778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90d0b2-3469-46c6-a423-4ea889fbfa9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=731e8edb557f4d46a2f8ec486308e8c3, user_id=ad04936f2bfc42c9b8d09dbcfa76b974, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:24.041746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90d0b2-3469-46c6-a423-4ea889fbfa9b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:24.073533 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4086/8132] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:23 2022] PUT /identity/v3/projects/731e8edb557f4d46a2f8ec486308e8c3/users/ad04936f2bfc42c9b8d09dbcfa76b974/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:24.075518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2205a-d21d-4042-8163-9bebaa659ff7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:24.075958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2205a-d21d-4042-8163-9bebaa659ff7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:24.076298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2205a-d21d-4042-8163-9bebaa659ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:24.117837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-99c2205a-d21d-4042-8163-9bebaa659ff7 None None] MFA Rules not processed for user `ad04936f2bfc42c9b8d09dbcfa76b974`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:24.119220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-99c2205a-d21d-4042-8163-9bebaa659ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:24.168939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:24.271509 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4047/8133] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:24.285933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90d0b2-3469-46c6-a423-4ea889fbfa9b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:24.288121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5c90d0b2-3469-46c6-a423-4ea889fbfa9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:24.397398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90d0b2-3469-46c6-a423-4ea889fbfa9b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:24.401917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8818f-de54-4ba4-b559-64327c920f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:24.403599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8818f-de54-4ba4-b559-64327c920f3c service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:24.404035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8818f-de54-4ba4-b559-64327c920f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:24.404863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8818f-de54-4ba4-b559-64327c920f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:24.425359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8818f-de54-4ba4-b559-64327c920f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:24.430521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8818f-de54-4ba4-b559-64327c920f3c service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:24.443716 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4087/8134] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:52:25.028745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2205a-d21d-4042-8163-9bebaa659ff7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:25.062587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2205a-d21d-4042-8163-9bebaa659ff7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:25.104087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76320-1533-4c81-9ced-ca36e30536a5 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad04936f2bfc42c9b8d09dbcfa76b974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '731e8edb557f4d46a2f8ec486308e8c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:25.105044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76320-1533-4c81-9ced-ca36e30536a5 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:25.105327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76320-1533-4c81-9ced-ca36e30536a5 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:25.105794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76320-1533-4c81-9ced-ca36e30536a5 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:25.106494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a76320-1533-4c81-9ced-ca36e30536a5 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:52:25.106796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a76320-1533-4c81-9ced-ca36e30536a5 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:25.108424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a76320-1533-4c81-9ced-ca36e30536a5 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:25.165558 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4048/8135] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:52:25.169950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8818f-de54-4ba4-b559-64327c920f3c service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:25.182629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8818f-de54-4ba4-b559-64327c920f3c service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:25.199419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44595adc-0ded-43a3-8952-47464cc972a0 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad04936f2bfc42c9b8d09dbcfa76b974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '731e8edb557f4d46a2f8ec486308e8c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:25.200239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44595adc-0ded-43a3-8952-47464cc972a0 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:25.200667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44595adc-0ded-43a3-8952-47464cc972a0 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:25.201088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44595adc-0ded-43a3-8952-47464cc972a0 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:25.201910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44595adc-0ded-43a3-8952-47464cc972a0 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:25.203974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44595adc-0ded-43a3-8952-47464cc972a0 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:25.271946 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4088/8136] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:25 2022] POST /identity/v3/projects => generated 354 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:25.276402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76320-1533-4c81-9ced-ca36e30536a5 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:25.292962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a76320-1533-4c81-9ced-ca36e30536a5 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:25.371334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc34a8a-3578-44bb-b306-dbb2ae74d0b8 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad04936f2bfc42c9b8d09dbcfa76b974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '731e8edb557f4d46a2f8ec486308e8c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:25.372133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc34a8a-3578-44bb-b306-dbb2ae74d0b8 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:25.372462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc34a8a-3578-44bb-b306-dbb2ae74d0b8 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:25.372735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc34a8a-3578-44bb-b306-dbb2ae74d0b8 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:25.373445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc34a8a-3578-44bb-b306-dbb2ae74d0b8 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:52:25.373747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc34a8a-3578-44bb-b306-dbb2ae74d0b8 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:25.375551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc34a8a-3578-44bb-b306-dbb2ae74d0b8 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:25.418476 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4049/8137] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:52:25.446511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44595adc-0ded-43a3-8952-47464cc972a0 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:25.467549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44595adc-0ded-43a3-8952-47464cc972a0 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:25.473018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad04936f2bfc42c9b8d09dbcfa76b974', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '731e8edb557f4d46a2f8ec486308e8c3', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:25.473950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:25.474462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:25.474969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] PATH_INFO: `/v3/projects/5217891066cf4ac792aabcad5bbbcc04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:25.476551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5217891066cf4ac792aabcad5bbbcc04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:25.478927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:25.574031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5217891066cf4ac792aabcad5bbbcc04', 'request_id': 'req-3e3170f8-17af-4bb9-9a7a-aaaddd543681'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:25.585418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5217891066cf4ac792aabcad5bbbcc04', 'request_id': 'req-3e3170f8-17af-4bb9-9a7a-aaaddd543681'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:25.596793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5217891066cf4ac792aabcad5bbbcc04', 'request_id': 'req-3e3170f8-17af-4bb9-9a7a-aaaddd543681'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:25.636225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] The token cache is being invalidate because project 5217891066cf4ac792aabcad5bbbcc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:25.636582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:25.639963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3e3170f8-17af-4bb9-9a7a-aaaddd543681 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:25.646494 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4089/8138] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:25 2022] DELETE /identity/v3/projects/5217891066cf4ac792aabcad5bbbcc04 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:26.003919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc34a8a-3578-44bb-b306-dbb2ae74d0b8 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:26.006290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0bc34a8a-3578-44bb-b306-dbb2ae74d0b8 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:26.254205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc34a8a-3578-44bb-b306-dbb2ae74d0b8 tempest-VolumeQuotaClassesTest-685172203 tempest-VolumeQuotaClassesTest-685172203-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:26.392269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:26.392999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:26.393331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:26.393662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] PATH_INFO: `/v3/users/773a103c15214ea887cc0b1a274ae11b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:26.394947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773a103c15214ea887cc0b1a274ae11b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:26.397671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:26.400092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:26.475265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773a103c15214ea887cc0b1a274ae11b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:26.484038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773a103c15214ea887cc0b1a274ae11b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:26.506569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773a103c15214ea887cc0b1a274ae11b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:26.526465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773a103c15214ea887cc0b1a274ae11b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:26.527180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773a103c15214ea887cc0b1a274ae11b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:26.536138 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4050/8139] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:26 2022] DELETE /identity/v3/users/773a103c15214ea887cc0b1a274ae11b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:26.542479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a9005-bf6a-4e76-b1af-d49c2da191c6 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:26.543367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a9005-bf6a-4e76-b1af-d49c2da191c6 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:26.543808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a9005-bf6a-4e76-b1af-d49c2da191c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:26.586875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-749a9005-bf6a-4e76-b1af-d49c2da191c6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:26.588517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-749a9005-bf6a-4e76-b1af-d49c2da191c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:26.644817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:26.673166 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4090/8140] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:26.681959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:26.694785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:26.836949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b0dc8-6a1e-4e3b-9ef9-3518bdabbbd0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:26.842375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48894fd3-90d9-465f-8cfc-c3917a0ded50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:26.843029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48894fd3-90d9-465f-8cfc-c3917a0ded50 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:26.843315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48894fd3-90d9-465f-8cfc-c3917a0ded50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:26.843697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48894fd3-90d9-465f-8cfc-c3917a0ded50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:26.862402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48894fd3-90d9-465f-8cfc-c3917a0ded50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:26.863903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48894fd3-90d9-465f-8cfc-c3917a0ded50 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:26.878442 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4051/8141] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:27.592066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a9005-bf6a-4e76-b1af-d49c2da191c6 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:27.593623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-749a9005-bf6a-4e76-b1af-d49c2da191c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:27.624695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a9005-bf6a-4e76-b1af-d49c2da191c6 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:27.635126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:27.636399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:27.637000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:27.637501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] PATH_INFO: `/v3/projects/87ea71ce9dd14d93ab31da6849cd59e3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:27.639258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ea71ce9dd14d93ab31da6849cd59e3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:27.642372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:27.729024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ea71ce9dd14d93ab31da6849cd59e3', 'request_id': 'req-8d88a17d-6515-43a3-8cbb-559df8ae9438'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:27.742570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ea71ce9dd14d93ab31da6849cd59e3', 'request_id': 'req-8d88a17d-6515-43a3-8cbb-559df8ae9438'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:27.763133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ea71ce9dd14d93ab31da6849cd59e3', 'request_id': 'req-8d88a17d-6515-43a3-8cbb-559df8ae9438'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:27.786398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] The token cache is being invalidate because project 87ea71ce9dd14d93ab31da6849cd59e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:27.786983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:27.787825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:27.789574 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4091/8142] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:27 2022] DELETE /identity/v3/projects/87ea71ce9dd14d93ab31da6849cd59e3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:27.795402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48894fd3-90d9-465f-8cfc-c3917a0ded50 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:27.811179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48894fd3-90d9-465f-8cfc-c3917a0ded50 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:27.953893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:27.954856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:27.955531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:27.956349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] PATH_INFO: `/v3/users/ad04936f2bfc42c9b8d09dbcfa76b974` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:27.958538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad04936f2bfc42c9b8d09dbcfa76b974)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:27.962059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:27.986961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:28.053221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad04936f2bfc42c9b8d09dbcfa76b974'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:28.063796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad04936f2bfc42c9b8d09dbcfa76b974'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:28.080593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad04936f2bfc42c9b8d09dbcfa76b974'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:28.092015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad04936f2bfc42c9b8d09dbcfa76b974'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:28.093107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc903889-f9bf-4c39-8cce-020df3228ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad04936f2bfc42c9b8d09dbcfa76b974'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:28.101941 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4052/8143] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:27 2022] DELETE /identity/v3/users/ad04936f2bfc42c9b8d09dbcfa76b974 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:28.620948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:28.623612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:28.643279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88a17d-6515-43a3-8cbb-559df8ae9438 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:28.757530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:28.758548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:28.758999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:28.759442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] PATH_INFO: `/v3/projects/731e8edb557f4d46a2f8ec486308e8c3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:28.760671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=731e8edb557f4d46a2f8ec486308e8c3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:28.762659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:28.856355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731e8edb557f4d46a2f8ec486308e8c3', 'request_id': 'req-926031d4-ab1b-42d8-96fc-d9d2b9f38620'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:28.864423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731e8edb557f4d46a2f8ec486308e8c3', 'request_id': 'req-926031d4-ab1b-42d8-96fc-d9d2b9f38620'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:28.876281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731e8edb557f4d46a2f8ec486308e8c3', 'request_id': 'req-926031d4-ab1b-42d8-96fc-d9d2b9f38620'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:28.888043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:28.894072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] The token cache is being invalidate because project 731e8edb557f4d46a2f8ec486308e8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:28.894815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:28.902841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-926031d4-ab1b-42d8-96fc-d9d2b9f38620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:28.913022 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4092/8144] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:28 2022] DELETE /identity/v3/projects/731e8edb557f4d46a2f8ec486308e8c3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:28.913533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92a56a-323e-4b09-92f6-60541ba295ba None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:28.914162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92a56a-323e-4b09-92f6-60541ba295ba None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:28.914162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92a56a-323e-4b09-92f6-60541ba295ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:29.019692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fe92a56a-323e-4b09-92f6-60541ba295ba None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:29.021244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fe92a56a-323e-4b09-92f6-60541ba295ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:29.207540 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4053/8145] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:29.216921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342693ef-6e9a-4dc1-873a-3dfd758a94ed None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:29.216921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342693ef-6e9a-4dc1-873a-3dfd758a94ed None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:29.217238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342693ef-6e9a-4dc1-873a-3dfd758a94ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:29.257426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-342693ef-6e9a-4dc1-873a-3dfd758a94ed None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:29.257426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-342693ef-6e9a-4dc1-873a-3dfd758a94ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:29.278556 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4093/8146] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:29.283357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92a56a-323e-4b09-92f6-60541ba295ba None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:29.318986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92a56a-323e-4b09-92f6-60541ba295ba None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:29.339747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1973cf-f988-4ad3-bdb3-a906975341d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:29.341747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1973cf-f988-4ad3-bdb3-a906975341d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:29.342280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1973cf-f988-4ad3-bdb3-a906975341d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:29.345252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1973cf-f988-4ad3-bdb3-a906975341d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:29.348463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1973cf-f988-4ad3-bdb3-a906975341d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:52:29.349078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1973cf-f988-4ad3-bdb3-a906975341d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:29.354280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1973cf-f988-4ad3-bdb3-a906975341d5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:29.383190 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4054/8147] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:52:29.387668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342693ef-6e9a-4dc1-873a-3dfd758a94ed None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:29.398822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342693ef-6e9a-4dc1-873a-3dfd758a94ed None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:29.413021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61037ef8-176c-4dcc-86eb-fd5dfa3741cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:29.413739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61037ef8-176c-4dcc-86eb-fd5dfa3741cd admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:29.414218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61037ef8-176c-4dcc-86eb-fd5dfa3741cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:29.414565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61037ef8-176c-4dcc-86eb-fd5dfa3741cd admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:29.415274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61037ef8-176c-4dcc-86eb-fd5dfa3741cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:29.419097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61037ef8-176c-4dcc-86eb-fd5dfa3741cd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:29.503697 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4094/8148] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:29 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:29.508471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1973cf-f988-4ad3-bdb3-a906975341d5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:29.531707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1973cf-f988-4ad3-bdb3-a906975341d5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:29.633561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970bfa-5a68-4d41-ae2d-ad3038f1cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:29.635003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970bfa-5a68-4d41-ae2d-ad3038f1cd92 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:29.635709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970bfa-5a68-4d41-ae2d-ad3038f1cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:29.636281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970bfa-5a68-4d41-ae2d-ad3038f1cd92 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:29.637231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e970bfa-5a68-4d41-ae2d-ad3038f1cd92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:29.639438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e970bfa-5a68-4d41-ae2d-ad3038f1cd92 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:29.654058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:29.698384 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4055/8149] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:29 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:29.700667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61037ef8-176c-4dcc-86eb-fd5dfa3741cd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:29.715134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61037ef8-176c-4dcc-86eb-fd5dfa3741cd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:29.720695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b8aae-c46c-43aa-a382-545d8a8aec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:29.721641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b8aae-c46c-43aa-a382-545d8a8aec05 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:29.722168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b8aae-c46c-43aa-a382-545d8a8aec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:29.722714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b8aae-c46c-43aa-a382-545d8a8aec05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:29.734279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b8aae-c46c-43aa-a382-545d8a8aec05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:29.743390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b8aae-c46c-43aa-a382-545d8a8aec05 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:29.768022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970bfa-5a68-4d41-ae2d-ad3038f1cd92 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:29.769915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7e970bfa-5a68-4d41-ae2d-ad3038f1cd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:29.778265 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4095/8150] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:29.780430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b8aae-c46c-43aa-a382-545d8a8aec05 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:29.803831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b8aae-c46c-43aa-a382-545d8a8aec05 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:29.813649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb98f-3d54-4ff0-979a-ad4fd7ca15b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:29.822787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb98f-3d54-4ff0-979a-ad4fd7ca15b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:29.823402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb98f-3d54-4ff0-979a-ad4fd7ca15b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:29.823842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb98f-3d54-4ff0-979a-ad4fd7ca15b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:29.824865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27feb98f-3d54-4ff0-979a-ad4fd7ca15b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:29.826989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27feb98f-3d54-4ff0-979a-ad4fd7ca15b0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:29.838915 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4096/8151] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:29.842655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb98f-3d54-4ff0-979a-ad4fd7ca15b0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:29.856060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb98f-3d54-4ff0-979a-ad4fd7ca15b0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:29.872154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8ff99-3a31-4e56-b32b-cf1177223f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:29.873089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8ff99-3a31-4e56-b32b-cf1177223f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:29.873367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8ff99-3a31-4e56-b32b-cf1177223f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:29.873636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8ff99-3a31-4e56-b32b-cf1177223f82 admin admin] PATH_INFO: `/v3/projects/4b7eb4be8b814be384ac37cceab04c48/users/b4418b5fe371477cb5e06e6048f10e33/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:29.881668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970bfa-5a68-4d41-ae2d-ad3038f1cd92 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:29.889183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50f73b-050b-4518-a6d6-dfbb29a17877 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:29.889817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50f73b-050b-4518-a6d6-dfbb29a17877 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:29.890118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50f73b-050b-4518-a6d6-dfbb29a17877 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:29.890383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50f73b-050b-4518-a6d6-dfbb29a17877 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:29.911021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7b50f73b-050b-4518-a6d6-dfbb29a17877 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:29.916989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8ff99-3a31-4e56-b32b-cf1177223f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7eb4be8b814be384ac37cceab04c48, user_id=b4418b5fe371477cb5e06e6048f10e33, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:29.923227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8ff99-3a31-4e56-b32b-cf1177223f82 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:29.962408 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4097/8152] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:29 2022] PUT /identity/v3/projects/4b7eb4be8b814be384ac37cceab04c48/users/b4418b5fe371477cb5e06e6048f10e33/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:29.973759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1662138-3d13-4a09-b2e0-c5ed89dfd3b1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:29.974347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1662138-3d13-4a09-b2e0-c5ed89dfd3b1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:29.974795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1662138-3d13-4a09-b2e0-c5ed89dfd3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:30.028924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e1662138-3d13-4a09-b2e0-c5ed89dfd3b1 None None] MFA Rules not processed for user `b4418b5fe371477cb5e06e6048f10e33`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:30.032316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e1662138-3d13-4a09-b2e0-c5ed89dfd3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:30.087594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50f73b-050b-4518-a6d6-dfbb29a17877 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:30.098860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50f73b-050b-4518-a6d6-dfbb29a17877 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:30.111973 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4056/8153] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:52:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:52:30.201819 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4098/8154] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:30.206360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50f73b-050b-4518-a6d6-dfbb29a17877 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:30.238694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50f73b-050b-4518-a6d6-dfbb29a17877 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:30.487891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aea66-036d-4652-bfbc-abb4cabbb3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:30.488793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aea66-036d-4652-bfbc-abb4cabbb3ea admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:30.489230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aea66-036d-4652-bfbc-abb4cabbb3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:30.489667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aea66-036d-4652-bfbc-abb4cabbb3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:30.490502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aea66-036d-4652-bfbc-abb4cabbb3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:30.492852 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904aea66-036d-4652-bfbc-abb4cabbb3ea admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:30.531675 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4057/8155] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:30 2022] POST /identity/v3/projects => generated 381 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:30.540625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1662138-3d13-4a09-b2e0-c5ed89dfd3b1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:30.611138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1662138-3d13-4a09-b2e0-c5ed89dfd3b1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:30.770152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0f11-6f36-4c59-8e83-a98a152add54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:30.771105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0f11-6f36-4c59-8e83-a98a152add54 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:30.771521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0f11-6f36-4c59-8e83-a98a152add54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:30.772049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0f11-6f36-4c59-8e83-a98a152add54 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:30.773096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b0f11-6f36-4c59-8e83-a98a152add54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:30.776188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b0f11-6f36-4c59-8e83-a98a152add54 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:30.845701 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4099/8156] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:30 2022] POST /identity/v3/users => generated 297 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:30.849708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aea66-036d-4652-bfbc-abb4cabbb3ea admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:30.873782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904aea66-036d-4652-bfbc-abb4cabbb3ea admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:30.879443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4812d90-1a0d-4e3a-a8d3-ffb5981f8eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:30.880329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4812d90-1a0d-4e3a-a8d3-ffb5981f8eff admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:30.880734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4812d90-1a0d-4e3a-a8d3-ffb5981f8eff admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:30.881095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4812d90-1a0d-4e3a-a8d3-ffb5981f8eff admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:30.882504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4812d90-1a0d-4e3a-a8d3-ffb5981f8eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:30.886819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4812d90-1a0d-4e3a-a8d3-ffb5981f8eff admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:30.913033 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4058/8157] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:52:30.913309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0f11-6f36-4c59-8e83-a98a152add54 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:30.919169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:30.931164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0f11-6f36-4c59-8e83-a98a152add54 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:30.939761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab50f0-b5db-46f0-a9c6-020fda4f57c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:30.941764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab50f0-b5db-46f0-a9c6-020fda4f57c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:30.942807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab50f0-b5db-46f0-a9c6-020fda4f57c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:30.943287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab50f0-b5db-46f0-a9c6-020fda4f57c7 admin admin] PATH_INFO: `/v3/projects/c66ed1c6e3ce4354b6cbb3720553e600/users/846affc4d2224662aaebfd61e0c18fbf/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:30.965388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab50f0-b5db-46f0-a9c6-020fda4f57c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66ed1c6e3ce4354b6cbb3720553e600, user_id=846affc4d2224662aaebfd61e0c18fbf, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:30.969608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab50f0-b5db-46f0-a9c6-020fda4f57c7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:31.014436 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4100/8158] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:30 2022] PUT /identity/v3/projects/c66ed1c6e3ce4354b6cbb3720553e600/users/846affc4d2224662aaebfd61e0c18fbf/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:31.019299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4812d90-1a0d-4e3a-a8d3-ffb5981f8eff admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:31.030953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4812d90-1a0d-4e3a-a8d3-ffb5981f8eff admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:31.035807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:31.114020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf5783-9bd1-497e-b723-e34a41d1f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:31.116083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5783-9bd1-497e-b723-e34a41d1f90a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:31.116795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5783-9bd1-497e-b723-e34a41d1f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:31.119010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf5783-9bd1-497e-b723-e34a41d1f90a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:31.127455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf5783-9bd1-497e-b723-e34a41d1f90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:31.129683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf5783-9bd1-497e-b723-e34a41d1f90a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:31.146860 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4059/8159] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:31.147918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab50f0-b5db-46f0-a9c6-020fda4f57c7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:31.179237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab50f0-b5db-46f0-a9c6-020fda4f57c7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:31.193698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974b7fb-0faa-4d6b-abc3-d08e6937dcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:31.194829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974b7fb-0faa-4d6b-abc3-d08e6937dcc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:31.194829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974b7fb-0faa-4d6b-abc3-d08e6937dcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:31.195244 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974b7fb-0faa-4d6b-abc3-d08e6937dcc9 admin admin] PATH_INFO: `/v3/projects/c66ed1c6e3ce4354b6cbb3720553e600/users/846affc4d2224662aaebfd61e0c18fbf/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:31.197758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974b7fb-0faa-4d6b-abc3-d08e6937dcc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66ed1c6e3ce4354b6cbb3720553e600, user_id=846affc4d2224662aaebfd61e0c18fbf, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:31.201513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974b7fb-0faa-4d6b-abc3-d08e6937dcc9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:31.238097 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4101/8160] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:31 2022] PUT /identity/v3/projects/c66ed1c6e3ce4354b6cbb3720553e600/users/846affc4d2224662aaebfd61e0c18fbf/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:31.248865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fd02a-4203-462a-814e-7f2481c08016 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:31.249147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fd02a-4203-462a-814e-7f2481c08016 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:31.249466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fd02a-4203-462a-814e-7f2481c08016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:31.286914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-001fd02a-4203-462a-814e-7f2481c08016 None None] MFA Rules not processed for user `846affc4d2224662aaebfd61e0c18fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:31.289780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-001fd02a-4203-462a-814e-7f2481c08016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:31.489140 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4060/8161] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:31.498131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974b7fb-0faa-4d6b-abc3-d08e6937dcc9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:31.500102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b974b7fb-0faa-4d6b-abc3-d08e6937dcc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:31.629387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974b7fb-0faa-4d6b-abc3-d08e6937dcc9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:31.661713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65de672-29dc-4111-aee6-77172b01140f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:31.662389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65de672-29dc-4111-aee6-77172b01140f service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:31.662689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65de672-29dc-4111-aee6-77172b01140f service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:31.663112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65de672-29dc-4111-aee6-77172b01140f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:31.688620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65de672-29dc-4111-aee6-77172b01140f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:31.691867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65de672-29dc-4111-aee6-77172b01140f service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:31.729920 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4102/8162] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:32.670203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fd02a-4203-462a-814e-7f2481c08016 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:32.943916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fd02a-4203-462a-814e-7f2481c08016 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:32.973018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:32.974429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:32.974878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:32.975339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] PATH_INFO: `/v3/users/b4418b5fe371477cb5e06e6048f10e33` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:32.978709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4418b5fe371477cb5e06e6048f10e33)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:32.981294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:33.117465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:33.137826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4418b5fe371477cb5e06e6048f10e33'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:33.153996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4418b5fe371477cb5e06e6048f10e33'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:33.186068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4418b5fe371477cb5e06e6048f10e33'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:33.209654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4418b5fe371477cb5e06e6048f10e33'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:33.210677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4418b5fe371477cb5e06e6048f10e33'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:33.220977 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4061/8163] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:32 2022] DELETE /identity/v3/users/b4418b5fe371477cb5e06e6048f10e33 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:33.245200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e88b-2f8c-4a5b-8dea-4305846ebf96 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:33.245200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e88b-2f8c-4a5b-8dea-4305846ebf96 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:33.245200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e88b-2f8c-4a5b-8dea-4305846ebf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:33.291492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5427e88b-2f8c-4a5b-8dea-4305846ebf96 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:33.292796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5427e88b-2f8c-4a5b-8dea-4305846ebf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:33.479667 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4103/8164] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:33.490414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:33.492027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:33.704835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ba7f0-0ae5-4e2b-ba1f-7b8524965077 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:33.712351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae3fc9-ac64-419e-851c-6ac2f5dbbd32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:33.713513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae3fc9-ac64-419e-851c-6ac2f5dbbd32 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:33.714070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae3fc9-ac64-419e-851c-6ac2f5dbbd32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:33.732925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae3fc9-ac64-419e-851c-6ac2f5dbbd32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:33.767170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae3fc9-ac64-419e-851c-6ac2f5dbbd32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:33.768968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae3fc9-ac64-419e-851c-6ac2f5dbbd32 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:33.805452 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4062/8165] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:34.964031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427e88b-2f8c-4a5b-8dea-4305846ebf96 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:34.966531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5427e88b-2f8c-4a5b-8dea-4305846ebf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:34.998897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427e88b-2f8c-4a5b-8dea-4305846ebf96 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:35.020740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:35.021765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:35.022107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:35.023319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] PATH_INFO: `/v3/projects/4b7eb4be8b814be384ac37cceab04c48` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:35.024660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7eb4be8b814be384ac37cceab04c48)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:35.026628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:35.154219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7eb4be8b814be384ac37cceab04c48', 'request_id': 'req-5baaff77-521b-4411-8fef-4fa5b1550640'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:35.162928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7eb4be8b814be384ac37cceab04c48', 'request_id': 'req-5baaff77-521b-4411-8fef-4fa5b1550640'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:35.181593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7eb4be8b814be384ac37cceab04c48', 'request_id': 'req-5baaff77-521b-4411-8fef-4fa5b1550640'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:35.186699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:35.211538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] The token cache is being invalidate because project 4b7eb4be8b814be384ac37cceab04c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:35.213607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:35.214453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:35.239046 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4104/8166] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:34 2022] DELETE /identity/v3/projects/4b7eb4be8b814be384ac37cceab04c48 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:52:35.243035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae3fc9-ac64-419e-851c-6ac2f5dbbd32 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:35.266230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae3fc9-ac64-419e-851c-6ac2f5dbbd32 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:35.406966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:35.407912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:35.408371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:35.408823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] PATH_INFO: `/v3/users/846affc4d2224662aaebfd61e0c18fbf` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:35.410526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=846affc4d2224662aaebfd61e0c18fbf)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:35.412665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:35.579505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '846affc4d2224662aaebfd61e0c18fbf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:35.598273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:35.623565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '846affc4d2224662aaebfd61e0c18fbf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:35.660714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '846affc4d2224662aaebfd61e0c18fbf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:35.702518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '846affc4d2224662aaebfd61e0c18fbf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:35.712233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37a69761-35b2-402c-b548-fe48567df08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '846affc4d2224662aaebfd61e0c18fbf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:35.763644 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4063/8167] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:35 2022] DELETE /identity/v3/users/846affc4d2224662aaebfd61e0c18fbf => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:36.785779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:36.787351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:36.851636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaff77-521b-4411-8fef-4fa5b1550640 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:36.967015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:36.967568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:36.968042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:36.968597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] PATH_INFO: `/v3/projects/c66ed1c6e3ce4354b6cbb3720553e600` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:36.969950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66ed1c6e3ce4354b6cbb3720553e600)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:36.972281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:37.033610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66ed1c6e3ce4354b6cbb3720553e600', 'request_id': 'req-0c29c576-655a-4b0e-a303-77e135873a4e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:37.040852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66ed1c6e3ce4354b6cbb3720553e600', 'request_id': 'req-0c29c576-655a-4b0e-a303-77e135873a4e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:37.052382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66ed1c6e3ce4354b6cbb3720553e600', 'request_id': 'req-0c29c576-655a-4b0e-a303-77e135873a4e'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:37.067740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] The token cache is being invalidate because project c66ed1c6e3ce4354b6cbb3720553e600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:37.068389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:37.069282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0c29c576-655a-4b0e-a303-77e135873a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:37.071189 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4105/8168] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:36 2022] DELETE /identity/v3/projects/c66ed1c6e3ce4354b6cbb3720553e600 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:37.076439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826fcb-d354-41e6-b26d-c0747ebeb9b3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:37.077455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826fcb-d354-41e6-b26d-c0747ebeb9b3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:37.078046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75826fcb-d354-41e6-b26d-c0747ebeb9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:37.107832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-75826fcb-d354-41e6-b26d-c0747ebeb9b3 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:37.109372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-75826fcb-d354-41e6-b26d-c0747ebeb9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:37.220343 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4064/8169] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:37.228076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbd1ec-334f-4cfc-b620-a9f3b7eac5c9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:37.228492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbd1ec-334f-4cfc-b620-a9f3b7eac5c9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:37.228969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbd1ec-334f-4cfc-b620-a9f3b7eac5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:37.254399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-adcbd1ec-334f-4cfc-b620-a9f3b7eac5c9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:37.256048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-adcbd1ec-334f-4cfc-b620-a9f3b7eac5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:37.272215 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4106/8170] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:37.279190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75826fcb-d354-41e6-b26d-c0747ebeb9b3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:37.292353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75826fcb-d354-41e6-b26d-c0747ebeb9b3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:37.302104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfd379-8ad3-4ada-814a-f40b2c7b186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:37.302921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfd379-8ad3-4ada-814a-f40b2c7b186b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:37.303295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfd379-8ad3-4ada-814a-f40b2c7b186b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:37.303701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfd379-8ad3-4ada-814a-f40b2c7b186b admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:37.304483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfd379-8ad3-4ada-814a-f40b2c7b186b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:52:37.304970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfd379-8ad3-4ada-814a-f40b2c7b186b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:37.306794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfd379-8ad3-4ada-814a-f40b2c7b186b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:37.323578 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4065/8171] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:52:37.327738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbd1ec-334f-4cfc-b620-a9f3b7eac5c9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:37.344117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbd1ec-334f-4cfc-b620-a9f3b7eac5c9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:37.353463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08555ace-017f-4bdc-b0cd-6f02e40f08b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:37.354128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08555ace-017f-4bdc-b0cd-6f02e40f08b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:37.354711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08555ace-017f-4bdc-b0cd-6f02e40f08b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:37.355181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08555ace-017f-4bdc-b0cd-6f02e40f08b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:37.356212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08555ace-017f-4bdc-b0cd-6f02e40f08b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:37.359609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08555ace-017f-4bdc-b0cd-6f02e40f08b5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:37.450609 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4107/8172] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:37 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:52:37.455107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfd379-8ad3-4ada-814a-f40b2c7b186b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:37.479769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfd379-8ad3-4ada-814a-f40b2c7b186b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:37.671849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b034865-2478-4386-9791-345a585e99ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:37.672499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b034865-2478-4386-9791-345a585e99ba admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:37.672756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b034865-2478-4386-9791-345a585e99ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:37.673025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b034865-2478-4386-9791-345a585e99ba admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:37.673689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b034865-2478-4386-9791-345a585e99ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:37.675734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b034865-2478-4386-9791-345a585e99ba admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:37.740173 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4066/8173] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:37 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:37.744339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08555ace-017f-4bdc-b0cd-6f02e40f08b5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:37.781382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08555ace-017f-4bdc-b0cd-6f02e40f08b5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:37.795212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3049d-e898-4715-930d-dbea037a751f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:37.795863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3049d-e898-4715-930d-dbea037a751f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:37.800577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3049d-e898-4715-930d-dbea037a751f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:37.808794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3049d-e898-4715-930d-dbea037a751f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:37.808794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3049d-e898-4715-930d-dbea037a751f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:37.808794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3049d-e898-4715-930d-dbea037a751f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:37.827766 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4108/8174] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:37.831809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b034865-2478-4386-9791-345a585e99ba admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:37.844836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b034865-2478-4386-9791-345a585e99ba admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:37.852152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17866bc-e635-4f4e-b756-4a240066df9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:37.852938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17866bc-e635-4f4e-b756-4a240066df9e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:37.853359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17866bc-e635-4f4e-b756-4a240066df9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:37.853829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17866bc-e635-4f4e-b756-4a240066df9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:37.855125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17866bc-e635-4f4e-b756-4a240066df9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:37.856907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17866bc-e635-4f4e-b756-4a240066df9e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:37.888051 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4067/8175] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:52:37.892127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3049d-e898-4715-930d-dbea037a751f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:37.904310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3049d-e898-4715-930d-dbea037a751f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:37.912846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1547e-d53d-4ab8-ac5f-7c4bba9c7f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:37.914840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1547e-d53d-4ab8-ac5f-7c4bba9c7f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:37.915428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1547e-d53d-4ab8-ac5f-7c4bba9c7f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:37.916187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1547e-d53d-4ab8-ac5f-7c4bba9c7f6b admin admin] PATH_INFO: `/v3/projects/887c0479fc6b4bf8a4e8c59c67552529/users/68b522a5f73f4e9498410a924bf16318/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:37.962882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1547e-d53d-4ab8-ac5f-7c4bba9c7f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=887c0479fc6b4bf8a4e8c59c67552529, user_id=68b522a5f73f4e9498410a924bf16318, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:37.972926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1547e-d53d-4ab8-ac5f-7c4bba9c7f6b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:38.006800 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4109/8176] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:37 2022] PUT /identity/v3/projects/887c0479fc6b4bf8a4e8c59c67552529/users/68b522a5f73f4e9498410a924bf16318/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:38.018245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924ca1-b074-47ee-86e9-e04dd9b20394 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:38.018631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924ca1-b074-47ee-86e9-e04dd9b20394 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:38.019023 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa924ca1-b074-47ee-86e9-e04dd9b20394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:38.083009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fa924ca1-b074-47ee-86e9-e04dd9b20394 None None] MFA Rules not processed for user `68b522a5f73f4e9498410a924bf16318`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:38.086419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fa924ca1-b074-47ee-86e9-e04dd9b20394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:38.122410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:38.252230 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4068/8177] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:38.257059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1547e-d53d-4ab8-ac5f-7c4bba9c7f6b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:38.267824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0dc1547e-d53d-4ab8-ac5f-7c4bba9c7f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:38.335717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:38.427974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1547e-d53d-4ab8-ac5f-7c4bba9c7f6b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:38.435871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa1e4-1aff-4431-a267-1a4b2ae7dc33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:38.436896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa1e4-1aff-4431-a267-1a4b2ae7dc33 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:38.437339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa1e4-1aff-4431-a267-1a4b2ae7dc33 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:38.437986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa1e4-1aff-4431-a267-1a4b2ae7dc33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:38.454645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa1e4-1aff-4431-a267-1a4b2ae7dc33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:38.459157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa1e4-1aff-4431-a267-1a4b2ae7dc33 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:38.483417 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4110/8178] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:40.506850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa924ca1-b074-47ee-86e9-e04dd9b20394 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:40.508607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fa924ca1-b074-47ee-86e9-e04dd9b20394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:40.696441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa924ca1-b074-47ee-86e9-e04dd9b20394 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:40.706637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18380572-be48-426d-af39-d8910c2498a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:40.707390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18380572-be48-426d-af39-d8910c2498a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:40.707736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18380572-be48-426d-af39-d8910c2498a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:40.708074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18380572-be48-426d-af39-d8910c2498a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:40.718915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-18380572-be48-426d-af39-d8910c2498a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:40.743726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18380572-be48-426d-af39-d8910c2498a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:40.746531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18380572-be48-426d-af39-d8910c2498a5 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:40.778911 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4069/8179] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:47.745293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa1e4-1aff-4431-a267-1a4b2ae7dc33 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:47.895618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa1e4-1aff-4431-a267-1a4b2ae7dc33 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:47.909130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:47.909816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:47.910125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:47.910397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] PATH_INFO: `/v3/users/68b522a5f73f4e9498410a924bf16318` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:47.917734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b522a5f73f4e9498410a924bf16318)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:47.919746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:48.039884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b522a5f73f4e9498410a924bf16318'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:48.040610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b522a5f73f4e9498410a924bf16318'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:48.049061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b522a5f73f4e9498410a924bf16318'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:48.069074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b522a5f73f4e9498410a924bf16318'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:48.114759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b522a5f73f4e9498410a924bf16318'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:48.152647 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4111/8180] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:52:47 2022] DELETE /identity/v3/users/68b522a5f73f4e9498410a924bf16318 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:48.154436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52886e-0776-429c-a01b-cdf92dbd6cc5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:48.154893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52886e-0776-429c-a01b-cdf92dbd6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:48.155004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52886e-0776-429c-a01b-cdf92dbd6cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:48.194057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7c52886e-0776-429c-a01b-cdf92dbd6cc5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:48.195483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7c52886e-0776-429c-a01b-cdf92dbd6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:48.411882 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4070/8181] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:52:48.425853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:48.428074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:48.571779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:48.611283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8e654-91ca-4ae7-8117-d60d41011362 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:48.621788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593732cd-fd3b-4eb2-ad50-1d719d8b9a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:48.622415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593732cd-fd3b-4eb2-ad50-1d719d8b9a6d service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:48.624382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593732cd-fd3b-4eb2-ad50-1d719d8b9a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:48.625444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593732cd-fd3b-4eb2-ad50-1d719d8b9a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:48.651015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593732cd-fd3b-4eb2-ad50-1d719d8b9a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:48.655062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593732cd-fd3b-4eb2-ad50-1d719d8b9a6d service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:48.688191 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4112/8182] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:52:49.692702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52886e-0776-429c-a01b-cdf92dbd6cc5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:49.697776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7c52886e-0776-429c-a01b-cdf92dbd6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:49.756708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52886e-0776-429c-a01b-cdf92dbd6cc5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:49.789840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:49.790519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:49.790862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:49.791050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] PATH_INFO: `/v3/projects/887c0479fc6b4bf8a4e8c59c67552529` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:49.793756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=887c0479fc6b4bf8a4e8c59c67552529)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:49.795853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:49.942938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '887c0479fc6b4bf8a4e8c59c67552529', 'request_id': 'req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:49.955003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '887c0479fc6b4bf8a4e8c59c67552529', 'request_id': 'req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:49.983693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '887c0479fc6b4bf8a4e8c59c67552529', 'request_id': 'req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:50.005547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:50.026551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] The token cache is being invalidate because project 887c0479fc6b4bf8a4e8c59c67552529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:52:50.026933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:50.027967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f0052aa1-99a6-4ed6-8211-4abbfd2bef15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:52:50.030825 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4071/8183] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:52:49 2022] DELETE /identity/v3/projects/887c0479fc6b4bf8a4e8c59c67552529 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:50.036503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a9056-4f10-4929-91ab-1cefb6419f06 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:50.037291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a9056-4f10-4929-91ab-1cefb6419f06 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:50.037993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a9056-4f10-4929-91ab-1cefb6419f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:50.076636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2f2a9056-4f10-4929-91ab-1cefb6419f06 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:50.078102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2f2a9056-4f10-4929-91ab-1cefb6419f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:50.198412 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4113/8184] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:50.205579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be9dc8-3472-4f08-9097-95460ff0547e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:50.205579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be9dc8-3472-4f08-9097-95460ff0547e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:50.205579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4be9dc8-3472-4f08-9097-95460ff0547e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:50.240586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b4be9dc8-3472-4f08-9097-95460ff0547e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:50.244994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b4be9dc8-3472-4f08-9097-95460ff0547e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:50.277482 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4072/8185] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:50.279112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a9056-4f10-4929-91ab-1cefb6419f06 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:50.294266 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a9056-4f10-4929-91ab-1cefb6419f06 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:50.306559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f556602-556c-4f1c-a16b-cab061ec700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:50.307688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f556602-556c-4f1c-a16b-cab061ec700f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:50.308122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f556602-556c-4f1c-a16b-cab061ec700f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:50.308531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f556602-556c-4f1c-a16b-cab061ec700f admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:50.309337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f556602-556c-4f1c-a16b-cab061ec700f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:52:50.310746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f556602-556c-4f1c-a16b-cab061ec700f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:50.312664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f556602-556c-4f1c-a16b-cab061ec700f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:50.338617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be9dc8-3472-4f08-9097-95460ff0547e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:50.345729 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4114/8186] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:52:50.362219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4be9dc8-3472-4f08-9097-95460ff0547e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:50.370668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d9c7-8735-4f83-b178-d81239f1b5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:50.375411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d9c7-8735-4f83-b178-d81239f1b5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:50.394041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d9c7-8735-4f83-b178-d81239f1b5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:50.394574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0d9c7-8735-4f83-b178-d81239f1b5d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:50.395539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0d9c7-8735-4f83-b178-d81239f1b5d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:50.408149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0d9c7-8735-4f83-b178-d81239f1b5d8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:50.471872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f556602-556c-4f1c-a16b-cab061ec700f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:50.479244 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4073/8187] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:52:50 2022] POST /identity/v3/projects => generated 397 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:52:50.486667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f556602-556c-4f1c-a16b-cab061ec700f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:50.620720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e4417-5def-4598-a782-2249f2f20e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:50.621440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4417-5def-4598-a782-2249f2f20e73 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:50.622717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4417-5def-4598-a782-2249f2f20e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:50.623797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e4417-5def-4598-a782-2249f2f20e73 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:50.624580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e4417-5def-4598-a782-2249f2f20e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:50.627996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e4417-5def-4598-a782-2249f2f20e73 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:50.722669 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4115/8188] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:52:50 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:52:50.727402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d9c7-8735-4f83-b178-d81239f1b5d8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:50.739778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0d9c7-8735-4f83-b178-d81239f1b5d8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:50.747429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5eb86-4cf3-45bf-84c2-412e0297c00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:50.748064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5eb86-4cf3-45bf-84c2-412e0297c00f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:50.748472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5eb86-4cf3-45bf-84c2-412e0297c00f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:50.748749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5eb86-4cf3-45bf-84c2-412e0297c00f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:50.749404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5eb86-4cf3-45bf-84c2-412e0297c00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:50.751355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5eb86-4cf3-45bf-84c2-412e0297c00f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:50.787935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4074/8189] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:52:50.792921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e4417-5def-4598-a782-2249f2f20e73 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:50.824359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e4417-5def-4598-a782-2249f2f20e73 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:50.843492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642db650-388f-4081-b930-3dc7142c345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:50.843492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db650-388f-4081-b930-3dc7142c345c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:50.843492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db650-388f-4081-b930-3dc7142c345c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:50.843492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642db650-388f-4081-b930-3dc7142c345c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:50.844662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642db650-388f-4081-b930-3dc7142c345c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:50.846432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642db650-388f-4081-b930-3dc7142c345c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:50.890480 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4116/8190] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:52:50.894504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5eb86-4cf3-45bf-84c2-412e0297c00f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:50.913174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5eb86-4cf3-45bf-84c2-412e0297c00f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:50.935929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a897400-07d5-4f12-ac6e-5eab0851066c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:50.937070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a897400-07d5-4f12-ac6e-5eab0851066c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:50.937412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a897400-07d5-4f12-ac6e-5eab0851066c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:50.938058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a897400-07d5-4f12-ac6e-5eab0851066c admin admin] PATH_INFO: `/v3/projects/82e7c547239242a493fe2ca48f3d72f9/users/dbe2cac0bb2148838b13867a8c322bf5/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:50.970412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a897400-07d5-4f12-ac6e-5eab0851066c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e7c547239242a493fe2ca48f3d72f9, user_id=dbe2cac0bb2148838b13867a8c322bf5, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:50.985010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a897400-07d5-4f12-ac6e-5eab0851066c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:51.012560 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4075/8191] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:52:50 2022] PUT /identity/v3/projects/82e7c547239242a493fe2ca48f3d72f9/users/dbe2cac0bb2148838b13867a8c322bf5/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:52:51.025083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be51494-7aa3-4c02-97ed-806e04265911 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:51.025729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be51494-7aa3-4c02-97ed-806e04265911 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:51.027966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be51494-7aa3-4c02-97ed-806e04265911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:51.079988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5be51494-7aa3-4c02-97ed-806e04265911 None None] MFA Rules not processed for user `dbe2cac0bb2148838b13867a8c322bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:52:51.081651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5be51494-7aa3-4c02-97ed-806e04265911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:51.161360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:51.200256 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4117/8192] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:52:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:52:51.234160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a897400-07d5-4f12-ac6e-5eab0851066c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:51.236273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7a897400-07d5-4f12-ac6e-5eab0851066c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:51.379080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a897400-07d5-4f12-ac6e-5eab0851066c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:51.384714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6be28-7dd9-4bb7-a9ff-5f60174014f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:51.385461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6be28-7dd9-4bb7-a9ff-5f60174014f5 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:51.386924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6be28-7dd9-4bb7-a9ff-5f60174014f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:51.388812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6be28-7dd9-4bb7-a9ff-5f60174014f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:51.430006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6be28-7dd9-4bb7-a9ff-5f60174014f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:51.431762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6be28-7dd9-4bb7-a9ff-5f60174014f5 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:51.463902 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4076/8193] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:51 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:52:54.904169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be51494-7aa3-4c02-97ed-806e04265911 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:52:54.907374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5be51494-7aa3-4c02-97ed-806e04265911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:55.162223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be51494-7aa3-4c02-97ed-806e04265911 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:52:55.168444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5eb4c-f2a0-475c-9a8a-b73f193f0fba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:52:55.169326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5eb4c-f2a0-475c-9a8a-b73f193f0fba service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:52:55.169742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5eb4c-f2a0-475c-9a8a-b73f193f0fba service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:52:55.170181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5eb4c-f2a0-475c-9a8a-b73f193f0fba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:52:55.172594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c6c5eb4c-f2a0-475c-9a8a-b73f193f0fba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:52:55.191035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5eb4c-f2a0-475c-9a8a-b73f193f0fba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:52:55.192745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5eb4c-f2a0-475c-9a8a-b73f193f0fba service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:52:55.238291 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4118/8194] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:52:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:01.329448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6be28-7dd9-4bb7-a9ff-5f60174014f5 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:01.331007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5cb6be28-7dd9-4bb7-a9ff-5f60174014f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:01.482900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6be28-7dd9-4bb7-a9ff-5f60174014f5 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:01.488452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:01.489501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:01.490029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:01.490692 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] PATH_INFO: `/v3/users/9c86031fbd964a74873f5306aae03490` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:01.492383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c86031fbd964a74873f5306aae03490)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:01.494855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:01.581719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:01.600038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c86031fbd964a74873f5306aae03490'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:01.609571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c86031fbd964a74873f5306aae03490'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:01.627186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c86031fbd964a74873f5306aae03490'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:01.650814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c86031fbd964a74873f5306aae03490'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:01.651555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c86031fbd964a74873f5306aae03490'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:01.673291 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4077/8195] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:53:01 2022] DELETE /identity/v3/users/9c86031fbd964a74873f5306aae03490 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:01.676858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e2309-0740-42d4-8ee3-a28a93c0fed0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:01.677280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e2309-0740-42d4-8ee3-a28a93c0fed0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:01.677412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e2309-0740-42d4-8ee3-a28a93c0fed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:01.720620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-834e2309-0740-42d4-8ee3-a28a93c0fed0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:01.722883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-834e2309-0740-42d4-8ee3-a28a93c0fed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:01.884377 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4119/8196] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:01.899691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:01.901150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:02.067260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f92b4-a744-477f-93d8-5b1fb0d81eb2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:02.078432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0786f-7187-4324-a22a-b0231c5ad7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:02.079342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0786f-7187-4324-a22a-b0231c5ad7bf service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:02.079802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0786f-7187-4324-a22a-b0231c5ad7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:02.080239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0786f-7187-4324-a22a-b0231c5ad7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:02.119037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0786f-7187-4324-a22a-b0231c5ad7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:02.120600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0786f-7187-4324-a22a-b0231c5ad7bf service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:02.148382 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4078/8197] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:02.683765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e2309-0740-42d4-8ee3-a28a93c0fed0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:02.685194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-834e2309-0740-42d4-8ee3-a28a93c0fed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:02.737050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e2309-0740-42d4-8ee3-a28a93c0fed0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:02.748055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:02.748716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:02.751523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:02.751952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] PATH_INFO: `/v3/projects/6be3717d6d9b4fe98b06dda885d558dd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:02.755682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be3717d6d9b4fe98b06dda885d558dd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:02.759156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:02.834823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be3717d6d9b4fe98b06dda885d558dd', 'request_id': 'req-0a303a4d-70b4-4168-b150-0bb6b21ca244'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:02.842940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be3717d6d9b4fe98b06dda885d558dd', 'request_id': 'req-0a303a4d-70b4-4168-b150-0bb6b21ca244'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:02.857807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be3717d6d9b4fe98b06dda885d558dd', 'request_id': 'req-0a303a4d-70b4-4168-b150-0bb6b21ca244'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:02.866283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:02.890304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] The token cache is being invalidate because project 6be3717d6d9b4fe98b06dda885d558dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:53:02.890597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:02.895144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a303a4d-70b4-4168-b150-0bb6b21ca244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:02.896911 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4120/8198] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:53:02 2022] DELETE /identity/v3/projects/6be3717d6d9b4fe98b06dda885d558dd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:02.901946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f485e-4622-4a74-9fa6-5de442c53e73 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:02.902838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f485e-4622-4a74-9fa6-5de442c53e73 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:02.903283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f485e-4622-4a74-9fa6-5de442c53e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:02.960427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-258f485e-4622-4a74-9fa6-5de442c53e73 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:02.961756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-258f485e-4622-4a74-9fa6-5de442c53e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:03.097207 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4079/8199] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:03.106110 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052ae1-03ad-4d27-b7ab-4fe8b932ea62 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:03.106389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052ae1-03ad-4d27-b7ab-4fe8b932ea62 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:03.106581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052ae1-03ad-4d27-b7ab-4fe8b932ea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:03.143418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1d052ae1-03ad-4d27-b7ab-4fe8b932ea62 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:03.144670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1d052ae1-03ad-4d27-b7ab-4fe8b932ea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:03.170821 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4121/8200] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:03.174811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f485e-4622-4a74-9fa6-5de442c53e73 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:03.187639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f485e-4622-4a74-9fa6-5de442c53e73 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:03.197584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac51c6-8dde-40e8-89f9-19c26b55dc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:03.198296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac51c6-8dde-40e8-89f9-19c26b55dc00 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:03.198580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac51c6-8dde-40e8-89f9-19c26b55dc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:03.198848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac51c6-8dde-40e8-89f9-19c26b55dc00 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:03.199524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac51c6-8dde-40e8-89f9-19c26b55dc00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:53:03.201111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac51c6-8dde-40e8-89f9-19c26b55dc00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:03.202815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac51c6-8dde-40e8-89f9-19c26b55dc00 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:03.231913 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4080/8201] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:53:03.236276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d052ae1-03ad-4d27-b7ab-4fe8b932ea62 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:03.247564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d052ae1-03ad-4d27-b7ab-4fe8b932ea62 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:03.252988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3650-1e6d-42c4-a505-5e4b4a4dd775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:03.254505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3650-1e6d-42c4-a505-5e4b4a4dd775 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:03.255010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3650-1e6d-42c4-a505-5e4b4a4dd775 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:03.255651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3650-1e6d-42c4-a505-5e4b4a4dd775 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:03.256642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f3650-1e6d-42c4-a505-5e4b4a4dd775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:03.258878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f3650-1e6d-42c4-a505-5e4b4a4dd775 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:03.318358 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4122/8202] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:03 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:53:03.322603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac51c6-8dde-40e8-89f9-19c26b55dc00 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:03.339884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac51c6-8dde-40e8-89f9-19c26b55dc00 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:03.462645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:03.524115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e76fc-cea9-44ef-83ed-db03efa31b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:03.526184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e76fc-cea9-44ef-83ed-db03efa31b7a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:03.526578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e76fc-cea9-44ef-83ed-db03efa31b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:03.526942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e76fc-cea9-44ef-83ed-db03efa31b7a admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:03.527703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e76fc-cea9-44ef-83ed-db03efa31b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:03.533765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e76fc-cea9-44ef-83ed-db03efa31b7a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:03.612347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3650-1e6d-42c4-a505-5e4b4a4dd775 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:03.615824 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4081/8203] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:03 2022] POST /identity/v3/users => generated 296 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:53:03.630675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3650-1e6d-42c4-a505-5e4b4a4dd775 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:03.656862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277acc68-b054-469f-a890-40526e53fb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:03.657677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277acc68-b054-469f-a890-40526e53fb87 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:03.658160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277acc68-b054-469f-a890-40526e53fb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:03.660149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277acc68-b054-469f-a890-40526e53fb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:03.661254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277acc68-b054-469f-a890-40526e53fb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:03.667048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277acc68-b054-469f-a890-40526e53fb87 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:03.704418 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4123/8204] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:03.705738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e76fc-cea9-44ef-83ed-db03efa31b7a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:03.720421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e76fc-cea9-44ef-83ed-db03efa31b7a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:03.735393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ee99d-7e1f-4db3-aa04-1f55c8890cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:03.736336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee99d-7e1f-4db3-aa04-1f55c8890cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:03.736759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee99d-7e1f-4db3-aa04-1f55c8890cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:03.737173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ee99d-7e1f-4db3-aa04-1f55c8890cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:03.738061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ee99d-7e1f-4db3-aa04-1f55c8890cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:03.739830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ee99d-7e1f-4db3-aa04-1f55c8890cb7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:03.763216 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4082/8205] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:03.764113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277acc68-b054-469f-a890-40526e53fb87 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:03.818003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277acc68-b054-469f-a890-40526e53fb87 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:03.834623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4b683-1559-444c-8a7f-4519a02330e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:03.836082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b683-1559-444c-8a7f-4519a02330e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:03.836366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b683-1559-444c-8a7f-4519a02330e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:03.836639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b683-1559-444c-8a7f-4519a02330e5 admin admin] PATH_INFO: `/v3/projects/52aef2ad05cd4cab96c9c60e6bd4c9ad/users/4ae60e04962146cbb7d2ccae9351b1ac/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:03.869137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4b683-1559-444c-8a7f-4519a02330e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52aef2ad05cd4cab96c9c60e6bd4c9ad, user_id=4ae60e04962146cbb7d2ccae9351b1ac, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:03.871901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab4b683-1559-444c-8a7f-4519a02330e5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:03.899079 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4124/8206] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:03 2022] PUT /identity/v3/projects/52aef2ad05cd4cab96c9c60e6bd4c9ad/users/4ae60e04962146cbb7d2ccae9351b1ac/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:53:03.909613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee7e38-5283-464c-8a9b-b1fcc16b208e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:03.910244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee7e38-5283-464c-8a9b-b1fcc16b208e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:03.910686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee7e38-5283-464c-8a9b-b1fcc16b208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:03.980931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-fcee7e38-5283-464c-8a9b-b1fcc16b208e None None] MFA Rules not processed for user `4ae60e04962146cbb7d2ccae9351b1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:03.982502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fcee7e38-5283-464c-8a9b-b1fcc16b208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:04.154986 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4083/8207] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:04.162483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4b683-1559-444c-8a7f-4519a02330e5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:04.164344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cab4b683-1559-444c-8a7f-4519a02330e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:04.305801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab4b683-1559-444c-8a7f-4519a02330e5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:04.314986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdfe3f-a1a6-4b81-9064-9bcde2758eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:04.316812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdfe3f-a1a6-4b81-9064-9bcde2758eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:04.317560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdfe3f-a1a6-4b81-9064-9bcde2758eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:04.317950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdfe3f-a1a6-4b81-9064-9bcde2758eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:04.383793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdfe3f-a1a6-4b81-9064-9bcde2758eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:04.385318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdfe3f-a1a6-4b81-9064-9bcde2758eb3 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:04.407125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4125/8208] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:06.273640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee7e38-5283-464c-8a9b-b1fcc16b208e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:06.277004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fcee7e38-5283-464c-8a9b-b1fcc16b208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:06.428414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee7e38-5283-464c-8a9b-b1fcc16b208e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:06.440184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:06.441095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:06.449691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:06.450032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] PATH_INFO: `/v3/users/dbe2cac0bb2148838b13867a8c322bf5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:06.451413 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe2cac0bb2148838b13867a8c322bf5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:06.453403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:06.524261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe2cac0bb2148838b13867a8c322bf5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:06.526394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:06.546504 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe2cac0bb2148838b13867a8c322bf5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:06.597411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe2cac0bb2148838b13867a8c322bf5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:06.608768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe2cac0bb2148838b13867a8c322bf5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:06.609694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe2cac0bb2148838b13867a8c322bf5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:06.628958 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4084/8209] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:53:06 2022] DELETE /identity/v3/users/dbe2cac0bb2148838b13867a8c322bf5 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:06.631735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174bdca-27e1-4a89-baa7-3a6ff85c5c61 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:06.632233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174bdca-27e1-4a89-baa7-3a6ff85c5c61 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:06.632464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174bdca-27e1-4a89-baa7-3a6ff85c5c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:06.680323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c174bdca-27e1-4a89-baa7-3a6ff85c5c61 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:06.682221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c174bdca-27e1-4a89-baa7-3a6ff85c5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:06.765804 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4126/8210] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:06.775535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:06.777301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:06.888745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc59c0a-7b80-48b5-874f-1c929d8cbfa7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:06.901237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e88e30-9ef7-4151-9d78-48aff961ec0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:06.901765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e88e30-9ef7-4151-9d78-48aff961ec0f service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:06.902103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e88e30-9ef7-4151-9d78-48aff961ec0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:06.902337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e88e30-9ef7-4151-9d78-48aff961ec0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:06.917278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e88e30-9ef7-4151-9d78-48aff961ec0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:06.918780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e88e30-9ef7-4151-9d78-48aff961ec0f service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:06.938380 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4085/8211] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:07.649758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174bdca-27e1-4a89-baa7-3a6ff85c5c61 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:07.651352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c174bdca-27e1-4a89-baa7-3a6ff85c5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:07.671617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174bdca-27e1-4a89-baa7-3a6ff85c5c61 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:07.708669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:07.710748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:07.711206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:07.713444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] PATH_INFO: `/v3/projects/82e7c547239242a493fe2ca48f3d72f9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:07.715036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e7c547239242a493fe2ca48f3d72f9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:07.718925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:07.808201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:07.847545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e7c547239242a493fe2ca48f3d72f9', 'request_id': 'req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:07.859726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e7c547239242a493fe2ca48f3d72f9', 'request_id': 'req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:07.878106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e7c547239242a493fe2ca48f3d72f9', 'request_id': 'req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:07.905398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] The token cache is being invalidate because project 82e7c547239242a493fe2ca48f3d72f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:53:07.908407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:07.909682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5ec35c58-06d9-42d8-bb1b-7dc0eeeb4cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:07.911967 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4127/8212] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:53:07 2022] DELETE /identity/v3/projects/82e7c547239242a493fe2ca48f3d72f9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:07.917283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8697-5ad3-4c48-98d7-0783c1db2cfa None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:07.918226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8697-5ad3-4c48-98d7-0783c1db2cfa None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:07.920991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8697-5ad3-4c48-98d7-0783c1db2cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:07.957363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-14ff8697-5ad3-4c48-98d7-0783c1db2cfa None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:07.958297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-14ff8697-5ad3-4c48-98d7-0783c1db2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:08.105128 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4086/8213] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:08.113708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f81653-067e-4f9c-815b-cbc2bcb3f329 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:08.114008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f81653-067e-4f9c-815b-cbc2bcb3f329 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:08.114275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f81653-067e-4f9c-815b-cbc2bcb3f329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:08.153809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b2f81653-067e-4f9c-815b-cbc2bcb3f329 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:08.155729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b2f81653-067e-4f9c-815b-cbc2bcb3f329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:08.172559 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4128/8214] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:08.176583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8697-5ad3-4c48-98d7-0783c1db2cfa None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:08.190136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8697-5ad3-4c48-98d7-0783c1db2cfa None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:08.201041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d731c-576d-47cc-b7db-f868b88f92ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:08.201748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d731c-576d-47cc-b7db-f868b88f92ef admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:08.202043 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d731c-576d-47cc-b7db-f868b88f92ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:08.202307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d731c-576d-47cc-b7db-f868b88f92ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:08.202967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d731c-576d-47cc-b7db-f868b88f92ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:53:08.203262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d731c-576d-47cc-b7db-f868b88f92ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:08.205942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d731c-576d-47cc-b7db-f868b88f92ef admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:08.232696 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4087/8215] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:53:08.235630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f81653-067e-4f9c-815b-cbc2bcb3f329 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:08.252482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f81653-067e-4f9c-815b-cbc2bcb3f329 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:08.262299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8d1e0-7da8-4b6d-8f62-f145ad372b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:08.262935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8d1e0-7da8-4b6d-8f62-f145ad372b58 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:08.263210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8d1e0-7da8-4b6d-8f62-f145ad372b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:08.263512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8d1e0-7da8-4b6d-8f62-f145ad372b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:08.264112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8d1e0-7da8-4b6d-8f62-f145ad372b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:08.266139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed8d1e0-7da8-4b6d-8f62-f145ad372b58 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:08.333145 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4129/8216] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:08 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:08.334878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d731c-576d-47cc-b7db-f868b88f92ef admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:08.354242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d731c-576d-47cc-b7db-f868b88f92ef admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:08.522690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:08.535805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b57a-66cd-4098-a10b-66f848d97cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:08.536509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b57a-66cd-4098-a10b-66f848d97cdb admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:08.536906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b57a-66cd-4098-a10b-66f848d97cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:08.537241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b57a-66cd-4098-a10b-66f848d97cdb admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:08.538199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8b57a-66cd-4098-a10b-66f848d97cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:08.540195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8b57a-66cd-4098-a10b-66f848d97cdb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:08.597495 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4088/8217] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:08 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:08.601971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8d1e0-7da8-4b6d-8f62-f145ad372b58 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:08.629304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8d1e0-7da8-4b6d-8f62-f145ad372b58 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:08.649338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6d90-b37a-46b9-95f1-a203fb1a2fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:08.650160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6d90-b37a-46b9-95f1-a203fb1a2fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:08.651049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6d90-b37a-46b9-95f1-a203fb1a2fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:08.651540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a6d90-b37a-46b9-95f1-a203fb1a2fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:08.652763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a6d90-b37a-46b9-95f1-a203fb1a2fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:08.658463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a6d90-b37a-46b9-95f1-a203fb1a2fc0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:08.673117 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4130/8218] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:08.676403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b57a-66cd-4098-a10b-66f848d97cdb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:08.694255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b57a-66cd-4098-a10b-66f848d97cdb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:08.699961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b28d7c-2b34-443f-b295-7808ba24a7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:08.700950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28d7c-2b34-443f-b295-7808ba24a7dd admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:08.701430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28d7c-2b34-443f-b295-7808ba24a7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:08.701949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28d7c-2b34-443f-b295-7808ba24a7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:08.702857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b28d7c-2b34-443f-b295-7808ba24a7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:08.704784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b28d7c-2b34-443f-b295-7808ba24a7dd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:08.718563 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4089/8219] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:53:08.722856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6d90-b37a-46b9-95f1-a203fb1a2fc0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:08.735146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a6d90-b37a-46b9-95f1-a203fb1a2fc0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:08.742210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0d6a6-9df2-4795-9d4f-2a34bb94e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:08.743157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0d6a6-9df2-4795-9d4f-2a34bb94e3e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:08.743818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0d6a6-9df2-4795-9d4f-2a34bb94e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:08.744283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0d6a6-9df2-4795-9d4f-2a34bb94e3e1 admin admin] PATH_INFO: `/v3/projects/f6a39276b63f4b90876da4b6f2aee072/users/d732e28d279f4b7985ef404d94703a90/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:08.765545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0d6a6-9df2-4795-9d4f-2a34bb94e3e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a39276b63f4b90876da4b6f2aee072, user_id=d732e28d279f4b7985ef404d94703a90, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:08.770044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0d6a6-9df2-4795-9d4f-2a34bb94e3e1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:08.795791 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4131/8220] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:08 2022] PUT /identity/v3/projects/f6a39276b63f4b90876da4b6f2aee072/users/d732e28d279f4b7985ef404d94703a90/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:08.801021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e46eb-d670-45a5-a8cd-269e2cb9d9cb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:08.801916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e46eb-d670-45a5-a8cd-269e2cb9d9cb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:08.801916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e46eb-d670-45a5-a8cd-269e2cb9d9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:08.841207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4c2e46eb-d670-45a5-a8cd-269e2cb9d9cb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:08.842669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4c2e46eb-d670-45a5-a8cd-269e2cb9d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:08.982755 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4090/8221] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:08.996083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0d6a6-9df2-4795-9d4f-2a34bb94e3e1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:08.998177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1ef0d6a6-9df2-4795-9d4f-2a34bb94e3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:09.109956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0d6a6-9df2-4795-9d4f-2a34bb94e3e1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:09.123499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee468c6a-361a-40c9-adc7-fb5d668f5ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:09.124452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee468c6a-361a-40c9-adc7-fb5d668f5ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:09.124793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee468c6a-361a-40c9-adc7-fb5d668f5ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:09.125152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee468c6a-361a-40c9-adc7-fb5d668f5ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:09.147656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee468c6a-361a-40c9-adc7-fb5d668f5ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:09.151247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee468c6a-361a-40c9-adc7-fb5d668f5ef1 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:09.178790 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4132/8222] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:18.232982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a738b-7cda-4972-9992-969d311d9cc4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:18.233503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a738b-7cda-4972-9992-969d311d9cc4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:18.233503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a738b-7cda-4972-9992-969d311d9cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:18.297953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3c1a738b-7cda-4972-9992-969d311d9cc4 None None] MFA Rules not processed for user `d732e28d279f4b7985ef404d94703a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:18.297953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3c1a738b-7cda-4972-9992-969d311d9cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:18.427296 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4091/8223] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:18.432336 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee468c6a-361a-40c9-adc7-fb5d668f5ef1 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:18.443011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee468c6a-361a-40c9-adc7-fb5d668f5ef1 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:18.448392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480cd44-4184-4841-b5f1-be25163c38f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:18.449769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480cd44-4184-4841-b5f1-be25163c38f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:18.449769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480cd44-4184-4841-b5f1-be25163c38f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:18.449769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480cd44-4184-4841-b5f1-be25163c38f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:18.450325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480cd44-4184-4841-b5f1-be25163c38f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:18.457639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480cd44-4184-4841-b5f1-be25163c38f9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:18.502217 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4133/8224] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:18 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:18.506943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a738b-7cda-4972-9992-969d311d9cc4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:18.533479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a738b-7cda-4972-9992-969d311d9cc4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:18.615490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff44cb0-1523-4676-82b6-ac30abfc3390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:18.616407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff44cb0-1523-4676-82b6-ac30abfc3390 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:18.616838 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff44cb0-1523-4676-82b6-ac30abfc3390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:18.617249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff44cb0-1523-4676-82b6-ac30abfc3390 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:18.618084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff44cb0-1523-4676-82b6-ac30abfc3390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:18.620479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff44cb0-1523-4676-82b6-ac30abfc3390 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:18.634509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:18.669048 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4092/8225] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:18 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:18.673056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480cd44-4184-4841-b5f1-be25163c38f9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:18.696910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480cd44-4184-4841-b5f1-be25163c38f9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:18.716165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7009c5-f8ca-4108-9821-751d3cb3089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:18.716820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7009c5-f8ca-4108-9821-751d3cb3089b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:18.717085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7009c5-f8ca-4108-9821-751d3cb3089b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:18.717351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7009c5-f8ca-4108-9821-751d3cb3089b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:18.718044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7009c5-f8ca-4108-9821-751d3cb3089b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:18.719655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7009c5-f8ca-4108-9821-751d3cb3089b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:18.741105 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4134/8226] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:53:18.745160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff44cb0-1523-4676-82b6-ac30abfc3390 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:18.760382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff44cb0-1523-4676-82b6-ac30abfc3390 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:18.789937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d7de5-9d8c-482a-ae1c-a0956659fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:18.790595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7de5-9d8c-482a-ae1c-a0956659fea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:18.791012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7de5-9d8c-482a-ae1c-a0956659fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:18.791291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d7de5-9d8c-482a-ae1c-a0956659fea5 admin admin] PATH_INFO: `/v3/projects/f9b192987dbd4a33bf542c1b68d0e865/users/200380fabca84394b9872615049a6062/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:18.850446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d7de5-9d8c-482a-ae1c-a0956659fea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b192987dbd4a33bf542c1b68d0e865, user_id=200380fabca84394b9872615049a6062, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:18.854619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d7de5-9d8c-482a-ae1c-a0956659fea5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:18.886991 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4093/8227] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:18 2022] PUT /identity/v3/projects/f9b192987dbd4a33bf542c1b68d0e865/users/200380fabca84394b9872615049a6062/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:18.890755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7009c5-f8ca-4108-9821-751d3cb3089b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:18.909391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7009c5-f8ca-4108-9821-751d3cb3089b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:18.951465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:19.094560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019031e9-8681-4360-971f-49dffc67c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:19.095195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019031e9-8681-4360-971f-49dffc67c1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:19.095469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019031e9-8681-4360-971f-49dffc67c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:19.095733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019031e9-8681-4360-971f-49dffc67c1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:19.096383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019031e9-8681-4360-971f-49dffc67c1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:19.098584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019031e9-8681-4360-971f-49dffc67c1b9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:19.126901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d7de5-9d8c-482a-ae1c-a0956659fea5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:19.135608 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4135/8228] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:19.146654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d7de5-9d8c-482a-ae1c-a0956659fea5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:19.167012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda51a29-6abf-4ca5-a087-1d3dc79ec8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:19.167904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda51a29-6abf-4ca5-a087-1d3dc79ec8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:19.168249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda51a29-6abf-4ca5-a087-1d3dc79ec8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:19.168588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda51a29-6abf-4ca5-a087-1d3dc79ec8c4 admin admin] PATH_INFO: `/v3/projects/f9b192987dbd4a33bf542c1b68d0e865/users/200380fabca84394b9872615049a6062/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:19.207426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda51a29-6abf-4ca5-a087-1d3dc79ec8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9b192987dbd4a33bf542c1b68d0e865, user_id=200380fabca84394b9872615049a6062, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:19.209159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda51a29-6abf-4ca5-a087-1d3dc79ec8c4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:19.227740 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4094/8229] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:19 2022] PUT /identity/v3/projects/f9b192987dbd4a33bf542c1b68d0e865/users/200380fabca84394b9872615049a6062/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:20.652852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019031e9-8681-4360-971f-49dffc67c1b9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:20.654899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-019031e9-8681-4360-971f-49dffc67c1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:20.696288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019031e9-8681-4360-971f-49dffc67c1b9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:20.815468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:20.816135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:20.816417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:20.816687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] PATH_INFO: `/v3/users/d98ace2d706c4a40b7aad280e153f2ac` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:20.819599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98ace2d706c4a40b7aad280e153f2ac)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:20.829033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:20.919574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98ace2d706c4a40b7aad280e153f2ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:20.920487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98ace2d706c4a40b7aad280e153f2ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:20.933944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98ace2d706c4a40b7aad280e153f2ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:20.950960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98ace2d706c4a40b7aad280e153f2ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:20.968093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98ace2d706c4a40b7aad280e153f2ac'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:20.985808 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4136/8230] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:53:20 2022] DELETE /identity/v3/users/d98ace2d706c4a40b7aad280e153f2ac => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:20.990865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e68d-fb09-48ae-9853-f8e2687ee6db None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:20.991301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e68d-fb09-48ae-9853-f8e2687ee6db None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:20.991424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e68d-fb09-48ae-9853-f8e2687ee6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:21.026584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ec59e68d-fb09-48ae-9853-f8e2687ee6db None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:21.027993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ec59e68d-fb09-48ae-9853-f8e2687ee6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:21.172807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:21.174419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:21.186787 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4095/8231] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:21.294686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:21.339690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd322b-1aaf-4adc-afd0-830c6296543b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:21.349636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e59141-d2d0-4b8e-9347-9f1365b775bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:21.350418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59141-d2d0-4b8e-9347-9f1365b775bf service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:21.350575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59141-d2d0-4b8e-9347-9f1365b775bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:21.351516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59141-d2d0-4b8e-9347-9f1365b775bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:21.375742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e59141-d2d0-4b8e-9347-9f1365b775bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:21.381384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e59141-d2d0-4b8e-9347-9f1365b775bf service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:21.419457 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4137/8232] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:53:21.958287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59e68d-fb09-48ae-9853-f8e2687ee6db None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:21.961057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ec59e68d-fb09-48ae-9853-f8e2687ee6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:22.001846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59e68d-fb09-48ae-9853-f8e2687ee6db None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:22.021735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:22.023223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:22.023912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:22.027886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] PATH_INFO: `/v3/projects/9b263fef3ef3462d8ee98d2eb048b406` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:22.032755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b263fef3ef3462d8ee98d2eb048b406)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:22.041234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:22.252046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b263fef3ef3462d8ee98d2eb048b406', 'request_id': 'req-fd49919a-19f8-488c-87f9-7ccd2b51c812'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:22.304698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b263fef3ef3462d8ee98d2eb048b406', 'request_id': 'req-fd49919a-19f8-488c-87f9-7ccd2b51c812'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:22.329488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b263fef3ef3462d8ee98d2eb048b406', 'request_id': 'req-fd49919a-19f8-488c-87f9-7ccd2b51c812'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:22.385953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] The token cache is being invalidate because project 9b263fef3ef3462d8ee98d2eb048b406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:53:22.387125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:22.390121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fd49919a-19f8-488c-87f9-7ccd2b51c812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:22.402556 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4096/8233] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:53:21 2022] DELETE /identity/v3/projects/9b263fef3ef3462d8ee98d2eb048b406 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:53:22.403898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7e759-04a0-41f7-88a7-409f8c58d77d None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:22.404341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7e759-04a0-41f7-88a7-409f8c58d77d None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:22.404504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7e759-04a0-41f7-88a7-409f8c58d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:22.466365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-89b7e759-04a0-41f7-88a7-409f8c58d77d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:22.469209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-89b7e759-04a0-41f7-88a7-409f8c58d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:22.632349 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4138/8234] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:22.649157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b2679-683a-408f-a609-7752b828e7ed None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:22.649377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b2679-683a-408f-a609-7752b828e7ed None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:22.649753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b2679-683a-408f-a609-7752b828e7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:22.715327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-930b2679-683a-408f-a609-7752b828e7ed None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:22.718532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-930b2679-683a-408f-a609-7752b828e7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:22.762774 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4097/8235] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:22.763670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7e759-04a0-41f7-88a7-409f8c58d77d None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:22.775564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7e759-04a0-41f7-88a7-409f8c58d77d None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:22.782214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3886f68-d16b-4165-9b28-eba4df9dffbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:22.783145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3886f68-d16b-4165-9b28-eba4df9dffbd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:22.783575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3886f68-d16b-4165-9b28-eba4df9dffbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:22.783979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3886f68-d16b-4165-9b28-eba4df9dffbd admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:22.784805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3886f68-d16b-4165-9b28-eba4df9dffbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:53:22.785334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3886f68-d16b-4165-9b28-eba4df9dffbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:22.787986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3886f68-d16b-4165-9b28-eba4df9dffbd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:22.805700 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4139/8236] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:53:22.810646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b2679-683a-408f-a609-7752b828e7ed None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:22.823603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b2679-683a-408f-a609-7752b828e7ed None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:22.833844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d029d-2821-4913-9cc4-49e2ca63512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:22.834581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d029d-2821-4913-9cc4-49e2ca63512e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:22.838412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d029d-2821-4913-9cc4-49e2ca63512e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:22.838617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d029d-2821-4913-9cc4-49e2ca63512e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:22.839659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d029d-2821-4913-9cc4-49e2ca63512e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:22.841675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d029d-2821-4913-9cc4-49e2ca63512e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:22.900198 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4098/8237] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:22 2022] POST /identity/v3/projects => generated 351 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:22.906805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3886f68-d16b-4165-9b28-eba4df9dffbd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:22.924476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3886f68-d16b-4165-9b28-eba4df9dffbd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:23.172401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a7906-fc48-4b78-8f5e-0ce21aa6a198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:23.172979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a7906-fc48-4b78-8f5e-0ce21aa6a198 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:23.173268 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a7906-fc48-4b78-8f5e-0ce21aa6a198 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:23.173585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a7906-fc48-4b78-8f5e-0ce21aa6a198 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:23.174241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a7906-fc48-4b78-8f5e-0ce21aa6a198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:23.177919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a7906-fc48-4b78-8f5e-0ce21aa6a198 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:23.251845 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4140/8238] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:22 2022] POST /identity/v3/users => generated 276 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:23.252646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d029d-2821-4913-9cc4-49e2ca63512e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:23.269248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d029d-2821-4913-9cc4-49e2ca63512e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:23.286580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbdbc4-6fea-41c3-adf5-24f81c09e34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:23.288053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbdbc4-6fea-41c3-adf5-24f81c09e34c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:23.288332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbdbc4-6fea-41c3-adf5-24f81c09e34c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:23.288603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbdbc4-6fea-41c3-adf5-24f81c09e34c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:23.289272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbdbc4-6fea-41c3-adf5-24f81c09e34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:23.297366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbdbc4-6fea-41c3-adf5-24f81c09e34c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:23.342196 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4099/8239] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:23.342884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a7906-fc48-4b78-8f5e-0ce21aa6a198 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:23.369439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a7906-fc48-4b78-8f5e-0ce21aa6a198 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:23.397024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8521c-3cc5-4caa-9ce4-36fb869b615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:23.398042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8521c-3cc5-4caa-9ce4-36fb869b615e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:23.398515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8521c-3cc5-4caa-9ce4-36fb869b615e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:23.398962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8521c-3cc5-4caa-9ce4-36fb869b615e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:23.399801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8521c-3cc5-4caa-9ce4-36fb869b615e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:23.403491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8521c-3cc5-4caa-9ce4-36fb869b615e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:23.432197 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4141/8240] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:23.433721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbdbc4-6fea-41c3-adf5-24f81c09e34c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:23.441050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:23.452374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbdbc4-6fea-41c3-adf5-24f81c09e34c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:23.488353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09002c-fcdb-40d5-a5f1-c87fe9154ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:23.489293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09002c-fcdb-40d5-a5f1-c87fe9154ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:23.489577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09002c-fcdb-40d5-a5f1-c87fe9154ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:23.490156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09002c-fcdb-40d5-a5f1-c87fe9154ce8 admin admin] PATH_INFO: `/v3/projects/414e6cf301a540928f7f99f814ac03fe/users/f79ca23978c24f6d98fea29b9c83246a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:23.547314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09002c-fcdb-40d5-a5f1-c87fe9154ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414e6cf301a540928f7f99f814ac03fe, user_id=f79ca23978c24f6d98fea29b9c83246a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:23.553005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09002c-fcdb-40d5-a5f1-c87fe9154ce8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:23.597562 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4100/8241] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:23 2022] PUT /identity/v3/projects/414e6cf301a540928f7f99f814ac03fe/users/f79ca23978c24f6d98fea29b9c83246a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:53:23.612815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93023f9d-f5b8-4d20-9f8a-f75fdfc0ea2c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:23.613626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93023f9d-f5b8-4d20-9f8a-f75fdfc0ea2c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:23.614136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93023f9d-f5b8-4d20-9f8a-f75fdfc0ea2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:23.746897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-93023f9d-f5b8-4d20-9f8a-f75fdfc0ea2c None None] MFA Rules not processed for user `f79ca23978c24f6d98fea29b9c83246a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:23.751240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-93023f9d-f5b8-4d20-9f8a-f75fdfc0ea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:23.898262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:23.972345 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4142/8242] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:23.984047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09002c-fcdb-40d5-a5f1-c87fe9154ce8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:23.985834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-da09002c-fcdb-40d5-a5f1-c87fe9154ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:24.078376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09002c-fcdb-40d5-a5f1-c87fe9154ce8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:24.082230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89f5a2-90e1-4643-a7cc-84752ecf4024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:24.082809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89f5a2-90e1-4643-a7cc-84752ecf4024 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:24.083088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89f5a2-90e1-4643-a7cc-84752ecf4024 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:24.083359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89f5a2-90e1-4643-a7cc-84752ecf4024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:24.093470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89f5a2-90e1-4643-a7cc-84752ecf4024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:24.095421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a89f5a2-90e1-4643-a7cc-84752ecf4024 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:24.105769 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4101/8243] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:27.894956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93023f9d-f5b8-4d20-9f8a-f75fdfc0ea2c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:27.897648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-93023f9d-f5b8-4d20-9f8a-f75fdfc0ea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:28.127468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93023f9d-f5b8-4d20-9f8a-f75fdfc0ea2c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:28.138179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fcf82-fe50-4f30-84bb-3a9bf0b522db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:28.139063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fcf82-fe50-4f30-84bb-3a9bf0b522db service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:28.139540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fcf82-fe50-4f30-84bb-3a9bf0b522db service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:28.139981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fcf82-fe50-4f30-84bb-3a9bf0b522db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:28.141963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-131fcf82-fe50-4f30-84bb-3a9bf0b522db service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:28.226700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89f5a2-90e1-4643-a7cc-84752ecf4024 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:28.298232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fcf82-fe50-4f30-84bb-3a9bf0b522db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:28.300459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fcf82-fe50-4f30-84bb-3a9bf0b522db service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:28.323393 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4143/8244] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:53:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:53:28.572842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89f5a2-90e1-4643-a7cc-84752ecf4024 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:28.572842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:28.572842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:28.572842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:28.575918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] PATH_INFO: `/v3/users/f79ca23978c24f6d98fea29b9c83246a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:28.575918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79ca23978c24f6d98fea29b9c83246a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:28.575918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:28.575918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79ca23978c24f6d98fea29b9c83246a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:28.575918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79ca23978c24f6d98fea29b9c83246a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:28.579224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79ca23978c24f6d98fea29b9c83246a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:28.585644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79ca23978c24f6d98fea29b9c83246a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:28.587436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79ca23978c24f6d98fea29b9c83246a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:28.607230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:28.615403 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4102/8245] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:53:28 2022] DELETE /identity/v3/users/f79ca23978c24f6d98fea29b9c83246a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:53:28.617254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897f4ed-8cc5-4091-93bf-d5bcc4c3c091 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:28.617390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897f4ed-8cc5-4091-93bf-d5bcc4c3c091 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:28.617599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897f4ed-8cc5-4091-93bf-d5bcc4c3c091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:28.673468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0897f4ed-8cc5-4091-93bf-d5bcc4c3c091 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:28.675392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0897f4ed-8cc5-4091-93bf-d5bcc4c3c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:28.872406 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4144/8246] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:28.883800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:28.887072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:29.043870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9761fe-1297-4b7b-a086-8f25fdc0b191 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:29.056091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc48b8-f4a3-4296-b321-2a4f2662825e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:29.056870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc48b8-f4a3-4296-b321-2a4f2662825e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:29.057157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc48b8-f4a3-4296-b321-2a4f2662825e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:29.057427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc48b8-f4a3-4296-b321-2a4f2662825e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:29.084700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc48b8-f4a3-4296-b321-2a4f2662825e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:29.086493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc48b8-f4a3-4296-b321-2a4f2662825e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:29.127933 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4103/8247] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:29.706945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897f4ed-8cc5-4091-93bf-d5bcc4c3c091 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:29.708506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0897f4ed-8cc5-4091-93bf-d5bcc4c3c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:29.737025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0897f4ed-8cc5-4091-93bf-d5bcc4c3c091 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:29.748008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:29.748405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:29.748854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:29.749025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] PATH_INFO: `/v3/projects/414e6cf301a540928f7f99f814ac03fe` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:29.756481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414e6cf301a540928f7f99f814ac03fe)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:29.758535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:29.803009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:29.933103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414e6cf301a540928f7f99f814ac03fe', 'request_id': 'req-7e295dbb-e561-4967-b40d-5ea2a9674007'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:29.941241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414e6cf301a540928f7f99f814ac03fe', 'request_id': 'req-7e295dbb-e561-4967-b40d-5ea2a9674007'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:29.979389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414e6cf301a540928f7f99f814ac03fe', 'request_id': 'req-7e295dbb-e561-4967-b40d-5ea2a9674007'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:29.993454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] The token cache is being invalidate because project 414e6cf301a540928f7f99f814ac03fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:53:29.994277 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:29.995311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7e295dbb-e561-4967-b40d-5ea2a9674007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:29.998710 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4145/8248] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:53:29 2022] DELETE /identity/v3/projects/414e6cf301a540928f7f99f814ac03fe => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:30.003565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c69289-5ed4-44cf-88d3-ec2830d86ca1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:30.004021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c69289-5ed4-44cf-88d3-ec2830d86ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:30.004123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c69289-5ed4-44cf-88d3-ec2830d86ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:30.052662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f4c69289-5ed4-44cf-88d3-ec2830d86ca1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:30.059479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f4c69289-5ed4-44cf-88d3-ec2830d86ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:30.268577 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4104/8249] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:53:30.276715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe8ea7-90da-4f84-ba2b-8e972dcce126 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:30.277161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe8ea7-90da-4f84-ba2b-8e972dcce126 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:30.277378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe8ea7-90da-4f84-ba2b-8e972dcce126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:30.323608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1ebe8ea7-90da-4f84-ba2b-8e972dcce126 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:30.325149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1ebe8ea7-90da-4f84-ba2b-8e972dcce126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:30.335004 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4146/8250] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:30.339141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c69289-5ed4-44cf-88d3-ec2830d86ca1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:30.353149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c69289-5ed4-44cf-88d3-ec2830d86ca1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:30.367820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990bd01-055f-400d-9704-19853527c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:30.370488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990bd01-055f-400d-9704-19853527c6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:30.370938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990bd01-055f-400d-9704-19853527c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:30.371345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990bd01-055f-400d-9704-19853527c6b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:30.372780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990bd01-055f-400d-9704-19853527c6b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:53:30.373251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990bd01-055f-400d-9704-19853527c6b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:30.375121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990bd01-055f-400d-9704-19853527c6b7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:30.407512 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4105/8251] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:53:30.412039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe8ea7-90da-4f84-ba2b-8e972dcce126 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:30.425548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe8ea7-90da-4f84-ba2b-8e972dcce126 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:30.437088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345509b-1a84-4b19-9c74-654fc80e408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:30.437739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345509b-1a84-4b19-9c74-654fc80e408c admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:30.438041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345509b-1a84-4b19-9c74-654fc80e408c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:30.438316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345509b-1a84-4b19-9c74-654fc80e408c admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:30.438965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345509b-1a84-4b19-9c74-654fc80e408c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:30.440903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345509b-1a84-4b19-9c74-654fc80e408c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:30.550320 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4147/8252] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:30 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:30.553945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990bd01-055f-400d-9704-19853527c6b7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:30.571850 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ebfdd-6443-4768-9b90-c8d4bc1b15f5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:30.572252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ebfdd-6443-4768-9b90-c8d4bc1b15f5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:30.572424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ebfdd-6443-4768-9b90-c8d4bc1b15f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:30.596808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990bd01-055f-400d-9704-19853527c6b7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:30.663831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e68ebfdd-6443-4768-9b90-c8d4bc1b15f5 None None] MFA Rules not processed for user `200380fabca84394b9872615049a6062`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:30.665008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e68ebfdd-6443-4768-9b90-c8d4bc1b15f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:30.702296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05052b9-2192-4246-951b-4d4f7997542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:30.703376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05052b9-2192-4246-951b-4d4f7997542c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:30.703948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05052b9-2192-4246-951b-4d4f7997542c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:30.704459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05052b9-2192-4246-951b-4d4f7997542c admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:30.705367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05052b9-2192-4246-951b-4d4f7997542c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:30.707898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05052b9-2192-4246-951b-4d4f7997542c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:30.784829 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4106/8253] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:30 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:30.789821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05052b9-2192-4246-951b-4d4f7997542c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:30.804450 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05052b9-2192-4246-951b-4d4f7997542c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:30.811381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1c3cc-ab53-4d04-85a5-01ad9d4533a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:30.812213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1c3cc-ab53-4d04-85a5-01ad9d4533a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:30.812770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1c3cc-ab53-4d04-85a5-01ad9d4533a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:30.813149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1c3cc-ab53-4d04-85a5-01ad9d4533a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:30.813985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1c3cc-ab53-4d04-85a5-01ad9d4533a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:30.816037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1c3cc-ab53-4d04-85a5-01ad9d4533a0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:30.828543 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4148/8254] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:30.829779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ebfdd-6443-4768-9b90-c8d4bc1b15f5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:30.835325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e68ebfdd-6443-4768-9b90-c8d4bc1b15f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:30.861345 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4107/8255] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:30.868451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1c3cc-ab53-4d04-85a5-01ad9d4533a0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:30.904802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1c3cc-ab53-4d04-85a5-01ad9d4533a0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:30.912046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d27686-b05c-4df8-b0f1-78fcda513a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:30.913359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d27686-b05c-4df8-b0f1-78fcda513a0b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:30.913359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d27686-b05c-4df8-b0f1-78fcda513a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:30.913359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d27686-b05c-4df8-b0f1-78fcda513a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:30.914170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d27686-b05c-4df8-b0f1-78fcda513a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:30.915742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d27686-b05c-4df8-b0f1-78fcda513a0b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:30.919127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:30.932836 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4108/8256] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:30.938084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d27686-b05c-4df8-b0f1-78fcda513a0b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:30.945706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:30.952642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d27686-b05c-4df8-b0f1-78fcda513a0b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:30.960228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfba679-2654-4b70-bf09-c139a5504f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:30.961152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba679-2654-4b70-bf09-c139a5504f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:30.961730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba679-2654-4b70-bf09-c139a5504f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:30.962087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfba679-2654-4b70-bf09-c139a5504f8b admin admin] PATH_INFO: `/v3/projects/4a196b18f3ba40848b1da84237d18628/users/c0bfc08d9ee64524a07f1ff795c37576/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:30.980040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ebfdd-6443-4768-9b90-c8d4bc1b15f5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:30.981316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfba679-2654-4b70-bf09-c139a5504f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a196b18f3ba40848b1da84237d18628, user_id=c0bfc08d9ee64524a07f1ff795c37576, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:30.985060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfba679-2654-4b70-bf09-c139a5504f8b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:30.987011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849a17-74c3-4c8a-b719-be45eae88c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:30.987644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849a17-74c3-4c8a-b719-be45eae88c4e service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:30.987919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849a17-74c3-4c8a-b719-be45eae88c4e service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:30.988185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47849a17-74c3-4c8a-b719-be45eae88c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:31.000647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47849a17-74c3-4c8a-b719-be45eae88c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:31.003603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47849a17-74c3-4c8a-b719-be45eae88c4e service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:31.011871 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4109/8257] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:30 2022] PUT /identity/v3/projects/4a196b18f3ba40848b1da84237d18628/users/c0bfc08d9ee64524a07f1ff795c37576/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:31.019095 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4149/8258] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:31.024638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91861bce-ace1-4684-b778-9a4210a3fb07 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:31.024928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91861bce-ace1-4684-b778-9a4210a3fb07 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:31.025204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91861bce-ace1-4684-b778-9a4210a3fb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:31.086395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-91861bce-ace1-4684-b778-9a4210a3fb07 None None] MFA Rules not processed for user `c0bfc08d9ee64524a07f1ff795c37576`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:31.089278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-91861bce-ace1-4684-b778-9a4210a3fb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:31.243563 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4110/8259] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:31.244233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849a17-74c3-4c8a-b719-be45eae88c4e service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:31.255831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47849a17-74c3-4c8a-b719-be45eae88c4e service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:31.437909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8411bf8-bf75-4888-89f8-ba35742c8f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:31.441541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411bf8-bf75-4888-89f8-ba35742c8f3f admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:31.441824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411bf8-bf75-4888-89f8-ba35742c8f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:31.446122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8411bf8-bf75-4888-89f8-ba35742c8f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:31.447477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8411bf8-bf75-4888-89f8-ba35742c8f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:31.450525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8411bf8-bf75-4888-89f8-ba35742c8f3f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:31.511308 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4150/8260] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:31 2022] POST /identity/v3/projects => generated 363 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:53:31.511678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91861bce-ace1-4684-b778-9a4210a3fb07 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:31.525033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91861bce-ace1-4684-b778-9a4210a3fb07 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:31.618609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235909b7-dfdd-4ffe-98ec-a5488b780cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:31.619243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235909b7-dfdd-4ffe-98ec-a5488b780cfa admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:31.619524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235909b7-dfdd-4ffe-98ec-a5488b780cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:31.619810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235909b7-dfdd-4ffe-98ec-a5488b780cfa admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:31.620474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235909b7-dfdd-4ffe-98ec-a5488b780cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:31.622711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235909b7-dfdd-4ffe-98ec-a5488b780cfa admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:31.666737 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4111/8261] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:31 2022] POST /identity/v3/users => generated 288 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:31.669846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8411bf8-bf75-4888-89f8-ba35742c8f3f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:31.692189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8411bf8-bf75-4888-89f8-ba35742c8f3f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:31.697934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0af4a6-e0aa-451a-8e03-4aff3c30a20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:31.698742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0af4a6-e0aa-451a-8e03-4aff3c30a20b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:31.699191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0af4a6-e0aa-451a-8e03-4aff3c30a20b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:31.699616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0af4a6-e0aa-451a-8e03-4aff3c30a20b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:31.700405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0af4a6-e0aa-451a-8e03-4aff3c30a20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:31.702616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0af4a6-e0aa-451a-8e03-4aff3c30a20b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:31.719606 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4151/8262] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:31.723662 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235909b7-dfdd-4ffe-98ec-a5488b780cfa admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:31.737430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235909b7-dfdd-4ffe-98ec-a5488b780cfa admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:31.780788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4593c6-0889-4221-b900-c8c31df71389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:31.782400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4593c6-0889-4221-b900-c8c31df71389 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:31.784726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4593c6-0889-4221-b900-c8c31df71389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:31.802909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4593c6-0889-4221-b900-c8c31df71389 admin admin] PATH_INFO: `/v3/projects/d4f3905d0e0f4505813cc84acccb15ab/users/c8a5b37bff1a48ee9c0960cd3c8f4203/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:31.831417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4593c6-0889-4221-b900-c8c31df71389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f3905d0e0f4505813cc84acccb15ab, user_id=c8a5b37bff1a48ee9c0960cd3c8f4203, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:31.836022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4593c6-0889-4221-b900-c8c31df71389 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:31.888403 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4112/8263] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:31 2022] PUT /identity/v3/projects/d4f3905d0e0f4505813cc84acccb15ab/users/c8a5b37bff1a48ee9c0960cd3c8f4203/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:31.889758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0af4a6-e0aa-451a-8e03-4aff3c30a20b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:31.920515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0af4a6-e0aa-451a-8e03-4aff3c30a20b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:32.047421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a198170-65b3-42e2-9a83-36d0d723b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:32.048075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a198170-65b3-42e2-9a83-36d0d723b8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:32.048349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a198170-65b3-42e2-9a83-36d0d723b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:32.048617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a198170-65b3-42e2-9a83-36d0d723b8f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:32.049449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a198170-65b3-42e2-9a83-36d0d723b8f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:32.055001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a198170-65b3-42e2-9a83-36d0d723b8f7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:32.086105 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4152/8264] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:32.088224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4593c6-0889-4221-b900-c8c31df71389 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:32.100678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4593c6-0889-4221-b900-c8c31df71389 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:32.112694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849f7f-a3a3-462a-9c0d-277903bd6d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:32.113527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849f7f-a3a3-462a-9c0d-277903bd6d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:32.114000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849f7f-a3a3-462a-9c0d-277903bd6d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:32.114546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849f7f-a3a3-462a-9c0d-277903bd6d6c admin admin] PATH_INFO: `/v3/projects/d4f3905d0e0f4505813cc84acccb15ab/users/c8a5b37bff1a48ee9c0960cd3c8f4203/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:32.133553 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16849f7f-a3a3-462a-9c0d-277903bd6d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f3905d0e0f4505813cc84acccb15ab, user_id=c8a5b37bff1a48ee9c0960cd3c8f4203, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:32.137340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16849f7f-a3a3-462a-9c0d-277903bd6d6c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:32.151805 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4113/8265] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:32 2022] PUT /identity/v3/projects/d4f3905d0e0f4505813cc84acccb15ab/users/c8a5b37bff1a48ee9c0960cd3c8f4203/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:32.165765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f085833-37c6-4b4b-973b-b842cd8fb769 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:32.166211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f085833-37c6-4b4b-973b-b842cd8fb769 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:32.166484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f085833-37c6-4b4b-973b-b842cd8fb769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:32.222693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1f085833-37c6-4b4b-973b-b842cd8fb769 None None] MFA Rules not processed for user `c8a5b37bff1a48ee9c0960cd3c8f4203`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:32.224286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1f085833-37c6-4b4b-973b-b842cd8fb769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:32.291558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:32.335944 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4153/8266] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:32.348454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849f7f-a3a3-462a-9c0d-277903bd6d6c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:32.351016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-16849f7f-a3a3-462a-9c0d-277903bd6d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:32.376891 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:32.450932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849f7f-a3a3-462a-9c0d-277903bd6d6c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:32.457024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e8962-b050-49a4-8db3-73bc8c09349e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:32.458996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e8962-b050-49a4-8db3-73bc8c09349e service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:32.459287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e8962-b050-49a4-8db3-73bc8c09349e service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:32.459666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e8962-b050-49a4-8db3-73bc8c09349e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:32.472398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e8962-b050-49a4-8db3-73bc8c09349e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:32.474535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e8962-b050-49a4-8db3-73bc8c09349e service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:32.490818 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4114/8267] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:32.518345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f085833-37c6-4b4b-973b-b842cd8fb769 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:32.519999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1f085833-37c6-4b4b-973b-b842cd8fb769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:32.671349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f085833-37c6-4b4b-973b-b842cd8fb769 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:32.690417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adba6ba-f4e5-4c9b-a551-027ac8ec1398 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:32.691058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba6ba-f4e5-4c9b-a551-027ac8ec1398 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:32.691331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba6ba-f4e5-4c9b-a551-027ac8ec1398 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:32.691595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adba6ba-f4e5-4c9b-a551-027ac8ec1398 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:32.693560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2adba6ba-f4e5-4c9b-a551-027ac8ec1398 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:32.750004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adba6ba-f4e5-4c9b-a551-027ac8ec1398 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:32.752038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adba6ba-f4e5-4c9b-a551-027ac8ec1398 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:32.779417 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4154/8268] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:33.445114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e8962-b050-49a4-8db3-73bc8c09349e service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:33.565017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e8962-b050-49a4-8db3-73bc8c09349e service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:33.571246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:33.572700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:33.573284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:33.573673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adba6ba-f4e5-4c9b-a551-027ac8ec1398 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:33.575115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] PATH_INFO: `/v3/users/c0bfc08d9ee64524a07f1ff795c37576` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:33.575227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2adba6ba-f4e5-4c9b-a551-027ac8ec1398 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:33.576789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0bfc08d9ee64524a07f1ff795c37576)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:33.579517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:33.621140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adba6ba-f4e5-4c9b-a551-027ac8ec1398 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:33.642783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efe8ab-6425-4dac-9091-98a09e2f12c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:33.643030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efe8ab-6425-4dac-9091-98a09e2f12c3 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:33.643247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efe8ab-6425-4dac-9091-98a09e2f12c3 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:33.643450 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efe8ab-6425-4dac-9091-98a09e2f12c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:33.645280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-67efe8ab-6425-4dac-9091-98a09e2f12c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:33.671155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0bfc08d9ee64524a07f1ff795c37576'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:33.690108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0bfc08d9ee64524a07f1ff795c37576'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:33.711204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efe8ab-6425-4dac-9091-98a09e2f12c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:33.712261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0bfc08d9ee64524a07f1ff795c37576'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:33.712847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efe8ab-6425-4dac-9091-98a09e2f12c3 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:33.723470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0bfc08d9ee64524a07f1ff795c37576'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:33.724750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b002c261-da88-438c-998a-2eae0c1f5f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0bfc08d9ee64524a07f1ff795c37576'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:33.738516 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4115/8269] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:53:33 2022] DELETE /identity/v3/users/c0bfc08d9ee64524a07f1ff795c37576 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:33.740522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab187b6-62c2-44d8-9d8d-9be98fc72b5c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:33.741016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab187b6-62c2-44d8-9d8d-9be98fc72b5c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:33.741670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab187b6-62c2-44d8-9d8d-9be98fc72b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:33.753679 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4155/8270] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:53:33.766203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2ab187b6-62c2-44d8-9d8d-9be98fc72b5c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:33.767926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2ab187b6-62c2-44d8-9d8d-9be98fc72b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:33.859324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:33.932207 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4116/8271] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:33.942352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efe8ab-6425-4dac-9091-98a09e2f12c3 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:33.944504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-67efe8ab-6425-4dac-9091-98a09e2f12c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:34.072567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efe8ab-6425-4dac-9091-98a09e2f12c3 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:34.195178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbca122-fe47-4051-ba04-0dba1a89e302 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:34.196139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbca122-fe47-4051-ba04-0dba1a89e302 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:34.196856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbca122-fe47-4051-ba04-0dba1a89e302 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:34.197273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbca122-fe47-4051-ba04-0dba1a89e302 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:34.220470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbca122-fe47-4051-ba04-0dba1a89e302 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:34.222242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbca122-fe47-4051-ba04-0dba1a89e302 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:34.246000 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4156/8272] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:34.916901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab187b6-62c2-44d8-9d8d-9be98fc72b5c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:34.918909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2ab187b6-62c2-44d8-9d8d-9be98fc72b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:34.953488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab187b6-62c2-44d8-9d8d-9be98fc72b5c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:34.976519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:34.978071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:34.978672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:34.979288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] PATH_INFO: `/v3/projects/4a196b18f3ba40848b1da84237d18628` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:34.981572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a196b18f3ba40848b1da84237d18628)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:34.983758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:35.107509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a196b18f3ba40848b1da84237d18628', 'request_id': 'req-f08da6f6-d322-4676-b539-86acd7082f05'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:35.123551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a196b18f3ba40848b1da84237d18628', 'request_id': 'req-f08da6f6-d322-4676-b539-86acd7082f05'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:35.168005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a196b18f3ba40848b1da84237d18628', 'request_id': 'req-f08da6f6-d322-4676-b539-86acd7082f05'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:35.188420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] The token cache is being invalidate because project 4a196b18f3ba40848b1da84237d18628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:53:35.189806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:35.193105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:35.211571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbca122-fe47-4051-ba04-0dba1a89e302 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:35.213895 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4117/8273] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:53:34 2022] DELETE /identity/v3/projects/4a196b18f3ba40848b1da84237d18628 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:35.225098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbca122-fe47-4051-ba04-0dba1a89e302 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:35.261587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:35.439418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:35.440083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:35.440832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:35.441120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] PATH_INFO: `/v3/users/c8a5b37bff1a48ee9c0960cd3c8f4203` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:35.443541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8a5b37bff1a48ee9c0960cd3c8f4203)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:35.446418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:35.589332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8a5b37bff1a48ee9c0960cd3c8f4203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:35.591033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8a5b37bff1a48ee9c0960cd3c8f4203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:35.603771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8a5b37bff1a48ee9c0960cd3c8f4203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:35.615533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8a5b37bff1a48ee9c0960cd3c8f4203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:35.633729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-859b7c62-bd1c-4792-b775-fcd50917cb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8a5b37bff1a48ee9c0960cd3c8f4203'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:35.676309 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4157/8274] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:53:35 2022] DELETE /identity/v3/users/c8a5b37bff1a48ee9c0960cd3c8f4203 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:35.852898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:35.854393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:35.870775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08da6f6-d322-4676-b539-86acd7082f05 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:35.978371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:35.979967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:35.980445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:35.980929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] PATH_INFO: `/v3/users/4ae60e04962146cbb7d2ccae9351b1ac` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:35.984314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae60e04962146cbb7d2ccae9351b1ac)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:35.990358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:36.105818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae60e04962146cbb7d2ccae9351b1ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:36.120353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae60e04962146cbb7d2ccae9351b1ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:36.137528 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:36.161510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae60e04962146cbb7d2ccae9351b1ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:36.183617 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae60e04962146cbb7d2ccae9351b1ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:36.184253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae60e04962146cbb7d2ccae9351b1ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:36.195506 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4118/8275] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:53:35 2022] DELETE /identity/v3/users/4ae60e04962146cbb7d2ccae9351b1ac => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:36.200080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ed9fe-2a53-40bc-9ec6-c75554f7f409 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:36.200402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ed9fe-2a53-40bc-9ec6-c75554f7f409 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:36.200678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ed9fe-2a53-40bc-9ec6-c75554f7f409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:36.235894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-059ed9fe-2a53-40bc-9ec6-c75554f7f409 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:36.239447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-059ed9fe-2a53-40bc-9ec6-c75554f7f409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:36.254959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:36.256714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:36.472158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922ea32-d043-43df-9d1a-543ace10dbc1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:36.496771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25367452-6d5e-4dfd-be52-54d111be6e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:36.497501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25367452-6d5e-4dfd-be52-54d111be6e61 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:36.500842 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4158/8276] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:36.510505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25367452-6d5e-4dfd-be52-54d111be6e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:36.510956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25367452-6d5e-4dfd-be52-54d111be6e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:36.518973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-25367452-6d5e-4dfd-be52-54d111be6e61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:36.568107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ed9fe-2a53-40bc-9ec6-c75554f7f409 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:36.570098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-059ed9fe-2a53-40bc-9ec6-c75554f7f409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:36.718400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:36.783176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ed9fe-2a53-40bc-9ec6-c75554f7f409 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:36.802455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ed131-20f8-41a3-8d70-5223acbfec87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:36.803140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ed131-20f8-41a3-8d70-5223acbfec87 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:36.803420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ed131-20f8-41a3-8d70-5223acbfec87 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:36.803693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ed131-20f8-41a3-8d70-5223acbfec87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:36.807309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25367452-6d5e-4dfd-be52-54d111be6e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:36.808905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25367452-6d5e-4dfd-be52-54d111be6e61 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:36.834301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ed131-20f8-41a3-8d70-5223acbfec87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:36.835012 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4119/8277] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:36.837043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ed131-20f8-41a3-8d70-5223acbfec87 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:36.854984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25367452-6d5e-4dfd-be52-54d111be6e61 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:36.862219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-25367452-6d5e-4dfd-be52-54d111be6e61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:36.886857 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4159/8278] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:53:36.915610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25367452-6d5e-4dfd-be52-54d111be6e61 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:36.931161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:36.932094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:36.934704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:36.935206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] PATH_INFO: `/v3/projects/d4f3905d0e0f4505813cc84acccb15ab` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:36.937842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f3905d0e0f4505813cc84acccb15ab)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:36.940224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:37.108256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f3905d0e0f4505813cc84acccb15ab', 'request_id': 'req-15cc54e8-b1a5-431a-907b-a2f23623b0b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:37.139669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f3905d0e0f4505813cc84acccb15ab', 'request_id': 'req-15cc54e8-b1a5-431a-907b-a2f23623b0b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:37.148943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f3905d0e0f4505813cc84acccb15ab', 'request_id': 'req-15cc54e8-b1a5-431a-907b-a2f23623b0b2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:37.163646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] The token cache is being invalidate because project d4f3905d0e0f4505813cc84acccb15ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:53:37.163945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:37.165611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-15cc54e8-b1a5-431a-907b-a2f23623b0b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:37.169288 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4120/8279] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:53:36 2022] DELETE /identity/v3/projects/d4f3905d0e0f4505813cc84acccb15ab => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:37.174855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f13ed-d6e0-402e-b136-849af8afbc8a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:37.175137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f13ed-d6e0-402e-b136-849af8afbc8a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:37.175412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f13ed-d6e0-402e-b136-849af8afbc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:37.227492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-521f13ed-d6e0-402e-b136-849af8afbc8a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:37.229115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-521f13ed-d6e0-402e-b136-849af8afbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:37.386164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4160/8280] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:37.394002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731575b-3bf3-4124-9c0a-0f8308218ff0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:37.394338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731575b-3bf3-4124-9c0a-0f8308218ff0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:37.394548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731575b-3bf3-4124-9c0a-0f8308218ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:37.422993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f731575b-3bf3-4124-9c0a-0f8308218ff0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:37.424027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f731575b-3bf3-4124-9c0a-0f8308218ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:37.438821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f13ed-d6e0-402e-b136-849af8afbc8a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:37.446022 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4121/8281] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:37.453792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f13ed-d6e0-402e-b136-849af8afbc8a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:37.467023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6b311-17e1-4ba5-a3e2-920ef26f074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:37.467668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6b311-17e1-4ba5-a3e2-920ef26f074d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:37.467944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6b311-17e1-4ba5-a3e2-920ef26f074d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:37.468251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6b311-17e1-4ba5-a3e2-920ef26f074d admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:37.468895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6b311-17e1-4ba5-a3e2-920ef26f074d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:53:37.469188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6b311-17e1-4ba5-a3e2-920ef26f074d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:37.471675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6b311-17e1-4ba5-a3e2-920ef26f074d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:37.501889 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4161/8282] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:53:37.506911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731575b-3bf3-4124-9c0a-0f8308218ff0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:37.520166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731575b-3bf3-4124-9c0a-0f8308218ff0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:37.533211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2f592-f47c-4c93-8aad-dac6ca561ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:37.533900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2f592-f47c-4c93-8aad-dac6ca561ebe admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:37.534195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2f592-f47c-4c93-8aad-dac6ca561ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:37.534458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2f592-f47c-4c93-8aad-dac6ca561ebe admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:37.535102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2f592-f47c-4c93-8aad-dac6ca561ebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:37.540113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2f592-f47c-4c93-8aad-dac6ca561ebe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:37.549322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:37.644630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6b311-17e1-4ba5-a3e2-920ef26f074d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:37.648112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-93d6b311-17e1-4ba5-a3e2-920ef26f074d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:37.657049 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4122/8283] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:37 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:37.659548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2f592-f47c-4c93-8aad-dac6ca561ebe admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:37.672527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6b311-17e1-4ba5-a3e2-920ef26f074d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:37.848587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:37.850548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:37.850926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:37.851346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] PATH_INFO: `/v3/projects/52aef2ad05cd4cab96c9c60e6bd4c9ad` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:37.851953 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2f592-f47c-4c93-8aad-dac6ca561ebe admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:37.854546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52aef2ad05cd4cab96c9c60e6bd4c9ad)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:37.859032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:37.866337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714e9ab-bf8c-4117-97b2-41cf0270a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:37.866967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714e9ab-bf8c-4117-97b2-41cf0270a797 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:37.867241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714e9ab-bf8c-4117-97b2-41cf0270a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:37.867512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714e9ab-bf8c-4117-97b2-41cf0270a797 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:37.868155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714e9ab-bf8c-4117-97b2-41cf0270a797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:37.870179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714e9ab-bf8c-4117-97b2-41cf0270a797 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:37.926128 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4123/8284] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:37 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:37.928046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714e9ab-bf8c-4117-97b2-41cf0270a797 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:37.947820 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714e9ab-bf8c-4117-97b2-41cf0270a797 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:37.959530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52aef2ad05cd4cab96c9c60e6bd4c9ad', 'request_id': 'req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:37.967781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52aef2ad05cd4cab96c9c60e6bd4c9ad', 'request_id': 'req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:37.983204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52aef2ad05cd4cab96c9c60e6bd4c9ad', 'request_id': 'req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:37.991841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:38.026536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] The token cache is being invalidate because project 52aef2ad05cd4cab96c9c60e6bd4c9ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:53:38.026895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:38.028174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8879e3f-1b7b-4eb6-a8c2-00a37d852669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:38.030870 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4162/8285] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:53:37 2022] DELETE /identity/v3/projects/52aef2ad05cd4cab96c9c60e6bd4c9ad => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:38.037294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa8c33-b529-4828-aed1-00b3b954067e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.037598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa8c33-b529-4828-aed1-00b3b954067e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.037893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa8c33-b529-4828-aed1-00b3b954067e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.059469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a169573-df52-41bb-b0b6-3dfcdcf5e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.060285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a169573-df52-41bb-b0b6-3dfcdcf5e423 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.060674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a169573-df52-41bb-b0b6-3dfcdcf5e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.061045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a169573-df52-41bb-b0b6-3dfcdcf5e423 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.061813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a169573-df52-41bb-b0b6-3dfcdcf5e423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.063817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a169573-df52-41bb-b0b6-3dfcdcf5e423 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.088954 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4124/8286] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:53:38.090007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a169573-df52-41bb-b0b6-3dfcdcf5e423 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.091857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0a169573-df52-41bb-b0b6-3dfcdcf5e423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:38.100141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-05aa8c33-b529-4828-aed1-00b3b954067e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:38.101405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-05aa8c33-b529-4828-aed1-00b3b954067e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:38.106097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a169573-df52-41bb-b0b6-3dfcdcf5e423 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.111180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f953b7-d138-4ea2-9fa3-d6ac1e517f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.111793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f953b7-d138-4ea2-9fa3-d6ac1e517f94 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.112239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f953b7-d138-4ea2-9fa3-d6ac1e517f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.112785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f953b7-d138-4ea2-9fa3-d6ac1e517f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.115173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f953b7-d138-4ea2-9fa3-d6ac1e517f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.117177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f953b7-d138-4ea2-9fa3-d6ac1e517f94 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.131813 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4163/8288] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:38.132085 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4125/8288] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:38.133442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b292-b5c0-419b-a8ba-7deaa1d7924b None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.133730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b292-b5c0-419b-a8ba-7deaa1d7924b None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.134033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4b292-b5c0-419b-a8ba-7deaa1d7924b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.135943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f953b7-d138-4ea2-9fa3-d6ac1e517f94 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.154368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f953b7-d138-4ea2-9fa3-d6ac1e517f94 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.160648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6303c38-7736-4189-a005-7c51b47dcdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.161905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6303c38-7736-4189-a005-7c51b47dcdeb admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.162295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6303c38-7736-4189-a005-7c51b47dcdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.162698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6303c38-7736-4189-a005-7c51b47dcdeb admin admin] PATH_INFO: `/v3/projects/1878ba1ec72444d4a979102358000272/users/57b7f47b1574470dae74216b5c625cfa/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.179083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-68c4b292-b5c0-419b-a8ba-7deaa1d7924b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:38.180408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-68c4b292-b5c0-419b-a8ba-7deaa1d7924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:38.202052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6303c38-7736-4189-a005-7c51b47dcdeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1878ba1ec72444d4a979102358000272, user_id=57b7f47b1574470dae74216b5c625cfa, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.205328 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4164/8289] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:38.205514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6303c38-7736-4189-a005-7c51b47dcdeb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.209575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4b292-b5c0-419b-a8ba-7deaa1d7924b None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.235376 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4126/8290] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:38 2022] PUT /identity/v3/projects/1878ba1ec72444d4a979102358000272/users/57b7f47b1574470dae74216b5c625cfa/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:38.236660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4b292-b5c0-419b-a8ba-7deaa1d7924b None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.252026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18097f11-7036-4a91-a802-ccbcf9ee14cb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.252315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18097f11-7036-4a91-a802-ccbcf9ee14cb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.252586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18097f11-7036-4a91-a802-ccbcf9ee14cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.306488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-18097f11-7036-4a91-a802-ccbcf9ee14cb None None] MFA Rules not processed for user `57b7f47b1574470dae74216b5c625cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:38.308225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-18097f11-7036-4a91-a802-ccbcf9ee14cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:38.347435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:38.360269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7db8d-0c2e-4b17-ade7-5ebf52f6ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.360905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7db8d-0c2e-4b17-ade7-5ebf52f6ff06 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.361188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7db8d-0c2e-4b17-ade7-5ebf52f6ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.361524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7db8d-0c2e-4b17-ade7-5ebf52f6ff06 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.362219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7db8d-0c2e-4b17-ade7-5ebf52f6ff06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:53:38.362520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7db8d-0c2e-4b17-ade7-5ebf52f6ff06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.365399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7db8d-0c2e-4b17-ade7-5ebf52f6ff06 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.380734 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4165/8291] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:53:38.387591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7db8d-0c2e-4b17-ade7-5ebf52f6ff06 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.407982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7db8d-0c2e-4b17-ade7-5ebf52f6ff06 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.427759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7cab3-7d67-4815-99f7-f25f3f87e104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.428390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7cab3-7d67-4815-99f7-f25f3f87e104 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.428720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7cab3-7d67-4815-99f7-f25f3f87e104 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.428921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7cab3-7d67-4815-99f7-f25f3f87e104 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.429659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7cab3-7d67-4815-99f7-f25f3f87e104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.431712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7cab3-7d67-4815-99f7-f25f3f87e104 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.477988 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4127/8292] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:53:38.478978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18097f11-7036-4a91-a802-ccbcf9ee14cb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.494048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18097f11-7036-4a91-a802-ccbcf9ee14cb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.519645 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4166/8293] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:38 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:38.521012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db64d1-58e4-41b1-a1c4-29e2bbb11237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.522782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db64d1-58e4-41b1-a1c4-29e2bbb11237 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.523802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7cab3-7d67-4815-99f7-f25f3f87e104 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.524164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db64d1-58e4-41b1-a1c4-29e2bbb11237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.524747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db64d1-58e4-41b1-a1c4-29e2bbb11237 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.526705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db64d1-58e4-41b1-a1c4-29e2bbb11237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.533657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db64d1-58e4-41b1-a1c4-29e2bbb11237 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.577061 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4128/8294] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:38 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:38.581037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db64d1-58e4-41b1-a1c4-29e2bbb11237 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.691078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7cab3-7d67-4815-99f7-f25f3f87e104 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.715720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db64d1-58e4-41b1-a1c4-29e2bbb11237 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.725332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e8361-e655-4cc9-89cc-a0879e0d33a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.726987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e8361-e655-4cc9-89cc-a0879e0d33a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.727285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e8361-e655-4cc9-89cc-a0879e0d33a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.727872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e8361-e655-4cc9-89cc-a0879e0d33a1 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.728729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e8361-e655-4cc9-89cc-a0879e0d33a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.731115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e8361-e655-4cc9-89cc-a0879e0d33a1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.766178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f977139-a776-4503-886b-aedf1b5f7ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.768269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977139-a776-4503-886b-aedf1b5f7ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.768817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977139-a776-4503-886b-aedf1b5f7ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.769352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977139-a776-4503-886b-aedf1b5f7ff7 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.770706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f977139-a776-4503-886b-aedf1b5f7ff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.773428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f977139-a776-4503-886b-aedf1b5f7ff7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.785414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:38.797155 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4129/8295] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:38 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:38.802020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e8361-e655-4cc9-89cc-a0879e0d33a1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.816919 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4167/8296] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:38 2022] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:38.821462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f977139-a776-4503-886b-aedf1b5f7ff7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.828721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e8361-e655-4cc9-89cc-a0879e0d33a1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.844752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2ed08-55fa-47d6-ab20-7b90afa7caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.845625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f977139-a776-4503-886b-aedf1b5f7ff7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.846468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2ed08-55fa-47d6-ab20-7b90afa7caff admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.847619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2ed08-55fa-47d6-ab20-7b90afa7caff admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.848395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2ed08-55fa-47d6-ab20-7b90afa7caff admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.849289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2ed08-55fa-47d6-ab20-7b90afa7caff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.854670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6350-352f-4ef6-aff3-5dde263fd0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.856175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2ed08-55fa-47d6-ab20-7b90afa7caff admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.860983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6350-352f-4ef6-aff3-5dde263fd0df admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.860983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6350-352f-4ef6-aff3-5dde263fd0df admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.861362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e6350-352f-4ef6-aff3-5dde263fd0df admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.862190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6350-352f-4ef6-aff3-5dde263fd0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.864082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e6350-352f-4ef6-aff3-5dde263fd0df admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.885618 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4168/8297] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:38.890005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6350-352f-4ef6-aff3-5dde263fd0df admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.917678 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4130/8298] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:38.921271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2ed08-55fa-47d6-ab20-7b90afa7caff admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.941376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2ed08-55fa-47d6-ab20-7b90afa7caff admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.950182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fd410-2e7e-4811-9778-d5c6d6b7359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.951545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fd410-2e7e-4811-9778-d5c6d6b7359c admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.951780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e6350-352f-4ef6-aff3-5dde263fd0df admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:38.952134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fd410-2e7e-4811-9778-d5c6d6b7359c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.952614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338fd410-2e7e-4811-9778-d5c6d6b7359c admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.953581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fd410-2e7e-4811-9778-d5c6d6b7359c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.956107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338fd410-2e7e-4811-9778-d5c6d6b7359c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.959172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a1284-eb11-48ab-9fca-c6e7433cd391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:38.959980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a1284-eb11-48ab-9fca-c6e7433cd391 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:38.960353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a1284-eb11-48ab-9fca-c6e7433cd391 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:38.960957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a1284-eb11-48ab-9fca-c6e7433cd391 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:38.962396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a1284-eb11-48ab-9fca-c6e7433cd391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:38.965040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a1284-eb11-48ab-9fca-c6e7433cd391 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:38.974860 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4131/8299] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:53:38.976708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fd410-2e7e-4811-9778-d5c6d6b7359c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:38.986022 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4169/8300] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:53:38.992408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a1284-eb11-48ab-9fca-c6e7433cd391 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:39.007950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338fd410-2e7e-4811-9778-d5c6d6b7359c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:39.014771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca008fd-1ebd-404b-9fd4-f49d3198f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:39.015594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca008fd-1ebd-404b-9fd4-f49d3198f439 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:39.015956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca008fd-1ebd-404b-9fd4-f49d3198f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:39.016261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca008fd-1ebd-404b-9fd4-f49d3198f439 admin admin] PATH_INFO: `/v3/projects/5c558ab2e64e487aa8ae287e0f856a1e/users/760cdbad42e24d8e9eafb414dc6d04d5/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:39.033057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a1284-eb11-48ab-9fca-c6e7433cd391 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:39.044735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca7bc6-5daf-479e-ba93-435195a105f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:39.046103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7bc6-5daf-479e-ba93-435195a105f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:39.046781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7bc6-5daf-479e-ba93-435195a105f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:39.048454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca008fd-1ebd-404b-9fd4-f49d3198f439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c558ab2e64e487aa8ae287e0f856a1e, user_id=760cdbad42e24d8e9eafb414dc6d04d5, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:39.049924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca7bc6-5daf-479e-ba93-435195a105f1 admin admin] PATH_INFO: `/v3/projects/9c1716158a614e5f9d96b95271ca8acf/users/a9ef01029e264fbca52310cfe3edfb6b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:39.055392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca008fd-1ebd-404b-9fd4-f49d3198f439 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:39.101445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca7bc6-5daf-479e-ba93-435195a105f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1716158a614e5f9d96b95271ca8acf, user_id=a9ef01029e264fbca52310cfe3edfb6b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:39.101687 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4132/8301] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:38 2022] PUT /identity/v3/projects/5c558ab2e64e487aa8ae287e0f856a1e/users/760cdbad42e24d8e9eafb414dc6d04d5/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:53:39.101791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca7bc6-5daf-479e-ba93-435195a105f1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:39.104998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb661a-e608-45c1-995c-abb873d6609f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:39.105365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb661a-e608-45c1-995c-abb873d6609f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:39.105637 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb661a-e608-45c1-995c-abb873d6609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:39.115476 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4170/8302] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:38 2022] PUT /identity/v3/projects/9c1716158a614e5f9d96b95271ca8acf/users/a9ef01029e264fbca52310cfe3edfb6b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:39.122902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6ebd-0f7d-4eee-a2a8-09812b39f8d2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:39.123583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6ebd-0f7d-4eee-a2a8-09812b39f8d2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:39.124678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da6ebd-0f7d-4eee-a2a8-09812b39f8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:39.147179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-73da6ebd-0f7d-4eee-a2a8-09812b39f8d2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:39.148565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-73da6ebd-0f7d-4eee-a2a8-09812b39f8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:39.170304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d2cb661a-e608-45c1-995c-abb873d6609f None None] MFA Rules not processed for user `760cdbad42e24d8e9eafb414dc6d04d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:39.171541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d2cb661a-e608-45c1-995c-abb873d6609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:39.232828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:39.258712 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4171/8303] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:39.270054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6ebd-0f7d-4eee-a2a8-09812b39f8d2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:39.274081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-73da6ebd-0f7d-4eee-a2a8-09812b39f8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:39.328087 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4133/8304] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:53:39.331384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb661a-e608-45c1-995c-abb873d6609f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:39.374152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb661a-e608-45c1-995c-abb873d6609f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:39.394643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad3a40-6667-4517-ab15-e79bf95889c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:39.395073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da6ebd-0f7d-4eee-a2a8-09812b39f8d2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:39.395525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad3a40-6667-4517-ab15-e79bf95889c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:39.395525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad3a40-6667-4517-ab15-e79bf95889c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:39.396455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad3a40-6667-4517-ab15-e79bf95889c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:39.398005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad3a40-6667-4517-ab15-e79bf95889c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:39.399361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c2475-a72a-4045-906d-701342b942e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:39.400461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c2475-a72a-4045-906d-701342b942e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:39.400794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c2475-a72a-4045-906d-701342b942e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:39.401126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c2475-a72a-4045-906d-701342b942e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:39.403925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad3a40-6667-4517-ab15-e79bf95889c2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:39.416787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c2475-a72a-4045-906d-701342b942e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:39.418718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c2475-a72a-4045-906d-701342b942e2 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:39.450174 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4172/8305] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:53:39.486658 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4134/8306] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:39 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:39.490793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c2475-a72a-4045-906d-701342b942e2 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:39.504701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c2475-a72a-4045-906d-701342b942e2 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:39.595552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:39.639133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12b34-e1b3-4c23-9b2f-cfc38b6a3ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:39.639133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12b34-e1b3-4c23-9b2f-cfc38b6a3ede admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:39.639133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12b34-e1b3-4c23-9b2f-cfc38b6a3ede admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:39.639133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b12b34-e1b3-4c23-9b2f-cfc38b6a3ede admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:39.643183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b12b34-e1b3-4c23-9b2f-cfc38b6a3ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:39.650543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b12b34-e1b3-4c23-9b2f-cfc38b6a3ede admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:39.711449 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4173/8307] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:39 2022] POST /identity/v3/users => generated 300 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:39.713598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad3a40-6667-4517-ab15-e79bf95889c2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:39.731004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad3a40-6667-4517-ab15-e79bf95889c2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:39.747341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53273708-1edb-4d62-bf3b-c39529b5a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:39.747975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273708-1edb-4d62-bf3b-c39529b5a69e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:39.748254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273708-1edb-4d62-bf3b-c39529b5a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:39.748523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273708-1edb-4d62-bf3b-c39529b5a69e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:39.749244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53273708-1edb-4d62-bf3b-c39529b5a69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:39.753740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53273708-1edb-4d62-bf3b-c39529b5a69e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:39.779798 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4135/8308] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:39.783975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12b34-e1b3-4c23-9b2f-cfc38b6a3ede admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:39.816560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b12b34-e1b3-4c23-9b2f-cfc38b6a3ede admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:39.822974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb58b7-ecea-437c-8a4c-126bc4902b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:39.824170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb58b7-ecea-437c-8a4c-126bc4902b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:39.824829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb58b7-ecea-437c-8a4c-126bc4902b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:39.825337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb58b7-ecea-437c-8a4c-126bc4902b40 admin admin] PATH_INFO: `/v3/projects/ae53bd051f49442ebde1c5482f3d8757/users/91643a844d18419eb0cbf6e00665538b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:39.846604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb58b7-ecea-437c-8a4c-126bc4902b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae53bd051f49442ebde1c5482f3d8757, user_id=91643a844d18419eb0cbf6e00665538b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:39.849780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb58b7-ecea-437c-8a4c-126bc4902b40 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:39.873343 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4174/8309] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:39 2022] PUT /identity/v3/projects/ae53bd051f49442ebde1c5482f3d8757/users/91643a844d18419eb0cbf6e00665538b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:39.877549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53273708-1edb-4d62-bf3b-c39529b5a69e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:39.891800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53273708-1edb-4d62-bf3b-c39529b5a69e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:39.990193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c4b3c-e036-4d36-aa2d-2ab9d34d89c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:39.991367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4b3c-e036-4d36-aa2d-2ab9d34d89c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:39.991797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4b3c-e036-4d36-aa2d-2ab9d34d89c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:39.992433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c4b3c-e036-4d36-aa2d-2ab9d34d89c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:39.993385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c4b3c-e036-4d36-aa2d-2ab9d34d89c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:39.995388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c4b3c-e036-4d36-aa2d-2ab9d34d89c6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:40.016862 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4136/8310] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:53:40.018485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb58b7-ecea-437c-8a4c-126bc4902b40 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:40.032438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb58b7-ecea-437c-8a4c-126bc4902b40 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:40.038241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671b38c-8a42-4f8f-b085-35db2ba8bf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:40.039214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671b38c-8a42-4f8f-b085-35db2ba8bf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:40.039338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671b38c-8a42-4f8f-b085-35db2ba8bf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:40.039618 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671b38c-8a42-4f8f-b085-35db2ba8bf20 admin admin] PATH_INFO: `/v3/projects/ae53bd051f49442ebde1c5482f3d8757/users/91643a844d18419eb0cbf6e00665538b/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:40.041643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671b38c-8a42-4f8f-b085-35db2ba8bf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae53bd051f49442ebde1c5482f3d8757, user_id=91643a844d18419eb0cbf6e00665538b, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:40.045050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671b38c-8a42-4f8f-b085-35db2ba8bf20 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:40.072888 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4175/8311] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:40 2022] PUT /identity/v3/projects/ae53bd051f49442ebde1c5482f3d8757/users/91643a844d18419eb0cbf6e00665538b/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:40.075064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc480-d73f-4c18-9a72-2bcdefda931e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:40.075522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc480-d73f-4c18-9a72-2bcdefda931e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:40.075942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc480-d73f-4c18-9a72-2bcdefda931e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:40.108650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f61bc480-d73f-4c18-9a72-2bcdefda931e None None] MFA Rules not processed for user `91643a844d18419eb0cbf6e00665538b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:40.110911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f61bc480-d73f-4c18-9a72-2bcdefda931e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:40.248007 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4137/8312] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:40.261131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671b38c-8a42-4f8f-b085-35db2ba8bf20 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:40.263153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9671b38c-8a42-4f8f-b085-35db2ba8bf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:40.456633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671b38c-8a42-4f8f-b085-35db2ba8bf20 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:40.465106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeee08-aa1e-4938-928a-72fabb8e7a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:40.465748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeee08-aa1e-4938-928a-72fabb8e7a2a service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:40.466107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeee08-aa1e-4938-928a-72fabb8e7a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:40.466344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeee08-aa1e-4938-928a-72fabb8e7a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:40.492557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeee08-aa1e-4938-928a-72fabb8e7a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:40.494120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeee08-aa1e-4938-928a-72fabb8e7a2a service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:40.520706 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4176/8313] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:41.539039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc480-d73f-4c18-9a72-2bcdefda931e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:41.561590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc480-d73f-4c18-9a72-2bcdefda931e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:41.571106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af677aa-563b-4679-aac7-1cea6f39ffbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:41.572156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af677aa-563b-4679-aac7-1cea6f39ffbc service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:41.572718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af677aa-563b-4679-aac7-1cea6f39ffbc service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:41.573225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af677aa-563b-4679-aac7-1cea6f39ffbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:41.603831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:41.736592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af677aa-563b-4679-aac7-1cea6f39ffbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:41.738243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af677aa-563b-4679-aac7-1cea6f39ffbc service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:41.760657 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4138/8314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:53:48.396972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeee08-aa1e-4938-928a-72fabb8e7a2a service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:48.398763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-55aeee08-aa1e-4938-928a-72fabb8e7a2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:48.554837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeee08-aa1e-4938-928a-72fabb8e7a2a service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:48.559826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:48.560801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:48.561196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:48.561466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] PATH_INFO: `/v3/users/d732e28d279f4b7985ef404d94703a90` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:48.562799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d732e28d279f4b7985ef404d94703a90)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:48.565116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:48.633780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:48.689136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd732e28d279f4b7985ef404d94703a90'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:48.690342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd732e28d279f4b7985ef404d94703a90'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:48.698835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd732e28d279f4b7985ef404d94703a90'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:48.709923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd732e28d279f4b7985ef404d94703a90'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:48.724519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd732e28d279f4b7985ef404d94703a90'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:48.733936 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4177/8315] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:53:48 2022] DELETE /identity/v3/users/d732e28d279f4b7985ef404d94703a90 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:49.108427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af677aa-563b-4679-aac7-1cea6f39ffbc service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:49.134151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af677aa-563b-4679-aac7-1cea6f39ffbc service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:49.224449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:49.225345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:49.225777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:49.226254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] PATH_INFO: `/v3/projects/f6a39276b63f4b90876da4b6f2aee072` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:49.228096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a39276b63f4b90876da4b6f2aee072)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:49.230364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:49.361007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a39276b63f4b90876da4b6f2aee072', 'request_id': 'req-aeb2d39e-aef6-4ca4-89ad-790b655dc383'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:49.383782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a39276b63f4b90876da4b6f2aee072', 'request_id': 'req-aeb2d39e-aef6-4ca4-89ad-790b655dc383'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:49.393807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a39276b63f4b90876da4b6f2aee072', 'request_id': 'req-aeb2d39e-aef6-4ca4-89ad-790b655dc383'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:49.407193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] The token cache is being invalidate because project f6a39276b63f4b90876da4b6f2aee072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:53:49.407483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:49.408270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-aeb2d39e-aef6-4ca4-89ad-790b655dc383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:49.410533 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4139/8316] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:53:49 2022] DELETE /identity/v3/projects/f6a39276b63f4b90876da4b6f2aee072 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:49.414494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:49.419013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:49.462886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679b56f-073e-4804-87ca-67d9b10fa6bf admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:49.574833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc342c6-8781-48fe-a1c2-27a7dd41ebb8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:49.575121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc342c6-8781-48fe-a1c2-27a7dd41ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:49.575379 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc342c6-8781-48fe-a1c2-27a7dd41ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:49.653790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:49.654857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bdc342c6-8781-48fe-a1c2-27a7dd41ebb8 None None] MFA Rules not processed for user `a9ef01029e264fbca52310cfe3edfb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:49.655067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:49.655535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:49.655995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] PATH_INFO: `/v3/users/200380fabca84394b9872615049a6062` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:49.656357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bdc342c6-8781-48fe-a1c2-27a7dd41ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:49.660904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] RBAC: Authorizing `identity:delete_user(user_id=200380fabca84394b9872615049a6062)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:49.662994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:49.731940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:49.791900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '200380fabca84394b9872615049a6062'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:49.793036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '200380fabca84394b9872615049a6062'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:49.813586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '200380fabca84394b9872615049a6062'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:49.830590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '200380fabca84394b9872615049a6062'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:49.836476 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4140/8317] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:53:49.842936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc342c6-8781-48fe-a1c2-27a7dd41ebb8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:49.848115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bdc342c6-8781-48fe-a1c2-27a7dd41ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:49.850369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '200380fabca84394b9872615049a6062'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:49.865349 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4178/8318] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:53:49 2022] DELETE /identity/v3/users/200380fabca84394b9872615049a6062 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:49.936366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc342c6-8781-48fe-a1c2-27a7dd41ebb8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:50.142815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297e1b-5995-419a-9b97-fcffb24df6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:50.143487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297e1b-5995-419a-9b97-fcffb24df6dd admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:50.143717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297e1b-5995-419a-9b97-fcffb24df6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:50.143987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c297e1b-5995-419a-9b97-fcffb24df6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:50.144630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c297e1b-5995-419a-9b97-fcffb24df6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:50.146663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c297e1b-5995-419a-9b97-fcffb24df6dd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:50.217032 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4141/8319] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:49 2022] POST /identity/v3/projects => generated 379 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:50.217994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:50.220842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:50.263774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88a089-626f-4089-8eed-d6530db4234d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:50.298876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297e1b-5995-419a-9b97-fcffb24df6dd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:50.300889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0c297e1b-5995-419a-9b97-fcffb24df6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:50.323096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:50.435062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224a584-6e9c-4391-a8e5-a1c6081756b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:50.437295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224a584-6e9c-4391-a8e5-a1c6081756b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:50.437748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224a584-6e9c-4391-a8e5-a1c6081756b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:50.438677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5224a584-6e9c-4391-a8e5-a1c6081756b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:50.439863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224a584-6e9c-4391-a8e5-a1c6081756b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:50.443247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5224a584-6e9c-4391-a8e5-a1c6081756b2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:50.472040 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c297e1b-5995-419a-9b97-fcffb24df6dd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:50.489034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:50.492275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:50.493266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:50.496410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] PATH_INFO: `/v3/projects/f9b192987dbd4a33bf542c1b68d0e865` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:50.501526 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4179/8320] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:50 2022] POST /identity/v3/users => generated 296 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:53:50.505984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9b192987dbd4a33bf542c1b68d0e865)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:50.509020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224a584-6e9c-4391-a8e5-a1c6081756b2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:50.509730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:50.534988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5224a584-6e9c-4391-a8e5-a1c6081756b2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:50.540421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324ac9f-d623-4f9c-90bc-31bbca2ab168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:50.541253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324ac9f-d623-4f9c-90bc-31bbca2ab168 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:50.541672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324ac9f-d623-4f9c-90bc-31bbca2ab168 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:50.542155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324ac9f-d623-4f9c-90bc-31bbca2ab168 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:50.546836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324ac9f-d623-4f9c-90bc-31bbca2ab168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:50.549569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324ac9f-d623-4f9c-90bc-31bbca2ab168 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:50.573916 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4180/8321] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:50.578049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324ac9f-d623-4f9c-90bc-31bbca2ab168 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:50.600712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324ac9f-d623-4f9c-90bc-31bbca2ab168 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:50.611207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9b192987dbd4a33bf542c1b68d0e865', 'request_id': 'req-fe7d99a5-8307-4f17-8bcc-c848ae345c25'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:50.626242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9b192987dbd4a33bf542c1b68d0e865', 'request_id': 'req-fe7d99a5-8307-4f17-8bcc-c848ae345c25'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:50.643704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9b192987dbd4a33bf542c1b68d0e865', 'request_id': 'req-fe7d99a5-8307-4f17-8bcc-c848ae345c25'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:50.645005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:50.673406 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] The token cache is being invalidate because project f9b192987dbd4a33bf542c1b68d0e865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:53:50.673777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:50.674970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe7d99a5-8307-4f17-8bcc-c848ae345c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:53:50.678552 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4142/8322] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:53:50 2022] DELETE /identity/v3/projects/f9b192987dbd4a33bf542c1b68d0e865 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:53:50.688875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38599737-1f53-4dad-889d-074264473a7e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:50.689176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38599737-1f53-4dad-889d-074264473a7e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:50.689426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38599737-1f53-4dad-889d-074264473a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:50.768816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a90e48-1b49-4d5f-a825-01652722d19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:50.769500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90e48-1b49-4d5f-a825-01652722d19c admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:50.769772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90e48-1b49-4d5f-a825-01652722d19c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:50.770084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90e48-1b49-4d5f-a825-01652722d19c admin admin] PATH_INFO: `/v3/projects/bc63a5f413b64d24ae1f9849814f4066/users/a6930d1989684117a7319f43c8f68739/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:50.780112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-38599737-1f53-4dad-889d-074264473a7e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:50.782824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-38599737-1f53-4dad-889d-074264473a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:50.800710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a90e48-1b49-4d5f-a825-01652722d19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc63a5f413b64d24ae1f9849814f4066, user_id=a6930d1989684117a7319f43c8f68739, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:50.804642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a90e48-1b49-4d5f-a825-01652722d19c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:50.810347 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4143/8323] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:50.819200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422ba83-e074-489c-aa8b-71f66a030f98 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:50.819589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422ba83-e074-489c-aa8b-71f66a030f98 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:50.823955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422ba83-e074-489c-aa8b-71f66a030f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:50.834821 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4181/8324] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:50 2022] PUT /identity/v3/projects/bc63a5f413b64d24ae1f9849814f4066/users/a6930d1989684117a7319f43c8f68739/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:53:50.849297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a90e48-1b49-4d5f-a825-01652722d19c admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:50.853465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51a90e48-1b49-4d5f-a825-01652722d19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:50.859666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a422ba83-e074-489c-aa8b-71f66a030f98 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:50.861381 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a422ba83-e074-489c-aa8b-71f66a030f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:51.021564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a90e48-1b49-4d5f-a825-01652722d19c admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:51.034128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47739f-1f8e-4080-9274-988de3fb0fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:51.035001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47739f-1f8e-4080-9274-988de3fb0fcb admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:51.035427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47739f-1f8e-4080-9274-988de3fb0fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:51.035899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47739f-1f8e-4080-9274-988de3fb0fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:51.040449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47739f-1f8e-4080-9274-988de3fb0fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:51.042664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce47739f-1f8e-4080-9274-988de3fb0fcb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:51.044847 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4144/8325] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:51.052834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422ba83-e074-489c-aa8b-71f66a030f98 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:51.064127 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4182/8326] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:51.068943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47739f-1f8e-4080-9274-988de3fb0fcb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:51.081604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422ba83-e074-489c-aa8b-71f66a030f98 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:51.088273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47739f-1f8e-4080-9274-988de3fb0fcb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:51.100140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26424-9622-4aca-8403-a313790afc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:51.100461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560cbb7-4363-48aa-bf28-c00d64ff6151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:51.101352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560cbb7-4363-48aa-bf28-c00d64ff6151 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:51.101777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560cbb7-4363-48aa-bf28-c00d64ff6151 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:51.102530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560cbb7-4363-48aa-bf28-c00d64ff6151 admin admin] PATH_INFO: `/v3/projects/bc63a5f413b64d24ae1f9849814f4066/users/a6930d1989684117a7319f43c8f68739/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:51.103762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26424-9622-4aca-8403-a313790afc33 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:51.104668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26424-9622-4aca-8403-a313790afc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:51.105497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26424-9622-4aca-8403-a313790afc33 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:51.105707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560cbb7-4363-48aa-bf28-c00d64ff6151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc63a5f413b64d24ae1f9849814f4066, user_id=a6930d1989684117a7319f43c8f68739, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:51.108622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560cbb7-4363-48aa-bf28-c00d64ff6151 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:51.108755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab26424-9622-4aca-8403-a313790afc33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:53:51.111115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab26424-9622-4aca-8403-a313790afc33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:51.116726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab26424-9622-4aca-8403-a313790afc33 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:51.142892 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4183/8327] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:51 2022] PUT /identity/v3/projects/bc63a5f413b64d24ae1f9849814f4066/users/a6930d1989684117a7319f43c8f68739/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:53:51.160611 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4145/8328] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:53:51.166202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560cbb7-4363-48aa-bf28-c00d64ff6151 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:51.194309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:51.321573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560cbb7-4363-48aa-bf28-c00d64ff6151 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:51.334665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999f00b-c5a2-4fa9-9155-aa8860e41f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:51.335302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999f00b-c5a2-4fa9-9155-aa8860e41f30 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:51.335725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999f00b-c5a2-4fa9-9155-aa8860e41f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:51.336117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999f00b-c5a2-4fa9-9155-aa8860e41f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:51.336768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999f00b-c5a2-4fa9-9155-aa8860e41f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:51.338763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999f00b-c5a2-4fa9-9155-aa8860e41f30 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:51.414125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4184/8329] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:51 2022] POST /identity/v3/projects => generated 381 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:51.418414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26424-9622-4aca-8403-a313790afc33 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:51.432486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26424-9622-4aca-8403-a313790afc33 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:51.601121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c0903-3d5b-4157-afad-ae7b3035e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:51.601767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c0903-3d5b-4157-afad-ae7b3035e47e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:51.602068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c0903-3d5b-4157-afad-ae7b3035e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:51.602677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c0903-3d5b-4157-afad-ae7b3035e47e admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:51.603311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c0903-3d5b-4157-afad-ae7b3035e47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:51.605352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c0903-3d5b-4157-afad-ae7b3035e47e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:51.657859 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4146/8330] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:51 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:53:51.661927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999f00b-c5a2-4fa9-9155-aa8860e41f30 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:51.685058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999f00b-c5a2-4fa9-9155-aa8860e41f30 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:51.690622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4743448-7d66-463a-95c7-7da5cc313ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:51.691260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4743448-7d66-463a-95c7-7da5cc313ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:51.691537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4743448-7d66-463a-95c7-7da5cc313ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:51.691809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4743448-7d66-463a-95c7-7da5cc313ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:51.692540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4743448-7d66-463a-95c7-7da5cc313ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:51.694169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4743448-7d66-463a-95c7-7da5cc313ee4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:51.722353 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4185/8331] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:53:51.726633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c0903-3d5b-4157-afad-ae7b3035e47e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:51.740462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c0903-3d5b-4157-afad-ae7b3035e47e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:51.764840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450cc15-5d90-4677-9096-1c04207c926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:51.767359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450cc15-5d90-4677-9096-1c04207c926f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:51.770320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450cc15-5d90-4677-9096-1c04207c926f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:51.771576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450cc15-5d90-4677-9096-1c04207c926f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:51.776051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450cc15-5d90-4677-9096-1c04207c926f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:51.789582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450cc15-5d90-4677-9096-1c04207c926f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:51.836917 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4147/8332] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:51.841267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4743448-7d66-463a-95c7-7da5cc313ee4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:51.867570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4743448-7d66-463a-95c7-7da5cc313ee4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:51.898241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62afd03-f088-41b7-b231-d269abc84f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:51.898976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62afd03-f088-41b7-b231-d269abc84f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:51.899259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62afd03-f088-41b7-b231-d269abc84f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:51.900762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62afd03-f088-41b7-b231-d269abc84f55 admin admin] PATH_INFO: `/v3/projects/1c61369ef2154c59b69412f259273919/users/5b5f08760bb949f0a8acbc3a0e44a6af/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:51.956410 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62afd03-f088-41b7-b231-d269abc84f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c61369ef2154c59b69412f259273919, user_id=5b5f08760bb949f0a8acbc3a0e44a6af, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:51.960095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62afd03-f088-41b7-b231-d269abc84f55 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:52.008681 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4186/8333] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:51 2022] PUT /identity/v3/projects/1c61369ef2154c59b69412f259273919/users/5b5f08760bb949f0a8acbc3a0e44a6af/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:52.019095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574bf2a-ac66-4cd9-b6ab-72febe013bfe None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:52.019501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574bf2a-ac66-4cd9-b6ab-72febe013bfe None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:52.019679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574bf2a-ac66-4cd9-b6ab-72febe013bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:52.122939 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e574bf2a-ac66-4cd9-b6ab-72febe013bfe None None] MFA Rules not processed for user `5b5f08760bb949f0a8acbc3a0e44a6af`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:52.124233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e574bf2a-ac66-4cd9-b6ab-72febe013bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:52.276899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:52.372078 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4148/8334] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:52.373118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62afd03-f088-41b7-b231-d269abc84f55 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:52.501458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62afd03-f088-41b7-b231-d269abc84f55 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:52.506359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb8589-7967-4c9d-8050-93426a5b8f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:52.507018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb8589-7967-4c9d-8050-93426a5b8f9d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:52.507356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb8589-7967-4c9d-8050-93426a5b8f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:52.507759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb8589-7967-4c9d-8050-93426a5b8f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:52.508418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb8589-7967-4c9d-8050-93426a5b8f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:52.510757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb8589-7967-4c9d-8050-93426a5b8f9d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:52.561556 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4187/8335] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:52 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:52.566243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574bf2a-ac66-4cd9-b6ab-72febe013bfe None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:52.589099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574bf2a-ac66-4cd9-b6ab-72febe013bfe None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:52.750514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e8d11-f356-4e61-abc1-94f5e2f026ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:52.751240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8d11-f356-4e61-abc1-94f5e2f026ed admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:52.751633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8d11-f356-4e61-abc1-94f5e2f026ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:52.751911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e8d11-f356-4e61-abc1-94f5e2f026ed admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:52.752643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e8d11-f356-4e61-abc1-94f5e2f026ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:52.758404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e8d11-f356-4e61-abc1-94f5e2f026ed admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:52.800125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb8589-7967-4c9d-8050-93426a5b8f9d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:52.802256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0ebb8589-7967-4c9d-8050-93426a5b8f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:52.821136 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4149/8336] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:52 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:52.825485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e8d11-f356-4e61-abc1-94f5e2f026ed admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:52.851242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e8d11-f356-4e61-abc1-94f5e2f026ed admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:52.869784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9dffa-8c7e-495a-8441-a460222a6448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:52.870926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9dffa-8c7e-495a-8441-a460222a6448 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:52.871424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9dffa-8c7e-495a-8441-a460222a6448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:52.871843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9dffa-8c7e-495a-8441-a460222a6448 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:52.872499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9dffa-8c7e-495a-8441-a460222a6448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:52.876054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9dffa-8c7e-495a-8441-a460222a6448 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:52.893363 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4150/8337] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:52.897232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9dffa-8c7e-495a-8441-a460222a6448 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:52.934739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9dffa-8c7e-495a-8441-a460222a6448 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:52.948683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6536e-5a5e-4edc-9408-c96fe53b2cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:52.949664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6536e-5a5e-4edc-9408-c96fe53b2cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:52.949978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6536e-5a5e-4edc-9408-c96fe53b2cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:52.950253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6536e-5a5e-4edc-9408-c96fe53b2cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:52.951073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6536e-5a5e-4edc-9408-c96fe53b2cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:52.953920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6536e-5a5e-4edc-9408-c96fe53b2cd4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:52.973939 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4151/8338] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:52.976261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:52.977848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6536e-5a5e-4edc-9408-c96fe53b2cd4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:52.986052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb8589-7967-4c9d-8050-93426a5b8f9d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:52.993779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6536e-5a5e-4edc-9408-c96fe53b2cd4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:52.994882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6431a-d19b-4f26-88c5-ae8dc5fc2f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:52.995896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6431a-d19b-4f26-88c5-ae8dc5fc2f20 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:52.997097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6431a-d19b-4f26-88c5-ae8dc5fc2f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:52.997097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6431a-d19b-4f26-88c5-ae8dc5fc2f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:52.999862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-37e6431a-d19b-4f26-88c5-ae8dc5fc2f20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:53.000255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b72d5-b1ac-4fd8-904a-21e278556c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:53.000954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b72d5-b1ac-4fd8-904a-21e278556c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:53.003110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b72d5-b1ac-4fd8-904a-21e278556c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:53.003518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b72d5-b1ac-4fd8-904a-21e278556c3c admin admin] PATH_INFO: `/v3/projects/a39b2d87ffe5429995b623e8a9c39b2b/users/d3ca68dd72bc4d4e97446d7b60b06ce4/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:53.033856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b72d5-b1ac-4fd8-904a-21e278556c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39b2d87ffe5429995b623e8a9c39b2b, user_id=d3ca68dd72bc4d4e97446d7b60b06ce4, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:53.037860 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b72d5-b1ac-4fd8-904a-21e278556c3c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:53.099577 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4152/8339] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:52 2022] PUT /identity/v3/projects/a39b2d87ffe5429995b623e8a9c39b2b/users/d3ca68dd72bc4d4e97446d7b60b06ce4/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:53.106734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53c39e-5914-4939-9c77-27499e9f6795 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:53.106734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53c39e-5914-4939-9c77-27499e9f6795 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:53.106734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53c39e-5914-4939-9c77-27499e9f6795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:53.168042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6431a-d19b-4f26-88c5-ae8dc5fc2f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:53.169558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6431a-d19b-4f26-88c5-ae8dc5fc2f20 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:53.176334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bf53c39e-5914-4939-9c77-27499e9f6795 None None] MFA Rules not processed for user `d3ca68dd72bc4d4e97446d7b60b06ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:53.178493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bf53c39e-5914-4939-9c77-27499e9f6795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:53.197253 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4188/8340] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:53:53.353745 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4153/8341] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:53:53.357323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6431a-d19b-4f26-88c5-ae8dc5fc2f20 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:53.373139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6431a-d19b-4f26-88c5-ae8dc5fc2f20 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:53.570989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8cbf6-974f-4b86-b369-64a72ec2d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:53.574603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8cbf6-974f-4b86-b369-64a72ec2d710 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:53.575140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8cbf6-974f-4b86-b369-64a72ec2d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:53.575803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8cbf6-974f-4b86-b369-64a72ec2d710 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:53.576867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8cbf6-974f-4b86-b369-64a72ec2d710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:53.580354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8cbf6-974f-4b86-b369-64a72ec2d710 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:53.657320 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4189/8342] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:53:53 2022] POST /identity/v3/projects => generated 389 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:53:53.662085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53c39e-5914-4939-9c77-27499e9f6795 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:53.689513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53c39e-5914-4939-9c77-27499e9f6795 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:53.715113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:53.833704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e808-cc6e-4016-9847-6de529f75818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:53.834656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e808-cc6e-4016-9847-6de529f75818 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:53.835348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e808-cc6e-4016-9847-6de529f75818 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:53.835715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8e808-cc6e-4016-9847-6de529f75818 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:53.844136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8e808-cc6e-4016-9847-6de529f75818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:53.849355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8e808-cc6e-4016-9847-6de529f75818 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:53.907066 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4154/8343] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:53:53 2022] POST /identity/v3/users => generated 301 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:53:53.912717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8cbf6-974f-4b86-b369-64a72ec2d710 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:53.952646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8cbf6-974f-4b86-b369-64a72ec2d710 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:53.966629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e0ca4-d150-4ca8-9e18-f466da9285a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:53.967866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0ca4-d150-4ca8-9e18-f466da9285a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:53.968357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0ca4-d150-4ca8-9e18-f466da9285a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:53.968826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0ca4-d150-4ca8-9e18-f466da9285a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:53.969681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e0ca4-d150-4ca8-9e18-f466da9285a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:53.972571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e0ca4-d150-4ca8-9e18-f466da9285a5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:54.003771 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4190/8344] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:54.009545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e808-cc6e-4016-9847-6de529f75818 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:54.041389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8e808-cc6e-4016-9847-6de529f75818 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:54.062680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b74d33-8e41-4b99-8fbf-855323cb48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:54.068030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b74d33-8e41-4b99-8fbf-855323cb48e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:54.069251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b74d33-8e41-4b99-8fbf-855323cb48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:54.069590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b74d33-8e41-4b99-8fbf-855323cb48e5 admin admin] PATH_INFO: `/v3/projects/c4893255555648b2bf1102255e21b6c8/users/3e5534a92df84c2b941c90a2223384f7/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:54.099927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b74d33-8e41-4b99-8fbf-855323cb48e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4893255555648b2bf1102255e21b6c8, user_id=3e5534a92df84c2b941c90a2223384f7, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:54.103459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b74d33-8e41-4b99-8fbf-855323cb48e5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:54.126717 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4155/8345] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:54 2022] PUT /identity/v3/projects/c4893255555648b2bf1102255e21b6c8/users/3e5534a92df84c2b941c90a2223384f7/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:53:54.128662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e0ca4-d150-4ca8-9e18-f466da9285a5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:54.144505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e0ca4-d150-4ca8-9e18-f466da9285a5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:54.288510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090d7de-5c75-45ea-ab52-93898aaffc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:54.290064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090d7de-5c75-45ea-ab52-93898aaffc9f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:54.290637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090d7de-5c75-45ea-ab52-93898aaffc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:54.291008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090d7de-5c75-45ea-ab52-93898aaffc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:54.292307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090d7de-5c75-45ea-ab52-93898aaffc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:54.294447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090d7de-5c75-45ea-ab52-93898aaffc9f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:54.310102 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4191/8346] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:53:54.313980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b74d33-8e41-4b99-8fbf-855323cb48e5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:54.332251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b74d33-8e41-4b99-8fbf-855323cb48e5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:54.341686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54f4bd-d49a-4364-b6df-1a41b87aa539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:54.344310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54f4bd-d49a-4364-b6df-1a41b87aa539 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:54.344807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54f4bd-d49a-4364-b6df-1a41b87aa539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:54.345324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54f4bd-d49a-4364-b6df-1a41b87aa539 admin admin] PATH_INFO: `/v3/projects/c4893255555648b2bf1102255e21b6c8/users/3e5534a92df84c2b941c90a2223384f7/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:54.349461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54f4bd-d49a-4364-b6df-1a41b87aa539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4893255555648b2bf1102255e21b6c8, user_id=3e5534a92df84c2b941c90a2223384f7, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:54.354747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54f4bd-d49a-4364-b6df-1a41b87aa539 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:54.383840 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4156/8347] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:53:54 2022] PUT /identity/v3/projects/c4893255555648b2bf1102255e21b6c8/users/3e5534a92df84c2b941c90a2223384f7/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:53:54.396663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c994c-f364-42bc-942a-7427c32d040e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:54.397020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c994c-f364-42bc-942a-7427c32d040e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:54.397511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c994c-f364-42bc-942a-7427c32d040e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:54.464484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:54.486738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-248c994c-f364-42bc-942a-7427c32d040e None None] MFA Rules not processed for user `3e5534a92df84c2b941c90a2223384f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:53:54.490709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-248c994c-f364-42bc-942a-7427c32d040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:54.708970 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4192/8348] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:53:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:53:54.725988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54f4bd-d49a-4364-b6df-1a41b87aa539 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:53:54.728027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4a54f4bd-d49a-4364-b6df-1a41b87aa539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:53:54.930980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54f4bd-d49a-4364-b6df-1a41b87aa539 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:53:54.939228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0563b-9d4d-4cd2-b152-d5dad909370e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:53:54.939896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0563b-9d4d-4cd2-b152-d5dad909370e service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:53:54.940170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0563b-9d4d-4cd2-b152-d5dad909370e service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:53:54.940444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0563b-9d4d-4cd2-b152-d5dad909370e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:53:55.139978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0563b-9d4d-4cd2-b152-d5dad909370e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:53:55.145949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0563b-9d4d-4cd2-b152-d5dad909370e service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:53:55.155470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:55.161591 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4157/8349] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:53:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:00.655965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c994c-f364-42bc-942a-7427c32d040e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:00.657422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-248c994c-f364-42bc-942a-7427c32d040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:00.779707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4d67-9ccb-4868-bc0f-4b8a6b7196de None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:00.780321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4d67-9ccb-4868-bc0f-4b8a6b7196de None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:00.780321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4d67-9ccb-4868-bc0f-4b8a6b7196de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:00.873734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c994c-f364-42bc-942a-7427c32d040e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:00.907121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acaf61-98ac-4537-ad7e-fa1cc895d3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:00.907879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acaf61-98ac-4537-ad7e-fa1cc895d3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:00.909097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acaf61-98ac-4537-ad7e-fa1cc895d3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:00.909385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acaf61-98ac-4537-ad7e-fa1cc895d3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:00.931865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acaf61-98ac-4537-ad7e-fa1cc895d3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:00.937852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71acaf61-98ac-4537-ad7e-fa1cc895d3f4 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:00.944491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b8aa4d67-9ccb-4868-bc0f-4b8a6b7196de None None] MFA Rules not processed for user `a6930d1989684117a7319f43c8f68739`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:00.946129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8aa4d67-9ccb-4868-bc0f-4b8a6b7196de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:00.968260 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4193/8350] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:01.128491 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4158/8351] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:54:01.142416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acaf61-98ac-4537-ad7e-fa1cc895d3f4 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:01.258276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acaf61-98ac-4537-ad7e-fa1cc895d3f4 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:01.263910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6210f2-34b8-4d12-85d6-fc77616ac1c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:01.266385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6210f2-34b8-4d12-85d6-fc77616ac1c2 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:01.266385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6210f2-34b8-4d12-85d6-fc77616ac1c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:01.266385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6210f2-34b8-4d12-85d6-fc77616ac1c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:01.286573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6210f2-34b8-4d12-85d6-fc77616ac1c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:01.294565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6210f2-34b8-4d12-85d6-fc77616ac1c2 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:01.360265 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4194/8352] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:01.597813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4d67-9ccb-4868-bc0f-4b8a6b7196de None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:01.599913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8aa4d67-9ccb-4868-bc0f-4b8a6b7196de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:01.625603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6210f2-34b8-4d12-85d6-fc77616ac1c2 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:01.627115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e6210f2-34b8-4d12-85d6-fc77616ac1c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:01.667939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6210f2-34b8-4d12-85d6-fc77616ac1c2 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:01.676733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ab086-618d-47e8-a881-60ef8005dd45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:01.681634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ab086-618d-47e8-a881-60ef8005dd45 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:01.681893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ab086-618d-47e8-a881-60ef8005dd45 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:01.682160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ab086-618d-47e8-a881-60ef8005dd45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:01.691671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7e1ab086-618d-47e8-a881-60ef8005dd45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:01.792987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4d67-9ccb-4868-bc0f-4b8a6b7196de None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:01.804063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:01.806510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:01.807434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:01.807716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:01.807974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] PATH_INFO: `/v3/users/57b7f47b1574470dae74216b5c625cfa` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:01.809242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b7f47b1574470dae74216b5c625cfa)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:01.812281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:01.877568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ab086-618d-47e8-a881-60ef8005dd45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:01.881125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ab086-618d-47e8-a881-60ef8005dd45 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:01.903164 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4195/8353] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:54:01.997394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b7f47b1574470dae74216b5c625cfa'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:02.023548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b7f47b1574470dae74216b5c625cfa'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:02.063652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b7f47b1574470dae74216b5c625cfa'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:02.083912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b7f47b1574470dae74216b5c625cfa'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:02.085474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b7f47b1574470dae74216b5c625cfa'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:02.104388 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4159/8354] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:54:01 2022] DELETE /identity/v3/users/57b7f47b1574470dae74216b5c625cfa => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:02.109339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f61d4c-6014-4cf8-81fa-333d390d5027 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:02.109624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f61d4c-6014-4cf8-81fa-333d390d5027 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:02.109970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f61d4c-6014-4cf8-81fa-333d390d5027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:02.164883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e4f61d4c-6014-4cf8-81fa-333d390d5027 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:02.166144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e4f61d4c-6014-4cf8-81fa-333d390d5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:02.344912 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4196/8355] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:02.355494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:02.357387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:02.368448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:02.563318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fb25a-e0e7-40f2-a8d5-96501e3aef43 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:02.578699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330795c2-135e-4f06-ba06-444f8d8c40dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:02.579363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330795c2-135e-4f06-ba06-444f8d8c40dc service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:02.585120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330795c2-135e-4f06-ba06-444f8d8c40dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:02.588222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330795c2-135e-4f06-ba06-444f8d8c40dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:02.624877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330795c2-135e-4f06-ba06-444f8d8c40dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:02.632116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330795c2-135e-4f06-ba06-444f8d8c40dc service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:02.679744 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4160/8356] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:04.358910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f61d4c-6014-4cf8-81fa-333d390d5027 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:04.361114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e4f61d4c-6014-4cf8-81fa-333d390d5027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:04.397941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f61d4c-6014-4cf8-81fa-333d390d5027 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:04.433132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:04.436608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:04.437040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:04.437545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] PATH_INFO: `/v3/projects/1878ba1ec72444d4a979102358000272` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:04.443801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1878ba1ec72444d4a979102358000272)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:04.449062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:04.549660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1878ba1ec72444d4a979102358000272', 'request_id': 'req-b7c6b513-5b97-45dd-af29-e97106fd083b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:04.591127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1878ba1ec72444d4a979102358000272', 'request_id': 'req-b7c6b513-5b97-45dd-af29-e97106fd083b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:04.663969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1878ba1ec72444d4a979102358000272', 'request_id': 'req-b7c6b513-5b97-45dd-af29-e97106fd083b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:04.700023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] The token cache is being invalidate because project 1878ba1ec72444d4a979102358000272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:54:04.700358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:04.702177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:04.718896 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4197/8357] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:54:04 2022] DELETE /identity/v3/projects/1878ba1ec72444d4a979102358000272 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:04.723677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330795c2-135e-4f06-ba06-444f8d8c40dc service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:04.741255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330795c2-135e-4f06-ba06-444f8d8c40dc service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:04.955312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:04.957608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:04.957608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:04.957608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] PATH_INFO: `/v3/users/760cdbad42e24d8e9eafb414dc6d04d5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:04.958425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=760cdbad42e24d8e9eafb414dc6d04d5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:04.960933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:05.083139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760cdbad42e24d8e9eafb414dc6d04d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:05.093398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760cdbad42e24d8e9eafb414dc6d04d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:05.111930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760cdbad42e24d8e9eafb414dc6d04d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:05.127992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760cdbad42e24d8e9eafb414dc6d04d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:05.129068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760cdbad42e24d8e9eafb414dc6d04d5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:05.151599 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4161/8358] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:54:04 2022] DELETE /identity/v3/users/760cdbad42e24d8e9eafb414dc6d04d5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:05.799743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:05.806674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:05.835712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6b513-5b97-45dd-af29-e97106fd083b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:05.981035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:05.981792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:05.982108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:05.982379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] PATH_INFO: `/v3/projects/5c558ab2e64e487aa8ae287e0f856a1e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:05.983542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c558ab2e64e487aa8ae287e0f856a1e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:05.986290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:05.998820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:06.127271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c558ab2e64e487aa8ae287e0f856a1e', 'request_id': 'req-e8c7af3d-f311-4db8-b755-5332392bfba2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:06.139573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c558ab2e64e487aa8ae287e0f856a1e', 'request_id': 'req-e8c7af3d-f311-4db8-b755-5332392bfba2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:06.174376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c558ab2e64e487aa8ae287e0f856a1e', 'request_id': 'req-e8c7af3d-f311-4db8-b755-5332392bfba2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:06.213448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] The token cache is being invalidate because project 5c558ab2e64e487aa8ae287e0f856a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:54:06.213747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:06.215536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e8c7af3d-f311-4db8-b755-5332392bfba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:06.219892 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4198/8359] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:54:05 2022] DELETE /identity/v3/projects/5c558ab2e64e487aa8ae287e0f856a1e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:06.221372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:06.223073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:06.253313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac92c8d-b17a-4c98-961b-261cca765fee admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:06.347507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:06.406604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd77f-b692-4a3d-8a2e-88eafb069ce7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:06.407126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd77f-b692-4a3d-8a2e-88eafb069ce7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:06.407598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd77f-b692-4a3d-8a2e-88eafb069ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:06.440817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:06.442189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:06.442735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:06.443344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] PATH_INFO: `/v3/users/91643a844d18419eb0cbf6e00665538b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:06.446727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91643a844d18419eb0cbf6e00665538b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:06.466462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:06.470607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-922dd77f-b692-4a3d-8a2e-88eafb069ce7 None None] MFA Rules not processed for user `a9ef01029e264fbca52310cfe3edfb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:06.472090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-922dd77f-b692-4a3d-8a2e-88eafb069ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:06.642425 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91643a844d18419eb0cbf6e00665538b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:06.691399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91643a844d18419eb0cbf6e00665538b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:06.755068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91643a844d18419eb0cbf6e00665538b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:06.770863 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4199/8360] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:54:06.793133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91643a844d18419eb0cbf6e00665538b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:06.793981 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91643a844d18419eb0cbf6e00665538b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:06.818482 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4162/8361] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:54:06 2022] DELETE /identity/v3/users/91643a844d18419eb0cbf6e00665538b => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:06.880374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dd77f-b692-4a3d-8a2e-88eafb069ce7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:06.882147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-922dd77f-b692-4a3d-8a2e-88eafb069ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:07.013171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dd77f-b692-4a3d-8a2e-88eafb069ce7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:07.146119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a7a4-9a50-4c3a-929f-2c0c379549d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:07.146858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a7a4-9a50-4c3a-929f-2c0c379549d9 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:07.147620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a7a4-9a50-4c3a-929f-2c0c379549d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:07.148082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a7a4-9a50-4c3a-929f-2c0c379549d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:07.158546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6370a7a4-9a50-4c3a-929f-2c0c379549d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:07.177753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:07.316543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370a7a4-9a50-4c3a-929f-2c0c379549d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:07.321328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370a7a4-9a50-4c3a-929f-2c0c379549d9 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:07.362659 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4200/8362] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:07.475804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:07.482643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:07.738175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c978d-3c59-496f-85f6-f9dd8b460822 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:07.750783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:07.763437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:07.763437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:07.763437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] PATH_INFO: `/v3/projects/ae53bd051f49442ebde1c5482f3d8757` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:07.765055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae53bd051f49442ebde1c5482f3d8757)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:07.767526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:07.925764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:07.930948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae53bd051f49442ebde1c5482f3d8757', 'request_id': 'req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:07.948677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae53bd051f49442ebde1c5482f3d8757', 'request_id': 'req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:07.964951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae53bd051f49442ebde1c5482f3d8757', 'request_id': 'req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:08.007247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] The token cache is being invalidate because project ae53bd051f49442ebde1c5482f3d8757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:54:08.008051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:08.008338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fc1a3400-f338-4b65-bea8-2bcd1c1f6eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:08.009946 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4163/8363] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:54:07 2022] DELETE /identity/v3/projects/ae53bd051f49442ebde1c5482f3d8757 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:08.015518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a7a4-9a50-4c3a-929f-2c0c379549d9 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:08.016146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c47e8a-83e4-42ee-a5d5-eb575d578156 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:08.016438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c47e8a-83e4-42ee-a5d5-eb575d578156 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:08.016712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c47e8a-83e4-42ee-a5d5-eb575d578156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:08.016972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6370a7a4-9a50-4c3a-929f-2c0c379549d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:08.061064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-34c47e8a-83e4-42ee-a5d5-eb575d578156 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:08.064643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-34c47e8a-83e4-42ee-a5d5-eb575d578156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:08.180702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a7a4-9a50-4c3a-929f-2c0c379549d9 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:08.184436 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4164/8364] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:08.193729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b822-b8e6-4848-94f0-efa4b23da0f0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:08.194048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b822-b8e6-4848-94f0-efa4b23da0f0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:08.194329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49b822-b8e6-4848-94f0-efa4b23da0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:08.252189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cc49b822-b8e6-4848-94f0-efa4b23da0f0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:08.253441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cc49b822-b8e6-4848-94f0-efa4b23da0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:08.286833 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4165/8365] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:08.291005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49b822-b8e6-4848-94f0-efa4b23da0f0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:08.301158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49b822-b8e6-4848-94f0-efa4b23da0f0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:08.306585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254cb2-0013-4ed2-9bff-c3646f7bcc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:08.308086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254cb2-0013-4ed2-9bff-c3646f7bcc1b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:08.313638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254cb2-0013-4ed2-9bff-c3646f7bcc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:08.313968 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254cb2-0013-4ed2-9bff-c3646f7bcc1b admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:08.314737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8254cb2-0013-4ed2-9bff-c3646f7bcc1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:54:08.315106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8254cb2-0013-4ed2-9bff-c3646f7bcc1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:08.316937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8254cb2-0013-4ed2-9bff-c3646f7bcc1b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:08.328899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588fad9-6362-42e7-9e15-e64d31c2a2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:08.329540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588fad9-6362-42e7-9e15-e64d31c2a2ed service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:08.329821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588fad9-6362-42e7-9e15-e64d31c2a2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:08.330143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588fad9-6362-42e7-9e15-e64d31c2a2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:08.333125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2588fad9-6362-42e7-9e15-e64d31c2a2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:08.343042 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4166/8366] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:54:08.345663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254cb2-0013-4ed2-9bff-c3646f7bcc1b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:08.348281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588fad9-6362-42e7-9e15-e64d31c2a2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:08.349995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588fad9-6362-42e7-9e15-e64d31c2a2ed service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:08.375665 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4201/8367] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:08.378271 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254cb2-0013-4ed2-9bff-c3646f7bcc1b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:08.407321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b931a-db0b-43c3-9cd4-487f807e5f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:08.409956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b931a-db0b-43c3-9cd4-487f807e5f02 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:08.410240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b931a-db0b-43c3-9cd4-487f807e5f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:08.410643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b931a-db0b-43c3-9cd4-487f807e5f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:08.411307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b931a-db0b-43c3-9cd4-487f807e5f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:08.417926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b931a-db0b-43c3-9cd4-487f807e5f02 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:08.476387 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4167/8368] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:54:08 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:08.480402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588fad9-6362-42e7-9e15-e64d31c2a2ed service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:08.502949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588fad9-6362-42e7-9e15-e64d31c2a2ed service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:08.651803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:08.671536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7ce31-4823-4871-87bc-b70e38e1ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:08.672185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7ce31-4823-4871-87bc-b70e38e1ebf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:08.672469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7ce31-4823-4871-87bc-b70e38e1ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:08.672753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7ce31-4823-4871-87bc-b70e38e1ebf7 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:08.673414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7ce31-4823-4871-87bc-b70e38e1ebf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:08.675562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7ce31-4823-4871-87bc-b70e38e1ebf7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:08.735058 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4202/8369] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:54:08 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:08.740485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b931a-db0b-43c3-9cd4-487f807e5f02 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:08.769815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b931a-db0b-43c3-9cd4-487f807e5f02 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:08.781055 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5874a93-b31e-4356-84ee-78e969d951a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:08.783179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874a93-b31e-4356-84ee-78e969d951a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:08.784326 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874a93-b31e-4356-84ee-78e969d951a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:08.784785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5874a93-b31e-4356-84ee-78e969d951a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:08.816292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5874a93-b31e-4356-84ee-78e969d951a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:08.818479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5874a93-b31e-4356-84ee-78e969d951a4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:08.839409 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4168/8370] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:08.844849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7ce31-4823-4871-87bc-b70e38e1ebf7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:08.858685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7ce31-4823-4871-87bc-b70e38e1ebf7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:08.863929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c92bda-286d-4698-8207-5ad93299f390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:08.865030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c92bda-286d-4698-8207-5ad93299f390 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:08.865541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c92bda-286d-4698-8207-5ad93299f390 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:08.866074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c92bda-286d-4698-8207-5ad93299f390 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:08.866854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c92bda-286d-4698-8207-5ad93299f390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:08.868675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c92bda-286d-4698-8207-5ad93299f390 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:08.882774 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4203/8371] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:08.886875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5874a93-b31e-4356-84ee-78e969d951a4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:08.902734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5874a93-b31e-4356-84ee-78e969d951a4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:08.916371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3c685-4d84-4e0a-9e4b-41c4ca931a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:08.918260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3c685-4d84-4e0a-9e4b-41c4ca931a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:08.918555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3c685-4d84-4e0a-9e4b-41c4ca931a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:08.918832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3c685-4d84-4e0a-9e4b-41c4ca931a65 admin admin] PATH_INFO: `/v3/projects/086aecb6e6c543128ee34b1f26fead78/users/28d9ac53643443a6ba421dd2f23073c8/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:08.995369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3c685-4d84-4e0a-9e4b-41c4ca931a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086aecb6e6c543128ee34b1f26fead78, user_id=28d9ac53643443a6ba421dd2f23073c8, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:09.008677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3c685-4d84-4e0a-9e4b-41c4ca931a65 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:09.059678 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4169/8372] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:54:08 2022] PUT /identity/v3/projects/086aecb6e6c543128ee34b1f26fead78/users/28d9ac53643443a6ba421dd2f23073c8/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:09.074011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c163cb-70ff-4298-81c3-71a55a2fb255 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:09.074536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c163cb-70ff-4298-81c3-71a55a2fb255 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:09.074690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c163cb-70ff-4298-81c3-71a55a2fb255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:09.166627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-48c163cb-70ff-4298-81c3-71a55a2fb255 None None] MFA Rules not processed for user `28d9ac53643443a6ba421dd2f23073c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:09.168326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-48c163cb-70ff-4298-81c3-71a55a2fb255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:09.347097 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8814-01f3-420c-96fc-6887826ed92f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:09.347395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8814-01f3-420c-96fc-6887826ed92f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:09.347672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8814-01f3-420c-96fc-6887826ed92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:09.374298 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4204/8373] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:09.379774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c163cb-70ff-4298-81c3-71a55a2fb255 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:09.439686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-697e8814-01f3-420c-96fc-6887826ed92f None None] MFA Rules not processed for user `5b5f08760bb949f0a8acbc3a0e44a6af`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:09.446950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-697e8814-01f3-420c-96fc-6887826ed92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:09.548099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c163cb-70ff-4298-81c3-71a55a2fb255 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:09.563053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57f6d0-a9ed-4c8b-890d-bab5546b2534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:09.564547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57f6d0-a9ed-4c8b-890d-bab5546b2534 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:09.564945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57f6d0-a9ed-4c8b-890d-bab5546b2534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:09.565317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57f6d0-a9ed-4c8b-890d-bab5546b2534 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:09.566145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57f6d0-a9ed-4c8b-890d-bab5546b2534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:09.568983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57f6d0-a9ed-4c8b-890d-bab5546b2534 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:09.670658 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4205/8374] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:54:09 2022] POST /identity/v3/projects => generated 383 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:09.672724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57f6d0-a9ed-4c8b-890d-bab5546b2534 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:09.700679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5d57f6d0-a9ed-4c8b-890d-bab5546b2534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:09.788668 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4170/8375] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:09.789894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e8814-01f3-420c-96fc-6887826ed92f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:09.845243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:09.859869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e8814-01f3-420c-96fc-6887826ed92f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:10.004499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57f6d0-a9ed-4c8b-890d-bab5546b2534 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:10.022105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398ce3-88e8-4eba-b7b6-83578f259a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:10.023830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398ce3-88e8-4eba-b7b6-83578f259a52 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:10.024035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398ce3-88e8-4eba-b7b6-83578f259a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:10.024299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb398ce3-88e8-4eba-b7b6-83578f259a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:10.032385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bb398ce3-88e8-4eba-b7b6-83578f259a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:10.058588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:10.086527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2e27-fc3d-4a7c-843e-e7596c008557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:10.087156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2e27-fc3d-4a7c-843e-e7596c008557 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:10.087429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2e27-fc3d-4a7c-843e-e7596c008557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:10.087695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc2e27-fc3d-4a7c-843e-e7596c008557 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:10.088333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc2e27-fc3d-4a7c-843e-e7596c008557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:10.094706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc2e27-fc3d-4a7c-843e-e7596c008557 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:10.180655 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4171/8376] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:54:09 2022] POST /identity/v3/users => generated 298 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:10.182088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2e27-fc3d-4a7c-843e-e7596c008557 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:10.205039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc2e27-fc3d-4a7c-843e-e7596c008557 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:10.238667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ca3a7-7024-4fee-8b3a-60451b51af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:10.239304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ca3a7-7024-4fee-8b3a-60451b51af20 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:10.239752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ca3a7-7024-4fee-8b3a-60451b51af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:10.241451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ca3a7-7024-4fee-8b3a-60451b51af20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:10.243347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ca3a7-7024-4fee-8b3a-60451b51af20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:10.250013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ca3a7-7024-4fee-8b3a-60451b51af20 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:10.282676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398ce3-88e8-4eba-b7b6-83578f259a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:10.284326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb398ce3-88e8-4eba-b7b6-83578f259a52 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:10.291331 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4172/8377] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:10.298352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ca3a7-7024-4fee-8b3a-60451b51af20 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:10.310347 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4206/8378] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:10.331203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ca3a7-7024-4fee-8b3a-60451b51af20 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:10.363463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc84ca0-7220-4e51-aedc-09181b358c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:10.365974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc84ca0-7220-4e51-aedc-09181b358c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:10.367748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc84ca0-7220-4e51-aedc-09181b358c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:10.369718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc84ca0-7220-4e51-aedc-09181b358c74 admin admin] PATH_INFO: `/v3/projects/2e569faafe0e4e64b86893c35a657162/users/14039bc4630743b3a2aac27a8bdacb77/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:10.424639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc84ca0-7220-4e51-aedc-09181b358c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e569faafe0e4e64b86893c35a657162, user_id=14039bc4630743b3a2aac27a8bdacb77, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:10.427961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc84ca0-7220-4e51-aedc-09181b358c74 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:10.456248 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4173/8379] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:54:10 2022] PUT /identity/v3/projects/2e569faafe0e4e64b86893c35a657162/users/14039bc4630743b3a2aac27a8bdacb77/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:10.461122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398ce3-88e8-4eba-b7b6-83578f259a52 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:10.481758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb398ce3-88e8-4eba-b7b6-83578f259a52 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:10.702430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d139c-5009-48a2-897f-d308fd1e23c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:10.703187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d139c-5009-48a2-897f-d308fd1e23c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:10.703469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d139c-5009-48a2-897f-d308fd1e23c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:10.703741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d139c-5009-48a2-897f-d308fd1e23c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:10.704401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d139c-5009-48a2-897f-d308fd1e23c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:10.710316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d139c-5009-48a2-897f-d308fd1e23c1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:10.742873 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4207/8380] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:10.747015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc84ca0-7220-4e51-aedc-09181b358c74 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:10.765133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc84ca0-7220-4e51-aedc-09181b358c74 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:10.784335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa65faa-8a1f-4b80-881c-f8f9d847e2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:10.785304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa65faa-8a1f-4b80-881c-f8f9d847e2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:10.788105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa65faa-8a1f-4b80-881c-f8f9d847e2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:10.788642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa65faa-8a1f-4b80-881c-f8f9d847e2cd admin admin] PATH_INFO: `/v3/projects/2e569faafe0e4e64b86893c35a657162/users/14039bc4630743b3a2aac27a8bdacb77/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:10.793738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa65faa-8a1f-4b80-881c-f8f9d847e2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e569faafe0e4e64b86893c35a657162, user_id=14039bc4630743b3a2aac27a8bdacb77, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:10.797142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa65faa-8a1f-4b80-881c-f8f9d847e2cd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:10.847469 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4174/8381] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:54:10 2022] PUT /identity/v3/projects/2e569faafe0e4e64b86893c35a657162/users/14039bc4630743b3a2aac27a8bdacb77/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:54:10.859493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918cb67-f1a9-4673-8d58-6070bbaeaafa None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:10.859781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918cb67-f1a9-4673-8d58-6070bbaeaafa None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:10.860055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918cb67-f1a9-4673-8d58-6070bbaeaafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:10.918520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f918cb67-f1a9-4673-8d58-6070bbaeaafa None None] MFA Rules not processed for user `14039bc4630743b3a2aac27a8bdacb77`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:10.919735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f918cb67-f1a9-4673-8d58-6070bbaeaafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:11.081519 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4208/8382] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:11.100599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa65faa-8a1f-4b80-881c-f8f9d847e2cd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:11.104742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8fa65faa-8a1f-4b80-881c-f8f9d847e2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:11.277436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa65faa-8a1f-4b80-881c-f8f9d847e2cd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:11.295873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889746e-b5da-401b-8c1e-373bfc24ed01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:11.296519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889746e-b5da-401b-8c1e-373bfc24ed01 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:11.296788 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889746e-b5da-401b-8c1e-373bfc24ed01 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:11.299150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889746e-b5da-401b-8c1e-373bfc24ed01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:11.331887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889746e-b5da-401b-8c1e-373bfc24ed01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:11.338825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889746e-b5da-401b-8c1e-373bfc24ed01 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:11.396568 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4175/8383] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:11.622682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918cb67-f1a9-4673-8d58-6070bbaeaafa None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:11.678616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918cb67-f1a9-4673-8d58-6070bbaeaafa None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:11.720780 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6f750-1e69-43c6-81a0-d732e1eb7566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:11.721526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6f750-1e69-43c6-81a0-d732e1eb7566 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:11.721691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6f750-1e69-43c6-81a0-d732e1eb7566 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:11.721999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6f750-1e69-43c6-81a0-d732e1eb7566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:11.801242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:12.122240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6f750-1e69-43c6-81a0-d732e1eb7566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:12.129286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6f750-1e69-43c6-81a0-d732e1eb7566 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:12.189772 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4209/8384] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:20.370896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889746e-b5da-401b-8c1e-373bfc24ed01 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:20.449284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:20.471740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889746e-b5da-401b-8c1e-373bfc24ed01 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:20.478861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:20.479574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:20.479905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:20.480227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] PATH_INFO: `/v3/users/28d9ac53643443a6ba421dd2f23073c8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:20.481779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d9ac53643443a6ba421dd2f23073c8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:20.484321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:20.561625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d9ac53643443a6ba421dd2f23073c8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:20.570093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d9ac53643443a6ba421dd2f23073c8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:20.583625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d9ac53643443a6ba421dd2f23073c8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:20.593924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d9ac53643443a6ba421dd2f23073c8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:20.594826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d9ac53643443a6ba421dd2f23073c8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:20.603372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4176/8385] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:54:20 2022] DELETE /identity/v3/users/28d9ac53643443a6ba421dd2f23073c8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:20.607656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cfc34-ff27-474e-9c18-1cafb2479163 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:20.608155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cfc34-ff27-474e-9c18-1cafb2479163 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:20.608292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cfc34-ff27-474e-9c18-1cafb2479163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:20.628792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a16cfc34-ff27-474e-9c18-1cafb2479163 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:20.630092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a16cfc34-ff27-474e-9c18-1cafb2479163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:20.695957 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4210/8386] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:20.705866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:20.707550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:20.778549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cde7a-98ae-46e9-9caf-8717f1ff8870 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:20.783683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c5290-d889-482b-9949-d5663e72dfd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:20.784261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c5290-d889-482b-9949-d5663e72dfd1 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:20.784537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c5290-d889-482b-9949-d5663e72dfd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:20.784810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c5290-d889-482b-9949-d5663e72dfd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:20.796550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c5290-d889-482b-9949-d5663e72dfd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:20.798080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c5290-d889-482b-9949-d5663e72dfd1 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:20.810081 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4177/8387] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:21.164196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cfc34-ff27-474e-9c18-1cafb2479163 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:21.165910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a16cfc34-ff27-474e-9c18-1cafb2479163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:21.188040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cfc34-ff27-474e-9c18-1cafb2479163 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:21.200287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:21.202324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:21.203018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:21.204114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] PATH_INFO: `/v3/projects/086aecb6e6c543128ee34b1f26fead78` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:21.208370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=086aecb6e6c543128ee34b1f26fead78)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:21.215374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:21.325898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086aecb6e6c543128ee34b1f26fead78', 'request_id': 'req-17b3f708-ba89-48bd-8f96-7db87edd3e3a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:21.338936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086aecb6e6c543128ee34b1f26fead78', 'request_id': 'req-17b3f708-ba89-48bd-8f96-7db87edd3e3a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:21.360943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086aecb6e6c543128ee34b1f26fead78', 'request_id': 'req-17b3f708-ba89-48bd-8f96-7db87edd3e3a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:21.380118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] The token cache is being invalidate because project 086aecb6e6c543128ee34b1f26fead78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:54:21.381859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:21.389638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:21.392007 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4211/8388] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:54:21 2022] DELETE /identity/v3/projects/086aecb6e6c543128ee34b1f26fead78 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:21.396488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c5290-d889-482b-9949-d5663e72dfd1 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:21.411741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c5290-d889-482b-9949-d5663e72dfd1 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:21.578472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:21.580149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:21.584018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:21.584456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] PATH_INFO: `/v3/users/14039bc4630743b3a2aac27a8bdacb77` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:21.591168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=14039bc4630743b3a2aac27a8bdacb77)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:21.603639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:21.663015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:21.733371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14039bc4630743b3a2aac27a8bdacb77'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:21.742997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14039bc4630743b3a2aac27a8bdacb77'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:21.760300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14039bc4630743b3a2aac27a8bdacb77'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:21.777524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14039bc4630743b3a2aac27a8bdacb77'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:21.778250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-e9361ee4-f8da-4356-860d-8785e29ca9ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14039bc4630743b3a2aac27a8bdacb77'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:21.803800 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4178/8389] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:54:21 2022] DELETE /identity/v3/users/14039bc4630743b3a2aac27a8bdacb77 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:22.269843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:22.271684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:22.313178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3f708-ba89-48bd-8f96-7db87edd3e3a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:22.396511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:22.448545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:22.450642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:22.450986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:22.451355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] PATH_INFO: `/v3/projects/2e569faafe0e4e64b86893c35a657162` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:22.454348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e569faafe0e4e64b86893c35a657162)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:22.458170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:22.556922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e569faafe0e4e64b86893c35a657162', 'request_id': 'req-3ffc00e4-d642-4814-9693-ad11de481235'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:22.569855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e569faafe0e4e64b86893c35a657162', 'request_id': 'req-3ffc00e4-d642-4814-9693-ad11de481235'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:22.589593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e569faafe0e4e64b86893c35a657162', 'request_id': 'req-3ffc00e4-d642-4814-9693-ad11de481235'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:22.623477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] The token cache is being invalidate because project 2e569faafe0e4e64b86893c35a657162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:54:22.624086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:22.625103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-3ffc00e4-d642-4814-9693-ad11de481235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:22.627706 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4212/8390] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:54:22 2022] DELETE /identity/v3/projects/2e569faafe0e4e64b86893c35a657162 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:22.632451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a26e7-6870-43aa-8b30-d457be728be5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:22.632976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a26e7-6870-43aa-8b30-d457be728be5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:22.632976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a26e7-6870-43aa-8b30-d457be728be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:22.686769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e57a26e7-6870-43aa-8b30-d457be728be5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:22.687994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e57a26e7-6870-43aa-8b30-d457be728be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:22.789227 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4179/8391] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:22.797782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365e3a3-e48c-4ffe-8645-8aa9f03567ab None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:22.798087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365e3a3-e48c-4ffe-8645-8aa9f03567ab None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:22.798359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365e3a3-e48c-4ffe-8645-8aa9f03567ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:22.822335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a365e3a3-e48c-4ffe-8645-8aa9f03567ab None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:22.823781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a365e3a3-e48c-4ffe-8645-8aa9f03567ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:22.836705 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4213/8392] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:22.837738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a26e7-6870-43aa-8b30-d457be728be5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:22.866609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a26e7-6870-43aa-8b30-d457be728be5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:22.881721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c584f-7c06-4853-96b2-b1ab48d932a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:22.882112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c584f-7c06-4853-96b2-b1ab48d932a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:22.882112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c584f-7c06-4853-96b2-b1ab48d932a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:22.882306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c584f-7c06-4853-96b2-b1ab48d932a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:22.882976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c584f-7c06-4853-96b2-b1ab48d932a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:54:22.883265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c584f-7c06-4853-96b2-b1ab48d932a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:22.884893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c584f-7c06-4853-96b2-b1ab48d932a9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:22.920549 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4180/8393] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:54:22.924898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365e3a3-e48c-4ffe-8645-8aa9f03567ab None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:22.938009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365e3a3-e48c-4ffe-8645-8aa9f03567ab None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:22.962856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad97dca-b880-46fa-9328-f5da847362ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:22.963495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad97dca-b880-46fa-9328-f5da847362ad admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:22.963767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad97dca-b880-46fa-9328-f5da847362ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:22.964027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad97dca-b880-46fa-9328-f5da847362ad admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:22.964668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad97dca-b880-46fa-9328-f5da847362ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:22.966655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad97dca-b880-46fa-9328-f5da847362ad admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:23.004946 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4214/8394] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:54:22 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:23.005435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c584f-7c06-4853-96b2-b1ab48d932a9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:23.021149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c584f-7c06-4853-96b2-b1ab48d932a9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:23.116581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9555c1-9b4b-4b3e-99cd-f846f3c3912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:23.117373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9555c1-9b4b-4b3e-99cd-f846f3c3912c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:23.117655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9555c1-9b4b-4b3e-99cd-f846f3c3912c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:23.117961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9555c1-9b4b-4b3e-99cd-f846f3c3912c admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:23.118607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9555c1-9b4b-4b3e-99cd-f846f3c3912c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:23.120676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9555c1-9b4b-4b3e-99cd-f846f3c3912c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:23.155254 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4181/8395] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:54:23 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:54:23.156914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad97dca-b880-46fa-9328-f5da847362ad admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:23.174870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad97dca-b880-46fa-9328-f5da847362ad admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:23.181564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668e07-60b4-4cf1-9508-1fea5ae3658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:23.182418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668e07-60b4-4cf1-9508-1fea5ae3658a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:23.182793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668e07-60b4-4cf1-9508-1fea5ae3658a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:23.183159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668e07-60b4-4cf1-9508-1fea5ae3658a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:23.183931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0668e07-60b4-4cf1-9508-1fea5ae3658a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:23.222910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0668e07-60b4-4cf1-9508-1fea5ae3658a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:23.258055 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4215/8396] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:23.260237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9555c1-9b4b-4b3e-99cd-f846f3c3912c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:23.273734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9555c1-9b4b-4b3e-99cd-f846f3c3912c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:23.287116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c689d58-0209-4543-b924-52e4121ec1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:23.287868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c689d58-0209-4543-b924-52e4121ec1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:23.288222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c689d58-0209-4543-b924-52e4121ec1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:23.288586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c689d58-0209-4543-b924-52e4121ec1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:23.290125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c689d58-0209-4543-b924-52e4121ec1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:23.292358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c689d58-0209-4543-b924-52e4121ec1e0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:23.294011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:23.305815 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4182/8397] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:23.310600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668e07-60b4-4cf1-9508-1fea5ae3658a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:23.323399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668e07-60b4-4cf1-9508-1fea5ae3658a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:23.331736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ec7c6-59bf-4491-b709-611d8b8c7479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:23.332582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ec7c6-59bf-4491-b709-611d8b8c7479 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:23.332852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ec7c6-59bf-4491-b709-611d8b8c7479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:23.333118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ec7c6-59bf-4491-b709-611d8b8c7479 admin admin] PATH_INFO: `/v3/projects/22c3fe70910c4d7288c0418f4d4a42f2/users/6a594194a9324823bc5ef235d23eefbb/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:23.352992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ec7c6-59bf-4491-b709-611d8b8c7479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c3fe70910c4d7288c0418f4d4a42f2, user_id=6a594194a9324823bc5ef235d23eefbb, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:23.355740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ec7c6-59bf-4491-b709-611d8b8c7479 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:23.372235 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4216/8398] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:54:23 2022] PUT /identity/v3/projects/22c3fe70910c4d7288c0418f4d4a42f2/users/6a594194a9324823bc5ef235d23eefbb/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:23.385804 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704491e-2a43-41db-8417-e592f65c65fb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:23.386319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704491e-2a43-41db-8417-e592f65c65fb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:23.386591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704491e-2a43-41db-8417-e592f65c65fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:23.416157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9704491e-2a43-41db-8417-e592f65c65fb None None] MFA Rules not processed for user `6a594194a9324823bc5ef235d23eefbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:23.417481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9704491e-2a43-41db-8417-e592f65c65fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:23.484074 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4183/8399] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:23.496014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ec7c6-59bf-4491-b709-611d8b8c7479 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:23.497973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1e0ec7c6-59bf-4491-b709-611d8b8c7479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:23.559496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ec7c6-59bf-4491-b709-611d8b8c7479 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:23.563259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556cfa97-1771-4e0b-b49f-d965048f7ec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:23.563990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cfa97-1771-4e0b-b49f-d965048f7ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:23.564262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cfa97-1771-4e0b-b49f-d965048f7ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:23.564529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556cfa97-1771-4e0b-b49f-d965048f7ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:23.573418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cfa97-1771-4e0b-b49f-d965048f7ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:23.575046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556cfa97-1771-4e0b-b49f-d965048f7ec4 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:23.585866 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4217/8400] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:23.609192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704491e-2a43-41db-8417-e592f65c65fb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:23.679153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704491e-2a43-41db-8417-e592f65c65fb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:23.690735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:23.691621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:23.692100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:23.692427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] PATH_INFO: `/v3/users/6a594194a9324823bc5ef235d23eefbb` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:23.694110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a594194a9324823bc5ef235d23eefbb)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:23.696233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:23.756808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a594194a9324823bc5ef235d23eefbb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:23.764591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a594194a9324823bc5ef235d23eefbb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:23.777154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a594194a9324823bc5ef235d23eefbb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:23.787119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a594194a9324823bc5ef235d23eefbb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:23.788359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a594194a9324823bc5ef235d23eefbb'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:23.794470 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4184/8401] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:54:23 2022] DELETE /identity/v3/users/6a594194a9324823bc5ef235d23eefbb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:23.799098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e998a8-fb85-4dda-85a9-2a7186238aaf None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:23.799383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e998a8-fb85-4dda-85a9-2a7186238aaf None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:23.799652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e998a8-fb85-4dda-85a9-2a7186238aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:23.808577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:23.823597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f6e998a8-fb85-4dda-85a9-2a7186238aaf None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:23.824824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f6e998a8-fb85-4dda-85a9-2a7186238aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:23.885859 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4218/8402] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:23.896206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:23.897681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:23.904934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:23.967848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432cff1-8251-44b0-a606-ae4c76706f7e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:23.972650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a3a18-5dbd-45e3-b5dd-57774c6e37fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:23.973024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3a18-5dbd-45e3-b5dd-57774c6e37fe service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:23.973330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3a18-5dbd-45e3-b5dd-57774c6e37fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:23.973715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a3a18-5dbd-45e3-b5dd-57774c6e37fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:23.984560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a3a18-5dbd-45e3-b5dd-57774c6e37fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:23.986223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a3a18-5dbd-45e3-b5dd-57774c6e37fe service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:24.000027 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4185/8403] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:24.322680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e998a8-fb85-4dda-85a9-2a7186238aaf None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:24.324778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f6e998a8-fb85-4dda-85a9-2a7186238aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:24.338194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e998a8-fb85-4dda-85a9-2a7186238aaf None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:24.343593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:24.344777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:24.345152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:24.345518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] PATH_INFO: `/v3/projects/22c3fe70910c4d7288c0418f4d4a42f2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:24.346832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c3fe70910c4d7288c0418f4d4a42f2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:24.349354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:24.422099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c3fe70910c4d7288c0418f4d4a42f2', 'request_id': 'req-72d49fb0-7726-4511-8400-922dc4d84dbd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:24.431479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c3fe70910c4d7288c0418f4d4a42f2', 'request_id': 'req-72d49fb0-7726-4511-8400-922dc4d84dbd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:24.443040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c3fe70910c4d7288c0418f4d4a42f2', 'request_id': 'req-72d49fb0-7726-4511-8400-922dc4d84dbd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:24.466575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] The token cache is being invalidate because project 22c3fe70910c4d7288c0418f4d4a42f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:54:24.468662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:24.469327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-72d49fb0-7726-4511-8400-922dc4d84dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:24.473955 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4219/8404] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:54:24 2022] DELETE /identity/v3/projects/22c3fe70910c4d7288c0418f4d4a42f2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:24.476087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2350-3f37-4300-80ca-bafba39d3132 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:24.476695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2350-3f37-4300-80ca-bafba39d3132 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:24.476966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f2350-3f37-4300-80ca-bafba39d3132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:24.499074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f53f2350-3f37-4300-80ca-bafba39d3132 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:24.501009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f53f2350-3f37-4300-80ca-bafba39d3132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:24.573703 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4186/8405] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:54:24.581713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d03ef6-a18f-474e-87e3-3d4965daabe1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:24.582349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d03ef6-a18f-474e-87e3-3d4965daabe1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:24.582626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d03ef6-a18f-474e-87e3-3d4965daabe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:24.606661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-01d03ef6-a18f-474e-87e3-3d4965daabe1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:24.608138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-01d03ef6-a18f-474e-87e3-3d4965daabe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:24.624199 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4220/8406] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:24.628063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2350-3f37-4300-80ca-bafba39d3132 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:24.647698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f2350-3f37-4300-80ca-bafba39d3132 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:24.653441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9ff9-a78e-4834-83a4-b54732b2098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:24.654620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9ff9-a78e-4834-83a4-b54732b2098b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:24.654974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9ff9-a78e-4834-83a4-b54732b2098b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:24.655317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce9ff9-a78e-4834-83a4-b54732b2098b admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:24.656484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce9ff9-a78e-4834-83a4-b54732b2098b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:54:24.656863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce9ff9-a78e-4834-83a4-b54732b2098b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:24.658989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce9ff9-a78e-4834-83a4-b54732b2098b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:24.677921 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4187/8407] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:54:24.680557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d03ef6-a18f-474e-87e3-3d4965daabe1 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:24.692143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d03ef6-a18f-474e-87e3-3d4965daabe1 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:24.699483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe22cb3-e5da-4c9c-89c9-e68e496331f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:24.700535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22cb3-e5da-4c9c-89c9-e68e496331f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:24.700885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22cb3-e5da-4c9c-89c9-e68e496331f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:24.701228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22cb3-e5da-4c9c-89c9-e68e496331f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:24.702039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe22cb3-e5da-4c9c-89c9-e68e496331f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:24.704286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe22cb3-e5da-4c9c-89c9-e68e496331f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:24.743443 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4221/8408] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:54:24 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:24.745124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9ff9-a78e-4834-83a4-b54732b2098b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:24.756672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce9ff9-a78e-4834-83a4-b54732b2098b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:24.835826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe91fc6-68b8-4bfd-b245-11037ad1f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:24.836573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe91fc6-68b8-4bfd-b245-11037ad1f6bc admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:24.836931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe91fc6-68b8-4bfd-b245-11037ad1f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:24.837391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe91fc6-68b8-4bfd-b245-11037ad1f6bc admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:24.838145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe91fc6-68b8-4bfd-b245-11037ad1f6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:24.840362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe91fc6-68b8-4bfd-b245-11037ad1f6bc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:24.865897 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4188/8409] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:54:24 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:24.870576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe22cb3-e5da-4c9c-89c9-e68e496331f2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:24.881902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe22cb3-e5da-4c9c-89c9-e68e496331f2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:24.886663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6329a-9cfe-4172-95e1-5c640bf48ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:24.887292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6329a-9cfe-4172-95e1-5c640bf48ccd admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:24.887565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6329a-9cfe-4172-95e1-5c640bf48ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:24.887834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6329a-9cfe-4172-95e1-5c640bf48ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:24.888480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6329a-9cfe-4172-95e1-5c640bf48ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:24.890141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6329a-9cfe-4172-95e1-5c640bf48ccd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:24.901540 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4222/8410] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:54:24.905426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe91fc6-68b8-4bfd-b245-11037ad1f6bc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:24.915957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe91fc6-68b8-4bfd-b245-11037ad1f6bc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:24.920809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df988b2-fef4-4719-85af-359d32f51bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:24.921438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df988b2-fef4-4719-85af-359d32f51bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:24.921716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df988b2-fef4-4719-85af-359d32f51bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:24.922032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df988b2-fef4-4719-85af-359d32f51bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:24.922830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df988b2-fef4-4719-85af-359d32f51bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:24.924465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df988b2-fef4-4719-85af-359d32f51bd7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:24.938353 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4189/8411] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:24.943128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6329a-9cfe-4172-95e1-5c640bf48ccd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:24.953573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6329a-9cfe-4172-95e1-5c640bf48ccd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:24.962853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e9195-a4fb-4f2c-aadf-0135b8e71ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:24.963540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e9195-a4fb-4f2c-aadf-0135b8e71ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:24.963820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e9195-a4fb-4f2c-aadf-0135b8e71ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:24.964095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e9195-a4fb-4f2c-aadf-0135b8e71ffb admin admin] PATH_INFO: `/v3/projects/5db9a1cdb25542df92915b5c1a52bf08/users/446f8234c94b4f5f84a7f58d99e0c089/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:24.980159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e9195-a4fb-4f2c-aadf-0135b8e71ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db9a1cdb25542df92915b5c1a52bf08, user_id=446f8234c94b4f5f84a7f58d99e0c089, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:24.982888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e9195-a4fb-4f2c-aadf-0135b8e71ffb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:24.997187 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4223/8412] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:54:24 2022] PUT /identity/v3/projects/5db9a1cdb25542df92915b5c1a52bf08/users/446f8234c94b4f5f84a7f58d99e0c089/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:25.007541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cbed0-5487-4680-afe2-655279f4970d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:25.007828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cbed0-5487-4680-afe2-655279f4970d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:25.008101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cbed0-5487-4680-afe2-655279f4970d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:25.034417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:25.038500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6c0cbed0-5487-4680-afe2-655279f4970d None None] MFA Rules not processed for user `446f8234c94b4f5f84a7f58d99e0c089`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:25.040606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6c0cbed0-5487-4680-afe2-655279f4970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:25.109001 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4190/8413] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:25.120222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e9195-a4fb-4f2c-aadf-0135b8e71ffb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:25.122216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b27e9195-a4fb-4f2c-aadf-0135b8e71ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:25.151480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:25.219338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e9195-a4fb-4f2c-aadf-0135b8e71ffb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:25.224920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be9839-366f-48b8-a943-c16518c1f876 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:25.225703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9839-366f-48b8-a943-c16518c1f876 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:25.226103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9839-366f-48b8-a943-c16518c1f876 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:25.226815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be9839-366f-48b8-a943-c16518c1f876 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:25.244283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be9839-366f-48b8-a943-c16518c1f876 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:25.246104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be9839-366f-48b8-a943-c16518c1f876 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:25.258639 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4224/8414] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:29.496325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cbed0-5487-4680-afe2-655279f4970d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:29.497973 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6c0cbed0-5487-4680-afe2-655279f4970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:29.600255 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cbed0-5487-4680-afe2-655279f4970d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:29.608059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecfee7f-f5cf-4f70-a9fa-c280f9457ca1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:29.610310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfee7f-f5cf-4f70-a9fa-c280f9457ca1 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:29.610589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfee7f-f5cf-4f70-a9fa-c280f9457ca1 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:29.610869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfee7f-f5cf-4f70-a9fa-c280f9457ca1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:29.614133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1ecfee7f-f5cf-4f70-a9fa-c280f9457ca1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:29.703108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfee7f-f5cf-4f70-a9fa-c280f9457ca1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:29.705066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecfee7f-f5cf-4f70-a9fa-c280f9457ca1 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:29.716813 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4191/8415] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:54:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:54:35.254132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=24 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:39.712910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=82 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:51.335344 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be9839-366f-48b8-a943-c16518c1f876 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:51.407130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be9839-366f-48b8-a943-c16518c1f876 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:51.412685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:51.413981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:51.414485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:51.415326 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] PATH_INFO: `/v3/users/446f8234c94b4f5f84a7f58d99e0c089` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:51.417262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=446f8234c94b4f5f84a7f58d99e0c089)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:51.419460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:51.481030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446f8234c94b4f5f84a7f58d99e0c089'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:51.482171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446f8234c94b4f5f84a7f58d99e0c089'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:51.491732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446f8234c94b4f5f84a7f58d99e0c089'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:51.504234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446f8234c94b4f5f84a7f58d99e0c089'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:51.520052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446f8234c94b4f5f84a7f58d99e0c089'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:51.531934 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4225/8416] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:54:51 2022] DELETE /identity/v3/users/446f8234c94b4f5f84a7f58d99e0c089 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:51.533720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9411b6b-406d-4c22-965c-69d8e0d8d5ad None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:51.534614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9411b6b-406d-4c22-965c-69d8e0d8d5ad None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:51.534614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9411b6b-406d-4c22-965c-69d8e0d8d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:51.587887 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b9411b6b-406d-4c22-965c-69d8e0d8d5ad None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:51.591306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b9411b6b-406d-4c22-965c-69d8e0d8d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:51.724901 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4192/8417] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:51.734785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:51.737356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:51.746843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4c355-d9c0-44d5-a9ea-3502c17e905d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:51.747248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4c355-d9c0-44d5-a9ea-3502c17e905d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:51.747624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4c355-d9c0-44d5-a9ea-3502c17e905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:51.779154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-65b4c355-d9c0-44d5-a9ea-3502c17e905d None None] MFA Rules not processed for user `a9ef01029e264fbca52310cfe3edfb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:51.780627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-65b4c355-d9c0-44d5-a9ea-3502c17e905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:51.819144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457103ff-85b2-40f5-bf2f-ed25f0a48c24 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:51.822862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c023bd-a28a-4e41-b82e-b4f6362f4b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:51.823640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c023bd-a28a-4e41-b82e-b4f6362f4b19 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:51.823919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c023bd-a28a-4e41-b82e-b4f6362f4b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:51.824196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c023bd-a28a-4e41-b82e-b4f6362f4b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:51.834878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c023bd-a28a-4e41-b82e-b4f6362f4b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:51.836342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c023bd-a28a-4e41-b82e-b4f6362f4b19 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:51.848196 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4226/8418] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:51.927861 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4193/8419] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:52.353323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c023bd-a28a-4e41-b82e-b4f6362f4b19 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:52.366178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d8c023bd-a28a-4e41-b82e-b4f6362f4b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:52.381509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4c355-d9c0-44d5-a9ea-3502c17e905d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:52.384494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-65b4c355-d9c0-44d5-a9ea-3502c17e905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:52.388980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c023bd-a28a-4e41-b82e-b4f6362f4b19 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:52.397897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740398d9-eff5-486e-9986-afa78d665f88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:52.398540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740398d9-eff5-486e-9986-afa78d665f88 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:52.398856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740398d9-eff5-486e-9986-afa78d665f88 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:52.399164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740398d9-eff5-486e-9986-afa78d665f88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:52.406311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-740398d9-eff5-486e-9986-afa78d665f88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:52.407051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4c355-d9c0-44d5-a9ea-3502c17e905d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:52.415410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:52.416394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:52.416653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:52.416957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] PATH_INFO: `/v3/projects/5db9a1cdb25542df92915b5c1a52bf08` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:52.418609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db9a1cdb25542df92915b5c1a52bf08)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:52.420703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:52.450077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740398d9-eff5-486e-9986-afa78d665f88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:52.451572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740398d9-eff5-486e-9986-afa78d665f88 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:52.473843 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4227/8420] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:54:52.488867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db9a1cdb25542df92915b5c1a52bf08', 'request_id': 'req-95ab325c-33c3-48d5-bf8e-93f087014697'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:52.506015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db9a1cdb25542df92915b5c1a52bf08', 'request_id': 'req-95ab325c-33c3-48d5-bf8e-93f087014697'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:52.515447 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db9a1cdb25542df92915b5c1a52bf08', 'request_id': 'req-95ab325c-33c3-48d5-bf8e-93f087014697'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:52.527307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] The token cache is being invalidate because project 5db9a1cdb25542df92915b5c1a52bf08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:54:52.527681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:52.528347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-95ab325c-33c3-48d5-bf8e-93f087014697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:54:52.537974 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4194/8421] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:54:52 2022] DELETE /identity/v3/projects/5db9a1cdb25542df92915b5c1a52bf08 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:54:52.538619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834503c-84a4-4dd7-88d3-76a35ac3a1fc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:52.538709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834503c-84a4-4dd7-88d3-76a35ac3a1fc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:52.538982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834503c-84a4-4dd7-88d3-76a35ac3a1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:52.565006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6834503c-84a4-4dd7-88d3-76a35ac3a1fc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:52.588888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6834503c-84a4-4dd7-88d3-76a35ac3a1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:52.599588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:52.668577 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4228/8422] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:52.677680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373817-bcff-409d-b873-c842ac7a02d9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:52.691231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373817-bcff-409d-b873-c842ac7a02d9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:52.696902 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34373817-bcff-409d-b873-c842ac7a02d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:52.747056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-34373817-bcff-409d-b873-c842ac7a02d9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:52.748629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-34373817-bcff-409d-b873-c842ac7a02d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:52.763031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834503c-84a4-4dd7-88d3-76a35ac3a1fc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:52.766035 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4195/8423] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:52.775169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834503c-84a4-4dd7-88d3-76a35ac3a1fc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:52.780191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860b13c-3414-4547-9ae6-7f35c4129c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:52.780800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860b13c-3414-4547-9ae6-7f35c4129c96 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:52.781075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860b13c-3414-4547-9ae6-7f35c4129c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:52.781343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860b13c-3414-4547-9ae6-7f35c4129c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:52.782456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860b13c-3414-4547-9ae6-7f35c4129c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:54:52.782819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860b13c-3414-4547-9ae6-7f35c4129c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:52.784607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860b13c-3414-4547-9ae6-7f35c4129c96 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:52.801333 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4229/8424] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:54:52.802707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34373817-bcff-409d-b873-c842ac7a02d9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:52.814207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34373817-bcff-409d-b873-c842ac7a02d9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:52.821709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9996fea-f543-4d51-8364-d778df72dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:52.822374 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996fea-f543-4d51-8364-d778df72dcde admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:52.822656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996fea-f543-4d51-8364-d778df72dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:52.822923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9996fea-f543-4d51-8364-d778df72dcde admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:52.823579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9996fea-f543-4d51-8364-d778df72dcde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:52.825631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9996fea-f543-4d51-8364-d778df72dcde admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:52.875115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:52.899816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860b13c-3414-4547-9ae6-7f35c4129c96 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:52.900159 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4196/8425] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:54:52 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:52.915645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860b13c-3414-4547-9ae6-7f35c4129c96 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:52.997979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9553e-0523-4e5a-946c-b980bb234c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:52.998653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9553e-0523-4e5a-946c-b980bb234c65 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:52.998933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9553e-0523-4e5a-946c-b980bb234c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:52.999260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9553e-0523-4e5a-946c-b980bb234c65 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:52.999902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9553e-0523-4e5a-946c-b980bb234c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:53.002062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9553e-0523-4e5a-946c-b980bb234c65 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:53.026343 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4230/8426] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:54:52 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:53.030748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9996fea-f543-4d51-8364-d778df72dcde admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:53.050780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9996fea-f543-4d51-8364-d778df72dcde admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:53.078404 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1e474-d114-4305-913f-74cc64ed4b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:53.079195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1e474-d114-4305-913f-74cc64ed4b8b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:53.079569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1e474-d114-4305-913f-74cc64ed4b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:53.079937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1e474-d114-4305-913f-74cc64ed4b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:53.080712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1e474-d114-4305-913f-74cc64ed4b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:53.083415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1e474-d114-4305-913f-74cc64ed4b8b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:53.107644 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4197/8427] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:53.111859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9553e-0523-4e5a-946c-b980bb234c65 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:53.123349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9553e-0523-4e5a-946c-b980bb234c65 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:53.136528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea7c39-a247-44ad-8630-08bd2b034bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:53.137359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea7c39-a247-44ad-8630-08bd2b034bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:53.137620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea7c39-a247-44ad-8630-08bd2b034bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:53.137907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea7c39-a247-44ad-8630-08bd2b034bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:53.138578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea7c39-a247-44ad-8630-08bd2b034bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:53.140324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea7c39-a247-44ad-8630-08bd2b034bd1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:53.153276 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4231/8428] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:53.157365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1e474-d114-4305-913f-74cc64ed4b8b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:53.180535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1e474-d114-4305-913f-74cc64ed4b8b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:53.197937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfee3a-9d35-4106-91d5-5d730ac648f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:53.198422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfee3a-9d35-4106-91d5-5d730ac648f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:53.198763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfee3a-9d35-4106-91d5-5d730ac648f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:53.199066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfee3a-9d35-4106-91d5-5d730ac648f4 admin admin] PATH_INFO: `/v3/projects/970e5b0b44ba48b988136c0e0f75335a/users/8a06258ee05b42cea34c5e5f488d14c8/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:53.249615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfee3a-9d35-4106-91d5-5d730ac648f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=970e5b0b44ba48b988136c0e0f75335a, user_id=8a06258ee05b42cea34c5e5f488d14c8, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:53.253140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfee3a-9d35-4106-91d5-5d730ac648f4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:53.293857 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4198/8429] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:54:53 2022] PUT /identity/v3/projects/970e5b0b44ba48b988136c0e0f75335a/users/8a06258ee05b42cea34c5e5f488d14c8/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:54:53.295528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54847a6-632e-4f97-b83c-6773e9f6beb7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:53.295878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54847a6-632e-4f97-b83c-6773e9f6beb7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:53.296215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54847a6-632e-4f97-b83c-6773e9f6beb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:53.332275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-a54847a6-632e-4f97-b83c-6773e9f6beb7 None None] MFA Rules not processed for user `8a06258ee05b42cea34c5e5f488d14c8`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:53.333671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a54847a6-632e-4f97-b83c-6773e9f6beb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:53.417975 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4232/8430] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:53.422844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfee3a-9d35-4106-91d5-5d730ac648f4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:53.518611 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfee3a-9d35-4106-91d5-5d730ac648f4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:53.524599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54128b-cf41-4f57-8b2c-6a7c4cb1667a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:53.525337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54128b-cf41-4f57-8b2c-6a7c4cb1667a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:53.525748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54128b-cf41-4f57-8b2c-6a7c4cb1667a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:53.526131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54128b-cf41-4f57-8b2c-6a7c4cb1667a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:53.526854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54128b-cf41-4f57-8b2c-6a7c4cb1667a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:53.529070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54128b-cf41-4f57-8b2c-6a7c4cb1667a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:53.563009 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4199/8431] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:54:53 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:53.571083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54847a6-632e-4f97-b83c-6773e9f6beb7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:53.593218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:53.598823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54847a6-632e-4f97-b83c-6773e9f6beb7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:53.681935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767d42-7f6c-46a3-a2fa-ad83ffc3c0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:53.681935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767d42-7f6c-46a3-a2fa-ad83ffc3c0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:53.681935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767d42-7f6c-46a3-a2fa-ad83ffc3c0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:53.681935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767d42-7f6c-46a3-a2fa-ad83ffc3c0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:53.682431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3767d42-7f6c-46a3-a2fa-ad83ffc3c0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:53.682935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3767d42-7f6c-46a3-a2fa-ad83ffc3c0d0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:53.717309 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4233/8432] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:54:53 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:54:53.717843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54128b-cf41-4f57-8b2c-6a7c4cb1667a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:53.730395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54128b-cf41-4f57-8b2c-6a7c4cb1667a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:53.738349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cac609-5e91-4995-9c0d-1dc0e2a1c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:53.738349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac609-5e91-4995-9c0d-1dc0e2a1c9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:53.738349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac609-5e91-4995-9c0d-1dc0e2a1c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:53.738349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac609-5e91-4995-9c0d-1dc0e2a1c9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:53.744027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cac609-5e91-4995-9c0d-1dc0e2a1c9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:53.744027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cac609-5e91-4995-9c0d-1dc0e2a1c9e7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:53.755629 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4200/8433] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:53.760036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767d42-7f6c-46a3-a2fa-ad83ffc3c0d0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:53.771726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767d42-7f6c-46a3-a2fa-ad83ffc3c0d0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:53.779632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5eeae-40a4-4db8-8cfa-3345bfc49639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:53.780389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5eeae-40a4-4db8-8cfa-3345bfc49639 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:53.780672 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5eeae-40a4-4db8-8cfa-3345bfc49639 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:53.780945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5eeae-40a4-4db8-8cfa-3345bfc49639 admin admin] PATH_INFO: `/v3/projects/d35d6426e8004b6592e6b4aeb705d8f8/users/68223cb040e34b3c9642effe79d576fd/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:53.802276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5eeae-40a4-4db8-8cfa-3345bfc49639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35d6426e8004b6592e6b4aeb705d8f8, user_id=68223cb040e34b3c9642effe79d576fd, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:53.805435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b5eeae-40a4-4db8-8cfa-3345bfc49639 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:53.825987 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4234/8434] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:54:53 2022] PUT /identity/v3/projects/d35d6426e8004b6592e6b4aeb705d8f8/users/68223cb040e34b3c9642effe79d576fd/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:54:53.829128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cac609-5e91-4995-9c0d-1dc0e2a1c9e7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:53.859742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cac609-5e91-4995-9c0d-1dc0e2a1c9e7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:53.965446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b13c55-18b2-458c-9f3b-646c5755b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:53.966310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b13c55-18b2-458c-9f3b-646c5755b97a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:53.966487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b13c55-18b2-458c-9f3b-646c5755b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:53.966709 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b13c55-18b2-458c-9f3b-646c5755b97a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:53.968263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b13c55-18b2-458c-9f3b-646c5755b97a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:53.977619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b13c55-18b2-458c-9f3b-646c5755b97a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:53.995110 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4201/8435] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:54:53.999182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5eeae-40a4-4db8-8cfa-3345bfc49639 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:54.012153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5eeae-40a4-4db8-8cfa-3345bfc49639 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:54.017470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87375548-05f1-4b5c-873d-c28cd60ae3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:54.018186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87375548-05f1-4b5c-873d-c28cd60ae3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:54.018518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87375548-05f1-4b5c-873d-c28cd60ae3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:54.018849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87375548-05f1-4b5c-873d-c28cd60ae3f2 admin admin] PATH_INFO: `/v3/projects/d35d6426e8004b6592e6b4aeb705d8f8/users/68223cb040e34b3c9642effe79d576fd/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:54.021343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87375548-05f1-4b5c-873d-c28cd60ae3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35d6426e8004b6592e6b4aeb705d8f8, user_id=68223cb040e34b3c9642effe79d576fd, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:54.024399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87375548-05f1-4b5c-873d-c28cd60ae3f2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:54.047912 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4235/8436] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:54:53 2022] PUT /identity/v3/projects/d35d6426e8004b6592e6b4aeb705d8f8/users/68223cb040e34b3c9642effe79d576fd/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:54:54.049912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6fa2c-b4d0-4d45-88e6-99c4f941fce9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:54.050898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6fa2c-b4d0-4d45-88e6-99c4f941fce9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:54.051182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6fa2c-b4d0-4d45-88e6-99c4f941fce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:54.087042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-aca6fa2c-b4d0-4d45-88e6-99c4f941fce9 None None] MFA Rules not processed for user `68223cb040e34b3c9642effe79d576fd`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:54:54.088302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aca6fa2c-b4d0-4d45-88e6-99c4f941fce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:54.115812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:54.214146 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4202/8437] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:54:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:54:54.230395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87375548-05f1-4b5c-873d-c28cd60ae3f2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:54.233390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-87375548-05f1-4b5c-873d-c28cd60ae3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:54.352885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87375548-05f1-4b5c-873d-c28cd60ae3f2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:54.357301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40187d-1c6f-4cfd-9b86-51150996e632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:54.358182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40187d-1c6f-4cfd-9b86-51150996e632 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:54.358671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40187d-1c6f-4cfd-9b86-51150996e632 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:54.359083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40187d-1c6f-4cfd-9b86-51150996e632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:54.450175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40187d-1c6f-4cfd-9b86-51150996e632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:54.452211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40187d-1c6f-4cfd-9b86-51150996e632 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:54.465456 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4236/8438] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:54:55.695280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6fa2c-b4d0-4d45-88e6-99c4f941fce9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:54:55.697136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-aca6fa2c-b4d0-4d45-88e6-99c4f941fce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:55.812180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6fa2c-b4d0-4d45-88e6-99c4f941fce9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:54:55.817320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a45c3-60bb-4a3c-aca9-ac0f7c48b593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:54:55.818270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a45c3-60bb-4a3c-aca9-ac0f7c48b593 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:54:55.818693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a45c3-60bb-4a3c-aca9-ac0f7c48b593 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:54:55.819134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a45c3-60bb-4a3c-aca9-ac0f7c48b593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:54:55.822121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7f1a45c3-60bb-4a3c-aca9-ac0f7c48b593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:54:55.861715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a45c3-60bb-4a3c-aca9-ac0f7c48b593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:54:55.863706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1a45c3-60bb-4a3c-aca9-ac0f7c48b593 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:54:55.965066 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4203/8439] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:54:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:55:00.860893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40187d-1c6f-4cfd-9b86-51150996e632 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:00.889533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:01.036660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40187d-1c6f-4cfd-9b86-51150996e632 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:01.048786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:01.051603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:01.051892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:01.052168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] PATH_INFO: `/v3/users/8a06258ee05b42cea34c5e5f488d14c8` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:01.064738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a06258ee05b42cea34c5e5f488d14c8)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:01.072597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:01.190461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a06258ee05b42cea34c5e5f488d14c8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:01.191409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a06258ee05b42cea34c5e5f488d14c8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:01.212036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a06258ee05b42cea34c5e5f488d14c8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:01.224116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a06258ee05b42cea34c5e5f488d14c8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:01.279445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a06258ee05b42cea34c5e5f488d14c8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:01.301137 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4237/8440] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:55:00 2022] DELETE /identity/v3/users/8a06258ee05b42cea34c5e5f488d14c8 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:01.305764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9275355-3b20-4a16-9b19-e44d0f5a495f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:01.306284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9275355-3b20-4a16-9b19-e44d0f5a495f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:01.306392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9275355-3b20-4a16-9b19-e44d0f5a495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:01.338926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d9275355-3b20-4a16-9b19-e44d0f5a495f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:01.342050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d9275355-3b20-4a16-9b19-e44d0f5a495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:01.507762 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4204/8441] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:55:01.517295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:01.519080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:01.621135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ab9e0-3393-4a4f-acec-56bd5ef5d2b3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:01.628310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de69d-1755-4dd2-9890-7eaaf0e162c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:01.629154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de69d-1755-4dd2-9890-7eaaf0e162c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:01.631577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de69d-1755-4dd2-9890-7eaaf0e162c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:01.632128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920de69d-1755-4dd2-9890-7eaaf0e162c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:01.646002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de69d-1755-4dd2-9890-7eaaf0e162c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:01.647673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920de69d-1755-4dd2-9890-7eaaf0e162c0 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:01.674947 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4238/8442] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:55:02.050961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9275355-3b20-4a16-9b19-e44d0f5a495f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:02.052676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d9275355-3b20-4a16-9b19-e44d0f5a495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:02.076244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9275355-3b20-4a16-9b19-e44d0f5a495f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:02.103448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:02.106969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:02.110475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:02.112241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] PATH_INFO: `/v3/projects/970e5b0b44ba48b988136c0e0f75335a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:02.117160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=970e5b0b44ba48b988136c0e0f75335a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:02.144465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:02.314772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970e5b0b44ba48b988136c0e0f75335a', 'request_id': 'req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:02.325052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970e5b0b44ba48b988136c0e0f75335a', 'request_id': 'req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:02.332907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:02.343091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970e5b0b44ba48b988136c0e0f75335a', 'request_id': 'req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:02.368036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] The token cache is being invalidate because project 970e5b0b44ba48b988136c0e0f75335a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:55:02.368498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:02.369288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:02.372950 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4205/8443] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:55:02 2022] DELETE /identity/v3/projects/970e5b0b44ba48b988136c0e0f75335a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:02.376939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de69d-1755-4dd2-9890-7eaaf0e162c0 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:02.392332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920de69d-1755-4dd2-9890-7eaaf0e162c0 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:02.499960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:02.550460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:02.551096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:02.551524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:02.551900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] PATH_INFO: `/v3/users/68223cb040e34b3c9642effe79d576fd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:02.553460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68223cb040e34b3c9642effe79d576fd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:02.555334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:02.659380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68223cb040e34b3c9642effe79d576fd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:02.660152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68223cb040e34b3c9642effe79d576fd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:02.669486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68223cb040e34b3c9642effe79d576fd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:02.686805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68223cb040e34b3c9642effe79d576fd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:02.709194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-734c93db-27b5-4b7f-81e8-fa9348e0f5f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68223cb040e34b3c9642effe79d576fd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:02.717924 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4239/8444] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:55:02 2022] DELETE /identity/v3/users/68223cb040e34b3c9642effe79d576fd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:03.058263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:03.059795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:03.082190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eee806-1bb8-457c-a5a1-9e53e35d0f2d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:03.156875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:03.157547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:03.157850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:03.158154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] PATH_INFO: `/v3/projects/d35d6426e8004b6592e6b4aeb705d8f8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:03.159724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35d6426e8004b6592e6b4aeb705d8f8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:03.162077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:03.239965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35d6426e8004b6592e6b4aeb705d8f8', 'request_id': 'req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:03.250117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35d6426e8004b6592e6b4aeb705d8f8', 'request_id': 'req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:03.257660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35d6426e8004b6592e6b4aeb705d8f8', 'request_id': 'req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:03.268699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] The token cache is being invalidate because project d35d6426e8004b6592e6b4aeb705d8f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:55:03.268989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:03.269633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-b3d7ec11-ec71-48a8-8cb6-9b0445e5bcf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:03.271359 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4206/8445] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:55:03 2022] DELETE /identity/v3/projects/d35d6426e8004b6592e6b4aeb705d8f8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:03.276285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcbd53-34e8-46ef-8649-1a82b2ad1f18 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:03.276573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcbd53-34e8-46ef-8649-1a82b2ad1f18 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:03.276848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcbd53-34e8-46ef-8649-1a82b2ad1f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:03.308883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e0fcbd53-34e8-46ef-8649-1a82b2ad1f18 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:03.310045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e0fcbd53-34e8-46ef-8649-1a82b2ad1f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:03.385836 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4240/8446] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:55:03.394295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481efde5-d043-4413-ac9a-e95061985c6b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:03.394750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481efde5-d043-4413-ac9a-e95061985c6b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:03.394858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481efde5-d043-4413-ac9a-e95061985c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:03.420750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-481efde5-d043-4413-ac9a-e95061985c6b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:03.422251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-481efde5-d043-4413-ac9a-e95061985c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:03.430602 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4207/8447] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:55:03.435011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcbd53-34e8-46ef-8649-1a82b2ad1f18 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:03.449300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcbd53-34e8-46ef-8649-1a82b2ad1f18 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:03.454192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26375ef1-a081-4b27-ad0d-1dca85232c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:03.454813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26375ef1-a081-4b27-ad0d-1dca85232c6e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:03.455093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26375ef1-a081-4b27-ad0d-1dca85232c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:03.455368 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26375ef1-a081-4b27-ad0d-1dca85232c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:03.456057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26375ef1-a081-4b27-ad0d-1dca85232c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:03.456357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26375ef1-a081-4b27-ad0d-1dca85232c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:03.458051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26375ef1-a081-4b27-ad0d-1dca85232c6e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:03.473955 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4241/8448] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:03.476906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481efde5-d043-4413-ac9a-e95061985c6b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:03.487596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481efde5-d043-4413-ac9a-e95061985c6b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:03.492119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a636e2-2849-4da7-902b-4c6db3082a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:03.492756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a636e2-2849-4da7-902b-4c6db3082a2e admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:03.493039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a636e2-2849-4da7-902b-4c6db3082a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:03.493452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a636e2-2849-4da7-902b-4c6db3082a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:03.494143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a636e2-2849-4da7-902b-4c6db3082a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:03.496515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a636e2-2849-4da7-902b-4c6db3082a2e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:03.563579 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4208/8449] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:55:03 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:55:03.570256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26375ef1-a081-4b27-ad0d-1dca85232c6e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:03.582311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26375ef1-a081-4b27-ad0d-1dca85232c6e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:03.632159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:03.654461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdafaa-828e-4c65-990d-d8994c3cc3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:03.655586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdafaa-828e-4c65-990d-d8994c3cc3fd admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:03.655862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdafaa-828e-4c65-990d-d8994c3cc3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:03.656128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdafaa-828e-4c65-990d-d8994c3cc3fd admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:03.657546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdafaa-828e-4c65-990d-d8994c3cc3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:03.661470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdafaa-828e-4c65-990d-d8994c3cc3fd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:03.704587 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4242/8450] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:55:03 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:55:03.709168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a636e2-2849-4da7-902b-4c6db3082a2e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:03.723099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a636e2-2849-4da7-902b-4c6db3082a2e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:03.735046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80462938-b407-4001-8a34-4cc916d4d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:03.735758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80462938-b407-4001-8a34-4cc916d4d2be admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:03.736048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80462938-b407-4001-8a34-4cc916d4d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:03.736337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80462938-b407-4001-8a34-4cc916d4d2be admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:03.737050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80462938-b407-4001-8a34-4cc916d4d2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:03.738888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80462938-b407-4001-8a34-4cc916d4d2be admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:03.753578 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4209/8451] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:55:03.754723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdafaa-828e-4c65-990d-d8994c3cc3fd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:03.766852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdafaa-828e-4c65-990d-d8994c3cc3fd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:03.776135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ab2ea-69cf-42e6-b97a-77bfd7c8255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:03.777585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ab2ea-69cf-42e6-b97a-77bfd7c8255c admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:03.777749 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ab2ea-69cf-42e6-b97a-77bfd7c8255c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:03.778108 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ab2ea-69cf-42e6-b97a-77bfd7c8255c admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:03.778810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ab2ea-69cf-42e6-b97a-77bfd7c8255c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:03.787050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ab2ea-69cf-42e6-b97a-77bfd7c8255c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:03.811848 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4243/8452] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:55:03.813014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80462938-b407-4001-8a34-4cc916d4d2be admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:03.832814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80462938-b407-4001-8a34-4cc916d4d2be admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:03.838484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06569409-8710-4ac9-aa8e-3fac4c943e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:03.839175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06569409-8710-4ac9-aa8e-3fac4c943e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:03.839559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06569409-8710-4ac9-aa8e-3fac4c943e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:03.839915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06569409-8710-4ac9-aa8e-3fac4c943e81 admin admin] PATH_INFO: `/v3/projects/db4d8a63379d47b6a1676a09313e4999/users/52fa2b5447174b51993b6c24e5cd2b53/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:03.857634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06569409-8710-4ac9-aa8e-3fac4c943e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db4d8a63379d47b6a1676a09313e4999, user_id=52fa2b5447174b51993b6c24e5cd2b53, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:03.862836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06569409-8710-4ac9-aa8e-3fac4c943e81 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:03.883463 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4210/8453] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:55:03 2022] PUT /identity/v3/projects/db4d8a63379d47b6a1676a09313e4999/users/52fa2b5447174b51993b6c24e5cd2b53/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:55:03.893599 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea6205-e0a3-46b1-a2d9-f896d34b6db2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:03.893887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea6205-e0a3-46b1-a2d9-f896d34b6db2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:03.894189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea6205-e0a3-46b1-a2d9-f896d34b6db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:03.923572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-faea6205-e0a3-46b1-a2d9-f896d34b6db2 None None] MFA Rules not processed for user `52fa2b5447174b51993b6c24e5cd2b53`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:03.925046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-faea6205-e0a3-46b1-a2d9-f896d34b6db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:03.997025 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4244/8454] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:55:04.004900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06569409-8710-4ac9-aa8e-3fac4c943e81 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:04.006700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-06569409-8710-4ac9-aa8e-3fac4c943e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:04.022621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:04.077093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06569409-8710-4ac9-aa8e-3fac4c943e81 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:04.081217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5792caa-e08b-435d-a512-d0a0e99853d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:04.082059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5792caa-e08b-435d-a512-d0a0e99853d9 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:04.082409 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5792caa-e08b-435d-a512-d0a0e99853d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:04.082739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5792caa-e08b-435d-a512-d0a0e99853d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:04.097433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5792caa-e08b-435d-a512-d0a0e99853d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:04.099157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5792caa-e08b-435d-a512-d0a0e99853d9 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:04.110660 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4211/8455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:55:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:55:04.145523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea6205-e0a3-46b1-a2d9-f896d34b6db2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:04.214721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea6205-e0a3-46b1-a2d9-f896d34b6db2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:04.219378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:04.220027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:04.220297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:04.220567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] PATH_INFO: `/v3/users/52fa2b5447174b51993b6c24e5cd2b53` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:04.222076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=52fa2b5447174b51993b6c24e5cd2b53)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:04.224157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:04.277560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52fa2b5447174b51993b6c24e5cd2b53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:04.278338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52fa2b5447174b51993b6c24e5cd2b53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:04.281433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:04.290419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52fa2b5447174b51993b6c24e5cd2b53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:04.302946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52fa2b5447174b51993b6c24e5cd2b53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:04.317393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52fa2b5447174b51993b6c24e5cd2b53'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:04.324350 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4245/8456] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:55:04 2022] DELETE /identity/v3/users/52fa2b5447174b51993b6c24e5cd2b53 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:04.329282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ffe9d-c1fd-4e16-b56e-715ca587bed0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:04.329827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ffe9d-c1fd-4e16-b56e-715ca587bed0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:04.330403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ffe9d-c1fd-4e16-b56e-715ca587bed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:04.353354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-295ffe9d-c1fd-4e16-b56e-715ca587bed0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:04.354628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-295ffe9d-c1fd-4e16-b56e-715ca587bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:04.429310 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4212/8457] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:55:04.439616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:04.441163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:04.508958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a3e49-8713-4b15-9d17-c05b78dbc3dd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:04.512909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5931d-3018-40ef-9194-9af7b1689146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:04.513701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5931d-3018-40ef-9194-9af7b1689146 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:04.514074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5931d-3018-40ef-9194-9af7b1689146 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:04.514442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5931d-3018-40ef-9194-9af7b1689146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:04.524848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5931d-3018-40ef-9194-9af7b1689146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:04.526419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5931d-3018-40ef-9194-9af7b1689146 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:04.537728 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4246/8458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:55:05.033082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ffe9d-c1fd-4e16-b56e-715ca587bed0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:05.034817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-295ffe9d-c1fd-4e16-b56e-715ca587bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:05.066218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ffe9d-c1fd-4e16-b56e-715ca587bed0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:05.083472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:05.084138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:05.084586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:05.085002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] PATH_INFO: `/v3/projects/db4d8a63379d47b6a1676a09313e4999` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:05.086963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db4d8a63379d47b6a1676a09313e4999)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:05.088944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:05.160297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db4d8a63379d47b6a1676a09313e4999', 'request_id': 'req-de4c50b6-6086-48d0-ad17-2b58108f5711'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:05.171873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db4d8a63379d47b6a1676a09313e4999', 'request_id': 'req-de4c50b6-6086-48d0-ad17-2b58108f5711'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:05.179200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db4d8a63379d47b6a1676a09313e4999', 'request_id': 'req-de4c50b6-6086-48d0-ad17-2b58108f5711'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:05.190778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] The token cache is being invalidate because project db4d8a63379d47b6a1676a09313e4999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:55:05.191074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:05.191735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-de4c50b6-6086-48d0-ad17-2b58108f5711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:05.197359 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4213/8459] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:55:05 2022] DELETE /identity/v3/projects/db4d8a63379d47b6a1676a09313e4999 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:05.199671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3eff-f7bf-4997-b9c7-a2160374b34a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:05.200017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3eff-f7bf-4997-b9c7-a2160374b34a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:05.200345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3eff-f7bf-4997-b9c7-a2160374b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:05.264418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-69ee3eff-f7bf-4997-b9c7-a2160374b34a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:05.266547 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-69ee3eff-f7bf-4997-b9c7-a2160374b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:05.337125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4247/8460] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:55:05.344151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae64af9-e84d-40dc-ae19-778b3d7f925f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:05.344436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae64af9-e84d-40dc-ae19-778b3d7f925f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:05.344863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae64af9-e84d-40dc-ae19-778b3d7f925f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:05.379077 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0ae64af9-e84d-40dc-ae19-778b3d7f925f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:05.381569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0ae64af9-e84d-40dc-ae19-778b3d7f925f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:05.397924 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4214/8461] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:55:05.399935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee3eff-f7bf-4997-b9c7-a2160374b34a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:05.411717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee3eff-f7bf-4997-b9c7-a2160374b34a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:05.416690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f0968-a7e8-4c21-8cb7-193af9df84a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:05.417483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f0968-a7e8-4c21-8cb7-193af9df84a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:05.417821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f0968-a7e8-4c21-8cb7-193af9df84a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:05.418179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f0968-a7e8-4c21-8cb7-193af9df84a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:05.419034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f0968-a7e8-4c21-8cb7-193af9df84a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:55:05.419384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f0968-a7e8-4c21-8cb7-193af9df84a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:05.421353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f0968-a7e8-4c21-8cb7-193af9df84a9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:05.435989 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4248/8462] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:55:05.440007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae64af9-e84d-40dc-ae19-778b3d7f925f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:05.470747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae64af9-e84d-40dc-ae19-778b3d7f925f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:05.490716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f3dbd-350e-4794-84a7-c5aaea78e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:05.491367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f3dbd-350e-4794-84a7-c5aaea78e8ef admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:05.491643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f3dbd-350e-4794-84a7-c5aaea78e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:05.491915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f3dbd-350e-4794-84a7-c5aaea78e8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:05.493051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f3dbd-350e-4794-84a7-c5aaea78e8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:05.494555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f3dbd-350e-4794-84a7-c5aaea78e8ef admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:05.531350 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4215/8463] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:55:05 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:55:05.536526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f0968-a7e8-4c21-8cb7-193af9df84a9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:05.547430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f0968-a7e8-4c21-8cb7-193af9df84a9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:05.626801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:05.634887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18467558-8567-4ce6-a60a-fe40367d3dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:05.635841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18467558-8567-4ce6-a60a-fe40367d3dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:05.636304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18467558-8567-4ce6-a60a-fe40367d3dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:05.636726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18467558-8567-4ce6-a60a-fe40367d3dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:05.637517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18467558-8567-4ce6-a60a-fe40367d3dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:05.641460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18467558-8567-4ce6-a60a-fe40367d3dc5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:05.676524 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4249/8464] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:55:05 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:55:05.680679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f3dbd-350e-4794-84a7-c5aaea78e8ef admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:05.693171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f3dbd-350e-4794-84a7-c5aaea78e8ef admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:05.700373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e252ac-edbf-4c31-8b99-1725554796b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:05.700997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e252ac-edbf-4c31-8b99-1725554796b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:05.701272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e252ac-edbf-4c31-8b99-1725554796b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:05.701541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e252ac-edbf-4c31-8b99-1725554796b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:05.702233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e252ac-edbf-4c31-8b99-1725554796b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:05.704012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e252ac-edbf-4c31-8b99-1725554796b8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:05.710948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:05.717677 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4216/8465] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:55:05.722296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18467558-8567-4ce6-a60a-fe40367d3dc5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:05.739851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18467558-8567-4ce6-a60a-fe40367d3dc5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:05.744997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9a91d-7db6-45b2-a2f9-65ee5a818717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:05.746324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a91d-7db6-45b2-a2f9-65ee5a818717 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:05.746866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a91d-7db6-45b2-a2f9-65ee5a818717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:05.747343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a91d-7db6-45b2-a2f9-65ee5a818717 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:05.748235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9a91d-7db6-45b2-a2f9-65ee5a818717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:05.750135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9a91d-7db6-45b2-a2f9-65ee5a818717 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:05.765731 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4250/8466] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:55:05.769608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e252ac-edbf-4c31-8b99-1725554796b8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:05.781914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e252ac-edbf-4c31-8b99-1725554796b8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:05.787056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dce180-2c03-4cc5-9486-cba39f3e73ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:05.787898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dce180-2c03-4cc5-9486-cba39f3e73ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:05.788181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dce180-2c03-4cc5-9486-cba39f3e73ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:05.788458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dce180-2c03-4cc5-9486-cba39f3e73ff admin admin] PATH_INFO: `/v3/projects/f764025ac7bd4e81995dde9a5185bd80/users/8579769774234e2088cb6e6fbe8fcc03/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:05.827362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dce180-2c03-4cc5-9486-cba39f3e73ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f764025ac7bd4e81995dde9a5185bd80, user_id=8579769774234e2088cb6e6fbe8fcc03, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:05.830721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dce180-2c03-4cc5-9486-cba39f3e73ff admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:05.850702 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4217/8467] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:55:05 2022] PUT /identity/v3/projects/f764025ac7bd4e81995dde9a5185bd80/users/8579769774234e2088cb6e6fbe8fcc03/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:55:05.855416 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8470a23-79c8-40be-94c0-2ee4ef4213a5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:05.855915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8470a23-79c8-40be-94c0-2ee4ef4213a5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:05.856360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8470a23-79c8-40be-94c0-2ee4ef4213a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:05.881961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b8470a23-79c8-40be-94c0-2ee4ef4213a5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:05.883659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b8470a23-79c8-40be-94c0-2ee4ef4213a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:05.977772 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4251/8468] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:55:06.020351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dce180-2c03-4cc5-9486-cba39f3e73ff admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:06.024566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-08dce180-2c03-4cc5-9486-cba39f3e73ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:06.112107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dce180-2c03-4cc5-9486-cba39f3e73ff admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:06.117344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d47d1-3037-4968-bc0c-65c443181887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:06.118702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d47d1-3037-4968-bc0c-65c443181887 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:06.118996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d47d1-3037-4968-bc0c-65c443181887 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:06.119267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d47d1-3037-4968-bc0c-65c443181887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:06.132681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d47d1-3037-4968-bc0c-65c443181887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:06.134674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d47d1-3037-4968-bc0c-65c443181887 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:06.147026 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4218/8469] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:55:14.882928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853ebc-8ead-4dac-ada2-5f45bdf24a14 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:14.883513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853ebc-8ead-4dac-ada2-5f45bdf24a14 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:14.883513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853ebc-8ead-4dac-ada2-5f45bdf24a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:14.952643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-22853ebc-8ead-4dac-ada2-5f45bdf24a14 None None] MFA Rules not processed for user `5b5f08760bb949f0a8acbc3a0e44a6af`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:14.965842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-22853ebc-8ead-4dac-ada2-5f45bdf24a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:15.123702 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4252/8470] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:55:15.391474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5befd87-f4f2-4753-88c6-509246edee05 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:15.393081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5befd87-f4f2-4753-88c6-509246edee05 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:15.393518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5befd87-f4f2-4753-88c6-509246edee05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:15.476501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c5befd87-f4f2-4753-88c6-509246edee05 None None] MFA Rules not processed for user `8579769774234e2088cb6e6fbe8fcc03`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:15.478028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c5befd87-f4f2-4753-88c6-509246edee05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:15.660406 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4219/8471] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:55:15.666415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22853ebc-8ead-4dac-ada2-5f45bdf24a14 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:15.694387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22853ebc-8ead-4dac-ada2-5f45bdf24a14 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:15.710564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598678ec-4b03-4ba7-a4a0-3a41b15cb81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:15.711224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598678ec-4b03-4ba7-a4a0-3a41b15cb81b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:15.711505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598678ec-4b03-4ba7-a4a0-3a41b15cb81b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:15.711776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598678ec-4b03-4ba7-a4a0-3a41b15cb81b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:15.712429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598678ec-4b03-4ba7-a4a0-3a41b15cb81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:15.718861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598678ec-4b03-4ba7-a4a0-3a41b15cb81b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:15.785696 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4253/8472] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:55:15 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:55:15.786734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5befd87-f4f2-4753-88c6-509246edee05 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:15.807656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5befd87-f4f2-4753-88c6-509246edee05 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:15.912200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e6796-9b4f-4ce7-a2f8-6e0abc3b4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:15.913021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e6796-9b4f-4ce7-a2f8-6e0abc3b4804 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:15.913783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e6796-9b4f-4ce7-a2f8-6e0abc3b4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:15.914342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e6796-9b4f-4ce7-a2f8-6e0abc3b4804 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:15.915098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e6796-9b4f-4ce7-a2f8-6e0abc3b4804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:15.917549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e6796-9b4f-4ce7-a2f8-6e0abc3b4804 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:15.951487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:15.968895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598678ec-4b03-4ba7-a4a0-3a41b15cb81b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:15.977340 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4220/8473] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:55:15 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:55:15.982827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598678ec-4b03-4ba7-a4a0-3a41b15cb81b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:15.990379 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97673d76-ff80-4d26-8be8-0abcdec71578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:15.991739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97673d76-ff80-4d26-8be8-0abcdec71578 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:15.992146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97673d76-ff80-4d26-8be8-0abcdec71578 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:15.992552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97673d76-ff80-4d26-8be8-0abcdec71578 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:15.993323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97673d76-ff80-4d26-8be8-0abcdec71578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:15.995777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97673d76-ff80-4d26-8be8-0abcdec71578 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:16.015106 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4254/8474] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:55:16.020716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e6796-9b4f-4ce7-a2f8-6e0abc3b4804 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:16.033618 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e6796-9b4f-4ce7-a2f8-6e0abc3b4804 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:16.042945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17901192-007c-4905-a910-6864f9483474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:16.045359 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17901192-007c-4905-a910-6864f9483474 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:16.046158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17901192-007c-4905-a910-6864f9483474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:16.046158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17901192-007c-4905-a910-6864f9483474 admin admin] PATH_INFO: `/v3/projects/5737b651cf954ed0ac000687ca89863a/users/5f0f2442740a4e0dabee53938c6fc760/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:16.070562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17901192-007c-4905-a910-6864f9483474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5737b651cf954ed0ac000687ca89863a, user_id=5f0f2442740a4e0dabee53938c6fc760, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:16.073775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17901192-007c-4905-a910-6864f9483474 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:16.101557 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4221/8475] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:55:16 2022] PUT /identity/v3/projects/5737b651cf954ed0ac000687ca89863a/users/5f0f2442740a4e0dabee53938c6fc760/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:16.106026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97673d76-ff80-4d26-8be8-0abcdec71578 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:16.127290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97673d76-ff80-4d26-8be8-0abcdec71578 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:16.258746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:16.296185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b6714-43cc-4e9d-9dc0-b59f4c54da8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:16.298231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b6714-43cc-4e9d-9dc0-b59f4c54da8a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:16.298875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b6714-43cc-4e9d-9dc0-b59f4c54da8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:16.299415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b6714-43cc-4e9d-9dc0-b59f4c54da8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:16.300296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b6714-43cc-4e9d-9dc0-b59f4c54da8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:16.302435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b6714-43cc-4e9d-9dc0-b59f4c54da8a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:16.318962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17901192-007c-4905-a910-6864f9483474 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:16.320512 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4255/8476] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:55:16.332929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17901192-007c-4905-a910-6864f9483474 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:16.340606 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3437b-fc21-468d-938e-eab9b1531542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:16.341684 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3437b-fc21-468d-938e-eab9b1531542 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:16.342819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3437b-fc21-468d-938e-eab9b1531542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:16.343455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3437b-fc21-468d-938e-eab9b1531542 admin admin] PATH_INFO: `/v3/projects/5737b651cf954ed0ac000687ca89863a/users/5f0f2442740a4e0dabee53938c6fc760/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:16.345824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3437b-fc21-468d-938e-eab9b1531542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5737b651cf954ed0ac000687ca89863a, user_id=5f0f2442740a4e0dabee53938c6fc760, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:16.349220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3437b-fc21-468d-938e-eab9b1531542 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:16.369330 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4222/8477] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:55:16 2022] PUT /identity/v3/projects/5737b651cf954ed0ac000687ca89863a/users/5f0f2442740a4e0dabee53938c6fc760/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:24.055408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b6714-43cc-4e9d-9dc0-b59f4c54da8a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:24.057313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-257b6714-43cc-4e9d-9dc0-b59f4c54da8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:24.243860 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b6714-43cc-4e9d-9dc0-b59f4c54da8a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:24.470683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac7776-dce8-4233-8e7a-9ba639c9b44c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:24.471958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7776-dce8-4233-8e7a-9ba639c9b44c service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:24.472473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7776-dce8-4233-8e7a-9ba639c9b44c service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:24.472900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac7776-dce8-4233-8e7a-9ba639c9b44c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:24.480422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-04ac7776-dce8-4233-8e7a-9ba639c9b44c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:24.514127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac7776-dce8-4233-8e7a-9ba639c9b44c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:24.516051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac7776-dce8-4233-8e7a-9ba639c9b44c service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:24.545973 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4256/8478] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:55:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:55:26.359712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=16,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:26.428112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12b09e-c674-41e4-8a78-9bae65f413be None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:26.428455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12b09e-c674-41e4-8a78-9bae65f413be None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:26.428834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12b09e-c674-41e4-8a78-9bae65f413be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:26.495046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9d12b09e-c674-41e4-8a78-9bae65f413be None None] MFA Rules not processed for user `5f0f2442740a4e0dabee53938c6fc760`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:26.496355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9d12b09e-c674-41e4-8a78-9bae65f413be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:26.637777 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4223/8479] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:55:26.648901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac7776-dce8-4233-8e7a-9ba639c9b44c service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:26.650927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-04ac7776-dce8-4233-8e7a-9ba639c9b44c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:26.805793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac7776-dce8-4233-8e7a-9ba639c9b44c service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:26.820687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb10893-47e3-4b97-862c-c43fb12ae70b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:26.859025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb10893-47e3-4b97-862c-c43fb12ae70b service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:26.859308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb10893-47e3-4b97-862c-c43fb12ae70b service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:26.859579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb10893-47e3-4b97-862c-c43fb12ae70b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:26.884641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:27.008107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb10893-47e3-4b97-862c-c43fb12ae70b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:27.010431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb10893-47e3-4b97-862c-c43fb12ae70b service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:27.084890 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4257/8480] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:55:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:55:36.628102 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=34 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:37.069090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=17 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:43.186390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12b09e-c674-41e4-8a78-9bae65f413be None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:43.188472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9d12b09e-c674-41e4-8a78-9bae65f413be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:43.354872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12b09e-c674-41e4-8a78-9bae65f413be None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:43.365518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f62de-4fd6-4ba9-a9e9-d2d87889f4e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:43.366531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f62de-4fd6-4ba9-a9e9-d2d87889f4e6 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:43.366959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f62de-4fd6-4ba9-a9e9-d2d87889f4e6 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:43.367392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f62de-4fd6-4ba9-a9e9-d2d87889f4e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:43.392744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-719f62de-4fd6-4ba9-a9e9-d2d87889f4e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:43.459434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f62de-4fd6-4ba9-a9e9-d2d87889f4e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:43.463572 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f62de-4fd6-4ba9-a9e9-d2d87889f4e6 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:43.502021 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4224/8481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:55:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:55:53.481806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=32 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:56.978903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb10893-47e3-4b97-862c-c43fb12ae70b service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:56.980991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0cb10893-47e3-4b97-862c-c43fb12ae70b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:57.071373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb10893-47e3-4b97-862c-c43fb12ae70b service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:57.087161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:57.089018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.091463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.091761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] PATH_INFO: `/v3/users/5b5f08760bb949f0a8acbc3a0e44a6af` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.099183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b5f08760bb949f0a8acbc3a0e44a6af)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:57.103822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:57.203575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b5f08760bb949f0a8acbc3a0e44a6af'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:57.204817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b5f08760bb949f0a8acbc3a0e44a6af'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:57.243419 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b5f08760bb949f0a8acbc3a0e44a6af'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:57.268657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b5f08760bb949f0a8acbc3a0e44a6af'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:57.290594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b5f08760bb949f0a8acbc3a0e44a6af'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:57.304991 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4258/8482] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:55:56 2022] DELETE /identity/v3/users/5b5f08760bb949f0a8acbc3a0e44a6af => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:57.310152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5adf6-fb9c-455b-9b0a-6e3e36c1f942 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.311288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5adf6-fb9c-455b-9b0a-6e3e36c1f942 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.311705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5adf6-fb9c-455b-9b0a-6e3e36c1f942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.358249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bbe5adf6-fb9c-455b-9b0a-6e3e36c1f942 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:55:57.360680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bbe5adf6-fb9c-455b-9b0a-6e3e36c1f942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:57.489205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4225/8483] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:55:57.499183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:57.500866 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:57.625537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90b220-1a6f-4d9d-b6e8-f65ca5b377dc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:57.628237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fdf00-da65-4e08-8d20-f6234428bbe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:57.628882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fdf00-da65-4e08-8d20-f6234428bbe5 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.629163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fdf00-da65-4e08-8d20-f6234428bbe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.629433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fdf00-da65-4e08-8d20-f6234428bbe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.640992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fdf00-da65-4e08-8d20-f6234428bbe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:57.643034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fdf00-da65-4e08-8d20-f6234428bbe5 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:57.656708 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4259/8484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:55:57.940551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5adf6-fb9c-455b-9b0a-6e3e36c1f942 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:57.942025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bbe5adf6-fb9c-455b-9b0a-6e3e36c1f942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:57.964957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5adf6-fb9c-455b-9b0a-6e3e36c1f942 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:57.976451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:57.977986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:57.978322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:57.978798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] PATH_INFO: `/v3/projects/1c61369ef2154c59b69412f259273919` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:57.981064 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c61369ef2154c59b69412f259273919)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:57.983251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:58.070626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c61369ef2154c59b69412f259273919', 'request_id': 'req-593e1ebd-6b5e-4247-9e01-7f01c2557994'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:58.081997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c61369ef2154c59b69412f259273919', 'request_id': 'req-593e1ebd-6b5e-4247-9e01-7f01c2557994'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:58.094352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c61369ef2154c59b69412f259273919', 'request_id': 'req-593e1ebd-6b5e-4247-9e01-7f01c2557994'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:58.114353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] The token cache is being invalidate because project 1c61369ef2154c59b69412f259273919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:55:58.114761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:58.115505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:58.117645 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4226/8485] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:55:57 2022] DELETE /identity/v3/projects/1c61369ef2154c59b69412f259273919 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:58.121977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fdf00-da65-4e08-8d20-f6234428bbe5 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:58.156965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fdf00-da65-4e08-8d20-f6234428bbe5 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:58.198041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:58.331541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:58.332204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:58.332485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:58.332903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] PATH_INFO: `/v3/users/d3ca68dd72bc4d4e97446d7b60b06ce4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:58.334088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ca68dd72bc4d4e97446d7b60b06ce4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:58.337114 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:58.433169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ca68dd72bc4d4e97446d7b60b06ce4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:58.434500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ca68dd72bc4d4e97446d7b60b06ce4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:58.460033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ca68dd72bc4d4e97446d7b60b06ce4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:58.476693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ca68dd72bc4d4e97446d7b60b06ce4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:58.506624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ca68dd72bc4d4e97446d7b60b06ce4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:58.521247 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4260/8486] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:55:58 2022] DELETE /identity/v3/users/d3ca68dd72bc4d4e97446d7b60b06ce4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:58.957549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:58.960287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:58.980582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e1ebd-6b5e-4247-9e01-7f01c2557994 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.071370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.072211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.072577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.072950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] PATH_INFO: `/v3/projects/a39b2d87ffe5429995b623e8a9c39b2b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.074651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39b2d87ffe5429995b623e8a9c39b2b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.077191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:59.129671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.164556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39b2d87ffe5429995b623e8a9c39b2b', 'request_id': 'req-37c7cf07-1764-4151-b40b-738d93df69c0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:59.180028 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39b2d87ffe5429995b623e8a9c39b2b', 'request_id': 'req-37c7cf07-1764-4151-b40b-738d93df69c0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:59.188779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39b2d87ffe5429995b623e8a9c39b2b', 'request_id': 'req-37c7cf07-1764-4151-b40b-738d93df69c0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:59.208699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] The token cache is being invalidate because project a39b2d87ffe5429995b623e8a9c39b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:55:59.209283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:59.210050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:59.214825 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4227/8487] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:55:58 2022] DELETE /identity/v3/projects/a39b2d87ffe5429995b623e8a9c39b2b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:55:59.215877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.217511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:59.244049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6e27d-b54c-4c25-82f4-e1d7c61a8adc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.353977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.354946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.356088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.356372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] PATH_INFO: `/v3/users/3e5534a92df84c2b941c90a2223384f7` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.358667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5534a92df84c2b941c90a2223384f7)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.360998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:55:59.434557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.441342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5534a92df84c2b941c90a2223384f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:59.442273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5534a92df84c2b941c90a2223384f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:59.450124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5534a92df84c2b941c90a2223384f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:59.460460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5534a92df84c2b941c90a2223384f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:59.477033 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5534a92df84c2b941c90a2223384f7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:55:59.492417 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4261/8488] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:55:59 2022] DELETE /identity/v3/users/3e5534a92df84c2b941c90a2223384f7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:55:59.858369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:55:59.860672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:55:59.874597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7cf07-1764-4151-b40b-738d93df69c0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:55:59.972016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:55:59.974675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:55:59.975122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:55:59.975781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] PATH_INFO: `/v3/projects/c4893255555648b2bf1102255e21b6c8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:55:59.977454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4893255555648b2bf1102255e21b6c8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:55:59.979580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:00.066139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4893255555648b2bf1102255e21b6c8', 'request_id': 'req-912d9b81-9955-4e13-834e-79b9f7d3dfa5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:00.084262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4893255555648b2bf1102255e21b6c8', 'request_id': 'req-912d9b81-9955-4e13-834e-79b9f7d3dfa5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:00.096512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4893255555648b2bf1102255e21b6c8', 'request_id': 'req-912d9b81-9955-4e13-834e-79b9f7d3dfa5'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:00.120366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] The token cache is being invalidate because project c4893255555648b2bf1102255e21b6c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:56:00.121556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:00.123090 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-912d9b81-9955-4e13-834e-79b9f7d3dfa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:00.128715 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4228/8489] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:55:59 2022] DELETE /identity/v3/projects/c4893255555648b2bf1102255e21b6c8 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:02.824119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:02.826557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:02.843461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cfd4ee-f005-443a-9dbd-1e51786622a9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:02.931868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:02.932514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:02.932790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:02.933057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] PATH_INFO: `/v3/users/7cc9a14732c94c9abee5821469c68bb2` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:02.934660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc9a14732c94c9abee5821469c68bb2)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:02.936874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:03.014239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc9a14732c94c9abee5821469c68bb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:03.014902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc9a14732c94c9abee5821469c68bb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:03.023792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc9a14732c94c9abee5821469c68bb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:03.036007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc9a14732c94c9abee5821469c68bb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:03.057105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc9a14732c94c9abee5821469c68bb2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:03.070614 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4262/8490] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:56:02 2022] DELETE /identity/v3/users/7cc9a14732c94c9abee5821469c68bb2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:03.072048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee4103-3844-44dd-a40b-3fad34127fd1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.072501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee4103-3844-44dd-a40b-3fad34127fd1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.072593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee4103-3844-44dd-a40b-3fad34127fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.121363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-dfee4103-3844-44dd-a40b-3fad34127fd1 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:03.123051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dfee4103-3844-44dd-a40b-3fad34127fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:03.212881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:03.253423 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4229/8491] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:03.260221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:03.262597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:03.335354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:03.355848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbec26-5ebb-4393-bccf-036c36a65881 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:03.369362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1147a1-fe4a-4c3e-a9f7-d54b43590b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:03.370637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1147a1-fe4a-4c3e-a9f7-d54b43590b33 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.370907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1147a1-fe4a-4c3e-a9f7-d54b43590b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.371279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1147a1-fe4a-4c3e-a9f7-d54b43590b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.389984 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1147a1-fe4a-4c3e-a9f7-d54b43590b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:03.392523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1147a1-fe4a-4c3e-a9f7-d54b43590b33 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:03.406494 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4263/8492] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:56:03.702487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee4103-3844-44dd-a40b-3fad34127fd1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:03.704519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dfee4103-3844-44dd-a40b-3fad34127fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:03.814423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee4103-3844-44dd-a40b-3fad34127fd1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:03.823621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cccac-29e8-4108-a3d6-c86e19c43943 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:03.825907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cccac-29e8-4108-a3d6-c86e19c43943 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.825907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cccac-29e8-4108-a3d6-c86e19c43943 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.825907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cccac-29e8-4108-a3d6-c86e19c43943 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.830087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6c7cccac-29e8-4108-a3d6-c86e19c43943 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:03.893254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1147a1-fe4a-4c3e-a9f7-d54b43590b33 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:03.895050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7a1147a1-fe4a-4c3e-a9f7-d54b43590b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:03.917511 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1147a1-fe4a-4c3e-a9f7-d54b43590b33 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:03.924688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:03.925531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:03.926131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:03.926587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] PATH_INFO: `/v3/projects/4c8711d1fa3844308bc9a805ec56931a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:03.927847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8711d1fa3844308bc9a805ec56931a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:03.930767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:03.955895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cccac-29e8-4108-a3d6-c86e19c43943 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:03.957935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cccac-29e8-4108-a3d6-c86e19c43943 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:03.968327 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4230/8493] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:56:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:56:03.999939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8711d1fa3844308bc9a805ec56931a', 'request_id': 'req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:04.008546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8711d1fa3844308bc9a805ec56931a', 'request_id': 'req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:04.019331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8711d1fa3844308bc9a805ec56931a', 'request_id': 'req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:04.039500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] The token cache is being invalidate because project 4c8711d1fa3844308bc9a805ec56931a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:56:04.039795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:04.040548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:04.043169 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4264/8494] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:56:03 2022] DELETE /identity/v3/projects/4c8711d1fa3844308bc9a805ec56931a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:04.047296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cccac-29e8-4108-a3d6-c86e19c43943 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:04.065783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cccac-29e8-4108-a3d6-c86e19c43943 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:04.176128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:04.177361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.177720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.178085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] PATH_INFO: `/v3/users/d373fe959ff54aad910eb75343332378` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.179751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d373fe959ff54aad910eb75343332378)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:04.182337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:04.236469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:04.266836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd373fe959ff54aad910eb75343332378'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:04.277919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd373fe959ff54aad910eb75343332378'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:04.306501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd373fe959ff54aad910eb75343332378'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:04.320879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd373fe959ff54aad910eb75343332378'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:04.321999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-d882d717-6d06-4855-8b79-ee54e0cb266d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd373fe959ff54aad910eb75343332378'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:04.336093 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4231/8495] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:56:04 2022] DELETE /identity/v3/users/d373fe959ff54aad910eb75343332378 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:56:04.774645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:04.776126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:04.804391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b8111-ee3f-4f01-a8d8-67394c58bfe4 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:04.936335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:04.937040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:04.937280 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:04.937630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] PATH_INFO: `/v3/projects/1555634a43554416829655e8d575534c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:04.939611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1555634a43554416829655e8d575534c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:04.941733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.005717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1555634a43554416829655e8d575534c', 'request_id': 'req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:05.014777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1555634a43554416829655e8d575534c', 'request_id': 'req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:05.025063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1555634a43554416829655e8d575534c', 'request_id': 'req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:05.035733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:05.043907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] The token cache is being invalidate because project 1555634a43554416829655e8d575534c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:56:05.044734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:05.045859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-adfc3b64-bbb5-4e69-9cf5-0e67c5f317fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:05.051141 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4265/8496] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:56:04 2022] DELETE /identity/v3/projects/1555634a43554416829655e8d575534c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:05.052873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4f440-f179-4772-be60-c8bfa676e8ce None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.053159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4f440-f179-4772-be60-c8bfa676e8ce None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.053432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4f440-f179-4772-be60-c8bfa676e8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.082098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-25d4f440-f179-4772-be60-c8bfa676e8ce None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:05.084245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-25d4f440-f179-4772-be60-c8bfa676e8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:05.167562 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4232/8497] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:05.176922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1155d-80a3-41e8-a916-a0b7a708c84f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.177329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1155d-80a3-41e8-a916-a0b7a708c84f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.177698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1155d-80a3-41e8-a916-a0b7a708c84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.208080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-13e1155d-80a3-41e8-a916-a0b7a708c84f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:05.209716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-13e1155d-80a3-41e8-a916-a0b7a708c84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:05.231005 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4266/8498] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:56:05.232335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4f440-f179-4772-be60-c8bfa676e8ce None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.245865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4f440-f179-4772-be60-c8bfa676e8ce None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.254267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77fae7-4502-4acc-8db8-bf694dc702e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.255472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77fae7-4502-4acc-8db8-bf694dc702e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.255847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77fae7-4502-4acc-8db8-bf694dc702e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.256214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77fae7-4502-4acc-8db8-bf694dc702e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.256986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77fae7-4502-4acc-8db8-bf694dc702e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:05.257691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77fae7-4502-4acc-8db8-bf694dc702e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.259663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77fae7-4502-4acc-8db8-bf694dc702e5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.277921 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4233/8499] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:05.282447 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1155d-80a3-41e8-a916-a0b7a708c84f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.293979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1155d-80a3-41e8-a916-a0b7a708c84f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.299910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74f467-dc21-4993-9645-c838d7f0b40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.300536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74f467-dc21-4993-9645-c838d7f0b40b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.300871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74f467-dc21-4993-9645-c838d7f0b40b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.301142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74f467-dc21-4993-9645-c838d7f0b40b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.301798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74f467-dc21-4993-9645-c838d7f0b40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.304174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74f467-dc21-4993-9645-c838d7f0b40b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.341627 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4267/8500] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:56:05 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:56:05.342749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77fae7-4502-4acc-8db8-bf694dc702e5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.355135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77fae7-4502-4acc-8db8-bf694dc702e5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.433496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7e4a5-c527-40af-8841-a8eb87e0f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.434317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7e4a5-c527-40af-8841-a8eb87e0f37c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.434753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7e4a5-c527-40af-8841-a8eb87e0f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.435181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7e4a5-c527-40af-8841-a8eb87e0f37c admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.436020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7e4a5-c527-40af-8841-a8eb87e0f37c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.439597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7e4a5-c527-40af-8841-a8eb87e0f37c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.479974 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4234/8501] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:56:05 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:05.484146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74f467-dc21-4993-9645-c838d7f0b40b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.505796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74f467-dc21-4993-9645-c838d7f0b40b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.511973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cb0fc-5310-4b32-b232-4d4efb04a3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.512725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cb0fc-5310-4b32-b232-4d4efb04a3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.513100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cb0fc-5310-4b32-b232-4d4efb04a3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.513468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068cb0fc-5310-4b32-b232-4d4efb04a3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.514398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cb0fc-5310-4b32-b232-4d4efb04a3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.517138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068cb0fc-5310-4b32-b232-4d4efb04a3a2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.530075 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4268/8502] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:05.534914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7e4a5-c527-40af-8841-a8eb87e0f37c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.553520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7e4a5-c527-40af-8841-a8eb87e0f37c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.559051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51fa18-b6f2-4155-9f93-3a3a38db5cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.559920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51fa18-b6f2-4155-9f93-3a3a38db5cdb admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.560355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51fa18-b6f2-4155-9f93-3a3a38db5cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.560832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51fa18-b6f2-4155-9f93-3a3a38db5cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.561656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51fa18-b6f2-4155-9f93-3a3a38db5cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.564929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51fa18-b6f2-4155-9f93-3a3a38db5cdb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.581935 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4235/8503] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:05.586181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cb0fc-5310-4b32-b232-4d4efb04a3a2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.596740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068cb0fc-5310-4b32-b232-4d4efb04a3a2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.603267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1c510-f610-4936-83eb-9c039fd7c17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.604136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1c510-f610-4936-83eb-9c039fd7c17a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.604561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1c510-f610-4936-83eb-9c039fd7c17a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.604987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1c510-f610-4936-83eb-9c039fd7c17a admin admin] PATH_INFO: `/v3/projects/2a02282370cc4661be112c4c65b4dc4d/users/7687aa04957447c0ac5a082d19417bae/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.630196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1c510-f610-4936-83eb-9c039fd7c17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a02282370cc4661be112c4c65b4dc4d, user_id=7687aa04957447c0ac5a082d19417bae, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.633297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1c510-f610-4936-83eb-9c039fd7c17a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.659966 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4269/8504] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:56:05 2022] PUT /identity/v3/projects/2a02282370cc4661be112c4c65b4dc4d/users/7687aa04957447c0ac5a082d19417bae/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:05.670464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497ee96-2689-42bb-9a44-83e0da87321d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.670745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497ee96-2689-42bb-9a44-83e0da87321d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.671013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497ee96-2689-42bb-9a44-83e0da87321d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.702480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:05.713283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6497ee96-2689-42bb-9a44-83e0da87321d None None] MFA Rules not processed for user `7687aa04957447c0ac5a082d19417bae`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:05.715434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6497ee96-2689-42bb-9a44-83e0da87321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:05.809498 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4236/8505] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:05.818341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1c510-f610-4936-83eb-9c039fd7c17a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:05.820159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-54a1c510-f610-4936-83eb-9c039fd7c17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:05.889331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1c510-f610-4936-83eb-9c039fd7c17a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:05.895999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298280c-12cd-4801-b2ef-9c1cdd99e0d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:05.896792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298280c-12cd-4801-b2ef-9c1cdd99e0d4 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:05.897204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298280c-12cd-4801-b2ef-9c1cdd99e0d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:05.897476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298280c-12cd-4801-b2ef-9c1cdd99e0d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:05.917400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298280c-12cd-4801-b2ef-9c1cdd99e0d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:05.918975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c298280c-12cd-4801-b2ef-9c1cdd99e0d4 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:05.939510 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4270/8506] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:56:15.802312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=27 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:15.924742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:16.147485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497ee96-2689-42bb-9a44-83e0da87321d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:16.278155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497ee96-2689-42bb-9a44-83e0da87321d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:16.288873 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:16.291027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.291698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.292126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] PATH_INFO: `/v3/users/7687aa04957447c0ac5a082d19417bae` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.293848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7687aa04957447c0ac5a082d19417bae)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:16.296216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:16.307720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d4745-1555-4bae-a123-099bcd178a7f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.310506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d4745-1555-4bae-a123-099bcd178a7f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.310506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d4745-1555-4bae-a123-099bcd178a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.331376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e43d4745-1555-4bae-a123-099bcd178a7f None None] MFA Rules not processed for user `a9ef01029e264fbca52310cfe3edfb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:16.333706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e43d4745-1555-4bae-a123-099bcd178a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:16.382900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7687aa04957447c0ac5a082d19417bae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:16.394211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7687aa04957447c0ac5a082d19417bae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:16.409386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7687aa04957447c0ac5a082d19417bae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:16.421131 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4271/8507] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:56:16.437152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7687aa04957447c0ac5a082d19417bae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:16.438603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7687aa04957447c0ac5a082d19417bae'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:16.450873 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4237/8508] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:56:16 2022] DELETE /identity/v3/users/7687aa04957447c0ac5a082d19417bae => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:16.455818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90227487-c915-40f7-bc12-70c05aeb103f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.456445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90227487-c915-40f7-bc12-70c05aeb103f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.456920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90227487-c915-40f7-bc12-70c05aeb103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.499490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-90227487-c915-40f7-bc12-70c05aeb103f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:16.499490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-90227487-c915-40f7-bc12-70c05aeb103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:16.595054 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4272/8509] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:16.608353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:16.610314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:16.719177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac39fa-d900-46dd-ad0d-6db2146c0b43 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:16.727066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b3ae0-526c-4e2b-8658-b9367d960e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:16.727718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b3ae0-526c-4e2b-8658-b9367d960e33 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:16.728741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b3ae0-526c-4e2b-8658-b9367d960e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:16.729029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b3ae0-526c-4e2b-8658-b9367d960e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:16.748561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b3ae0-526c-4e2b-8658-b9367d960e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:16.750677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b3ae0-526c-4e2b-8658-b9367d960e33 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:16.770682 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4238/8510] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:56:17.235942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90227487-c915-40f7-bc12-70c05aeb103f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.238424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-90227487-c915-40f7-bc12-70c05aeb103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:17.256146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90227487-c915-40f7-bc12-70c05aeb103f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.262627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.264406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.264907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.265395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] PATH_INFO: `/v3/projects/2a02282370cc4661be112c4c65b4dc4d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.268212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a02282370cc4661be112c4c65b4dc4d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.271400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.331391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a02282370cc4661be112c4c65b4dc4d', 'request_id': 'req-a97c993d-4d42-4c15-8404-4aa034d224b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:17.337895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a02282370cc4661be112c4c65b4dc4d', 'request_id': 'req-a97c993d-4d42-4c15-8404-4aa034d224b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:17.347189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a02282370cc4661be112c4c65b4dc4d', 'request_id': 'req-a97c993d-4d42-4c15-8404-4aa034d224b7'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:17.358520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] The token cache is being invalidate because project 2a02282370cc4661be112c4c65b4dc4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:56:17.359074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:17.360101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a97c993d-4d42-4c15-8404-4aa034d224b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:17.366563 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4273/8511] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:56:17 2022] DELETE /identity/v3/projects/2a02282370cc4661be112c4c65b4dc4d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:17.372927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e8ab6-2131-4361-8072-4e1920b0604b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.373605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e8ab6-2131-4361-8072-4e1920b0604b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.373605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e8ab6-2131-4361-8072-4e1920b0604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.397614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8b7e8ab6-2131-4361-8072-4e1920b0604b None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:17.399167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8b7e8ab6-2131-4361-8072-4e1920b0604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:17.433283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:17.485918 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4239/8512] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:17.495047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2e0c-1cb9-428d-bb72-51b79304d979 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.495389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2e0c-1cb9-428d-bb72-51b79304d979 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.495796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd2e0c-1cb9-428d-bb72-51b79304d979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.519692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-21dd2e0c-1cb9-428d-bb72-51b79304d979 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:17.521204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-21dd2e0c-1cb9-428d-bb72-51b79304d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:17.536996 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4274/8513] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:17.540996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e8ab6-2131-4361-8072-4e1920b0604b None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.556543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e8ab6-2131-4361-8072-4e1920b0604b None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.561570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd095e8-3c90-44d8-8e0f-2af24200dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.562395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd095e8-3c90-44d8-8e0f-2af24200dfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.562657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd095e8-3c90-44d8-8e0f-2af24200dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.563885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd095e8-3c90-44d8-8e0f-2af24200dfa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.564781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd095e8-3c90-44d8-8e0f-2af24200dfa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:17.565243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd095e8-3c90-44d8-8e0f-2af24200dfa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.567154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd095e8-3c90-44d8-8e0f-2af24200dfa1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.587171 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4240/8514] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:17.592018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2e0c-1cb9-428d-bb72-51b79304d979 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.608032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd2e0c-1cb9-428d-bb72-51b79304d979 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.616713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d9786-443c-44e5-a471-ba57b07e6e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.617373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d9786-443c-44e5-a471-ba57b07e6e5a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.617652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d9786-443c-44e5-a471-ba57b07e6e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.618193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d9786-443c-44e5-a471-ba57b07e6e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.618910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d9786-443c-44e5-a471-ba57b07e6e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.620920 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d9786-443c-44e5-a471-ba57b07e6e5a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.660543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:17.679810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd095e8-3c90-44d8-8e0f-2af24200dfa1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.691689 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4275/8515] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:56:17 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:17.694588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd095e8-3c90-44d8-8e0f-2af24200dfa1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.785241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07428e74-59b7-4e14-a365-921d2c043b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.786234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07428e74-59b7-4e14-a365-921d2c043b37 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.786773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07428e74-59b7-4e14-a365-921d2c043b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.787202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07428e74-59b7-4e14-a365-921d2c043b37 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.788269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07428e74-59b7-4e14-a365-921d2c043b37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.791779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07428e74-59b7-4e14-a365-921d2c043b37 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.831574 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4241/8516] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:56:17 2022] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:17.835260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d9786-443c-44e5-a471-ba57b07e6e5a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.847482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d9786-443c-44e5-a471-ba57b07e6e5a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.855139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054f7b8-f9d7-4838-8653-ec054410d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.855874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054f7b8-f9d7-4838-8653-ec054410d22e admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.856224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054f7b8-f9d7-4838-8653-ec054410d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.856622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054f7b8-f9d7-4838-8653-ec054410d22e admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.857358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054f7b8-f9d7-4838-8653-ec054410d22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.859085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054f7b8-f9d7-4838-8653-ec054410d22e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.879128 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4276/8517] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:17.879266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07428e74-59b7-4e14-a365-921d2c043b37 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.892580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07428e74-59b7-4e14-a365-921d2c043b37 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.914496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ef1a3-b60e-46d1-847b-b0ba658248f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.915299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ef1a3-b60e-46d1-847b-b0ba658248f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.917463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ef1a3-b60e-46d1-847b-b0ba658248f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.917844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ef1a3-b60e-46d1-847b-b0ba658248f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.918530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ef1a3-b60e-46d1-847b-b0ba658248f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.920361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ef1a3-b60e-46d1-847b-b0ba658248f9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.935003 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4242/8518] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:17.938885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054f7b8-f9d7-4838-8653-ec054410d22e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:17.950020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054f7b8-f9d7-4838-8653-ec054410d22e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:17.956065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea045c2-3f04-4638-9fc2-852bc3045081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:17.956906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea045c2-3f04-4638-9fc2-852bc3045081 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:17.957217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea045c2-3f04-4638-9fc2-852bc3045081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:17.957565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea045c2-3f04-4638-9fc2-852bc3045081 admin admin] PATH_INFO: `/v3/projects/d034dea78fda4fe1b745368799c41431/users/916ab6c8e51d4b0e9121ea59a6482b89/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:17.975297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea045c2-3f04-4638-9fc2-852bc3045081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d034dea78fda4fe1b745368799c41431, user_id=916ab6c8e51d4b0e9121ea59a6482b89, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:17.978687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea045c2-3f04-4638-9fc2-852bc3045081 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:17.993929 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4277/8519] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:56:17 2022] PUT /identity/v3/projects/d034dea78fda4fe1b745368799c41431/users/916ab6c8e51d4b0e9121ea59a6482b89/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:18.005910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20a989-7a1a-4bbb-912f-64d0381dbe7e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.006144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20a989-7a1a-4bbb-912f-64d0381dbe7e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.006376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20a989-7a1a-4bbb-912f-64d0381dbe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.054517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1b20a989-7a1a-4bbb-912f-64d0381dbe7e None None] MFA Rules not processed for user `916ab6c8e51d4b0e9121ea59a6482b89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:18.055897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1b20a989-7a1a-4bbb-912f-64d0381dbe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:18.126017 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4243/8520] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:18.135921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea045c2-3f04-4638-9fc2-852bc3045081 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:18.137972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5ea045c2-3f04-4638-9fc2-852bc3045081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:18.211382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea045c2-3f04-4638-9fc2-852bc3045081 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:18.216805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ce9b1-872b-460b-a6dd-0f43bd34bc8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:18.217767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce9b1-872b-460b-a6dd-0f43bd34bc8f service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:18.218217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce9b1-872b-460b-a6dd-0f43bd34bc8f service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:18.218579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ce9b1-872b-460b-a6dd-0f43bd34bc8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:18.231889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ce9b1-872b-460b-a6dd-0f43bd34bc8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:18.233555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ce9b1-872b-460b-a6dd-0f43bd34bc8f service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:18.245631 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4278/8521] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:56:26.913328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20a989-7a1a-4bbb-912f-64d0381dbe7e None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:26.914984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1b20a989-7a1a-4bbb-912f-64d0381dbe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:26.993263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:27.097029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20a989-7a1a-4bbb-912f-64d0381dbe7e None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:27.106330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:27.106991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:27.107270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:27.107589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] PATH_INFO: `/v3/users/43e7e2b5fb2144dda9331bc7c6a77238` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:27.145196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e7e2b5fb2144dda9331bc7c6a77238)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:27.148116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:27.280900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e7e2b5fb2144dda9331bc7c6a77238'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:27.299076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e7e2b5fb2144dda9331bc7c6a77238'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:27.356793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e7e2b5fb2144dda9331bc7c6a77238'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:27.402991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e7e2b5fb2144dda9331bc7c6a77238'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:27.419679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e7e2b5fb2144dda9331bc7c6a77238'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:27.441463 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4244/8522] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:56:26 2022] DELETE /identity/v3/users/43e7e2b5fb2144dda9331bc7c6a77238 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:27.448611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6035b-1b48-447c-9b1e-6ab7bb1c5066 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:27.449165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6035b-1b48-447c-9b1e-6ab7bb1c5066 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:27.449165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6035b-1b48-447c-9b1e-6ab7bb1c5066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:27.488502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-96b6035b-1b48-447c-9b1e-6ab7bb1c5066 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:27.490102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-96b6035b-1b48-447c-9b1e-6ab7bb1c5066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:27.614516 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4279/8523] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:27.633760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:27.635667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:27.838772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e39d4b-3fa7-473a-a12b-6e0787d2a9f8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:27.854549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ab491-4f8a-41ae-b366-3b4b03b2e142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:27.855348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab491-4f8a-41ae-b366-3b4b03b2e142 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:27.855646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab491-4f8a-41ae-b366-3b4b03b2e142 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:27.855924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ab491-4f8a-41ae-b366-3b4b03b2e142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:27.873656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ab491-4f8a-41ae-b366-3b4b03b2e142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:27.876774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ab491-4f8a-41ae-b366-3b4b03b2e142 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:27.898122 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4245/8524] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:56:28.398957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6035b-1b48-447c-9b1e-6ab7bb1c5066 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:28.414565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-96b6035b-1b48-447c-9b1e-6ab7bb1c5066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:28.434894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6035b-1b48-447c-9b1e-6ab7bb1c5066 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:28.441196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:28.441847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.442155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.442535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] PATH_INFO: `/v3/projects/9608e1e491ba463bb7ea9ee8ceb819ba` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.474573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9608e1e491ba463bb7ea9ee8ceb819ba)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:28.481818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:28.573649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9608e1e491ba463bb7ea9ee8ceb819ba', 'request_id': 'req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:28.596121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9608e1e491ba463bb7ea9ee8ceb819ba', 'request_id': 'req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:28.600563 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:28.613541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9608e1e491ba463bb7ea9ee8ceb819ba', 'request_id': 'req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:28.663745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] The token cache is being invalidate because project 9608e1e491ba463bb7ea9ee8ceb819ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:56:28.664273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:28.664737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-db64f2d4-4fee-4fbe-aa4f-5bed68b1502c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:28.666519 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4280/8525] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:56:28 2022] DELETE /identity/v3/projects/9608e1e491ba463bb7ea9ee8ceb819ba => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:28.671728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45185bd-9c38-4076-b973-976e569792d5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.675135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45185bd-9c38-4076-b973-976e569792d5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.675135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45185bd-9c38-4076-b973-976e569792d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.708284 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a45185bd-9c38-4076-b973-976e569792d5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:28.717455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a45185bd-9c38-4076-b973-976e569792d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:28.767297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:28.856851 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4246/8526] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:28.868301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6cb3f-7f7a-4bda-9eaa-13a4fe3b9421 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.868301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6cb3f-7f7a-4bda-9eaa-13a4fe3b9421 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.868301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6cb3f-7f7a-4bda-9eaa-13a4fe3b9421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.914091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d4a6cb3f-7f7a-4bda-9eaa-13a4fe3b9421 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:28.915695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d4a6cb3f-7f7a-4bda-9eaa-13a4fe3b9421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:28.934269 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4281/8527] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:28.936641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45185bd-9c38-4076-b973-976e569792d5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:28.962888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45185bd-9c38-4076-b973-976e569792d5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:28.987366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374054a9-4c80-4e2a-9c7f-c0aeef204fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:28.988361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374054a9-4c80-4e2a-9c7f-c0aeef204fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:28.988656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374054a9-4c80-4e2a-9c7f-c0aeef204fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:28.989204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374054a9-4c80-4e2a-9c7f-c0aeef204fd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:28.990103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374054a9-4c80-4e2a-9c7f-c0aeef204fd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:28.990479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374054a9-4c80-4e2a-9c7f-c0aeef204fd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:28.992198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374054a9-4c80-4e2a-9c7f-c0aeef204fd5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.024637 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4247/8528] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:29.025801 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6cb3f-7f7a-4bda-9eaa-13a4fe3b9421 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.037075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6cb3f-7f7a-4bda-9eaa-13a4fe3b9421 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.044557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9924-c132-4b50-820e-ffcf2cf05e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.045542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9924-c132-4b50-820e-ffcf2cf05e79 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.045902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9924-c132-4b50-820e-ffcf2cf05e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.046198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f9924-c132-4b50-820e-ffcf2cf05e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.046993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f9924-c132-4b50-820e-ffcf2cf05e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.049094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f9924-c132-4b50-820e-ffcf2cf05e79 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.104611 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4282/8529] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:56:29 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:56:29.108831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374054a9-4c80-4e2a-9c7f-c0aeef204fd5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.120420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374054a9-4c80-4e2a-9c7f-c0aeef204fd5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.236197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe60df9-bdb9-4aa7-b2b8-ee69ab360d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.236814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe60df9-bdb9-4aa7-b2b8-ee69ab360d9a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.237089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe60df9-bdb9-4aa7-b2b8-ee69ab360d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.237350 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe60df9-bdb9-4aa7-b2b8-ee69ab360d9a admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.238037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe60df9-bdb9-4aa7-b2b8-ee69ab360d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.239952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe60df9-bdb9-4aa7-b2b8-ee69ab360d9a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.301642 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4248/8530] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:56:29 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:29.307247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9924-c132-4b50-820e-ffcf2cf05e79 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.330674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f9924-c132-4b50-820e-ffcf2cf05e79 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.342564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c70d3-57fb-47e9-bc1f-914094c9f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.343417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c70d3-57fb-47e9-bc1f-914094c9f093 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.344954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c70d3-57fb-47e9-bc1f-914094c9f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.345417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c70d3-57fb-47e9-bc1f-914094c9f093 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.350654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c70d3-57fb-47e9-bc1f-914094c9f093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.352279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c70d3-57fb-47e9-bc1f-914094c9f093 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.364599 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4283/8531] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:29.368901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe60df9-bdb9-4aa7-b2b8-ee69ab360d9a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.386625 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe60df9-bdb9-4aa7-b2b8-ee69ab360d9a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.408014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bc914-27af-49cf-b821-506f38d335f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.408959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bc914-27af-49cf-b821-506f38d335f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.409390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bc914-27af-49cf-b821-506f38d335f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.409817 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bc914-27af-49cf-b821-506f38d335f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.410650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bc914-27af-49cf-b821-506f38d335f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.412275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bc914-27af-49cf-b821-506f38d335f5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.430409 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4249/8532] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:29.434711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c70d3-57fb-47e9-bc1f-914094c9f093 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.460187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c70d3-57fb-47e9-bc1f-914094c9f093 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:29.479425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431b0e-b35e-499c-84b6-e4217a6a44b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:29.482243 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431b0e-b35e-499c-84b6-e4217a6a44b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.482546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431b0e-b35e-499c-84b6-e4217a6a44b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.482831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431b0e-b35e-499c-84b6-e4217a6a44b7 admin admin] PATH_INFO: `/v3/projects/a03df79c37ef4631b2346723f454d3f6/users/1bdd09f7e1b3432a88077a88e23e5ca9/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.547614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9431b0e-b35e-499c-84b6-e4217a6a44b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03df79c37ef4631b2346723f454d3f6, user_id=1bdd09f7e1b3432a88077a88e23e5ca9, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:29.555365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9431b0e-b35e-499c-84b6-e4217a6a44b7 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:29.583906 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4284/8533] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:56:29 2022] PUT /identity/v3/projects/a03df79c37ef4631b2346723f454d3f6/users/1bdd09f7e1b3432a88077a88e23e5ca9/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:29.594675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5e49-e97b-4b51-8bab-3d714758e093 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:29.594958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5e49-e97b-4b51-8bab-3d714758e093 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:29.595241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a5e49-e97b-4b51-8bab-3d714758e093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:29.671462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b34a5e49-e97b-4b51-8bab-3d714758e093 None None] MFA Rules not processed for user `1bdd09f7e1b3432a88077a88e23e5ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:29.673266 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b34a5e49-e97b-4b51-8bab-3d714758e093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:29.800910 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4250/8534] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:29.810404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431b0e-b35e-499c-84b6-e4217a6a44b7 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:29.812082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b9431b0e-b35e-499c-84b6-e4217a6a44b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:29.992811 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431b0e-b35e-499c-84b6-e4217a6a44b7 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:30.009825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03dea7d-4ad2-42dd-b21a-6a0d038f6946 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:30.012221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dea7d-4ad2-42dd-b21a-6a0d038f6946 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:30.013007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dea7d-4ad2-42dd-b21a-6a0d038f6946 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:30.014425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03dea7d-4ad2-42dd-b21a-6a0d038f6946 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:30.045852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dea7d-4ad2-42dd-b21a-6a0d038f6946 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:30.047553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03dea7d-4ad2-42dd-b21a-6a0d038f6946 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:30.068761 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4285/8535] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:56:39.789126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:40.057455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=57 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:41.358784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5e49-e97b-4b51-8bab-3d714758e093 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.360395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b34a5e49-e97b-4b51-8bab-3d714758e093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:41.448356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a5e49-e97b-4b51-8bab-3d714758e093 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.453079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.453819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.454129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.454398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] PATH_INFO: `/v3/users/916ab6c8e51d4b0e9121ea59a6482b89` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.455539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=916ab6c8e51d4b0e9121ea59a6482b89)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.457599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.529995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916ab6c8e51d4b0e9121ea59a6482b89'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:41.539221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916ab6c8e51d4b0e9121ea59a6482b89'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:41.556431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916ab6c8e51d4b0e9121ea59a6482b89'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:41.570797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916ab6c8e51d4b0e9121ea59a6482b89'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:41.572073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916ab6c8e51d4b0e9121ea59a6482b89'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:41.583539 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4251/8536] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:56:41 2022] DELETE /identity/v3/users/916ab6c8e51d4b0e9121ea59a6482b89 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:41.587843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24f00-6b25-4a50-a6eb-88e8aa8cee6e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.588348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24f00-6b25-4a50-a6eb-88e8aa8cee6e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.588444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d24f00-6b25-4a50-a6eb-88e8aa8cee6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.616593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f2d24f00-6b25-4a50-a6eb-88e8aa8cee6e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:41.618217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f2d24f00-6b25-4a50-a6eb-88e8aa8cee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:41.700441 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4286/8537] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:56:41.710643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:41.712574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:41.818886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189c843-d87c-4c0d-92b8-69147c421d3f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:41.823962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a7bd-2942-4850-a5d4-dbffa26eb553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:41.824961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a7bd-2942-4850-a5d4-dbffa26eb553 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:41.825477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a7bd-2942-4850-a5d4-dbffa26eb553 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:41.826228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a7bd-2942-4850-a5d4-dbffa26eb553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:41.840638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a7bd-2942-4850-a5d4-dbffa26eb553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:41.843457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a7bd-2942-4850-a5d4-dbffa26eb553 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:41.858055 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4252/8538] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:56:42.185179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d24f00-6b25-4a50-a6eb-88e8aa8cee6e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:42.187570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f2d24f00-6b25-4a50-a6eb-88e8aa8cee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:42.211154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d24f00-6b25-4a50-a6eb-88e8aa8cee6e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:42.218934 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:42.220245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.220580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.220939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] PATH_INFO: `/v3/projects/d034dea78fda4fe1b745368799c41431` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.224116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d034dea78fda4fe1b745368799c41431)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:42.224905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:42.283873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd034dea78fda4fe1b745368799c41431', 'request_id': 'req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:42.292727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd034dea78fda4fe1b745368799c41431', 'request_id': 'req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:42.305393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd034dea78fda4fe1b745368799c41431', 'request_id': 'req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:42.319872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] The token cache is being invalidate because project d034dea78fda4fe1b745368799c41431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:56:42.320218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:42.322123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0dc632b7-5b45-4f34-8c9c-30f4fdcb7a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:42.324319 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4287/8539] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:56:42 2022] DELETE /identity/v3/projects/d034dea78fda4fe1b745368799c41431 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:42.332799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb96dab-4a50-4737-9e9d-6c269d0ec6e6 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.333100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb96dab-4a50-4737-9e9d-6c269d0ec6e6 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.333354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb96dab-4a50-4737-9e9d-6c269d0ec6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.362938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-beb96dab-4a50-4737-9e9d-6c269d0ec6e6 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:42.364417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-beb96dab-4a50-4737-9e9d-6c269d0ec6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:42.384133 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:42.448288 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4253/8540] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:42.456246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf787f-bc6f-4d09-b8e2-4fdbb615f391 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.456527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf787f-bc6f-4d09-b8e2-4fdbb615f391 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.456796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf787f-bc6f-4d09-b8e2-4fdbb615f391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.486616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9adf787f-bc6f-4d09-b8e2-4fdbb615f391 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:42.487961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9adf787f-bc6f-4d09-b8e2-4fdbb615f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:42.497833 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4288/8541] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:42.502056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb96dab-4a50-4737-9e9d-6c269d0ec6e6 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:42.512718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb96dab-4a50-4737-9e9d-6c269d0ec6e6 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:42.518057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b660a-46c2-4894-9b56-1e6d55e372fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:42.518907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b660a-46c2-4894-9b56-1e6d55e372fd admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.519501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b660a-46c2-4894-9b56-1e6d55e372fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.519964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b660a-46c2-4894-9b56-1e6d55e372fd admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.520615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b660a-46c2-4894-9b56-1e6d55e372fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:42.520915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b660a-46c2-4894-9b56-1e6d55e372fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:42.523186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b660a-46c2-4894-9b56-1e6d55e372fd admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:42.541247 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4254/8542] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:56:42.545138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf787f-bc6f-4d09-b8e2-4fdbb615f391 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:42.556031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf787f-bc6f-4d09-b8e2-4fdbb615f391 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:42.560862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051445c-5fef-4de3-b15c-111f05ae828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:42.561549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051445c-5fef-4de3-b15c-111f05ae828a admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.561906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051445c-5fef-4de3-b15c-111f05ae828a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.562679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051445c-5fef-4de3-b15c-111f05ae828a admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.563390 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051445c-5fef-4de3-b15c-111f05ae828a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:42.565440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051445c-5fef-4de3-b15c-111f05ae828a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:42.601745 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4289/8543] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:56:42 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:42.606129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b660a-46c2-4894-9b56-1e6d55e372fd admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:42.617135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b660a-46c2-4894-9b56-1e6d55e372fd admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:42.681695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859f868-6420-4b47-9059-811cd71009c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:42.682366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859f868-6420-4b47-9059-811cd71009c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.682640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859f868-6420-4b47-9059-811cd71009c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.682906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859f868-6420-4b47-9059-811cd71009c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.683562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859f868-6420-4b47-9059-811cd71009c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:42.685501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2859f868-6420-4b47-9059-811cd71009c6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:42.712887 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4255/8544] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:56:42 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:42.716597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051445c-5fef-4de3-b15c-111f05ae828a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:42.728762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051445c-5fef-4de3-b15c-111f05ae828a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:42.736303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfa4e5-2616-4a4e-b040-6c9ee22be741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:42.736995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfa4e5-2616-4a4e-b040-6c9ee22be741 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.737275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfa4e5-2616-4a4e-b040-6c9ee22be741 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.737551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfa4e5-2616-4a4e-b040-6c9ee22be741 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.738271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfa4e5-2616-4a4e-b040-6c9ee22be741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:42.739907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfa4e5-2616-4a4e-b040-6c9ee22be741 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:42.756134 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4290/8545] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:42.757507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859f868-6420-4b47-9059-811cd71009c6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:42.771308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859f868-6420-4b47-9059-811cd71009c6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:42.784658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df751674-5fce-4102-93a7-402062a5cb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:42.785290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df751674-5fce-4102-93a7-402062a5cb70 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.785566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df751674-5fce-4102-93a7-402062a5cb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.785830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df751674-5fce-4102-93a7-402062a5cb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.786515 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df751674-5fce-4102-93a7-402062a5cb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:42.788218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df751674-5fce-4102-93a7-402062a5cb70 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:42.800793 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4256/8546] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:42.804816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfa4e5-2616-4a4e-b040-6c9ee22be741 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:42.815596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfa4e5-2616-4a4e-b040-6c9ee22be741 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:42.830224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d2d93-bb6f-421f-b959-de7708385ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:42.834703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d2d93-bb6f-421f-b959-de7708385ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.835096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d2d93-bb6f-421f-b959-de7708385ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.835670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d2d93-bb6f-421f-b959-de7708385ce0 admin admin] PATH_INFO: `/v3/projects/5885583cf39249369a101f874f8d3456/users/9ee0b4a7253d425baa53a69b2c749c92/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.866505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d2d93-bb6f-421f-b959-de7708385ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5885583cf39249369a101f874f8d3456, user_id=9ee0b4a7253d425baa53a69b2c749c92, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:42.870558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d2d93-bb6f-421f-b959-de7708385ce0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:42.889063 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4291/8547] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:56:42 2022] PUT /identity/v3/projects/5885583cf39249369a101f874f8d3456/users/9ee0b4a7253d425baa53a69b2c749c92/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:42.905063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbba8-728e-4f8e-bd2b-3ec5135188de None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:42.905499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbba8-728e-4f8e-bd2b-3ec5135188de None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:42.906281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbba8-728e-4f8e-bd2b-3ec5135188de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:42.939373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d4ebbba8-728e-4f8e-bd2b-3ec5135188de None None] MFA Rules not processed for user `9ee0b4a7253d425baa53a69b2c749c92`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:42.940597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d4ebbba8-728e-4f8e-bd2b-3ec5135188de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:43.021055 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4257/8548] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:43.022763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d2d93-bb6f-421f-b959-de7708385ce0 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:43.047634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:43.097327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d2d93-bb6f-421f-b959-de7708385ce0 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:43.102808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d208d00-2a04-4e89-9580-a8fd835c1fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:43.103679 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d208d00-2a04-4e89-9580-a8fd835c1fdc admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:43.103956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d208d00-2a04-4e89-9580-a8fd835c1fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:43.104224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d208d00-2a04-4e89-9580-a8fd835c1fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:43.104880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d208d00-2a04-4e89-9580-a8fd835c1fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:43.106858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d208d00-2a04-4e89-9580-a8fd835c1fdc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:43.137672 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4292/8549] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:56:43 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:43.141901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebbba8-728e-4f8e-bd2b-3ec5135188de None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:43.153579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebbba8-728e-4f8e-bd2b-3ec5135188de None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:43.167281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:43.218474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0cf1-c9db-495a-b394-57e529f1b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:43.219175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0cf1-c9db-495a-b394-57e529f1b3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:43.219464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0cf1-c9db-495a-b394-57e529f1b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:43.219730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0cf1-c9db-495a-b394-57e529f1b3c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:43.220396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0cf1-c9db-495a-b394-57e529f1b3c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:43.222757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0cf1-c9db-495a-b394-57e529f1b3c7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:43.249829 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4258/8550] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:56:43 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:43.253040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d208d00-2a04-4e89-9580-a8fd835c1fdc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:43.264995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d208d00-2a04-4e89-9580-a8fd835c1fdc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:43.270292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c1da9-0f6e-4954-b669-6e3f0180f050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:43.271020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c1da9-0f6e-4954-b669-6e3f0180f050 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:43.271306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c1da9-0f6e-4954-b669-6e3f0180f050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:43.271570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c1da9-0f6e-4954-b669-6e3f0180f050 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:43.272211 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c1da9-0f6e-4954-b669-6e3f0180f050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:43.274092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c1da9-0f6e-4954-b669-6e3f0180f050 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:43.289788 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4293/8551] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:56:43.293988 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0cf1-c9db-495a-b394-57e529f1b3c7 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:43.305124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0cf1-c9db-495a-b394-57e529f1b3c7 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:43.313236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add2596-f60a-499f-aa85-203248783e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:43.313945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2596-f60a-499f-aa85-203248783e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:43.314226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2596-f60a-499f-aa85-203248783e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:43.314502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add2596-f60a-499f-aa85-203248783e25 admin admin] PATH_INFO: `/v3/projects/066f7a77e9d2402892b9cb95319c55b5/users/e033106cfd9547109e2e331f18ecbfaa/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:43.332382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add2596-f60a-499f-aa85-203248783e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=066f7a77e9d2402892b9cb95319c55b5, user_id=e033106cfd9547109e2e331f18ecbfaa, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:43.335615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add2596-f60a-499f-aa85-203248783e25 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:43.354150 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4259/8552] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:56:43 2022] PUT /identity/v3/projects/066f7a77e9d2402892b9cb95319c55b5/users/e033106cfd9547109e2e331f18ecbfaa/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:43.362737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa6694-5783-4b19-8c47-ceae6bf6c4f7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:43.363132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa6694-5783-4b19-8c47-ceae6bf6c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:43.363462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa6694-5783-4b19-8c47-ceae6bf6c4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:43.393705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-99fa6694-5783-4b19-8c47-ceae6bf6c4f7 None None] MFA Rules not processed for user `e033106cfd9547109e2e331f18ecbfaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:43.396674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-99fa6694-5783-4b19-8c47-ceae6bf6c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:43.498038 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4294/8553] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:43 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:43.527263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add2596-f60a-499f-aa85-203248783e25 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:43.529527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7add2596-f60a-499f-aa85-203248783e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:43.628375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add2596-f60a-499f-aa85-203248783e25 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:43.633903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3315fb-6c87-4b6a-b87c-a372cecd568c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:43.643198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3315fb-6c87-4b6a-b87c-a372cecd568c service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:43.643622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3315fb-6c87-4b6a-b87c-a372cecd568c service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:43.643967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3315fb-6c87-4b6a-b87c-a372cecd568c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:43.653715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3315fb-6c87-4b6a-b87c-a372cecd568c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:43.655672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3315fb-6c87-4b6a-b87c-a372cecd568c service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:43.667860 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4260/8554] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:56:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 04:56:44.352205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa6694-5783-4b19-8c47-ceae6bf6c4f7 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:44.428697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa6694-5783-4b19-8c47-ceae6bf6c4f7 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:44.434356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:44.435124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:44.435406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:44.435940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] PATH_INFO: `/v3/users/9ee0b4a7253d425baa53a69b2c749c92` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:44.437130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ee0b4a7253d425baa53a69b2c749c92)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:44.439857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:44.480238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:44.507333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ee0b4a7253d425baa53a69b2c749c92'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:44.508121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ee0b4a7253d425baa53a69b2c749c92'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:44.516825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ee0b4a7253d425baa53a69b2c749c92'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:44.529049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ee0b4a7253d425baa53a69b2c749c92'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:44.544565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ee0b4a7253d425baa53a69b2c749c92'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:44.553077 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4295/8555] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:56:44 2022] DELETE /identity/v3/users/9ee0b4a7253d425baa53a69b2c749c92 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:44.557980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97be11-fe2b-407d-a1c7-f1a6063e48d9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:44.558477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97be11-fe2b-407d-a1c7-f1a6063e48d9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:44.558655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97be11-fe2b-407d-a1c7-f1a6063e48d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:44.583009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bb97be11-fe2b-407d-a1c7-f1a6063e48d9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:44.584469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bb97be11-fe2b-407d-a1c7-f1a6063e48d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:44.657744 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4261/8556] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:44.670893 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:44.672522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:44.764896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c8dee-7a65-451b-943a-3aa4c7dc013d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:44.769234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a2675-9fc9-49f4-9dcd-2543ada84b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:44.769485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a2675-9fc9-49f4-9dcd-2543ada84b1f service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:44.769763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a2675-9fc9-49f4-9dcd-2543ada84b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:44.770072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a2675-9fc9-49f4-9dcd-2543ada84b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:44.783047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a2675-9fc9-49f4-9dcd-2543ada84b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:44.786998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a2675-9fc9-49f4-9dcd-2543ada84b1f service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:44.800176 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4296/8557] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:56:45.217732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97be11-fe2b-407d-a1c7-f1a6063e48d9 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:45.220120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bb97be11-fe2b-407d-a1c7-f1a6063e48d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:45.234885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97be11-fe2b-407d-a1c7-f1a6063e48d9 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:45.245677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:45.246066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:45.246330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:45.246599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] PATH_INFO: `/v3/projects/5885583cf39249369a101f874f8d3456` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:45.247739 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5885583cf39249369a101f874f8d3456)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:45.250222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:45.260038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:45.309186 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5885583cf39249369a101f874f8d3456', 'request_id': 'req-dc815769-1725-4407-9b1e-bf0ec859f090'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:45.318410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5885583cf39249369a101f874f8d3456', 'request_id': 'req-dc815769-1725-4407-9b1e-bf0ec859f090'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:45.325032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5885583cf39249369a101f874f8d3456', 'request_id': 'req-dc815769-1725-4407-9b1e-bf0ec859f090'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:45.337520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] The token cache is being invalidate because project 5885583cf39249369a101f874f8d3456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:56:45.337828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:45.339108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:45.343647 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4262/8558] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:56:45 2022] DELETE /identity/v3/projects/5885583cf39249369a101f874f8d3456 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:45.345063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a2675-9fc9-49f4-9dcd-2543ada84b1f service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:45.355285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a2675-9fc9-49f4-9dcd-2543ada84b1f service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:45.419493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:45.420666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:45.421093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:45.421646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] PATH_INFO: `/v3/users/e033106cfd9547109e2e331f18ecbfaa` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:45.422967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e033106cfd9547109e2e331f18ecbfaa)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:45.425538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:45.652715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e033106cfd9547109e2e331f18ecbfaa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:45.653389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e033106cfd9547109e2e331f18ecbfaa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:45.655094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:45.664846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e033106cfd9547109e2e331f18ecbfaa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:45.678557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e033106cfd9547109e2e331f18ecbfaa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:45.696960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-77cf2217-1077-4414-96da-75b480f28d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e033106cfd9547109e2e331f18ecbfaa'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:45.703902 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4297/8559] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:56:45 2022] DELETE /identity/v3/users/e033106cfd9547109e2e331f18ecbfaa => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:46.012244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.014466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:46.052190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc815769-1725-4407-9b1e-bf0ec859f090 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.143908 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.144552 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.145007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.145434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] PATH_INFO: `/v3/projects/066f7a77e9d2402892b9cb95319c55b5` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.146881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] RBAC: Authorizing `identity:delete_project(project_id=066f7a77e9d2402892b9cb95319c55b5)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.149148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.204779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066f7a77e9d2402892b9cb95319c55b5', 'request_id': 'req-a7f2de23-e02a-4eb9-8059-c487fbf8118f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:46.217014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066f7a77e9d2402892b9cb95319c55b5', 'request_id': 'req-a7f2de23-e02a-4eb9-8059-c487fbf8118f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:46.225734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066f7a77e9d2402892b9cb95319c55b5', 'request_id': 'req-a7f2de23-e02a-4eb9-8059-c487fbf8118f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:46.237540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] The token cache is being invalidate because project 066f7a77e9d2402892b9cb95319c55b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:56:46.237853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:46.238533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:56:46.240121 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4263/8560] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:56:46 2022] DELETE /identity/v3/projects/066f7a77e9d2402892b9cb95319c55b5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:46.245224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdd09-d8a0-46ed-be3f-672b72e7b7f2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.245540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdd09-d8a0-46ed-be3f-672b72e7b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.245812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebdd09-d8a0-46ed-be3f-672b72e7b7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.271185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-faebdd09-d8a0-46ed-be3f-672b72e7b7f2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:46.272669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-faebdd09-d8a0-46ed-be3f-672b72e7b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:46.315433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.317642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:46.365069 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4298/8561] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:46.366714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410a19e-b0b8-48a5-adc9-e664b00cd4e0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.366960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410a19e-b0b8-48a5-adc9-e664b00cd4e0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.367232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410a19e-b0b8-48a5-adc9-e664b00cd4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.373639 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:46.392295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c410a19e-b0b8-48a5-adc9-e664b00cd4e0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:46.393543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c410a19e-b0b8-48a5-adc9-e664b00cd4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:46.410683 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4299/8562] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:46.411758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410a19e-b0b8-48a5-adc9-e664b00cd4e0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.423559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410a19e-b0b8-48a5-adc9-e664b00cd4e0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.428827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0ad01-d90a-4f53-b0b6-f5dea5760357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.429448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0ad01-d90a-4f53-b0b6-f5dea5760357 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.429721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0ad01-d90a-4f53-b0b6-f5dea5760357 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.430017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0ad01-d90a-4f53-b0b6-f5dea5760357 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.430665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0ad01-d90a-4f53-b0b6-f5dea5760357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:56:46.430959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0ad01-d90a-4f53-b0b6-f5dea5760357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.432620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0ad01-d90a-4f53-b0b6-f5dea5760357 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.445586 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4300/8563] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 04:56:46.450369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0ad01-d90a-4f53-b0b6-f5dea5760357 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.452391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2de23-e02a-4eb9-8059-c487fbf8118f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.460477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5550-e13d-4018-be1d-1361ea8e10ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.461153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5550-e13d-4018-be1d-1361ea8e10ab service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.461441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5550-e13d-4018-be1d-1361ea8e10ab service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.461714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e5550-e13d-4018-be1d-1361ea8e10ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.462075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0ad01-d90a-4f53-b0b6-f5dea5760357 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.463827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d97e5550-e13d-4018-be1d-1361ea8e10ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:46.467660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ae720-cffd-455b-a2a6-8902d6bc3d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.468404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ae720-cffd-455b-a2a6-8902d6bc3d99 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.468777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ae720-cffd-455b-a2a6-8902d6bc3d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.469172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ae720-cffd-455b-a2a6-8902d6bc3d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.470125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ae720-cffd-455b-a2a6-8902d6bc3d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.473406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ae720-cffd-455b-a2a6-8902d6bc3d99 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.513111 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4301/8564] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:56:46 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:46.517689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ae720-cffd-455b-a2a6-8902d6bc3d99 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.546063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e5550-e13d-4018-be1d-1361ea8e10ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.548718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e5550-e13d-4018-be1d-1361ea8e10ab service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.560436 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4264/8565] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:56:46.609437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ae720-cffd-455b-a2a6-8902d6bc3d99 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.627381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625b87-bc95-45bc-901b-48c4d3ec4f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.628024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625b87-bc95-45bc-901b-48c4d3ec4f08 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.628348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625b87-bc95-45bc-901b-48c4d3ec4f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.628619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625b87-bc95-45bc-901b-48c4d3ec4f08 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.629261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7625b87-bc95-45bc-901b-48c4d3ec4f08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.632239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7625b87-bc95-45bc-901b-48c4d3ec4f08 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.664715 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4302/8566] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:56:46 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:46.669737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5550-e13d-4018-be1d-1361ea8e10ab service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.683916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e5550-e13d-4018-be1d-1361ea8e10ab service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.690365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e3998-d708-4182-88e1-37de870ae54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.691303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e3998-d708-4182-88e1-37de870ae54b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.691784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e3998-d708-4182-88e1-37de870ae54b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.692270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e3998-d708-4182-88e1-37de870ae54b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.693129 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e3998-d708-4182-88e1-37de870ae54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.695686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e3998-d708-4182-88e1-37de870ae54b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.711289 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4265/8567] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:46.715913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625b87-bc95-45bc-901b-48c4d3ec4f08 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.729948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7625b87-bc95-45bc-901b-48c4d3ec4f08 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.735965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc69fe-40c5-4f34-91bd-9376c0a48709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.737687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc69fe-40c5-4f34-91bd-9376c0a48709 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.738292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc69fe-40c5-4f34-91bd-9376c0a48709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.738936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc69fe-40c5-4f34-91bd-9376c0a48709 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.739912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc69fe-40c5-4f34-91bd-9376c0a48709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.741729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc69fe-40c5-4f34-91bd-9376c0a48709 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.754711 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4303/8568] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:46.759030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e3998-d708-4182-88e1-37de870ae54b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.772656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e3998-d708-4182-88e1-37de870ae54b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:46.777645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69e5fa-9a8b-4eba-8992-2318a2bc38fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:46.779966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e5fa-9a8b-4eba-8992-2318a2bc38fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.780448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e5fa-9a8b-4eba-8992-2318a2bc38fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.780982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e5fa-9a8b-4eba-8992-2318a2bc38fb admin admin] PATH_INFO: `/v3/projects/044a26fc72ed46d8ac7f5a14bbebaf51/users/132069159f58439f8f88aaa592f61b0a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.801956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69e5fa-9a8b-4eba-8992-2318a2bc38fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=044a26fc72ed46d8ac7f5a14bbebaf51, user_id=132069159f58439f8f88aaa592f61b0a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:46.805003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69e5fa-9a8b-4eba-8992-2318a2bc38fb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:46.826715 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4266/8569] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:56:46 2022] PUT /identity/v3/projects/044a26fc72ed46d8ac7f5a14bbebaf51/users/132069159f58439f8f88aaa592f61b0a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:46.832203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554692c4-d40a-4d3b-86c9-cf57590ffa4c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:46.832425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554692c4-d40a-4d3b-86c9-cf57590ffa4c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:46.832706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554692c4-d40a-4d3b-86c9-cf57590ffa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:46.854009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:46.879609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-554692c4-d40a-4d3b-86c9-cf57590ffa4c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:46.881165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-554692c4-d40a-4d3b-86c9-cf57590ffa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:46.965541 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4304/8570] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:46.977683 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69e5fa-9a8b-4eba-8992-2318a2bc38fb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:46.993898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4e69e5fa-9a8b-4eba-8992-2318a2bc38fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:47.058534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69e5fa-9a8b-4eba-8992-2318a2bc38fb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:47.062919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1525b-13cf-4ce5-a44d-a2b977defbb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:47.063581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1525b-13cf-4ce5-a44d-a2b977defbb7 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:47.063807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1525b-13cf-4ce5-a44d-a2b977defbb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:47.064092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1525b-13cf-4ce5-a44d-a2b977defbb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:47.074298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1525b-13cf-4ce5-a44d-a2b977defbb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:47.075768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1525b-13cf-4ce5-a44d-a2b977defbb7 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:47.086763 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4267/8571] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:56:54.275671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554692c4-d40a-4d3b-86c9-cf57590ffa4c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:54.278077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-554692c4-d40a-4d3b-86c9-cf57590ffa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:54.303614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554692c4-d40a-4d3b-86c9-cf57590ffa4c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:54.312353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bea15a-a9df-4a21-ae4e-c0eeb2cdf22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:54.314143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea15a-a9df-4a21-ae4e-c0eeb2cdf22f service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:54.315106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea15a-a9df-4a21-ae4e-c0eeb2cdf22f service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:54.315759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bea15a-a9df-4a21-ae4e-c0eeb2cdf22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:54.320042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-51bea15a-a9df-4a21-ae4e-c0eeb2cdf22f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:54.361762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bea15a-a9df-4a21-ae4e-c0eeb2cdf22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:54.363274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bea15a-a9df-4a21-ae4e-c0eeb2cdf22f service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:54.389180 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4305/8572] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:56:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:56:54.727094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473adac-b6f7-4444-b807-d249ba8e3e98 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:54.727667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473adac-b6f7-4444-b807-d249ba8e3e98 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:54.727751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473adac-b6f7-4444-b807-d249ba8e3e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:54.793540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4473adac-b6f7-4444-b807-d249ba8e3e98 None None] MFA Rules not processed for user `132069159f58439f8f88aaa592f61b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:56:54.795087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4473adac-b6f7-4444-b807-d249ba8e3e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:56:54.834046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:54.928579 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4268/8573] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:56:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:56:54.933323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bea15a-a9df-4a21-ae4e-c0eeb2cdf22f service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:54.944875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bea15a-a9df-4a21-ae4e-c0eeb2cdf22f service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:54.955395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f0faf-3c4f-4068-b262-081da29e85e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:54.956029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f0faf-3c4f-4068-b262-081da29e85e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:54.956307 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f0faf-3c4f-4068-b262-081da29e85e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:54.956573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f0faf-3c4f-4068-b262-081da29e85e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:54.957219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f0faf-3c4f-4068-b262-081da29e85e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:54.959173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f0faf-3c4f-4068-b262-081da29e85e3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:55.007202 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4306/8574] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:56:54 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:55.008303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473adac-b6f7-4444-b807-d249ba8e3e98 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.025471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473adac-b6f7-4444-b807-d249ba8e3e98 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.136554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8aad5-918c-4d96-b83d-9bf1d570676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:55.137443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8aad5-918c-4d96-b83d-9bf1d570676c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.137853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8aad5-918c-4d96-b83d-9bf1d570676c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.138254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8aad5-918c-4d96-b83d-9bf1d570676c admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.139443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8aad5-918c-4d96-b83d-9bf1d570676c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:55.143649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8aad5-918c-4d96-b83d-9bf1d570676c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:55.176557 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4269/8575] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:56:55 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:56:55.181557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f0faf-3c4f-4068-b262-081da29e85e3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.219967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f0faf-3c4f-4068-b262-081da29e85e3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.227089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41b3eb-22c8-4692-a65f-ccc3fb3c3ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:55.228383 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41b3eb-22c8-4692-a65f-ccc3fb3c3ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.228999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41b3eb-22c8-4692-a65f-ccc3fb3c3ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.229470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41b3eb-22c8-4692-a65f-ccc3fb3c3ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.230621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41b3eb-22c8-4692-a65f-ccc3fb3c3ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:55.233720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41b3eb-22c8-4692-a65f-ccc3fb3c3ec3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:55.249499 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4307/8576] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:55.250918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8aad5-918c-4d96-b83d-9bf1d570676c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.262901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8aad5-918c-4d96-b83d-9bf1d570676c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.281760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77098e-0a3b-4309-ab25-47fb907447f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:55.282520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77098e-0a3b-4309-ab25-47fb907447f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.282794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77098e-0a3b-4309-ab25-47fb907447f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.283228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77098e-0a3b-4309-ab25-47fb907447f6 admin admin] PATH_INFO: `/v3/projects/acbc14826f2d4ca4a9908e342139cfbb/users/7020012585964cbd9dc83aa4d17b70ff/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.303604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77098e-0a3b-4309-ab25-47fb907447f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbc14826f2d4ca4a9908e342139cfbb, user_id=7020012585964cbd9dc83aa4d17b70ff, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:55.306879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77098e-0a3b-4309-ab25-47fb907447f6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:55.324312 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4270/8577] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:56:55 2022] PUT /identity/v3/projects/acbc14826f2d4ca4a9908e342139cfbb/users/7020012585964cbd9dc83aa4d17b70ff/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:56:55.328492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41b3eb-22c8-4692-a65f-ccc3fb3c3ec3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.344980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41b3eb-22c8-4692-a65f-ccc3fb3c3ec3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.438136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7e9b3-f3a9-431e-a8cd-4541461cd47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:55.439657 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7e9b3-f3a9-431e-a8cd-4541461cd47b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.440032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7e9b3-f3a9-431e-a8cd-4541461cd47b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.440399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7e9b3-f3a9-431e-a8cd-4541461cd47b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.441922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7e9b3-f3a9-431e-a8cd-4541461cd47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:55.444433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7e9b3-f3a9-431e-a8cd-4541461cd47b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:55.460332 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4308/8578] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:56:55.462429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77098e-0a3b-4309-ab25-47fb907447f6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:56:55.475225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77098e-0a3b-4309-ab25-47fb907447f6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:56:55.481367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db15c6-5582-47de-b700-4780751b2ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:56:55.482143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db15c6-5582-47de-b700-4780751b2ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:56:55.482422 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db15c6-5582-47de-b700-4780751b2ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:56:55.482688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db15c6-5582-47de-b700-4780751b2ab6 admin admin] PATH_INFO: `/v3/projects/acbc14826f2d4ca4a9908e342139cfbb/users/7020012585964cbd9dc83aa4d17b70ff/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:56:55.485132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db15c6-5582-47de-b700-4780751b2ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acbc14826f2d4ca4a9908e342139cfbb, user_id=7020012585964cbd9dc83aa4d17b70ff, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:56:55.487937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db15c6-5582-47de-b700-4780751b2ab6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:56:55.516016 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4271/8579] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:56:55 2022] PUT /identity/v3/projects/acbc14826f2d4ca4a9908e342139cfbb/users/7020012585964cbd9dc83aa4d17b70ff/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:02.780535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7e9b3-f3a9-431e-a8cd-4541461cd47b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:02.783025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-88b7e9b3-f3a9-431e-a8cd-4541461cd47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:02.962731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:03.009353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7e9b3-f3a9-431e-a8cd-4541461cd47b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:03.125711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3b9d7-bd00-4373-9b26-b894b9b42cd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:03.126666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b9d7-bd00-4373-9b26-b894b9b42cd5 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:03.127036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b9d7-bd00-4373-9b26-b894b9b42cd5 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:03.127402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3b9d7-bd00-4373-9b26-b894b9b42cd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:03.134614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ade3b9d7-bd00-4373-9b26-b894b9b42cd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:03.173444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3b9d7-bd00-4373-9b26-b894b9b42cd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:03.175288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3b9d7-bd00-4373-9b26-b894b9b42cd5 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:03.212446 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4309/8580] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:57:05.505718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=62,keystone:INSERT=5 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:06.680486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db15c6-5582-47de-b700-4780751b2ab6 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:06.719693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db15c6-5582-47de-b700-4780751b2ab6 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:06.762259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3feec-88c9-43f4-8932-2fa0507213ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:06.764793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3feec-88c9-43f4-8932-2fa0507213ea service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:06.766806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3feec-88c9-43f4-8932-2fa0507213ea service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:06.768218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3feec-88c9-43f4-8932-2fa0507213ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:06.810659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f1e3feec-88c9-43f4-8932-2fa0507213ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:06.844224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3feec-88c9-43f4-8932-2fa0507213ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:06.845858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3feec-88c9-43f4-8932-2fa0507213ea service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:06.891254 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4272/8581] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 04:57:07.738468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bce43-0f3b-489e-90fd-9f3621d04457 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:07.739686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bce43-0f3b-489e-90fd-9f3621d04457 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:07.740075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bce43-0f3b-489e-90fd-9f3621d04457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:07.906421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c76bce43-0f3b-489e-90fd-9f3621d04457 None None] MFA Rules not processed for user `7020012585964cbd9dc83aa4d17b70ff`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:07.907791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c76bce43-0f3b-489e-90fd-9f3621d04457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:08.008565 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4310/8582] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:08.023750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3feec-88c9-43f4-8932-2fa0507213ea service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:08.340853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3feec-88c9-43f4-8932-2fa0507213ea service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:08.373061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ac07b-5feb-47ac-a76e-e66234ff5e79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:08.376026 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac07b-5feb-47ac-a76e-e66234ff5e79 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:08.376470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac07b-5feb-47ac-a76e-e66234ff5e79 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:08.376919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac07b-5feb-47ac-a76e-e66234ff5e79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:08.404486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ac07b-5feb-47ac-a76e-e66234ff5e79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:08.407451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ac07b-5feb-47ac-a76e-e66234ff5e79 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:08.433853 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4273/8583] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:57:08.578969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d839b-6c6a-4440-9b20-1fbd4db2f593 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:08.579259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d839b-6c6a-4440-9b20-1fbd4db2f593 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:08.579540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d839b-6c6a-4440-9b20-1fbd4db2f593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:08.623013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-471d839b-6c6a-4440-9b20-1fbd4db2f593 None None] MFA Rules not processed for user `132069159f58439f8f88aaa592f61b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:08.625044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-471d839b-6c6a-4440-9b20-1fbd4db2f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:08.761571 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4311/8584] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:10.513194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ac07b-5feb-47ac-a76e-e66234ff5e79 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:10.515475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9a1ac07b-5feb-47ac-a76e-e66234ff5e79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:10.559385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ac07b-5feb-47ac-a76e-e66234ff5e79 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:10.566185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaae926-8caa-489d-a0e7-ef251c3bd655 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:10.585220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaae926-8caa-489d-a0e7-ef251c3bd655 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:10.585539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaae926-8caa-489d-a0e7-ef251c3bd655 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:10.585812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaae926-8caa-489d-a0e7-ef251c3bd655 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:10.589826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ecaae926-8caa-489d-a0e7-ef251c3bd655 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:10.659125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaae926-8caa-489d-a0e7-ef251c3bd655 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:10.662932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaae926-8caa-489d-a0e7-ef251c3bd655 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:10.707877 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4274/8585] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:57:14.127936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d839b-6c6a-4440-9b20-1fbd4db2f593 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:14.129489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-471d839b-6c6a-4440-9b20-1fbd4db2f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:14.224533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:14.434219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d839b-6c6a-4440-9b20-1fbd4db2f593 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:14.461668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:14.462627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:14.463136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:14.463908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] PATH_INFO: `/v3/users/dfbbe60c10ee4f8d8fd85208b77bbfc4` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:14.465585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfbbe60c10ee4f8d8fd85208b77bbfc4)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:14.469135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:14.578660 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfbbe60c10ee4f8d8fd85208b77bbfc4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:14.589911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfbbe60c10ee4f8d8fd85208b77bbfc4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:14.603217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfbbe60c10ee4f8d8fd85208b77bbfc4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:14.620172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfbbe60c10ee4f8d8fd85208b77bbfc4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:14.694001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfbbe60c10ee4f8d8fd85208b77bbfc4'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:14.711018 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4312/8586] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:57:14 2022] DELETE /identity/v3/users/dfbbe60c10ee4f8d8fd85208b77bbfc4 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:14.890141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaae926-8caa-489d-a0e7-ef251c3bd655 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.141134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.143062 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:15.199098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaae926-8caa-489d-a0e7-ef251c3bd655 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.316351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb32dc4-960c-4422-8419-958fae21407d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.316914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb32dc4-960c-4422-8419-958fae21407d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.317294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb32dc4-960c-4422-8419-958fae21407d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.318418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb32dc4-960c-4422-8419-958fae21407d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.320180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ccb32dc4-960c-4422-8419-958fae21407d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:15.359531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb32dc4-960c-4422-8419-958fae21407d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.362505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb32dc4-960c-4422-8419-958fae21407d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.403047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbfbf6-2f2a-4592-a5b3-f462eea9cdc5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.404276 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4275/8587] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:57:15.410891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.411848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.412172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.412532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] PATH_INFO: `/v3/projects/bbbce923e1ea4fc9b1e528241cb16d0e` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.413763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbce923e1ea4fc9b1e528241cb16d0e)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.417805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.512002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:15.554906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbce923e1ea4fc9b1e528241cb16d0e', 'request_id': 'req-228bb060-aed2-449a-b5ce-8699f64d1388'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:15.572239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbce923e1ea4fc9b1e528241cb16d0e', 'request_id': 'req-228bb060-aed2-449a-b5ce-8699f64d1388'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:15.595636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbce923e1ea4fc9b1e528241cb16d0e', 'request_id': 'req-228bb060-aed2-449a-b5ce-8699f64d1388'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:15.656335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] The token cache is being invalidate because project bbbce923e1ea4fc9b1e528241cb16d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:57:15.656881 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:15.659151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:15.661486 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4313/8588] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:57:15 2022] DELETE /identity/v3/projects/bbbce923e1ea4fc9b1e528241cb16d0e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:57:15.668470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb32dc4-960c-4422-8419-958fae21407d service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:15.699280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb32dc4-960c-4422-8419-958fae21407d service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:15.717673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:15.773903 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:15.774834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:15.775343 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:15.777340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] PATH_INFO: `/v3/users/44ecebb2aa1347a1a216032f983d87f1` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:15.778856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=44ecebb2aa1347a1a216032f983d87f1)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:15.782205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:15.878501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44ecebb2aa1347a1a216032f983d87f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:15.891376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44ecebb2aa1347a1a216032f983d87f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:15.908198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44ecebb2aa1347a1a216032f983d87f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:15.934590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44ecebb2aa1347a1a216032f983d87f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:15.936719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44ecebb2aa1347a1a216032f983d87f1'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:15.972351 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4276/8589] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:57:15 2022] DELETE /identity/v3/users/44ecebb2aa1347a1a216032f983d87f1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:16.274987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:16.280415 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:16.304479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bb060-aed2-449a-b5ce-8699f64d1388 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:16.457712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:16.458474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:16.458826 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:16.459167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] PATH_INFO: `/v3/projects/c70b46691a6a43e6905bb5cac95c975b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:16.462645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70b46691a6a43e6905bb5cac95c975b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:16.464693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:16.575699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70b46691a6a43e6905bb5cac95c975b', 'request_id': 'req-fd82db52-a316-402b-9c09-e586567458f5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:16.616263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70b46691a6a43e6905bb5cac95c975b', 'request_id': 'req-fd82db52-a316-402b-9c09-e586567458f5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:16.650483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70b46691a6a43e6905bb5cac95c975b', 'request_id': 'req-fd82db52-a316-402b-9c09-e586567458f5'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:16.692627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] The token cache is being invalidate because project c70b46691a6a43e6905bb5cac95c975b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:57:16.693170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:16.701432 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-fd82db52-a316-402b-9c09-e586567458f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:16.729981 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4314/8590] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:57:16 2022] DELETE /identity/v3/projects/c70b46691a6a43e6905bb5cac95c975b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:21.575182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:21.579207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:21.792348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79a43c-58f0-4bdd-82a3-7b7fada9c1bf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:21.832929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:21.872526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ff964-eb5b-4a24-84ad-97db8e23e2ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:21.873482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff964-eb5b-4a24-84ad-97db8e23e2ec service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:21.874112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff964-eb5b-4a24-84ad-97db8e23e2ec service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:21.875042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ff964-eb5b-4a24-84ad-97db8e23e2ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:21.877482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-643ff964-eb5b-4a24-84ad-97db8e23e2ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:21.900812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ff964-eb5b-4a24-84ad-97db8e23e2ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:21.915763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ff964-eb5b-4a24-84ad-97db8e23e2ec service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:21.936471 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4277/8591] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:57:24.857161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b57b6-e7f9-4307-bf69-85400f25a718 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:24.858263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b57b6-e7f9-4307-bf69-85400f25a718 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:24.858911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b57b6-e7f9-4307-bf69-85400f25a718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:24.890613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ed8b57b6-e7f9-4307-bf69-85400f25a718 None None] MFA Rules not processed for user `132069159f58439f8f88aaa592f61b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:24.892341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ed8b57b6-e7f9-4307-bf69-85400f25a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:24.979839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:24.997078 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4315/8592] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:29.146602 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ff964-eb5b-4a24-84ad-97db8e23e2ec service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:29.147972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-643ff964-eb5b-4a24-84ad-97db8e23e2ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:29.179130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ff964-eb5b-4a24-84ad-97db8e23e2ec service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:29.194616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56862657-44db-495d-a24f-331599347cff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:29.195371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56862657-44db-495d-a24f-331599347cff service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:29.195703 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56862657-44db-495d-a24f-331599347cff service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:29.196039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56862657-44db-495d-a24f-331599347cff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:29.199825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-56862657-44db-495d-a24f-331599347cff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:29.234748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56862657-44db-495d-a24f-331599347cff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:29.240107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56862657-44db-495d-a24f-331599347cff service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:29.259223 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4278/8593] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:57:39.249289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=24 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:45.959876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b57b6-e7f9-4307-bf69-85400f25a718 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:45.961562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ed8b57b6-e7f9-4307-bf69-85400f25a718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:46.058854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b57b6-e7f9-4307-bf69-85400f25a718 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:46.077346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:46.078678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:46.078970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:46.079247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] PATH_INFO: `/v3/users/1bdd09f7e1b3432a88077a88e23e5ca9` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:46.080545 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bdd09f7e1b3432a88077a88e23e5ca9)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:46.082544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:46.190454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bdd09f7e1b3432a88077a88e23e5ca9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:46.191699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bdd09f7e1b3432a88077a88e23e5ca9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:46.202125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bdd09f7e1b3432a88077a88e23e5ca9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:46.216284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bdd09f7e1b3432a88077a88e23e5ca9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:46.236200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bdd09f7e1b3432a88077a88e23e5ca9'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:46.266022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c46ab-45f3-436b-a6fa-003218f7dd98 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:46.267027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c46ab-45f3-436b-a6fa-003218f7dd98 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:46.267484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c46ab-45f3-436b-a6fa-003218f7dd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:46.274991 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4316/8594] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:57:45 2022] DELETE /identity/v3/users/1bdd09f7e1b3432a88077a88e23e5ca9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:46.301329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-103c46ab-45f3-436b-a6fa-003218f7dd98 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:46.305171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-103c46ab-45f3-436b-a6fa-003218f7dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:46.404409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:46.405966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:46.415213 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4279/8595] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:46.491080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907bdc0-7531-4ec2-b2d3-84c5fc774147 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:46.495148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8857534-05b6-445a-83f2-9db5dec126fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:46.495785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857534-05b6-445a-83f2-9db5dec126fe service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:46.496067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857534-05b6-445a-83f2-9db5dec126fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:46.496339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8857534-05b6-445a-83f2-9db5dec126fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:46.506853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8857534-05b6-445a-83f2-9db5dec126fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:46.516309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8857534-05b6-445a-83f2-9db5dec126fe service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:46.545228 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4317/8596] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:57:47.060291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c46ab-45f3-436b-a6fa-003218f7dd98 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.062482 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-103c46ab-45f3-436b-a6fa-003218f7dd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:47.081076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c46ab-45f3-436b-a6fa-003218f7dd98 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:47.086984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:47.086984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.086984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.087382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] PATH_INFO: `/v3/projects/a03df79c37ef4631b2346723f454d3f6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.088537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03df79c37ef4631b2346723f454d3f6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:47.090483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:47.178954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03df79c37ef4631b2346723f454d3f6', 'request_id': 'req-f16bbefd-f116-42d9-a115-60ba2e03fbda'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:47.190285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03df79c37ef4631b2346723f454d3f6', 'request_id': 'req-f16bbefd-f116-42d9-a115-60ba2e03fbda'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:47.198533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03df79c37ef4631b2346723f454d3f6', 'request_id': 'req-f16bbefd-f116-42d9-a115-60ba2e03fbda'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:47.218086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] The token cache is being invalidate because project a03df79c37ef4631b2346723f454d3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:57:47.219256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:47.220233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f16bbefd-f116-42d9-a115-60ba2e03fbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:47.227064 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4280/8597] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:57:47 2022] DELETE /identity/v3/projects/a03df79c37ef4631b2346723f454d3f6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:47.229426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa48ea2-2f5f-4022-964d-aad3833480a0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.229954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa48ea2-2f5f-4022-964d-aad3833480a0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.230214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa48ea2-2f5f-4022-964d-aad3833480a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.246100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:47.266293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-cfa48ea2-2f5f-4022-964d-aad3833480a0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:47.267675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-cfa48ea2-2f5f-4022-964d-aad3833480a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:47.348385 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4318/8598] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:47.356007 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587bd98-2001-4386-8d6e-780ccb063745 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.356544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587bd98-2001-4386-8d6e-780ccb063745 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.356544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b587bd98-2001-4386-8d6e-780ccb063745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.383876 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b587bd98-2001-4386-8d6e-780ccb063745 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:47.385764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b587bd98-2001-4386-8d6e-780ccb063745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:47.395917 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4281/8599] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:47.399834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa48ea2-2f5f-4022-964d-aad3833480a0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.410090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa48ea2-2f5f-4022-964d-aad3833480a0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:47.415398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f95048-7ffc-4918-b32f-bcfd04815c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:47.416140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f95048-7ffc-4918-b32f-bcfd04815c32 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.416481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f95048-7ffc-4918-b32f-bcfd04815c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.416821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f95048-7ffc-4918-b32f-bcfd04815c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.417900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f95048-7ffc-4918-b32f-bcfd04815c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:47.417900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f95048-7ffc-4918-b32f-bcfd04815c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:47.419601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f95048-7ffc-4918-b32f-bcfd04815c32 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:47.432879 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4319/8600] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:47.437630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587bd98-2001-4386-8d6e-780ccb063745 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.447177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b587bd98-2001-4386-8d6e-780ccb063745 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:47.452468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a33ee0-9ccd-445a-8176-5ed816a9e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:47.453368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a33ee0-9ccd-445a-8176-5ed816a9e1bc admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.453984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a33ee0-9ccd-445a-8176-5ed816a9e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.454442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a33ee0-9ccd-445a-8176-5ed816a9e1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.455273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a33ee0-9ccd-445a-8176-5ed816a9e1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:47.457407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a33ee0-9ccd-445a-8176-5ed816a9e1bc admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:47.495718 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4282/8601] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:57:47 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:47.499967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f95048-7ffc-4918-b32f-bcfd04815c32 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.511572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f95048-7ffc-4918-b32f-bcfd04815c32 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:47.594169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f7d53-262d-4e04-b2a9-79a147782a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:47.594797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7d53-262d-4e04-b2a9-79a147782a39 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.595202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7d53-262d-4e04-b2a9-79a147782a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.595487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7d53-262d-4e04-b2a9-79a147782a39 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.596437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f7d53-262d-4e04-b2a9-79a147782a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:47.599233 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f7d53-262d-4e04-b2a9-79a147782a39 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:47.648966 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4320/8602] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:57:47 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 04:57:47.652385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a33ee0-9ccd-445a-8176-5ed816a9e1bc admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.693420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a33ee0-9ccd-445a-8176-5ed816a9e1bc admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:47.711016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c26d74-4e0c-44ee-bc15-32e146843a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:47.713202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c26d74-4e0c-44ee-bc15-32e146843a6d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.713656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c26d74-4e0c-44ee-bc15-32e146843a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.717137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c26d74-4e0c-44ee-bc15-32e146843a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.722907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c26d74-4e0c-44ee-bc15-32e146843a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:47.724994 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c26d74-4e0c-44ee-bc15-32e146843a6d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:47.751928 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4283/8603] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:57:47.756055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f7d53-262d-4e04-b2a9-79a147782a39 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.769902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f7d53-262d-4e04-b2a9-79a147782a39 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:47.794909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a49c31-a443-41c4-9f6f-d0f6108cec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:47.796533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a49c31-a443-41c4-9f6f-d0f6108cec84 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.799640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a49c31-a443-41c4-9f6f-d0f6108cec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.799940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a49c31-a443-41c4-9f6f-d0f6108cec84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.800631 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a49c31-a443-41c4-9f6f-d0f6108cec84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:47.802310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a49c31-a443-41c4-9f6f-d0f6108cec84 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:47.822921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c26d74-4e0c-44ee-bc15-32e146843a6d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:47.823181 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4321/8604] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:57:47.835430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c26d74-4e0c-44ee-bc15-32e146843a6d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:47.863478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ce41b-5406-4030-8822-9dd47f23b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:47.865228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ce41b-5406-4030-8822-9dd47f23b0be admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.865740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ce41b-5406-4030-8822-9dd47f23b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.866497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ce41b-5406-4030-8822-9dd47f23b0be admin admin] PATH_INFO: `/v3/projects/bcc1933a8bed40c7b7119766b8d930f3/users/c082a9f9c508402fabfab0558b26ccc8/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.890678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a5c1f-0c5e-416e-a40a-18cf33573146 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.890907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a5c1f-0c5e-416e-a40a-18cf33573146 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.891187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a5c1f-0c5e-416e-a40a-18cf33573146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:47.899250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ce41b-5406-4030-8822-9dd47f23b0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc1933a8bed40c7b7119766b8d930f3, user_id=c082a9f9c508402fabfab0558b26ccc8, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:47.903075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ce41b-5406-4030-8822-9dd47f23b0be admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:47.927946 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4284/8605] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:57:47 2022] PUT /identity/v3/projects/bcc1933a8bed40c7b7119766b8d930f3/users/c082a9f9c508402fabfab0558b26ccc8/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:47.939289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e50a5c1f-0c5e-416e-a40a-18cf33573146 None None] MFA Rules not processed for user `a9ef01029e264fbca52310cfe3edfb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:47.940601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e50a5c1f-0c5e-416e-a40a-18cf33573146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:47.941466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6a055-8e68-43fd-b2c8-2487abfa92ce None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:47.942551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6a055-8e68-43fd-b2c8-2487abfa92ce None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:47.942929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6a055-8e68-43fd-b2c8-2487abfa92ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:48.012507 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4322/8606] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:48.069551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-75f6a055-8e68-43fd-b2c8-2487abfa92ce None None] MFA Rules not processed for user `c082a9f9c508402fabfab0558b26ccc8`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:48.070982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-75f6a055-8e68-43fd-b2c8-2487abfa92ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:48.081306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:48.198526 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4285/8607] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:48.206699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a5c1f-0c5e-416e-a40a-18cf33573146 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:48.208160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e50a5c1f-0c5e-416e-a40a-18cf33573146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:48.248556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:48.355848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a5c1f-0c5e-416e-a40a-18cf33573146 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:48.369153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4edfa-6525-40fc-bbc3-95125a38fe43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:48.369558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4edfa-6525-40fc-bbc3-95125a38fe43 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:48.369852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4edfa-6525-40fc-bbc3-95125a38fe43 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:48.370270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4edfa-6525-40fc-bbc3-95125a38fe43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:48.386651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4edfa-6525-40fc-bbc3-95125a38fe43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:48.388322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4edfa-6525-40fc-bbc3-95125a38fe43 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:48.400030 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4323/8608] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:57:54.610659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6a055-8e68-43fd-b2c8-2487abfa92ce None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:54.747853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6a055-8e68-43fd-b2c8-2487abfa92ce None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:54.765657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:54.766753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:54.767152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:54.767534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] PATH_INFO: `/v3/users/c082a9f9c508402fabfab0558b26ccc8` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:54.769434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c082a9f9c508402fabfab0558b26ccc8)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:54.772060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:54.906699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c082a9f9c508402fabfab0558b26ccc8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:54.930899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c082a9f9c508402fabfab0558b26ccc8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:54.959859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c082a9f9c508402fabfab0558b26ccc8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:54.971963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c082a9f9c508402fabfab0558b26ccc8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:54.971963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c082a9f9c508402fabfab0558b26ccc8'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:54.987292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005dcba-7b38-48f1-a4b4-7edc8dee6f78 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:54.987292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005dcba-7b38-48f1-a4b4-7edc8dee6f78 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:54.987292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005dcba-7b38-48f1-a4b4-7edc8dee6f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:54.989709 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4286/8609] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:57:54 2022] DELETE /identity/v3/users/c082a9f9c508402fabfab0558b26ccc8 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:55.009041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7005dcba-7b38-48f1-a4b4-7edc8dee6f78 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:55.010487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7005dcba-7b38-48f1-a4b4-7edc8dee6f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:55.096716 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4324/8610] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:55.154139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:55.155849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:55.244244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:55.340792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582feb3-34aa-46f2-8da4-353a92bb462e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:55.354047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf0547-9fe6-4112-9f30-2754e90950db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:55.356570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf0547-9fe6-4112-9f30-2754e90950db service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:55.356570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf0547-9fe6-4112-9f30-2754e90950db service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:55.356570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf0547-9fe6-4112-9f30-2754e90950db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:55.376041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf0547-9fe6-4112-9f30-2754e90950db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:55.380740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf0547-9fe6-4112-9f30-2754e90950db service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:55.416256 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4287/8611] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:57:56.486046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005dcba-7b38-48f1-a4b4-7edc8dee6f78 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:56.488132 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7005dcba-7b38-48f1-a4b4-7edc8dee6f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:56.502150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005dcba-7b38-48f1-a4b4-7edc8dee6f78 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:56.508252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:56.509528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.510366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.510884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] PATH_INFO: `/v3/projects/bcc1933a8bed40c7b7119766b8d930f3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.513518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc1933a8bed40c7b7119766b8d930f3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:56.516402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:56.649648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc1933a8bed40c7b7119766b8d930f3', 'request_id': 'req-170e8905-4d9d-4797-9abd-9e2a6e318b38'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:56.696408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc1933a8bed40c7b7119766b8d930f3', 'request_id': 'req-170e8905-4d9d-4797-9abd-9e2a6e318b38'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:56.719272 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc1933a8bed40c7b7119766b8d930f3', 'request_id': 'req-170e8905-4d9d-4797-9abd-9e2a6e318b38'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:56.737287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] The token cache is being invalidate because project bcc1933a8bed40c7b7119766b8d930f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:57:56.738085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:56.739252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-170e8905-4d9d-4797-9abd-9e2a6e318b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:56.741332 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4325/8612] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:57:56 2022] DELETE /identity/v3/projects/bcc1933a8bed40c7b7119766b8d930f3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:56.746134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21bf74-275c-4f5e-889a-8115bba65856 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.746636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21bf74-275c-4f5e-889a-8115bba65856 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.746721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21bf74-275c-4f5e-889a-8115bba65856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:56.788442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7f21bf74-275c-4f5e-889a-8115bba65856 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:56.789954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7f21bf74-275c-4f5e-889a-8115bba65856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:56.940756 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4288/8613] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:56.953694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcf35c-24e5-4a91-8547-af756fb6ea77 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:56.953995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcf35c-24e5-4a91-8547-af756fb6ea77 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:56.957338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcf35c-24e5-4a91-8547-af756fb6ea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.014403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d6dcf35c-24e5-4a91-8547-af756fb6ea77 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:57.015684 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d6dcf35c-24e5-4a91-8547-af756fb6ea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:57.040065 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4326/8614] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:57.045287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21bf74-275c-4f5e-889a-8115bba65856 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.056836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21bf74-275c-4f5e-889a-8115bba65856 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.089861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf603c-cc95-4a80-a1d9-f60900ce87e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.090921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf603c-cc95-4a80-a1d9-f60900ce87e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.091362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf603c-cc95-4a80-a1d9-f60900ce87e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.091781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf603c-cc95-4a80-a1d9-f60900ce87e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.092737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf603c-cc95-4a80-a1d9-f60900ce87e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 04:57:57.093260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf603c-cc95-4a80-a1d9-f60900ce87e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.096264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf603c-cc95-4a80-a1d9-f60900ce87e5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.131952 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4289/8615] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 04:57:57.136524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcf35c-24e5-4a91-8547-af756fb6ea77 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.151003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcf35c-24e5-4a91-8547-af756fb6ea77 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.162870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7c35c-b754-4dad-a538-4a7b3835fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.163514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7c35c-b754-4dad-a538-4a7b3835fe72 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.163797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7c35c-b754-4dad-a538-4a7b3835fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.164073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7c35c-b754-4dad-a538-4a7b3835fe72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.164746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7c35c-b754-4dad-a538-4a7b3835fe72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.174205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7c35c-b754-4dad-a538-4a7b3835fe72 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.240944 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4327/8616] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 04:57:57 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:57.244875 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf603c-cc95-4a80-a1d9-f60900ce87e5 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.259190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf603c-cc95-4a80-a1d9-f60900ce87e5 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.389047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18207d54-b90a-4451-b99a-806fbff836c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.389487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18207d54-b90a-4451-b99a-806fbff836c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.389773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18207d54-b90a-4451-b99a-806fbff836c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.390085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18207d54-b90a-4451-b99a-806fbff836c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.391649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18207d54-b90a-4451-b99a-806fbff836c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.395181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18207d54-b90a-4451-b99a-806fbff836c9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.436831 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4290/8617] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 04:57:57 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 04:57:57.441592 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7c35c-b754-4dad-a538-4a7b3835fe72 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.451436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:57.462371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7c35c-b754-4dad-a538-4a7b3835fe72 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.472210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2121-4620-4c6a-81ce-6f5756821e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.473434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2121-4620-4c6a-81ce-6f5756821e5a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.473673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2121-4620-4c6a-81ce-6f5756821e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.474558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a2121-4620-4c6a-81ce-6f5756821e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.475162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a2121-4620-4c6a-81ce-6f5756821e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.476693 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a2121-4620-4c6a-81ce-6f5756821e5a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.498418 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4328/8618] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 04:57:57.502354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18207d54-b90a-4451-b99a-806fbff836c9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.516582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18207d54-b90a-4451-b99a-806fbff836c9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.522126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff70ba-2cfb-4f9f-ac90-4bdc02a238b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.522813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff70ba-2cfb-4f9f-ac90-4bdc02a238b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.523378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff70ba-2cfb-4f9f-ac90-4bdc02a238b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.523793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff70ba-2cfb-4f9f-ac90-4bdc02a238b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.524358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff70ba-2cfb-4f9f-ac90-4bdc02a238b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.526669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff70ba-2cfb-4f9f-ac90-4bdc02a238b6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.543092 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4291/8619] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 04:57:57.547683 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2121-4620-4c6a-81ce-6f5756821e5a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.559403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a2121-4620-4c6a-81ce-6f5756821e5a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.564938 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9619235-c97d-4cf5-acbb-3ae682c35c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.566236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619235-c97d-4cf5-acbb-3ae682c35c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.566748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619235-c97d-4cf5-acbb-3ae682c35c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.567247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9619235-c97d-4cf5-acbb-3ae682c35c5d admin admin] PATH_INFO: `/v3/projects/23f8950f1af14715ae86c0c8e365e720/users/14f4460822964a7fa4de923c76b1e374/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.585807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9619235-c97d-4cf5-acbb-3ae682c35c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f8950f1af14715ae86c0c8e365e720, user_id=14f4460822964a7fa4de923c76b1e374, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.590570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9619235-c97d-4cf5-acbb-3ae682c35c5d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.633778 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4329/8620] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 04:57:57 2022] PUT /identity/v3/projects/23f8950f1af14715ae86c0c8e365e720/users/14f4460822964a7fa4de923c76b1e374/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:57.641221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b57900-51c3-484c-8379-b7edd771e1f2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.641221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b57900-51c3-484c-8379-b7edd771e1f2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.641538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b57900-51c3-484c-8379-b7edd771e1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.668157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9619235-c97d-4cf5-acbb-3ae682c35c5d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.671601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c9619235-c97d-4cf5-acbb-3ae682c35c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:57.684907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-80b57900-51c3-484c-8379-b7edd771e1f2 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:57.687641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-80b57900-51c3-484c-8379-b7edd771e1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:57.814586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9619235-c97d-4cf5-acbb-3ae682c35c5d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:57.820169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:57.821135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:57.821636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:57.822155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] PATH_INFO: `/v3/users/132069159f58439f8f88aaa592f61b0a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:57.823601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132069159f58439f8f88aaa592f61b0a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:57.825017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:57.827872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:57.882497 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4292/8621] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:57.904799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132069159f58439f8f88aaa592f61b0a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:57.905394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b57900-51c3-484c-8379-b7edd771e1f2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:57.906517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132069159f58439f8f88aaa592f61b0a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:57.907768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-80b57900-51c3-484c-8379-b7edd771e1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:57.916788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132069159f58439f8f88aaa592f61b0a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:57.943084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132069159f58439f8f88aaa592f61b0a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:57.971076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132069159f58439f8f88aaa592f61b0a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:57.985920 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4330/8622] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:57:57 2022] DELETE /identity/v3/users/132069159f58439f8f88aaa592f61b0a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:57:58.046087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b57900-51c3-484c-8379-b7edd771e1f2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:58.124644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb8e30-8742-48a2-a0c6-89948860b089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:58.125555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb8e30-8742-48a2-a0c6-89948860b089 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:58.126024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb8e30-8742-48a2-a0c6-89948860b089 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:58.126459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb8e30-8742-48a2-a0c6-89948860b089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:58.128464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-74fb8e30-8742-48a2-a0c6-89948860b089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:58.279779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb8e30-8742-48a2-a0c6-89948860b089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:58.281541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb8e30-8742-48a2-a0c6-89948860b089 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:58.307806 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4293/8623] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:57:58.402147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:58.403721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:58.457396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b66a7-9471-417c-96a1-9dc7dddc1f34 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:58.463634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:58.464628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:58.464964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:58.465757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] PATH_INFO: `/v3/projects/044a26fc72ed46d8ac7f5a14bbebaf51` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:58.467585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044a26fc72ed46d8ac7f5a14bbebaf51)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:58.469768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:58.547348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:58.555290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044a26fc72ed46d8ac7f5a14bbebaf51', 'request_id': 'req-ab1932bf-a550-42c3-a6ab-21f3f8562225'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:58.567073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044a26fc72ed46d8ac7f5a14bbebaf51', 'request_id': 'req-ab1932bf-a550-42c3-a6ab-21f3f8562225'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:58.581045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044a26fc72ed46d8ac7f5a14bbebaf51', 'request_id': 'req-ab1932bf-a550-42c3-a6ab-21f3f8562225'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:58.604370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] The token cache is being invalidate because project 044a26fc72ed46d8ac7f5a14bbebaf51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:57:58.604966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:58.606000 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:58.608047 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4331/8624] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:57:58 2022] DELETE /identity/v3/projects/044a26fc72ed46d8ac7f5a14bbebaf51 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:57:58.612159 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb8e30-8742-48a2-a0c6-89948860b089 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:58.626584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb8e30-8742-48a2-a0c6-89948860b089 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:58.710727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:58.733034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:58.734270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:58.734601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:58.735108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] PATH_INFO: `/v3/users/7020012585964cbd9dc83aa4d17b70ff` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:58.736577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7020012585964cbd9dc83aa4d17b70ff)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:58.738824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:58.809246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7020012585964cbd9dc83aa4d17b70ff'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:58.821336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7020012585964cbd9dc83aa4d17b70ff'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:58.839391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7020012585964cbd9dc83aa4d17b70ff'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:58.858448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7020012585964cbd9dc83aa4d17b70ff'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:58.859131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-bcdfd657-8473-4436-8e6c-4868e4a5945e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7020012585964cbd9dc83aa4d17b70ff'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:58.876819 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4294/8625] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:57:58 2022] DELETE /identity/v3/users/7020012585964cbd9dc83aa4d17b70ff => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:59.131497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:59.133221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:59.165321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1932bf-a550-42c3-a6ab-21f3f8562225 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:59.237635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:59.238387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:59.238713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:59.238993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] PATH_INFO: `/v3/projects/acbc14826f2d4ca4a9908e342139cfbb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:59.240279 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acbc14826f2d4ca4a9908e342139cfbb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:59.243038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:59.305639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acbc14826f2d4ca4a9908e342139cfbb', 'request_id': 'req-94a35e37-4c89-45da-a239-d70bd27e6ea2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:59.314997 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acbc14826f2d4ca4a9908e342139cfbb', 'request_id': 'req-94a35e37-4c89-45da-a239-d70bd27e6ea2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:59.326854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acbc14826f2d4ca4a9908e342139cfbb', 'request_id': 'req-94a35e37-4c89-45da-a239-d70bd27e6ea2'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:59.342023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] The token cache is being invalidate because project acbc14826f2d4ca4a9908e342139cfbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:57:59.342619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:59.343638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:57:59.345997 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4332/8626] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:57:59 2022] DELETE /identity/v3/projects/acbc14826f2d4ca4a9908e342139cfbb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:57:59.530123 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f2fe-a34d-4011-b707-7304d5f997ff None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:59.530455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f2fe-a34d-4011-b707-7304d5f997ff None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:59.530686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f2fe-a34d-4011-b707-7304d5f997ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:59.594079 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-bf89f2fe-a34d-4011-b707-7304d5f997ff None None] MFA Rules not processed for user `14f4460822964a7fa4de923c76b1e374`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:57:59.600060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bf89f2fe-a34d-4011-b707-7304d5f997ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:59.776299 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4295/8627] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:57:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:57:59.789263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:57:59.791581 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:57:59.892604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a35e37-4c89-45da-a239-d70bd27e6ea2 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:57:59.896387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd635179-bbe7-4524-af1a-dee22c679853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:57:59.897008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd635179-bbe7-4524-af1a-dee22c679853 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:57:59.897286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd635179-bbe7-4524-af1a-dee22c679853 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:57:59.897556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd635179-bbe7-4524-af1a-dee22c679853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:57:59.906714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd635179-bbe7-4524-af1a-dee22c679853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:57:59.908194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd635179-bbe7-4524-af1a-dee22c679853 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:57:59.917793 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4333/8628] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:57:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:58:01.829107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89f2fe-a34d-4011-b707-7304d5f997ff None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:01.831204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bf89f2fe-a34d-4011-b707-7304d5f997ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:01.893108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:01.926483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89f2fe-a34d-4011-b707-7304d5f997ff None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:01.932298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5c7ee-a1d1-4e80-a409-cc2215fe3dfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:01.932916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5c7ee-a1d1-4e80-a409-cc2215fe3dfa service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:01.933194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5c7ee-a1d1-4e80-a409-cc2215fe3dfa service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:01.933464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5c7ee-a1d1-4e80-a409-cc2215fe3dfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:01.935440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d6f5c7ee-a1d1-4e80-a409-cc2215fe3dfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:01.951862 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5c7ee-a1d1-4e80-a409-cc2215fe3dfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:01.953491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5c7ee-a1d1-4e80-a409-cc2215fe3dfa service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:01.967716 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4296/8629] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:58:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:58:06.497501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029b023-6c56-435e-83ec-64e6f90773d9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:06.497501 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029b023-6c56-435e-83ec-64e6f90773d9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:06.498134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029b023-6c56-435e-83ec-64e6f90773d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:06.506526 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:06.518397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b029b023-6c56-435e-83ec-64e6f90773d9 None None] MFA Rules not processed for user `8579769774234e2088cb6e6fbe8fcc03`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:06.520793 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b029b023-6c56-435e-83ec-64e6f90773d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:06.576110 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4334/8630] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:58:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:58:11.156732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f76b7-6068-4d34-acc9-9de88134a4a3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:11.158121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f76b7-6068-4d34-acc9-9de88134a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:11.158624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f76b7-6068-4d34-acc9-9de88134a4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:11.306069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-998f76b7-6068-4d34-acc9-9de88134a4a3 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:11.307582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-998f76b7-6068-4d34-acc9-9de88134a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:11.494630 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4297/8631] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 04:58:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:58:11.610567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029b023-6c56-435e-83ec-64e6f90773d9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:11.613271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b029b023-6c56-435e-83ec-64e6f90773d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:11.906467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029b023-6c56-435e-83ec-64e6f90773d9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:11.922282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fd300-b7d3-4e92-86bd-334180250621 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:11.923036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fd300-b7d3-4e92-86bd-334180250621 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:11.923520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fd300-b7d3-4e92-86bd-334180250621 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:11.928174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fd300-b7d3-4e92-86bd-334180250621 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:11.961412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fd300-b7d3-4e92-86bd-334180250621 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:11.963076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fd300-b7d3-4e92-86bd-334180250621 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:11.999961 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4335/8632] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:58:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:58:13.694487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ea08d-0a9e-47c6-aea4-280bed533976 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:13.695020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ea08d-0a9e-47c6-aea4-280bed533976 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:13.695020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ea08d-0a9e-47c6-aea4-280bed533976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:13.714713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-552ea08d-0a9e-47c6-aea4-280bed533976 None None] MFA Rules not processed for user `a9ef01029e264fbca52310cfe3edfb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:58:13.716117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-552ea08d-0a9e-47c6-aea4-280bed533976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:13.773713 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4298/8633] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:58:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:58:21.517504 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fd300-b7d3-4e92-86bd-334180250621 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:21.538678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fd300-b7d3-4e92-86bd-334180250621 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:21.546625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf657-9ca3-47db-aef2-665cebe30152 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:21.547351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf657-9ca3-47db-aef2-665cebe30152 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:21.547864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf657-9ca3-47db-aef2-665cebe30152 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:21.548201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfdf657-9ca3-47db-aef2-665cebe30152 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:21.558391 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdf657-9ca3-47db-aef2-665cebe30152 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:21.560457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfdf657-9ca3-47db-aef2-665cebe30152 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:21.571016 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4336/8634] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:58:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:58:23.766738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:31.567134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=70 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:58:32.922426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ea08d-0a9e-47c6-aea4-280bed533976 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:58:32.925776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-552ea08d-0a9e-47c6-aea4-280bed533976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:33.012786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ea08d-0a9e-47c6-aea4-280bed533976 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:58:33.017789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb2147-7abc-45fd-b657-31407ac6ebe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:58:33.018522 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb2147-7abc-45fd-b657-31407ac6ebe4 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:58:33.019020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb2147-7abc-45fd-b657-31407ac6ebe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:58:33.019621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb2147-7abc-45fd-b657-31407ac6ebe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:58:33.021807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-09cb2147-7abc-45fd-b657-31407ac6ebe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:58:33.095525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb2147-7abc-45fd-b657-31407ac6ebe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:58:33.097145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb2147-7abc-45fd-b657-31407ac6ebe4 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:58:33.107689 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4299/8635] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:58:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:58:43.102775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=50 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:01.758597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf657-9ca3-47db-aef2-665cebe30152 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:01.760141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-bbfdf657-9ca3-47db-aef2-665cebe30152 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:01.849975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfdf657-9ca3-47db-aef2-665cebe30152 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:01.855675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11e6c7-cbe8-4222-b77a-8a01e5dbf59a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:01.856465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e6c7-cbe8-4222-b77a-8a01e5dbf59a service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:01.856742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e6c7-cbe8-4222-b77a-8a01e5dbf59a service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:01.857012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11e6c7-cbe8-4222-b77a-8a01e5dbf59a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:01.858800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2b11e6c7-cbe8-4222-b77a-8a01e5dbf59a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:01.869939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11e6c7-cbe8-4222-b77a-8a01e5dbf59a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:01.871911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11e6c7-cbe8-4222-b77a-8a01e5dbf59a service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:01.881565 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4337/8636] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:59:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:59:02.010370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38130-cbed-4437-b02d-992f786939ce None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:02.011066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38130-cbed-4437-b02d-992f786939ce None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:02.011227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38130-cbed-4437-b02d-992f786939ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:02.035850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b6f38130-cbed-4437-b02d-992f786939ce None None] MFA Rules not processed for user `14f4460822964a7fa4de923c76b1e374`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:59:02.037367 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b6f38130-cbed-4437-b02d-992f786939ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:02.046307 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4300/8637] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:59:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:59:05.419725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ef100-753e-468e-a8f3-5917ab4a53db None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:05.420245 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ef100-753e-468e-a8f3-5917ab4a53db None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:05.420394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ef100-753e-468e-a8f3-5917ab4a53db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:05.440948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c67ef100-753e-468e-a8f3-5917ab4a53db None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:59:05.442324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c67ef100-753e-468e-a8f3-5917ab4a53db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:05.450107 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4338/8638] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 04:59:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 04:59:05.463978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f38130-cbed-4437-b02d-992f786939ce None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:05.481227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f38130-cbed-4437-b02d-992f786939ce None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:05.487053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9415-d32f-47ba-bc60-e03f925bc9e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:05.488188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9415-d32f-47ba-bc60-e03f925bc9e6 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:05.488464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9415-d32f-47ba-bc60-e03f925bc9e6 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:05.488731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe9415-d32f-47ba-bc60-e03f925bc9e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:05.499108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe9415-d32f-47ba-bc60-e03f925bc9e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:05.501198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe9415-d32f-47ba-bc60-e03f925bc9e6 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:05.510986 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4301/8639] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 04:59:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 04:59:08.756482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ef100-753e-468e-a8f3-5917ab4a53db None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:08.761188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c67ef100-753e-468e-a8f3-5917ab4a53db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:08.775459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ef100-753e-468e-a8f3-5917ab4a53db None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:08.779538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dcbcc-19d4-49ec-b8ef-0d76524a747e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:08.780168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dcbcc-19d4-49ec-b8ef-0d76524a747e service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:08.780448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dcbcc-19d4-49ec-b8ef-0d76524a747e service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:08.780719 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dcbcc-19d4-49ec-b8ef-0d76524a747e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:08.782525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-702dcbcc-19d4-49ec-b8ef-0d76524a747e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:08.803189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dcbcc-19d4-49ec-b8ef-0d76524a747e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:08.805232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dcbcc-19d4-49ec-b8ef-0d76524a747e service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:08.821588 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4339/8640] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:59:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:59:11.425520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9415-d32f-47ba-bc60-e03f925bc9e6 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:11.439975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe9415-d32f-47ba-bc60-e03f925bc9e6 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:11.445112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26592374-66a8-4300-ab32-2f75f5a64e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:11.446205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26592374-66a8-4300-ab32-2f75f5a64e12 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:11.446659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26592374-66a8-4300-ab32-2f75f5a64e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:11.446930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26592374-66a8-4300-ab32-2f75f5a64e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:11.449237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-26592374-66a8-4300-ab32-2f75f5a64e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:11.469501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26592374-66a8-4300-ab32-2f75f5a64e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:11.471744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26592374-66a8-4300-ab32-2f75f5a64e12 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:11.489779 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4302/8641] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:59:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 04:59:18.812952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=47 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:21.478893 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=15 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:31.558859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dcbcc-19d4-49ec-b8ef-0d76524a747e service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:31.560833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-702dcbcc-19d4-49ec-b8ef-0d76524a747e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:31.692158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dcbcc-19d4-49ec-b8ef-0d76524a747e service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:31.697016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:31.697831 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:31.698324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:31.698655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] PATH_INFO: `/v3/users/8579769774234e2088cb6e6fbe8fcc03` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:31.699829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8579769774234e2088cb6e6fbe8fcc03)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:31.701786 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:31.763309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8579769774234e2088cb6e6fbe8fcc03'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:31.764008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8579769774234e2088cb6e6fbe8fcc03'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:31.771105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8579769774234e2088cb6e6fbe8fcc03'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:31.779754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8579769774234e2088cb6e6fbe8fcc03'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:31.793003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8579769774234e2088cb6e6fbe8fcc03'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:31.799201 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4340/8642] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:59:31 2022] DELETE /identity/v3/users/8579769774234e2088cb6e6fbe8fcc03 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:59:32.005029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26592374-66a8-4300-ab32-2f75f5a64e12 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:32.016243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26592374-66a8-4300-ab32-2f75f5a64e12 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:32.076031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:32.076674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:32.076943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:32.077216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] PATH_INFO: `/v3/projects/f764025ac7bd4e81995dde9a5185bd80` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:32.078370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f764025ac7bd4e81995dde9a5185bd80)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:32.080317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:32.131741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f764025ac7bd4e81995dde9a5185bd80', 'request_id': 'req-1937a143-1e73-4b40-b9d4-6770cb981e8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.141127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f764025ac7bd4e81995dde9a5185bd80', 'request_id': 'req-1937a143-1e73-4b40-b9d4-6770cb981e8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.148198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f764025ac7bd4e81995dde9a5185bd80', 'request_id': 'req-1937a143-1e73-4b40-b9d4-6770cb981e8b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.159590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] The token cache is being invalidate because project f764025ac7bd4e81995dde9a5185bd80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:59:32.160236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.160899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.162583 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4303/8643] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:59:32 2022] DELETE /identity/v3/projects/f764025ac7bd4e81995dde9a5185bd80 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:59:32.167616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:32.169548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:32.184762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46148726-9816-491f-a28b-80c029bca5d1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:32.260059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:32.260872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:32.261313 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:32.261708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] PATH_INFO: `/v3/users/5f0f2442740a4e0dabee53938c6fc760` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:32.263035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0f2442740a4e0dabee53938c6fc760)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:32.265250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:32.292257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:32.337323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0f2442740a4e0dabee53938c6fc760'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.338008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0f2442740a4e0dabee53938c6fc760'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.346348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0f2442740a4e0dabee53938c6fc760'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.356171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0f2442740a4e0dabee53938c6fc760'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.371475 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-797a5738-dddc-4654-a308-6d6fa8f87d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0f2442740a4e0dabee53938c6fc760'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.381080 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4341/8644] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 04:59:32 2022] DELETE /identity/v3/users/5f0f2442740a4e0dabee53938c6fc760 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 04:59:32.569323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:32.571408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:32.581147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477836-6123-4fa1-9ece-4f0d5d24ae8f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:32.581655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477836-6123-4fa1-9ece-4f0d5d24ae8f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:32.581774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477836-6123-4fa1-9ece-4f0d5d24ae8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:32.599397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937a143-1e73-4b40-b9d4-6770cb981e8b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:32.608258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-12477836-6123-4fa1-9ece-4f0d5d24ae8f None None] MFA Rules not processed for user `a9ef01029e264fbca52310cfe3edfb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 04:59:32.610027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-12477836-6123-4fa1-9ece-4f0d5d24ae8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:32.670273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:32.671160 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:32.671598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:32.672152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] PATH_INFO: `/v3/projects/5737b651cf954ed0ac000687ca89863a` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:32.673556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5737b651cf954ed0ac000687ca89863a)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:32.676146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:32.690380 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4342/8645] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 04:59:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 04:59:32.758549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:32.776624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5737b651cf954ed0ac000687ca89863a', 'request_id': 'req-f3b19712-b36a-4af4-8857-fd011bdccfd0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.787288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5737b651cf954ed0ac000687ca89863a', 'request_id': 'req-f3b19712-b36a-4af4-8857-fd011bdccfd0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.795162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5737b651cf954ed0ac000687ca89863a', 'request_id': 'req-f3b19712-b36a-4af4-8857-fd011bdccfd0'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.807650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] The token cache is being invalidate because project 5737b651cf954ed0ac000687ca89863a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 04:59:32.808301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.809202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 04:59:32.812034 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4304/8646] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 04:59:32 2022] DELETE /identity/v3/projects/5737b651cf954ed0ac000687ca89863a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 04:59:42.675067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=7,keystone:SELECT=45,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:42.804312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:57.663220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477836-6123-4fa1-9ece-4f0d5d24ae8f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 04:59:57.664906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-12477836-6123-4fa1-9ece-4f0d5d24ae8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:57.736614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477836-6123-4fa1-9ece-4f0d5d24ae8f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 04:59:57.790978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b043dfe-3536-48b8-b5ed-2fe371af0cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 04:59:57.791675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043dfe-3536-48b8-b5ed-2fe371af0cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 04:59:57.791958 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043dfe-3536-48b8-b5ed-2fe371af0cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 04:59:57.792226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b043dfe-3536-48b8-b5ed-2fe371af0cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 04:59:57.794528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5b043dfe-3536-48b8-b5ed-2fe371af0cd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 04:59:57.870507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b043dfe-3536-48b8-b5ed-2fe371af0cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 04:59:57.879102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b043dfe-3536-48b8-b5ed-2fe371af0cd4 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 04:59:57.907895 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4343/8647] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 04:59:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:00:00.107378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:00.109448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:00.127721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19712-b36a-4af4-8857-fd011bdccfd0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:00.131905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1c234-91aa-48cc-a998-f894208b0f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:00.132546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1c234-91aa-48cc-a998-f894208b0f99 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:00.132825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1c234-91aa-48cc-a998-f894208b0f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:00.133089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1c234-91aa-48cc-a998-f894208b0f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:00.135174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6ee1c234-91aa-48cc-a998-f894208b0f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:00.149311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1c234-91aa-48cc-a998-f894208b0f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:00.150924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1c234-91aa-48cc-a998-f894208b0f99 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:00.164274 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4305/8648] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:00:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:00:07.890859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=70 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:10.159201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:19.050078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcdce4-ba6c-434d-b43c-4d415c54f846 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:19.050661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcdce4-ba6c-434d-b43c-4d415c54f846 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:19.050661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcdce4-ba6c-434d-b43c-4d415c54f846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:19.071805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d6fcdce4-ba6c-434d-b43c-4d415c54f846 None None] MFA Rules not processed for user `14f4460822964a7fa4de923c76b1e374`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:00:19.073107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d6fcdce4-ba6c-434d-b43c-4d415c54f846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:19.130799 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4344/8649] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:00:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:00:19.401312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1c234-91aa-48cc-a998-f894208b0f99 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:00:19.403143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6ee1c234-91aa-48cc-a998-f894208b0f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:19.418402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1c234-91aa-48cc-a998-f894208b0f99 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:00:19.423607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc63729-f320-4ab3-b409-8f6348c1c546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:00:19.424224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63729-f320-4ab3-b409-8f6348c1c546 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:00:19.424503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63729-f320-4ab3-b409-8f6348c1c546 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:00:19.424769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc63729-f320-4ab3-b409-8f6348c1c546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:00:19.426916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0dc63729-f320-4ab3-b409-8f6348c1c546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:00:19.440911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc63729-f320-4ab3-b409-8f6348c1c546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:00:19.442483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc63729-f320-4ab3-b409-8f6348c1c546 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:00:19.453357 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4306/8650] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:00:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:00:29.123659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=25 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:00:29.447184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:01.660330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcdce4-ba6c-434d-b43c-4d415c54f846 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:01.661988 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d6fcdce4-ba6c-434d-b43c-4d415c54f846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:01.745490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcdce4-ba6c-434d-b43c-4d415c54f846 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:01.751566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa41f8-660a-41e8-a40e-6c2142a3833f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:01.752192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa41f8-660a-41e8-a40e-6c2142a3833f service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:01.752467 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa41f8-660a-41e8-a40e-6c2142a3833f service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:01.752779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa41f8-660a-41e8-a40e-6c2142a3833f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:01.754557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4daa41f8-660a-41e8-a40e-6c2142a3833f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:01.770530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa41f8-660a-41e8-a40e-6c2142a3833f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:01.772315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa41f8-660a-41e8-a40e-6c2142a3833f service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:01.785772 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4345/8651] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:01:11.778575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=34 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:48.136579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc63729-f320-4ab3-b409-8f6348c1c546 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:48.138034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0dc63729-f320-4ab3-b409-8f6348c1c546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:48.201430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa41f8-660a-41e8-a40e-6c2142a3833f service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:48.203701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4daa41f8-660a-41e8-a40e-6c2142a3833f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:48.265076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc63729-f320-4ab3-b409-8f6348c1c546 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:48.270459 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914edce9-1237-4e2b-8094-688218b146c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:48.271081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914edce9-1237-4e2b-8094-688218b146c3 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:48.271361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914edce9-1237-4e2b-8094-688218b146c3 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:48.271626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914edce9-1237-4e2b-8094-688218b146c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:48.273380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-914edce9-1237-4e2b-8094-688218b146c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:48.288021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914edce9-1237-4e2b-8094-688218b146c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:48.289657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914edce9-1237-4e2b-8094-688218b146c3 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:48.301343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa41f8-660a-41e8-a40e-6c2142a3833f service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:48.305057 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4307/8652] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:01:48.306756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:48.307538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:48.307961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:48.308405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] PATH_INFO: `/v3/users/14f4460822964a7fa4de923c76b1e374` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:48.309746 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f4460822964a7fa4de923c76b1e374)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:48.311933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:48.372716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f4460822964a7fa4de923c76b1e374'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:01:48.373378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f4460822964a7fa4de923c76b1e374'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:01:48.381323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f4460822964a7fa4de923c76b1e374'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:01:48.390701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f4460822964a7fa4de923c76b1e374'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:01:48.402822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-0a230f0a-b506-4126-88e4-aba056d4d3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f4460822964a7fa4de923c76b1e374'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:01:48.409124 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4346/8653] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:01:48 2022] DELETE /identity/v3/users/14f4460822964a7fa4de923c76b1e374 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:01:48.594333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914edce9-1237-4e2b-8094-688218b146c3 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:48.625344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914edce9-1237-4e2b-8094-688218b146c3 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:48.682797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:48.683430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:48.683729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:48.683995 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] PATH_INFO: `/v3/projects/23f8950f1af14715ae86c0c8e365e720` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:48.685127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f8950f1af14715ae86c0c8e365e720)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:48.687110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:48.731914 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:48.735907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f8950f1af14715ae86c0c8e365e720', 'request_id': 'req-6a499769-47ed-4dac-9d7a-24750abe92fe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:01:48.745758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f8950f1af14715ae86c0c8e365e720', 'request_id': 'req-6a499769-47ed-4dac-9d7a-24750abe92fe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:01:48.752580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f8950f1af14715ae86c0c8e365e720', 'request_id': 'req-6a499769-47ed-4dac-9d7a-24750abe92fe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:01:48.763600 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] The token cache is being invalidate because project 23f8950f1af14715ae86c0c8e365e720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:01:48.763877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:01:48.764592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-6a499769-47ed-4dac-9d7a-24750abe92fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:01:48.766314 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4308/8654] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:01:48 2022] DELETE /identity/v3/projects/23f8950f1af14715ae86c0c8e365e720 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:01:48.771835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811fe5-d0e9-490c-8e42-2fb404552ca0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:48.772120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811fe5-d0e9-490c-8e42-2fb404552ca0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:48.772388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93811fe5-d0e9-490c-8e42-2fb404552ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:48.794149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-93811fe5-d0e9-490c-8e42-2fb404552ca0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:48.795370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-93811fe5-d0e9-490c-8e42-2fb404552ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:48.844962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:48.861290 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4347/8655] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:48.867138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0323b1d-2196-45d7-a507-f2865e9e1a46 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:48.867509 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0323b1d-2196-45d7-a507-f2865e9e1a46 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:48.867881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0323b1d-2196-45d7-a507-f2865e9e1a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:48.897201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e0323b1d-2196-45d7-a507-f2865e9e1a46 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:48.898362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e0323b1d-2196-45d7-a507-f2865e9e1a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:48.907351 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4309/8656] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:48.911868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93811fe5-d0e9-490c-8e42-2fb404552ca0 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:48.922403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93811fe5-d0e9-490c-8e42-2fb404552ca0 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:48.928304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27e03-9062-4b36-bf70-a4c00975d91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:48.928880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27e03-9062-4b36-bf70-a4c00975d91f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:48.929159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27e03-9062-4b36-bf70-a4c00975d91f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:48.929461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d27e03-9062-4b36-bf70-a4c00975d91f admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:48.930166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27e03-9062-4b36-bf70-a4c00975d91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:01:48.930468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27e03-9062-4b36-bf70-a4c00975d91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:48.932052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d27e03-9062-4b36-bf70-a4c00975d91f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:48.944396 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4348/8657] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:01:48.948777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0323b1d-2196-45d7-a507-f2865e9e1a46 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:48.958635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0323b1d-2196-45d7-a507-f2865e9e1a46 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:48.963715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd78e7d-4048-43b5-8474-0cb01f5951f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:48.964680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd78e7d-4048-43b5-8474-0cb01f5951f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:48.964961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd78e7d-4048-43b5-8474-0cb01f5951f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:48.965225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd78e7d-4048-43b5-8474-0cb01f5951f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:48.965857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd78e7d-4048-43b5-8474-0cb01f5951f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:48.967949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd78e7d-4048-43b5-8474-0cb01f5951f2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:48.996114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4310/8658] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:01:48 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:01:49.000577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27e03-9062-4b36-bf70-a4c00975d91f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.011172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d27e03-9062-4b36-bf70-a4c00975d91f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.070706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe034cc-4a2f-40dd-a338-f88a230d2cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.071317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe034cc-4a2f-40dd-a338-f88a230d2cad admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.071593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe034cc-4a2f-40dd-a338-f88a230d2cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.071842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe034cc-4a2f-40dd-a338-f88a230d2cad admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.072466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe034cc-4a2f-40dd-a338-f88a230d2cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.074466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe034cc-4a2f-40dd-a338-f88a230d2cad admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.101167 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4349/8659] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:01:48 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:01:49.106205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd78e7d-4048-43b5-8474-0cb01f5951f2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.118686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd78e7d-4048-43b5-8474-0cb01f5951f2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.123763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd39b7-8739-43ae-b872-7cb1f8aaa46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.124369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd39b7-8739-43ae-b872-7cb1f8aaa46a admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.124648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd39b7-8739-43ae-b872-7cb1f8aaa46a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.124920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd39b7-8739-43ae-b872-7cb1f8aaa46a admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.125591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd39b7-8739-43ae-b872-7cb1f8aaa46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.127442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd39b7-8739-43ae-b872-7cb1f8aaa46a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.138135 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4311/8660] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:01:49.142375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe034cc-4a2f-40dd-a338-f88a230d2cad admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.153306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe034cc-4a2f-40dd-a338-f88a230d2cad admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.158892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d495f-aa87-4dd6-b580-18ab48516a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.159520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d495f-aa87-4dd6-b580-18ab48516a9f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.159795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d495f-aa87-4dd6-b580-18ab48516a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.160058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d495f-aa87-4dd6-b580-18ab48516a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.160752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d495f-aa87-4dd6-b580-18ab48516a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.162405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d495f-aa87-4dd6-b580-18ab48516a9f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.174372 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4350/8661] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:01:49.180479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd39b7-8739-43ae-b872-7cb1f8aaa46a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.194085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd39b7-8739-43ae-b872-7cb1f8aaa46a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.200098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a18e6-43a7-4a27-a47c-b2a60ec1eeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.200758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a18e6-43a7-4a27-a47c-b2a60ec1eeff admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.201037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a18e6-43a7-4a27-a47c-b2a60ec1eeff admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.201282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a18e6-43a7-4a27-a47c-b2a60ec1eeff admin admin] PATH_INFO: `/v3/projects/034985deb9f247a980ea90ee864655a6/users/9da5025c748446d6a2c084c6441b2934/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.217467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a18e6-43a7-4a27-a47c-b2a60ec1eeff admin admin] RBAC: Authorizing `identity:create_grant(project_id=034985deb9f247a980ea90ee864655a6, user_id=9da5025c748446d6a2c084c6441b2934, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.220665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a18e6-43a7-4a27-a47c-b2a60ec1eeff admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.236680 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4312/8662] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:01:49 2022] PUT /identity/v3/projects/034985deb9f247a980ea90ee864655a6/users/9da5025c748446d6a2c084c6441b2934/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:01:49.247423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c0e5-56a9-4e69-875c-457eb8f5dd1c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.247908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c0e5-56a9-4e69-875c-457eb8f5dd1c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.248046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c0e5-56a9-4e69-875c-457eb8f5dd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.278007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3ba5c0e5-56a9-4e69-875c-457eb8f5dd1c None None] MFA Rules not processed for user `9da5025c748446d6a2c084c6441b2934`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:49.279221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3ba5c0e5-56a9-4e69-875c-457eb8f5dd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:49.356839 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4351/8663] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:01:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:49.361857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a18e6-43a7-4a27-a47c-b2a60ec1eeff admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.427390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a18e6-43a7-4a27-a47c-b2a60ec1eeff admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.433149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f45c-448a-4458-9a64-e1ac4b054859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.433741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f45c-448a-4458-9a64-e1ac4b054859 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.434066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f45c-448a-4458-9a64-e1ac4b054859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.434354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265f45c-448a-4458-9a64-e1ac4b054859 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.434966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265f45c-448a-4458-9a64-e1ac4b054859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.436863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265f45c-448a-4458-9a64-e1ac4b054859 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.465720 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4313/8664] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:01:49 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:01:49.470639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5c0e5-56a9-4e69-875c-457eb8f5dd1c None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.481973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5c0e5-56a9-4e69-875c-457eb8f5dd1c None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.534528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:49.543341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6730a-7007-4032-8073-e80c87707912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.543961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6730a-7007-4032-8073-e80c87707912 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.544237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6730a-7007-4032-8073-e80c87707912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.544503 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6730a-7007-4032-8073-e80c87707912 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.545159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6730a-7007-4032-8073-e80c87707912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.547111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6730a-7007-4032-8073-e80c87707912 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.570146 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4352/8665] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:01:49 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:01:49.574926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f45c-448a-4458-9a64-e1ac4b054859 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.585708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265f45c-448a-4458-9a64-e1ac4b054859 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.590865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce9f6b-e81b-4687-b372-e95b8230902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.591469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce9f6b-e81b-4687-b372-e95b8230902f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.591773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce9f6b-e81b-4687-b372-e95b8230902f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.592048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce9f6b-e81b-4687-b372-e95b8230902f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.592792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce9f6b-e81b-4687-b372-e95b8230902f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.594500 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce9f6b-e81b-4687-b372-e95b8230902f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.606296 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4314/8666] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:01:49.611428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6730a-7007-4032-8073-e80c87707912 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.622706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6730a-7007-4032-8073-e80c87707912 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.628783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679cbef-c1de-4e6c-9f46-beaa2c9621e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.629454 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679cbef-c1de-4e6c-9f46-beaa2c9621e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.629728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679cbef-c1de-4e6c-9f46-beaa2c9621e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.630029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679cbef-c1de-4e6c-9f46-beaa2c9621e1 admin admin] PATH_INFO: `/v3/projects/a75e505513b94d87ba733819e489a741/users/3a53019f0627449ca634ab10dd9b7ee6/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.647124 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679cbef-c1de-4e6c-9f46-beaa2c9621e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75e505513b94d87ba733819e489a741, user_id=3a53019f0627449ca634ab10dd9b7ee6, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.649806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679cbef-c1de-4e6c-9f46-beaa2c9621e1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.666719 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4353/8667] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:01:49 2022] PUT /identity/v3/projects/a75e505513b94d87ba733819e489a741/users/3a53019f0627449ca634ab10dd9b7ee6/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:01:49.671226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce9f6b-e81b-4687-b372-e95b8230902f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.682589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce9f6b-e81b-4687-b372-e95b8230902f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.725693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:49.744964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df30ecd-89d4-4aa0-b6df-0f4431dd1f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.745573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df30ecd-89d4-4aa0-b6df-0f4431dd1f81 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.745847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df30ecd-89d4-4aa0-b6df-0f4431dd1f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.746142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df30ecd-89d4-4aa0-b6df-0f4431dd1f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.746779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df30ecd-89d4-4aa0-b6df-0f4431dd1f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.748390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df30ecd-89d4-4aa0-b6df-0f4431dd1f81 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.758901 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4315/8668] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:01:49.765790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679cbef-c1de-4e6c-9f46-beaa2c9621e1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.779324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679cbef-c1de-4e6c-9f46-beaa2c9621e1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:49.785046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d8442-c24f-44c1-bc53-3569d0c9cf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:49.785712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d8442-c24f-44c1-bc53-3569d0c9cf1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.786022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d8442-c24f-44c1-bc53-3569d0c9cf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.786290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d8442-c24f-44c1-bc53-3569d0c9cf1d admin admin] PATH_INFO: `/v3/projects/a75e505513b94d87ba733819e489a741/users/3a53019f0627449ca634ab10dd9b7ee6/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.788460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d8442-c24f-44c1-bc53-3569d0c9cf1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75e505513b94d87ba733819e489a741, user_id=3a53019f0627449ca634ab10dd9b7ee6, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:49.791175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d8442-c24f-44c1-bc53-3569d0c9cf1d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:49.802575 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4354/8669] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:01:49 2022] PUT /identity/v3/projects/a75e505513b94d87ba733819e489a741/users/3a53019f0627449ca634ab10dd9b7ee6/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:01:49.817604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda825-f9a9-49ac-9847-b4d50162d3e7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:49.817917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda825-f9a9-49ac-9847-b4d50162d3e7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:49.818222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda825-f9a9-49ac-9847-b4d50162d3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:49.849760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-32dda825-f9a9-49ac-9847-b4d50162d3e7 None None] MFA Rules not processed for user `3a53019f0627449ca634ab10dd9b7ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:49.851042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-32dda825-f9a9-49ac-9847-b4d50162d3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:49.925135 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4316/8670] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:01:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:01:49.941858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d8442-c24f-44c1-bc53-3569d0c9cf1d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:49.944069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c4d8442-c24f-44c1-bc53-3569d0c9cf1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:50.022723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d8442-c24f-44c1-bc53-3569d0c9cf1d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:50.029478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943420be-5f4a-4a4d-a5b2-937b7994e015 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:50.030113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943420be-5f4a-4a4d-a5b2-937b7994e015 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:50.030385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943420be-5f4a-4a4d-a5b2-937b7994e015 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:50.030650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943420be-5f4a-4a4d-a5b2-937b7994e015 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:50.096616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943420be-5f4a-4a4d-a5b2-937b7994e015 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:50.098923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943420be-5f4a-4a4d-a5b2-937b7994e015 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:50.113272 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4355/8671] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:01:53.294127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa55d2-7a13-4862-bf52-b10bccb7373e None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:53.294708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa55d2-7a13-4862-bf52-b10bccb7373e None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:53.294708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa55d2-7a13-4862-bf52-b10bccb7373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:53.333094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-03aa55d2-7a13-4862-bf52-b10bccb7373e None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:53.334356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-03aa55d2-7a13-4862-bf52-b10bccb7373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:53.386858 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4317/8672] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Aug 30 05:01:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:01:53.393755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943420be-5f4a-4a4d-a5b2-937b7994e015 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:01:53.403430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943420be-5f4a-4a4d-a5b2-937b7994e015 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:01:53.407332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84dd0d-8f40-475d-8b3d-967af6e11287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:01:53.408248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84dd0d-8f40-475d-8b3d-967af6e11287 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:53.408678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84dd0d-8f40-475d-8b3d-967af6e11287 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:53.408955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84dd0d-8f40-475d-8b3d-967af6e11287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:53.418613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84dd0d-8f40-475d-8b3d-967af6e11287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:01:53.420055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84dd0d-8f40-475d-8b3d-967af6e11287 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:01:53.431179 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4356/8673] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:01:53 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:01:56.059061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994592d4-4f7d-48db-aacf-b33e3cf8c114 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:01:56.060098 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994592d4-4f7d-48db-aacf-b33e3cf8c114 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:01:56.060604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994592d4-4f7d-48db-aacf-b33e3cf8c114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:01:56.089753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-994592d4-4f7d-48db-aacf-b33e3cf8c114 None None] MFA Rules not processed for user `9da5025c748446d6a2c084c6441b2934`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:01:56.091616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-994592d4-4f7d-48db-aacf-b33e3cf8c114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:01:56.108120 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4318/8674] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:01:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:03.426201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:04.263913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d369dee-6aaa-496d-b490-016d50d584ed None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:04.264208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d369dee-6aaa-496d-b490-016d50d584ed None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:04.264479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d369dee-6aaa-496d-b490-016d50d584ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:04.284888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0d369dee-6aaa-496d-b490-016d50d584ed None None] MFA Rules not processed for user `a9ef01029e264fbca52310cfe3edfb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:04.286142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0d369dee-6aaa-496d-b490-016d50d584ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:04.348843 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4357/8675] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:02:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:04.681706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ef4b-6534-4de1-b58b-90a5ebdfcc16 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:04.682290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ef4b-6534-4de1-b58b-90a5ebdfcc16 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:04.682290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0ef4b-6534-4de1-b58b-90a5ebdfcc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:04.714135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7ad0ef4b-6534-4de1-b58b-90a5ebdfcc16 None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:04.715429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ad0ef4b-6534-4de1-b58b-90a5ebdfcc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:04.722989 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4319/8676] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Aug 30 05:02:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:04.729129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d369dee-6aaa-496d-b490-016d50d584ed None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:04.739490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d369dee-6aaa-496d-b490-016d50d584ed None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:04.743215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73d293-c45c-4e0c-b1fc-c4cb8b33c2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:04.743823 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73d293-c45c-4e0c-b1fc-c4cb8b33c2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:04.744091 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73d293-c45c-4e0c-b1fc-c4cb8b33c2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:04.744356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73d293-c45c-4e0c-b1fc-c4cb8b33c2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:04.746403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-be73d293-c45c-4e0c-b1fc-c4cb8b33c2a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:04.759364 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73d293-c45c-4e0c-b1fc-c4cb8b33c2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:04.760822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73d293-c45c-4e0c-b1fc-c4cb8b33c2a0 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:04.771771 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4358/8677] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:05.275261 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2356c3e-efcf-451f-ab45-07d68e16cb6c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:05.275622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2356c3e-efcf-451f-ab45-07d68e16cb6c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:05.276060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2356c3e-efcf-451f-ab45-07d68e16cb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:05.332190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e2356c3e-efcf-451f-ab45-07d68e16cb6c None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:05.333503 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e2356c3e-efcf-451f-ab45-07d68e16cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:05.342738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:05.401361 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4320/8678] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:02:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:05.414016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73d293-c45c-4e0c-b1fc-c4cb8b33c2a0 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:05.415461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-be73d293-c45c-4e0c-b1fc-c4cb8b33c2a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:05.433399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73d293-c45c-4e0c-b1fc-c4cb8b33c2a0 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:05.439247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783777-4966-4d3f-aa68-7fbdbf9cb197 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:05.439854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783777-4966-4d3f-aa68-7fbdbf9cb197 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:05.440121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783777-4966-4d3f-aa68-7fbdbf9cb197 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:05.440398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a783777-4966-4d3f-aa68-7fbdbf9cb197 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:05.449685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783777-4966-4d3f-aa68-7fbdbf9cb197 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:05.451445 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a783777-4966-4d3f-aa68-7fbdbf9cb197 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:05.462263 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4359/8679] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:11.876641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2356c3e-efcf-451f-ab45-07d68e16cb6c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:11.878368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e2356c3e-efcf-451f-ab45-07d68e16cb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:11.894846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2356c3e-efcf-451f-ab45-07d68e16cb6c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:11.900657 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd28404-5d0c-47ff-bf38-a83d312f4916 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:11.901362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28404-5d0c-47ff-bf38-a83d312f4916 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:11.901643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28404-5d0c-47ff-bf38-a83d312f4916 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:11.901935 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28404-5d0c-47ff-bf38-a83d312f4916 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:11.903802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cdd28404-5d0c-47ff-bf38-a83d312f4916 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:11.930362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd28404-5d0c-47ff-bf38-a83d312f4916 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:11.932526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd28404-5d0c-47ff-bf38-a83d312f4916 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:11.947079 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4321/8680] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:14.311520 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783777-4966-4d3f-aa68-7fbdbf9cb197 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:14.323981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a783777-4966-4d3f-aa68-7fbdbf9cb197 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:14.328926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7de978-a705-4e51-8a60-fa7fd4ee81e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:14.329623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de978-a705-4e51-8a60-fa7fd4ee81e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:14.330227 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de978-a705-4e51-8a60-fa7fd4ee81e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:14.330649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7de978-a705-4e51-8a60-fa7fd4ee81e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:14.335309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ff7de978-a705-4e51-8a60-fa7fd4ee81e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:14.353737 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7de978-a705-4e51-8a60-fa7fd4ee81e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:14.355473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7de978-a705-4e51-8a60-fa7fd4ee81e5 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:14.367626 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4360/8681] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:21.939387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=29 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:23.584647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd28404-5d0c-47ff-bf38-a83d312f4916 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:23.607648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd28404-5d0c-47ff-bf38-a83d312f4916 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:23.614370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afba42-4a04-4fa7-8a97-793c3b9b0087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:23.615002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afba42-4a04-4fa7-8a97-793c3b9b0087 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:23.615282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afba42-4a04-4fa7-8a97-793c3b9b0087 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:23.615568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66afba42-4a04-4fa7-8a97-793c3b9b0087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:23.617436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-66afba42-4a04-4fa7-8a97-793c3b9b0087 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:23.657213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afba42-4a04-4fa7-8a97-793c3b9b0087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:23.658926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66afba42-4a04-4fa7-8a97-793c3b9b0087 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:23.673075 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4322/8682] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:24.362499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=43 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:33.665759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=14 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:02:49.950570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7de978-a705-4e51-8a60-fa7fd4ee81e5 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:49.968017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7de978-a705-4e51-8a60-fa7fd4ee81e5 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:49.973481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689f7de-350f-452e-9b37-c821b6c8f56b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:49.974135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689f7de-350f-452e-9b37-c821b6c8f56b service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:49.974430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689f7de-350f-452e-9b37-c821b6c8f56b service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:49.974712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689f7de-350f-452e-9b37-c821b6c8f56b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:49.976459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8689f7de-350f-452e-9b37-c821b6c8f56b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:49.993804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689f7de-350f-452e-9b37-c821b6c8f56b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:49.995575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689f7de-350f-452e-9b37-c821b6c8f56b service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:50.008961 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4361/8683] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:50.181769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afba42-4a04-4fa7-8a97-793c3b9b0087 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:50.193671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66afba42-4a04-4fa7-8a97-793c3b9b0087 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:50.198497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b4afc-9503-415f-b930-d31cfa5f6132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:50.199282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b4afc-9503-415f-b930-d31cfa5f6132 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:50.199562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b4afc-9503-415f-b930-d31cfa5f6132 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:50.199829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b4afc-9503-415f-b930-d31cfa5f6132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:50.202132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fe3b4afc-9503-415f-b930-d31cfa5f6132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:50.231088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b4afc-9503-415f-b930-d31cfa5f6132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:50.232614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b4afc-9503-415f-b930-d31cfa5f6132 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:50.244274 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4323/8684] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:50.355817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc4c3-e6b9-4f93-a5a4-a733ef84ae24 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:50.356143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc4c3-e6b9-4f93-a5a4-a733ef84ae24 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:50.356572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc4c3-e6b9-4f93-a5a4-a733ef84ae24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:50.377259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6d7cc4c3-e6b9-4f93-a5a4-a733ef84ae24 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:50.378439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6d7cc4c3-e6b9-4f93-a5a4-a733ef84ae24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:50.387121 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4362/8685] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:02:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:50.399041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b4afc-9503-415f-b930-d31cfa5f6132 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:50.414014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b4afc-9503-415f-b930-d31cfa5f6132 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:50.419216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808e63f-e120-4be5-9b73-b2d09a723473 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:50.419823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808e63f-e120-4be5-9b73-b2d09a723473 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:50.420095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808e63f-e120-4be5-9b73-b2d09a723473 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:50.420356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808e63f-e120-4be5-9b73-b2d09a723473 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:50.429632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808e63f-e120-4be5-9b73-b2d09a723473 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:50.431303 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808e63f-e120-4be5-9b73-b2d09a723473 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:50.441509 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4324/8686] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:50.630427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cc4c3-e6b9-4f93-a5a4-a733ef84ae24 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:50.642142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cc4c3-e6b9-4f93-a5a4-a733ef84ae24 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:50.645770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6207708-dadb-4cb7-bea9-08ae40e918fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:50.646481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6207708-dadb-4cb7-bea9-08ae40e918fe service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:50.646758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6207708-dadb-4cb7-bea9-08ae40e918fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:50.647025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6207708-dadb-4cb7-bea9-08ae40e918fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:50.649093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f6207708-dadb-4cb7-bea9-08ae40e918fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:50.666674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6207708-dadb-4cb7-bea9-08ae40e918fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:50.668459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6207708-dadb-4cb7-bea9-08ae40e918fe service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:50.682940 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4363/8687] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:02:50.733555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb7fd-745f-407c-bbab-a57b6e5b3c81 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:50.733897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb7fd-745f-407c-bbab-a57b6e5b3c81 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:50.734193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafb7fd-745f-407c-bbab-a57b6e5b3c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:50.756096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0eafb7fd-745f-407c-bbab-a57b6e5b3c81 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:02:50.757307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0eafb7fd-745f-407c-bbab-a57b6e5b3c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:02:50.767712 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4325/8688] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:02:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:02:50.781867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6207708-dadb-4cb7-bea9-08ae40e918fe service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:02:50.803235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6207708-dadb-4cb7-bea9-08ae40e918fe service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:02:50.812295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2566a7-de08-4020-8859-3a0ddb7d02e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:02:50.813186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2566a7-de08-4020-8859-3a0ddb7d02e4 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:02:50.813562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2566a7-de08-4020-8859-3a0ddb7d02e4 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:02:50.813829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2566a7-de08-4020-8859-3a0ddb7d02e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:02:50.822789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2566a7-de08-4020-8859-3a0ddb7d02e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:02:50.824382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2566a7-de08-4020-8859-3a0ddb7d02e4 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:02:50.834290 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4364/8689] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:02:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:00.750334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=20 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:00.830398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=21 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:05.921855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafb7fd-745f-407c-bbab-a57b6e5b3c81 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:05.935670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafb7fd-745f-407c-bbab-a57b6e5b3c81 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:05.940752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da510e4-67a5-4101-9257-26a93015acb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:05.941325 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da510e4-67a5-4101-9257-26a93015acb3 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:05.941624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da510e4-67a5-4101-9257-26a93015acb3 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:05.941856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da510e4-67a5-4101-9257-26a93015acb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:05.943986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7da510e4-67a5-4101-9257-26a93015acb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:05.958674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da510e4-67a5-4101-9257-26a93015acb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:05.960265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da510e4-67a5-4101-9257-26a93015acb3 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:05.973729 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4326/8690] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:10.386283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2566a7-de08-4020-8859-3a0ddb7d02e4 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:03:10.387821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9e2566a7-de08-4020-8859-3a0ddb7d02e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:10.408104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2566a7-de08-4020-8859-3a0ddb7d02e4 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:03:10.414729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08979e06-26ef-40ca-91b7-efa2660b113d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:03:10.415627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979e06-26ef-40ca-91b7-efa2660b113d service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:03:10.415900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979e06-26ef-40ca-91b7-efa2660b113d service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:03:10.416166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08979e06-26ef-40ca-91b7-efa2660b113d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:03:10.418232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-08979e06-26ef-40ca-91b7-efa2660b113d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:03:10.435973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08979e06-26ef-40ca-91b7-efa2660b113d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:03:10.437702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08979e06-26ef-40ca-91b7-efa2660b113d service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:03:10.454918 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4365/8691] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:03:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:03:15.966492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:20.445615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:02.059776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05178f-a61d-420d-bf4e-4fac79f27341 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:02.060287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05178f-a61d-420d-bf4e-4fac79f27341 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:02.060287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05178f-a61d-420d-bf4e-4fac79f27341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:02.115014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7c05178f-a61d-420d-bf4e-4fac79f27341 None None] MFA Rules not processed for user `38a84e3c6a2d4c0ab3a00851e555330a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:02.116218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7c05178f-a61d-420d-bf4e-4fac79f27341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:02.178408 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4327/8692] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Aug 30 05:04:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:02.187057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08979e06-26ef-40ca-91b7-efa2660b113d service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:02.198401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08979e06-26ef-40ca-91b7-efa2660b113d service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:02.202977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dec5b-f70a-4c99-a733-2ff89276f450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:02.203583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dec5b-f70a-4c99-a733-2ff89276f450 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:02.203854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dec5b-f70a-4c99-a733-2ff89276f450 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:02.204112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82dec5b-f70a-4c99-a733-2ff89276f450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:02.206138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a82dec5b-f70a-4c99-a733-2ff89276f450 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:02.241285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dec5b-f70a-4c99-a733-2ff89276f450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:02.242827 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82dec5b-f70a-4c99-a733-2ff89276f450 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:02.261209 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4366/8693] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:11.275305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219690bd-7a7c-4088-9783-702decfed163 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:11.275934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219690bd-7a7c-4088-9783-702decfed163 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:11.275934 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219690bd-7a7c-4088-9783-702decfed163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:11.306116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-219690bd-7a7c-4088-9783-702decfed163 None None] MFA Rules not processed for user `a9ef01029e264fbca52310cfe3edfb6b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:11.308069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-219690bd-7a7c-4088-9783-702decfed163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:11.315519 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4328/8694] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:04:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:11.361265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dec5b-f70a-4c99-a733-2ff89276f450 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:11.362907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a82dec5b-f70a-4c99-a733-2ff89276f450 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:11.378418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82dec5b-f70a-4c99-a733-2ff89276f450 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:11.383122 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccd475-56ad-4330-9842-7c597156e6bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:11.383745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccd475-56ad-4330-9842-7c597156e6bf service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:11.384022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccd475-56ad-4330-9842-7c597156e6bf service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:11.384285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccd475-56ad-4330-9842-7c597156e6bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:11.386461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-19ccd475-56ad-4330-9842-7c597156e6bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:11.404358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccd475-56ad-4330-9842-7c597156e6bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:11.405796 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccd475-56ad-4330-9842-7c597156e6bf service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:11.420444 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4367/8695] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:12.253378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219690bd-7a7c-4088-9783-702decfed163 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:12.263854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219690bd-7a7c-4088-9783-702decfed163 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:12.269135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4741890-7cd2-4a57-a73b-4d70e7d24b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:12.269832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4741890-7cd2-4a57-a73b-4d70e7d24b4d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:12.270209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4741890-7cd2-4a57-a73b-4d70e7d24b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:12.270480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4741890-7cd2-4a57-a73b-4d70e7d24b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:12.272455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d4741890-7cd2-4a57-a73b-4d70e7d24b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:12.290787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4741890-7cd2-4a57-a73b-4d70e7d24b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:12.292312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4741890-7cd2-4a57-a73b-4d70e7d24b4d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:12.306537 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4329/8696] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:21.412169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=25 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:22.298801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=46 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:22.562109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccd475-56ad-4330-9842-7c597156e6bf service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:04:22.577057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccd475-56ad-4330-9842-7c597156e6bf service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:04:22.582682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e2473-c758-4b99-9bb7-241d0a2c50fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:04:22.583524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e2473-c758-4b99-9bb7-241d0a2c50fa service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:22.583981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e2473-c758-4b99-9bb7-241d0a2c50fa service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:22.584401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e2473-c758-4b99-9bb7-241d0a2c50fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:22.587199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1e2e2473-c758-4b99-9bb7-241d0a2c50fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:22.604803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e2473-c758-4b99-9bb7-241d0a2c50fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:04:22.606543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e2473-c758-4b99-9bb7-241d0a2c50fa service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:04:22.632172 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4368/8697] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:04:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:04:29.005046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bfcef-a783-47ce-ade0-70502a718909 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:04:29.005565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bfcef-a783-47ce-ade0-70502a718909 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:04:29.005674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bfcef-a783-47ce-ade0-70502a718909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:04:29.029139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4c4bfcef-a783-47ce-ade0-70502a718909 None None] MFA Rules not processed for user `9da5025c748446d6a2c084c6441b2934`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:04:29.030537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4c4bfcef-a783-47ce-ade0-70502a718909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:04:29.037620 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4330/8698] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:04:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:04:32.620617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:39.023752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:15.554729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e2473-c758-4b99-9bb7-241d0a2c50fa service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:05:15.566230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e2473-c758-4b99-9bb7-241d0a2c50fa service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:05:15.570149 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd12e2-790d-494b-ad3b-fcf480e98579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:05:15.570909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd12e2-790d-494b-ad3b-fcf480e98579 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:05:15.571185 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd12e2-790d-494b-ad3b-fcf480e98579 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:05:15.571455 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd12e2-790d-494b-ad3b-fcf480e98579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:05:15.573339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-21bd12e2-790d-494b-ad3b-fcf480e98579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:05:15.586976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd12e2-790d-494b-ad3b-fcf480e98579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:05:15.588417 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd12e2-790d-494b-ad3b-fcf480e98579 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:05:15.600147 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4369/8699] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:05:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:05:25.593292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:56.269751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bfcef-a783-47ce-ade0-70502a718909 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:05:56.280059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bfcef-a783-47ce-ade0-70502a718909 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:05:56.285283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1795e-6bec-428c-bcf5-a2569e3b6e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:05:56.286259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1795e-6bec-428c-bcf5-a2569e3b6e3f service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:05:56.286605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1795e-6bec-428c-bcf5-a2569e3b6e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:05:56.286962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1795e-6bec-428c-bcf5-a2569e3b6e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:05:56.290267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a6b1795e-6bec-428c-bcf5-a2569e3b6e3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:05:56.305165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1795e-6bec-428c-bcf5-a2569e3b6e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:05:56.306650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1795e-6bec-428c-bcf5-a2569e3b6e3f service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:05:56.319996 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4331/8700] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:05:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:05:56.354309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd12e2-790d-494b-ad3b-fcf480e98579 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:05:56.370016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd12e2-790d-494b-ad3b-fcf480e98579 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:05:56.376109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e326f32-dd4a-493c-83ab-231fa08899f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:05:56.376730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e326f32-dd4a-493c-83ab-231fa08899f1 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:05:56.377002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e326f32-dd4a-493c-83ab-231fa08899f1 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:05:56.377262 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e326f32-dd4a-493c-83ab-231fa08899f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:05:56.379404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6e326f32-dd4a-493c-83ab-231fa08899f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:05:56.395949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e326f32-dd4a-493c-83ab-231fa08899f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:05:56.397536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e326f32-dd4a-493c-83ab-231fa08899f1 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:05:56.410613 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4370/8701] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:05:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:05:56.575535 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1795e-6bec-428c-bcf5-a2569e3b6e3f service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:05:56.584872 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1795e-6bec-428c-bcf5-a2569e3b6e3f service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:05:56.589380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7bf21-bb0a-4ac5-85f1-6dcd891dd95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:05:56.590035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7bf21-bb0a-4ac5-85f1-6dcd891dd95e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:05:56.590302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7bf21-bb0a-4ac5-85f1-6dcd891dd95e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:05:56.590598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7bf21-bb0a-4ac5-85f1-6dcd891dd95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:05:56.592475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-15b7bf21-bb0a-4ac5-85f1-6dcd891dd95e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:05:56.606012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7bf21-bb0a-4ac5-85f1-6dcd891dd95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:05:56.607488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7bf21-bb0a-4ac5-85f1-6dcd891dd95e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:05:56.619330 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4332/8702] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:05:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:05:56.726825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcec76-2848-433c-9f34-3cf1a192b2a4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:05:56.727329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcec76-2848-433c-9f34-3cf1a192b2a4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:05:56.727778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcec76-2848-433c-9f34-3cf1a192b2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:05:56.748614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0abcec76-2848-433c-9f34-3cf1a192b2a4 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:05:56.749830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0abcec76-2848-433c-9f34-3cf1a192b2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:05:56.759240 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4371/8703] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:05:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:05:56.771109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7bf21-bb0a-4ac5-85f1-6dcd891dd95e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:05:56.786314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7bf21-bb0a-4ac5-85f1-6dcd891dd95e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:05:56.791644 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894012ea-4bde-486f-95ce-0ac6935e4c28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:05:56.792373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894012ea-4bde-486f-95ce-0ac6935e4c28 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:05:56.792650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894012ea-4bde-486f-95ce-0ac6935e4c28 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:05:56.792929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894012ea-4bde-486f-95ce-0ac6935e4c28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:05:56.802295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894012ea-4bde-486f-95ce-0ac6935e4c28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:05:56.804794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894012ea-4bde-486f-95ce-0ac6935e4c28 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:05:56.819745 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4333/8704] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:05:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:05:57.028054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcec76-2848-433c-9f34-3cf1a192b2a4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:05:57.037975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcec76-2848-433c-9f34-3cf1a192b2a4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:05:57.041731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70eab-01ce-4c54-8cc8-6e7e99227a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:05:57.042370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70eab-01ce-4c54-8cc8-6e7e99227a9b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:05:57.042648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70eab-01ce-4c54-8cc8-6e7e99227a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:05:57.042913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a70eab-01ce-4c54-8cc8-6e7e99227a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:05:57.044739 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b8a70eab-01ce-4c54-8cc8-6e7e99227a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:05:57.062220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a70eab-01ce-4c54-8cc8-6e7e99227a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:05:57.063652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a70eab-01ce-4c54-8cc8-6e7e99227a9b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:05:57.080328 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4372/8705] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:05:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:06:06.813225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=18 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:07.070225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=15 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:07.622424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894012ea-4bde-486f-95ce-0ac6935e4c28 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:07.648432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894012ea-4bde-486f-95ce-0ac6935e4c28 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:07.658638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aab075-866d-4188-a53d-8d515646bcad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:07.659677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aab075-866d-4188-a53d-8d515646bcad service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:07.660084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aab075-866d-4188-a53d-8d515646bcad service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:07.660506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aab075-866d-4188-a53d-8d515646bcad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:07.662580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-61aab075-866d-4188-a53d-8d515646bcad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:07.679085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aab075-866d-4188-a53d-8d515646bcad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:07.680740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aab075-866d-4188-a53d-8d515646bcad service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:07.695404 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4334/8706] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:06:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:06:17.687132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:34.268678 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70eab-01ce-4c54-8cc8-6e7e99227a9b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:34.278327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a70eab-01ce-4c54-8cc8-6e7e99227a9b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:34.282219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a5dcc-9709-4881-ab40-37bbb6535f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:34.282835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5dcc-9709-4881-ab40-37bbb6535f0c service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:34.283139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5dcc-9709-4881-ab40-37bbb6535f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:34.283409 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a5dcc-9709-4881-ab40-37bbb6535f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:34.285145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-434a5dcc-9709-4881-ab40-37bbb6535f0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:34.374519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a5dcc-9709-4881-ab40-37bbb6535f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:34.376096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a5dcc-9709-4881-ab40-37bbb6535f0c service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:34.386655 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4373/8707] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:06:40.820924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aab075-866d-4188-a53d-8d515646bcad service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:40.823113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-61aab075-866d-4188-a53d-8d515646bcad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:40.850759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aab075-866d-4188-a53d-8d515646bcad service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:40.855687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:40.856601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:40.856842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:40.857365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] PATH_INFO: `/v3/users/a9ef01029e264fbca52310cfe3edfb6b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:40.858508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ef01029e264fbca52310cfe3edfb6b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:40.860478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:40.917377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ef01029e264fbca52310cfe3edfb6b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:40.924879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ef01029e264fbca52310cfe3edfb6b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:40.937533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ef01029e264fbca52310cfe3edfb6b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:40.946812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ef01029e264fbca52310cfe3edfb6b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:40.947630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ef01029e264fbca52310cfe3edfb6b'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:40.953999 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4335/8708] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:06:40 2022] DELETE /identity/v3/users/a9ef01029e264fbca52310cfe3edfb6b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:06:41.134985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a5dcc-9709-4881-ab40-37bbb6535f0c service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:41.145789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a5dcc-9709-4881-ab40-37bbb6535f0c service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:41.218204 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:41.218784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:41.219064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:41.219335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] PATH_INFO: `/v3/projects/9c1716158a614e5f9d96b95271ca8acf` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:41.220476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1716158a614e5f9d96b95271ca8acf)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:41.222443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:41.270498 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1716158a614e5f9d96b95271ca8acf', 'request_id': 'req-19e9e343-b63d-4c6f-822c-3d06fb072f17'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.276601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1716158a614e5f9d96b95271ca8acf', 'request_id': 'req-19e9e343-b63d-4c6f-822c-3d06fb072f17'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.286531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1716158a614e5f9d96b95271ca8acf', 'request_id': 'req-19e9e343-b63d-4c6f-822c-3d06fb072f17'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.298042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] The token cache is being invalidate because project 9c1716158a614e5f9d96b95271ca8acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:06:41.298327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.299088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.300717 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4374/8709] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:06:41 2022] DELETE /identity/v3/projects/9c1716158a614e5f9d96b95271ca8acf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:06:41.305475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:41.307044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:41.321640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d2d38-6c0e-4e24-a2c7-fdaa9b0b9881 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:41.382702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:41.383357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:41.383612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:41.383880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] PATH_INFO: `/v3/users/a6930d1989684117a7319f43c8f68739` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:41.397182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6930d1989684117a7319f43c8f68739)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:41.399167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:41.449967 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6930d1989684117a7319f43c8f68739'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.456909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6930d1989684117a7319f43c8f68739'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.462634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:41.471328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6930d1989684117a7319f43c8f68739'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.479966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6930d1989684117a7319f43c8f68739'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.480650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6930d1989684117a7319f43c8f68739'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.486722 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4336/8710] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:06:41 2022] DELETE /identity/v3/users/a6930d1989684117a7319f43c8f68739 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:06:41.684567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:06:41.686487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:06:41.697080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:41.701972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9e343-b63d-4c6f-822c-3d06fb072f17 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:06:41.770131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:06:41.771020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:06:41.771309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:06:41.771688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] PATH_INFO: `/v3/projects/bc63a5f413b64d24ae1f9849814f4066` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:06:41.784066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc63a5f413b64d24ae1f9849814f4066)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:06:41.786028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:06:41.833037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc63a5f413b64d24ae1f9849814f4066', 'request_id': 'req-d063e456-b918-41ac-ade6-cd7fa171bb7a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.840609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc63a5f413b64d24ae1f9849814f4066', 'request_id': 'req-d063e456-b918-41ac-ade6-cd7fa171bb7a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.848686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc63a5f413b64d24ae1f9849814f4066', 'request_id': 'req-d063e456-b918-41ac-ade6-cd7fa171bb7a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.859696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] The token cache is being invalidate because project bc63a5f413b64d24ae1f9849814f4066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:06:41.859985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.860624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:06:41.862187 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4375/8711] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:06:41 2022] DELETE /identity/v3/projects/bc63a5f413b64d24ae1f9849814f4066 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:06:51.483807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:51.856667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:04.709695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:04.711360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:04.807037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02741b3a-a40d-41d9-8ac1-2b35375be564 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:04.886649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de4440-0922-44b4-8c25-4ebacc9e1ec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:04.887272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de4440-0922-44b4-8c25-4ebacc9e1ec7 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:04.887548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de4440-0922-44b4-8c25-4ebacc9e1ec7 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:04.887815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de4440-0922-44b4-8c25-4ebacc9e1ec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:04.889587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-55de4440-0922-44b4-8c25-4ebacc9e1ec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:04.960505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de4440-0922-44b4-8c25-4ebacc9e1ec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:04.962176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de4440-0922-44b4-8c25-4ebacc9e1ec7 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:04.971714 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4337/8712] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:14.967465 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=84 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:18.656604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:18.658925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:18.740158 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063e456-b918-41ac-ade6-cd7fa171bb7a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:18.745862 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f0a81-6b4b-461a-bc19-2744df770899 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:18.746513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0a81-6b4b-461a-bc19-2744df770899 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:18.746788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0a81-6b4b-461a-bc19-2744df770899 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:18.747056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f0a81-6b4b-461a-bc19-2744df770899 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:18.748979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c6f0a81-6b4b-461a-bc19-2744df770899 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:18.764885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f0a81-6b4b-461a-bc19-2744df770899 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:18.766444 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f0a81-6b4b-461a-bc19-2744df770899 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:18.780187 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4376/8713] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:27.869015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de4440-0922-44b4-8c25-4ebacc9e1ec7 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:27.871311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-55de4440-0922-44b4-8c25-4ebacc9e1ec7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:27.892870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de4440-0922-44b4-8c25-4ebacc9e1ec7 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:27.899776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a49b54-7ef8-444a-a2be-78986ba5a56d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:27.900388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a49b54-7ef8-444a-a2be-78986ba5a56d service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:27.900668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a49b54-7ef8-444a-a2be-78986ba5a56d service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:27.900933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a49b54-7ef8-444a-a2be-78986ba5a56d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:27.902998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d6a49b54-7ef8-444a-a2be-78986ba5a56d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:27.969293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a49b54-7ef8-444a-a2be-78986ba5a56d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:27.970961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a49b54-7ef8-444a-a2be-78986ba5a56d service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:27.981050 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4338/8714] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:27 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:28.772471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=32 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:35.861373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f0a81-6b4b-461a-bc19-2744df770899 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:35.863007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c6f0a81-6b4b-461a-bc19-2744df770899 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:35.879081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f0a81-6b4b-461a-bc19-2744df770899 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:35.884162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c08a2-86ed-432b-99a4-b304fb22a31a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:35.884838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c08a2-86ed-432b-99a4-b304fb22a31a service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:35.885698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c08a2-86ed-432b-99a4-b304fb22a31a service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:35.885698 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c08a2-86ed-432b-99a4-b304fb22a31a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:35.887440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-292c08a2-86ed-432b-99a4-b304fb22a31a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:35.902756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c08a2-86ed-432b-99a4-b304fb22a31a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:35.904712 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c08a2-86ed-432b-99a4-b304fb22a31a service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:35.920340 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4377/8715] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:37.976564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=30 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:42.896707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e56ec-bc27-45e9-9093-15234c33f150 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:42.897431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e56ec-bc27-45e9-9093-15234c33f150 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:42.897431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e56ec-bc27-45e9-9093-15234c33f150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:42.917975 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-073e56ec-bc27-45e9-9093-15234c33f150 None None] MFA Rules not processed for user `9da5025c748446d6a2c084c6441b2934`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:07:42.919149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-073e56ec-bc27-45e9-9093-15234c33f150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:42.927592 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4339/8716] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:07:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:07:43.316566 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c08a2-86ed-432b-99a4-b304fb22a31a service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:43.318128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-292c08a2-86ed-432b-99a4-b304fb22a31a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:43.400010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c08a2-86ed-432b-99a4-b304fb22a31a service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:43.404812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbff095-1453-4a16-a2fd-d1d4c4a7a1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:43.405441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbff095-1453-4a16-a2fd-d1d4c4a7a1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:43.405718 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbff095-1453-4a16-a2fd-d1d4c4a7a1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:43.406024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbff095-1453-4a16-a2fd-d1d4c4a7a1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:43.407963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0dbff095-1453-4a16-a2fd-d1d4c4a7a1a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:43.422021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbff095-1453-4a16-a2fd-d1d4c4a7a1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:43.423596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbff095-1453-4a16-a2fd-d1d4c4a7a1a4 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:43.438073 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4378/8717] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:45.873828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e56ec-bc27-45e9-9093-15234c33f150 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:45.885998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e56ec-bc27-45e9-9093-15234c33f150 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:45.890613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f3b33-ae0b-4126-9dff-86156cfeaf39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:45.891292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f3b33-ae0b-4126-9dff-86156cfeaf39 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:45.891573 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f3b33-ae0b-4126-9dff-86156cfeaf39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:45.891846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f3b33-ae0b-4126-9dff-86156cfeaf39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:45.894092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-808f3b33-ae0b-4126-9dff-86156cfeaf39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:45.912184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f3b33-ae0b-4126-9dff-86156cfeaf39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:45.913682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f3b33-ae0b-4126-9dff-86156cfeaf39 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:45.927822 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4340/8718] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:51.994817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbff095-1453-4a16-a2fd-d1d4c4a7a1a4 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:07:52.013082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbff095-1453-4a16-a2fd-d1d4c4a7a1a4 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:07:52.019829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce50ed5-e43c-47a9-a01d-dc9c5506ace5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:07:52.020452 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce50ed5-e43c-47a9-a01d-dc9c5506ace5 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:07:52.020723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce50ed5-e43c-47a9-a01d-dc9c5506ace5 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:07:52.020986 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce50ed5-e43c-47a9-a01d-dc9c5506ace5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:07:52.022942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9ce50ed5-e43c-47a9-a01d-dc9c5506ace5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:07:52.039340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce50ed5-e43c-47a9-a01d-dc9c5506ace5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:07:52.041983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce50ed5-e43c-47a9-a01d-dc9c5506ace5 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:07:52.058108 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4379/8719] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:07:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:07:55.920231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=9 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:02.050802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=38 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:09.833239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f3b33-ae0b-4126-9dff-86156cfeaf39 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:08:09.872549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f3b33-ae0b-4126-9dff-86156cfeaf39 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:08:09.879251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d327086-d93d-40e9-8639-17687f60a825 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:08:09.879857 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327086-d93d-40e9-8639-17687f60a825 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:08:09.880130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327086-d93d-40e9-8639-17687f60a825 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:08:09.880394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d327086-d93d-40e9-8639-17687f60a825 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:08:09.882426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2d327086-d93d-40e9-8639-17687f60a825 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:08:09.896984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d327086-d93d-40e9-8639-17687f60a825 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:08:09.898633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d327086-d93d-40e9-8639-17687f60a825 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:08:09.911313 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4341/8720] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:08:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:08:19.904696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:31.521517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce50ed5-e43c-47a9-a01d-dc9c5506ace5 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:08:31.541189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce50ed5-e43c-47a9-a01d-dc9c5506ace5 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:08:31.546615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524f1a4-0249-4c1f-9a59-63afd54317c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:08:31.547224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f1a4-0249-4c1f-9a59-63afd54317c5 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:08:31.547495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f1a4-0249-4c1f-9a59-63afd54317c5 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:08:31.547756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524f1a4-0249-4c1f-9a59-63afd54317c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:08:31.549552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3524f1a4-0249-4c1f-9a59-63afd54317c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:08:31.561322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524f1a4-0249-4c1f-9a59-63afd54317c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:08:31.562936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524f1a4-0249-4c1f-9a59-63afd54317c5 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:08:31.572930 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4380/8721] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:08:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:08:33.929487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d327086-d93d-40e9-8639-17687f60a825 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:08:33.946521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d327086-d93d-40e9-8639-17687f60a825 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:08:33.952954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdebdfa-c749-4fe8-a4e0-3449ec55ef15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:08:33.953604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdebdfa-c749-4fe8-a4e0-3449ec55ef15 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:08:33.953840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdebdfa-c749-4fe8-a4e0-3449ec55ef15 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:08:33.954190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdebdfa-c749-4fe8-a4e0-3449ec55ef15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:08:33.957783 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fdebdfa-c749-4fe8-a4e0-3449ec55ef15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:08:33.975714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdebdfa-c749-4fe8-a4e0-3449ec55ef15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:08:33.977577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdebdfa-c749-4fe8-a4e0-3449ec55ef15 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:08:33.992308 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4342/8722] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:08:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:08:41.568668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:43.984640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:58.236030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f539-f12f-4f83-8c7c-ff1e17339393 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:08:58.236626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f539-f12f-4f83-8c7c-ff1e17339393 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:08:58.236626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f539-f12f-4f83-8c7c-ff1e17339393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:08:58.258252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-02a9f539-f12f-4f83-8c7c-ff1e17339393 None None] MFA Rules not processed for user `9da5025c748446d6a2c084c6441b2934`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:08:58.259491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-02a9f539-f12f-4f83-8c7c-ff1e17339393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:08:58.268506 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4381/8723] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:08:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:08:59.065301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdebdfa-c749-4fe8-a4e0-3449ec55ef15 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:08:59.107493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdebdfa-c749-4fe8-a4e0-3449ec55ef15 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:08:59.114706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979a65b-c207-4835-9a5f-bf15b2e3516e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:08:59.115634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a65b-c207-4835-9a5f-bf15b2e3516e service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:08:59.116103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a65b-c207-4835-9a5f-bf15b2e3516e service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:08:59.116557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979a65b-c207-4835-9a5f-bf15b2e3516e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:08:59.122164 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c979a65b-c207-4835-9a5f-bf15b2e3516e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:08:59.144226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979a65b-c207-4835-9a5f-bf15b2e3516e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:08:59.147801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979a65b-c207-4835-9a5f-bf15b2e3516e service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:08:59.191331 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4343/8724] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:08:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:08.251961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:09.159706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:12.177361 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9f539-f12f-4f83-8c7c-ff1e17339393 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:12.198952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9f539-f12f-4f83-8c7c-ff1e17339393 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:12.203090 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a9b1a-eb97-4fd5-9fc8-61eeb75cda28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:12.203724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a9b1a-eb97-4fd5-9fc8-61eeb75cda28 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:12.203970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a9b1a-eb97-4fd5-9fc8-61eeb75cda28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:12.204264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a9b1a-eb97-4fd5-9fc8-61eeb75cda28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:12.206089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c08a9b1a-eb97-4fd5-9fc8-61eeb75cda28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:12.223558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a9b1a-eb97-4fd5-9fc8-61eeb75cda28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:12.225034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a9b1a-eb97-4fd5-9fc8-61eeb75cda28 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:12.250910 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4382/8725] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:09:22.248754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=14 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:47.093016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979a65b-c207-4835-9a5f-bf15b2e3516e service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:47.103210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979a65b-c207-4835-9a5f-bf15b2e3516e service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:47.107332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4c816-f31b-4f2d-9ebc-5ecfb2a0d262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:47.107937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4c816-f31b-4f2d-9ebc-5ecfb2a0d262 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:47.108205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4c816-f31b-4f2d-9ebc-5ecfb2a0d262 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:47.108468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4c816-f31b-4f2d-9ebc-5ecfb2a0d262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:47.110251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-93e4c816-f31b-4f2d-9ebc-5ecfb2a0d262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:47.126811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4c816-f31b-4f2d-9ebc-5ecfb2a0d262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:47.127173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46513aa-334e-4792-aee1-8ddd31ec3603 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:47.127641 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46513aa-334e-4792-aee1-8ddd31ec3603 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:47.127752 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46513aa-334e-4792-aee1-8ddd31ec3603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:47.128251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4c816-f31b-4f2d-9ebc-5ecfb2a0d262 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:47.142933 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4344/8726] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:09:47.160115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f46513aa-334e-4792-aee1-8ddd31ec3603 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:47.161342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f46513aa-334e-4792-aee1-8ddd31ec3603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:47.170549 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4383/8727] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 30 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:47.186172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73736c2-d352-46aa-bab0-74940d8e4ad4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:47.186583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73736c2-d352-46aa-bab0-74940d8e4ad4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:47.186845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73736c2-d352-46aa-bab0-74940d8e4ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:47.209298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-a73736c2-d352-46aa-bab0-74940d8e4ad4 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:09:47.210669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a73736c2-d352-46aa-bab0-74940d8e4ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:09:47.220773 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4345/8728] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Aug 30 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:09:47.228619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46513aa-334e-4792-aee1-8ddd31ec3603 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:09:47.239822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46513aa-334e-4792-aee1-8ddd31ec3603 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:09:47.245710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9b2ee-8959-4ef1-8f7c-6a268e2745cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:09:47.246371 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b2ee-8959-4ef1-8f7c-6a268e2745cc service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:09:47.246651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b2ee-8959-4ef1-8f7c-6a268e2745cc service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:09:47.246919 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b2ee-8959-4ef1-8f7c-6a268e2745cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:09:47.256263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9b2ee-8959-4ef1-8f7c-6a268e2745cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:09:47.257843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9b2ee-8959-4ef1-8f7c-6a268e2745cc service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:09:47.268830 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4384/8729] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:09:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:09:57.203877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=9 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:57.264107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=13 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:09.792400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8e72b-ed3c-4d97-8f5d-db68797457d0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:09.793025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8e72b-ed3c-4d97-8f5d-db68797457d0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:09.793025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8e72b-ed3c-4d97-8f5d-db68797457d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:09.819049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ddc8e72b-ed3c-4d97-8f5d-db68797457d0 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:09.820268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ddc8e72b-ed3c-4d97-8f5d-db68797457d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:09.831476 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4346/8730] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Aug 30 05:10:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:09.861841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9b2ee-8959-4ef1-8f7c-6a268e2745cc service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:09.876729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9b2ee-8959-4ef1-8f7c-6a268e2745cc service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:09.883264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc49e0-f986-44b7-9303-286146b7e84f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:09.884035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc49e0-f986-44b7-9303-286146b7e84f service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:09.884714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc49e0-f986-44b7-9303-286146b7e84f service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:09.884989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc49e0-f986-44b7-9303-286146b7e84f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:09.894321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc49e0-f986-44b7-9303-286146b7e84f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:09.895936 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc49e0-f986-44b7-9303-286146b7e84f service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:09.906862 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4385/8731] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:19.813058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:19.902608 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:48.355419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8e72b-ed3c-4d97-8f5d-db68797457d0 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.369179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8e72b-ed3c-4d97-8f5d-db68797457d0 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.374260 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8db110-388d-4b26-82f2-7d667f70bdc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.374865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8db110-388d-4b26-82f2-7d667f70bdc5 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.375136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8db110-388d-4b26-82f2-7d667f70bdc5 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.375400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8db110-388d-4b26-82f2-7d667f70bdc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.377078 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c8db110-388d-4b26-82f2-7d667f70bdc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:48.391584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8db110-388d-4b26-82f2-7d667f70bdc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:48.393181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8db110-388d-4b26-82f2-7d667f70bdc5 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:48.406015 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4347/8732] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:48.621485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc49e0-f986-44b7-9303-286146b7e84f service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.625189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-03bc49e0-f986-44b7-9303-286146b7e84f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:48.720289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc49e0-f986-44b7-9303-286146b7e84f service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.727080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.728285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.728285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.728428 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] PATH_INFO: `/v3/users/9da5025c748446d6a2c084c6441b2934` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.729604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da5025c748446d6a2c084c6441b2934)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:48.732721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:48.788436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da5025c748446d6a2c084c6441b2934'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:48.789093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da5025c748446d6a2c084c6441b2934'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:48.796057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da5025c748446d6a2c084c6441b2934'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:48.806225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da5025c748446d6a2c084c6441b2934'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:48.820077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da5025c748446d6a2c084c6441b2934'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:48.826461 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4386/8733] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:48 2022] DELETE /identity/v3/users/9da5025c748446d6a2c084c6441b2934 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:48.831185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6b33-02a8-4897-992f-a8828c6737ed None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:48.831541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6b33-02a8-4897-992f-a8828c6737ed None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:48.831874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac6b33-02a8-4897-992f-a8828c6737ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:48.859979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b8ac6b33-02a8-4897-992f-a8828c6737ed None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:48.861147 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8ac6b33-02a8-4897-992f-a8828c6737ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:48.922783 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4348/8734] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:48.933041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:48.934579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:48.994664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ca070-4683-4e66-b878-2261a4f385cc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:48.999206 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37cc1a-4130-4ba0-9207-cacbb8820b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:48.999808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37cc1a-4130-4ba0-9207-cacbb8820b4b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.000078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37cc1a-4130-4ba0-9207-cacbb8820b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.000345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37cc1a-4130-4ba0-9207-cacbb8820b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.010602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37cc1a-4130-4ba0-9207-cacbb8820b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.012047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37cc1a-4130-4ba0-9207-cacbb8820b4b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.022388 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4387/8735] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:49.219524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac6b33-02a8-4897-992f-a8828c6737ed None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.220931 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b8ac6b33-02a8-4897-992f-a8828c6737ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.233062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac6b33-02a8-4897-992f-a8828c6737ed None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.238479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.239124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.239497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.239768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] PATH_INFO: `/v3/projects/034985deb9f247a980ea90ee864655a6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.240913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] RBAC: Authorizing `identity:delete_project(project_id=034985deb9f247a980ea90ee864655a6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.243262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.293950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034985deb9f247a980ea90ee864655a6', 'request_id': 'req-60e06014-da80-4bd4-9423-f38d0fb6c1be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.304929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034985deb9f247a980ea90ee864655a6', 'request_id': 'req-60e06014-da80-4bd4-9423-f38d0fb6c1be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.311480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034985deb9f247a980ea90ee864655a6', 'request_id': 'req-60e06014-da80-4bd4-9423-f38d0fb6c1be'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.322882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] The token cache is being invalidate because project 034985deb9f247a980ea90ee864655a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:49.323166 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.323800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.325602 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4349/8736] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:49 2022] DELETE /identity/v3/projects/034985deb9f247a980ea90ee864655a6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:49.330003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37cc1a-4130-4ba0-9207-cacbb8820b4b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.340721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37cc1a-4130-4ba0-9207-cacbb8820b4b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.351026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:49.408221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.408963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.409287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.409640 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] PATH_INFO: `/v3/users/3a53019f0627449ca634ab10dd9b7ee6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.412252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a53019f0627449ca634ab10dd9b7ee6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.415289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.471138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a53019f0627449ca634ab10dd9b7ee6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.471806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a53019f0627449ca634ab10dd9b7ee6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.479457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a53019f0627449ca634ab10dd9b7ee6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.488778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a53019f0627449ca634ab10dd9b7ee6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.500973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-37f2b7d7-f9aa-4913-b3f8-ce7457ad91d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a53019f0627449ca634ab10dd9b7ee6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.507379 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4388/8737] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:10:49 2022] DELETE /identity/v3/users/3a53019f0627449ca634ab10dd9b7ee6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:49.687052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:49.689142 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.705665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e06014-da80-4bd4-9423-f38d0fb6c1be admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:49.765324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:49.766059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.766304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.766605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] PATH_INFO: `/v3/projects/a75e505513b94d87ba733819e489a741` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.767773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75e505513b94d87ba733819e489a741)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:49.769701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:49.776451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:49.820591 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75e505513b94d87ba733819e489a741', 'request_id': 'req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.829674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75e505513b94d87ba733819e489a741', 'request_id': 'req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.836263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75e505513b94d87ba733819e489a741', 'request_id': 'req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.848050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] The token cache is being invalidate because project a75e505513b94d87ba733819e489a741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:10:49.848337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.849130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-dbfb8146-7020-4b41-9a7c-c6d1b89782b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:10:49.850813 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4350/8738] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:10:49 2022] DELETE /identity/v3/projects/a75e505513b94d87ba733819e489a741 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:49.856180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b07feb-2e56-4d6e-aeea-ba39ff8e7357 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.856710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b07feb-2e56-4d6e-aeea-ba39ff8e7357 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.856710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b07feb-2e56-4d6e-aeea-ba39ff8e7357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.899865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-82b07feb-2e56-4d6e-aeea-ba39ff8e7357 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:49.901095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-82b07feb-2e56-4d6e-aeea-ba39ff8e7357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:49.962769 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4389/8739] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:49.971291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbcb18-f6ab-4821-8eb1-333be1b34222 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:49.971578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbcb18-f6ab-4821-8eb1-333be1b34222 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:49.971847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acbcb18-f6ab-4821-8eb1-333be1b34222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:49.993206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9acbcb18-f6ab-4821-8eb1-333be1b34222 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:49.995049 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9acbcb18-f6ab-4821-8eb1-333be1b34222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:50.008567 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4351/8740] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:50.014950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b07feb-2e56-4d6e-aeea-ba39ff8e7357 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.026135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b07feb-2e56-4d6e-aeea-ba39ff8e7357 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.031426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4b828-1b8a-43c7-bfc1-c18e3fae084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.032131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b828-1b8a-43c7-bfc1-c18e3fae084b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.032423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b828-1b8a-43c7-bfc1-c18e3fae084b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.032691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b828-1b8a-43c7-bfc1-c18e3fae084b admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.033342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4b828-1b8a-43c7-bfc1-c18e3fae084b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:10:50.033705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4b828-1b8a-43c7-bfc1-c18e3fae084b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.035468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4b828-1b8a-43c7-bfc1-c18e3fae084b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.049254 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4390/8741] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:10:50.055841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbcb18-f6ab-4821-8eb1-333be1b34222 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.065764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acbcb18-f6ab-4821-8eb1-333be1b34222 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.071158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e5efc-2bc4-4947-897f-d4510b234deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.071757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e5efc-2bc4-4947-897f-d4510b234deb admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.072031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e5efc-2bc4-4947-897f-d4510b234deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.072298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e5efc-2bc4-4947-897f-d4510b234deb admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.072925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e5efc-2bc4-4947-897f-d4510b234deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.074899 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e5efc-2bc4-4947-897f-d4510b234deb admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.117572 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4352/8742] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:50 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:50.121971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4b828-1b8a-43c7-bfc1-c18e3fae084b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.128535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:50.134286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4b828-1b8a-43c7-bfc1-c18e3fae084b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.197385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc269c46-fcc9-4d1d-a168-7f352320685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.198027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc269c46-fcc9-4d1d-a168-7f352320685d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.198306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc269c46-fcc9-4d1d-a168-7f352320685d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.198586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc269c46-fcc9-4d1d-a168-7f352320685d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.199220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc269c46-fcc9-4d1d-a168-7f352320685d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.201165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc269c46-fcc9-4d1d-a168-7f352320685d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.230910 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4391/8743] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:50 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:50.232170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e5efc-2bc4-4947-897f-d4510b234deb admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.243354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e5efc-2bc4-4947-897f-d4510b234deb admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.248184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74ced-5738-4e84-9d67-a435a5e660b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.248786 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74ced-5738-4e84-9d67-a435a5e660b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.249058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74ced-5738-4e84-9d67-a435a5e660b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.249322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a74ced-5738-4e84-9d67-a435a5e660b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.250044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74ced-5738-4e84-9d67-a435a5e660b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.251671 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a74ced-5738-4e84-9d67-a435a5e660b1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.261591 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4353/8744] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:50.265585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc269c46-fcc9-4d1d-a168-7f352320685d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.276971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc269c46-fcc9-4d1d-a168-7f352320685d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.282116 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68696c-bd41-4c2a-9b1e-20f4523bb4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.282724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68696c-bd41-4c2a-9b1e-20f4523bb4bc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.283006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68696c-bd41-4c2a-9b1e-20f4523bb4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.283273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68696c-bd41-4c2a-9b1e-20f4523bb4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.283935 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68696c-bd41-4c2a-9b1e-20f4523bb4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.285517 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68696c-bd41-4c2a-9b1e-20f4523bb4bc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.296920 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4392/8745] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:50.301187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74ced-5738-4e84-9d67-a435a5e660b1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.311647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a74ced-5738-4e84-9d67-a435a5e660b1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.316869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec8d54-80ad-4733-888e-90010bd2377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.317499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec8d54-80ad-4733-888e-90010bd2377d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.317790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec8d54-80ad-4733-888e-90010bd2377d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.318184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec8d54-80ad-4733-888e-90010bd2377d admin admin] PATH_INFO: `/v3/projects/aa4fbc58b3334a59882da06ebf0023f9/users/3c785f51eaee4545b4a864aa50f6e14b/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.333265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec8d54-80ad-4733-888e-90010bd2377d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4fbc58b3334a59882da06ebf0023f9, user_id=3c785f51eaee4545b4a864aa50f6e14b, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.335992 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ec8d54-80ad-4733-888e-90010bd2377d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.352170 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4354/8746] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:50 2022] PUT /identity/v3/projects/aa4fbc58b3334a59882da06ebf0023f9/users/3c785f51eaee4545b4a864aa50f6e14b/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:50.363074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e91a9-702e-4051-bdd8-c92c41a4f7af None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.363358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e91a9-702e-4051-bdd8-c92c41a4f7af None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.363623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e91a9-702e-4051-bdd8-c92c41a4f7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.393533 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d95e91a9-702e-4051-bdd8-c92c41a4f7af None None] MFA Rules not processed for user `3c785f51eaee4545b4a864aa50f6e14b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:50.394777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d95e91a9-702e-4051-bdd8-c92c41a4f7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:50.467796 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4393/8747] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:10:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:50.472558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec8d54-80ad-4733-888e-90010bd2377d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.548140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec8d54-80ad-4733-888e-90010bd2377d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.553745 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23e3d-d90a-4b16-8827-17ddd1f72787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.554384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23e3d-d90a-4b16-8827-17ddd1f72787 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.554661 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23e3d-d90a-4b16-8827-17ddd1f72787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.554929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec23e3d-d90a-4b16-8827-17ddd1f72787 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.555561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec23e3d-d90a-4b16-8827-17ddd1f72787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.557514 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec23e3d-d90a-4b16-8827-17ddd1f72787 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.594326 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4355/8748] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:10:50 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:10:50.600905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e91a9-702e-4051-bdd8-c92c41a4f7af None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.612414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e91a9-702e-4051-bdd8-c92c41a4f7af None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.674535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dc58e-beda-4b7c-9a1a-780c545a54ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.675352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dc58e-beda-4b7c-9a1a-780c545a54ca admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.675703 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dc58e-beda-4b7c-9a1a-780c545a54ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.676043 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dc58e-beda-4b7c-9a1a-780c545a54ca admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.676954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dc58e-beda-4b7c-9a1a-780c545a54ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.680016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dc58e-beda-4b7c-9a1a-780c545a54ca admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.710311 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4394/8749] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:10:50 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:10:50.714844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23e3d-d90a-4b16-8827-17ddd1f72787 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.727233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec23e3d-d90a-4b16-8827-17ddd1f72787 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.732805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c9f2c-fb07-4d12-a4a3-6559425a04e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.733451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c9f2c-fb07-4d12-a4a3-6559425a04e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.733734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c9f2c-fb07-4d12-a4a3-6559425a04e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.734032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c9f2c-fb07-4d12-a4a3-6559425a04e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.734685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c9f2c-fb07-4d12-a4a3-6559425a04e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.736324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c9f2c-fb07-4d12-a4a3-6559425a04e1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.737633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:50.749807 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4356/8750] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:50.753922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dc58e-beda-4b7c-9a1a-780c545a54ca admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.760302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:50.768207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dc58e-beda-4b7c-9a1a-780c545a54ca admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.774957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af966e20-07b8-43da-911a-a14b54589bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.775623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af966e20-07b8-43da-911a-a14b54589bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.775902 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af966e20-07b8-43da-911a-a14b54589bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.776176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af966e20-07b8-43da-911a-a14b54589bdb admin admin] PATH_INFO: `/v3/projects/be9e6708174e4d6081db5710641c3aba/users/17b765b4ff8c4a10808bc7c9e3a503a6/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.794080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af966e20-07b8-43da-911a-a14b54589bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9e6708174e4d6081db5710641c3aba, user_id=17b765b4ff8c4a10808bc7c9e3a503a6, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.798330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af966e20-07b8-43da-911a-a14b54589bdb admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.817308 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4395/8751] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:50 2022] PUT /identity/v3/projects/be9e6708174e4d6081db5710641c3aba/users/17b765b4ff8c4a10808bc7c9e3a503a6/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:50.821885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c9f2c-fb07-4d12-a4a3-6559425a04e1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.837855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c9f2c-fb07-4d12-a4a3-6559425a04e1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.904640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f9e9b7-9ff8-49e8-b159-a4a5c223f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.905254 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e9b7-9ff8-49e8-b159-a4a5c223f92d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.905533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e9b7-9ff8-49e8-b159-a4a5c223f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.905799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f9e9b7-9ff8-49e8-b159-a4a5c223f92d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.906480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9e9b7-9ff8-49e8-b159-a4a5c223f92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.908110 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f9e9b7-9ff8-49e8-b159-a4a5c223f92d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.919193 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4357/8752] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:10:50.924551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af966e20-07b8-43da-911a-a14b54589bdb admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:50.936491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af966e20-07b8-43da-911a-a14b54589bdb admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:50.942058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e01cc1-6e8b-454f-9372-b4def3240889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:50.942724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e01cc1-6e8b-454f-9372-b4def3240889 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.943171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e01cc1-6e8b-454f-9372-b4def3240889 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.943449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e01cc1-6e8b-454f-9372-b4def3240889 admin admin] PATH_INFO: `/v3/projects/be9e6708174e4d6081db5710641c3aba/users/17b765b4ff8c4a10808bc7c9e3a503a6/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:50.945482 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e01cc1-6e8b-454f-9372-b4def3240889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9e6708174e4d6081db5710641c3aba, user_id=17b765b4ff8c4a10808bc7c9e3a503a6, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:50.948180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e01cc1-6e8b-454f-9372-b4def3240889 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:50.959211 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4396/8753] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:10:50 2022] PUT /identity/v3/projects/be9e6708174e4d6081db5710641c3aba/users/17b765b4ff8c4a10808bc7c9e3a503a6/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:10:50.976487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada50d72-2413-4915-8df3-a174398e3d4f None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:50.976774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada50d72-2413-4915-8df3-a174398e3d4f None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:50.977047 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada50d72-2413-4915-8df3-a174398e3d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:51.005896 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ada50d72-2413-4915-8df3-a174398e3d4f None None] MFA Rules not processed for user `17b765b4ff8c4a10808bc7c9e3a503a6`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:51.007163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ada50d72-2413-4915-8df3-a174398e3d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:51.086031 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4358/8754] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:10:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:10:51.097554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e01cc1-6e8b-454f-9372-b4def3240889 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:51.099644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-16e01cc1-6e8b-454f-9372-b4def3240889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:51.162820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e01cc1-6e8b-454f-9372-b4def3240889 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:51.167352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461648c0-a695-482a-93ba-5a51c409faba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:51.167966 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461648c0-a695-482a-93ba-5a51c409faba service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:51.168238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461648c0-a695-482a-93ba-5a51c409faba service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:51.168773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461648c0-a695-482a-93ba-5a51c409faba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:51.229585 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461648c0-a695-482a-93ba-5a51c409faba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:51.231053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461648c0-a695-482a-93ba-5a51c409faba service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:51.240775 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4397/8755] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:53.059213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada50d72-2413-4915-8df3-a174398e3d4f None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:10:53.069393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada50d72-2413-4915-8df3-a174398e3d4f None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:10:53.073178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269e770-16cc-4073-82c1-01f51be32d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:10:53.073768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269e770-16cc-4073-82c1-01f51be32d05 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:53.074071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269e770-16cc-4073-82c1-01f51be32d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:53.074340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269e770-16cc-4073-82c1-01f51be32d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:53.083776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269e770-16cc-4073-82c1-01f51be32d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:10:53.085239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269e770-16cc-4073-82c1-01f51be32d05 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:10:53.096079 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4359/8756] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:10:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:10:57.471082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8bb7-097c-43e0-9198-5874812e5e8a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:10:57.471560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8bb7-097c-43e0-9198-5874812e5e8a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:10:57.471810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8bb7-097c-43e0-9198-5874812e5e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:10:57.492190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2f2c8bb7-097c-43e0-9198-5874812e5e8a None None] MFA Rules not processed for user `3c785f51eaee4545b4a864aa50f6e14b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:10:57.493711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2f2c8bb7-097c-43e0-9198-5874812e5e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:10:57.500957 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4398/8757] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:10:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:11:01.239577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269e770-16cc-4073-82c1-01f51be32d05 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:11:01.241609 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c269e770-16cc-4073-82c1-01f51be32d05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:01.254018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269e770-16cc-4073-82c1-01f51be32d05 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:11:01.258285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c5a58-30a3-4ea5-8fc9-6249fe440f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:11:01.258911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c5a58-30a3-4ea5-8fc9-6249fe440f58 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:11:01.259187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c5a58-30a3-4ea5-8fc9-6249fe440f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:11:01.259454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c5a58-30a3-4ea5-8fc9-6249fe440f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:11:01.261387 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-016c5a58-30a3-4ea5-8fc9-6249fe440f58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:11:01.276048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c5a58-30a3-4ea5-8fc9-6249fe440f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:11:01.277704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c5a58-30a3-4ea5-8fc9-6249fe440f58 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:11:01.290513 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4360/8758] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:11:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:11:07.486400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=65,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:11.283175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=77 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:20.278724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8337a-2aa4-4058-8f85-86afffe8c4db None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.279340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8337a-2aa4-4058-8f85-86afffe8c4db None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.279340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8337a-2aa4-4058-8f85-86afffe8c4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.361024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-23f8337a-2aa4-4058-8f85-86afffe8c4db None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:20.362352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-23f8337a-2aa4-4058-8f85-86afffe8c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:20.396139 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4399/8759] 10.222.0.45 () {58 vars in 1015 bytes} [Tue Aug 30 05:12:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:20.414469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c5a58-30a3-4ea5-8fc9-6249fe440f58 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:20.438044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c5a58-30a3-4ea5-8fc9-6249fe440f58 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:20.442810 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc6417-35d0-42f1-8d42-9af79100167e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:20.443763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc6417-35d0-42f1-8d42-9af79100167e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:20.444193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc6417-35d0-42f1-8d42-9af79100167e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:20.444771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc6417-35d0-42f1-8d42-9af79100167e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:20.455432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc6417-35d0-42f1-8d42-9af79100167e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:20.457521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc6417-35d0-42f1-8d42-9af79100167e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:20.467551 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4361/8760] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:21.375565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fd095-3387-40ad-83ff-4a92488b0a29 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:21.376137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fd095-3387-40ad-83ff-4a92488b0a29 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:21.376234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fd095-3387-40ad-83ff-4a92488b0a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:21.397173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6d8fd095-3387-40ad-83ff-4a92488b0a29 None None] MFA Rules not processed for user `3c785f51eaee4545b4a864aa50f6e14b`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:21.398510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6d8fd095-3387-40ad-83ff-4a92488b0a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:21.420700 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4400/8761] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:12:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:21.458226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc7aa4-a9a8-4cd9-aed1-4b7bf64be667 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:21.458763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc7aa4-a9a8-4cd9-aed1-4b7bf64be667 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:21.458911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc7aa4-a9a8-4cd9-aed1-4b7bf64be667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:21.497867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f8cc7aa4-a9a8-4cd9-aed1-4b7bf64be667 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:21.499105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f8cc7aa4-a9a8-4cd9-aed1-4b7bf64be667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:21.576832 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4362/8762] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Aug 30 05:12:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:21.586213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570a5a1-8afe-424e-90e7-1177d95ba558 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:21.586483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570a5a1-8afe-424e-90e7-1177d95ba558 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:21.587010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570a5a1-8afe-424e-90e7-1177d95ba558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:21.610787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9570a5a1-8afe-424e-90e7-1177d95ba558 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:21.612027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9570a5a1-8afe-424e-90e7-1177d95ba558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:21.622157 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4401/8763] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:12:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:21.643565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfcc43-9674-47b4-9a16-048156d53b8d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:21.643925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfcc43-9674-47b4-9a16-048156d53b8d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:21.644282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfcc43-9674-47b4-9a16-048156d53b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:21.704719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6edfcc43-9674-47b4-9a16-048156d53b8d None None] MFA Rules not processed for user `0d31eed8c74549f8b8c6bb5aaa6bee98`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:21.706081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6edfcc43-9674-47b4-9a16-048156d53b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:21.770343 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4363/8764] 10.222.0.43 () {58 vars in 1064 bytes} [Tue Aug 30 05:12:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:21.776494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570a5a1-8afe-424e-90e7-1177d95ba558 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:21.786548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570a5a1-8afe-424e-90e7-1177d95ba558 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:21.790771 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544eb86-fe88-43bc-8412-0d1bddf9e0b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:21.802333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544eb86-fe88-43bc-8412-0d1bddf9e0b0 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:21.802804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544eb86-fe88-43bc-8412-0d1bddf9e0b0 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:21.803190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544eb86-fe88-43bc-8412-0d1bddf9e0b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:21.815996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544eb86-fe88-43bc-8412-0d1bddf9e0b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:21.817661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3544eb86-fe88-43bc-8412-0d1bddf9e0b0 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:21.830919 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4402/8765] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:22.154143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb2dc-19c8-45cf-8afd-8ad6529330d5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:22.154466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb2dc-19c8-45cf-8afd-8ad6529330d5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:22.154699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb2dc-19c8-45cf-8afd-8ad6529330d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:22.175206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c8aeb2dc-19c8-45cf-8afd-8ad6529330d5 None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:22.176420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c8aeb2dc-19c8-45cf-8afd-8ad6529330d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:22.184495 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4364/8766] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:12:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:22.196819 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544eb86-fe88-43bc-8412-0d1bddf9e0b0 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:22.208248 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3544eb86-fe88-43bc-8412-0d1bddf9e0b0 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:22.213825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eea86d-e1df-45f6-bfbc-01f38a7b5d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:22.214558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea86d-e1df-45f6-bfbc-01f38a7b5d53 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:22.215077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea86d-e1df-45f6-bfbc-01f38a7b5d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:22.215418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea86d-e1df-45f6-bfbc-01f38a7b5d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:22.225564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eea86d-e1df-45f6-bfbc-01f38a7b5d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:22.227825 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eea86d-e1df-45f6-bfbc-01f38a7b5d53 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:22.237989 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4403/8767] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:22.660736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8a4a4-67e9-4bbc-8904-9afb8642ee48 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:22.661218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8a4a4-67e9-4bbc-8904-9afb8642ee48 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:22.661410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8a4a4-67e9-4bbc-8904-9afb8642ee48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:22.684511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f2d8a4a4-67e9-4bbc-8904-9afb8642ee48 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:22.685863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f2d8a4a4-67e9-4bbc-8904-9afb8642ee48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:22.699584 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4365/8768] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Aug 30 05:12:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:22.706343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf543f-1d3a-4ed7-b5e5-a38b8bd87218 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:22.707305 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf543f-1d3a-4ed7-b5e5-a38b8bd87218 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:22.707652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf543f-1d3a-4ed7-b5e5-a38b8bd87218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:22.745119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8ecf543f-1d3a-4ed7-b5e5-a38b8bd87218 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:22.746824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8ecf543f-1d3a-4ed7-b5e5-a38b8bd87218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:22.757201 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4404/8769] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:12:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:22.771272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8a4a4-67e9-4bbc-8904-9afb8642ee48 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:22.781346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8a4a4-67e9-4bbc-8904-9afb8642ee48 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:22.785244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31483-44d6-4030-a722-4a5c320f733c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:22.786067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31483-44d6-4030-a722-4a5c320f733c service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:22.786566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31483-44d6-4030-a722-4a5c320f733c service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:22.786836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c31483-44d6-4030-a722-4a5c320f733c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:22.799346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c31483-44d6-4030-a722-4a5c320f733c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:22.800795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c31483-44d6-4030-a722-4a5c320f733c service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:22.809309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:22.817644 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4366/8770] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:25.624570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1c325-abbd-490d-8eea-b339cb4b521c None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:25.625157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1c325-abbd-490d-8eea-b339cb4b521c None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:25.625157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1c325-abbd-490d-8eea-b339cb4b521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:25.651670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-22b1c325-abbd-490d-8eea-b339cb4b521c None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:25.652900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-22b1c325-abbd-490d-8eea-b339cb4b521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:25.659679 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4405/8771] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 30 05:12:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:25.672881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31483-44d6-4030-a722-4a5c320f733c service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:25.684388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c31483-44d6-4030-a722-4a5c320f733c service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:25.688481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c92f5-4d5e-4a70-8e51-38bef49515d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:25.689120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c92f5-4d5e-4a70-8e51-38bef49515d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:25.689518 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c92f5-4d5e-4a70-8e51-38bef49515d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:25.689798 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c92f5-4d5e-4a70-8e51-38bef49515d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:25.699597 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c92f5-4d5e-4a70-8e51-38bef49515d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:25.701068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c92f5-4d5e-4a70-8e51-38bef49515d9 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:25.710131 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4367/8772] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:26.390527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c679e2-6f8a-4d5e-82f9-cd40a7079843 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:26.390883 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c679e2-6f8a-4d5e-82f9-cd40a7079843 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:26.391240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c679e2-6f8a-4d5e-82f9-cd40a7079843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:26.428382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-66c679e2-6f8a-4d5e-82f9-cd40a7079843 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:26.429615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-66c679e2-6f8a-4d5e-82f9-cd40a7079843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:26.446512 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4406/8773] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:12:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:26.459727 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c92f5-4d5e-4a70-8e51-38bef49515d9 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:26.473545 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c92f5-4d5e-4a70-8e51-38bef49515d9 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:26.479635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a07ea3-fb95-44b9-aa8d-31fb847f49d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:26.480282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a07ea3-fb95-44b9-aa8d-31fb847f49d6 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:26.480621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a07ea3-fb95-44b9-aa8d-31fb847f49d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:26.480905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a07ea3-fb95-44b9-aa8d-31fb847f49d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:26.490452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a07ea3-fb95-44b9-aa8d-31fb847f49d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:26.492045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a07ea3-fb95-44b9-aa8d-31fb847f49d6 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:26.504378 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4368/8774] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:31.428937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab2a50-0f18-4217-bc00-c35c72dcaec1 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:31.429424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab2a50-0f18-4217-bc00-c35c72dcaec1 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:31.429524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab2a50-0f18-4217-bc00-c35c72dcaec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:31.453003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-99ab2a50-0f18-4217-bc00-c35c72dcaec1 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:12:31.454436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-99ab2a50-0f18-4217-bc00-c35c72dcaec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:12:31.465051 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4407/8775] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:12:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:12:31.480570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a07ea3-fb95-44b9-aa8d-31fb847f49d6 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:12:31.492167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a07ea3-fb95-44b9-aa8d-31fb847f49d6 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:12:31.499365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c73355-eef0-47a4-854a-25c34d54cd79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:12:31.500594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c73355-eef0-47a4-854a-25c34d54cd79 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:12:31.500870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c73355-eef0-47a4-854a-25c34d54cd79 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:12:31.501137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c73355-eef0-47a4-854a-25c34d54cd79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:12:31.511232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c73355-eef0-47a4-854a-25c34d54cd79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:12:31.512830 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c73355-eef0-47a4-854a-25c34d54cd79 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:12:31.524284 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4369/8776] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:12:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:12:41.447459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=70 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:41.519317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=19 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:07.332854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547421f9-2bee-4cda-970b-a46e6fbdc4bb None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:07.333380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547421f9-2bee-4cda-970b-a46e6fbdc4bb None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:07.333380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547421f9-2bee-4cda-970b-a46e6fbdc4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:07.355591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-547421f9-2bee-4cda-970b-a46e6fbdc4bb None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:07.356989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-547421f9-2bee-4cda-970b-a46e6fbdc4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:07.367923 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4408/8777] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:07.384086 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c73355-eef0-47a4-854a-25c34d54cd79 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:07.396300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c73355-eef0-47a4-854a-25c34d54cd79 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:07.403280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ea8b7-abb1-48de-8b2c-cf9b1d579782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:07.404050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea8b7-abb1-48de-8b2c-cf9b1d579782 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:07.404429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea8b7-abb1-48de-8b2c-cf9b1d579782 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:07.404807 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ea8b7-abb1-48de-8b2c-cf9b1d579782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:07.415296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea8b7-abb1-48de-8b2c-cf9b1d579782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:07.417061 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ea8b7-abb1-48de-8b2c-cf9b1d579782 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:07.428435 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4370/8778] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:14.514541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547421f9-2bee-4cda-970b-a46e6fbdc4bb None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:13:14.515996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-547421f9-2bee-4cda-970b-a46e6fbdc4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:14.606747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547421f9-2bee-4cda-970b-a46e6fbdc4bb None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:13:14.613157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59908af1-1f44-48a9-b62f-5284ce03fb96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:13:14.613389 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59908af1-1f44-48a9-b62f-5284ce03fb96 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:14.613603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59908af1-1f44-48a9-b62f-5284ce03fb96 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:14.613895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59908af1-1f44-48a9-b62f-5284ce03fb96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:14.615897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-59908af1-1f44-48a9-b62f-5284ce03fb96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:14.632906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59908af1-1f44-48a9-b62f-5284ce03fb96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:13:14.633711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59908af1-1f44-48a9-b62f-5284ce03fb96 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:13:14.649174 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4409/8779] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:13:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:13:17.423963 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:20.812240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700aee7-0fbe-47d6-9085-204181362b64 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:13:20.812777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700aee7-0fbe-47d6-9085-204181362b64 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:13:20.812777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700aee7-0fbe-47d6-9085-204181362b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:13:20.832969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b700aee7-0fbe-47d6-9085-204181362b64 None None] MFA Rules not processed for user `3c785f51eaee4545b4a864aa50f6e14b`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:13:20.834372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b700aee7-0fbe-47d6-9085-204181362b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:13:20.846642 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4371/8780] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:13:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:13:24.642004 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=40 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:30.826969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:17.811677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59908af1-1f44-48a9-b62f-5284ce03fb96 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:17.879311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59908af1-1f44-48a9-b62f-5284ce03fb96 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:17.883846 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:17.884510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:17.884784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:17.885051 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] PATH_INFO: `/v3/users/3c785f51eaee4545b4a864aa50f6e14b` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:17.886218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c785f51eaee4545b4a864aa50f6e14b)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:17.888535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:17.938954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c785f51eaee4545b4a864aa50f6e14b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:17.939687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c785f51eaee4545b4a864aa50f6e14b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:17.947763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c785f51eaee4545b4a864aa50f6e14b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:17.956151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c785f51eaee4545b4a864aa50f6e14b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:17.970351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c785f51eaee4545b4a864aa50f6e14b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:17.977078 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4410/8781] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:14:17 2022] DELETE /identity/v3/users/3c785f51eaee4545b4a864aa50f6e14b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:17.982211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f2fc6-6f94-4177-9319-7025c9cdfb69 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:17.982742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f2fc6-6f94-4177-9319-7025c9cdfb69 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:17.982742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f2fc6-6f94-4177-9319-7025c9cdfb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:18.002182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d90f2fc6-6f94-4177-9319-7025c9cdfb69 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:18.003402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d90f2fc6-6f94-4177-9319-7025c9cdfb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:18.069081 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4372/8782] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:18.079175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:18.080685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:18.157230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe727f2-1b5a-40a4-8e7d-01658ce78e10 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:18.161096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fc8e1-c851-40f7-a906-3c95858a8f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:18.161709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fc8e1-c851-40f7-a906-3c95858a8f92 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:18.162017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fc8e1-c851-40f7-a906-3c95858a8f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:18.162296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fc8e1-c851-40f7-a906-3c95858a8f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:18.171726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fc8e1-c851-40f7-a906-3c95858a8f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:18.173174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fc8e1-c851-40f7-a906-3c95858a8f92 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:18.182698 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4411/8783] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:18.363386 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f2fc6-6f94-4177-9319-7025c9cdfb69 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:18.365029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d90f2fc6-6f94-4177-9319-7025c9cdfb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:18.384766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f2fc6-6f94-4177-9319-7025c9cdfb69 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:18.390046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:18.391022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:18.391493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:18.391951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] PATH_INFO: `/v3/projects/aa4fbc58b3334a59882da06ebf0023f9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:18.393316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4fbc58b3334a59882da06ebf0023f9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:18.395665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:18.446842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4fbc58b3334a59882da06ebf0023f9', 'request_id': 'req-78177725-bdfc-4a72-b125-e2a8b581f950'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:18.455292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4fbc58b3334a59882da06ebf0023f9', 'request_id': 'req-78177725-bdfc-4a72-b125-e2a8b581f950'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:18.461554 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4fbc58b3334a59882da06ebf0023f9', 'request_id': 'req-78177725-bdfc-4a72-b125-e2a8b581f950'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:18.472508 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] The token cache is being invalidate because project aa4fbc58b3334a59882da06ebf0023f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:14:18.472791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:18.473457 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:18.475010 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4373/8784] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:14:18 2022] DELETE /identity/v3/projects/aa4fbc58b3334a59882da06ebf0023f9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:18.479054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fc8e1-c851-40f7-a906-3c95858a8f92 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:18.489933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fc8e1-c851-40f7-a906-3c95858a8f92 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:18.497662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:18.552784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:18.553425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:18.553723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:18.554021 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] PATH_INFO: `/v3/users/17b765b4ff8c4a10808bc7c9e3a503a6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:18.555234 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b765b4ff8c4a10808bc7c9e3a503a6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:18.557179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:18.609567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b765b4ff8c4a10808bc7c9e3a503a6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:18.610241 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b765b4ff8c4a10808bc7c9e3a503a6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:18.617481 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b765b4ff8c4a10808bc7c9e3a503a6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:18.627071 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b765b4ff8c4a10808bc7c9e3a503a6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:18.640872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-15543af6-d5c1-40b6-a59d-030db246d525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b765b4ff8c4a10808bc7c9e3a503a6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:18.647654 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4412/8785] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:14:18 2022] DELETE /identity/v3/users/17b765b4ff8c4a10808bc7c9e3a503a6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:14:18.952603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:18.954246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:18.968736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78177725-bdfc-4a72-b125-e2a8b581f950 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:19.034958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:19.035623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.035784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.036050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] PATH_INFO: `/v3/projects/be9e6708174e4d6081db5710641c3aba` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.037217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9e6708174e4d6081db5710641c3aba)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:19.039232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:19.071394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:19.090209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9e6708174e4d6081db5710641c3aba', 'request_id': 'req-53da3b71-9de4-4186-bafe-b7a6e7a28adf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:19.099487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9e6708174e4d6081db5710641c3aba', 'request_id': 'req-53da3b71-9de4-4186-bafe-b7a6e7a28adf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:19.106134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9e6708174e4d6081db5710641c3aba', 'request_id': 'req-53da3b71-9de4-4186-bafe-b7a6e7a28adf'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:19.117089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] The token cache is being invalidate because project be9e6708174e4d6081db5710641c3aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:14:19.117400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:19.118181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-53da3b71-9de4-4186-bafe-b7a6e7a28adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:19.119937 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4374/8786] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:14:18 2022] DELETE /identity/v3/projects/be9e6708174e4d6081db5710641c3aba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:19.125236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7fe0-5cc3-4cf0-914d-9dfff734f540 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.125708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7fe0-5cc3-4cf0-914d-9dfff734f540 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.125808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7fe0-5cc3-4cf0-914d-9dfff734f540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.145430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d64f7fe0-5cc3-4cf0-914d-9dfff734f540 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:19.146655 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d64f7fe0-5cc3-4cf0-914d-9dfff734f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:19.212916 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4413/8787] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:19.221752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3d7b-4d9b-4523-87fb-bce081160de5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.222066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3d7b-4d9b-4523-87fb-bce081160de5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.222336 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b3d7b-4d9b-4523-87fb-bce081160de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.245225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9c8b3d7b-4d9b-4523-87fb-bce081160de5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:19.246492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c8b3d7b-4d9b-4523-87fb-bce081160de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:19.259597 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4375/8788] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:19.264646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f7fe0-5cc3-4cf0-914d-9dfff734f540 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:19.275014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f7fe0-5cc3-4cf0-914d-9dfff734f540 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:19.281402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116ce72-d4c3-479f-a42a-7b16027231da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:19.282077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116ce72-d4c3-479f-a42a-7b16027231da admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.282355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116ce72-d4c3-479f-a42a-7b16027231da admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.282620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116ce72-d4c3-479f-a42a-7b16027231da admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.283270 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116ce72-d4c3-479f-a42a-7b16027231da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:14:19.283573 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116ce72-d4c3-479f-a42a-7b16027231da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:19.285287 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116ce72-d4c3-479f-a42a-7b16027231da admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:19.299182 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4414/8789] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:14:19.303555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b3d7b-4d9b-4523-87fb-bce081160de5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:19.313427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b3d7b-4d9b-4523-87fb-bce081160de5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:19.318416 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2293-82e5-47b5-a174-6e58806d7e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:19.319024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2293-82e5-47b5-a174-6e58806d7e41 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.319306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2293-82e5-47b5-a174-6e58806d7e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.319581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d2293-82e5-47b5-a174-6e58806d7e41 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.320242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d2293-82e5-47b5-a174-6e58806d7e41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:19.322206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d2293-82e5-47b5-a174-6e58806d7e41 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:19.353045 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4376/8790] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:14:19 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:14:19.357667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116ce72-d4c3-479f-a42a-7b16027231da admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:19.368045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116ce72-d4c3-479f-a42a-7b16027231da admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:19.381019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:19.429898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa345264-f088-409f-b74c-bcf82f008a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:19.430531 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa345264-f088-409f-b74c-bcf82f008a96 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.430809 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa345264-f088-409f-b74c-bcf82f008a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.431077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa345264-f088-409f-b74c-bcf82f008a96 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.431710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa345264-f088-409f-b74c-bcf82f008a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:19.433634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa345264-f088-409f-b74c-bcf82f008a96 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:19.456584 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4415/8791] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:14:19 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:14:19.460848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2293-82e5-47b5-a174-6e58806d7e41 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:19.472640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d2293-82e5-47b5-a174-6e58806d7e41 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:19.477685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c592a3-83a6-469c-a495-03d5b653fd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:19.478345 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c592a3-83a6-469c-a495-03d5b653fd11 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.478626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c592a3-83a6-469c-a495-03d5b653fd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.478895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c592a3-83a6-469c-a495-03d5b653fd11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.479540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c592a3-83a6-469c-a495-03d5b653fd11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:19.481806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c592a3-83a6-469c-a495-03d5b653fd11 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:19.492012 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4377/8792] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:14:19.496171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa345264-f088-409f-b74c-bcf82f008a96 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:19.507073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa345264-f088-409f-b74c-bcf82f008a96 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:19.513687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a2ebf-55fa-47fe-907b-57d5d7f3d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:19.514330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2ebf-55fa-47fe-907b-57d5d7f3d939 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.515025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2ebf-55fa-47fe-907b-57d5d7f3d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.515293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a2ebf-55fa-47fe-907b-57d5d7f3d939 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.516254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a2ebf-55fa-47fe-907b-57d5d7f3d939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:19.517855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a2ebf-55fa-47fe-907b-57d5d7f3d939 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:19.530249 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4416/8793] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:14:19.535640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c592a3-83a6-469c-a495-03d5b653fd11 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:19.546408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c592a3-83a6-469c-a495-03d5b653fd11 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:19.551436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f4388-92f9-4184-8350-0ea413d4cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:19.552085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4388-92f9-4184-8350-0ea413d4cf83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.552360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4388-92f9-4184-8350-0ea413d4cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.552634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4388-92f9-4184-8350-0ea413d4cf83 admin admin] PATH_INFO: `/v3/projects/1ed255510d8a4e22916bc12257682c11/users/55cbd5f9f6eb4d20954b016fc1673f01/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.567770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f4388-92f9-4184-8350-0ea413d4cf83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed255510d8a4e22916bc12257682c11, user_id=55cbd5f9f6eb4d20954b016fc1673f01, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:19.570458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f4388-92f9-4184-8350-0ea413d4cf83 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:19.584674 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4378/8794] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:14:19 2022] PUT /identity/v3/projects/1ed255510d8a4e22916bc12257682c11/users/55cbd5f9f6eb4d20954b016fc1673f01/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:19.590181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb6d0e-b5e6-4aad-96b8-a6f0b0efa342 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.590670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb6d0e-b5e6-4aad-96b8-a6f0b0efa342 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.590835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb6d0e-b5e6-4aad-96b8-a6f0b0efa342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.610213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-06eb6d0e-b5e6-4aad-96b8-a6f0b0efa342 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:19.611427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-06eb6d0e-b5e6-4aad-96b8-a6f0b0efa342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:19.680253 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4417/8795] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:19.687929 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f4388-92f9-4184-8350-0ea413d4cf83 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:19.691676 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4c3f4388-92f9-4184-8350-0ea413d4cf83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:19.762165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f4388-92f9-4184-8350-0ea413d4cf83 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:19.767344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d686f46-48c0-48bf-ac97-4774befadaa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:19.767986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d686f46-48c0-48bf-ac97-4774befadaa4 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:19.768259 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d686f46-48c0-48bf-ac97-4774befadaa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:19.768521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d686f46-48c0-48bf-ac97-4774befadaa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:19.779822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d686f46-48c0-48bf-ac97-4774befadaa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:19.781311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d686f46-48c0-48bf-ac97-4774befadaa4 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:19.791990 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4379/8796] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:23.806989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dfaff-4611-4a67-ad47-e8a13652ad47 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:23.807507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dfaff-4611-4a67-ad47-e8a13652ad47 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:23.807507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dfaff-4611-4a67-ad47-e8a13652ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:23.837918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c73dfaff-4611-4a67-ad47-e8a13652ad47 None None] MFA Rules not processed for user `55cbd5f9f6eb4d20954b016fc1673f01`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:23.839148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c73dfaff-4611-4a67-ad47-e8a13652ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:23.911273 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4418/8797] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:23.915765 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d686f46-48c0-48bf-ac97-4774befadaa4 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:23.925955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d686f46-48c0-48bf-ac97-4774befadaa4 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:23.931267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd4d26-3744-4995-8920-741b1ae4a315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:23.931880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd4d26-3744-4995-8920-741b1ae4a315 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:23.932169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd4d26-3744-4995-8920-741b1ae4a315 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:23.932441 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd4d26-3744-4995-8920-741b1ae4a315 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:23.933096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd4d26-3744-4995-8920-741b1ae4a315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:23.935244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd4d26-3744-4995-8920-741b1ae4a315 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:23.959817 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4380/8798] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:14:23 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:14:23.964298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dfaff-4611-4a67-ad47-e8a13652ad47 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:23.976229 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dfaff-4611-4a67-ad47-e8a13652ad47 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:23.980925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd608166-f283-43f4-a079-5fdd4639e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:23.981560 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd608166-f283-43f4-a079-5fdd4639e3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:23.981830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd608166-f283-43f4-a079-5fdd4639e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:23.982137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd608166-f283-43f4-a079-5fdd4639e3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:23.982785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd608166-f283-43f4-a079-5fdd4639e3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:23.984436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd608166-f283-43f4-a079-5fdd4639e3e6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:23.996847 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4419/8799] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:14:24.009109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd4d26-3744-4995-8920-741b1ae4a315 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:24.015452 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd4d26-3744-4995-8920-741b1ae4a315 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:24.020861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db57dfa-da5c-4b40-8af3-fead9c6aa28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:24.021556 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db57dfa-da5c-4b40-8af3-fead9c6aa28b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:24.021831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db57dfa-da5c-4b40-8af3-fead9c6aa28b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:24.022193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db57dfa-da5c-4b40-8af3-fead9c6aa28b admin admin] PATH_INFO: `/v3/system/users/f264d09c364d48868bc70320075ed619/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:24.040177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db57dfa-da5c-4b40-8af3-fead9c6aa28b admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f264d09c364d48868bc70320075ed619, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:24.042184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db57dfa-da5c-4b40-8af3-fead9c6aa28b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:24.051217 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4381/8800] 10.222.0.43 () {60 vars in 1378 bytes} [Tue Aug 30 05:14:23 2022] PUT /identity/v3/system/users/f264d09c364d48868bc70320075ed619/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:24.062830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d1bc6-9659-45a3-9596-12b405d1f093 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:24.063345 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d1bc6-9659-45a3-9596-12b405d1f093 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:24.063628 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d1bc6-9659-45a3-9596-12b405d1f093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:24.093298 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-258d1bc6-9659-45a3-9596-12b405d1f093 None None] MFA Rules not processed for user `f264d09c364d48868bc70320075ed619`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:24.094554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-258d1bc6-9659-45a3-9596-12b405d1f093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:24.096658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:24.173318 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4420/8801] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:24 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 05:14:24.177987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db57dfa-da5c-4b40-8af3-fead9c6aa28b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:24.195411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=6,keystone:SELECT=87,keystone:INSERT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:24.291937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db57dfa-da5c-4b40-8af3-fead9c6aa28b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:24.334360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6232c-c7bb-4b24-aec3-502ecd640ce7 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f264d09c364d48868bc70320075ed619', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:24.335094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6232c-c7bb-4b24-aec3-502ecd640ce7 None tempest-ImageQuotaTest-327044686-system-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:24.335468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6232c-c7bb-4b24-aec3-502ecd640ce7 None tempest-ImageQuotaTest-327044686-system-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:24.335815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc6232c-c7bb-4b24-aec3-502ecd640ce7 None tempest-ImageQuotaTest-327044686-system-admin] PATH_INFO: `/v3/services` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:24.336578 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6232c-c7bb-4b24-aec3-502ecd640ce7 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:24.338592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc6232c-c7bb-4b24-aec3-502ecd640ce7 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:24.346810 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4382/8802] 10.222.0.43 () {58 vars in 1110 bytes} [Tue Aug 30 05:14:24 2022] GET /identity/v3/services => generated 2191 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:14:24.351644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d1bc6-9659-45a3-9596-12b405d1f093 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:24.460339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d1bc6-9659-45a3-9596-12b405d1f093 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:24.506284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d58a2-6ce7-4283-965e-44aa689bed45 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f264d09c364d48868bc70320075ed619', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:24.506913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d58a2-6ce7-4283-965e-44aa689bed45 None tempest-ImageQuotaTest-327044686-system-admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:24.507194 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d58a2-6ce7-4283-965e-44aa689bed45 None tempest-ImageQuotaTest-327044686-system-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:24.507495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d58a2-6ce7-4283-965e-44aa689bed45 None tempest-ImageQuotaTest-327044686-system-admin] PATH_INFO: `/v3/limits` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:24.508173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d58a2-6ce7-4283-965e-44aa689bed45 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:24.509505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d58a2-6ce7-4283-965e-44aa689bed45 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:24.514168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application [None req-cf8d58a2-6ce7-4283-965e-44aa689bed45 None tempest-ImageQuotaTest-327044686-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 30 05:14:24.595960 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 30 05:14:24.597000 n-d-820368-36 devstack@keystone.service[82098]: ERROR keystone.server.flask.application Aug 30 05:14:24.597706 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4421/8803] 10.222.0.43 () {60 vars in 1126 bytes} [Tue Aug 30 05:14:24 2022] POST /identity/v3/limits => generated 124 bytes in 246 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 30 05:14:24.603656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6232c-c7bb-4b24-aec3-502ecd640ce7 None tempest-ImageQuotaTest-327044686-system-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:24.692546 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:24.715882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc6232c-c7bb-4b24-aec3-502ecd640ce7 None tempest-ImageQuotaTest-327044686-system-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:24.750719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744f8cf-c21a-4f58-a564-992b0af12567 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f264d09c364d48868bc70320075ed619', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:24.751330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f8cf-c21a-4f58-a564-992b0af12567 None tempest-ImageQuotaTest-327044686-system-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:24.751674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f8cf-c21a-4f58-a564-992b0af12567 None tempest-ImageQuotaTest-327044686-system-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:24.751955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744f8cf-c21a-4f58-a564-992b0af12567 None tempest-ImageQuotaTest-327044686-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:24.752669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744f8cf-c21a-4f58-a564-992b0af12567 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:24.754009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744f8cf-c21a-4f58-a564-992b0af12567 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:24.760817 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4383/8804] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Aug 30 05:14:24 2022] GET /identity/v3/registered_limits => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:14:24.767092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d58a2-6ce7-4283-965e-44aa689bed45 None tempest-ImageQuotaTest-327044686-system-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:24.896039 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d58a2-6ce7-4283-965e-44aa689bed45 None tempest-ImageQuotaTest-327044686-system-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:24.931955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d563093-0687-430f-ad1d-a7d9f3582359 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f264d09c364d48868bc70320075ed619', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:24.932557 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d563093-0687-430f-ad1d-a7d9f3582359 None tempest-ImageQuotaTest-327044686-system-admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:24.932836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d563093-0687-430f-ad1d-a7d9f3582359 None tempest-ImageQuotaTest-327044686-system-admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:24.933112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d563093-0687-430f-ad1d-a7d9f3582359 None tempest-ImageQuotaTest-327044686-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:24.933726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d563093-0687-430f-ad1d-a7d9f3582359 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:24.935658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d563093-0687-430f-ad1d-a7d9f3582359 None tempest-ImageQuotaTest-327044686-system-admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:24.941631 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4422/8805] 10.222.0.43 () {58 vars in 1137 bytes} [Tue Aug 30 05:14:24 2022] GET /identity/v3/registered_limits => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:14:28.704608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744f8cf-c21a-4f58-a564-992b0af12567 None tempest-ImageQuotaTest-327044686-system-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:28.717950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744f8cf-c21a-4f58-a564-992b0af12567 None tempest-ImageQuotaTest-327044686-system-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:28.722415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:28.723050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:28.723327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:28.723626 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] PATH_INFO: `/v3/users/55cbd5f9f6eb4d20954b016fc1673f01` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:28.724738 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=55cbd5f9f6eb4d20954b016fc1673f01)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:28.726821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:28.782659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55cbd5f9f6eb4d20954b016fc1673f01'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:28.795466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55cbd5f9f6eb4d20954b016fc1673f01'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:28.807605 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55cbd5f9f6eb4d20954b016fc1673f01'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:28.816895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55cbd5f9f6eb4d20954b016fc1673f01'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:28.817714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55cbd5f9f6eb4d20954b016fc1673f01'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:28.828146 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4384/8806] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:14:28 2022] DELETE /identity/v3/users/55cbd5f9f6eb4d20954b016fc1673f01 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:29.019097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d563093-0687-430f-ad1d-a7d9f3582359 None tempest-ImageQuotaTest-327044686-system-admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:29.020911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6d563093-0687-430f-ad1d-a7d9f3582359 None tempest-ImageQuotaTest-327044686-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:29.088872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d563093-0687-430f-ad1d-a7d9f3582359 None tempest-ImageQuotaTest-327044686-system-admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:29.093728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:29.094386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:29.094662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:29.094927 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] PATH_INFO: `/v3/projects/1ed255510d8a4e22916bc12257682c11` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:29.096036 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed255510d8a4e22916bc12257682c11)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:29.097965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:29.099440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:29.148442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed255510d8a4e22916bc12257682c11', 'request_id': 'req-80702076-d67e-46aa-a20c-0fbaaadca040'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:29.155161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed255510d8a4e22916bc12257682c11', 'request_id': 'req-80702076-d67e-46aa-a20c-0fbaaadca040'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:29.167102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed255510d8a4e22916bc12257682c11', 'request_id': 'req-80702076-d67e-46aa-a20c-0fbaaadca040'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:29.181548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] The token cache is being invalidate because project 1ed255510d8a4e22916bc12257682c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:14:29.181848 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:29.182953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-80702076-d67e-46aa-a20c-0fbaaadca040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:29.185799 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4423/8807] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:14:29 2022] DELETE /identity/v3/projects/1ed255510d8a4e22916bc12257682c11 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:14:29.191490 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:29.201673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb257de-3c49-46b9-9087-3cee1dc11d1c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:29.258802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:29.259437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:29.259714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:29.259980 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] PATH_INFO: `/v3/users/f264d09c364d48868bc70320075ed619` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:29.261141 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f264d09c364d48868bc70320075ed619)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:29.263174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:29.273394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:29.322894 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f264d09c364d48868bc70320075ed619'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:29.330547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f264d09c364d48868bc70320075ed619'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:29.342564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f264d09c364d48868bc70320075ed619'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:29.351385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f264d09c364d48868bc70320075ed619'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:29.352069 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-24503f86-9ad6-4dbe-97fd-bac551b34727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f264d09c364d48868bc70320075ed619'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:29.358782 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4385/8808] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:14:29 2022] DELETE /identity/v3/users/f264d09c364d48868bc70320075ed619 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:39.176598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:39.354613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=11,keystone:SELECT=26,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:39.703888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473ff1-bac1-44ce-8834-5d606318edee None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:39.704171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473ff1-bac1-44ce-8834-5d606318edee None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:39.704484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473ff1-bac1-44ce-8834-5d606318edee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:39.728274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e9473ff1-bac1-44ce-8834-5d606318edee None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:39.729493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e9473ff1-bac1-44ce-8834-5d606318edee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:39.794028 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4424/8809] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:39.804414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a9be-dfe3-4917-8632-ef3bf59eb1d5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:39.804797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a9be-dfe3-4917-8632-ef3bf59eb1d5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:39.805114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a9be-dfe3-4917-8632-ef3bf59eb1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:39.832775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b5b3a9be-dfe3-4917-8632-ef3bf59eb1d5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:39.834030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b5b3a9be-dfe3-4917-8632-ef3bf59eb1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:39.844001 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4386/8810] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:39.851661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473ff1-bac1-44ce-8834-5d606318edee None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:39.864894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473ff1-bac1-44ce-8834-5d606318edee None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:39.870074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed38b37-06da-4fe9-8500-a46e4fe27fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:39.870681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed38b37-06da-4fe9-8500-a46e4fe27fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:39.870957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed38b37-06da-4fe9-8500-a46e4fe27fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:39.871225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed38b37-06da-4fe9-8500-a46e4fe27fb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:39.872175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed38b37-06da-4fe9-8500-a46e4fe27fb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:14:39.872505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed38b37-06da-4fe9-8500-a46e4fe27fb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:39.874173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed38b37-06da-4fe9-8500-a46e4fe27fb8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:39.886264 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4425/8811] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:14:39.898169 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3a9be-dfe3-4917-8632-ef3bf59eb1d5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:39.907670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3a9be-dfe3-4917-8632-ef3bf59eb1d5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:39.912588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43344f-d9af-4f78-a319-18eca1815db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:39.913190 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43344f-d9af-4f78-a319-18eca1815db9 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:39.913474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43344f-d9af-4f78-a319-18eca1815db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:39.913737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43344f-d9af-4f78-a319-18eca1815db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:39.914391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43344f-d9af-4f78-a319-18eca1815db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:39.916300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43344f-d9af-4f78-a319-18eca1815db9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:39.951344 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4387/8812] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:14:39 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:14:39.954878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed38b37-06da-4fe9-8500-a46e4fe27fb8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:39.966143 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed38b37-06da-4fe9-8500-a46e4fe27fb8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:40.033024 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f3695-4bac-43b4-b72d-3f5bf883631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:40.033638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f3695-4bac-43b4-b72d-3f5bf883631d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.033947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f3695-4bac-43b4-b72d-3f5bf883631d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.034220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f3695-4bac-43b4-b72d-3f5bf883631d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.034841 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f3695-4bac-43b4-b72d-3f5bf883631d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:40.036779 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f3695-4bac-43b4-b72d-3f5bf883631d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:40.060029 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4426/8813] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:14:39 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:14:40.063743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43344f-d9af-4f78-a319-18eca1815db9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:40.074308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43344f-d9af-4f78-a319-18eca1815db9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:40.079226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e0dd6-59e8-4546-890e-9d0d88d2e8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:40.079828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e0dd6-59e8-4546-890e-9d0d88d2e8ff admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.080106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e0dd6-59e8-4546-890e-9d0d88d2e8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.080372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e0dd6-59e8-4546-890e-9d0d88d2e8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.081014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e0dd6-59e8-4546-890e-9d0d88d2e8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:40.082678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e0dd6-59e8-4546-890e-9d0d88d2e8ff admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:40.093138 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4388/8814] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:14:40.097343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f3695-4bac-43b4-b72d-3f5bf883631d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:40.108583 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f3695-4bac-43b4-b72d-3f5bf883631d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:40.114002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc62342-3d29-4352-b807-35ef84be48c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:40.114602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc62342-3d29-4352-b807-35ef84be48c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.114872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc62342-3d29-4352-b807-35ef84be48c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.115135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc62342-3d29-4352-b807-35ef84be48c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.115769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc62342-3d29-4352-b807-35ef84be48c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:40.117370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc62342-3d29-4352-b807-35ef84be48c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:40.130379 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4427/8815] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:14:40.136948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e0dd6-59e8-4546-890e-9d0d88d2e8ff admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:40.147331 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e0dd6-59e8-4546-890e-9d0d88d2e8ff admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:40.152886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30403b-a9a8-4951-ae91-ce4cd9f05523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:40.153534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30403b-a9a8-4951-ae91-ce4cd9f05523 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.153824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30403b-a9a8-4951-ae91-ce4cd9f05523 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.154104 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30403b-a9a8-4951-ae91-ce4cd9f05523 admin admin] PATH_INFO: `/v3/projects/c71d86e32def46f5b45c735be099bd56/users/69433c5501cc4f21908606c60fcace54/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.170402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30403b-a9a8-4951-ae91-ce4cd9f05523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71d86e32def46f5b45c735be099bd56, user_id=69433c5501cc4f21908606c60fcace54, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:40.173058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30403b-a9a8-4951-ae91-ce4cd9f05523 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:40.187421 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4389/8816] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:14:40 2022] PUT /identity/v3/projects/c71d86e32def46f5b45c735be099bd56/users/69433c5501cc4f21908606c60fcace54/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:14:40.201580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e7bdd-fd33-4e1c-863f-46fc9be86077 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.202120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e7bdd-fd33-4e1c-863f-46fc9be86077 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.202271 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e7bdd-fd33-4e1c-863f-46fc9be86077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.232296 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-812e7bdd-fd33-4e1c-863f-46fc9be86077 None None] MFA Rules not processed for user `69433c5501cc4f21908606c60fcace54`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:40.233626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-812e7bdd-fd33-4e1c-863f-46fc9be86077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:40.303586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:40.314155 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4428/8817] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:40.318729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30403b-a9a8-4951-ae91-ce4cd9f05523 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:40.394730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30403b-a9a8-4951-ae91-ce4cd9f05523 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:40.400628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0870274-8158-450f-bfb0-70606982310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:40.401250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0870274-8158-450f-bfb0-70606982310a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.401527 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0870274-8158-450f-bfb0-70606982310a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.401795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0870274-8158-450f-bfb0-70606982310a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.402467 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0870274-8158-450f-bfb0-70606982310a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:40.404587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0870274-8158-450f-bfb0-70606982310a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:40.439201 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4390/8818] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:14:40 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:14:40.443711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e7bdd-fd33-4e1c-863f-46fc9be86077 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:40.456964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e7bdd-fd33-4e1c-863f-46fc9be86077 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:40.518397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b6a66-151d-446c-a997-54ed365b1b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:40.519008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b6a66-151d-446c-a997-54ed365b1b1d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.519288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b6a66-151d-446c-a997-54ed365b1b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.519552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b6a66-151d-446c-a997-54ed365b1b1d admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.520177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b6a66-151d-446c-a997-54ed365b1b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:40.522151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b6a66-151d-446c-a997-54ed365b1b1d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:40.546696 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4429/8819] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:14:40 2022] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:14:40.550833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0870274-8158-450f-bfb0-70606982310a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:40.561911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0870274-8158-450f-bfb0-70606982310a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:40.567096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd214c-9829-4ab7-b2b8-0d8097ec54f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:40.567698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd214c-9829-4ab7-b2b8-0d8097ec54f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.567969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd214c-9829-4ab7-b2b8-0d8097ec54f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.568248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd214c-9829-4ab7-b2b8-0d8097ec54f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.568978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd214c-9829-4ab7-b2b8-0d8097ec54f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:40.570638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd214c-9829-4ab7-b2b8-0d8097ec54f2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:40.581342 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4391/8820] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:14:40.585624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b6a66-151d-446c-a997-54ed365b1b1d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:40.597092 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b6a66-151d-446c-a997-54ed365b1b1d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:40.602536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e12717-3003-4f4a-b287-775595b42cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:40.603197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e12717-3003-4f4a-b287-775595b42cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.603472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e12717-3003-4f4a-b287-775595b42cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.603744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e12717-3003-4f4a-b287-775595b42cb1 admin admin] PATH_INFO: `/v3/projects/0b8c448d4a554d45ba906819aa65d2e6/users/cc093d1e026f4059a55c9473477c116c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.620571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e12717-3003-4f4a-b287-775595b42cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8c448d4a554d45ba906819aa65d2e6, user_id=cc093d1e026f4059a55c9473477c116c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:40.623653 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e12717-3003-4f4a-b287-775595b42cb1 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:40.637746 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4430/8821] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:14:40 2022] PUT /identity/v3/projects/0b8c448d4a554d45ba906819aa65d2e6/users/cc093d1e026f4059a55c9473477c116c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:14:40.642308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd214c-9829-4ab7-b2b8-0d8097ec54f2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:40.652799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd214c-9829-4ab7-b2b8-0d8097ec54f2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:40.713056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90af56b-8589-4c4f-b293-b2131da55de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:40.713575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af56b-8589-4c4f-b293-b2131da55de5 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.713840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af56b-8589-4c4f-b293-b2131da55de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.714140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90af56b-8589-4c4f-b293-b2131da55de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.714777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90af56b-8589-4c4f-b293-b2131da55de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:40.716480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90af56b-8589-4c4f-b293-b2131da55de5 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:40.726114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4392/8822] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:14:40.730564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e12717-3003-4f4a-b287-775595b42cb1 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:40.741456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e12717-3003-4f4a-b287-775595b42cb1 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:40.746429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d78950-f3c5-4b6b-a73f-74a3cb6d716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:40.747320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d78950-f3c5-4b6b-a73f-74a3cb6d716b admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.747627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d78950-f3c5-4b6b-a73f-74a3cb6d716b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.747896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d78950-f3c5-4b6b-a73f-74a3cb6d716b admin admin] PATH_INFO: `/v3/projects/0b8c448d4a554d45ba906819aa65d2e6/users/cc093d1e026f4059a55c9473477c116c/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.750068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d78950-f3c5-4b6b-a73f-74a3cb6d716b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8c448d4a554d45ba906819aa65d2e6, user_id=cc093d1e026f4059a55c9473477c116c, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:40.753576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d78950-f3c5-4b6b-a73f-74a3cb6d716b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:40.764966 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4431/8823] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:14:40 2022] PUT /identity/v3/projects/0b8c448d4a554d45ba906819aa65d2e6/users/cc093d1e026f4059a55c9473477c116c/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:40.775334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475518e5-a45e-4525-be55-c53d548029e1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.775630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475518e5-a45e-4525-be55-c53d548029e1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.775898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475518e5-a45e-4525-be55-c53d548029e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.796287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:40.812100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-475518e5-a45e-4525-be55-c53d548029e1 None None] MFA Rules not processed for user `cc093d1e026f4059a55c9473477c116c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:40.813313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-475518e5-a45e-4525-be55-c53d548029e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:40.884714 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4393/8824] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:40.898284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e96f-0144-436f-938f-b6b99139c31f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:40.898648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e96f-0144-436f-938f-b6b99139c31f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:40.898923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8e96f-0144-436f-938f-b6b99139c31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:40.919912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-98a8e96f-0144-436f-938f-b6b99139c31f None None] MFA Rules not processed for user `69433c5501cc4f21908606c60fcace54`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:40.921126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-98a8e96f-0144-436f-938f-b6b99139c31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:40.983820 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4432/8825] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:40.997861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475518e5-a45e-4525-be55-c53d548029e1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:40.999717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-475518e5-a45e-4525-be55-c53d548029e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:41.075107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475518e5-a45e-4525-be55-c53d548029e1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:41.081794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a1963-30d3-4f67-a32a-9ed16ca37065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:41.082439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a1963-30d3-4f67-a32a-9ed16ca37065 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:41.082730 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a1963-30d3-4f67-a32a-9ed16ca37065 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:41.082985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a1963-30d3-4f67-a32a-9ed16ca37065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:41.091991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a1963-30d3-4f67-a32a-9ed16ca37065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:41.093586 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a1963-30d3-4f67-a32a-9ed16ca37065 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:41.102539 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4394/8826] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:42.629522 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e96f-0144-436f-938f-b6b99139c31f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:42.631044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-98a8e96f-0144-436f-938f-b6b99139c31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:42.684781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:42.704082 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8e96f-0144-436f-938f-b6b99139c31f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:42.709289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c50ccb-8321-463b-bc2a-adb52cb796b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:42.709963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50ccb-8321-463b-bc2a-adb52cb796b2 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:42.710341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50ccb-8321-463b-bc2a-adb52cb796b2 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:42.710611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50ccb-8321-463b-bc2a-adb52cb796b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:42.712702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e4c50ccb-8321-463b-bc2a-adb52cb796b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:42.724932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c50ccb-8321-463b-bc2a-adb52cb796b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:42.726491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c50ccb-8321-463b-bc2a-adb52cb796b2 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:42.737402 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4433/8827] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:51.098371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=65 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:52.374432 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a1963-30d3-4f67-a32a-9ed16ca37065 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:52.375997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6d6a1963-30d3-4f67-a32a-9ed16ca37065 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:52.391433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a1963-30d3-4f67-a32a-9ed16ca37065 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:52.401761 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe3868-40ef-4314-803f-7d5c3f6df42a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:52.402700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe3868-40ef-4314-803f-7d5c3f6df42a service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:52.403088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe3868-40ef-4314-803f-7d5c3f6df42a service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:52.403369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe3868-40ef-4314-803f-7d5c3f6df42a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:52.412677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe3868-40ef-4314-803f-7d5c3f6df42a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:52.414319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe3868-40ef-4314-803f-7d5c3f6df42a service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:52.426212 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4395/8828] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:52 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:14:52.444097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c1634-83fc-4858-9887-9fb9b9fccead None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:52.444600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c1634-83fc-4858-9887-9fb9b9fccead None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:52.444600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c1634-83fc-4858-9887-9fb9b9fccead None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:52.446013 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4434/8829] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 05:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:14:52.450748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe3868-40ef-4314-803f-7d5c3f6df42a service nova] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 05:14:52.463035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe3868-40ef-4314-803f-7d5c3f6df42a service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:52.472119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe3868-40ef-4314-803f-7d5c3f6df42a service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:52.480341 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfafeb-a547-4104-b5a4-247aae56e1a7 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc093d1e026f4059a55c9473477c116c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b8c448d4a554d45ba906819aa65d2e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:52.481094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfafeb-a547-4104-b5a4-247aae56e1a7 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:52.481292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfafeb-a547-4104-b5a4-247aae56e1a7 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:52.481643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfafeb-a547-4104-b5a4-247aae56e1a7 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] PATH_INFO: `/v3/projects/0b8c448d4a554d45ba906819aa65d2e6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:52.483172 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfafeb-a547-4104-b5a4-247aae56e1a7 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] RBAC: Authorizing `identity:get_project(project_id=0b8c448d4a554d45ba906819aa65d2e6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:52.485563 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bfafeb-a547-4104-b5a4-247aae56e1a7 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:52.487603 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4396/8830] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 05:14:52 2022] GET /identity/v3/projects/0b8c448d4a554d45ba906819aa65d2e6 => generated 391 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:14:52.732519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=8 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:52.827424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c727d-1c16-411e-b4d8-c7067716c123 None None] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:52.827773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c727d-1c16-411e-b4d8-c7067716c123 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:52.828066 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c727d-1c16-411e-b4d8-c7067716c123 None None] PATH_INFO: `/` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:52.829827 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4435/8831] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 05:14:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 05:14:52.834871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfafeb-a547-4104-b5a4-247aae56e1a7 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] Authenticating service token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 30 05:14:52.858614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfafeb-a547-4104-b5a4-247aae56e1a7 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:52.869932 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfafeb-a547-4104-b5a4-247aae56e1a7 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:52.875983 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dd150-71fd-4143-ab06-800d6544f2d8 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc093d1e026f4059a55c9473477c116c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b8c448d4a554d45ba906819aa65d2e6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:52.876670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dd150-71fd-4143-ab06-800d6544f2d8 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:52.876947 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dd150-71fd-4143-ab06-800d6544f2d8 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:52.877215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5dd150-71fd-4143-ab06-800d6544f2d8 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] PATH_INFO: `/v3/projects/0b8c448d4a554d45ba906819aa65d2e6` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:52.878484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5dd150-71fd-4143-ab06-800d6544f2d8 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] RBAC: Authorizing `identity:get_project(project_id=0b8c448d4a554d45ba906819aa65d2e6)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:52.880328 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5dd150-71fd-4143-ab06-800d6544f2d8 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:52.882042 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4397/8832] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Aug 30 05:14:52 2022] GET /identity/v3/projects/0b8c448d4a554d45ba906819aa65d2e6 => generated 391 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:14:53.040009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70cf3-b34e-4396-a3f7-325697a3fa96 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:53.040286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70cf3-b34e-4396-a3f7-325697a3fa96 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:53.040615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70cf3-b34e-4396-a3f7-325697a3fa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:53.066506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f0a70cf3-b34e-4396-a3f7-325697a3fa96 None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:53.067757 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f0a70cf3-b34e-4396-a3f7-325697a3fa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:53.129260 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4436/8833] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:14:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:53.144643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dd150-71fd-4143-ab06-800d6544f2d8 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:53.146631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cd5dd150-71fd-4143-ab06-800d6544f2d8 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:53.159189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5dd150-71fd-4143-ab06-800d6544f2d8 tempest-ServersAdminNegativeTestJSON-310841347 tempest-ServersAdminNegativeTestJSON-310841347-project-admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:53.163080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f56e52-d640-46bf-9459-641ed5a64d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:53.163682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f56e52-d640-46bf-9459-641ed5a64d27 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:53.163959 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f56e52-d640-46bf-9459-641ed5a64d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:53.164226 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f56e52-d640-46bf-9459-641ed5a64d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:53.172094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f56e52-d640-46bf-9459-641ed5a64d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:53.173567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f56e52-d640-46bf-9459-641ed5a64d27 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:53.181556 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4398/8834] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:55.687176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70cf3-b34e-4396-a3f7-325697a3fa96 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:55.704251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70cf3-b34e-4396-a3f7-325697a3fa96 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:55.710276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5093283-b7e3-449e-b711-aa9f49573b8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:55.710905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5093283-b7e3-449e-b711-aa9f49573b8d service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:55.711180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5093283-b7e3-449e-b711-aa9f49573b8d service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:55.711449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5093283-b7e3-449e-b711-aa9f49573b8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:55.713541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f5093283-b7e3-449e-b711-aa9f49573b8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:55.726112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5093283-b7e3-449e-b711-aa9f49573b8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:55.727724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5093283-b7e3-449e-b711-aa9f49573b8d service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:55.738312 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4437/8835] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:57.005665 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f56e52-d640-46bf-9459-641ed5a64d27 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:57.085496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f56e52-d640-46bf-9459-641ed5a64d27 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:57.091792 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:57.092430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:57.092706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:57.092991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] PATH_INFO: `/v3/users/69433c5501cc4f21908606c60fcace54` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:57.094221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69433c5501cc4f21908606c60fcace54)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:57.096155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:57.147541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69433c5501cc4f21908606c60fcace54'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.155640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69433c5501cc4f21908606c60fcace54'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.172920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69433c5501cc4f21908606c60fcace54'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.181687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69433c5501cc4f21908606c60fcace54'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.182347 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69433c5501cc4f21908606c60fcace54'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.188617 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4399/8836] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:14:57 2022] DELETE /identity/v3/users/69433c5501cc4f21908606c60fcace54 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:57.193441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc176e2-16ed-446b-82ca-2307d5ed6e50 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:57.193965 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc176e2-16ed-446b-82ca-2307d5ed6e50 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:57.194065 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc176e2-16ed-446b-82ca-2307d5ed6e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:57.214334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-8fc176e2-16ed-446b-82ca-2307d5ed6e50 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:57.215610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8fc176e2-16ed-446b-82ca-2307d5ed6e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:57.279133 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4438/8837] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:14:57.289969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:57.291670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:57.339389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:57.362276 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c36203-956c-4caf-9cd6-54bbeb833932 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:57.366262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef2dd-e22f-45dc-a314-5fc3c93c7495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:57.366906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef2dd-e22f-45dc-a314-5fc3c93c7495 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:57.367189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef2dd-e22f-45dc-a314-5fc3c93c7495 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:57.367445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bef2dd-e22f-45dc-a314-5fc3c93c7495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:57.377270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bef2dd-e22f-45dc-a314-5fc3c93c7495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:57.378801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bef2dd-e22f-45dc-a314-5fc3c93c7495 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:57.388751 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4400/8838] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:14:57.571261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc176e2-16ed-446b-82ca-2307d5ed6e50 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:57.572803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8fc176e2-16ed-446b-82ca-2307d5ed6e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:57.586468 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc176e2-16ed-446b-82ca-2307d5ed6e50 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:57.593050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:57.593849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:57.594178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:57.594457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] PATH_INFO: `/v3/projects/c71d86e32def46f5b45c735be099bd56` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:57.595690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71d86e32def46f5b45c735be099bd56)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:57.597621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:57.650982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71d86e32def46f5b45c735be099bd56', 'request_id': 'req-e3c85b6a-cfdd-477f-87f1-39b590f967dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.658196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71d86e32def46f5b45c735be099bd56', 'request_id': 'req-e3c85b6a-cfdd-477f-87f1-39b590f967dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.669439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71d86e32def46f5b45c735be099bd56', 'request_id': 'req-e3c85b6a-cfdd-477f-87f1-39b590f967dc'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.680380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] The token cache is being invalidate because project c71d86e32def46f5b45c735be099bd56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:14:57.680668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.681347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.682875 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4439/8839] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:14:57 2022] DELETE /identity/v3/projects/c71d86e32def46f5b45c735be099bd56 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:57.687317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef2dd-e22f-45dc-a314-5fc3c93c7495 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:57.697757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bef2dd-e22f-45dc-a314-5fc3c93c7495 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:57.764311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:57.764948 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:57.765222 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:57.765488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] PATH_INFO: `/v3/users/cc093d1e026f4059a55c9473477c116c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:57.766760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc093d1e026f4059a55c9473477c116c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:57.768706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:57.821901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc093d1e026f4059a55c9473477c116c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.828912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc093d1e026f4059a55c9473477c116c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.841781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc093d1e026f4059a55c9473477c116c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.850485 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc093d1e026f4059a55c9473477c116c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.851089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-a4b08ad8-8730-4fbc-842a-c7b367475347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc093d1e026f4059a55c9473477c116c'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:57.857344 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4401/8840] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:14:57 2022] DELETE /identity/v3/users/cc093d1e026f4059a55c9473477c116c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:58.171027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:58.172530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:58.186731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c85b6a-cfdd-477f-87f1-39b590f967dc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:58.205386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:58.250276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:58.250914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:58.251186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:58.251453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] PATH_INFO: `/v3/projects/0b8c448d4a554d45ba906819aa65d2e6` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:58.252610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8c448d4a554d45ba906819aa65d2e6)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:58.254551 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:58.312291 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8c448d4a554d45ba906819aa65d2e6', 'request_id': 'req-7d4f3612-3a4d-421f-96b9-c939da152ed6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:58.318459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8c448d4a554d45ba906819aa65d2e6', 'request_id': 'req-7d4f3612-3a4d-421f-96b9-c939da152ed6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:58.328079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8c448d4a554d45ba906819aa65d2e6', 'request_id': 'req-7d4f3612-3a4d-421f-96b9-c939da152ed6'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:58.339154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] The token cache is being invalidate because project 0b8c448d4a554d45ba906819aa65d2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:14:58.339370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:58.340301 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-7d4f3612-3a4d-421f-96b9-c939da152ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:14:58.342405 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4440/8841] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:14:58 2022] DELETE /identity/v3/projects/0b8c448d4a554d45ba906819aa65d2e6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:14:58.348476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22b9e6-583c-414a-8455-5191062a9a89 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:58.349013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22b9e6-583c-414a-8455-5191062a9a89 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:58.349013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22b9e6-583c-414a-8455-5191062a9a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:58.371332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0d22b9e6-583c-414a-8455-5191062a9a89 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:58.373499 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0d22b9e6-583c-414a-8455-5191062a9a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:58.432073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:58.446433 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4402/8842] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:58.459820 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399dad3-fbf8-4f97-a597-38c9ec79d167 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:58.460192 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399dad3-fbf8-4f97-a597-38c9ec79d167 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:58.460604 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399dad3-fbf8-4f97-a597-38c9ec79d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:58.483325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5399dad3-fbf8-4f97-a597-38c9ec79d167 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:58.484541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5399dad3-fbf8-4f97-a597-38c9ec79d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:58.494256 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4441/8843] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:58.499244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22b9e6-583c-414a-8455-5191062a9a89 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:58.509651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22b9e6-583c-414a-8455-5191062a9a89 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:58.515818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e7d2-1d25-4cba-9e31-29039ed5bbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:58.516417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e7d2-1d25-4cba-9e31-29039ed5bbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:58.516688 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e7d2-1d25-4cba-9e31-29039ed5bbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:58.516954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7e7d2-1d25-4cba-9e31-29039ed5bbf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:58.517596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e7d2-1d25-4cba-9e31-29039ed5bbf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:14:58.517917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e7d2-1d25-4cba-9e31-29039ed5bbf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:58.519818 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7e7d2-1d25-4cba-9e31-29039ed5bbf0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:58.532160 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4403/8844] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:14:58.536558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399dad3-fbf8-4f97-a597-38c9ec79d167 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:58.546995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399dad3-fbf8-4f97-a597-38c9ec79d167 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:58.552257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3fa44-92b5-420f-ab25-dc6f1cf332d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:58.552907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3fa44-92b5-420f-ab25-dc6f1cf332d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:58.553299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3fa44-92b5-420f-ab25-dc6f1cf332d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:58.553572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3fa44-92b5-420f-ab25-dc6f1cf332d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:58.554257 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3fa44-92b5-420f-ab25-dc6f1cf332d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:58.556170 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e3fa44-92b5-420f-ab25-dc6f1cf332d6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:58.585403 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4442/8845] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:14:58 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:14:58.589977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e7d2-1d25-4cba-9e31-29039ed5bbf0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:58.600305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7e7d2-1d25-4cba-9e31-29039ed5bbf0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:58.665034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb962e-9d76-464c-b149-b8af05a19f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:58.666062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb962e-9d76-464c-b149-b8af05a19f72 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:58.666506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb962e-9d76-464c-b149-b8af05a19f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:58.666950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb962e-9d76-464c-b149-b8af05a19f72 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:58.667978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb962e-9d76-464c-b149-b8af05a19f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:58.670456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fb962e-9d76-464c-b149-b8af05a19f72 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:58.693387 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4404/8846] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:14:58 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:14:58.697895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3fa44-92b5-420f-ab25-dc6f1cf332d6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:58.711145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e3fa44-92b5-420f-ab25-dc6f1cf332d6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:58.718200 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d8d2e-a785-4408-8b38-8d8c60aad1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:58.718816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8d2e-a785-4408-8b38-8d8c60aad1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:58.719089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8d2e-a785-4408-8b38-8d8c60aad1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:58.719352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8d2e-a785-4408-8b38-8d8c60aad1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:58.719982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d8d2e-a785-4408-8b38-8d8c60aad1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:58.721844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d8d2e-a785-4408-8b38-8d8c60aad1f3 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:58.732364 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4443/8847] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:14:58.736565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb962e-9d76-464c-b149-b8af05a19f72 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:58.747791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb962e-9d76-464c-b149-b8af05a19f72 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:58.755165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f3f69-5446-4e45-985b-5d835f6448f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:58.755771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f3f69-5446-4e45-985b-5d835f6448f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:58.756120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f3f69-5446-4e45-985b-5d835f6448f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:58.756435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f3f69-5446-4e45-985b-5d835f6448f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:58.757229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f3f69-5446-4e45-985b-5d835f6448f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:58.759536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f3f69-5446-4e45-985b-5d835f6448f7 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:58.771751 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4405/8848] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:14:58.776134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d8d2e-a785-4408-8b38-8d8c60aad1f3 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:58.787103 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d8d2e-a785-4408-8b38-8d8c60aad1f3 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:58.793671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3333956-be52-4d3c-b508-e81225df738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:58.794440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3333956-be52-4d3c-b508-e81225df738d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:58.794714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3333956-be52-4d3c-b508-e81225df738d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:58.795005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3333956-be52-4d3c-b508-e81225df738d admin admin] PATH_INFO: `/v3/projects/32f9c14618df455496ff17fd61d17401/users/a4b3b0a7dd5c4cd3a25d8971013d48cf/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:58.810880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3333956-be52-4d3c-b508-e81225df738d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f9c14618df455496ff17fd61d17401, user_id=a4b3b0a7dd5c4cd3a25d8971013d48cf, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:58.813521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3333956-be52-4d3c-b508-e81225df738d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:58.828974 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4444/8849] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:14:58 2022] PUT /identity/v3/projects/32f9c14618df455496ff17fd61d17401/users/a4b3b0a7dd5c4cd3a25d8971013d48cf/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:14:58.834300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5049-6171-4423-9f90-95545ab5ce2c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:58.834613 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5049-6171-4423-9f90-95545ab5ce2c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:58.834892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d5049-6171-4423-9f90-95545ab5ce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:58.854466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ff4d5049-6171-4423-9f90-95545ab5ce2c None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:14:58.855631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ff4d5049-6171-4423-9f90-95545ab5ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:58.925801 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4406/8850] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:14:58.938600 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3333956-be52-4d3c-b508-e81225df738d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:14:58.941230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d3333956-be52-4d3c-b508-e81225df738d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:14:58.996895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:59.003217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3333956-be52-4d3c-b508-e81225df738d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:14:59.007993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d58a48-e420-45f4-8c40-f5f24593c87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:14:59.008617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d58a48-e420-45f4-8c40-f5f24593c87f service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:14:59.009054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d58a48-e420-45f4-8c40-f5f24593c87f service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:14:59.009513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d58a48-e420-45f4-8c40-f5f24593c87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:14:59.019506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d58a48-e420-45f4-8c40-f5f24593c87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:14:59.020952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d58a48-e420-45f4-8c40-f5f24593c87f service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:14:59.031215 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4445/8851] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:03.201669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b48a3-99f9-4361-991a-7a580a98dae5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:03.202197 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b48a3-99f9-4361-991a-7a580a98dae5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:03.202289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b48a3-99f9-4361-991a-7a580a98dae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:03.232878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f67b48a3-99f9-4361-991a-7a580a98dae5 None None] MFA Rules not processed for user `a4b3b0a7dd5c4cd3a25d8971013d48cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:03.234247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f67b48a3-99f9-4361-991a-7a580a98dae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:03.293840 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:03.306484 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4407/8852] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:15:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:03.319335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef44e05-c190-488d-ba35-b634c5a36f08 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:03.319842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef44e05-c190-488d-ba35-b634c5a36f08 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:03.319948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef44e05-c190-488d-ba35-b634c5a36f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:03.339506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4ef44e05-c190-488d-ba35-b634c5a36f08 None None] MFA Rules not processed for user `a4b3b0a7dd5c4cd3a25d8971013d48cf`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:03.340788 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ef44e05-c190-488d-ba35-b634c5a36f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:03.348208 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4446/8853] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:15:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:03.361920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b48a3-99f9-4361-991a-7a580a98dae5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:03.363361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f67b48a3-99f9-4361-991a-7a580a98dae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:03.441659 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b48a3-99f9-4361-991a-7a580a98dae5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:03.447383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677ca06-1d54-4a5e-9fd3-f2b23fc19c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:03.448038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677ca06-1d54-4a5e-9fd3-f2b23fc19c52 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:03.448285 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677ca06-1d54-4a5e-9fd3-f2b23fc19c52 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:03.448643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677ca06-1d54-4a5e-9fd3-f2b23fc19c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:03.461909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677ca06-1d54-4a5e-9fd3-f2b23fc19c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:03.465806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677ca06-1d54-4a5e-9fd3-f2b23fc19c52 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:03.476083 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4408/8854] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:04.084954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87d31-925a-478f-830a-0b0282535e34 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:04.085208 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87d31-925a-478f-830a-0b0282535e34 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:04.085646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e87d31-925a-478f-830a-0b0282535e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:04.132886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e2e87d31-925a-478f-830a-0b0282535e34 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:04.134113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e2e87d31-925a-478f-830a-0b0282535e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:04.199492 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4447/8855] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Aug 30 05:15:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:04.205675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677ca06-1d54-4a5e-9fd3-f2b23fc19c52 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:04.217344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677ca06-1d54-4a5e-9fd3-f2b23fc19c52 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:04.222298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451abfbf-9cee-4a8d-897c-4f7fbdfc7c67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:04.222927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451abfbf-9cee-4a8d-897c-4f7fbdfc7c67 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:04.223202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451abfbf-9cee-4a8d-897c-4f7fbdfc7c67 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:04.223469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451abfbf-9cee-4a8d-897c-4f7fbdfc7c67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:04.225362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-451abfbf-9cee-4a8d-897c-4f7fbdfc7c67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:04.237480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451abfbf-9cee-4a8d-897c-4f7fbdfc7c67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:04.239089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451abfbf-9cee-4a8d-897c-4f7fbdfc7c67 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:04.249082 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4409/8856] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:15:13.997635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f820a8c-df34-4998-99aa-bf85b649bbde None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:13.999017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f820a8c-df34-4998-99aa-bf85b649bbde None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:13.999017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f820a8c-df34-4998-99aa-bf85b649bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:14.018996 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-6f820a8c-df34-4998-99aa-bf85b649bbde None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:14.020217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6f820a8c-df34-4998-99aa-bf85b649bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:14.026837 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4448/8857] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:15:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:14.043996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451abfbf-9cee-4a8d-897c-4f7fbdfc7c67 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:14.054538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451abfbf-9cee-4a8d-897c-4f7fbdfc7c67 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:14.058344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc2c97-5088-48b3-9b03-495c6a511318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:14.059022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2c97-5088-48b3-9b03-495c6a511318 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:14.059288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2c97-5088-48b3-9b03-495c6a511318 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:14.059555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc2c97-5088-48b3-9b03-495c6a511318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:14.067827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc2c97-5088-48b3-9b03-495c6a511318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:14.069721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc2c97-5088-48b3-9b03-495c6a511318 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:14.078611 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4410/8858] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:14.186303 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f820a8c-df34-4998-99aa-bf85b649bbde None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:14.199569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f820a8c-df34-4998-99aa-bf85b649bbde None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:14.204666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596f6f5-50a6-4576-a92e-0530336d3d60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:14.205273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f6f5-50a6-4576-a92e-0530336d3d60 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:14.205553 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f6f5-50a6-4576-a92e-0530336d3d60 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:14.205847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f6f5-50a6-4576-a92e-0530336d3d60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:14.207674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e596f6f5-50a6-4576-a92e-0530336d3d60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:14.221525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596f6f5-50a6-4576-a92e-0530336d3d60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:14.224027 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596f6f5-50a6-4576-a92e-0530336d3d60 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:14.239260 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4449/8859] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:14.428771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a83dab-52b7-4fb1-9f83-7a200f70d706 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:14.429056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a83dab-52b7-4fb1-9f83-7a200f70d706 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:14.429349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a83dab-52b7-4fb1-9f83-7a200f70d706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:14.450207 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-02a83dab-52b7-4fb1-9f83-7a200f70d706 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:14.451444 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-02a83dab-52b7-4fb1-9f83-7a200f70d706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:14.462799 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4411/8860] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:15:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:14.472998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596f6f5-50a6-4576-a92e-0530336d3d60 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:14.483088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596f6f5-50a6-4576-a92e-0530336d3d60 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:14.487898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209840b8-56ac-4c98-9ecf-6ff860557ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:14.488493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209840b8-56ac-4c98-9ecf-6ff860557ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:14.488765 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209840b8-56ac-4c98-9ecf-6ff860557ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:14.489028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209840b8-56ac-4c98-9ecf-6ff860557ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:14.500089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209840b8-56ac-4c98-9ecf-6ff860557ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:14.501509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209840b8-56ac-4c98-9ecf-6ff860557ed2 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:14.512387 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4450/8861] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:14.870370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a83dab-52b7-4fb1-9f83-7a200f70d706 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:14.872541 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-02a83dab-52b7-4fb1-9f83-7a200f70d706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:14.890524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a83dab-52b7-4fb1-9f83-7a200f70d706 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:14.896370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21342d-0636-425f-ad71-3938061495ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:14.897016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21342d-0636-425f-ad71-3938061495ab service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:14.897295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21342d-0636-425f-ad71-3938061495ab service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:14.897539 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21342d-0636-425f-ad71-3938061495ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:14.899936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-de21342d-0636-425f-ad71-3938061495ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:14.912540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21342d-0636-425f-ad71-3938061495ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:14.914175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21342d-0636-425f-ad71-3938061495ab service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:14.924306 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4412/8862] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:24.507597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=58 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:24.920140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=58 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:57.189109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e319653-3ddb-491e-bf5a-88d3990cd635 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:57.189569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e319653-3ddb-491e-bf5a-88d3990cd635 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:57.189643 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e319653-3ddb-491e-bf5a-88d3990cd635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:57.217955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9e319653-3ddb-491e-bf5a-88d3990cd635 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:57.218580 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9e319653-3ddb-491e-bf5a-88d3990cd635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:57.227516 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4451/8863] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:15:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:57.244550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21342d-0636-425f-ad71-3938061495ab service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:57.256153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21342d-0636-425f-ad71-3938061495ab service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:57.262017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ba8e3-e024-4756-9bc5-745d4b1544d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:57.262594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e319653-3ddb-491e-bf5a-88d3990cd635 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:57.262736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ba8e3-e024-4756-9bc5-745d4b1544d8 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:57.262925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ba8e3-e024-4756-9bc5-745d4b1544d8 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:57.263191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ba8e3-e024-4756-9bc5-745d4b1544d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:57.273108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ba8e3-e024-4756-9bc5-745d4b1544d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:57.274828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ba8e3-e024-4756-9bc5-745d4b1544d8 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:57.276822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e319653-3ddb-491e-bf5a-88d3990cd635 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:57.286709 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4413/8864] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:15:57.288743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:57.289401 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:57.289782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:57.290076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] PATH_INFO: `/v3/users/a4b3b0a7dd5c4cd3a25d8971013d48cf` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:57.291851 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b3b0a7dd5c4cd3a25d8971013d48cf)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:57.293964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:57.350395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b3b0a7dd5c4cd3a25d8971013d48cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:57.351067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b3b0a7dd5c4cd3a25d8971013d48cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:57.361282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b3b0a7dd5c4cd3a25d8971013d48cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:57.370852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b3b0a7dd5c4cd3a25d8971013d48cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:57.384309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-14ba7189-88ba-4634-9e7c-3278ec4c48e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b3b0a7dd5c4cd3a25d8971013d48cf'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:57.390922 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4452/8865] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:15:57 2022] DELETE /identity/v3/users/a4b3b0a7dd5c4cd3a25d8971013d48cf => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:15:57.584155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ba8e3-e024-4756-9bc5-745d4b1544d8 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:57.596724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ba8e3-e024-4756-9bc5-745d4b1544d8 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:57.656627 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:57.657270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:57.657690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:57.658002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] PATH_INFO: `/v3/projects/32f9c14618df455496ff17fd61d17401` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:57.659156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f9c14618df455496ff17fd61d17401)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:57.661075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:57.711438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f9c14618df455496ff17fd61d17401', 'request_id': 'req-fddb00d4-440c-41a2-87c9-0257eb91d966'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:57.719831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f9c14618df455496ff17fd61d17401', 'request_id': 'req-fddb00d4-440c-41a2-87c9-0257eb91d966'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:57.726682 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f9c14618df455496ff17fd61d17401', 'request_id': 'req-fddb00d4-440c-41a2-87c9-0257eb91d966'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:57.738652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] The token cache is being invalidate because project 32f9c14618df455496ff17fd61d17401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:15:57.738945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:57.739667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-fddb00d4-440c-41a2-87c9-0257eb91d966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:15:57.741274 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4414/8866] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:15:57 2022] DELETE /identity/v3/projects/32f9c14618df455496ff17fd61d17401 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:15:57.746555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ffdc0-434b-46d5-bea4-bc836376f6bc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:57.746839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ffdc0-434b-46d5-bea4-bc836376f6bc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:57.747112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ffdc0-434b-46d5-bea4-bc836376f6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:57.767099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-571ffdc0-434b-46d5-bea4-bc836376f6bc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:57.768205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-571ffdc0-434b-46d5-bea4-bc836376f6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:57.833443 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4453/8867] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:15:57.842139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12884c-cc8f-4866-8475-7ce8ca1676cd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:57.842448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12884c-cc8f-4866-8475-7ce8ca1676cd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:57.842716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12884c-cc8f-4866-8475-7ce8ca1676cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:57.864085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9f12884c-cc8f-4866-8475-7ce8ca1676cd None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:57.865293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9f12884c-cc8f-4866-8475-7ce8ca1676cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:57.876209 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4415/8868] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:15:57.881456 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ffdc0-434b-46d5-bea4-bc836376f6bc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:57.895357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ffdc0-434b-46d5-bea4-bc836376f6bc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:57.901753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7024f1-bef5-4bbf-8dad-9025c1770c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:57.902637 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7024f1-bef5-4bbf-8dad-9025c1770c69 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:57.902949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7024f1-bef5-4bbf-8dad-9025c1770c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:57.903217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7024f1-bef5-4bbf-8dad-9025c1770c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:57.903857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7024f1-bef5-4bbf-8dad-9025c1770c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:15:57.904154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7024f1-bef5-4bbf-8dad-9025c1770c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:57.905740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7024f1-bef5-4bbf-8dad-9025c1770c69 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:57.918425 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4454/8869] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:15:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:15:57.922889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12884c-cc8f-4866-8475-7ce8ca1676cd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:57.932323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12884c-cc8f-4866-8475-7ce8ca1676cd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:57.938721 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4e140-b4f9-421b-845a-c5b6c917f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:57.939342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4e140-b4f9-421b-845a-c5b6c917f33a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:57.939629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4e140-b4f9-421b-845a-c5b6c917f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:57.939845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4e140-b4f9-421b-845a-c5b6c917f33a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:57.940507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4e140-b4f9-421b-845a-c5b6c917f33a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:57.942455 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4e140-b4f9-421b-845a-c5b6c917f33a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:57.977758 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4416/8870] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:15:57 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:15:57.982123 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7024f1-bef5-4bbf-8dad-9025c1770c69 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:57.994422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7024f1-bef5-4bbf-8dad-9025c1770c69 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:58.045404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:58.058351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b5902-07e5-476d-acca-83305fd067bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:58.059627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b5902-07e5-476d-acca-83305fd067bd admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:58.059937 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b5902-07e5-476d-acca-83305fd067bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:58.060263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b5902-07e5-476d-acca-83305fd067bd admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:58.061347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b5902-07e5-476d-acca-83305fd067bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:58.063838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b5902-07e5-476d-acca-83305fd067bd admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:58.089590 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4455/8871] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:15:57 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:15:58.092267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4e140-b4f9-421b-845a-c5b6c917f33a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:58.103136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4e140-b4f9-421b-845a-c5b6c917f33a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:58.109181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1b6c-9136-4bfc-8a54-f5089379c07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:58.109781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1b6c-9136-4bfc-8a54-f5089379c07d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:58.110100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1b6c-9136-4bfc-8a54-f5089379c07d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:58.110364 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1b6c-9136-4bfc-8a54-f5089379c07d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:58.111063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea1b6c-9136-4bfc-8a54-f5089379c07d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:58.112652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea1b6c-9136-4bfc-8a54-f5089379c07d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:58.123740 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4417/8872] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:15:58.127995 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b5902-07e5-476d-acca-83305fd067bd admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:58.138964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b5902-07e5-476d-acca-83305fd067bd admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:58.144868 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f934b1f-6abd-4ec7-9778-8317cf9bee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:58.145469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f934b1f-6abd-4ec7-9778-8317cf9bee93 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:58.145745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f934b1f-6abd-4ec7-9778-8317cf9bee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:58.146044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f934b1f-6abd-4ec7-9778-8317cf9bee93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:58.146689 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f934b1f-6abd-4ec7-9778-8317cf9bee93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:58.148320 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f934b1f-6abd-4ec7-9778-8317cf9bee93 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:58.160899 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4456/8873] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:15:58.165145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1b6c-9136-4bfc-8a54-f5089379c07d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:58.176648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1b6c-9136-4bfc-8a54-f5089379c07d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:58.181449 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021decd-82bd-4118-9d3b-f39d4f1919cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:58.182143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021decd-82bd-4118-9d3b-f39d4f1919cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:58.182564 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021decd-82bd-4118-9d3b-f39d4f1919cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:58.182821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021decd-82bd-4118-9d3b-f39d4f1919cf admin admin] PATH_INFO: `/v3/projects/34b84f5bd86b49fba7c406ddc62d480e/users/b6f3421fc079438f9c2e9eaf773dd109/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:58.198009 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021decd-82bd-4118-9d3b-f39d4f1919cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b84f5bd86b49fba7c406ddc62d480e, user_id=b6f3421fc079438f9c2e9eaf773dd109, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:58.201060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021decd-82bd-4118-9d3b-f39d4f1919cf admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:58.216445 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4418/8874] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:15:58 2022] PUT /identity/v3/projects/34b84f5bd86b49fba7c406ddc62d480e/users/b6f3421fc079438f9c2e9eaf773dd109/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:15:58.224253 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9dfd1-d8fc-4538-a804-84e076284124 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:58.224953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9dfd1-d8fc-4538-a804-84e076284124 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:58.225049 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9dfd1-d8fc-4538-a804-84e076284124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:58.254385 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-e6a9dfd1-d8fc-4538-a804-84e076284124 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:15:58.256645 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e6a9dfd1-d8fc-4538-a804-84e076284124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:58.319417 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4457/8875] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:15:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:15:58.329510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021decd-82bd-4118-9d3b-f39d4f1919cf admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:15:58.331585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b021decd-82bd-4118-9d3b-f39d4f1919cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:15:58.349020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:58.394431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021decd-82bd-4118-9d3b-f39d4f1919cf admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:15:58.398560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37f7ce-6a88-4ce9-bf70-a35933f9ff85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:15:58.399171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37f7ce-6a88-4ce9-bf70-a35933f9ff85 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:15:58.399486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37f7ce-6a88-4ce9-bf70-a35933f9ff85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:15:58.399749 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37f7ce-6a88-4ce9-bf70-a35933f9ff85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:15:58.409371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37f7ce-6a88-4ce9-bf70-a35933f9ff85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:15:58.410831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37f7ce-6a88-4ce9-bf70-a35933f9ff85 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:15:58.420648 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4419/8876] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:15:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:02.634037 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26598a52-4d2e-454b-870d-45649b3a92ff None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:02.634574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26598a52-4d2e-454b-870d-45649b3a92ff None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:02.634574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26598a52-4d2e-454b-870d-45649b3a92ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:02.685097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-26598a52-4d2e-454b-870d-45649b3a92ff None None] MFA Rules not processed for user `b6f3421fc079438f9c2e9eaf773dd109`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:02.686352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-26598a52-4d2e-454b-870d-45649b3a92ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:02.751910 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4458/8877] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:02.763205 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357850b2-120f-4fb1-a553-af2ac41900de None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:02.763785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357850b2-120f-4fb1-a553-af2ac41900de None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:02.763785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357850b2-120f-4fb1-a553-af2ac41900de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:02.784601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-357850b2-120f-4fb1-a553-af2ac41900de None None] MFA Rules not processed for user `b6f3421fc079438f9c2e9eaf773dd109`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:02.785803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-357850b2-120f-4fb1-a553-af2ac41900de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:02.794212 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4420/8878] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:16:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:16:02.806423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26598a52-4d2e-454b-870d-45649b3a92ff None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:16:02.807880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-26598a52-4d2e-454b-870d-45649b3a92ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:02.886059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:02.903940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26598a52-4d2e-454b-870d-45649b3a92ff None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:16:02.909688 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e642-ccb5-409d-959d-35124ac2bb34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:16:02.910337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e642-ccb5-409d-959d-35124ac2bb34 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:02.910634 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e642-ccb5-409d-959d-35124ac2bb34 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:02.910899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e642-ccb5-409d-959d-35124ac2bb34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:02.919359 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e642-ccb5-409d-959d-35124ac2bb34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:16:02.920959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e642-ccb5-409d-959d-35124ac2bb34 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:16:02.930125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4459/8879] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:16:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:16:12.778592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=23 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:12.925971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:54.530093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ea7a-9e3d-4a85-bd81-f5583ab9b793 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:16:54.530690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ea7a-9e3d-4a85-bd81-f5583ab9b793 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:16:54.530690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209ea7a-9e3d-4a85-bd81-f5583ab9b793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:16:54.551737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d209ea7a-9e3d-4a85-bd81-f5583ab9b793 None None] MFA Rules not processed for user `b6f3421fc079438f9c2e9eaf773dd109`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:16:54.552971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d209ea7a-9e3d-4a85-bd81-f5583ab9b793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:16:54.563447 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4421/8880] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:16:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:04.545584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:21.827128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e642-ccb5-409d-959d-35124ac2bb34 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:21.837925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e642-ccb5-409d-959d-35124ac2bb34 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:21.841633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472cf3d-3c75-4707-8f64-1958c81413dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:21.842269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472cf3d-3c75-4707-8f64-1958c81413dc service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:21.842539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472cf3d-3c75-4707-8f64-1958c81413dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:21.842806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472cf3d-3c75-4707-8f64-1958c81413dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:21.844858 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7472cf3d-3c75-4707-8f64-1958c81413dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:21.859112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472cf3d-3c75-4707-8f64-1958c81413dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:21.860654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472cf3d-3c75-4707-8f64-1958c81413dc service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:21.872244 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4460/8881] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:23.057296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ea7a-9e3d-4a85-bd81-f5583ab9b793 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:23.070273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209ea7a-9e3d-4a85-bd81-f5583ab9b793 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:23.074351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d523f4-490a-4819-9bf2-a06e661e70da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:23.074956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d523f4-490a-4819-9bf2-a06e661e70da service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:23.075234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d523f4-490a-4819-9bf2-a06e661e70da service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:23.075494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d523f4-490a-4819-9bf2-a06e661e70da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:23.077224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-82d523f4-490a-4819-9bf2-a06e661e70da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:23.091649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d523f4-490a-4819-9bf2-a06e661e70da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:23.093087 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d523f4-490a-4819-9bf2-a06e661e70da service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:23.104259 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4422/8882] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:31.867167 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:33.099183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:33.975260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472cf3d-3c75-4707-8f64-1958c81413dc service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:33.989633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472cf3d-3c75-4707-8f64-1958c81413dc service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:34.001231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db9e0-bfa5-4806-970b-0acc9eb0ff68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:34.001840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db9e0-bfa5-4806-970b-0acc9eb0ff68 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:34.002156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db9e0-bfa5-4806-970b-0acc9eb0ff68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:34.002425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db9e0-bfa5-4806-970b-0acc9eb0ff68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:34.004399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-247db9e0-bfa5-4806-970b-0acc9eb0ff68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:34.014915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247db9e0-bfa5-4806-970b-0acc9eb0ff68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:34.016350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247db9e0-bfa5-4806-970b-0acc9eb0ff68 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:34.027267 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4461/8883] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:34.274360 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d523f4-490a-4819-9bf2-a06e661e70da service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:34.275960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-82d523f4-490a-4819-9bf2-a06e661e70da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:34.292668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d523f4-490a-4819-9bf2-a06e661e70da service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:34.292668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a750d7-660a-4dc9-9c1f-f2692d6e8880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:34.292668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a750d7-660a-4dc9-9c1f-f2692d6e8880 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:34.292668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a750d7-660a-4dc9-9c1f-f2692d6e8880 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:34.293062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a750d7-660a-4dc9-9c1f-f2692d6e8880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:34.294769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-33a750d7-660a-4dc9-9c1f-f2692d6e8880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:34.304620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a750d7-660a-4dc9-9c1f-f2692d6e8880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:34.306111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a750d7-660a-4dc9-9c1f-f2692d6e8880 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:34.316148 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4423/8884] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:41.505727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db9e0-bfa5-4806-970b-0acc9eb0ff68 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:41.507854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-247db9e0-bfa5-4806-970b-0acc9eb0ff68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:41.534166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db9e0-bfa5-4806-970b-0acc9eb0ff68 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:41.541477 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe0b78-7c30-49d3-84a3-f3380d31e359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:41.542134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe0b78-7c30-49d3-84a3-f3380d31e359 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:41.542459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe0b78-7c30-49d3-84a3-f3380d31e359 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:41.542740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe0b78-7c30-49d3-84a3-f3380d31e359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:41.544899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-e6fe0b78-7c30-49d3-84a3-f3380d31e359 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:41.558743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe0b78-7c30-49d3-84a3-f3380d31e359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:41.560351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe0b78-7c30-49d3-84a3-f3380d31e359 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:41.572143 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4462/8885] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:44.310728 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:48.545675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cff14-4dda-418c-bde3-1835af6182f5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:48.546361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cff14-4dda-418c-bde3-1835af6182f5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:48.548646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cff14-4dda-418c-bde3-1835af6182f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:48.571442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-340cff14-4dda-418c-bde3-1835af6182f5 None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:48.573474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-340cff14-4dda-418c-bde3-1835af6182f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:48.615896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe0b78-7c30-49d3-84a3-f3380d31e359 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:48.627659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe0b78-7c30-49d3-84a3-f3380d31e359 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:48.633470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:48.634515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:48.634917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:48.635352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] PATH_INFO: `/v3/users/b6f3421fc079438f9c2e9eaf773dd109` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:48.636686 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f3421fc079438f9c2e9eaf773dd109)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:48.638768 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:48.655761 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4424/8886] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:17:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:48.670598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cff14-4dda-418c-bde3-1835af6182f5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:48.672223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-340cff14-4dda-418c-bde3-1835af6182f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:48.688472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cff14-4dda-418c-bde3-1835af6182f5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:48.693581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978545b-1ec1-49be-92ee-d20a2d7aea76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:48.694236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978545b-1ec1-49be-92ee-d20a2d7aea76 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:48.694540 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978545b-1ec1-49be-92ee-d20a2d7aea76 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:48.694811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978545b-1ec1-49be-92ee-d20a2d7aea76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:48.698422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f3421fc079438f9c2e9eaf773dd109'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.699131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f3421fc079438f9c2e9eaf773dd109'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.703704 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978545b-1ec1-49be-92ee-d20a2d7aea76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:48.705314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978545b-1ec1-49be-92ee-d20a2d7aea76 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:48.706985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f3421fc079438f9c2e9eaf773dd109'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.715879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f3421fc079438f9c2e9eaf773dd109'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.717023 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4425/8887] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:17:48.728607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-6ba1a5ff-b9a3-428e-af9e-8eb1c4c93728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f3421fc079438f9c2e9eaf773dd109'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:48.734988 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4463/8888] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:17:48 2022] DELETE /identity/v3/users/b6f3421fc079438f9c2e9eaf773dd109 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:48.925182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978545b-1ec1-49be-92ee-d20a2d7aea76 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:48.938949 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978545b-1ec1-49be-92ee-d20a2d7aea76 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:49.010405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:49.011198 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.011537 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.012154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] PATH_INFO: `/v3/projects/34b84f5bd86b49fba7c406ddc62d480e` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.013313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b84f5bd86b49fba7c406ddc62d480e)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:49.015330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:49.063124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b84f5bd86b49fba7c406ddc62d480e', 'request_id': 'req-3084b139-2f3c-4652-b39b-d6e34c76e3ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:49.071694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b84f5bd86b49fba7c406ddc62d480e', 'request_id': 'req-3084b139-2f3c-4652-b39b-d6e34c76e3ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:49.078063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b84f5bd86b49fba7c406ddc62d480e', 'request_id': 'req-3084b139-2f3c-4652-b39b-d6e34c76e3ac'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:49.089695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:49.105863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] The token cache is being invalidate because project 34b84f5bd86b49fba7c406ddc62d480e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:17:49.106505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:49.107296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3084b139-2f3c-4652-b39b-d6e34c76e3ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:17:49.109441 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4426/8889] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:17:48 2022] DELETE /identity/v3/projects/34b84f5bd86b49fba7c406ddc62d480e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:49.115539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125be6f2-2c7a-4c9f-a54a-4969595eabfc None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.115928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125be6f2-2c7a-4c9f-a54a-4969595eabfc None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.116351 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125be6f2-2c7a-4c9f-a54a-4969595eabfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.139302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-125be6f2-2c7a-4c9f-a54a-4969595eabfc None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:49.140530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-125be6f2-2c7a-4c9f-a54a-4969595eabfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:49.204384 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4464/8890] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:49.213814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4aa50-d27d-49f5-b96f-fa731bedaf18 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.214124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4aa50-d27d-49f5-b96f-fa731bedaf18 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.214399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4aa50-d27d-49f5-b96f-fa731bedaf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.237907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c7e4aa50-d27d-49f5-b96f-fa731bedaf18 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:49.239274 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c7e4aa50-d27d-49f5-b96f-fa731bedaf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:49.249085 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4427/8891] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:49.254527 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125be6f2-2c7a-4c9f-a54a-4969595eabfc None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:49.270375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125be6f2-2c7a-4c9f-a54a-4969595eabfc None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:49.278119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f9499-873e-4950-a880-09efb8f1a2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:49.278740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f9499-873e-4950-a880-09efb8f1a2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.279019 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f9499-873e-4950-a880-09efb8f1a2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.279290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f9499-873e-4950-a880-09efb8f1a2f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.279975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f9499-873e-4950-a880-09efb8f1a2f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:17:49.280275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f9499-873e-4950-a880-09efb8f1a2f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:49.282017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f9499-873e-4950-a880-09efb8f1a2f6 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:49.296663 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4465/8892] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:17:49.302405 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4aa50-d27d-49f5-b96f-fa731bedaf18 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:49.315338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4aa50-d27d-49f5-b96f-fa731bedaf18 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:49.321202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94953fd9-74e1-45b7-82dc-4232c2c52417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:49.321847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94953fd9-74e1-45b7-82dc-4232c2c52417 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.322715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94953fd9-74e1-45b7-82dc-4232c2c52417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.322962 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94953fd9-74e1-45b7-82dc-4232c2c52417 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.323608 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94953fd9-74e1-45b7-82dc-4232c2c52417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:49.325544 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94953fd9-74e1-45b7-82dc-4232c2c52417 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:49.359039 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4428/8893] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:17:49 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:49.366178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f9499-873e-4950-a880-09efb8f1a2f6 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:49.378874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f9499-873e-4950-a880-09efb8f1a2f6 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:49.422097 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:49.451237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a503c4-393f-4a65-972c-c21689798951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:49.451892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a503c4-393f-4a65-972c-c21689798951 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.452205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a503c4-393f-4a65-972c-c21689798951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.452478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a503c4-393f-4a65-972c-c21689798951 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.453168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a503c4-393f-4a65-972c-c21689798951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:49.455205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a503c4-393f-4a65-972c-c21689798951 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:49.480041 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4466/8894] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:17:49 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:17:49.486111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94953fd9-74e1-45b7-82dc-4232c2c52417 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:49.497196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94953fd9-74e1-45b7-82dc-4232c2c52417 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:49.502118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5556b-31be-4b3e-a11c-980df7bd46c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:49.502748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5556b-31be-4b3e-a11c-980df7bd46c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.503022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5556b-31be-4b3e-a11c-980df7bd46c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.503286 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5556b-31be-4b3e-a11c-980df7bd46c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.503965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5556b-31be-4b3e-a11c-980df7bd46c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:49.505566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5556b-31be-4b3e-a11c-980df7bd46c9 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:49.516901 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4429/8895] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:49.522168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a503c4-393f-4a65-972c-c21689798951 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:49.536355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a503c4-393f-4a65-972c-c21689798951 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:49.545728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd32c9-4356-4763-8e94-2ff9d6d7f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:49.546671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd32c9-4356-4763-8e94-2ff9d6d7f05d admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.547040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd32c9-4356-4763-8e94-2ff9d6d7f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.547372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd32c9-4356-4763-8e94-2ff9d6d7f05d admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.548317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd32c9-4356-4763-8e94-2ff9d6d7f05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:49.550306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd32c9-4356-4763-8e94-2ff9d6d7f05d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:49.566413 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4467/8896] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:17:49.572972 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5556b-31be-4b3e-a11c-980df7bd46c9 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:49.583795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5556b-31be-4b3e-a11c-980df7bd46c9 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:49.589889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3b33e-54f3-474c-98b0-8f321d3333f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:49.590562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b33e-54f3-474c-98b0-8f321d3333f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.590828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b33e-54f3-474c-98b0-8f321d3333f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.591126 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b33e-54f3-474c-98b0-8f321d3333f0 admin admin] PATH_INFO: `/v3/projects/c8d513488e4940e5b60968bd4460e9bb/users/b4bf2627334043f3a65eb8d75bee64ba/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.611008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3b33e-54f3-474c-98b0-8f321d3333f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d513488e4940e5b60968bd4460e9bb, user_id=b4bf2627334043f3a65eb8d75bee64ba, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:49.613762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3b33e-54f3-474c-98b0-8f321d3333f0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:49.631961 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4430/8897] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:17:49 2022] PUT /identity/v3/projects/c8d513488e4940e5b60968bd4460e9bb/users/b4bf2627334043f3a65eb8d75bee64ba/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:17:49.638276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7de5-82c6-481d-98dc-0ecd1b774217 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.638785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7de5-82c6-481d-98dc-0ecd1b774217 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.638785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7de5-82c6-481d-98dc-0ecd1b774217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.662118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-192d7de5-82c6-481d-98dc-0ecd1b774217 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:49.663357 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-192d7de5-82c6-481d-98dc-0ecd1b774217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:49.724578 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4468/8898] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:49.735241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3b33e-54f3-474c-98b0-8f321d3333f0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:49.737042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7cc3b33e-54f3-474c-98b0-8f321d3333f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:49.805772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3b33e-54f3-474c-98b0-8f321d3333f0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:49.809702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb929578-587e-4882-bb0a-f78db892b869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:49.810356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb929578-587e-4882-bb0a-f78db892b869 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:49.810628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb929578-587e-4882-bb0a-f78db892b869 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:49.810901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb929578-587e-4882-bb0a-f78db892b869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:49.820471 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb929578-587e-4882-bb0a-f78db892b869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:49.821954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb929578-587e-4882-bb0a-f78db892b869 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:49.831643 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4431/8899] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:54.062346 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e354c2-a3ae-4ec2-8e20-d043709a55d7 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:54.062822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e354c2-a3ae-4ec2-8e20-d043709a55d7 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:54.062915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e354c2-a3ae-4ec2-8e20-d043709a55d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:54.094281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-65e354c2-a3ae-4ec2-8e20-d043709a55d7 None None] MFA Rules not processed for user `b4bf2627334043f3a65eb8d75bee64ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:54.096160 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-65e354c2-a3ae-4ec2-8e20-d043709a55d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:54.171236 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4469/8900] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:17:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:54.185782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb929578-587e-4882-bb0a-f78db892b869 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:54.187706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fb929578-587e-4882-bb0a-f78db892b869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:54.280510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb929578-587e-4882-bb0a-f78db892b869 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:54.286100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2434e7-fb7b-4ea0-9296-479e8e78da28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:54.286725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2434e7-fb7b-4ea0-9296-479e8e78da28 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:54.287003 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2434e7-fb7b-4ea0-9296-479e8e78da28 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:54.287273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2434e7-fb7b-4ea0-9296-479e8e78da28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:54.296039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2434e7-fb7b-4ea0-9296-479e8e78da28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:54.297678 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2434e7-fb7b-4ea0-9296-479e8e78da28 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:54.307984 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4432/8901] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:17:55.692901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d339f2d-2bf0-4a13-86ba-701398b9a155 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:55.693411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d339f2d-2bf0-4a13-86ba-701398b9a155 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:55.693519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d339f2d-2bf0-4a13-86ba-701398b9a155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:55.714042 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9d339f2d-2bf0-4a13-86ba-701398b9a155 None None] MFA Rules not processed for user `b4bf2627334043f3a65eb8d75bee64ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:17:55.715249 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9d339f2d-2bf0-4a13-86ba-701398b9a155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:55.723145 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4470/8902] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:17:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:17:56.055429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2434e7-fb7b-4ea0-9296-479e8e78da28 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:17:56.065750 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2434e7-fb7b-4ea0-9296-479e8e78da28 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:17:56.070492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c1fc-8ccf-4f46-bbc2-cc25662da4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:17:56.071108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c1fc-8ccf-4f46-bbc2-cc25662da4bc service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:17:56.072096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c1fc-8ccf-4f46-bbc2-cc25662da4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:17:56.072096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861c1fc-8ccf-4f46-bbc2-cc25662da4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:17:56.074037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b861c1fc-8ccf-4f46-bbc2-cc25662da4bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:17:56.086974 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861c1fc-8ccf-4f46-bbc2-cc25662da4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:17:56.088700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861c1fc-8ccf-4f46-bbc2-cc25662da4bc service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:17:56.097241 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4433/8903] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:17:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:18:05.707964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:06.093650 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=96,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:09.558314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d339f2d-2bf0-4a13-86ba-701398b9a155 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:18:09.571724 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d339f2d-2bf0-4a13-86ba-701398b9a155 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:18:09.577402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b9054-9b75-4c2a-afa9-0b6ae36fef06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:18:09.578095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b9054-9b75-4c2a-afa9-0b6ae36fef06 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:18:09.578376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b9054-9b75-4c2a-afa9-0b6ae36fef06 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:18:09.578646 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b9054-9b75-4c2a-afa9-0b6ae36fef06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:18:09.580398 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-af6b9054-9b75-4c2a-afa9-0b6ae36fef06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:18:09.593333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b9054-9b75-4c2a-afa9-0b6ae36fef06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:18:09.594953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b9054-9b75-4c2a-afa9-0b6ae36fef06 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:18:09.605696 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4471/8904] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:18:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:18:19.601507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:29.978691 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c1fc-8ccf-4f46-bbc2-cc25662da4bc service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:19:30.004690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861c1fc-8ccf-4f46-bbc2-cc25662da4bc service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:19:30.011497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56564817-64d7-49be-88f3-2a54caaf747b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:19:30.012116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564817-64d7-49be-88f3-2a54caaf747b service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:30.012393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564817-64d7-49be-88f3-2a54caaf747b service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:30.012700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56564817-64d7-49be-88f3-2a54caaf747b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:30.014664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-56564817-64d7-49be-88f3-2a54caaf747b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:30.028892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56564817-64d7-49be-88f3-2a54caaf747b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:19:30.030560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56564817-64d7-49be-88f3-2a54caaf747b service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:19:30.042625 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4434/8905] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:19:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:19:40.037698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:40.155382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01f511-2913-45d1-8b52-b5e604835cc9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:19:40.155963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01f511-2913-45d1-8b52-b5e604835cc9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:19:40.155963 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01f511-2913-45d1-8b52-b5e604835cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:19:40.177028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-9d01f511-2913-45d1-8b52-b5e604835cc9 None None] MFA Rules not processed for user `b4bf2627334043f3a65eb8d75bee64ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:19:40.178246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9d01f511-2913-45d1-8b52-b5e604835cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:19:40.186000 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4472/8906] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:19:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:19:50.172235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:17.825253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56564817-64d7-49be-88f3-2a54caaf747b service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:17.827395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-56564817-64d7-49be-88f3-2a54caaf747b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:17.914919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56564817-64d7-49be-88f3-2a54caaf747b service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:17.920748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a976c-9650-4b66-b807-d5ca7bcc8406 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:17.921358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a976c-9650-4b66-b807-d5ca7bcc8406 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:17.921632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a976c-9650-4b66-b807-d5ca7bcc8406 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:17.921920 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a976c-9650-4b66-b807-d5ca7bcc8406 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:17.923904 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-036a976c-9650-4b66-b807-d5ca7bcc8406 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:17.936870 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a976c-9650-4b66-b807-d5ca7bcc8406 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:17.938501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a976c-9650-4b66-b807-d5ca7bcc8406 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:17.948514 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4435/8907] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:20:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:20:27.944470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=36 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:33.561022 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01f511-2913-45d1-8b52-b5e604835cc9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:33.579956 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01f511-2913-45d1-8b52-b5e604835cc9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:33.587576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee93ee-9fdf-48ff-955e-04b66df7db7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:33.588188 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee93ee-9fdf-48ff-955e-04b66df7db7b service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:33.588469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee93ee-9fdf-48ff-955e-04b66df7db7b service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:33.588741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee93ee-9fdf-48ff-955e-04b66df7db7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:33.590603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-67ee93ee-9fdf-48ff-955e-04b66df7db7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:33.602838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee93ee-9fdf-48ff-955e-04b66df7db7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:33.604360 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee93ee-9fdf-48ff-955e-04b66df7db7b service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:33.614563 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4473/8908] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:20:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:20:41.343712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a976c-9650-4b66-b807-d5ca7bcc8406 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:41.363943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a976c-9650-4b66-b807-d5ca7bcc8406 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:41.367978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc67eb7-0ae6-4927-ab21-d00646f48901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:41.368747 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67eb7-0ae6-4927-ab21-d00646f48901 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:41.369027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67eb7-0ae6-4927-ab21-d00646f48901 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:41.369295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67eb7-0ae6-4927-ab21-d00646f48901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:41.371140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fc67eb7-0ae6-4927-ab21-d00646f48901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:41.381267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc67eb7-0ae6-4927-ab21-d00646f48901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:41.382827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc67eb7-0ae6-4927-ab21-d00646f48901 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:41.391332 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4436/8909] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:20:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:20:41.490363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee93ee-9fdf-48ff-955e-04b66df7db7b service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:41.492055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-67ee93ee-9fdf-48ff-955e-04b66df7db7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:41.505925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee93ee-9fdf-48ff-955e-04b66df7db7b service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:41.512007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683a20-70fd-4a6b-9e4d-d9fa28c6df3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:41.512615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683a20-70fd-4a6b-9e4d-d9fa28c6df3f service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:41.512889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683a20-70fd-4a6b-9e4d-d9fa28c6df3f service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:41.513155 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29683a20-70fd-4a6b-9e4d-d9fa28c6df3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:41.515209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-29683a20-70fd-4a6b-9e4d-d9fa28c6df3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:41.526731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683a20-70fd-4a6b-9e4d-d9fa28c6df3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:41.528293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29683a20-70fd-4a6b-9e4d-d9fa28c6df3f service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:41.537856 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4474/8910] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:20:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:20:41.712434 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc67eb7-0ae6-4927-ab21-d00646f48901 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:41.727915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc67eb7-0ae6-4927-ab21-d00646f48901 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:41.735121 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c09e1-b983-43c4-b24b-5ea210a2f2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:41.736035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c09e1-b983-43c4-b24b-5ea210a2f2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:41.736469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c09e1-b983-43c4-b24b-5ea210a2f2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:41.736808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c09e1-b983-43c4-b24b-5ea210a2f2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:41.739889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b19c09e1-b983-43c4-b24b-5ea210a2f2d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:41.754310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c09e1-b983-43c4-b24b-5ea210a2f2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:41.756211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19c09e1-b983-43c4-b24b-5ea210a2f2d8 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:41.767696 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4437/8911] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:20:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:20:41.832530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683a20-70fd-4a6b-9e4d-d9fa28c6df3f service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:41.843603 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29683a20-70fd-4a6b-9e4d-d9fa28c6df3f service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:41.849093 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332460-fa3b-4627-a394-f3aa46ae09ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:41.849753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332460-fa3b-4627-a394-f3aa46ae09ae service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:41.850069 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332460-fa3b-4627-a394-f3aa46ae09ae service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:41.850340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332460-fa3b-4627-a394-f3aa46ae09ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:41.852216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ed332460-fa3b-4627-a394-f3aa46ae09ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:41.863794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed332460-fa3b-4627-a394-f3aa46ae09ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:41.865375 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed332460-fa3b-4627-a394-f3aa46ae09ae service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:41.875177 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4475/8912] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:20:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:20:51.762401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=16 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:51.871340 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=18 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:58.309051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2e2e-bdce-434b-98a8-dfce683775e7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:58.309630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2e2e-bdce-434b-98a8-dfce683775e7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:58.309630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba2e2e-bdce-434b-98a8-dfce683775e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:58.329322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-93ba2e2e-bdce-434b-98a8-dfce683775e7 None None] MFA Rules not processed for user `b4bf2627334043f3a65eb8d75bee64ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:20:58.330604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-93ba2e2e-bdce-434b-98a8-dfce683775e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:58.338497 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4438/8913] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:20:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:20:58.659209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332460-fa3b-4627-a394-f3aa46ae09ae service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:58.668968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332460-fa3b-4627-a394-f3aa46ae09ae service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:58.672632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793bdcc-549d-4948-b604-7fe99588f958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:58.673236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793bdcc-549d-4948-b604-7fe99588f958 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:58.673493 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793bdcc-549d-4948-b604-7fe99588f958 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:58.673759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793bdcc-549d-4948-b604-7fe99588f958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:58.675492 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7793bdcc-549d-4948-b604-7fe99588f958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:58.686612 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793bdcc-549d-4948-b604-7fe99588f958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:58.688202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793bdcc-549d-4948-b604-7fe99588f958 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:58.697511 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4476/8914] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:20:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:20:59.049757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba2e2e-bdce-434b-98a8-dfce683775e7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:20:59.062315 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba2e2e-bdce-434b-98a8-dfce683775e7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:20:59.067681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9fc4f-672d-400a-aee4-c62d05364310 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:20:59.068300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9fc4f-672d-400a-aee4-c62d05364310 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:20:59.068549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9fc4f-672d-400a-aee4-c62d05364310 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:20:59.068851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9fc4f-672d-400a-aee4-c62d05364310 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:20:59.071005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fb9fc4f-672d-400a-aee4-c62d05364310 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:20:59.084669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9fc4f-672d-400a-aee4-c62d05364310 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:20:59.086298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9fc4f-672d-400a-aee4-c62d05364310 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:20:59.097050 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4439/8915] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:20:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:21:08.693109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:09.092333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=9 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:18.288701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08413ad0-9112-475c-adf5-9359849029f2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:22:18.289207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08413ad0-9112-475c-adf5-9359849029f2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:22:18.289376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08413ad0-9112-475c-adf5-9359849029f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:22:18.309903 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-08413ad0-9112-475c-adf5-9359849029f2 None None] MFA Rules not processed for user `b4bf2627334043f3a65eb8d75bee64ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:22:18.311438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-08413ad0-9112-475c-adf5-9359849029f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:22:18.319444 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4477/8916] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:22:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:22:22.428960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9fc4f-672d-400a-aee4-c62d05364310 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:22:22.450253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9fc4f-672d-400a-aee4-c62d05364310 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:22:22.454112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e181c9f-711a-48ba-8324-43795f4ed730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:22:22.454741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e181c9f-711a-48ba-8324-43795f4ed730 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:22:22.455019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e181c9f-711a-48ba-8324-43795f4ed730 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:22:22.455289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e181c9f-711a-48ba-8324-43795f4ed730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:22:22.457161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4e181c9f-711a-48ba-8324-43795f4ed730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:22:22.519937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e181c9f-711a-48ba-8324-43795f4ed730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:22:22.521531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e181c9f-711a-48ba-8324-43795f4ed730 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:22:22.533058 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4440/8917] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:22:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:22:23.725751 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08413ad0-9112-475c-adf5-9359849029f2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:22:23.738983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08413ad0-9112-475c-adf5-9359849029f2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:22:23.742835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504126d5-28ce-40c2-9170-ddb72f9e4d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:22:23.743436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504126d5-28ce-40c2-9170-ddb72f9e4d2b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:22:23.743706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504126d5-28ce-40c2-9170-ddb72f9e4d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:22:23.743977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504126d5-28ce-40c2-9170-ddb72f9e4d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:22:23.745714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-504126d5-28ce-40c2-9170-ddb72f9e4d2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:22:23.758882 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504126d5-28ce-40c2-9170-ddb72f9e4d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:22:23.760309 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504126d5-28ce-40c2-9170-ddb72f9e4d2b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:22:23.770994 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4478/8918] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:22:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:22:32.528478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=28 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:33.766632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=11 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:23:30.431648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e181c9f-711a-48ba-8324-43795f4ed730 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:23:30.433577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4e181c9f-711a-48ba-8324-43795f4ed730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:23:30.445017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e181c9f-711a-48ba-8324-43795f4ed730 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:23:30.449919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481e9a2-907e-4562-8340-085ef7d311c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:23:30.450532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e9a2-907e-4562-8340-085ef7d311c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:23:30.450799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e9a2-907e-4562-8340-085ef7d311c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:23:30.451091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481e9a2-907e-4562-8340-085ef7d311c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:23:30.453117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f481e9a2-907e-4562-8340-085ef7d311c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:23:30.463158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481e9a2-907e-4562-8340-085ef7d311c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:23:30.464803 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481e9a2-907e-4562-8340-085ef7d311c0 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:23:30.472702 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4441/8919] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:23:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:23:40.469445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:23:41.766329 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd3f06-b64e-4068-ab62-4d0a24139d03 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:23:41.766798 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd3f06-b64e-4068-ab62-4d0a24139d03 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:23:41.766914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd3f06-b64e-4068-ab62-4d0a24139d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:23:41.845621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-4ffd3f06-b64e-4068-ab62-4d0a24139d03 None None] MFA Rules not processed for user `38a84e3c6a2d4c0ab3a00851e555330a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:23:41.846895 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ffd3f06-b64e-4068-ab62-4d0a24139d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:23:41.920620 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4479/8920] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Aug 30 05:23:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:23:41.926795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481e9a2-907e-4562-8340-085ef7d311c0 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:23:41.937392 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481e9a2-907e-4562-8340-085ef7d311c0 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:23:41.942177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf13e4a-1fef-4041-9c92-fe9d107953c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:23:41.942808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf13e4a-1fef-4041-9c92-fe9d107953c7 service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:23:41.943083 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf13e4a-1fef-4041-9c92-fe9d107953c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:23:41.943351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf13e4a-1fef-4041-9c92-fe9d107953c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:23:41.955240 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf13e4a-1fef-4041-9c92-fe9d107953c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:23:41.957053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf13e4a-1fef-4041-9c92-fe9d107953c7 service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:23:41.968581 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4442/8921] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:23:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:23:51.918217 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=46 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:23:51.962767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:22.559949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd3f06-b64e-4068-ab62-4d0a24139d03 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:24:22.570274 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd3f06-b64e-4068-ab62-4d0a24139d03 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:24:22.574462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5204cd5-9c15-45f1-8153-c463bbd239c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:24:22.575168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5204cd5-9c15-45f1-8153-c463bbd239c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:24:22.575536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5204cd5-9c15-45f1-8153-c463bbd239c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:24:22.575921 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5204cd5-9c15-45f1-8153-c463bbd239c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:24:22.578041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b5204cd5-9c15-45f1-8153-c463bbd239c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:24:22.603992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5204cd5-9c15-45f1-8153-c463bbd239c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:24:22.605437 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5204cd5-9c15-45f1-8153-c463bbd239c3 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:24:22.614056 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4480/8922] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:24:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:24:32.610210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=11 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:39.064372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf13e4a-1fef-4041-9c92-fe9d107953c7 service cinder] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:24:39.089634 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf13e4a-1fef-4041-9c92-fe9d107953c7 service cinder] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:24:39.096584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6967bc8-566e-45cc-a622-9f29f55cea37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:24:39.097375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6967bc8-566e-45cc-a622-9f29f55cea37 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:24:39.097778 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6967bc8-566e-45cc-a622-9f29f55cea37 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:24:39.098179 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6967bc8-566e-45cc-a622-9f29f55cea37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:24:39.100107 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e6967bc8-566e-45cc-a622-9f29f55cea37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:24:39.129161 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6967bc8-566e-45cc-a622-9f29f55cea37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:24:39.130882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6967bc8-566e-45cc-a622-9f29f55cea37 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:24:39.143907 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4443/8923] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:24:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:24:44.212913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5204cd5-9c15-45f1-8153-c463bbd239c3 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:24:44.214659 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b5204cd5-9c15-45f1-8153-c463bbd239c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:24:44.232284 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5204cd5-9c15-45f1-8153-c463bbd239c3 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:24:44.238574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24482157-8cb2-435a-8d3c-62ff784585b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:24:44.239264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24482157-8cb2-435a-8d3c-62ff784585b8 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:24:44.239540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24482157-8cb2-435a-8d3c-62ff784585b8 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:24:44.239807 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24482157-8cb2-435a-8d3c-62ff784585b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:24:44.250001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24482157-8cb2-435a-8d3c-62ff784585b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:24:44.251674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24482157-8cb2-435a-8d3c-62ff784585b8 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:24:44.262999 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4481/8924] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:24:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:24:49.138711 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=14 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:54.258539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:13.037802 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6967bc8-566e-45cc-a622-9f29f55cea37 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:13.048349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6967bc8-566e-45cc-a622-9f29f55cea37 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:13.052419 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba8add-8c57-411b-92a7-9c0e147ae6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:13.053025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba8add-8c57-411b-92a7-9c0e147ae6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:13.053297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba8add-8c57-411b-92a7-9c0e147ae6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:13.053559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba8add-8c57-411b-92a7-9c0e147ae6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:13.063772 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba8add-8c57-411b-92a7-9c0e147ae6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:13.065216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba8add-8c57-411b-92a7-9c0e147ae6b3 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:13.086454 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4444/8925] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:25:16.298735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24482157-8cb2-435a-8d3c-62ff784585b8 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:16.310723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24482157-8cb2-435a-8d3c-62ff784585b8 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:16.316224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd41acd-1b8b-4f6f-8a86-1d605b553e1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:16.316943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd41acd-1b8b-4f6f-8a86-1d605b553e1f service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:16.317295 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd41acd-1b8b-4f6f-8a86-1d605b553e1f service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:16.317759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd41acd-1b8b-4f6f-8a86-1d605b553e1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:16.319770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8cd41acd-1b8b-4f6f-8a86-1d605b553e1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:16.350045 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd41acd-1b8b-4f6f-8a86-1d605b553e1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:16.351943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd41acd-1b8b-4f6f-8a86-1d605b553e1f service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:16.364407 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4482/8926] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:25:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:25:16.368794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba8add-8c57-411b-92a7-9c0e147ae6b3 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:16.381353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba8add-8c57-411b-92a7-9c0e147ae6b3 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:16.387828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:16.388579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:16.388950 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:16.389283 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] PATH_INFO: `/v3/users/b4bf2627334043f3a65eb8d75bee64ba` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:16.390607 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4bf2627334043f3a65eb8d75bee64ba)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:16.392742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:16.446897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4bf2627334043f3a65eb8d75bee64ba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:25:16.454243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4bf2627334043f3a65eb8d75bee64ba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:25:16.469417 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4bf2627334043f3a65eb8d75bee64ba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:25:16.478150 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4bf2627334043f3a65eb8d75bee64ba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:25:16.478752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-c712503a-799c-4a73-81a6-930cb7390600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4bf2627334043f3a65eb8d75bee64ba'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:25:16.484697 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4445/8927] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:25:16 2022] DELETE /identity/v3/users/b4bf2627334043f3a65eb8d75bee64ba => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:25:16.684528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd41acd-1b8b-4f6f-8a86-1d605b553e1f service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:16.695440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd41acd-1b8b-4f6f-8a86-1d605b553e1f service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:16.760213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:16.760889 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:16.761161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:16.761429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] PATH_INFO: `/v3/projects/c8d513488e4940e5b60968bd4460e9bb` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:16.762586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d513488e4940e5b60968bd4460e9bb)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:16.764519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:16.817691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d513488e4940e5b60968bd4460e9bb', 'request_id': 'req-a33972f0-2dd9-4519-bfaa-a5585c792321'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:25:16.824710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d513488e4940e5b60968bd4460e9bb', 'request_id': 'req-a33972f0-2dd9-4519-bfaa-a5585c792321'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:25:16.834273 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d513488e4940e5b60968bd4460e9bb', 'request_id': 'req-a33972f0-2dd9-4519-bfaa-a5585c792321'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:25:16.845310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] The token cache is being invalidate because project c8d513488e4940e5b60968bd4460e9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:25:16.845622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:25:16.846302 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-a33972f0-2dd9-4519-bfaa-a5585c792321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:25:16.847795 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4483/8928] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:25:16 2022] DELETE /identity/v3/projects/c8d513488e4940e5b60968bd4460e9bb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:25:16.853641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd548f-2c03-4dd3-8507-3cacd90a35c8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:16.854044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd548f-2c03-4dd3-8507-3cacd90a35c8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:16.854323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd548f-2c03-4dd3-8507-3cacd90a35c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:16.905474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-97bd548f-2c03-4dd3-8507-3cacd90a35c8 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:25:16.906648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-97bd548f-2c03-4dd3-8507-3cacd90a35c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:16.991937 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4446/8929] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:25:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:25:17.057961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beccfb-a61d-4158-811e-5efe7269887e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:17.058254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beccfb-a61d-4158-811e-5efe7269887e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:17.058490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61beccfb-a61d-4158-811e-5efe7269887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:17.079372 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-61beccfb-a61d-4158-811e-5efe7269887e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:25:17.080960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-61beccfb-a61d-4158-811e-5efe7269887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:17.091556 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4484/8930] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:25:17.096767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd548f-2c03-4dd3-8507-3cacd90a35c8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:17.108923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd548f-2c03-4dd3-8507-3cacd90a35c8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:17.114241 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ea5fa-1d08-496b-a581-a92a48c8b262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:17.114850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ea5fa-1d08-496b-a581-a92a48c8b262 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:17.115127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ea5fa-1d08-496b-a581-a92a48c8b262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:17.115403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ea5fa-1d08-496b-a581-a92a48c8b262 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:17.116058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ea5fa-1d08-496b-a581-a92a48c8b262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:25:17.116352 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ea5fa-1d08-496b-a581-a92a48c8b262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:17.118146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ea5fa-1d08-496b-a581-a92a48c8b262 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:17.131040 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4447/8931] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:25:17.135596 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beccfb-a61d-4158-811e-5efe7269887e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:17.146096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61beccfb-a61d-4158-811e-5efe7269887e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:17.152040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708a853-d42f-4db4-bcf3-b9cd7d4a3971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:17.152670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708a853-d42f-4db4-bcf3-b9cd7d4a3971 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:17.152943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708a853-d42f-4db4-bcf3-b9cd7d4a3971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:17.153193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708a853-d42f-4db4-bcf3-b9cd7d4a3971 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:17.153888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708a853-d42f-4db4-bcf3-b9cd7d4a3971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:17.155899 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708a853-d42f-4db4-bcf3-b9cd7d4a3971 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:17.197952 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4485/8932] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:25:17 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:25:17.200184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ea5fa-1d08-496b-a581-a92a48c8b262 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:17.211182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ea5fa-1d08-496b-a581-a92a48c8b262 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:17.223099 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:17.273610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4516a00-41ae-4533-ac1d-905c6028b2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:17.274330 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4516a00-41ae-4533-ac1d-905c6028b2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:17.274668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4516a00-41ae-4533-ac1d-905c6028b2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:17.275046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4516a00-41ae-4533-ac1d-905c6028b2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:17.275700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4516a00-41ae-4533-ac1d-905c6028b2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:17.277646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4516a00-41ae-4533-ac1d-905c6028b2d2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:17.305660 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4448/8933] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:25:17 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:25:17.310212 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708a853-d42f-4db4-bcf3-b9cd7d4a3971 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:17.322513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708a853-d42f-4db4-bcf3-b9cd7d4a3971 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:17.327516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976e7e5-3209-4e89-8975-c8ef6e3181fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:17.328127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976e7e5-3209-4e89-8975-c8ef6e3181fc admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:17.328402 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976e7e5-3209-4e89-8975-c8ef6e3181fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:17.328669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976e7e5-3209-4e89-8975-c8ef6e3181fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:17.329310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976e7e5-3209-4e89-8975-c8ef6e3181fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:17.331426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976e7e5-3209-4e89-8975-c8ef6e3181fc admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:17.342247 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4486/8934] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:25:17.346338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4516a00-41ae-4533-ac1d-905c6028b2d2 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:17.356548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4516a00-41ae-4533-ac1d-905c6028b2d2 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:17.362307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883e322-9086-43d7-831e-7b5e90045e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:17.362906 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883e322-9086-43d7-831e-7b5e90045e13 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:17.363183 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883e322-9086-43d7-831e-7b5e90045e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:17.363437 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883e322-9086-43d7-831e-7b5e90045e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:17.364074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883e322-9086-43d7-831e-7b5e90045e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:17.365693 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883e322-9086-43d7-831e-7b5e90045e13 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:17.376763 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4449/8935] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:25:17.381068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976e7e5-3209-4e89-8975-c8ef6e3181fc admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:17.391538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976e7e5-3209-4e89-8975-c8ef6e3181fc admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:17.396134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3187d7-624d-43de-aa9c-c086f01591e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:17.396781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3187d7-624d-43de-aa9c-c086f01591e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:17.397053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3187d7-624d-43de-aa9c-c086f01591e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:17.397322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3187d7-624d-43de-aa9c-c086f01591e8 admin admin] PATH_INFO: `/v3/projects/e711c037ea9345869166841555941a14/users/bb6f9ba02ec2424b83d4175229095b30/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:17.415969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3187d7-624d-43de-aa9c-c086f01591e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e711c037ea9345869166841555941a14, user_id=bb6f9ba02ec2424b83d4175229095b30, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:17.418589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3187d7-624d-43de-aa9c-c086f01591e8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:17.420814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:17.435367 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4487/8936] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:25:17 2022] PUT /identity/v3/projects/e711c037ea9345869166841555941a14/users/bb6f9ba02ec2424b83d4175229095b30/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:25:17.440805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80c1f0-a1f4-41af-aad6-fd3e5d0fafde None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:17.441094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80c1f0-a1f4-41af-aad6-fd3e5d0fafde None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:17.441365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80c1f0-a1f4-41af-aad6-fd3e5d0fafde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:17.463189 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5b80c1f0-a1f4-41af-aad6-fd3e5d0fafde None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:25:17.464420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5b80c1f0-a1f4-41af-aad6-fd3e5d0fafde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:17.534080 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4450/8937] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:25:17.547720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3187d7-624d-43de-aa9c-c086f01591e8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:17.549824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-df3187d7-624d-43de-aa9c-c086f01591e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:17.615642 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3187d7-624d-43de-aa9c-c086f01591e8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:17.620948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c69680-7758-4455-a5d7-477b5af7ba83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:17.621564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c69680-7758-4455-a5d7-477b5af7ba83 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:17.621839 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c69680-7758-4455-a5d7-477b5af7ba83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:17.622142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c69680-7758-4455-a5d7-477b5af7ba83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:17.633239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c69680-7758-4455-a5d7-477b5af7ba83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:17.634769 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c69680-7758-4455-a5d7-477b5af7ba83 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:17.645508 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4488/8938] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:25:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:25:21.883346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80c1f0-a1f4-41af-aad6-fd3e5d0fafde None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:21.884924 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5b80c1f0-a1f4-41af-aad6-fd3e5d0fafde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:22.008424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80c1f0-a1f4-41af-aad6-fd3e5d0fafde None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:22.034136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed23b-d29b-473b-9c13-c67b0026373c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:22.034957 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed23b-d29b-473b-9c13-c67b0026373c service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:22.035243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed23b-d29b-473b-9c13-c67b0026373c service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:22.035601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed23b-d29b-473b-9c13-c67b0026373c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:22.042118 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-21aed23b-d29b-473b-9c13-c67b0026373c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:22.066319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed23b-d29b-473b-9c13-c67b0026373c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:22.068057 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed23b-d29b-473b-9c13-c67b0026373c service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:22.124908 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4451/8939] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:25:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:25:22.366952 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c68e-ddbd-4c26-b13b-5c9f054210fe None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:22.367892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c68e-ddbd-4c26-b13b-5c9f054210fe None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:22.367892 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88c68e-ddbd-4c26-b13b-5c9f054210fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:22.399694 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5a88c68e-ddbd-4c26-b13b-5c9f054210fe None None] MFA Rules not processed for user `bb6f9ba02ec2424b83d4175229095b30`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:25:22.402588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5a88c68e-ddbd-4c26-b13b-5c9f054210fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:22.487125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4489/8940] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:25:22.498203 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a4041-d6b8-454c-a6db-9eb6a1590358 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:22.498489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a4041-d6b8-454c-a6db-9eb6a1590358 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:22.498760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a4041-d6b8-454c-a6db-9eb6a1590358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:22.519458 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d25a4041-d6b8-454c-a6db-9eb6a1590358 None None] MFA Rules not processed for user `bb6f9ba02ec2424b83d4175229095b30`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:25:22.520843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d25a4041-d6b8-454c-a6db-9eb6a1590358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:22.531914 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4452/8941] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:25:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:25:22.547153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88c68e-ddbd-4c26-b13b-5c9f054210fe None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:22.549275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5a88c68e-ddbd-4c26-b13b-5c9f054210fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:22.647539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88c68e-ddbd-4c26-b13b-5c9f054210fe None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:22.653605 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4f3dc-56c9-4656-8259-7c817d093234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:22.654304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f3dc-56c9-4656-8259-7c817d093234 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:22.654582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f3dc-56c9-4656-8259-7c817d093234 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:22.654854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4f3dc-56c9-4656-8259-7c817d093234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:22.664235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4f3dc-56c9-4656-8259-7c817d093234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:22.665985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b4f3dc-56c9-4656-8259-7c817d093234 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:22.676589 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4490/8942] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:25:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:25:22.969569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a4041-d6b8-454c-a6db-9eb6a1590358 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:22.971497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d25a4041-d6b8-454c-a6db-9eb6a1590358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:22.984809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a4041-d6b8-454c-a6db-9eb6a1590358 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:22.988991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702ec6-0a29-4008-96df-47ba6c2fe3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:22.989917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702ec6-0a29-4008-96df-47ba6c2fe3bc service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:22.990269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702ec6-0a29-4008-96df-47ba6c2fe3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:22.990616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702ec6-0a29-4008-96df-47ba6c2fe3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:22.992673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0c702ec6-0a29-4008-96df-47ba6c2fe3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:23.004559 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702ec6-0a29-4008-96df-47ba6c2fe3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:23.006073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702ec6-0a29-4008-96df-47ba6c2fe3bc service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:23.014724 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4453/8943] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:25:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:25:32.671572 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:INSERT=1,keystone:SELECT=94 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:33.011277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:35.362460 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464daa9e-d209-4d1c-9eba-21f894ed3560 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:35.362979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464daa9e-d209-4d1c-9eba-21f894ed3560 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:35.362979 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464daa9e-d209-4d1c-9eba-21f894ed3560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:35.385541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-464daa9e-d209-4d1c-9eba-21f894ed3560 None None] MFA Rules not processed for user `bb6f9ba02ec2424b83d4175229095b30`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:25:35.386817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-464daa9e-d209-4d1c-9eba-21f894ed3560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:35.395123 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4491/8944] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:25:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:25:36.546497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702ec6-0a29-4008-96df-47ba6c2fe3bc service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:36.548162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0c702ec6-0a29-4008-96df-47ba6c2fe3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:36.564063 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702ec6-0a29-4008-96df-47ba6c2fe3bc service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:36.569171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601494c-0fa5-4204-a85b-4ceda21052e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:36.569776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601494c-0fa5-4204-a85b-4ceda21052e8 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:36.570073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601494c-0fa5-4204-a85b-4ceda21052e8 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:36.570333 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601494c-0fa5-4204-a85b-4ceda21052e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:36.572081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d601494c-0fa5-4204-a85b-4ceda21052e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:36.584302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601494c-0fa5-4204-a85b-4ceda21052e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:36.585940 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601494c-0fa5-4204-a85b-4ceda21052e8 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:36.596284 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4454/8945] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:25:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:25:38.579610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464daa9e-d209-4d1c-9eba-21f894ed3560 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:38.599198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464daa9e-d209-4d1c-9eba-21f894ed3560 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:38.605907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d91a38-f341-4cfc-a8a6-544e01416028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:38.607061 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d91a38-f341-4cfc-a8a6-544e01416028 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:38.607430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d91a38-f341-4cfc-a8a6-544e01416028 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:38.607810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d91a38-f341-4cfc-a8a6-544e01416028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:38.609808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-60d91a38-f341-4cfc-a8a6-544e01416028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:25:38.629480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d91a38-f341-4cfc-a8a6-544e01416028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:38.631374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d91a38-f341-4cfc-a8a6-544e01416028 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:25:38.646252 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4492/8946] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:25:46.591806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:48.640052 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=9 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:59.972905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601494c-0fa5-4204-a85b-4ceda21052e8 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:25:59.986014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601494c-0fa5-4204-a85b-4ceda21052e8 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:25:59.992128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:25:59.992814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:25:59.993084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:25:59.993349 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] PATH_INFO: `/v3/users/bb6f9ba02ec2424b83d4175229095b30` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:25:59.994533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6f9ba02ec2424b83d4175229095b30)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:25:59.996819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:00.056964 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6f9ba02ec2424b83d4175229095b30'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:00.065322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6f9ba02ec2424b83d4175229095b30'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:00.078132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6f9ba02ec2424b83d4175229095b30'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:00.087030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6f9ba02ec2424b83d4175229095b30'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:00.087855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-f34b6332-b3b6-4d5d-99cc-7ab19b4f4fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6f9ba02ec2424b83d4175229095b30'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:00.093998 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4455/8947] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:25:59 2022] DELETE /identity/v3/users/bb6f9ba02ec2424b83d4175229095b30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:00.285136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d91a38-f341-4cfc-a8a6-544e01416028 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:00.301732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d91a38-f341-4cfc-a8a6-544e01416028 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:00.362352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:00.362993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:00.363267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:00.363541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] PATH_INFO: `/v3/projects/e711c037ea9345869166841555941a14` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:00.364706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e711c037ea9345869166841555941a14)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:00.366652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:00.416380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e711c037ea9345869166841555941a14', 'request_id': 'req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:00.422509 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e711c037ea9345869166841555941a14', 'request_id': 'req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:00.431489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e711c037ea9345869166841555941a14', 'request_id': 'req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:00.442524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] The token cache is being invalidate because project e711c037ea9345869166841555941a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:26:00.442813 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:00.443429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-f4b24a53-9f7a-44d5-a4b8-96d69e7b951b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:00.444967 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4493/8948] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:26:00 2022] DELETE /identity/v3/projects/e711c037ea9345869166841555941a14 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:00.450177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0342-2ba3-417f-bd89-65168b805edb None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:00.450468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0342-2ba3-417f-bd89-65168b805edb None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:00.450768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b0342-2ba3-417f-bd89-65168b805edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:00.471329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-341b0342-2ba3-417f-bd89-65168b805edb None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:00.472548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-341b0342-2ba3-417f-bd89-65168b805edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:00.535520 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4456/8949] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:00.543922 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d8dd-e0ff-4b7c-b42d-aee5e397c4c9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:00.544201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d8dd-e0ff-4b7c-b42d-aee5e397c4c9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:00.544469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906d8dd-e0ff-4b7c-b42d-aee5e397c4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:00.569569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-0906d8dd-e0ff-4b7c-b42d-aee5e397c4c9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:00.571626 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0906d8dd-e0ff-4b7c-b42d-aee5e397c4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:00.585585 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4494/8950] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:00.590250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b0342-2ba3-417f-bd89-65168b805edb None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:00.600886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b0342-2ba3-417f-bd89-65168b805edb None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:00.606638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b04c9a-703c-433d-a5ca-c2cacf837240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:00.607278 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b04c9a-703c-433d-a5ca-c2cacf837240 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:00.607551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b04c9a-703c-433d-a5ca-c2cacf837240 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:00.607855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b04c9a-703c-433d-a5ca-c2cacf837240 admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:00.608494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b04c9a-703c-433d-a5ca-c2cacf837240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:26:00.608789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b04c9a-703c-433d-a5ca-c2cacf837240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:00.610604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b04c9a-703c-433d-a5ca-c2cacf837240 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:00.623149 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4457/8951] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:26:00.627879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906d8dd-e0ff-4b7c-b42d-aee5e397c4c9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:00.638077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906d8dd-e0ff-4b7c-b42d-aee5e397c4c9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:00.644627 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7152181-bbd4-428e-a08d-82541d4d716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:00.645269 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7152181-bbd4-428e-a08d-82541d4d716d admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:00.645568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7152181-bbd4-428e-a08d-82541d4d716d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:00.645834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7152181-bbd4-428e-a08d-82541d4d716d admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:00.646561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7152181-bbd4-428e-a08d-82541d4d716d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:00.648524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7152181-bbd4-428e-a08d-82541d4d716d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:00.681934 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4495/8952] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:26:00 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:26:00.687401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b04c9a-703c-433d-a5ca-c2cacf837240 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:00.697979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b04c9a-703c-433d-a5ca-c2cacf837240 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:00.761861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7110f-57c7-4ada-8147-046cff2b4e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:00.762513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7110f-57c7-4ada-8147-046cff2b4e50 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:00.762795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7110f-57c7-4ada-8147-046cff2b4e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:00.763066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f7110f-57c7-4ada-8147-046cff2b4e50 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:00.763716 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7110f-57c7-4ada-8147-046cff2b4e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:00.766084 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f7110f-57c7-4ada-8147-046cff2b4e50 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:00.774291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:00.790564 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4458/8953] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:26:00 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:26:00.794974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7152181-bbd4-428e-a08d-82541d4d716d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:00.806142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7152181-bbd4-428e-a08d-82541d4d716d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:00.811201 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b80299-a04f-4999-babe-4bfd837a2d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:00.811930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80299-a04f-4999-babe-4bfd837a2d99 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:00.812216 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80299-a04f-4999-babe-4bfd837a2d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:00.812479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b80299-a04f-4999-babe-4bfd837a2d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:00.813137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b80299-a04f-4999-babe-4bfd837a2d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:00.814854 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b80299-a04f-4999-babe-4bfd837a2d99 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:00.825451 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4496/8954] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:26:00.830237 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7110f-57c7-4ada-8147-046cff2b4e50 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:00.841833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f7110f-57c7-4ada-8147-046cff2b4e50 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:00.847806 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73228795-d123-4871-b1aa-feb9d69b7a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:00.848415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73228795-d123-4871-b1aa-feb9d69b7a89 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:00.848717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73228795-d123-4871-b1aa-feb9d69b7a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:00.848966 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73228795-d123-4871-b1aa-feb9d69b7a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:00.849610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73228795-d123-4871-b1aa-feb9d69b7a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:00.851282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73228795-d123-4871-b1aa-feb9d69b7a89 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:00.862555 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4459/8955] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:26:00.867223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b80299-a04f-4999-babe-4bfd837a2d99 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:00.878362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b80299-a04f-4999-babe-4bfd837a2d99 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:00.883812 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f5631-1ff7-4031-9db9-0699a02f529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:00.884465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f5631-1ff7-4031-9db9-0699a02f529e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:00.884738 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f5631-1ff7-4031-9db9-0699a02f529e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:00.885002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f5631-1ff7-4031-9db9-0699a02f529e admin admin] PATH_INFO: `/v3/projects/7b7a75b1fce74daf8cdb8370d6eebdd0/users/b4b5a2b9dbf441359e5bb918b116856c/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:00.901567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f5631-1ff7-4031-9db9-0699a02f529e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7a75b1fce74daf8cdb8370d6eebdd0, user_id=b4b5a2b9dbf441359e5bb918b116856c, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:00.904546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f5631-1ff7-4031-9db9-0699a02f529e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:00.920654 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4497/8956] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:26:00 2022] PUT /identity/v3/projects/7b7a75b1fce74daf8cdb8370d6eebdd0/users/b4b5a2b9dbf441359e5bb918b116856c/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:00.932502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a60274-dce7-425b-be00-0291e64f88f3 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:00.932725 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a60274-dce7-425b-be00-0291e64f88f3 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:00.932998 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a60274-dce7-425b-be00-0291e64f88f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:00.962757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-46a60274-dce7-425b-be00-0291e64f88f3 None None] MFA Rules not processed for user `b4b5a2b9dbf441359e5bb918b116856c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:00.963985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-46a60274-dce7-425b-be00-0291e64f88f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:01.039107 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4460/8957] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:01.049609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f5631-1ff7-4031-9db9-0699a02f529e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:01.051552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-8e5f5631-1ff7-4031-9db9-0699a02f529e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:01.084333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:01.113015 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f5631-1ff7-4031-9db9-0699a02f529e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:01.117031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772a6d-ca07-46d4-86e2-5e16366e40fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:01.117664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772a6d-ca07-46d4-86e2-5e16366e40fc service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:01.117943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772a6d-ca07-46d4-86e2-5e16366e40fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:01.118242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772a6d-ca07-46d4-86e2-5e16366e40fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:01.127130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94772a6d-ca07-46d4-86e2-5e16366e40fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:01.128570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94772a6d-ca07-46d4-86e2-5e16366e40fc service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:01.137554 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4498/8958] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:26:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:26:06.334299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a60274-dce7-425b-be00-0291e64f88f3 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:06.335755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-46a60274-dce7-425b-be00-0291e64f88f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:06.432497 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a60274-dce7-425b-be00-0291e64f88f3 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:06.439120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02914d-1515-43cd-bcc7-c6668dd34023 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:06.439993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02914d-1515-43cd-bcc7-c6668dd34023 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:06.440451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02914d-1515-43cd-bcc7-c6668dd34023 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:06.440722 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02914d-1515-43cd-bcc7-c6668dd34023 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:06.442526 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1e02914d-1515-43cd-bcc7-c6668dd34023 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:06.456156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02914d-1515-43cd-bcc7-c6668dd34023 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:06.457799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02914d-1515-43cd-bcc7-c6668dd34023 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:06.471376 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4461/8959] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:26:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:26:11.133397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=14 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:12.978555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772a6d-ca07-46d4-86e2-5e16366e40fc service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:13.060597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772a6d-ca07-46d4-86e2-5e16366e40fc service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:13.065472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:13.066145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:13.066429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:13.066700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] PATH_INFO: `/v3/users/b4b5a2b9dbf441359e5bb918b116856c` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:13.067818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4b5a2b9dbf441359e5bb918b116856c)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:13.069748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:13.120781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4b5a2b9dbf441359e5bb918b116856c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:13.121376 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4b5a2b9dbf441359e5bb918b116856c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:13.128490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4b5a2b9dbf441359e5bb918b116856c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:13.137259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4b5a2b9dbf441359e5bb918b116856c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:13.149766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4b5a2b9dbf441359e5bb918b116856c'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:13.156090 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4499/8960] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:26:12 2022] DELETE /identity/v3/users/b4b5a2b9dbf441359e5bb918b116856c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:13.160791 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ef45-3748-4e81-8fa7-2f0af6985af7 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:13.161301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ef45-3748-4e81-8fa7-2f0af6985af7 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:13.161398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ef45-3748-4e81-8fa7-2f0af6985af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:13.182548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9997ef45-3748-4e81-8fa7-2f0af6985af7 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:13.183837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9997ef45-3748-4e81-8fa7-2f0af6985af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:13.238900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:13.250068 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4462/8961] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:13.260086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:13.261968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:13.326652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ef7ff-d203-4562-ad63-4d64caef0680 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:13.334767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fd07d-024b-4660-bc17-33ba7d1357d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:13.335518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fd07d-024b-4660-bc17-33ba7d1357d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:13.335774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fd07d-024b-4660-bc17-33ba7d1357d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:13.336140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fd07d-024b-4660-bc17-33ba7d1357d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:13.349221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fd07d-024b-4660-bc17-33ba7d1357d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:13.350717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fd07d-024b-4660-bc17-33ba7d1357d0 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:13.361267 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4500/8962] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:26:13.540985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997ef45-3748-4e81-8fa7-2f0af6985af7 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:13.542569 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9997ef45-3748-4e81-8fa7-2f0af6985af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:13.557002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997ef45-3748-4e81-8fa7-2f0af6985af7 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:13.564550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:13.565125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:13.565520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:13.565653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] PATH_INFO: `/v3/projects/7b7a75b1fce74daf8cdb8370d6eebdd0` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:13.566943 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7a75b1fce74daf8cdb8370d6eebdd0)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:13.568892 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:13.621221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7a75b1fce74daf8cdb8370d6eebdd0', 'request_id': 'req-1e969113-61e8-4604-82a0-b7052ad0df7d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:13.630194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7a75b1fce74daf8cdb8370d6eebdd0', 'request_id': 'req-1e969113-61e8-4604-82a0-b7052ad0df7d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:13.636565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7a75b1fce74daf8cdb8370d6eebdd0', 'request_id': 'req-1e969113-61e8-4604-82a0-b7052ad0df7d'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:13.648022 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] The token cache is being invalidate because project 7b7a75b1fce74daf8cdb8370d6eebdd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:26:13.648306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:13.649002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-1e969113-61e8-4604-82a0-b7052ad0df7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:13.650579 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4463/8963] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:26:13 2022] DELETE /identity/v3/projects/7b7a75b1fce74daf8cdb8370d6eebdd0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:13.656013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c87e92-afaf-402c-8b7a-5299659c22c4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:13.656231 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c87e92-afaf-402c-8b7a-5299659c22c4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:13.656497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c87e92-afaf-402c-8b7a-5299659c22c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:13.676743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-82c87e92-afaf-402c-8b7a-5299659c22c4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:13.677981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-82c87e92-afaf-402c-8b7a-5299659c22c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:13.696836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:13.748646 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4501/8964] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:13.756690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dbff2-532a-421a-bc20-ec41bea4dac4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:13.756979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dbff2-532a-421a-bc20-ec41bea4dac4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:13.757258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dbff2-532a-421a-bc20-ec41bea4dac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:13.777771 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5e3dbff2-532a-421a-bc20-ec41bea4dac4 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:13.779020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5e3dbff2-532a-421a-bc20-ec41bea4dac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:13.787808 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4464/8965] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:13.792252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c87e92-afaf-402c-8b7a-5299659c22c4 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:13.803518 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c87e92-afaf-402c-8b7a-5299659c22c4 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:13.808767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e2b4e-b1d0-490f-89df-73be9f0c2e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:13.809373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e2b4e-b1d0-490f-89df-73be9f0c2e82 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:13.809650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e2b4e-b1d0-490f-89df-73be9f0c2e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:13.810075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e2b4e-b1d0-490f-89df-73be9f0c2e82 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:13.810720 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e2b4e-b1d0-490f-89df-73be9f0c2e82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:26:13.811018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e2b4e-b1d0-490f-89df-73be9f0c2e82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:13.812734 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e2b4e-b1d0-490f-89df-73be9f0c2e82 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:13.825306 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4502/8966] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:26:13.830306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dbff2-532a-421a-bc20-ec41bea4dac4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:13.840066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dbff2-532a-421a-bc20-ec41bea4dac4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:13.845784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f49c-9cc8-486b-948a-6a45758256e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:13.846429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f49c-9cc8-486b-948a-6a45758256e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:13.846707 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f49c-9cc8-486b-948a-6a45758256e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:13.846977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7f49c-9cc8-486b-948a-6a45758256e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:13.847638 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7f49c-9cc8-486b-948a-6a45758256e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:13.849565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7f49c-9cc8-486b-948a-6a45758256e0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:13.879488 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4465/8967] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:26:13 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:26:13.883576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e2b4e-b1d0-490f-89df-73be9f0c2e82 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:13.893867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e2b4e-b1d0-490f-89df-73be9f0c2e82 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:13.960304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd1a77-4065-4f6c-a2ef-e7b2d33e7b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:13.960821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd1a77-4065-4f6c-a2ef-e7b2d33e7b53 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:13.961098 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd1a77-4065-4f6c-a2ef-e7b2d33e7b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:13.961366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd1a77-4065-4f6c-a2ef-e7b2d33e7b53 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:13.962034 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd1a77-4065-4f6c-a2ef-e7b2d33e7b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:13.963994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd1a77-4065-4f6c-a2ef-e7b2d33e7b53 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:13.989351 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4503/8968] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:26:13 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:26:13.994218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f49c-9cc8-486b-948a-6a45758256e0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:14.005299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7f49c-9cc8-486b-948a-6a45758256e0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:14.009976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f943e1-0ada-4a71-9a36-a01ad21d2f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:14.010575 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f943e1-0ada-4a71-9a36-a01ad21d2f3b admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:14.010847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f943e1-0ada-4a71-9a36-a01ad21d2f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:14.011113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f943e1-0ada-4a71-9a36-a01ad21d2f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:14.011753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f943e1-0ada-4a71-9a36-a01ad21d2f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:14.013391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f943e1-0ada-4a71-9a36-a01ad21d2f3b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:14.024024 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4466/8969] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:26:14.028276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd1a77-4065-4f6c-a2ef-e7b2d33e7b53 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:14.039159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd1a77-4065-4f6c-a2ef-e7b2d33e7b53 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:14.044837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbdb77-8eea-43fe-a549-9a492e928d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:14.045483 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbdb77-8eea-43fe-a549-9a492e928d8a admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:14.045753 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbdb77-8eea-43fe-a549-9a492e928d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:14.046223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbdb77-8eea-43fe-a549-9a492e928d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:14.047330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbdb77-8eea-43fe-a549-9a492e928d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:14.048941 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbdb77-8eea-43fe-a549-9a492e928d8a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:14.060148 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4504/8970] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:26:14.064351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f943e1-0ada-4a71-9a36-a01ad21d2f3b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:14.075050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f943e1-0ada-4a71-9a36-a01ad21d2f3b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:14.081116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c45183-9488-4285-8cfe-66f7d19970e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:14.081777 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c45183-9488-4285-8cfe-66f7d19970e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:14.082088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c45183-9488-4285-8cfe-66f7d19970e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:14.082366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c45183-9488-4285-8cfe-66f7d19970e8 admin admin] PATH_INFO: `/v3/projects/b4442057fc034eb6b508d465262bd68f/users/bbd9855bd48c4185a4d122898f4adeca/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:14.098135 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c45183-9488-4285-8cfe-66f7d19970e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4442057fc034eb6b508d465262bd68f, user_id=bbd9855bd48c4185a4d122898f4adeca, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:14.100845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c45183-9488-4285-8cfe-66f7d19970e8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:14.117162 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4467/8971] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:26:14 2022] PUT /identity/v3/projects/b4442057fc034eb6b508d465262bd68f/users/bbd9855bd48c4185a4d122898f4adeca/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:14.129821 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b996e-660a-4f73-82cd-2c61f36437ef None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:14.130136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b996e-660a-4f73-82cd-2c61f36437ef None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:14.130404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b996e-660a-4f73-82cd-2c61f36437ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:14.161609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7b1b996e-660a-4f73-82cd-2c61f36437ef None None] MFA Rules not processed for user `bbd9855bd48c4185a4d122898f4adeca`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:14.162885 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7b1b996e-660a-4f73-82cd-2c61f36437ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:14.234753 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4505/8972] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:14.244917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c45183-9488-4285-8cfe-66f7d19970e8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:14.246847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-85c45183-9488-4285-8cfe-66f7d19970e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:14.305629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c45183-9488-4285-8cfe-66f7d19970e8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:14.310288 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11293d9e-95cf-4399-9968-4747e66b12fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:14.310911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11293d9e-95cf-4399-9968-4747e66b12fc service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:14.311191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11293d9e-95cf-4399-9968-4747e66b12fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:14.311656 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11293d9e-95cf-4399-9968-4747e66b12fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:14.321046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11293d9e-95cf-4399-9968-4747e66b12fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:14.322560 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11293d9e-95cf-4399-9968-4747e66b12fc service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:14.332427 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4468/8973] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:26:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:26:18.865668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b996e-660a-4f73-82cd-2c61f36437ef None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:18.891196 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:18.938156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b996e-660a-4f73-82cd-2c61f36437ef None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:18.943129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:18.943764 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:18.944041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:18.944311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] PATH_INFO: `/v3/users/bbd9855bd48c4185a4d122898f4adeca` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:18.945500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd9855bd48c4185a4d122898f4adeca)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:18.947479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:18.997367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd9855bd48c4185a4d122898f4adeca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:18.998056 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd9855bd48c4185a4d122898f4adeca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:19.005074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd9855bd48c4185a4d122898f4adeca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:19.014407 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd9855bd48c4185a4d122898f4adeca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:19.026964 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd9855bd48c4185a4d122898f4adeca'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:19.033154 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4506/8974] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:26:18 2022] DELETE /identity/v3/users/bbd9855bd48c4185a4d122898f4adeca => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:19.037897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eadfed-5b8a-425e-84a8-bc7b5e3708be None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.038385 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eadfed-5b8a-425e-84a8-bc7b5e3708be None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.038498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eadfed-5b8a-425e-84a8-bc7b5e3708be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.058494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-10eadfed-5b8a-425e-84a8-bc7b5e3708be None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:19.059628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-10eadfed-5b8a-425e-84a8-bc7b5e3708be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:19.073660 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:19.126207 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4469/8975] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:26:19.136516 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:19.138031 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:19.211677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b14d40-ad73-4520-937d-4eed35ac6904 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:19.215702 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25775295-2cac-4d7a-9993-db3926611b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:19.216317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775295-2cac-4d7a-9993-db3926611b7d service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.216593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775295-2cac-4d7a-9993-db3926611b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.216856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25775295-2cac-4d7a-9993-db3926611b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.226874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25775295-2cac-4d7a-9993-db3926611b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:19.228252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25775295-2cac-4d7a-9993-db3926611b7d service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:19.238183 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4507/8976] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:26:19.426898 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eadfed-5b8a-425e-84a8-bc7b5e3708be None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:19.428346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-10eadfed-5b8a-425e-84a8-bc7b5e3708be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:19.440853 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eadfed-5b8a-425e-84a8-bc7b5e3708be None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:19.446476 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:19.447117 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.447558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.448033 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] PATH_INFO: `/v3/projects/b4442057fc034eb6b508d465262bd68f` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.449155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4442057fc034eb6b508d465262bd68f)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:19.451414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:19.504933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4442057fc034eb6b508d465262bd68f', 'request_id': 'req-3c6f9470-0bad-4042-94a7-da4bc1eced2e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:19.512454 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4442057fc034eb6b508d465262bd68f', 'request_id': 'req-3c6f9470-0bad-4042-94a7-da4bc1eced2e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:19.519411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4442057fc034eb6b508d465262bd68f', 'request_id': 'req-3c6f9470-0bad-4042-94a7-da4bc1eced2e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:19.529794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] The token cache is being invalidate because project b4442057fc034eb6b508d465262bd68f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:26:19.530146 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:19.530942 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-3c6f9470-0bad-4042-94a7-da4bc1eced2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:26:19.532437 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4470/8977] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:26:19 2022] DELETE /identity/v3/projects/b4442057fc034eb6b508d465262bd68f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:19.537635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356327d-d54a-493e-8d5c-1c2cf67dfb69 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.537948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356327d-d54a-493e-8d5c-1c2cf67dfb69 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.538267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356327d-d54a-493e-8d5c-1c2cf67dfb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.558709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2356327d-d54a-493e-8d5c-1c2cf67dfb69 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:19.559931 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2356327d-d54a-493e-8d5c-1c2cf67dfb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:19.594833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:19.626710 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4508/8978] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:19.635075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a8ef-309a-4562-9aea-2e37da1c85e5 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.635448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a8ef-309a-4562-9aea-2e37da1c85e5 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.635782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242a8ef-309a-4562-9aea-2e37da1c85e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.656755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f242a8ef-309a-4562-9aea-2e37da1c85e5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:19.658025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f242a8ef-309a-4562-9aea-2e37da1c85e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:19.666458 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4471/8979] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:19.670977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356327d-d54a-493e-8d5c-1c2cf67dfb69 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:19.681652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356327d-d54a-493e-8d5c-1c2cf67dfb69 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:19.687214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bcd4b-b398-4b08-8ea0-62d6378fd957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:19.687830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bcd4b-b398-4b08-8ea0-62d6378fd957 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.688104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bcd4b-b398-4b08-8ea0-62d6378fd957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.688373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bcd4b-b398-4b08-8ea0-62d6378fd957 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.689020 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bcd4b-b398-4b08-8ea0-62d6378fd957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:26:19.689317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bcd4b-b398-4b08-8ea0-62d6378fd957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:19.690953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bcd4b-b398-4b08-8ea0-62d6378fd957 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:19.703572 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4509/8980] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:26:19.708346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a8ef-309a-4562-9aea-2e37da1c85e5 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:19.718302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242a8ef-309a-4562-9aea-2e37da1c85e5 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:19.723466 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22094e9-2cb2-4a32-92dd-67e59a619b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:19.724073 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22094e9-2cb2-4a32-92dd-67e59a619b74 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.724348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22094e9-2cb2-4a32-92dd-67e59a619b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.724614 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22094e9-2cb2-4a32-92dd-67e59a619b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.725256 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22094e9-2cb2-4a32-92dd-67e59a619b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:19.727196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22094e9-2cb2-4a32-92dd-67e59a619b74 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:19.760106 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4472/8981] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:26:19 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:26:19.766322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bcd4b-b398-4b08-8ea0-62d6378fd957 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:19.777260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bcd4b-b398-4b08-8ea0-62d6378fd957 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:19.835998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467d836-ad4b-421b-8bff-812284459ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:19.836697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467d836-ad4b-421b-8bff-812284459ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.836999 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467d836-ad4b-421b-8bff-812284459ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.837238 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467d836-ad4b-421b-8bff-812284459ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.837983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467d836-ad4b-421b-8bff-812284459ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:19.839915 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467d836-ad4b-421b-8bff-812284459ed5 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:19.862461 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4510/8982] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:26:19 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:26:19.866868 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22094e9-2cb2-4a32-92dd-67e59a619b74 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:19.877843 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22094e9-2cb2-4a32-92dd-67e59a619b74 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:19.883886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab2432-1efc-4e05-b880-09f9287854d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:19.884483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab2432-1efc-4e05-b880-09f9287854d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.884758 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab2432-1efc-4e05-b880-09f9287854d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.885053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab2432-1efc-4e05-b880-09f9287854d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.885699 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab2432-1efc-4e05-b880-09f9287854d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:19.887408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab2432-1efc-4e05-b880-09f9287854d1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:19.897803 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4473/8983] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:26:19.901968 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467d836-ad4b-421b-8bff-812284459ed5 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:19.912670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467d836-ad4b-421b-8bff-812284459ed5 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:19.918617 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba14b68-80f6-4537-9fa7-0728adbb2831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:19.919223 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14b68-80f6-4537-9fa7-0728adbb2831 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.919497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14b68-80f6-4537-9fa7-0728adbb2831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.919760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba14b68-80f6-4537-9fa7-0728adbb2831 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.920405 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba14b68-80f6-4537-9fa7-0728adbb2831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:19.922154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba14b68-80f6-4537-9fa7-0728adbb2831 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:19.933275 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4511/8984] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:26:19.937689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab2432-1efc-4e05-b880-09f9287854d1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:19.948512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab2432-1efc-4e05-b880-09f9287854d1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:19.954822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d405-8b11-4510-b6b5-7133153401a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:19.955489 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d405-8b11-4510-b6b5-7133153401a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.955764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d405-8b11-4510-b6b5-7133153401a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.956036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d405-8b11-4510-b6b5-7133153401a0 admin admin] PATH_INFO: `/v3/projects/aa04d848f3bd4afaa684186703a91893/users/927b3a6005064ada99c70e30a48f2487/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:19.971371 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6d405-8b11-4510-b6b5-7133153401a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa04d848f3bd4afaa684186703a91893, user_id=927b3a6005064ada99c70e30a48f2487, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:19.974131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6d405-8b11-4510-b6b5-7133153401a0 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:19.989570 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4474/8985] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:26:19 2022] PUT /identity/v3/projects/aa04d848f3bd4afaa684186703a91893/users/927b3a6005064ada99c70e30a48f2487/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:19.995343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60724428-4962-4954-814b-344a85e4a463 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:19.995713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60724428-4962-4954-814b-344a85e4a463 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:19.996054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60724428-4962-4954-814b-344a85e4a463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:20.017682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-60724428-4962-4954-814b-344a85e4a463 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:20.018930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-60724428-4962-4954-814b-344a85e4a463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:20.083125 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4512/8986] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:20.094629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d405-8b11-4510-b6b5-7133153401a0 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:20.096632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2ca6d405-8b11-4510-b6b5-7133153401a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:20.142187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:20.158435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d405-8b11-4510-b6b5-7133153401a0 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:20.162314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901761-582e-4885-b226-8ee6aaa7721d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:20.162925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901761-582e-4885-b226-8ee6aaa7721d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:20.163196 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901761-582e-4885-b226-8ee6aaa7721d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:20.163462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0901761-582e-4885-b226-8ee6aaa7721d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:20.173112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0901761-582e-4885-b226-8ee6aaa7721d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:20.174610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0901761-582e-4885-b226-8ee6aaa7721d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:20.184294 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4475/8987] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:26:24.547392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffc13f-18a2-4f8a-a3f3-8b0148b22cb2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:24.547946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffc13f-18a2-4f8a-a3f3-8b0148b22cb2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:24.547946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ffc13f-18a2-4f8a-a3f3-8b0148b22cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:24.578767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f9ffc13f-18a2-4f8a-a3f3-8b0148b22cb2 None None] MFA Rules not processed for user `927b3a6005064ada99c70e30a48f2487`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:24.580308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f9ffc13f-18a2-4f8a-a3f3-8b0148b22cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:24.621286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:24.662609 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4513/8988] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:24.667245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901761-582e-4885-b226-8ee6aaa7721d service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:24.677279 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0901761-582e-4885-b226-8ee6aaa7721d service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:24.682193 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0ce48-0fb7-4d2f-88e1-358f8539f7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:24.682835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ce48-0fb7-4d2f-88e1-358f8539f7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:24.683175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ce48-0fb7-4d2f-88e1-358f8539f7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:24.683451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0ce48-0fb7-4d2f-88e1-358f8539f7d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:24.684108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0ce48-0fb7-4d2f-88e1-358f8539f7d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:24.686171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0ce48-0fb7-4d2f-88e1-358f8539f7d1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:24.726719 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4476/8989] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:26:24 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 05:26:24.731256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffc13f-18a2-4f8a-a3f3-8b0148b22cb2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:24.743464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ffc13f-18a2-4f8a-a3f3-8b0148b22cb2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:24.802904 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a215e8-8ceb-48c9-836c-2f960d1d1f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:24.803591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a215e8-8ceb-48c9-836c-2f960d1d1f66 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:24.803872 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a215e8-8ceb-48c9-836c-2f960d1d1f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:24.804144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a215e8-8ceb-48c9-836c-2f960d1d1f66 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:24.804787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a215e8-8ceb-48c9-836c-2f960d1d1f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:24.806774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a215e8-8ceb-48c9-836c-2f960d1d1f66 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:24.830949 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4514/8990] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:26:24 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:26:24.835498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0ce48-0fb7-4d2f-88e1-358f8539f7d1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:24.847821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0ce48-0fb7-4d2f-88e1-358f8539f7d1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:24.852550 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43311769-8aff-4166-9233-ffed84660aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:24.853297 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43311769-8aff-4166-9233-ffed84660aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:24.853647 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43311769-8aff-4166-9233-ffed84660aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:24.854000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43311769-8aff-4166-9233-ffed84660aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:24.854720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43311769-8aff-4166-9233-ffed84660aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:24.856423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43311769-8aff-4166-9233-ffed84660aa4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:24.868167 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4477/8991] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:26:24.872335 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a215e8-8ceb-48c9-836c-2f960d1d1f66 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:24.883106 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a215e8-8ceb-48c9-836c-2f960d1d1f66 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:24.888191 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7381307-761f-456b-aa82-d0924752bd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:24.888977 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7381307-761f-456b-aa82-d0924752bd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:24.889325 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7381307-761f-456b-aa82-d0924752bd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:24.889664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7381307-761f-456b-aa82-d0924752bd3f admin admin] PATH_INFO: `/v3/projects/03cb541c42884dd895958c5c9fe46cb7/users/f4f50c9b391141e490d7af1c023cb303/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:24.908665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7381307-761f-456b-aa82-d0924752bd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cb541c42884dd895958c5c9fe46cb7, user_id=f4f50c9b391141e490d7af1c023cb303, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:24.911411 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7381307-761f-456b-aa82-d0924752bd3f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:24.928829 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4515/8992] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:26:24 2022] PUT /identity/v3/projects/03cb541c42884dd895958c5c9fe46cb7/users/f4f50c9b391141e490d7af1c023cb303/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:24.933113 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43311769-8aff-4166-9233-ffed84660aa4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:24.943787 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43311769-8aff-4166-9233-ffed84660aa4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:25.004048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87633e9-1644-4082-bb12-1162fbcc6e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:25.004706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87633e9-1644-4082-bb12-1162fbcc6e0f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:25.004979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87633e9-1644-4082-bb12-1162fbcc6e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:25.005248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87633e9-1644-4082-bb12-1162fbcc6e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:25.005925 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87633e9-1644-4082-bb12-1162fbcc6e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:25.007557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87633e9-1644-4082-bb12-1162fbcc6e0f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:25.022650 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4478/8993] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:26:25.023877 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7381307-761f-456b-aa82-d0924752bd3f admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:25.035615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7381307-761f-456b-aa82-d0924752bd3f admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:25.041141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad63e57-8398-46a1-8e15-b3c2525b3b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:25.041824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad63e57-8398-46a1-8e15-b3c2525b3b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:25.042130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad63e57-8398-46a1-8e15-b3c2525b3b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:25.042397 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad63e57-8398-46a1-8e15-b3c2525b3b1e admin admin] PATH_INFO: `/v3/projects/03cb541c42884dd895958c5c9fe46cb7/users/f4f50c9b391141e490d7af1c023cb303/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:25.044488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad63e57-8398-46a1-8e15-b3c2525b3b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cb541c42884dd895958c5c9fe46cb7, user_id=f4f50c9b391141e490d7af1c023cb303, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:25.047251 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad63e57-8398-46a1-8e15-b3c2525b3b1e admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:25.058387 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4516/8994] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:26:25 2022] PUT /identity/v3/projects/03cb541c42884dd895958c5c9fe46cb7/users/f4f50c9b391141e490d7af1c023cb303/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:26:29.552204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb323ae1-c276-4c5d-9da4-f4ddead2f948 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:29.552768 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb323ae1-c276-4c5d-9da4-f4ddead2f948 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:29.552877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb323ae1-c276-4c5d-9da4-f4ddead2f948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:29.584173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-eb323ae1-c276-4c5d-9da4-f4ddead2f948 None None] MFA Rules not processed for user `f4f50c9b391141e490d7af1c023cb303`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:29.585764 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-eb323ae1-c276-4c5d-9da4-f4ddead2f948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:29.667523 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4479/8995] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:29.689537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad63e57-8398-46a1-8e15-b3c2525b3b1e admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:29.692002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fad63e57-8398-46a1-8e15-b3c2525b3b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:29.803063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad63e57-8398-46a1-8e15-b3c2525b3b1e admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:29.808593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d72e0-4595-4f8d-bb83-8f0ac2f0f277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:29.809228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d72e0-4595-4f8d-bb83-8f0ac2f0f277 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:29.809499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d72e0-4595-4f8d-bb83-8f0ac2f0f277 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:29.809762 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d72e0-4595-4f8d-bb83-8f0ac2f0f277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:29.836582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:29.874515 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d72e0-4595-4f8d-bb83-8f0ac2f0f277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:29.876265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d72e0-4595-4f8d-bb83-8f0ac2f0f277 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:29.886388 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4517/8996] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:26:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:26:29.959715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f2949-4699-48d2-a4b9-3fe7f2c46d45 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:29.960244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f2949-4699-48d2-a4b9-3fe7f2c46d45 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:29.960519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f2949-4699-48d2-a4b9-3fe7f2c46d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:29.981175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7e7f2949-4699-48d2-a4b9-3fe7f2c46d45 None None] MFA Rules not processed for user `927b3a6005064ada99c70e30a48f2487`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:26:29.982464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7e7f2949-4699-48d2-a4b9-3fe7f2c46d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:29.989643 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4480/8997] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:26:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:26:30.279096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d72e0-4595-4f8d-bb83-8f0ac2f0f277 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:30.280706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1b2d72e0-4595-4f8d-bb83-8f0ac2f0f277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:30.343109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d72e0-4595-4f8d-bb83-8f0ac2f0f277 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:30.346944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac5c39-2944-4e45-80c7-7c6fea6ba73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:30.347601 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5c39-2944-4e45-80c7-7c6fea6ba73c service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:30.347879 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5c39-2944-4e45-80c7-7c6fea6ba73c service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:30.348146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac5c39-2944-4e45-80c7-7c6fea6ba73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:30.349950 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a8ac5c39-2944-4e45-80c7-7c6fea6ba73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:30.360579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac5c39-2944-4e45-80c7-7c6fea6ba73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:30.362134 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac5c39-2944-4e45-80c7-7c6fea6ba73c service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:30.371215 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4518/8998] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:26:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:26:30.724961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f2949-4699-48d2-a4b9-3fe7f2c46d45 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:30.732956 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7e7f2949-4699-48d2-a4b9-3fe7f2c46d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:30.776851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:30.822354 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f2949-4699-48d2-a4b9-3fe7f2c46d45 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:30.827312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df63a1ed-855f-43fb-a651-6b47ea2c6ff7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:30.827938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63a1ed-855f-43fb-a651-6b47ea2c6ff7 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:30.828318 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63a1ed-855f-43fb-a651-6b47ea2c6ff7 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:30.828598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63a1ed-855f-43fb-a651-6b47ea2c6ff7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:30.830784 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-df63a1ed-855f-43fb-a651-6b47ea2c6ff7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:30.843363 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63a1ed-855f-43fb-a651-6b47ea2c6ff7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:30.845091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df63a1ed-855f-43fb-a651-6b47ea2c6ff7 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:30.854945 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4481/8999] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:26:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:26:40.367130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=42 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:40.850886 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=21 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:41.798190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac5c39-2944-4e45-80c7-7c6fea6ba73c service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:26:41.799849 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-a8ac5c39-2944-4e45-80c7-7c6fea6ba73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:26:41.863673 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac5c39-2944-4e45-80c7-7c6fea6ba73c service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:26:41.867924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff83a30-d2b7-4d29-adc7-2c7e77b4f4b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:26:41.868587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff83a30-d2b7-4d29-adc7-2c7e77b4f4b2 service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:26:41.868863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff83a30-d2b7-4d29-adc7-2c7e77b4f4b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:26:41.869128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff83a30-d2b7-4d29-adc7-2c7e77b4f4b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:26:41.879399 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff83a30-d2b7-4d29-adc7-2c7e77b4f4b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:26:41.880886 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff83a30-d2b7-4d29-adc7-2c7e77b4f4b2 service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:26:41.891047 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4519/9000] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:26:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:26:51.886696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=26 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:07.380167 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b794e66-89d2-44ac-9021-990315509991 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:27:07.380694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b794e66-89d2-44ac-9021-990315509991 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:27:07.380799 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b794e66-89d2-44ac-9021-990315509991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:27:07.400879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6b794e66-89d2-44ac-9021-990315509991 None None] MFA Rules not processed for user `927b3a6005064ada99c70e30a48f2487`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:27:07.402187 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6b794e66-89d2-44ac-9021-990315509991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:27:07.410340 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4482/9001] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:27:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:27:08.040799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff83a30-d2b7-4d29-adc7-2c7e77b4f4b2 service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:27:08.053075 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff83a30-d2b7-4d29-adc7-2c7e77b4f4b2 service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:27:08.058690 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fb3d8-cd66-4280-9efd-f047999e35b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:27:08.059306 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fb3d8-cd66-4280-9efd-f047999e35b0 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:27:08.059586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fb3d8-cd66-4280-9efd-f047999e35b0 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:27:08.059855 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fb3d8-cd66-4280-9efd-f047999e35b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:27:08.061654 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-701fb3d8-cd66-4280-9efd-f047999e35b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:27:08.074142 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fb3d8-cd66-4280-9efd-f047999e35b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:27:08.075713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701fb3d8-cd66-4280-9efd-f047999e35b0 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:27:08.089829 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4520/9002] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:27:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:27:17.395470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:18.085338 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:32.800861 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b794e66-89d2-44ac-9021-990315509991 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:27:32.810897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b794e66-89d2-44ac-9021-990315509991 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:27:32.815653 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c9408-44a2-48b1-b09c-b31975f8680e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:27:32.816258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9408-44a2-48b1-b09c-b31975f8680e service cinder] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:27:32.816652 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9408-44a2-48b1-b09c-b31975f8680e service cinder] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:27:32.816923 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c9408-44a2-48b1-b09c-b31975f8680e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:27:32.819092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-bd9c9408-44a2-48b1-b09c-b31975f8680e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:27:32.834306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9408-44a2-48b1-b09c-b31975f8680e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:27:32.835751 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c9408-44a2-48b1-b09c-b31975f8680e service cinder] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:27:32.847161 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4483/9003] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:27:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:27:38.397513 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fb3d8-cd66-4280-9efd-f047999e35b0 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:27:38.408127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701fb3d8-cd66-4280-9efd-f047999e35b0 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:27:38.412871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14389106-0b1d-4f33-8cb2-314fd49fc69d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38a84e3c6a2d4c0ab3a00851e555330a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:27:38.413546 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14389106-0b1d-4f33-8cb2-314fd49fc69d service cinder] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:27:38.413853 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14389106-0b1d-4f33-8cb2-314fd49fc69d service cinder] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:27:38.414151 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14389106-0b1d-4f33-8cb2-314fd49fc69d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:27:38.416135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-14389106-0b1d-4f33-8cb2-314fd49fc69d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:27:38.431073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14389106-0b1d-4f33-8cb2-314fd49fc69d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:27:38.432500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14389106-0b1d-4f33-8cb2-314fd49fc69d service cinder] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:27:38.444144 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4521/9004] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:27:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:27:42.842253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:45.687234 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e391ac9-3e86-463e-93dc-6fae9e60befd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:27:45.687811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e391ac9-3e86-463e-93dc-6fae9e60befd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:27:45.687811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e391ac9-3e86-463e-93dc-6fae9e60befd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:27:45.709372 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-3e391ac9-3e86-463e-93dc-6fae9e60befd None None] MFA Rules not processed for user `927b3a6005064ada99c70e30a48f2487`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:27:45.710596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3e391ac9-3e86-463e-93dc-6fae9e60befd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:27:45.718315 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4484/9005] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:27:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:27:48.438759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:55.703859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:30.164620 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14389106-0b1d-4f33-8cb2-314fd49fc69d service cinder] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:30.249386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14389106-0b1d-4f33-8cb2-314fd49fc69d service cinder] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:30.255408 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:30.256057 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:30.256366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:30.256635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] PATH_INFO: `/v3/users/927b3a6005064ada99c70e30a48f2487` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:30.257776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] RBAC: Authorizing `identity:delete_user(user_id=927b3a6005064ada99c70e30a48f2487)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:30.259730 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:30.309406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927b3a6005064ada99c70e30a48f2487'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.310088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927b3a6005064ada99c70e30a48f2487'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.320334 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927b3a6005064ada99c70e30a48f2487'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.331394 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927b3a6005064ada99c70e30a48f2487'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.350729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927b3a6005064ada99c70e30a48f2487'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.359896 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4522/9006] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:28:30 2022] DELETE /identity/v3/users/927b3a6005064ada99c70e30a48f2487 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:28:30.553737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e391ac9-3e86-463e-93dc-6fae9e60befd None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:30.565319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e391ac9-3e86-463e-93dc-6fae9e60befd None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:30.641562 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:30.642263 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:30.642548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:30.642824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] PATH_INFO: `/v3/projects/aa04d848f3bd4afaa684186703a91893` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:30.644085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa04d848f3bd4afaa684186703a91893)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:30.646122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:30.704533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa04d848f3bd4afaa684186703a91893', 'request_id': 'req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.713534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa04d848f3bd4afaa684186703a91893', 'request_id': 'req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.720616 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa04d848f3bd4afaa684186703a91893', 'request_id': 'req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.743735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] The token cache is being invalidate because project aa04d848f3bd4afaa684186703a91893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:28:30.744018 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.744631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.746412 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4485/9007] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:28:30 2022] DELETE /identity/v3/projects/aa04d848f3bd4afaa684186703a91893 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:28:30.750540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:30.751946 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:30.766115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95c4af-0354-4122-b46f-06616635863a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:30.824173 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:30.824767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:30.825058 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:30.825327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] PATH_INFO: `/v3/users/f4f50c9b391141e490d7af1c023cb303` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:30.826525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f50c9b391141e490d7af1c023cb303)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:30.828759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:30.842403 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:30.878907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f50c9b391141e490d7af1c023cb303'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.879575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f50c9b391141e490d7af1c023cb303'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.887343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f50c9b391141e490d7af1c023cb303'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.895590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f50c9b391141e490d7af1c023cb303'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.907985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-1bdc1524-92a4-45a9-8ff6-c4eccdef2f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f50c9b391141e490d7af1c023cb303'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:30.914234 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4523/9008] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:28:30 2022] DELETE /identity/v3/users/f4f50c9b391141e490d7af1c023cb303 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:28:31.103781 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:31.105470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:31.118577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1ee3f-8662-48e9-95fa-ec93b2b6defe admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:31.177021 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:31.177712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.178035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.178305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] PATH_INFO: `/v3/projects/03cb541c42884dd895958c5c9fe46cb7` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.179479 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cb541c42884dd895958c5c9fe46cb7)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:31.181397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:31.205505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:31.231233 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cb541c42884dd895958c5c9fe46cb7', 'request_id': 'req-2d881294-1acf-4f31-9518-8cf1f5c41c7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:31.240319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cb541c42884dd895958c5c9fe46cb7', 'request_id': 'req-2d881294-1acf-4f31-9518-8cf1f5c41c7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:31.246775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cb541c42884dd895958c5c9fe46cb7', 'request_id': 'req-2d881294-1acf-4f31-9518-8cf1f5c41c7a'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:31.258253 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] The token cache is being invalidate because project 03cb541c42884dd895958c5c9fe46cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:28:31.258697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:31.259355 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-2d881294-1acf-4f31-9518-8cf1f5c41c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:28:31.264552 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4486/9009] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:28:31 2022] DELETE /identity/v3/projects/03cb541c42884dd895958c5c9fe46cb7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:28:31.266171 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e0a72-a735-4850-ba9b-86cbf5f3b19e None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.266685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e0a72-a735-4850-ba9b-86cbf5f3b19e None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.266685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e0a72-a735-4850-ba9b-86cbf5f3b19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.288181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-254e0a72-a735-4850-ba9b-86cbf5f3b19e None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:28:31.289564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-254e0a72-a735-4850-ba9b-86cbf5f3b19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:31.357446 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4524/9010] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:28:31.365724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4611-7122-48f3-9f08-8e505837df11 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.366059 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4611-7122-48f3-9f08-8e505837df11 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.366298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f4611-7122-48f3-9f08-8e505837df11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.393151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-839f4611-7122-48f3-9f08-8e505837df11 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:28:31.394423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-839f4611-7122-48f3-9f08-8e505837df11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:31.404707 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4487/9011] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:28:31.410611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e0a72-a735-4850-ba9b-86cbf5f3b19e None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:31.420588 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e0a72-a735-4850-ba9b-86cbf5f3b19e None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:31.425046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c8c43-d9bb-4c2f-9cf6-edf6d29ac305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:31.425650 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c8c43-d9bb-4c2f-9cf6-edf6d29ac305 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.425962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c8c43-d9bb-4c2f-9cf6-edf6d29ac305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.426230 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c8c43-d9bb-4c2f-9cf6-edf6d29ac305 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.426869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c8c43-d9bb-4c2f-9cf6-edf6d29ac305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:28:31.427161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c8c43-d9bb-4c2f-9cf6-edf6d29ac305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:31.428754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c8c43-d9bb-4c2f-9cf6-edf6d29ac305 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:31.440468 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4525/9012] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:28:31.444916 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f4611-7122-48f3-9f08-8e505837df11 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:31.455827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f4611-7122-48f3-9f08-8e505837df11 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:31.464477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e246d8-8198-4ee0-beab-b341d3022d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:31.465182 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e246d8-8198-4ee0-beab-b341d3022d91 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.465583 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e246d8-8198-4ee0-beab-b341d3022d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.466017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e246d8-8198-4ee0-beab-b341d3022d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.467010 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e246d8-8198-4ee0-beab-b341d3022d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:31.470065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e246d8-8198-4ee0-beab-b341d3022d91 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:31.504395 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4488/9013] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:28:31 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:28:31.508967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c8c43-d9bb-4c2f-9cf6-edf6d29ac305 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:31.519675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c8c43-d9bb-4c2f-9cf6-edf6d29ac305 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:31.580992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7dae9-293c-49af-a55a-001bf0f4984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:31.581502 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7dae9-293c-49af-a55a-001bf0f4984b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.581776 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7dae9-293c-49af-a55a-001bf0f4984b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.582085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7dae9-293c-49af-a55a-001bf0f4984b admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.582721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7dae9-293c-49af-a55a-001bf0f4984b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:31.584670 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7dae9-293c-49af-a55a-001bf0f4984b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:31.611198 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4526/9014] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:28:31 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:28:31.615473 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e246d8-8198-4ee0-beab-b341d3022d91 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:31.626170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e246d8-8198-4ee0-beab-b341d3022d91 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:31.630991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c200-d71c-417a-a794-72bd9e712364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:31.631593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c200-d71c-417a-a794-72bd9e712364 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.631869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c200-d71c-417a-a794-72bd9e712364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.632137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2c200-d71c-417a-a794-72bd9e712364 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.632782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c200-d71c-417a-a794-72bd9e712364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:31.634438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2c200-d71c-417a-a794-72bd9e712364 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:31.649000 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4489/9015] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:28:31.653459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7dae9-293c-49af-a55a-001bf0f4984b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:31.668179 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7dae9-293c-49af-a55a-001bf0f4984b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:31.673430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62819a-c988-48c7-9005-608ac456a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:31.674044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62819a-c988-48c7-9005-608ac456a879 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.674319 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62819a-c988-48c7-9005-608ac456a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.674591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62819a-c988-48c7-9005-608ac456a879 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.675237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62819a-c988-48c7-9005-608ac456a879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:31.676835 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62819a-c988-48c7-9005-608ac456a879 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:31.678140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:31.689507 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4527/9016] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:28:31.693734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c200-d71c-417a-a794-72bd9e712364 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:31.704502 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2c200-d71c-417a-a794-72bd9e712364 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:31.709173 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b496c0b-ed51-472c-b31c-78221da0577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:31.709827 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b496c0b-ed51-472c-b31c-78221da0577d admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.710138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b496c0b-ed51-472c-b31c-78221da0577d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.710408 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b496c0b-ed51-472c-b31c-78221da0577d admin admin] PATH_INFO: `/v3/projects/76ab523c990a4ba48993c5e09aec8694/users/cadcd3c85d6240b281be2136dc43afa3/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.726396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b496c0b-ed51-472c-b31c-78221da0577d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ab523c990a4ba48993c5e09aec8694, user_id=cadcd3c85d6240b281be2136dc43afa3, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:31.729134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b496c0b-ed51-472c-b31c-78221da0577d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:31.746925 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4490/9017] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:28:31 2022] PUT /identity/v3/projects/76ab523c990a4ba48993c5e09aec8694/users/cadcd3c85d6240b281be2136dc43afa3/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:28:31.752076 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca9ca3-f73e-4674-bc10-4d6ee6de123f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.752356 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca9ca3-f73e-4674-bc10-4d6ee6de123f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.752623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca9ca3-f73e-4674-bc10-4d6ee6de123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.772026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-c8ca9ca3-f73e-4674-bc10-4d6ee6de123f None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:28:31.773254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-c8ca9ca3-f73e-4674-bc10-4d6ee6de123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:31.841963 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4528/9018] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:28:31.852302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b496c0b-ed51-472c-b31c-78221da0577d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:31.854037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0b496c0b-ed51-472c-b31c-78221da0577d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:31.910066 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b496c0b-ed51-472c-b31c-78221da0577d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:31.913681 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c4b21-cefe-4b51-829d-2c758aebaa59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:31.914314 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c4b21-cefe-4b51-829d-2c758aebaa59 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:31.914584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c4b21-cefe-4b51-829d-2c758aebaa59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:31.914855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c4b21-cefe-4b51-829d-2c758aebaa59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:31.924014 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c4b21-cefe-4b51-829d-2c758aebaa59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:31.925475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c4b21-cefe-4b51-829d-2c758aebaa59 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:31.935427 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4491/9019] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:28:36.028324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3540aa-bab0-4a28-87cc-1370d20a64ac None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:36.028845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3540aa-bab0-4a28-87cc-1370d20a64ac None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:36.028845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3540aa-bab0-4a28-87cc-1370d20a64ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:36.061030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-5d3540aa-bab0-4a28-87cc-1370d20a64ac None None] MFA Rules not processed for user `cadcd3c85d6240b281be2136dc43afa3`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:28:36.062317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5d3540aa-bab0-4a28-87cc-1370d20a64ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:36.154430 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4529/9020] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:28:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:28:36.159290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c4b21-cefe-4b51-829d-2c758aebaa59 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:36.169742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c4b21-cefe-4b51-829d-2c758aebaa59 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:36.174670 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a885432-0214-4930-b45f-7f71d055249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:36.175321 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a885432-0214-4930-b45f-7f71d055249a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:36.175594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a885432-0214-4930-b45f-7f71d055249a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:36.175865 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a885432-0214-4930-b45f-7f71d055249a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:36.176512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a885432-0214-4930-b45f-7f71d055249a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:36.178576 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a885432-0214-4930-b45f-7f71d055249a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:36.209640 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4492/9021] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:28:36 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:28:36.213957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3540aa-bab0-4a28-87cc-1370d20a64ac None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:36.225543 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3540aa-bab0-4a28-87cc-1370d20a64ac None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:36.285687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4323f-b50f-4db4-aa28-fce7cef741ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:36.286347 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4323f-b50f-4db4-aa28-fce7cef741ee admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:36.286625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4323f-b50f-4db4-aa28-fce7cef741ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:36.286890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4323f-b50f-4db4-aa28-fce7cef741ee admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:36.287536 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4323f-b50f-4db4-aa28-fce7cef741ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:36.289480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4323f-b50f-4db4-aa28-fce7cef741ee admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:36.316548 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4530/9022] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:28:36 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:28:36.317836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a885432-0214-4930-b45f-7f71d055249a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:36.330839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a885432-0214-4930-b45f-7f71d055249a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:36.335675 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e9ceb-7f1b-4e00-aff0-ad2e7a4e0f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:36.336298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e9ceb-7f1b-4e00-aff0-ad2e7a4e0f70 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:36.336581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e9ceb-7f1b-4e00-aff0-ad2e7a4e0f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:36.336849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e9ceb-7f1b-4e00-aff0-ad2e7a4e0f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:36.337529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e9ceb-7f1b-4e00-aff0-ad2e7a4e0f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:36.339384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e9ceb-7f1b-4e00-aff0-ad2e7a4e0f70 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:36.352674 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4493/9023] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:28:36.357121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4323f-b50f-4db4-aa28-fce7cef741ee admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:36.369246 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4323f-b50f-4db4-aa28-fce7cef741ee admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:36.374891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dcc5a-b75b-4a5b-b997-e13d4758ba1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:36.375559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dcc5a-b75b-4a5b-b997-e13d4758ba1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:36.375834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dcc5a-b75b-4a5b-b997-e13d4758ba1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:36.376107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dcc5a-b75b-4a5b-b997-e13d4758ba1d admin admin] PATH_INFO: `/v3/projects/47fd00939f154bb392cb5420ea75abb3/users/9d755380e27a489bb583813e91136be2/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:36.390252 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:36.397591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dcc5a-b75b-4a5b-b997-e13d4758ba1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47fd00939f154bb392cb5420ea75abb3, user_id=9d755380e27a489bb583813e91136be2, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:36.400744 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dcc5a-b75b-4a5b-b997-e13d4758ba1d admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:36.415784 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4531/9024] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:28:36 2022] PUT /identity/v3/projects/47fd00939f154bb392cb5420ea75abb3/users/9d755380e27a489bb583813e91136be2/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:28:36.420668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e9ceb-7f1b-4e00-aff0-ad2e7a4e0f70 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:36.431338 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e9ceb-7f1b-4e00-aff0-ad2e7a4e0f70 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:36.446571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:36.496542 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10738d-abdb-4c5b-9364-92cc02fd23e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:36.497247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10738d-abdb-4c5b-9364-92cc02fd23e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:36.497512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10738d-abdb-4c5b-9364-92cc02fd23e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:36.497780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10738d-abdb-4c5b-9364-92cc02fd23e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:36.498483 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10738d-abdb-4c5b-9364-92cc02fd23e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:36.500199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10738d-abdb-4c5b-9364-92cc02fd23e3 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:36.511325 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4494/9025] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:28:36.515810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dcc5a-b75b-4a5b-b997-e13d4758ba1d admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:36.527435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dcc5a-b75b-4a5b-b997-e13d4758ba1d admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:36.533068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daa1c6-7776-4809-af11-02fd522f704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:36.534587 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daa1c6-7776-4809-af11-02fd522f704a admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:36.534890 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daa1c6-7776-4809-af11-02fd522f704a admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:36.535197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5daa1c6-7776-4809-af11-02fd522f704a admin admin] PATH_INFO: `/v3/projects/47fd00939f154bb392cb5420ea75abb3/users/9d755380e27a489bb583813e91136be2/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:36.537315 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5daa1c6-7776-4809-af11-02fd522f704a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47fd00939f154bb392cb5420ea75abb3, user_id=9d755380e27a489bb583813e91136be2, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:36.540044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5daa1c6-7776-4809-af11-02fd522f704a admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:36.552798 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4532/9026] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:28:36 2022] PUT /identity/v3/projects/47fd00939f154bb392cb5420ea75abb3/users/9d755380e27a489bb583813e91136be2/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:28:41.024280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21be7c0-5a44-4ba2-86e8-f156b11f32a9 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:41.025178 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21be7c0-5a44-4ba2-86e8-f156b11f32a9 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:41.025487 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21be7c0-5a44-4ba2-86e8-f156b11f32a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:41.059227 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-c21be7c0-5a44-4ba2-86e8-f156b11f32a9 None None] MFA Rules not processed for user `9d755380e27a489bb583813e91136be2`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:28:41.060469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-c21be7c0-5a44-4ba2-86e8-f156b11f32a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:41.180773 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4495/9027] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:28:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:28:41.217040 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daa1c6-7776-4809-af11-02fd522f704a admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:41.219564 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b5daa1c6-7776-4809-af11-02fd522f704a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:41.318576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5daa1c6-7776-4809-af11-02fd522f704a admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:41.322685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a5bf6-73d1-4c6e-ab71-ed7d282ea345 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:41.323380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a5bf6-73d1-4c6e-ab71-ed7d282ea345 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:41.324154 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a5bf6-73d1-4c6e-ab71-ed7d282ea345 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:41.325068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a5bf6-73d1-4c6e-ab71-ed7d282ea345 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:41.406100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a5bf6-73d1-4c6e-ab71-ed7d282ea345 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:41.407499 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a5bf6-73d1-4c6e-ab71-ed7d282ea345 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:41.418634 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4533/9028] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:28:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:28:41.583874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5c7c2-f0aa-44bb-83bd-400acb47f274 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:41.584155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5c7c2-f0aa-44bb-83bd-400acb47f274 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:41.584421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5c7c2-f0aa-44bb-83bd-400acb47f274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:41.666370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-09a5c7c2-f0aa-44bb-83bd-400acb47f274 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:28:41.669658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-09a5c7c2-f0aa-44bb-83bd-400acb47f274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:41.754485 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4496/9029] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:28:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:28:41.803674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a4784-c53b-44ce-9197-7dec39036d5a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:41.803962 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a4784-c53b-44ce-9197-7dec39036d5a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:41.804260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a4784-c53b-44ce-9197-7dec39036d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:41.867157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-7d9a4784-c53b-44ce-9197-7dec39036d5a None None] MFA Rules not processed for user `d9592051e6894c86a699ca2074a32079`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:28:41.868358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7d9a4784-c53b-44ce-9197-7dec39036d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:41.918905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:41.952231 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4534/9030] 10.222.0.43 () {58 vars in 1040 bytes} [Tue Aug 30 05:28:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:28:41.958828 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5c7c2-f0aa-44bb-83bd-400acb47f274 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:41.975401 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5c7c2-f0aa-44bb-83bd-400acb47f274 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:41.980826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9444d0-d346-4335-b093-18257ae9f345 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:41.981993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9444d0-d346-4335-b093-18257ae9f345 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:41.982273 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9444d0-d346-4335-b093-18257ae9f345 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:41.982530 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9444d0-d346-4335-b093-18257ae9f345 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:41.989322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=100 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:41.992062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9444d0-d346-4335-b093-18257ae9f345 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:41.994291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9444d0-d346-4335-b093-18257ae9f345 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:42.004647 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4497/9031] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:28:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:28:50.675174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a0e74-32ca-4409-a6b0-c703494a0a0f None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:50.675731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a0e74-32ca-4409-a6b0-c703494a0a0f None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:50.675871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a0e74-32ca-4409-a6b0-c703494a0a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:50.697392 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-2c7a0e74-32ca-4409-a6b0-c703494a0a0f None None] MFA Rules not processed for user `cadcd3c85d6240b281be2136dc43afa3`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:28:50.698732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2c7a0e74-32ca-4409-a6b0-c703494a0a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:50.706730 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4535/9032] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:28:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:28:52.001229 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:52.724051 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913f0e0-e41f-400d-80a8-3967a507a584 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:52.724643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913f0e0-e41f-400d-80a8-3967a507a584 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:52.725134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913f0e0-e41f-400d-80a8-3967a507a584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:52.751951 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-8913f0e0-e41f-400d-80a8-3967a507a584 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:28:52.753277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8913f0e0-e41f-400d-80a8-3967a507a584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:28:52.761913 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4498/9033] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:28:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:28:52.776013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a0e74-32ca-4409-a6b0-c703494a0a0f None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:28:52.788443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a0e74-32ca-4409-a6b0-c703494a0a0f None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:28:52.793745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1594dcb-fcfd-47fa-8566-356b3e610dd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:28:52.794443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594dcb-fcfd-47fa-8566-356b3e610dd6 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:28:52.794705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594dcb-fcfd-47fa-8566-356b3e610dd6 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:28:52.794961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1594dcb-fcfd-47fa-8566-356b3e610dd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:28:52.803496 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1594dcb-fcfd-47fa-8566-356b3e610dd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:28:52.804943 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1594dcb-fcfd-47fa-8566-356b3e610dd6 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:28:52.813372 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4536/9034] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:28:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:29:02.746096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:29:02.810101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=20 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:29:26.107185 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913f0e0-e41f-400d-80a8-3967a507a584 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:29:26.109176 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8913f0e0-e41f-400d-80a8-3967a507a584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:29:26.171890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913f0e0-e41f-400d-80a8-3967a507a584 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:29:26.178393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b7e96-9fdc-4958-bc39-17d95a9cbaa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:29:26.179267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b7e96-9fdc-4958-bc39-17d95a9cbaa8 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:29:26.179601 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b7e96-9fdc-4958-bc39-17d95a9cbaa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:29:26.179944 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b7e96-9fdc-4958-bc39-17d95a9cbaa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:29:26.196558 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b7e96-9fdc-4958-bc39-17d95a9cbaa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:29:26.198067 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b7e96-9fdc-4958-bc39-17d95a9cbaa8 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:29:26.208827 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4499/9035] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:29:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:29:28.370084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1594dcb-fcfd-47fa-8566-356b3e610dd6 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:29:28.384382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1594dcb-fcfd-47fa-8566-356b3e610dd6 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:29:28.391723 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01845ab5-1687-47cc-ad84-084b17a3e5ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:29:28.392507 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845ab5-1687-47cc-ad84-084b17a3e5ff service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:29:28.392867 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845ab5-1687-47cc-ad84-084b17a3e5ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:29:28.393267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01845ab5-1687-47cc-ad84-084b17a3e5ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:29:28.395484 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-01845ab5-1687-47cc-ad84-084b17a3e5ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:29:28.408675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01845ab5-1687-47cc-ad84-084b17a3e5ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:29:28.410363 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01845ab5-1687-47cc-ad84-084b17a3e5ff service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:29:28.424398 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4537/9036] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:29:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:29:36.204177 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=26 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:29:38.419976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:30:27.814191 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b7e96-9fdc-4958-bc39-17d95a9cbaa8 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:30:27.815855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-041b7e96-9fdc-4958-bc39-17d95a9cbaa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:30:27.900296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b7e96-9fdc-4958-bc39-17d95a9cbaa8 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:30:27.907201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a072883-6b58-437d-8594-fd3eaa5e7a9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:30:27.907859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a072883-6b58-437d-8594-fd3eaa5e7a9d service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:30:27.908148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a072883-6b58-437d-8594-fd3eaa5e7a9d service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:30:27.908511 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a072883-6b58-437d-8594-fd3eaa5e7a9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:30:27.910715 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7a072883-6b58-437d-8594-fd3eaa5e7a9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:30:27.923211 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a072883-6b58-437d-8594-fd3eaa5e7a9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:30:27.924714 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a072883-6b58-437d-8594-fd3eaa5e7a9d service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:30:27.939453 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4500/9037] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:30:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:30:37.933006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=36 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:30:44.535667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01845ab5-1687-47cc-ad84-084b17a3e5ff service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:30:44.549666 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01845ab5-1687-47cc-ad84-084b17a3e5ff service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:30:44.555756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a676622-7fc8-4977-b27c-83dc3cae222d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:30:44.556354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a676622-7fc8-4977-b27c-83dc3cae222d service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:30:44.556623 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a676622-7fc8-4977-b27c-83dc3cae222d service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:30:44.556888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a676622-7fc8-4977-b27c-83dc3cae222d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:30:44.558775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7a676622-7fc8-4977-b27c-83dc3cae222d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:30:44.571148 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a676622-7fc8-4977-b27c-83dc3cae222d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:30:44.572725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a676622-7fc8-4977-b27c-83dc3cae222d service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:30:44.582922 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4538/9038] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:30:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:30:54.579332 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:32:23.399025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a072883-6b58-437d-8594-fd3eaa5e7a9d service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:32:23.401549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7a072883-6b58-437d-8594-fd3eaa5e7a9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:23.575933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a072883-6b58-437d-8594-fd3eaa5e7a9d service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:32:23.582654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c2f23-2c31-48b7-813d-8be9a11f9b48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:32:23.583415 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c2f23-2c31-48b7-813d-8be9a11f9b48 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:23.583756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c2f23-2c31-48b7-813d-8be9a11f9b48 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:23.584092 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c2f23-2c31-48b7-813d-8be9a11f9b48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:23.586619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3d8c2f23-2c31-48b7-813d-8be9a11f9b48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:23.601989 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c2f23-2c31-48b7-813d-8be9a11f9b48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:32:23.604300 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c2f23-2c31-48b7-813d-8be9a11f9b48 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:32:23.619276 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4501/9039] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:32:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:32:33.613411 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=58 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:32:36.758743 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a676622-7fc8-4977-b27c-83dc3cae222d service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:32:36.800163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a676622-7fc8-4977-b27c-83dc3cae222d service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:32:36.804265 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f27026-fc4d-4ef5-a4e9-f44fa1e2ab30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:32:36.804873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f27026-fc4d-4ef5-a4e9-f44fa1e2ab30 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:36.805144 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f27026-fc4d-4ef5-a4e9-f44fa1e2ab30 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:36.805406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f27026-fc4d-4ef5-a4e9-f44fa1e2ab30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:36.807317 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d3f27026-fc4d-4ef5-a4e9-f44fa1e2ab30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:36.822574 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f27026-fc4d-4ef5-a4e9-f44fa1e2ab30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:32:36.824261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f27026-fc4d-4ef5-a4e9-f44fa1e2ab30 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:32:36.835883 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4539/9040] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:32:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:32:39.126999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f5f0-8b3b-4104-b59e-5e3b4b8c3b6d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:39.127494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f5f0-8b3b-4104-b59e-5e3b4b8c3b6d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:39.127596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360f5f0-8b3b-4104-b59e-5e3b4b8c3b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:39.148156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b360f5f0-8b3b-4104-b59e-5e3b4b8c3b6d None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:32:39.149370 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b360f5f0-8b3b-4104-b59e-5e3b4b8c3b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:39.157332 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4502/9041] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:32:39.197696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f27026-fc4d-4ef5-a4e9-f44fa1e2ab30 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:32:39.209479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f27026-fc4d-4ef5-a4e9-f44fa1e2ab30 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:32:39.214871 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bbf53-efcd-4af8-a390-1c9d9101d020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:32:39.215473 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bbf53-efcd-4af8-a390-1c9d9101d020 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:39.215747 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bbf53-efcd-4af8-a390-1c9d9101d020 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:39.216017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bbf53-efcd-4af8-a390-1c9d9101d020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:39.224972 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bbf53-efcd-4af8-a390-1c9d9101d020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:32:39.226667 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128bbf53-efcd-4af8-a390-1c9d9101d020 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:32:39.234873 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4540/9042] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:32:39.734825 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd299c2c-77c6-4741-af6a-3926d9cb4016 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:39.735112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd299c2c-77c6-4741-af6a-3926d9cb4016 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:39.735463 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd299c2c-77c6-4741-af6a-3926d9cb4016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:39.756120 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-cd299c2c-77c6-4741-af6a-3926d9cb4016 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:32:39.757369 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-cd299c2c-77c6-4741-af6a-3926d9cb4016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:39.764934 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4503/9043] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:32:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:32:39.777635 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bbf53-efcd-4af8-a390-1c9d9101d020 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:32:39.788168 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bbf53-efcd-4af8-a390-1c9d9101d020 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:32:39.793395 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83053d8-d57f-4bbd-80c8-12ffd6ddeedf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:32:39.794026 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83053d8-d57f-4bbd-80c8-12ffd6ddeedf service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:39.794297 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83053d8-d57f-4bbd-80c8-12ffd6ddeedf service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:39.794561 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83053d8-d57f-4bbd-80c8-12ffd6ddeedf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:39.803692 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83053d8-d57f-4bbd-80c8-12ffd6ddeedf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:32:39.805276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83053d8-d57f-4bbd-80c8-12ffd6ddeedf service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:32:39.814346 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4541/9044] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:32:48.057293 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadeda9-d88d-47e6-8792-9855f6275bea None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:48.057895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadeda9-d88d-47e6-8792-9855f6275bea None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:48.057895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadeda9-d88d-47e6-8792-9855f6275bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:48.077306 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5eadeda9-d88d-47e6-8792-9855f6275bea None None] MFA Rules not processed for user `cadcd3c85d6240b281be2136dc43afa3`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:32:48.078551 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5eadeda9-d88d-47e6-8792-9855f6275bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:48.085476 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4504/9045] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:32:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:32:48.128001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615f09-8b48-48ae-ae6d-f7ba73fa59de None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:48.128422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615f09-8b48-48ae-ae6d-f7ba73fa59de None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:48.128519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64615f09-8b48-48ae-ae6d-f7ba73fa59de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:48.170969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-64615f09-8b48-48ae-ae6d-f7ba73fa59de None None] MFA Rules not processed for user `0d31eed8c74549f8b8c6bb5aaa6bee98`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:32:48.172193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-64615f09-8b48-48ae-ae6d-f7ba73fa59de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:48.179567 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4542/9046] 10.222.0.43 () {58 vars in 1064 bytes} [Tue Aug 30 05:32:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:32:48.185658 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadeda9-d88d-47e6-8792-9855f6275bea None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:32:48.196378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadeda9-d88d-47e6-8792-9855f6275bea None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:32:48.201140 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b677e-edbb-48e3-b93a-6bb920f9ae5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:32:48.201813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b677e-edbb-48e3-b93a-6bb920f9ae5a service glance] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:48.202114 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b677e-edbb-48e3-b93a-6bb920f9ae5a service glance] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:48.202376 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b677e-edbb-48e3-b93a-6bb920f9ae5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:48.204464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c7b677e-edbb-48e3-b93a-6bb920f9ae5a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:48.219760 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b677e-edbb-48e3-b93a-6bb920f9ae5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:32:48.221215 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b677e-edbb-48e3-b93a-6bb920f9ae5a service glance] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:32:48.232593 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4505/9047] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:32:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:32:48.485947 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64615f09-8b48-48ae-ae6d-f7ba73fa59de None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:32:48.495887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64615f09-8b48-48ae-ae6d-f7ba73fa59de None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:32:48.500414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297cffa-0cf8-49bc-92ab-b668d0559625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:32:48.501235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297cffa-0cf8-49bc-92ab-b668d0559625 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:48.501647 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297cffa-0cf8-49bc-92ab-b668d0559625 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:48.501911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297cffa-0cf8-49bc-92ab-b668d0559625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:48.503992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d297cffa-0cf8-49bc-92ab-b668d0559625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:48.513275 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297cffa-0cf8-49bc-92ab-b668d0559625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:32:48.514735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297cffa-0cf8-49bc-92ab-b668d0559625 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:32:48.522599 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4543/9048] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:32:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:32:48.868210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b677e-edbb-48e3-b93a-6bb920f9ae5a service glance] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:32:48.869648 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9c7b677e-edbb-48e3-b93a-6bb920f9ae5a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:48.885124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b677e-edbb-48e3-b93a-6bb920f9ae5a service glance] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:32:48.890339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1893-e598-474f-b827-07960350eebf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:32:48.891041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1893-e598-474f-b827-07960350eebf service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:48.891337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1893-e598-474f-b827-07960350eebf service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:48.891628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d1893-e598-474f-b827-07960350eebf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:48.893389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-621d1893-e598-474f-b827-07960350eebf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:48.905532 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d1893-e598-474f-b827-07960350eebf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:32:48.907217 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d1893-e598-474f-b827-07960350eebf service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:32:48.917437 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4506/9049] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:32:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:32:50.294214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f907f-83a9-4715-aa7e-9aa1016e7ad8 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:50.294721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f907f-83a9-4715-aa7e-9aa1016e7ad8 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:50.294953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f907f-83a9-4715-aa7e-9aa1016e7ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:50.317162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-d06f907f-83a9-4715-aa7e-9aa1016e7ad8 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:32:50.318497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d06f907f-83a9-4715-aa7e-9aa1016e7ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:32:50.326889 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4544/9050] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:32:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:32:50.340156 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1893-e598-474f-b827-07960350eebf service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:32:50.352633 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d1893-e598-474f-b827-07960350eebf service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:32:50.357624 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0728ab-9cee-42ad-a1fa-11655d267397 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:32:50.358267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0728ab-9cee-42ad-a1fa-11655d267397 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:32:50.358543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0728ab-9cee-42ad-a1fa-11655d267397 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:32:50.358815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0728ab-9cee-42ad-a1fa-11655d267397 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:32:50.367900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0728ab-9cee-42ad-a1fa-11655d267397 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:32:50.369510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0728ab-9cee-42ad-a1fa-11655d267397 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:32:50.379353 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4507/9051] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:32:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:33:00.310225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=48 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:33:00.374696 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=27 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:33:01.601029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f907f-83a9-4715-aa7e-9aa1016e7ad8 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:33:01.611685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f907f-83a9-4715-aa7e-9aa1016e7ad8 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:33:01.617491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc36c0-1618-4e28-8d60-4999924d7dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:33:01.618140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc36c0-1618-4e28-8d60-4999924d7dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:33:01.618418 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc36c0-1618-4e28-8d60-4999924d7dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:33:01.618687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc36c0-1618-4e28-8d60-4999924d7dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:33:01.620576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-9abc36c0-1618-4e28-8d60-4999924d7dc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:33:01.631341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc36c0-1618-4e28-8d60-4999924d7dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:33:01.632804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc36c0-1618-4e28-8d60-4999924d7dc2 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:33:01.641861 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4545/9052] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:33:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:33:02.234516 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0728ab-9cee-42ad-a1fa-11655d267397 service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:33:02.236708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-dd0728ab-9cee-42ad-a1fa-11655d267397 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:33:02.256153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0728ab-9cee-42ad-a1fa-11655d267397 service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:33:02.263002 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48363271-d76d-4788-9db1-2fc629f3fc09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:33:02.264025 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363271-d76d-4788-9db1-2fc629f3fc09 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:33:02.264436 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363271-d76d-4788-9db1-2fc629f3fc09 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:33:02.264708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48363271-d76d-4788-9db1-2fc629f3fc09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:33:02.267174 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-48363271-d76d-4788-9db1-2fc629f3fc09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:33:02.292020 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48363271-d76d-4788-9db1-2fc629f3fc09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:33:02.293731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48363271-d76d-4788-9db1-2fc629f3fc09 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:33:02.305246 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4508/9053] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:33:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:33:09.548032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc36c0-1618-4e28-8d60-4999924d7dc2 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:33:09.565625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc36c0-1618-4e28-8d60-4999924d7dc2 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:33:09.572121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1d82d-b39a-4a6b-9322-aecf50473484 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:33:09.572729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1d82d-b39a-4a6b-9322-aecf50473484 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:33:09.573010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1d82d-b39a-4a6b-9322-aecf50473484 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:33:09.573281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1d82d-b39a-4a6b-9322-aecf50473484 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:33:09.575324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f4a1d82d-b39a-4a6b-9322-aecf50473484 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:33:09.589316 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1d82d-b39a-4a6b-9322-aecf50473484 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:33:09.590961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1d82d-b39a-4a6b-9322-aecf50473484 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:33:09.602405 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4546/9054] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:33:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:33:12.300754 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:33:19.598169 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=12 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:34:26.001523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48363271-d76d-4788-9db1-2fc629f3fc09 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:34:26.013668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48363271-d76d-4788-9db1-2fc629f3fc09 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:34:26.020913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3ce74-1981-4fa2-85d3-35cb7e456a6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:34:26.021519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3ce74-1981-4fa2-85d3-35cb7e456a6e service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:34:26.021796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3ce74-1981-4fa2-85d3-35cb7e456a6e service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:34:26.022165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3ce74-1981-4fa2-85d3-35cb7e456a6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:34:26.031093 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3ce74-1981-4fa2-85d3-35cb7e456a6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:34:26.032698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3ce74-1981-4fa2-85d3-35cb7e456a6e service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:34:26.042750 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4509/9055] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:34:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:34:36.037736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:35:34.866117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1d82d-b39a-4a6b-9322-aecf50473484 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:35:34.878125 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1d82d-b39a-4a6b-9322-aecf50473484 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:35:34.884700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8bcb5-800f-478d-a91d-2958ec1069be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:35:34.885312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bcb5-800f-478d-a91d-2958ec1069be service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:35:34.885586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bcb5-800f-478d-a91d-2958ec1069be service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:35:34.885847 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bcb5-800f-478d-a91d-2958ec1069be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:35:34.895388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8bcb5-800f-478d-a91d-2958ec1069be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:35:34.897018 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8bcb5-800f-478d-a91d-2958ec1069be service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:35:34.908038 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4547/9056] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:35:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:35:44.903422 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:35:51.532431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3ce74-1981-4fa2-85d3-35cb7e456a6e service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:35:51.545533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3ce74-1981-4fa2-85d3-35cb7e456a6e service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:35:51.553105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ade334-30ce-4936-8391-66d0f12962e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:35:51.553723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ade334-30ce-4936-8391-66d0f12962e0 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:35:51.554032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ade334-30ce-4936-8391-66d0f12962e0 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:35:51.554334 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ade334-30ce-4936-8391-66d0f12962e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:35:51.564131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ade334-30ce-4936-8391-66d0f12962e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:35:51.565769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ade334-30ce-4936-8391-66d0f12962e0 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:35:51.578040 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4510/9057] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:35:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:35:56.563648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c548-02df-41d9-b9ed-7921574b5ea2 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:35:56.564190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c548-02df-41d9-b9ed-7921574b5ea2 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:35:56.564190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c548-02df-41d9-b9ed-7921574b5ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:35:56.595495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-20c5c548-02df-41d9-b9ed-7921574b5ea2 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:35:56.596697 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-20c5c548-02df-41d9-b9ed-7921574b5ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:35:56.612417 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4548/9058] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 05:35:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:35:56.654391 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ade334-30ce-4936-8391-66d0f12962e0 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:35:56.665841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ade334-30ce-4936-8391-66d0f12962e0 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:35:56.672395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f00d96-65c1-4ba9-95cf-2adb8805807f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:35:56.673035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00d96-65c1-4ba9-95cf-2adb8805807f service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:35:56.673309 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00d96-65c1-4ba9-95cf-2adb8805807f service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:35:56.673577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f00d96-65c1-4ba9-95cf-2adb8805807f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:35:56.683013 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f00d96-65c1-4ba9-95cf-2adb8805807f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:35:56.684984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f00d96-65c1-4ba9-95cf-2adb8805807f service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:35:56.694163 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4511/9059] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:35:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:35:57.065286 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c548-02df-41d9-b9ed-7921574b5ea2 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:35:57.076025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c548-02df-41d9-b9ed-7921574b5ea2 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:35:57.080228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a98db-e90c-45e1-939c-b42ef820050a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:35:57.080836 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a98db-e90c-45e1-939c-b42ef820050a service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:35:57.081113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a98db-e90c-45e1-939c-b42ef820050a service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:35:57.081380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a98db-e90c-45e1-939c-b42ef820050a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:35:57.144321 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a98db-e90c-45e1-939c-b42ef820050a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:35:57.145742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a98db-e90c-45e1-939c-b42ef820050a service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:35:57.165484 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4549/9060] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:36:00.454859 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f00d96-65c1-4ba9-95cf-2adb8805807f service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:00.467464 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f00d96-65c1-4ba9-95cf-2adb8805807f service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:00.473461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb7c86-eef8-446a-b090-000c7b8beacc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:00.474119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb7c86-eef8-446a-b090-000c7b8beacc service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:00.474368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb7c86-eef8-446a-b090-000c7b8beacc service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:00.474641 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb7c86-eef8-446a-b090-000c7b8beacc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:00.476628 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-00fb7c86-eef8-446a-b090-000c7b8beacc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:00.524713 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb7c86-eef8-446a-b090-000c7b8beacc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:00.526524 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb7c86-eef8-446a-b090-000c7b8beacc service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:00.540540 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4512/9061] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:36:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:36:03.484331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a98db-e90c-45e1-939c-b42ef820050a service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:03.507760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a98db-e90c-45e1-939c-b42ef820050a service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:03.513669 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d637e7-96ff-45f5-8c32-d0afe99eda97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:03.514494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d637e7-96ff-45f5-8c32-d0afe99eda97 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:03.514863 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d637e7-96ff-45f5-8c32-d0afe99eda97 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:03.515203 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d637e7-96ff-45f5-8c32-d0afe99eda97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:03.517139 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b8d637e7-96ff-45f5-8c32-d0afe99eda97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:03.530568 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d637e7-96ff-45f5-8c32-d0afe99eda97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:03.532183 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d637e7-96ff-45f5-8c32-d0afe99eda97 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:03.550596 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4550/9062] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:36:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:36:03.570822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb7c86-eef8-446a-b090-000c7b8beacc service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:03.582878 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb7c86-eef8-446a-b090-000c7b8beacc service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:03.592645 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:03.593323 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:03.593577 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:03.593848 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] PATH_INFO: `/v3/users/cadcd3c85d6240b281be2136dc43afa3` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:03.595221 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cadcd3c85d6240b281be2136dc43afa3)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:03.597438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:03.646970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cadcd3c85d6240b281be2136dc43afa3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:03.656986 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cadcd3c85d6240b281be2136dc43afa3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:03.670555 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cadcd3c85d6240b281be2136dc43afa3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:03.678834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cadcd3c85d6240b281be2136dc43afa3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:03.679462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cadcd3c85d6240b281be2136dc43afa3'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:03.687786 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4513/9063] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:36:03 2022] DELETE /identity/v3/users/cadcd3c85d6240b281be2136dc43afa3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:36:04.207969 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d637e7-96ff-45f5-8c32-d0afe99eda97 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:04.219590 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d637e7-96ff-45f5-8c32-d0afe99eda97 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:04.282113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:04.282754 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:04.283030 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:04.283294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] PATH_INFO: `/v3/projects/76ab523c990a4ba48993c5e09aec8694` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:04.284420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ab523c990a4ba48993c5e09aec8694)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:04.286373 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:04.341109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ab523c990a4ba48993c5e09aec8694', 'request_id': 'req-dfcb956c-65e4-40d9-ae09-04ecba7e1022'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.343414 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:04.348219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ab523c990a4ba48993c5e09aec8694', 'request_id': 'req-dfcb956c-65e4-40d9-ae09-04ecba7e1022'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.357554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ab523c990a4ba48993c5e09aec8694', 'request_id': 'req-dfcb956c-65e4-40d9-ae09-04ecba7e1022'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.368512 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] The token cache is being invalidate because project 76ab523c990a4ba48993c5e09aec8694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:36:04.368777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.369384 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.370892 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4551/9064] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:36:04 2022] DELETE /identity/v3/projects/76ab523c990a4ba48993c5e09aec8694 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:36:04.375604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:04.377119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:04.391165 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638298d-e420-4820-8933-1e925c98ef7f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:04.452128 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:04.452680 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:04.452960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:04.453231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] PATH_INFO: `/v3/users/9d755380e27a489bb583813e91136be2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:04.454470 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d755380e27a489bb583813e91136be2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:04.456493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:04.478697 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:04.505346 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d755380e27a489bb583813e91136be2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.512431 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d755380e27a489bb583813e91136be2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.524277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d755380e27a489bb583813e91136be2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.531780 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d755380e27a489bb583813e91136be2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.532390 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-8be9e270-c62f-40f9-9759-0e8576de0114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d755380e27a489bb583813e91136be2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.538347 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4514/9065] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:36:04 2022] DELETE /identity/v3/users/9d755380e27a489bb583813e91136be2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:36:04.719843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:04.721339 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:04.735775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb956c-65e4-40d9-ae09-04ecba7e1022 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:04.793478 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:04.794471 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:04.794700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:04.794985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] PATH_INFO: `/v3/projects/47fd00939f154bb392cb5420ea75abb3` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:04.796157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=47fd00939f154bb392cb5420ea75abb3)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:04.798120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:04.847781 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47fd00939f154bb392cb5420ea75abb3', 'request_id': 'req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.854005 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47fd00939f154bb392cb5420ea75abb3', 'request_id': 'req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.864133 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47fd00939f154bb392cb5420ea75abb3', 'request_id': 'req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.875209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] The token cache is being invalidate because project 47fd00939f154bb392cb5420ea75abb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:36:04.875494 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.876130 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-ac5db8e5-357a-4359-bb50-07c2bf83bc3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:36:04.877619 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4552/9066] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:36:04 2022] DELETE /identity/v3/projects/47fd00939f154bb392cb5420ea75abb3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:36:04.884775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a7768-7630-40d9-8c94-efab99c43d54 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:04.885267 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a7768-7630-40d9-8c94-efab99c43d54 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:04.885383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a7768-7630-40d9-8c94-efab99c43d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:04.949651 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7e0a7768-7630-40d9-8c94-efab99c43d54 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:36:04.950919 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7e0a7768-7630-40d9-8c94-efab99c43d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:05.016884 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4515/9067] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:36:05.026569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac573c-8146-467e-b557-5dbf0fcf8a22 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.026933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac573c-8146-467e-b557-5dbf0fcf8a22 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.027300 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac573c-8146-467e-b557-5dbf0fcf8a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.050048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-dfac573c-8146-467e-b557-5dbf0fcf8a22 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:36:05.051276 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-dfac573c-8146-467e-b557-5dbf0fcf8a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:05.061209 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4553/9068] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:36:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:36:05.065718 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a7768-7630-40d9-8c94-efab99c43d54 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.076885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a7768-7630-40d9-8c94-efab99c43d54 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.082705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862ac2c-7d8a-46a5-82f8-9a13df655fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.083312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ac2c-7d8a-46a5-82f8-9a13df655fbe admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.083585 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ac2c-7d8a-46a5-82f8-9a13df655fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.083851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862ac2c-7d8a-46a5-82f8-9a13df655fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.084496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862ac2c-7d8a-46a5-82f8-9a13df655fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82099) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:36:05.084782 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862ac2c-7d8a-46a5-82f8-9a13df655fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.086445 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862ac2c-7d8a-46a5-82f8-9a13df655fbe admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.098992 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4516/9069] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:36:05.105136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac573c-8146-467e-b557-5dbf0fcf8a22 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.115187 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac573c-8146-467e-b557-5dbf0fcf8a22 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.121799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e5bfb-5210-490b-84dc-78cc0c75364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.122705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e5bfb-5210-490b-84dc-78cc0c75364b admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.123067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e5bfb-5210-490b-84dc-78cc0c75364b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.123341 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e5bfb-5210-490b-84dc-78cc0c75364b admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.123982 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e5bfb-5210-490b-84dc-78cc0c75364b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.125909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e5bfb-5210-490b-84dc-78cc0c75364b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.167267 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4554/9070] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:36:05 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:36:05.173181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862ac2c-7d8a-46a5-82f8-9a13df655fbe admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.184149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862ac2c-7d8a-46a5-82f8-9a13df655fbe admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.238080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:05.245204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbb500-50a0-4863-b04c-5a82474c79d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.245855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbb500-50a0-4863-b04c-5a82474c79d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.246168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbb500-50a0-4863-b04c-5a82474c79d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.246448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbb500-50a0-4863-b04c-5a82474c79d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.247424 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbb500-50a0-4863-b04c-5a82474c79d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.250060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbb500-50a0-4863-b04c-5a82474c79d1 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.275228 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4517/9071] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:36:05 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:36:05.279699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e5bfb-5210-490b-84dc-78cc0c75364b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.291299 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e5bfb-5210-490b-84dc-78cc0c75364b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.297190 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea026b-2197-41e6-9ed8-e7f9ed9a261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.297817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea026b-2197-41e6-9ed8-e7f9ed9a261b admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.298105 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea026b-2197-41e6-9ed8-e7f9ed9a261b admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.298369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea026b-2197-41e6-9ed8-e7f9ed9a261b admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.299012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea026b-2197-41e6-9ed8-e7f9ed9a261b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.300622 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea026b-2197-41e6-9ed8-e7f9ed9a261b admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.310830 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4555/9072] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:36:05.315089 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbb500-50a0-4863-b04c-5a82474c79d1 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.326065 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbb500-50a0-4863-b04c-5a82474c79d1 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.331595 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f207733-3dbb-45c2-abc9-8143bb13ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.332223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207733-3dbb-45c2-abc9-8143bb13ef68 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.332498 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207733-3dbb-45c2-abc9-8143bb13ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.332770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207733-3dbb-45c2-abc9-8143bb13ef68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.333440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f207733-3dbb-45c2-abc9-8143bb13ef68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.335112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f207733-3dbb-45c2-abc9-8143bb13ef68 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.346205 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4518/9073] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:36:05.350500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea026b-2197-41e6-9ed8-e7f9ed9a261b admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.360633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea026b-2197-41e6-9ed8-e7f9ed9a261b admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.365314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d84c9-ab2d-46de-8386-89ec2c8c3ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.365991 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d84c9-ab2d-46de-8386-89ec2c8c3ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.366264 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d84c9-ab2d-46de-8386-89ec2c8c3ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.366530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d84c9-ab2d-46de-8386-89ec2c8c3ef8 admin admin] PATH_INFO: `/v3/projects/bbaba3f748a6486d80cfd7a60e58c217/users/c5fd99c5cc3e469e862b77c12053508a/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.381625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d84c9-ab2d-46de-8386-89ec2c8c3ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbaba3f748a6486d80cfd7a60e58c217, user_id=c5fd99c5cc3e469e862b77c12053508a, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.384310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d84c9-ab2d-46de-8386-89ec2c8c3ef8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.394050 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:05.400460 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4556/9074] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:36:05 2022] PUT /identity/v3/projects/bbaba3f748a6486d80cfd7a60e58c217/users/c5fd99c5cc3e469e862b77c12053508a/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:36:05.411706 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544ee6f-1cd3-4fc7-9121-9c5300fb00f8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.412070 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544ee6f-1cd3-4fc7-9121-9c5300fb00f8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.412461 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544ee6f-1cd3-4fc7-9121-9c5300fb00f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.443997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-5544ee6f-1cd3-4fc7-9121-9c5300fb00f8 None None] MFA Rules not processed for user `c5fd99c5cc3e469e862b77c12053508a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:36:05.445223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-5544ee6f-1cd3-4fc7-9121-9c5300fb00f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:05.515972 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4519/9075] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:36:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:36:05.522830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d84c9-ab2d-46de-8386-89ec2c8c3ef8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.599924 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d84c9-ab2d-46de-8386-89ec2c8c3ef8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.605928 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caffd7-10c3-4982-8d29-5f37562c6175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.606985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caffd7-10c3-4982-8d29-5f37562c6175 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.607263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caffd7-10c3-4982-8d29-5f37562c6175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.607537 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18caffd7-10c3-4982-8d29-5f37562c6175 admin admin] PATH_INFO: `/v3/projects` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.608178 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caffd7-10c3-4982-8d29-5f37562c6175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.610254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18caffd7-10c3-4982-8d29-5f37562c6175 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.643708 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4557/9076] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:36:05 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:36:05.649937 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544ee6f-1cd3-4fc7-9121-9c5300fb00f8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.663115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544ee6f-1cd3-4fc7-9121-9c5300fb00f8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.722874 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7a251-e35b-48e1-8983-ccea6d17d14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.723495 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7a251-e35b-48e1-8983-ccea6d17d14c admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.723769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7a251-e35b-48e1-8983-ccea6d17d14c admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.724035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7a251-e35b-48e1-8983-ccea6d17d14c admin admin] PATH_INFO: `/v3/users` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.724667 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7a251-e35b-48e1-8983-ccea6d17d14c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.726649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7a251-e35b-48e1-8983-ccea6d17d14c admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.751289 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4520/9077] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:36:05 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:36:05.755549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caffd7-10c3-4982-8d29-5f37562c6175 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.766775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18caffd7-10c3-4982-8d29-5f37562c6175 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.772619 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca984-d94b-443e-93b6-56ddfb11d1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.773232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca984-d94b-443e-93b6-56ddfb11d1ee admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.773508 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca984-d94b-443e-93b6-56ddfb11d1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.773772 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ca984-d94b-443e-93b6-56ddfb11d1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.774442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ca984-d94b-443e-93b6-56ddfb11d1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.776080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ca984-d94b-443e-93b6-56ddfb11d1ee admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.787611 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4558/9078] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:36:05.792030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7a251-e35b-48e1-8983-ccea6d17d14c admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.802854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7a251-e35b-48e1-8983-ccea6d17d14c admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.808100 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9859-7247-4037-9bef-26d268c64420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.808757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9859-7247-4037-9bef-26d268c64420 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.809037 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9859-7247-4037-9bef-26d268c64420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.809310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9859-7247-4037-9bef-26d268c64420 admin admin] PATH_INFO: `/v3/projects/96c34ccb2f294a939d84a4038a904c7c/users/fba80788929b4f8cb8bedf2d57641abd/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.826231 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b9859-7247-4037-9bef-26d268c64420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c34ccb2f294a939d84a4038a904c7c, user_id=fba80788929b4f8cb8bedf2d57641abd, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.829228 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b9859-7247-4037-9bef-26d268c64420 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.844316 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4521/9079] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:36:05 2022] PUT /identity/v3/projects/96c34ccb2f294a939d84a4038a904c7c/users/fba80788929b4f8cb8bedf2d57641abd/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:36:05.850374 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca984-d94b-443e-93b6-56ddfb11d1ee admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.861224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ca984-d94b-443e-93b6-56ddfb11d1ee admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.934998 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11f41b-4266-4798-962b-343edf458f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.935621 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f41b-4266-4798-962b-343edf458f57 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.935894 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f41b-4266-4798-962b-343edf458f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.936161 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11f41b-4266-4798-962b-343edf458f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.936808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11f41b-4266-4798-962b-343edf458f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.938439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11f41b-4266-4798-962b-343edf458f57 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.951021 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4559/9080] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:36:05.956282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9859-7247-4037-9bef-26d268c64420 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:05.970619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9859-7247-4037-9bef-26d268c64420 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:05.977082 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646421e-d09e-4efd-a8e5-9c9ab933e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:05.977735 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646421e-d09e-4efd-a8e5-9c9ab933e471 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:05.978042 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646421e-d09e-4efd-a8e5-9c9ab933e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:05.978290 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e646421e-d09e-4efd-a8e5-9c9ab933e471 admin admin] PATH_INFO: `/v3/projects/96c34ccb2f294a939d84a4038a904c7c/users/fba80788929b4f8cb8bedf2d57641abd/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:05.980762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646421e-d09e-4efd-a8e5-9c9ab933e471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c34ccb2f294a939d84a4038a904c7c, user_id=fba80788929b4f8cb8bedf2d57641abd, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:05.983443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e646421e-d09e-4efd-a8e5-9c9ab933e471 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:05.994256 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4522/9081] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:36:05 2022] PUT /identity/v3/projects/96c34ccb2f294a939d84a4038a904c7c/users/fba80788929b4f8cb8bedf2d57641abd/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:36:06.004978 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189d1f-4487-41e5-915e-60576b3ab686 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:06.005353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189d1f-4487-41e5-915e-60576b3ab686 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:06.005792 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba189d1f-4487-41e5-915e-60576b3ab686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:06.037337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ba189d1f-4487-41e5-915e-60576b3ab686 None None] MFA Rules not processed for user `fba80788929b4f8cb8bedf2d57641abd`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:36:06.038586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ba189d1f-4487-41e5-915e-60576b3ab686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:06.104152 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:06.116235 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4560/9082] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:36:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:36:06.131313 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646421e-d09e-4efd-a8e5-9c9ab933e471 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:06.133398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e646421e-d09e-4efd-a8e5-9c9ab933e471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:06.159763 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:06.226834 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e646421e-d09e-4efd-a8e5-9c9ab933e471 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:06.234433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918d169-ff14-49a7-aac0-9374a157fd98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:06.235060 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d169-ff14-49a7-aac0-9374a157fd98 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:06.235365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d169-ff14-49a7-aac0-9374a157fd98 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:06.235630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918d169-ff14-49a7-aac0-9374a157fd98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:06.299917 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918d169-ff14-49a7-aac0-9374a157fd98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:06.301533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918d169-ff14-49a7-aac0-9374a157fd98 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:06.311534 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4523/9083] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:36:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:36:10.179716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba189d1f-4487-41e5-915e-60576b3ab686 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:10.181425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ba189d1f-4487-41e5-915e-60576b3ab686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:10.254226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba189d1f-4487-41e5-915e-60576b3ab686 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:10.258009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428874a-5fe5-4cd4-8c9b-53c429e53e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:10.258630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428874a-5fe5-4cd4-8c9b-53c429e53e28 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:10.258908 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428874a-5fe5-4cd4-8c9b-53c429e53e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:10.259176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428874a-5fe5-4cd4-8c9b-53c429e53e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:10.268674 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428874a-5fe5-4cd4-8c9b-53c429e53e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:10.270189 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428874a-5fe5-4cd4-8c9b-53c429e53e28 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:10.280552 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4561/9084] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:36:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:36:13.432429 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec6e7-6949-499a-b8f7-2f0257cc474a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:13.432888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec6e7-6949-499a-b8f7-2f0257cc474a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:13.432996 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ec6e7-6949-499a-b8f7-2f0257cc474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:13.456623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-ab4ec6e7-6949-499a-b8f7-2f0257cc474a None None] MFA Rules not processed for user `c5fd99c5cc3e469e862b77c12053508a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:36:13.457941 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ab4ec6e7-6949-499a-b8f7-2f0257cc474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:13.465109 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4524/9085] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:36:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:36:14.297312 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428874a-5fe5-4cd4-8c9b-53c429e53e28 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:14.299013 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1428874a-5fe5-4cd4-8c9b-53c429e53e28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:14.375705 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428874a-5fe5-4cd4-8c9b-53c429e53e28 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:14.381060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766899c-ebb3-4f64-ab02-0d3071ad3828 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:14.381814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766899c-ebb3-4f64-ab02-0d3071ad3828 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:14.382120 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766899c-ebb3-4f64-ab02-0d3071ad3828 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:14.382380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766899c-ebb3-4f64-ab02-0d3071ad3828 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:14.384087 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d766899c-ebb3-4f64-ab02-0d3071ad3828 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:14.396774 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766899c-ebb3-4f64-ab02-0d3071ad3828 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:14.399675 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766899c-ebb3-4f64-ab02-0d3071ad3828 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:14.409433 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4562/9086] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:36:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:36:16.469565 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec6e7-6949-499a-b8f7-2f0257cc474a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:36:16.471380 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ab4ec6e7-6949-499a-b8f7-2f0257cc474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:16.484420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4ec6e7-6949-499a-b8f7-2f0257cc474a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:36:16.489008 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b627-05f7-4ccf-95bb-727fbb1d66f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:36:16.489712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b627-05f7-4ccf-95bb-727fbb1d66f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:36:16.490081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b627-05f7-4ccf-95bb-727fbb1d66f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:36:16.490418 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95b627-05f7-4ccf-95bb-727fbb1d66f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:36:16.492302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9d95b627-05f7-4ccf-95bb-727fbb1d66f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:36:16.503275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95b627-05f7-4ccf-95bb-727fbb1d66f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:36:16.504724 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95b627-05f7-4ccf-95bb-727fbb1d66f9 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:36:16.514056 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4525/9087] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:36:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:36:24.404898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=66 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:26.509930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=62 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:37:16.968542 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1616a-835d-4619-859a-2f37302ee2be None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:37:16.969025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1616a-835d-4619-859a-2f37302ee2be None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:37:16.969025 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1616a-835d-4619-859a-2f37302ee2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:37:16.989548 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-efe1616a-835d-4619-859a-2f37302ee2be None None] MFA Rules not processed for user `c5fd99c5cc3e469e862b77c12053508a`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:37:16.991113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-efe1616a-835d-4619-859a-2f37302ee2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:37:16.998451 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4563/9088] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:37:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:37:17.354106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b627-05f7-4ccf-95bb-727fbb1d66f9 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:37:17.363797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95b627-05f7-4ccf-95bb-727fbb1d66f9 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:37:17.368594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37e960-a35b-4918-a649-643ce72920de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:37:17.369249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37e960-a35b-4918-a649-643ce72920de service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:37:17.369501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37e960-a35b-4918-a649-643ce72920de service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:37:17.369790 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37e960-a35b-4918-a649-643ce72920de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:37:17.372216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-fe37e960-a35b-4918-a649-643ce72920de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:37:17.384105 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37e960-a35b-4918-a649-643ce72920de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:37:17.385858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37e960-a35b-4918-a649-643ce72920de service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:37:17.395409 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4526/9089] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:37:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:37:26.984113 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:37:27.391075 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:36.214282 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1616a-835d-4619-859a-2f37302ee2be None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:38:36.226180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1616a-835d-4619-859a-2f37302ee2be None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:38:36.231145 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c01e2-23b9-4709-adfa-afe865b480a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:38:36.231804 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c01e2-23b9-4709-adfa-afe865b480a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:38:36.232101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c01e2-23b9-4709-adfa-afe865b480a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:38:36.232358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c01e2-23b9-4709-adfa-afe865b480a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:38:36.234240 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6b4c01e2-23b9-4709-adfa-afe865b480a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:38:36.249544 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c01e2-23b9-4709-adfa-afe865b480a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:38:36.251038 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c01e2-23b9-4709-adfa-afe865b480a3 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:38:36.251275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37e960-a35b-4918-a649-643ce72920de service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:38:36.260412 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37e960-a35b-4918-a649-643ce72920de service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:38:36.262840 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4564/9090] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:38:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:38:36.264598 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11db504-c743-47bb-a9cc-e5660dcc5b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:38:36.265194 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11db504-c743-47bb-a9cc-e5660dcc5b2a service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:38:36.265512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11db504-c743-47bb-a9cc-e5660dcc5b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:38:36.265775 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11db504-c743-47bb-a9cc-e5660dcc5b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:38:36.267734 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a11db504-c743-47bb-a9cc-e5660dcc5b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:38:36.278204 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11db504-c743-47bb-a9cc-e5660dcc5b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:38:36.279664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11db504-c743-47bb-a9cc-e5660dcc5b2a service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:38:36.288658 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4527/9091] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:38:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:38:37.463441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c01e2-23b9-4709-adfa-afe865b480a3 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:38:37.477844 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c01e2-23b9-4709-adfa-afe865b480a3 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:38:37.484598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840c942-0b3a-4696-bb43-6984bf646703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:38:37.485465 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840c942-0b3a-4696-bb43-6984bf646703 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:38:37.485755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840c942-0b3a-4696-bb43-6984bf646703 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:38:37.486081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840c942-0b3a-4696-bb43-6984bf646703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:38:37.489278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1840c942-0b3a-4696-bb43-6984bf646703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:38:37.508523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840c942-0b3a-4696-bb43-6984bf646703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:38:37.509990 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840c942-0b3a-4696-bb43-6984bf646703 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:38:37.521545 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4565/9092] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:38:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:38:46.284890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:47.516162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=12 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:39:44.701561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11db504-c743-47bb-a9cc-e5660dcc5b2a service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:39:44.704247 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a11db504-c743-47bb-a9cc-e5660dcc5b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:39:44.724373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11db504-c743-47bb-a9cc-e5660dcc5b2a service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:39:44.730131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba325087-c1f7-4746-9ec4-fbb34d91ad1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:39:44.730779 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba325087-c1f7-4746-9ec4-fbb34d91ad1e service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:39:44.731062 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba325087-c1f7-4746-9ec4-fbb34d91ad1e service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:39:44.731329 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba325087-c1f7-4746-9ec4-fbb34d91ad1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:39:44.733210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-ba325087-c1f7-4746-9ec4-fbb34d91ad1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:39:44.745674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba325087-c1f7-4746-9ec4-fbb34d91ad1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:39:44.747752 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba325087-c1f7-4746-9ec4-fbb34d91ad1e service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:39:44.758731 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4528/9093] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:39:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:39:47.192012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840c942-0b3a-4696-bb43-6984bf646703 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:39:47.204006 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840c942-0b3a-4696-bb43-6984bf646703 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:39:47.210731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9b5c9-bd93-468f-9d03-189544b7a3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:39:47.211616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b5c9-bd93-468f-9d03-189544b7a3a6 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:39:47.212089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b5c9-bd93-468f-9d03-189544b7a3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:39:47.212558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b5c9-bd93-468f-9d03-189544b7a3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:39:47.215453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d6e9b5c9-bd93-468f-9d03-189544b7a3a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:39:47.228961 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9b5c9-bd93-468f-9d03-189544b7a3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:39:47.230614 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9b5c9-bd93-468f-9d03-189544b7a3a6 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:39:47.243883 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4566/9094] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:39:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:39:54.754299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:39:57.238897 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:39:58.899999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed674db-9998-4177-afc3-48d628593a2a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:39:58.901050 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed674db-9998-4177-afc3-48d628593a2a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:39:58.901324 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed674db-9998-4177-afc3-48d628593a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:39:58.926826 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7ed674db-9998-4177-afc3-48d628593a2a None None] MFA Rules not processed for user `c5fd99c5cc3e469e862b77c12053508a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:39:58.928243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ed674db-9998-4177-afc3-48d628593a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:39:58.935712 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4529/9095] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:39:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:40:07.477400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9b5c9-bd93-468f-9d03-189544b7a3a6 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:40:07.489530 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9b5c9-bd93-468f-9d03-189544b7a3a6 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:40:07.495777 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b458d-accd-48fc-a0ba-5849ebc18662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:40:07.496404 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b458d-accd-48fc-a0ba-5849ebc18662 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:40:07.496682 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b458d-accd-48fc-a0ba-5849ebc18662 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:40:07.496954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b458d-accd-48fc-a0ba-5849ebc18662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:40:07.498817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-eb1b458d-accd-48fc-a0ba-5849ebc18662 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:40:07.513975 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b458d-accd-48fc-a0ba-5849ebc18662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:40:07.515878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b458d-accd-48fc-a0ba-5849ebc18662 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:40:07.528790 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4567/9096] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:40:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:40:08.921930 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:40:17.523239 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:40:39.746982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed674db-9998-4177-afc3-48d628593a2a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:40:39.772961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed674db-9998-4177-afc3-48d628593a2a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:40:39.778856 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8f246-bcf4-4b36-aada-830e3f1c4895 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:40:39.779474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8f246-bcf4-4b36-aada-830e3f1c4895 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:40:39.779755 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8f246-bcf4-4b36-aada-830e3f1c4895 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:40:39.780027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8f246-bcf4-4b36-aada-830e3f1c4895 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:40:39.782011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4fb8f246-bcf4-4b36-aada-830e3f1c4895 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:40:39.794517 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8f246-bcf4-4b36-aada-830e3f1c4895 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:40:39.796310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8f246-bcf4-4b36-aada-830e3f1c4895 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:40:39.806686 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4530/9097] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:40:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:40:44.162909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b458d-accd-48fc-a0ba-5849ebc18662 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:40:44.172671 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b458d-accd-48fc-a0ba-5849ebc18662 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:40:44.177582 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ec567-5daa-4016-9cf3-f60ffc15f657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:40:44.178232 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ec567-5daa-4016-9cf3-f60ffc15f657 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:40:44.178505 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ec567-5daa-4016-9cf3-f60ffc15f657 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:40:44.178891 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ec567-5daa-4016-9cf3-f60ffc15f657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:40:44.181789 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fa3ec567-5daa-4016-9cf3-f60ffc15f657 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:40:44.197060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ec567-5daa-4016-9cf3-f60ffc15f657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:40:44.198625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ec567-5daa-4016-9cf3-f60ffc15f657 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:40:44.206996 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4568/9098] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:40:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:40:44.348220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7498ef2-20af-4db1-8899-d7bd61f6def4 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:40:44.349131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7498ef2-20af-4db1-8899-d7bd61f6def4 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:40:44.349414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7498ef2-20af-4db1-8899-d7bd61f6def4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:40:44.388399 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b7498ef2-20af-4db1-8899-d7bd61f6def4 None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:40:44.389529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b7498ef2-20af-4db1-8899-d7bd61f6def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:40:44.397774 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4531/9099] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:40:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:40:44.410449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ec567-5daa-4016-9cf3-f60ffc15f657 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:40:44.419439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ec567-5daa-4016-9cf3-f60ffc15f657 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:40:44.423701 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac6149-dcb7-4ba4-9f67-8d8de226aa94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:40:44.424308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac6149-dcb7-4ba4-9f67-8d8de226aa94 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:40:44.424586 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac6149-dcb7-4ba4-9f67-8d8de226aa94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:40:44.424856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac6149-dcb7-4ba4-9f67-8d8de226aa94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:40:44.432638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac6149-dcb7-4ba4-9f67-8d8de226aa94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:40:44.434131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac6149-dcb7-4ba4-9f67-8d8de226aa94 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:40:44.442727 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4569/9100] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:40:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:40:44.542824 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7498ef2-20af-4db1-8899-d7bd61f6def4 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:40:44.564766 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7498ef2-20af-4db1-8899-d7bd61f6def4 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:40:44.570743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620f708-a53f-4994-843f-65c10e0499e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:40:44.571353 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620f708-a53f-4994-843f-65c10e0499e4 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:40:44.571632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620f708-a53f-4994-843f-65c10e0499e4 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:40:44.571881 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620f708-a53f-4994-843f-65c10e0499e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:40:44.573655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d620f708-a53f-4994-843f-65c10e0499e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:40:44.585612 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620f708-a53f-4994-843f-65c10e0499e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:40:44.587264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620f708-a53f-4994-843f-65c10e0499e4 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:40:44.597208 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4532/9101] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:40:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:40:44.780294 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b884d8-f2da-418e-92b2-a5d30c8274c9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:40:44.780735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b884d8-f2da-418e-92b2-a5d30c8274c9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:40:44.781153 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b884d8-f2da-418e-92b2-a5d30c8274c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:40:44.829865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-f3b884d8-f2da-418e-92b2-a5d30c8274c9 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:40:44.832911 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f3b884d8-f2da-418e-92b2-a5d30c8274c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:40:44.848288 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4570/9102] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:40:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:40:44.862836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620f708-a53f-4994-843f-65c10e0499e4 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:40:44.873643 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620f708-a53f-4994-843f-65c10e0499e4 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:40:44.878438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ed123-63b6-4f50-bf2b-3b65eb601da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:40:44.879044 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ed123-63b6-4f50-bf2b-3b65eb601da3 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:40:44.879320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ed123-63b6-4f50-bf2b-3b65eb601da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:40:44.879587 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ed123-63b6-4f50-bf2b-3b65eb601da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:40:44.892139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ed123-63b6-4f50-bf2b-3b65eb601da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:40:44.893677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ed123-63b6-4f50-bf2b-3b65eb601da3 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:40:44.905455 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4533/9103] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:40:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:40:44.976073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b884d8-f2da-418e-92b2-a5d30c8274c9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:40:44.988681 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b884d8-f2da-418e-92b2-a5d30c8274c9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:40:44.995289 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418bf21-b1dc-4aff-90ad-0b991e906bfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:40:44.995929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418bf21-b1dc-4aff-90ad-0b991e906bfb service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:40:44.996225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418bf21-b1dc-4aff-90ad-0b991e906bfb service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:40:44.996491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418bf21-b1dc-4aff-90ad-0b991e906bfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:40:44.998680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1418bf21-b1dc-4aff-90ad-0b991e906bfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:40:45.011228 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418bf21-b1dc-4aff-90ad-0b991e906bfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:40:45.012900 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418bf21-b1dc-4aff-90ad-0b991e906bfb service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:40:45.023238 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4571/9104] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:40:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:40:53.517708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ed123-63b6-4f50-bf2b-3b65eb601da3 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:40:53.534841 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ed123-63b6-4f50-bf2b-3b65eb601da3 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:40:53.543139 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eac75-c663-468f-bc29-07ef6963c432 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:40:53.543741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eac75-c663-468f-bc29-07ef6963c432 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:40:53.544001 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eac75-c663-468f-bc29-07ef6963c432 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:40:53.544310 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eac75-c663-468f-bc29-07ef6963c432 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:40:53.546304 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-3c9eac75-c663-468f-bc29-07ef6963c432 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:40:53.558296 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9eac75-c663-468f-bc29-07ef6963c432 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:40:53.559901 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9eac75-c663-468f-bc29-07ef6963c432 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:40:53.572741 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4534/9105] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:40:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:40:55.018974 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=27 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:41:03.567793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=37 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:41:07.069758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418bf21-b1dc-4aff-90ad-0b991e906bfb service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:41:07.085140 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418bf21-b1dc-4aff-90ad-0b991e906bfb service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:41:07.092157 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510326f-f410-4af9-bd0c-db48b85ab8c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:41:07.092770 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510326f-f410-4af9-bd0c-db48b85ab8c1 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:41:07.093048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510326f-f410-4af9-bd0c-db48b85ab8c1 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:41:07.093314 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510326f-f410-4af9-bd0c-db48b85ab8c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:41:07.101388 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510326f-f410-4af9-bd0c-db48b85ab8c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:41:07.103060 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510326f-f410-4af9-bd0c-db48b85ab8c1 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:41:07.112446 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4572/9106] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:41:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:41:17.108658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:42:13.091327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eac75-c663-468f-bc29-07ef6963c432 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:42:13.106774 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eac75-c663-468f-bc29-07ef6963c432 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:42:13.113081 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df423f9c-b52f-42e6-9dda-9ddd12c12cda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:42:13.113708 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df423f9c-b52f-42e6-9dda-9ddd12c12cda service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:42:13.114199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df423f9c-b52f-42e6-9dda-9ddd12c12cda service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:42:13.114475 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df423f9c-b52f-42e6-9dda-9ddd12c12cda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:42:13.116239 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-df423f9c-b52f-42e6-9dda-9ddd12c12cda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:42:13.131027 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df423f9c-b52f-42e6-9dda-9ddd12c12cda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:42:13.132911 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df423f9c-b52f-42e6-9dda-9ddd12c12cda service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:42:13.152055 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4535/9107] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:42:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:42:17.155857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510326f-f410-4af9-bd0c-db48b85ab8c1 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:42:17.166630 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510326f-f410-4af9-bd0c-db48b85ab8c1 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:42:17.170959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d197f-4c19-477f-a685-01c66c7cb170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:42:17.171579 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d197f-4c19-477f-a685-01c66c7cb170 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:42:17.171909 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d197f-4c19-477f-a685-01c66c7cb170 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:42:17.172184 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d197f-4c19-477f-a685-01c66c7cb170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:42:17.182224 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d197f-4c19-477f-a685-01c66c7cb170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:42:17.183687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d197f-4c19-477f-a685-01c66c7cb170 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:42:17.194553 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4573/9108] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:42:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:42:20.233570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920291-1e44-44d1-a720-8dd4e002775c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:42:20.234510 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920291-1e44-44d1-a720-8dd4e002775c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:42:20.235015 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920291-1e44-44d1-a720-8dd4e002775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:42:20.255335 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-0b920291-1e44-44d1-a720-8dd4e002775c None None] MFA Rules not processed for user `c5fd99c5cc3e469e862b77c12053508a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:42:20.256885 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0b920291-1e44-44d1-a720-8dd4e002775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:42:20.264305 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4536/9109] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:42:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:42:20.606424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d197f-4c19-477f-a685-01c66c7cb170 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:42:20.615528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d197f-4c19-477f-a685-01c66c7cb170 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:42:20.620100 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e6ad8-041f-4c51-b7d8-07002a9a95c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:42:20.620736 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e6ad8-041f-4c51-b7d8-07002a9a95c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:42:20.621011 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e6ad8-041f-4c51-b7d8-07002a9a95c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:42:20.621278 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e6ad8-041f-4c51-b7d8-07002a9a95c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:42:20.629044 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e6ad8-041f-4c51-b7d8-07002a9a95c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:42:20.630488 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e6ad8-041f-4c51-b7d8-07002a9a95c9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:42:20.643238 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4574/9110] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:42:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:42:20.975375 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920291-1e44-44d1-a720-8dd4e002775c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:42:20.991811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920291-1e44-44d1-a720-8dd4e002775c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:42:21.000287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d26db-9c22-47fb-ae7e-6ecd7e086c19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:42:21.000945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d26db-9c22-47fb-ae7e-6ecd7e086c19 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:42:21.001223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d26db-9c22-47fb-ae7e-6ecd7e086c19 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:42:21.001496 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d26db-9c22-47fb-ae7e-6ecd7e086c19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:42:21.012200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d26db-9c22-47fb-ae7e-6ecd7e086c19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:42:21.013832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d26db-9c22-47fb-ae7e-6ecd7e086c19 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:42:21.025439 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4537/9111] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:42:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:42:23.241706 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e6ad8-041f-4c51-b7d8-07002a9a95c9 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:42:23.251242 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e6ad8-041f-4c51-b7d8-07002a9a95c9 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:42:23.255162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97a192-8d65-417d-9bb5-ce8df07349aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:42:23.256131 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a192-8d65-417d-9bb5-ce8df07349aa service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:42:23.256510 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a192-8d65-417d-9bb5-ce8df07349aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:42:23.256878 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97a192-8d65-417d-9bb5-ce8df07349aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:42:23.265662 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97a192-8d65-417d-9bb5-ce8df07349aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:42:23.267441 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97a192-8d65-417d-9bb5-ce8df07349aa service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:42:23.281017 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4575/9112] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:42:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:42:31.020224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=15 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:42:33.272930 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=18 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:45.585407 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d26db-9c22-47fb-ae7e-6ecd7e086c19 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:43:45.624756 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d26db-9c22-47fb-ae7e-6ecd7e086c19 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:43:45.628501 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89147d1-575a-44bd-9600-7298761260f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:43:45.629116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89147d1-575a-44bd-9600-7298761260f2 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:43:45.630085 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89147d1-575a-44bd-9600-7298761260f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:43:45.630398 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89147d1-575a-44bd-9600-7298761260f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:43:45.665729 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89147d1-575a-44bd-9600-7298761260f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:43:45.667248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89147d1-575a-44bd-9600-7298761260f2 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:43:45.689248 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4538/9113] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:43:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:43:46.887423 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97a192-8d65-417d-9bb5-ce8df07349aa service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:43:46.922174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97a192-8d65-417d-9bb5-ce8df07349aa service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:43:46.926219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d049789-a79d-4f94-9e37-8f977e0ccabf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:43:46.926834 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d049789-a79d-4f94-9e37-8f977e0ccabf service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:43:46.927112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d049789-a79d-4f94-9e37-8f977e0ccabf service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:43:46.927380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d049789-a79d-4f94-9e37-8f977e0ccabf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:43:46.939593 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d049789-a79d-4f94-9e37-8f977e0ccabf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:43:46.941072 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d049789-a79d-4f94-9e37-8f977e0ccabf service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:43:46.952595 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4576/9114] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:43:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:43:55.686568 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=31 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:56.947571 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=15 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:58.220000 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880ca31-ee4a-4185-b87a-359b968fcadc None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:43:58.220673 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880ca31-ee4a-4185-b87a-359b968fcadc None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:43:58.220985 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880ca31-ee4a-4185-b87a-359b968fcadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:43:58.257589 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9880ca31-ee4a-4185-b87a-359b968fcadc None None] MFA Rules not processed for user `c5fd99c5cc3e469e862b77c12053508a`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:43:58.259052 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9880ca31-ee4a-4185-b87a-359b968fcadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:43:58.268340 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4539/9115] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:43:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:44:08.251525 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=7 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:44:45.798370 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d049789-a79d-4f94-9e37-8f977e0ccabf service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:45.809782 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d049789-a79d-4f94-9e37-8f977e0ccabf service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:45.815261 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efb0a8-73ea-4d49-ba38-7efda002de2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:45.815874 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb0a8-73ea-4d49-ba38-7efda002de2c service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:45.816147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb0a8-73ea-4d49-ba38-7efda002de2c service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:45.816412 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efb0a8-73ea-4d49-ba38-7efda002de2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:45.827711 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efb0a8-73ea-4d49-ba38-7efda002de2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:45.827953 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efb0a8-73ea-4d49-ba38-7efda002de2c service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:45.839563 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4577/9116] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:44:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:44:52.679262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880ca31-ee4a-4185-b87a-359b968fcadc None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:52.680845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9880ca31-ee4a-4185-b87a-359b968fcadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:52.697808 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9880ca31-ee4a-4185-b87a-359b968fcadc None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:52.704519 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dfd9d-d967-47a9-bf37-c648caee2f11 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:52.705148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dfd9d-d967-47a9-bf37-c648caee2f11 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:52.705427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dfd9d-d967-47a9-bf37-c648caee2f11 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:52.705695 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dfd9d-d967-47a9-bf37-c648caee2f11 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:52.707604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-455dfd9d-d967-47a9-bf37-c648caee2f11 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:52.720295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dfd9d-d967-47a9-bf37-c648caee2f11 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:52.721910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dfd9d-d967-47a9-bf37-c648caee2f11 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:52.732967 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4540/9117] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:44:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:44:52.979421 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efb0a8-73ea-4d49-ba38-7efda002de2c service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:53.052940 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efb0a8-73ea-4d49-ba38-7efda002de2c service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:53.058260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:53.058917 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:53.059199 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:53.059470 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] PATH_INFO: `/v3/users/c5fd99c5cc3e469e862b77c12053508a` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:53.060616 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5fd99c5cc3e469e862b77c12053508a)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:53.062584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:53.117726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5fd99c5cc3e469e862b77c12053508a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.118426 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5fd99c5cc3e469e862b77c12053508a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.126378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5fd99c5cc3e469e862b77c12053508a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.139985 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5fd99c5cc3e469e862b77c12053508a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.153708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5fd99c5cc3e469e862b77c12053508a'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.159849 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4578/9118] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:44:52 2022] DELETE /identity/v3/users/c5fd99c5cc3e469e862b77c12053508a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:44:53.164640 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1272d7-cadc-4d18-9748-1b55c04d760a None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:53.164926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1272d7-cadc-4d18-9748-1b55c04d760a None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:53.165220 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1272d7-cadc-4d18-9748-1b55c04d760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:53.198184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-1c1272d7-cadc-4d18-9748-1b55c04d760a None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:44:53.199584 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1c1272d7-cadc-4d18-9748-1b55c04d760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:53.262227 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4541/9119] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:44:53.272745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:53.275150 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:53.339439 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262502ff-a667-40fe-9a07-59ff243b9827 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:53.344951 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1732e-04e9-4838-b0c4-033f570088b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:53.345576 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1732e-04e9-4838-b0c4-033f570088b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:53.345852 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1732e-04e9-4838-b0c4-033f570088b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:53.346146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1732e-04e9-4838-b0c4-033f570088b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:53.356457 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1732e-04e9-4838-b0c4-033f570088b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:53.358164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c1732e-04e9-4838-b0c4-033f570088b1 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:53.363707 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:44:53.369489 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4579/9120] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:44:53.553813 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1272d7-cadc-4d18-9748-1b55c04d760a None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:53.555291 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-1c1272d7-cadc-4d18-9748-1b55c04d760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:53.567812 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1272d7-cadc-4d18-9748-1b55c04d760a None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:53.573048 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:53.574348 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:53.574669 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:53.574915 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] PATH_INFO: `/v3/projects/bbaba3f748a6486d80cfd7a60e58c217` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:53.576056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbaba3f748a6486d80cfd7a60e58c217)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:53.578045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:53.627154 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbaba3f748a6486d80cfd7a60e58c217', 'request_id': 'req-209ea804-ae76-42bb-87e0-2da3340a937e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.635679 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbaba3f748a6486d80cfd7a60e58c217', 'request_id': 'req-209ea804-ae76-42bb-87e0-2da3340a937e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.643206 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbaba3f748a6486d80cfd7a60e58c217', 'request_id': 'req-209ea804-ae76-42bb-87e0-2da3340a937e'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.655071 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] The token cache is being invalidate because project bbaba3f748a6486d80cfd7a60e58c217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:44:53.655384 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.656163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.657820 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4542/9121] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:44:53 2022] DELETE /identity/v3/projects/bbaba3f748a6486d80cfd7a60e58c217 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:44:53.663957 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1732e-04e9-4838-b0c4-033f570088b1 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:53.674540 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1732e-04e9-4838-b0c4-033f570088b1 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:53.733129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:53.733775 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:53.734138 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:53.734406 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] PATH_INFO: `/v3/users/fba80788929b4f8cb8bedf2d57641abd` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:53.735565 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba80788929b4f8cb8bedf2d57641abd)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:53.737525 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:53.786559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba80788929b4f8cb8bedf2d57641abd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.787292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba80788929b4f8cb8bedf2d57641abd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.794824 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba80788929b4f8cb8bedf2d57641abd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.803464 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba80788929b4f8cb8bedf2d57641abd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.815311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-9d7bff18-2bb1-4cb9-8a4c-135ee4f96aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba80788929b4f8cb8bedf2d57641abd'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:53.821553 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4580/9122] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:44:53 2022] DELETE /identity/v3/users/fba80788929b4f8cb8bedf2d57641abd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:44:54.105970 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:54.107629 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:54.123632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ea804-ae76-42bb-87e0-2da3340a937e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:54.182175 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:54.182769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.183094 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.183361 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] PATH_INFO: `/v3/projects/96c34ccb2f294a939d84a4038a904c7c` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.184481 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c34ccb2f294a939d84a4038a904c7c)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:54.186448 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:54.187888 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:44:54.245664 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c34ccb2f294a939d84a4038a904c7c', 'request_id': 'req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:54.255472 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c34ccb2f294a939d84a4038a904c7c', 'request_id': 'req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:54.262800 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c34ccb2f294a939d84a4038a904c7c', 'request_id': 'req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:54.276785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] The token cache is being invalidate because project 96c34ccb2f294a939d84a4038a904c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:44:54.277151 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:54.277969 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-5063d840-f065-4fd0-9e78-8fc1fc49c6f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:44:54.279483 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4543/9123] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:44:54 2022] DELETE /identity/v3/projects/96c34ccb2f294a939d84a4038a904c7c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:44:54.285067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846011-2a3b-4239-96d2-c55925e06dd9 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.285570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846011-2a3b-4239-96d2-c55925e06dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.285570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad846011-2a3b-4239-96d2-c55925e06dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.306487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-ad846011-2a3b-4239-96d2-c55925e06dd9 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:44:54.307740 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-ad846011-2a3b-4239-96d2-c55925e06dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:54.377514 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4581/9124] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:44:54.386521 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b928-9f4d-4a55-8ba2-105deed9ed03 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.386805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b928-9f4d-4a55-8ba2-105deed9ed03 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.387041 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b928-9f4d-4a55-8ba2-105deed9ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.408212 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-f9b8b928-9f4d-4a55-8ba2-105deed9ed03 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:44:54.409439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-f9b8b928-9f4d-4a55-8ba2-105deed9ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:54.418838 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4544/9125] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:44:54.423459 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad846011-2a3b-4239-96d2-c55925e06dd9 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:54.434054 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad846011-2a3b-4239-96d2-c55925e06dd9 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:54.439570 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b3dd5-ac5c-478a-b638-f8ea0e412916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:54.440180 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3dd5-ac5c-478a-b638-f8ea0e412916 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.440438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3dd5-ac5c-478a-b638-f8ea0e412916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.440709 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3dd5-ac5c-478a-b638-f8ea0e412916 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.441387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b3dd5-ac5c-478a-b638-f8ea0e412916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:44:54.441687 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b3dd5-ac5c-478a-b638-f8ea0e412916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:54.443322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b3dd5-ac5c-478a-b638-f8ea0e412916 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:54.456107 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4582/9126] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 05:44:54.460630 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b928-9f4d-4a55-8ba2-105deed9ed03 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:54.470581 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b928-9f4d-4a55-8ba2-105deed9ed03 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:54.477258 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b121f-3071-4be3-b104-c7108a7e2e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:54.477855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b121f-3071-4be3-b104-c7108a7e2e4a admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.478163 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b121f-3071-4be3-b104-c7108a7e2e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.478423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b121f-3071-4be3-b104-c7108a7e2e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.479053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b121f-3071-4be3-b104-c7108a7e2e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:54.481216 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b121f-3071-4be3-b104-c7108a7e2e4a admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:54.520012 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4545/9127] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:44:54 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:44:54.524293 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b3dd5-ac5c-478a-b638-f8ea0e412916 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:54.535209 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b3dd5-ac5c-478a-b638-f8ea0e412916 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:54.539597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:44:54.598828 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad4267-a0ab-49c9-a325-40e01e5892c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:54.599429 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad4267-a0ab-49c9-a325-40e01e5892c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.599710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad4267-a0ab-49c9-a325-40e01e5892c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.599973 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad4267-a0ab-49c9-a325-40e01e5892c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.600594 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad4267-a0ab-49c9-a325-40e01e5892c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:54.602555 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad4267-a0ab-49c9-a325-40e01e5892c9 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:54.625332 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4583/9128] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:44:54 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:44:54.629668 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b121f-3071-4be3-b104-c7108a7e2e4a admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:54.640649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b121f-3071-4be3-b104-c7108a7e2e4a admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:54.645468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7230a6d-0099-4539-ad0e-0c5005257738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:54.646119 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7230a6d-0099-4539-ad0e-0c5005257738 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.646396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7230a6d-0099-4539-ad0e-0c5005257738 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.646666 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7230a6d-0099-4539-ad0e-0c5005257738 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.647373 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7230a6d-0099-4539-ad0e-0c5005257738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:54.648997 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7230a6d-0099-4539-ad0e-0c5005257738 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:54.659273 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4546/9129] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:44:54.664118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad4267-a0ab-49c9-a325-40e01e5892c9 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:54.676434 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad4267-a0ab-49c9-a325-40e01e5892c9 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:54.681717 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88542d14-2fcc-423c-b0d8-3287c0bd3bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:54.682380 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88542d14-2fcc-423c-b0d8-3287c0bd3bea admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.682658 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88542d14-2fcc-423c-b0d8-3287c0bd3bea admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.683078 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88542d14-2fcc-423c-b0d8-3287c0bd3bea admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.683732 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88542d14-2fcc-423c-b0d8-3287c0bd3bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:54.685438 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88542d14-2fcc-423c-b0d8-3287c0bd3bea admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:54.696937 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4584/9130] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:44:54.701809 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7230a6d-0099-4539-ad0e-0c5005257738 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:54.712869 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7230a6d-0099-4539-ad0e-0c5005257738 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:54.718905 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af7092-d7bc-4e8c-83c6-300920032d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:54.719610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7092-d7bc-4e8c-83c6-300920032d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.719882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7092-d7bc-4e8c-83c6-300920032d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.720143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7092-d7bc-4e8c-83c6-300920032d3b admin admin] PATH_INFO: `/v3/projects/6a9d5abb7480400a863d905a6075b5c9/users/7da8ec6f938441b4a16dfb383e781fbe/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.737635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af7092-d7bc-4e8c-83c6-300920032d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9d5abb7480400a863d905a6075b5c9, user_id=7da8ec6f938441b4a16dfb383e781fbe, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:54.742034 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af7092-d7bc-4e8c-83c6-300920032d3b admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:54.757989 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4547/9131] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:44:54 2022] PUT /identity/v3/projects/6a9d5abb7480400a863d905a6075b5c9/users/7da8ec6f938441b4a16dfb383e781fbe/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:44:54.763668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73fad3-43ba-4d3c-baf2-b795592bb9b5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.763948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73fad3-43ba-4d3c-baf2-b795592bb9b5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.764218 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73fad3-43ba-4d3c-baf2-b795592bb9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.786156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-af73fad3-43ba-4d3c-baf2-b795592bb9b5 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:44:54.787783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-af73fad3-43ba-4d3c-baf2-b795592bb9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:54.862604 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4585/9132] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:44:54.872982 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af7092-d7bc-4e8c-83c6-300920032d3b admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:54.874927 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-82af7092-d7bc-4e8c-83c6-300920032d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:54.936039 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af7092-d7bc-4e8c-83c6-300920032d3b admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:54.940294 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec975-f541-45e2-a984-c10c7af4eaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:54.940895 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec975-f541-45e2-a984-c10c7af4eaab service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:54.941168 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec975-f541-45e2-a984-c10c7af4eaab service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:54.941433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ec975-f541-45e2-a984-c10c7af4eaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:54.951308 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ec975-f541-45e2-a984-c10c7af4eaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:54.952759 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ec975-f541-45e2-a984-c10c7af4eaab service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:54.962353 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4548/9133] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:44:58.846861 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b22ef-dd6e-412e-bc86-68bb80b7f6d5 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:58.847369 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b22ef-dd6e-412e-bc86-68bb80b7f6d5 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:58.847613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b22ef-dd6e-412e-bc86-68bb80b7f6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:58.879699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-067b22ef-dd6e-412e-bc86-68bb80b7f6d5 None None] MFA Rules not processed for user `7da8ec6f938441b4a16dfb383e781fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:44:58.880933 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-067b22ef-dd6e-412e-bc86-68bb80b7f6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:44:58.966085 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4586/9134] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:44:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:44:58.970958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec975-f541-45e2-a984-c10c7af4eaab service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:58.982213 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ec975-f541-45e2-a984-c10c7af4eaab service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:58.987218 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01685-c38a-4709-ade4-8d70210a3e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:58.987837 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01685-c38a-4709-ade4-8d70210a3e07 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:58.988111 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01685-c38a-4709-ade4-8d70210a3e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:58.988396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01685-c38a-4709-ade4-8d70210a3e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:58.989032 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b01685-c38a-4709-ade4-8d70210a3e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:58.991031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b01685-c38a-4709-ade4-8d70210a3e07 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:59.024282 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4549/9135] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:44:58 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:44:59.025615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b22ef-dd6e-412e-bc86-68bb80b7f6d5 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:59.037333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b22ef-dd6e-412e-bc86-68bb80b7f6d5 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:59.049865 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:44:59.098910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd0754-dc81-4657-b622-053866bc5eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:59.099539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd0754-dc81-4657-b622-053866bc5eae admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:59.099817 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd0754-dc81-4657-b622-053866bc5eae admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:59.100086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd0754-dc81-4657-b622-053866bc5eae admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:59.100733 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd0754-dc81-4657-b622-053866bc5eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:59.102727 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd0754-dc81-4657-b622-053866bc5eae admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:59.128892 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4587/9136] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:44:59 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:44:59.130365 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01685-c38a-4709-ade4-8d70210a3e07 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:59.141910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01685-c38a-4709-ade4-8d70210a3e07 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:59.146770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66da4a-d8c6-4ddd-8976-05682b21a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:59.147421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66da4a-d8c6-4ddd-8976-05682b21a09d admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:59.147702 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66da4a-d8c6-4ddd-8976-05682b21a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:59.148005 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66da4a-d8c6-4ddd-8976-05682b21a09d admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:59.148690 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66da4a-d8c6-4ddd-8976-05682b21a09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:59.150362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66da4a-d8c6-4ddd-8976-05682b21a09d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:59.151879 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:44:59.164552 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4550/9137] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:44:59.169002 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd0754-dc81-4657-b622-053866bc5eae admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:59.179884 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd0754-dc81-4657-b622-053866bc5eae admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:59.185210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0cc7d-e70b-4e8b-bca8-c032fcce9895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:59.185945 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0cc7d-e70b-4e8b-bca8-c032fcce9895 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:59.186198 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0cc7d-e70b-4e8b-bca8-c032fcce9895 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:59.186472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0cc7d-e70b-4e8b-bca8-c032fcce9895 admin admin] PATH_INFO: `/v3/projects/7b0d4f4e11784d80a4d9ff102ad04b5b/users/1584b53c248f43598a886e8c4041c561/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:59.203330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0cc7d-e70b-4e8b-bca8-c032fcce9895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0d4f4e11784d80a4d9ff102ad04b5b, user_id=1584b53c248f43598a886e8c4041c561, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:59.206202 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0cc7d-e70b-4e8b-bca8-c032fcce9895 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:59.221861 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4588/9138] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:44:59 2022] PUT /identity/v3/projects/7b0d4f4e11784d80a4d9ff102ad04b5b/users/1584b53c248f43598a886e8c4041c561/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:44:59.226170 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66da4a-d8c6-4ddd-8976-05682b21a09d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:59.237427 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66da4a-d8c6-4ddd-8976-05682b21a09d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:59.300106 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb1a7f-9c51-4147-9725-85bcbbbbd37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:59.300753 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1a7f-9c51-4147-9725-85bcbbbbd37f admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:59.301031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1a7f-9c51-4147-9725-85bcbbbbd37f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:59.301299 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb1a7f-9c51-4147-9725-85bcbbbbd37f admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:59.301945 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb1a7f-9c51-4147-9725-85bcbbbbd37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:59.303593 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb1a7f-9c51-4147-9725-85bcbbbbd37f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:59.318960 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4551/9139] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 05:44:59.324489 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0cc7d-e70b-4e8b-bca8-c032fcce9895 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:44:59.336304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0cc7d-e70b-4e8b-bca8-c032fcce9895 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:44:59.342104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6298c-a1b1-4f1f-b958-e4a8cb602709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:44:59.342783 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6298c-a1b1-4f1f-b958-e4a8cb602709 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:44:59.343063 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6298c-a1b1-4f1f-b958-e4a8cb602709 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:44:59.343324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6298c-a1b1-4f1f-b958-e4a8cb602709 admin admin] PATH_INFO: `/v3/projects/7b0d4f4e11784d80a4d9ff102ad04b5b/users/1584b53c248f43598a886e8c4041c561/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:44:59.345366 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6298c-a1b1-4f1f-b958-e4a8cb602709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0d4f4e11784d80a4d9ff102ad04b5b, user_id=1584b53c248f43598a886e8c4041c561, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:44:59.348055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6298c-a1b1-4f1f-b958-e4a8cb602709 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:44:59.359304 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4589/9140] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:44:59 2022] PUT /identity/v3/projects/7b0d4f4e11784d80a4d9ff102ad04b5b/users/1584b53c248f43598a886e8c4041c561/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:45:04.018101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dad81c-62f3-43d9-ad03-5184ee1af35b None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:45:04.018619 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dad81c-62f3-43d9-ad03-5184ee1af35b None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:45:04.018858 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dad81c-62f3-43d9-ad03-5184ee1af35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:45:04.066689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-80dad81c-62f3-43d9-ad03-5184ee1af35b None None] MFA Rules not processed for user `1584b53c248f43598a886e8c4041c561`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:45:04.068223 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-80dad81c-62f3-43d9-ad03-5184ee1af35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:45:04.159957 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4552/9141] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:45:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:45:04.178758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6298c-a1b1-4f1f-b958-e4a8cb602709 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:45:04.180567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4cc6298c-a1b1-4f1f-b958-e4a8cb602709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:45:04.279729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6298c-a1b1-4f1f-b958-e4a8cb602709 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:45:04.285589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f28c-e7a9-4990-bc97-2a01ee5e0fa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:45:04.286263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f28c-e7a9-4990-bc97-2a01ee5e0fa9 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:45:04.287182 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f28c-e7a9-4990-bc97-2a01ee5e0fa9 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:45:04.287463 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f28c-e7a9-4990-bc97-2a01ee5e0fa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:45:04.356888 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f28c-e7a9-4990-bc97-2a01ee5e0fa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:45:04.358787 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f28c-e7a9-4990-bc97-2a01ee5e0fa9 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:45:04.370639 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4590/9142] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:45:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:45:05.784717 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624be4-200f-4c95-898f-bea76ebe146c None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:45:05.785396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624be4-200f-4c95-898f-bea76ebe146c None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:45:05.785396 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4624be4-200f-4c95-898f-bea76ebe146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:45:05.804845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-d4624be4-200f-4c95-898f-bea76ebe146c None None] MFA Rules not processed for user `7da8ec6f938441b4a16dfb383e781fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:45:05.806109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d4624be4-200f-4c95-898f-bea76ebe146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:45:05.813423 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4553/9143] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:45:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:45:14.365111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:15.799486 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=68 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:16.792247 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f28c-e7a9-4990-bc97-2a01ee5e0fa9 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:45:16.793906 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4d41f28c-e7a9-4990-bc97-2a01ee5e0fa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:45:16.812111 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f28c-e7a9-4990-bc97-2a01ee5e0fa9 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:45:16.818254 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f538e-37f5-40dd-9840-7d75762d5b39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:45:16.819310 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f538e-37f5-40dd-9840-7d75762d5b39 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:45:16.819661 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f538e-37f5-40dd-9840-7d75762d5b39 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:45:16.819989 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f538e-37f5-40dd-9840-7d75762d5b39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:45:16.821800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-036f538e-37f5-40dd-9840-7d75762d5b39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:45:16.834292 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f538e-37f5-40dd-9840-7d75762d5b39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:45:16.835976 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f538e-37f5-40dd-9840-7d75762d5b39 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:45:16.846987 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4591/9144] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:45:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:45:19.430548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4624be4-200f-4c95-898f-bea76ebe146c None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:45:19.432130 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d4624be4-200f-4c95-898f-bea76ebe146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:45:19.492103 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4624be4-200f-4c95-898f-bea76ebe146c None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:45:19.498474 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd4484-6377-423f-968a-bc00139cba9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:45:19.499394 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd4484-6377-423f-968a-bc00139cba9e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:45:19.499794 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd4484-6377-423f-968a-bc00139cba9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:45:19.500845 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd4484-6377-423f-968a-bc00139cba9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:45:19.511674 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd4484-6377-423f-968a-bc00139cba9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:45:19.513344 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd4484-6377-423f-968a-bc00139cba9e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:45:19.524196 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4554/9145] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:45:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:45:21.517311 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f538e-37f5-40dd-9840-7d75762d5b39 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:45:21.529308 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f538e-37f5-40dd-9840-7d75762d5b39 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:45:21.535141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ab278-20b7-4ea0-911e-91cf9b24c6af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:45:21.536084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ab278-20b7-4ea0-911e-91cf9b24c6af service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:45:21.536084 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ab278-20b7-4ea0-911e-91cf9b24c6af service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:45:21.536324 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ab278-20b7-4ea0-911e-91cf9b24c6af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:45:21.538068 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-6d1ab278-20b7-4ea0-911e-91cf9b24c6af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:45:21.551035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ab278-20b7-4ea0-911e-91cf9b24c6af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:45:21.552649 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ab278-20b7-4ea0-911e-91cf9b24c6af service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:45:21.565590 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4592/9146] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:45:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:45:29.519478 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=26 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:31.560556 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=12 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:45.825819 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd4484-6377-423f-968a-bc00139cba9e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:45:45.827421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6bfd4484-6377-423f-968a-bc00139cba9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:45:45.901153 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd4484-6377-423f-968a-bc00139cba9e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:45:45.907694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5a76e-87ad-475f-b0d9-88e39862e2eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:45:45.908319 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5a76e-87ad-475f-b0d9-88e39862e2eb service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:45:45.908596 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5a76e-87ad-475f-b0d9-88e39862e2eb service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:45:45.908866 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5a76e-87ad-475f-b0d9-88e39862e2eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:45:45.910977 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-16f5a76e-87ad-475f-b0d9-88e39862e2eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:45:45.923776 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5a76e-87ad-475f-b0d9-88e39862e2eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:45:45.925400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5a76e-87ad-475f-b0d9-88e39862e2eb service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:45:45.936110 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4555/9147] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:45:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:45:55.931705 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=32 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:46:00.544177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ab278-20b7-4ea0-911e-91cf9b24c6af service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:46:00.559633 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ab278-20b7-4ea0-911e-91cf9b24c6af service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:46:00.566172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299d6b9-cfd3-4d3c-ac9b-4ca2c03854ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:46:00.566905 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d6b9-cfd3-4d3c-ac9b-4ca2c03854ca service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:46:00.567215 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d6b9-cfd3-4d3c-ac9b-4ca2c03854ca service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:46:00.567480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d6b9-cfd3-4d3c-ac9b-4ca2c03854ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:46:00.569856 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5299d6b9-cfd3-4d3c-ac9b-4ca2c03854ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:46:00.606322 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299d6b9-cfd3-4d3c-ac9b-4ca2c03854ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:46:00.608318 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299d6b9-cfd3-4d3c-ac9b-4ca2c03854ca service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:46:00.618647 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4593/9148] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:46:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:46:10.614575 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=11 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:47:28.262833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d57ad-abbe-479f-8b74-7cd301c9c430 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:28.263378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d57ad-abbe-479f-8b74-7cd301c9c430 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:28.263378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d57ad-abbe-479f-8b74-7cd301c9c430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:28.328143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-174d57ad-abbe-479f-8b74-7cd301c9c430 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:47:28.329400 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-174d57ad-abbe-479f-8b74-7cd301c9c430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:28.414778 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4556/9149] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:47:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:47:28.465079 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299d6b9-cfd3-4d3c-ac9b-4ca2c03854ca service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:47:28.466648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-5299d6b9-cfd3-4d3c-ac9b-4ca2c03854ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:28.562074 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299d6b9-cfd3-4d3c-ac9b-4ca2c03854ca service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:47:28.567577 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21270c-58d5-4fbd-9a50-7d238c5aa9b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:47:28.568222 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21270c-58d5-4fbd-9a50-7d238c5aa9b9 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:28.568495 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21270c-58d5-4fbd-9a50-7d238c5aa9b9 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:28.568758 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21270c-58d5-4fbd-9a50-7d238c5aa9b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:28.578523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21270c-58d5-4fbd-9a50-7d238c5aa9b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:47:28.580197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21270c-58d5-4fbd-9a50-7d238c5aa9b9 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:47:28.588555 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4594/9150] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:47:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:47:37.627922 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d57ad-abbe-479f-8b74-7cd301c9c430 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:47:37.641124 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d57ad-abbe-479f-8b74-7cd301c9c430 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:47:37.646672 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad1635b-5902-4897-88ae-07440ea997d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:47:37.647571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1635b-5902-4897-88ae-07440ea997d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:37.647847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1635b-5902-4897-88ae-07440ea997d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:37.648116 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1635b-5902-4897-88ae-07440ea997d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:37.650991 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7ad1635b-5902-4897-88ae-07440ea997d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:37.679698 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1635b-5902-4897-88ae-07440ea997d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:47:37.681158 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad1635b-5902-4897-88ae-07440ea997d1 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:47:37.690000 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4557/9151] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:47:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:47:38.585089 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=41 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:47:40.996896 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21270c-58d5-4fbd-9a50-7d238c5aa9b9 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:47:41.006726 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21270c-58d5-4fbd-9a50-7d238c5aa9b9 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:47:41.010803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2812cf9-d4f7-4eb8-8b87-5fce8058056b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:47:41.011400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2812cf9-d4f7-4eb8-8b87-5fce8058056b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:41.011700 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2812cf9-d4f7-4eb8-8b87-5fce8058056b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:41.012001 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2812cf9-d4f7-4eb8-8b87-5fce8058056b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:41.013898 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d2812cf9-d4f7-4eb8-8b87-5fce8058056b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:41.023453 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2812cf9-d4f7-4eb8-8b87-5fce8058056b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:47:41.024873 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2812cf9-d4f7-4eb8-8b87-5fce8058056b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:47:41.032849 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4595/9152] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:47:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:47:41.173322 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c42068-b99b-4621-b0cc-93cfd77ce1f1 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:41.173816 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c42068-b99b-4621-b0cc-93cfd77ce1f1 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:41.173928 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c42068-b99b-4621-b0cc-93cfd77ce1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:41.229257 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-41c42068-b99b-4621-b0cc-93cfd77ce1f1 None None] MFA Rules not processed for user `d3a99d39337841849b3e2efe48ebe53c`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:47:41.229636 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-41c42068-b99b-4621-b0cc-93cfd77ce1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:41.240475 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4558/9153] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 05:47:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 30 05:47:41.253016 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2812cf9-d4f7-4eb8-8b87-5fce8058056b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:47:41.254912 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-d2812cf9-d4f7-4eb8-8b87-5fce8058056b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:41.360012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2812cf9-d4f7-4eb8-8b87-5fce8058056b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:47:41.363715 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ccdd-bb48-4ae3-a54f-8da47c0d8371 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:47:41.364330 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ccdd-bb48-4ae3-a54f-8da47c0d8371 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:41.364607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ccdd-bb48-4ae3-a54f-8da47c0d8371 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:41.364948 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ccdd-bb48-4ae3-a54f-8da47c0d8371 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:41.376323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ccdd-bb48-4ae3-a54f-8da47c0d8371 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:47:41.377808 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ccdd-bb48-4ae3-a54f-8da47c0d8371 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:47:41.388404 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4596/9154] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:47:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:47:41.460811 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c42068-b99b-4621-b0cc-93cfd77ce1f1 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:47:41.470978 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c42068-b99b-4621-b0cc-93cfd77ce1f1 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:47:41.474533 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa5d78-88ce-4d5d-ae55-a5d040c298f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:47:41.475137 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa5d78-88ce-4d5d-ae55-a5d040c298f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:41.475410 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa5d78-88ce-4d5d-ae55-a5d040c298f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:41.475677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa5d78-88ce-4d5d-ae55-a5d040c298f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:41.477395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7eaa5d78-88ce-4d5d-ae55-a5d040c298f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:41.486833 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa5d78-88ce-4d5d-ae55-a5d040c298f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:47:41.488272 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa5d78-88ce-4d5d-ae55-a5d040c298f0 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:47:41.496090 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4559/9155] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:47:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:47:41.583064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ccdd-bb48-4ae3-a54f-8da47c0d8371 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:47:41.596433 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ccdd-bb48-4ae3-a54f-8da47c0d8371 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:47:41.602987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a6136-2551-4abd-a633-453031be9933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:47:41.603869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a6136-2551-4abd-a633-453031be9933 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:41.604174 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a6136-2551-4abd-a633-453031be9933 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:41.604491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a6136-2551-4abd-a633-453031be9933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:41.607386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1e0a6136-2551-4abd-a633-453031be9933 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:41.623023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a6136-2551-4abd-a633-453031be9933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:47:41.624491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a6136-2551-4abd-a633-453031be9933 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:47:41.635992 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4597/9156] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:47:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:47:41.703831 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa5d78-88ce-4d5d-ae55-a5d040c298f0 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:47:41.717236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa5d78-88ce-4d5d-ae55-a5d040c298f0 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:47:41.722700 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbaa726-3e46-4547-a7a5-a69c697e2c41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:47:41.723295 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa726-3e46-4547-a7a5-a69c697e2c41 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:41.723567 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa726-3e46-4547-a7a5-a69c697e2c41 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:41.723836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbaa726-3e46-4547-a7a5-a69c697e2c41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:41.725610 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fbaa726-3e46-4547-a7a5-a69c697e2c41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:41.737112 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaa726-3e46-4547-a7a5-a69c697e2c41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:47:41.738737 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbaa726-3e46-4547-a7a5-a69c697e2c41 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:47:41.749315 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4560/9157] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:47:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:47:42.662219 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a6136-2551-4abd-a633-453031be9933 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:47:42.673197 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a6136-2551-4abd-a633-453031be9933 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:47:42.678610 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1372d-1b2e-49e8-af44-4c90b1701d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:47:42.679331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1372d-1b2e-49e8-af44-4c90b1701d1b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:42.679615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1372d-1b2e-49e8-af44-4c90b1701d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:42.679875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1372d-1b2e-49e8-af44-4c90b1701d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:42.682035 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-0cf1372d-1b2e-49e8-af44-4c90b1701d1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:42.697107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1372d-1b2e-49e8-af44-4c90b1701d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:47:42.699528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf1372d-1b2e-49e8-af44-4c90b1701d1b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:47:42.708718 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4598/9158] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:47:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:47:44.274443 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643386e6-0a2b-4df0-a9d5-5131c6558221 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:44.274946 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643386e6-0a2b-4df0-a9d5-5131c6558221 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:44.275155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643386e6-0a2b-4df0-a9d5-5131c6558221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:44.295536 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-643386e6-0a2b-4df0-a9d5-5131c6558221 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:47:44.296740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-643386e6-0a2b-4df0-a9d5-5131c6558221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:47:44.304532 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4561/9159] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:47:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:47:44.316387 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1372d-1b2e-49e8-af44-4c90b1701d1b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:47:44.329479 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1372d-1b2e-49e8-af44-4c90b1701d1b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:47:44.334629 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557df818-3d19-4c05-8326-a542544e8e36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:47:44.335236 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557df818-3d19-4c05-8326-a542544e8e36 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:47:44.335539 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557df818-3d19-4c05-8326-a542544e8e36 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:47:44.335806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557df818-3d19-4c05-8326-a542544e8e36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:47:44.344259 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557df818-3d19-4c05-8326-a542544e8e36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:47:44.345859 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557df818-3d19-4c05-8326-a542544e8e36 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:47:44.354100 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4599/9160] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:47:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:47:54.290301 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=85 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:47:54.351059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=59 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:48:04.091513 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b74d1-a530-42ae-933a-73ff7d80d853 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:48:04.092053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b74d1-a530-42ae-933a-73ff7d80d853 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:48:04.092053 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b74d1-a530-42ae-933a-73ff7d80d853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:48:04.113357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-7f5b74d1-a530-42ae-933a-73ff7d80d853 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:48:04.114767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-7f5b74d1-a530-42ae-933a-73ff7d80d853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:48:04.122614 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4562/9161] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 05:48:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:48:04.136162 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557df818-3d19-4c05-8326-a542544e8e36 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:48:04.147382 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557df818-3d19-4c05-8326-a542544e8e36 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:48:04.152842 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deba88a-bafe-4bdf-ae0c-ef3dcfde59d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:48:04.153442 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deba88a-bafe-4bdf-ae0c-ef3dcfde59d3 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:48:04.153716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deba88a-bafe-4bdf-ae0c-ef3dcfde59d3 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:48:04.154048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deba88a-bafe-4bdf-ae0c-ef3dcfde59d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:48:04.162396 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deba88a-bafe-4bdf-ae0c-ef3dcfde59d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:48:04.163981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deba88a-bafe-4bdf-ae0c-ef3dcfde59d3 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:48:04.172083 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4600/9162] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:48:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:48:14.107719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:48:14.168799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:49:42.103080 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b74d1-a530-42ae-933a-73ff7d80d853 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:49:42.113389 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b74d1-a530-42ae-933a-73ff7d80d853 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:49:42.116933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a316a6-5f33-49dc-8042-3a38623c0c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:49:42.117543 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a316a6-5f33-49dc-8042-3a38623c0c2e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:49:42.117823 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a316a6-5f33-49dc-8042-3a38623c0c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:49:42.118127 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a316a6-5f33-49dc-8042-3a38623c0c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:49:42.119854 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d0a316a6-5f33-49dc-8042-3a38623c0c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:49:42.134507 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a316a6-5f33-49dc-8042-3a38623c0c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:49:42.136030 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a316a6-5f33-49dc-8042-3a38623c0c2e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:49:42.147359 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4563/9163] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:49:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:49:43.362778 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deba88a-bafe-4bdf-ae0c-ef3dcfde59d3 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:49:43.372967 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deba88a-bafe-4bdf-ae0c-ef3dcfde59d3 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:49:43.378822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e648-346a-48e2-8b39-c7a2d9fe51ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:49:43.379532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e648-346a-48e2-8b39-c7a2d9fe51ca service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:49:43.379806 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e648-346a-48e2-8b39-c7a2d9fe51ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:49:43.380067 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0e648-346a-48e2-8b39-c7a2d9fe51ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:49:43.382055 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ad0e648-346a-48e2-8b39-c7a2d9fe51ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:49:43.397220 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e648-346a-48e2-8b39-c7a2d9fe51ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:49:43.398810 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0e648-346a-48e2-8b39-c7a2d9fe51ca service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:49:43.410523 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4601/9164] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:49:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:49:47.003035 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0966b47-729a-4731-a3ff-52ed99b9e7a2 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:49:47.003574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0966b47-729a-4731-a3ff-52ed99b9e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:49:47.003574 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0966b47-729a-4731-a3ff-52ed99b9e7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:49:47.024694 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-e0966b47-729a-4731-a3ff-52ed99b9e7a2 None None] MFA Rules not processed for user `7da8ec6f938441b4a16dfb383e781fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:49:47.025938 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-e0966b47-729a-4731-a3ff-52ed99b9e7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:49:47.034045 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4564/9165] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:49:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:49:53.405260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:49:57.019214 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=9 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:50:04.191748 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e648-346a-48e2-8b39-c7a2d9fe51ca service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:50:04.193235 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4ad0e648-346a-48e2-8b39-c7a2d9fe51ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:50:04.209028 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0e648-346a-48e2-8b39-c7a2d9fe51ca service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:50:04.215193 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d970b62-99cc-4821-9bf1-1095f4807b01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:50:04.215887 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d970b62-99cc-4821-9bf1-1095f4807b01 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:50:04.216165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d970b62-99cc-4821-9bf1-1095f4807b01 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:50:04.216435 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d970b62-99cc-4821-9bf1-1095f4807b01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:50:04.218365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3d970b62-99cc-4821-9bf1-1095f4807b01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:50:04.230857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d970b62-99cc-4821-9bf1-1095f4807b01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:50:04.232443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d970b62-99cc-4821-9bf1-1095f4807b01 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:50:04.242748 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4602/9166] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:50:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:50:05.267793 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0966b47-729a-4731-a3ff-52ed99b9e7a2 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:50:05.283157 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0966b47-729a-4731-a3ff-52ed99b9e7a2 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:50:05.290531 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c5077-1a67-46af-bf03-f293c30b5990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:50:05.291143 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c5077-1a67-46af-bf03-f293c30b5990 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:50:05.291420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c5077-1a67-46af-bf03-f293c30b5990 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:50:05.291689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c5077-1a67-46af-bf03-f293c30b5990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:50:05.300689 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c5077-1a67-46af-bf03-f293c30b5990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:50:05.302342 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c5077-1a67-46af-bf03-f293c30b5990 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:50:05.311533 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4565/9167] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:50:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:50:09.788837 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d970b62-99cc-4821-9bf1-1095f4807b01 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:50:09.807818 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d970b62-99cc-4821-9bf1-1095f4807b01 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:50:09.816121 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04df8-8ee8-4faf-b716-35f42ffb2767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:50:09.817971 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04df8-8ee8-4faf-b716-35f42ffb2767 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:50:09.819164 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04df8-8ee8-4faf-b716-35f42ffb2767 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:50:09.819602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc04df8-8ee8-4faf-b716-35f42ffb2767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:50:09.822949 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-fdc04df8-8ee8-4faf-b716-35f42ffb2767 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:50:09.844880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04df8-8ee8-4faf-b716-35f42ffb2767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:50:09.847256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc04df8-8ee8-4faf-b716-35f42ffb2767 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:50:09.862546 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4603/9168] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:50:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:50:15.307512 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:50:19.857136 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=12 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:50:24.253122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c5077-1a67-46af-bf03-f293c30b5990 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:50:24.266492 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c5077-1a67-46af-bf03-f293c30b5990 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:50:24.273236 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd204c-8027-4bb2-a9a9-7f95edf38fa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:50:24.274036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd204c-8027-4bb2-a9a9-7f95edf38fa0 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:50:24.274307 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd204c-8027-4bb2-a9a9-7f95edf38fa0 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:50:24.274570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd204c-8027-4bb2-a9a9-7f95edf38fa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:50:24.283965 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd204c-8027-4bb2-a9a9-7f95edf38fa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:50:24.285822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd204c-8027-4bb2-a9a9-7f95edf38fa0 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:50:24.297730 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4566/9169] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:50:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:50:25.953993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04df8-8ee8-4faf-b716-35f42ffb2767 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:50:25.969925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc04df8-8ee8-4faf-b716-35f42ffb2767 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:50:25.976367 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b074d-edec-441b-826c-0aa88301506b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:50:25.977102 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b074d-edec-441b-826c-0aa88301506b service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:50:25.977333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b074d-edec-441b-826c-0aa88301506b service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:50:25.977602 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b074d-edec-441b-826c-0aa88301506b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:50:25.988101 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b074d-edec-441b-826c-0aa88301506b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:50:25.989528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b074d-edec-441b-826c-0aa88301506b service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:50:25.999609 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4604/9170] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:50:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:50:34.293268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:50:35.995128 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:50:51.795006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd204c-8027-4bb2-a9a9-7f95edf38fa0 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:50:51.820188 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd204c-8027-4bb2-a9a9-7f95edf38fa0 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:50:51.826131 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d9de7-865b-4fd1-8cd7-5fcf6c0eeeca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:50:51.826741 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d9de7-865b-4fd1-8cd7-5fcf6c0eeeca service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:50:51.827017 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d9de7-865b-4fd1-8cd7-5fcf6c0eeeca service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:50:51.827287 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d9de7-865b-4fd1-8cd7-5fcf6c0eeeca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:50:51.836281 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d9de7-865b-4fd1-8cd7-5fcf6c0eeeca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:50:51.837897 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d9de7-865b-4fd1-8cd7-5fcf6c0eeeca service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:50:51.848160 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4567/9171] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:50:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:51:01.843594 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=10 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:51:03.541195 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b074d-edec-441b-826c-0aa88301506b service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:51:03.554129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b074d-edec-441b-826c-0aa88301506b service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:51:03.560803 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581abe-ac25-41b1-b2c8-b5533c2a2ff9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:51:03.561449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581abe-ac25-41b1-b2c8-b5533c2a2ff9 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:51:03.561714 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581abe-ac25-41b1-b2c8-b5533c2a2ff9 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:51:03.562029 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581abe-ac25-41b1-b2c8-b5533c2a2ff9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:51:03.572625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72581abe-ac25-41b1-b2c8-b5533c2a2ff9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:51:03.574514 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72581abe-ac25-41b1-b2c8-b5533c2a2ff9 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:51:03.585021 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4605/9172] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:51:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:51:13.580676 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:52:38.936631 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d9de7-865b-4fd1-8cd7-5fcf6c0eeeca service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:52:38.947362 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d9de7-865b-4fd1-8cd7-5fcf6c0eeeca service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:52:38.951270 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb714d-4be7-4d67-be9e-08db8a5a4cfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:52:38.951882 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb714d-4be7-4d67-be9e-08db8a5a4cfe service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:52:38.952155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb714d-4be7-4d67-be9e-08db8a5a4cfe service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:52:38.952420 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb714d-4be7-4d67-be9e-08db8a5a4cfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:52:38.954144 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-d9bb714d-4be7-4d67-be9e-08db8a5a4cfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:52:38.964180 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb714d-4be7-4d67-be9e-08db8a5a4cfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:52:38.965686 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb714d-4be7-4d67-be9e-08db8a5a4cfe service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:52:38.974265 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4568/9173] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:52:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:52:45.228117 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581abe-ac25-41b1-b2c8-b5533c2a2ff9 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:52:45.238365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581abe-ac25-41b1-b2c8-b5533c2a2ff9 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:52:45.243378 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113696d4-a990-4d5a-84e1-b382969063d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:52:45.244008 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113696d4-a990-4d5a-84e1-b382969063d9 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:52:45.244420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113696d4-a990-4d5a-84e1-b382969063d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:52:45.244696 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113696d4-a990-4d5a-84e1-b382969063d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:52:45.252794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113696d4-a990-4d5a-84e1-b382969063d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:52:45.254343 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113696d4-a990-4d5a-84e1-b382969063d9 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:52:45.263884 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4606/9174] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:52:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:52:48.970907 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=6 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:52:55.259791 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:54:21.113096 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb714d-4be7-4d67-be9e-08db8a5a4cfe service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:21.189393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb714d-4be7-4d67-be9e-08db8a5a4cfe service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:21.196395 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbec24-9d6b-47d5-836c-f6194a4b40b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:21.197317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbec24-9d6b-47d5-836c-f6194a4b40b7 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:21.197549 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbec24-9d6b-47d5-836c-f6194a4b40b7 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:21.197805 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbec24-9d6b-47d5-836c-f6194a4b40b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:21.209731 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbec24-9d6b-47d5-836c-f6194a4b40b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:21.210909 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbec24-9d6b-47d5-836c-f6194a4b40b7 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:21.223542 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4569/9175] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:54:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:54:27.030458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113696d4-a990-4d5a-84e1-b382969063d9 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:27.062430 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113696d4-a990-4d5a-84e1-b382969063d9 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:27.066461 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f706d5-0522-4f7c-a9bb-b12ba6204c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:27.067250 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f706d5-0522-4f7c-a9bb-b12ba6204c33 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:27.067521 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f706d5-0522-4f7c-a9bb-b12ba6204c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:27.067785 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f706d5-0522-4f7c-a9bb-b12ba6204c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:27.133944 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f706d5-0522-4f7c-a9bb-b12ba6204c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:27.135443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f706d5-0522-4f7c-a9bb-b12ba6204c33 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:27.155514 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4607/9176] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:54:30.159332 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbec24-9d6b-47d5-836c-f6194a4b40b7 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:30.174999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbec24-9d6b-47d5-836c-f6194a4b40b7 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:30.182252 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586a1c-de3f-4d4f-a1ac-b0bc55ec8928 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:30.182877 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586a1c-de3f-4d4f-a1ac-b0bc55ec8928 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:30.183155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586a1c-de3f-4d4f-a1ac-b0bc55ec8928 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:30.183423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586a1c-de3f-4d4f-a1ac-b0bc55ec8928 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:30.185184 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-53586a1c-de3f-4d4f-a1ac-b0bc55ec8928 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:30.219451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53586a1c-de3f-4d4f-a1ac-b0bc55ec8928 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:30.219451 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53586a1c-de3f-4d4f-a1ac-b0bc55ec8928 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:30.228052 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4570/9177] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:54:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:54:33.591767 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f706d5-0522-4f7c-a9bb-b12ba6204c33 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:33.610127 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f706d5-0522-4f7c-a9bb-b12ba6204c33 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:33.616485 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:33.617147 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:33.617535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:33.617713 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] PATH_INFO: `/v3/users/7da8ec6f938441b4a16dfb383e781fbe` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:33.619680 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da8ec6f938441b4a16dfb383e781fbe)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:33.621784 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:33.675843 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da8ec6f938441b4a16dfb383e781fbe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:33.676538 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da8ec6f938441b4a16dfb383e781fbe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:33.691668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da8ec6f938441b4a16dfb383e781fbe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:33.716328 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da8ec6f938441b4a16dfb383e781fbe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:33.727830 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da8ec6f938441b4a16dfb383e781fbe'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:33.734466 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4608/9178] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:54:33 2022] DELETE /identity/v3/users/7da8ec6f938441b4a16dfb383e781fbe => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:54:33.920655 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586a1c-de3f-4d4f-a1ac-b0bc55ec8928 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:33.941801 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586a1c-de3f-4d4f-a1ac-b0bc55ec8928 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:34.010742 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:34.011421 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:34.011701 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:34.011971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] PATH_INFO: `/v3/projects/6a9d5abb7480400a863d905a6075b5c9` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:34.013132 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9d5abb7480400a863d905a6075b5c9)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:34.015108 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:34.071849 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9d5abb7480400a863d905a6075b5c9', 'request_id': 'req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.080320 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9d5abb7480400a863d905a6075b5c9', 'request_id': 'req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.087072 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9d5abb7480400a863d905a6075b5c9', 'request_id': 'req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.097579 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] The token cache is being invalidate because project 6a9d5abb7480400a863d905a6075b5c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:54:34.097889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.098590 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.100201 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4571/9179] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:54:33 2022] DELETE /identity/v3/projects/6a9d5abb7480400a863d905a6075b5c9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:54:34.104350 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:34.105923 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:34.119929 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2b037-07c7-4635-a947-b8b30faee180 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:34.155003 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:54:34.182524 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:34.183449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:34.183833 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:34.184256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] PATH_INFO: `/v3/users/1584b53c248f43598a886e8c4041c561` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:34.186177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1584b53c248f43598a886e8c4041c561)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:34.189081 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:34.240677 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1584b53c248f43598a886e8c4041c561'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.241745 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1584b53c248f43598a886e8c4041c561'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.250876 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1584b53c248f43598a886e8c4041c561'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.260181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1584b53c248f43598a886e8c4041c561'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.273716 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-c8b93ac4-0295-449c-ace7-a0fe868949ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1584b53c248f43598a886e8c4041c561'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.280158 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4609/9180] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 05:54:34 2022] DELETE /identity/v3/users/1584b53c248f43598a886e8c4041c561 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:54:34.468723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:34.470327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:34.488248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1825e4-2e8c-44aa-ade5-9dc6c063ad6f admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:34.496248 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:54:34.552785 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:34.553456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:34.553736 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:34.554038 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] PATH_INFO: `/v3/projects/7b0d4f4e11784d80a4d9ff102ad04b5b` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:34.555200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0d4f4e11784d80a4d9ff102ad04b5b)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:34.557162 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:34.613846 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0d4f4e11784d80a4d9ff102ad04b5b', 'request_id': 'req-0bcca2ad-6477-4cfc-ad53-270305e1d374'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.624268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0d4f4e11784d80a4d9ff102ad04b5b', 'request_id': 'req-0bcca2ad-6477-4cfc-ad53-270305e1d374'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.632232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0d4f4e11784d80a4d9ff102ad04b5b', 'request_id': 'req-0bcca2ad-6477-4cfc-ad53-270305e1d374'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.644580 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] The token cache is being invalidate because project 7b0d4f4e11784d80a4d9ff102ad04b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82099) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 05:54:34.645149 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.646122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-0bcca2ad-6477-4cfc-ad53-270305e1d374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 05:54:34.647768 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4572/9181] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 05:54:34 2022] DELETE /identity/v3/projects/7b0d4f4e11784d80a4d9ff102ad04b5b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:54:34.653135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d64b9b-8ae5-456b-8ca0-abbd990dda72 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:34.653651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d64b9b-8ae5-456b-8ca0-abbd990dda72 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:34.653651 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d64b9b-8ae5-456b-8ca0-abbd990dda72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:34.708462 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-84d64b9b-8ae5-456b-8ca0-abbd990dda72 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:54:34.709728 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-84d64b9b-8ae5-456b-8ca0-abbd990dda72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:34.776501 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4610/9182] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:54:34.784835 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f883ad3-6490-4273-8057-162d8bd2334d None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:34.785244 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f883ad3-6490-4273-8057-162d8bd2334d None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:34.785538 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f883ad3-6490-4273-8057-162d8bd2334d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:34.805477 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6f883ad3-6490-4273-8057-162d8bd2334d None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:54:34.806712 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6f883ad3-6490-4273-8057-162d8bd2334d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:34.815195 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4573/9183] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 05:54:34.820047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d64b9b-8ae5-456b-8ca0-abbd990dda72 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:34.833085 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d64b9b-8ae5-456b-8ca0-abbd990dda72 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:34.841448 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb14dd9-ab45-4212-91a5-f6ae38835a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:34.842393 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb14dd9-ab45-4212-91a5-f6ae38835a22 admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:34.842735 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb14dd9-ab45-4212-91a5-f6ae38835a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:34.843165 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb14dd9-ab45-4212-91a5-f6ae38835a22 admin admin] PATH_INFO: `/v3/domains` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:34.844221 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb14dd9-ab45-4212-91a5-f6ae38835a22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82098) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 05:54:34.844699 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb14dd9-ab45-4212-91a5-f6ae38835a22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:34.847353 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb14dd9-ab45-4212-91a5-f6ae38835a22 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:34.859872 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4611/9184] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 05:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 05:54:34.864720 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f883ad3-6490-4273-8057-162d8bd2334d None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:34.874663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f883ad3-6490-4273-8057-162d8bd2334d None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:34.880076 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609bdee-9976-41c0-a770-089b033b503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:34.880723 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609bdee-9976-41c0-a770-089b033b503d admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:34.881004 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609bdee-9976-41c0-a770-089b033b503d admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:34.881277 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609bdee-9976-41c0-a770-089b033b503d admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:34.881954 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609bdee-9976-41c0-a770-089b033b503d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:34.883918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609bdee-9976-41c0-a770-089b033b503d admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:34.930161 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4574/9185] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:54:34 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:54:34.931354 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb14dd9-ab45-4212-91a5-f6ae38835a22 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:34.944918 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb14dd9-ab45-4212-91a5-f6ae38835a22 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:34.964742 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:54:35.013598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f001c7-be28-47c4-9a4a-b6f9f6f3ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:35.014258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f001c7-be28-47c4-9a4a-b6f9f6f3ca15 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:35.014532 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f001c7-be28-47c4-9a4a-b6f9f6f3ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:35.014797 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f001c7-be28-47c4-9a4a-b6f9f6f3ca15 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:35.015431 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f001c7-be28-47c4-9a4a-b6f9f6f3ca15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:35.017342 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f001c7-be28-47c4-9a4a-b6f9f6f3ca15 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:35.041409 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4612/9186] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:54:34 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:54:35.045936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609bdee-9976-41c0-a770-089b033b503d admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:35.057357 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609bdee-9976-41c0-a770-089b033b503d admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:35.062152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0474164-a38b-4a07-b33e-51bf14a0159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:35.062773 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0474164-a38b-4a07-b33e-51bf14a0159e admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:35.063024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0474164-a38b-4a07-b33e-51bf14a0159e admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:35.063280 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0474164-a38b-4a07-b33e-51bf14a0159e admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:35.064246 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0474164-a38b-4a07-b33e-51bf14a0159e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:35.065910 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0474164-a38b-4a07-b33e-51bf14a0159e admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:35.076324 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4575/9187] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:54:35.080731 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f001c7-be28-47c4-9a4a-b6f9f6f3ca15 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:35.091073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f001c7-be28-47c4-9a4a-b6f9f6f3ca15 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:35.096059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f489f-610a-4ed6-b54a-44cabc63c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:35.096638 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f489f-610a-4ed6-b54a-44cabc63c85f admin admin] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:35.096910 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f489f-610a-4ed6-b54a-44cabc63c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:35.097175 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f489f-610a-4ed6-b54a-44cabc63c85f admin admin] PATH_INFO: `/v3/roles` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:35.097840 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f489f-610a-4ed6-b54a-44cabc63c85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:35.099613 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f489f-610a-4ed6-b54a-44cabc63c85f admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:35.110406 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4613/9188] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:54:35.114921 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0474164-a38b-4a07-b33e-51bf14a0159e admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:35.125377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0474164-a38b-4a07-b33e-51bf14a0159e admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:35.130649 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb214-8b91-4bf9-9304-53a5153fabc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:35.131298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb214-8b91-4bf9-9304-53a5153fabc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:35.131571 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb214-8b91-4bf9-9304-53a5153fabc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:35.131839 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bb214-8b91-4bf9-9304-53a5153fabc4 admin admin] PATH_INFO: `/v3/projects/82012f46260a467f892baa2952ca68ae/users/604f8666461945d48f18a96e6e2add98/roles/4d5ba4daa0e84cf89f3bc5854a124660` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:35.147155 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bb214-8b91-4bf9-9304-53a5153fabc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82012f46260a467f892baa2952ca68ae, user_id=604f8666461945d48f18a96e6e2add98, role_id=4d5ba4daa0e84cf89f3bc5854a124660)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:35.149844 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021bb214-8b91-4bf9-9304-53a5153fabc4 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:35.164516 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4576/9189] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:54:35 2022] PUT /identity/v3/projects/82012f46260a467f892baa2952ca68ae/users/604f8666461945d48f18a96e6e2add98/roles/4d5ba4daa0e84cf89f3bc5854a124660 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:54:35.171258 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b12b4-718d-457f-9c13-71489d0a63d0 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:35.171535 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b12b4-718d-457f-9c13-71489d0a63d0 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:35.171802 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b12b4-718d-457f-9c13-71489d0a63d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:35.191010 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-122b12b4-718d-457f-9c13-71489d0a63d0 None None] MFA Rules not processed for user `ad96c68450db4b7c8c97facc17fd8c89`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:54:35.192552 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-122b12b4-718d-457f-9c13-71489d0a63d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:35.258867 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4614/9190] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:54:35.273268 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb214-8b91-4bf9-9304-53a5153fabc4 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:35.275200 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-021bb214-8b91-4bf9-9304-53a5153fabc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:35.311847 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:54:35.341145 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bb214-8b91-4bf9-9304-53a5153fabc4 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:35.344851 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a2c6f-234f-4a28-968a-489a88318f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:35.345462 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a2c6f-234f-4a28-968a-489a88318f4f service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:35.345732 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a2c6f-234f-4a28-968a-489a88318f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:35.346031 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a2c6f-234f-4a28-968a-489a88318f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:35.355632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a2c6f-234f-4a28-968a-489a88318f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:35.357091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a2c6f-234f-4a28-968a-489a88318f4f service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:35.366942 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4577/9191] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:54:39.210480 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6fee-27ad-435f-993c-822ad32502df None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:39.210983 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6fee-27ad-435f-993c-822ad32502df None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:39.211094 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f6fee-27ad-435f-993c-822ad32502df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:39.240685 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-607f6fee-27ad-435f-993c-822ad32502df None None] MFA Rules not processed for user `604f8666461945d48f18a96e6e2add98`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:54:39.241914 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-607f6fee-27ad-435f-993c-822ad32502df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:39.323808 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4615/9192] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:54:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:54:39.328453 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a2c6f-234f-4a28-968a-489a88318f4f service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:39.338621 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a2c6f-234f-4a28-968a-489a88318f4f service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:39.343340 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35295c8a-1d9e-4dad-9a93-082e980acaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:39.344046 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35295c8a-1d9e-4dad-9a93-082e980acaf8 admin admin] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:39.344383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35295c8a-1d9e-4dad-9a93-082e980acaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:39.344719 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35295c8a-1d9e-4dad-9a93-082e980acaf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:39.345358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35295c8a-1d9e-4dad-9a93-082e980acaf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:39.347316 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35295c8a-1d9e-4dad-9a93-082e980acaf8 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:39.381946 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4578/9193] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 05:54:39 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:54:39.386500 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f6fee-27ad-435f-993c-822ad32502df None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:39.398288 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f6fee-27ad-435f-993c-822ad32502df None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:39.430486 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:54:39.461263 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87d9ea-70bf-4b30-aa4e-34342019af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:39.461926 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87d9ea-70bf-4b30-aa4e-34342019af62 admin admin] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:39.462213 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87d9ea-70bf-4b30-aa4e-34342019af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:39.462487 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87d9ea-70bf-4b30-aa4e-34342019af62 admin admin] PATH_INFO: `/v3/users` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:39.463135 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87d9ea-70bf-4b30-aa4e-34342019af62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:39.465086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b87d9ea-70bf-4b30-aa4e-34342019af62 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:39.488668 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4616/9194] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 05:54:39 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 05:54:39.492663 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35295c8a-1d9e-4dad-9a93-082e980acaf8 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:39.503423 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35295c8a-1d9e-4dad-9a93-082e980acaf8 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:39.508426 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f960d-1faf-44bf-8353-b02ddcd30792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:39.509029 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f960d-1faf-44bf-8353-b02ddcd30792 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:39.509302 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f960d-1faf-44bf-8353-b02ddcd30792 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:39.509570 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f960d-1faf-44bf-8353-b02ddcd30792 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:39.510249 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f960d-1faf-44bf-8353-b02ddcd30792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:39.511871 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f960d-1faf-44bf-8353-b02ddcd30792 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:39.523529 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4579/9195] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:54:39.527993 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87d9ea-70bf-4b30-aa4e-34342019af62 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:39.539007 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87d9ea-70bf-4b30-aa4e-34342019af62 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:39.544096 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd485a8-399a-40d2-ad98-8e7f0a54b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:39.544799 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd485a8-399a-40d2-ad98-8e7f0a54b1db admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:39.545077 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd485a8-399a-40d2-ad98-8e7f0a54b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:39.545352 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd485a8-399a-40d2-ad98-8e7f0a54b1db admin admin] PATH_INFO: `/v3/projects/dd7aaa28b62d4573900bc408cc7df44d/users/b691d6f1c23843728b281541fcc958d2/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:39.564186 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd485a8-399a-40d2-ad98-8e7f0a54b1db admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7aaa28b62d4573900bc408cc7df44d, user_id=b691d6f1c23843728b281541fcc958d2, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:39.568632 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd485a8-399a-40d2-ad98-8e7f0a54b1db admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:39.584417 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4617/9196] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:54:39 2022] PUT /identity/v3/projects/dd7aaa28b62d4573900bc408cc7df44d/users/b691d6f1c23843728b281541fcc958d2/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 05:54:39.588762 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f960d-1faf-44bf-8353-b02ddcd30792 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:39.600125 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f960d-1faf-44bf-8353-b02ddcd30792 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:39.663744 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1142f1-de7b-415f-b6f6-a808e3720334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:39.664366 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1142f1-de7b-415f-b6f6-a808e3720334 admin admin] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:39.664642 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1142f1-de7b-415f-b6f6-a808e3720334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:39.664912 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1142f1-de7b-415f-b6f6-a808e3720334 admin admin] PATH_INFO: `/v3/roles` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:39.665603 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1142f1-de7b-415f-b6f6-a808e3720334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:39.667264 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1142f1-de7b-415f-b6f6-a808e3720334 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:39.677760 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4580/9197] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 05:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 05:54:39.682337 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd485a8-399a-40d2-ad98-8e7f0a54b1db admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:39.696115 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd485a8-399a-40d2-ad98-8e7f0a54b1db admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:39.706838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9209a0-4bf1-4898-9fa9-835ee6150556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:39.708086 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9209a0-4bf1-4898-9fa9-835ee6150556 admin admin] REQUEST_METHOD: `PUT` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:39.708497 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9209a0-4bf1-4898-9fa9-835ee6150556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:39.708939 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9209a0-4bf1-4898-9fa9-835ee6150556 admin admin] PATH_INFO: `/v3/projects/dd7aaa28b62d4573900bc408cc7df44d/users/b691d6f1c23843728b281541fcc958d2/roles/a56982ccacee4cd0b5dba95be3067f04` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:39.711907 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9209a0-4bf1-4898-9fa9-835ee6150556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd7aaa28b62d4573900bc408cc7df44d, user_id=b691d6f1c23843728b281541fcc958d2, role_id=a56982ccacee4cd0b5dba95be3067f04)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:39.716226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9209a0-4bf1-4898-9fa9-835ee6150556 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:39.731653 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4618/9198] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 05:54:39 2022] PUT /identity/v3/projects/dd7aaa28b62d4573900bc408cc7df44d/users/b691d6f1c23843728b281541fcc958d2/roles/a56982ccacee4cd0b5dba95be3067f04 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 05:54:44.377298 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463bfb3-7a94-4e73-badc-451678a18518 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:44.377832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463bfb3-7a94-4e73-badc-451678a18518 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:44.377832 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463bfb3-7a94-4e73-badc-451678a18518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:44.415505 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-2463bfb3-7a94-4e73-badc-451678a18518 None None] MFA Rules not processed for user `b691d6f1c23843728b281541fcc958d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:54:44.416958 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-2463bfb3-7a94-4e73-badc-451678a18518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:44.500841 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4581/9199] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:54:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:54:44.518129 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9209a0-4bf1-4898-9fa9-835ee6150556 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:44.520959 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1f9209a0-4bf1-4898-9fa9-835ee6150556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:44.608362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9209a0-4bf1-4898-9fa9-835ee6150556 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:44.614506 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c5e39-07f0-4f6e-b75b-501e61088ccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:44.615156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c5e39-07f0-4f6e-b75b-501e61088ccc service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:44.615425 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c5e39-07f0-4f6e-b75b-501e61088ccc service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:44.615691 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c5e39-07f0-4f6e-b75b-501e61088ccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:44.687400 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c5e39-07f0-4f6e-b75b-501e61088ccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:44.689059 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c5e39-07f0-4f6e-b75b-501e61088ccc service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:44.705742 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4619/9200] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:54:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:54:45.890547 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e02ec-408b-45e8-8e84-19043fd4d346 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:45.891016 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e02ec-408b-45e8-8e84-19043fd4d346 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:45.891378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e02ec-408b-45e8-8e84-19043fd4d346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:45.923225 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-9e9e02ec-408b-45e8-8e84-19043fd4d346 None None] MFA Rules not processed for user `604f8666461945d48f18a96e6e2add98`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:54:45.924456 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-9e9e02ec-408b-45e8-8e84-19043fd4d346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:45.932612 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4582/9201] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:54:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:54:45.983761 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c5e39-07f0-4f6e-b75b-501e61088ccc service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:45.985137 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-7a5c5e39-07f0-4f6e-b75b-501e61088ccc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:46.014126 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:54:46.055053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c5e39-07f0-4f6e-b75b-501e61088ccc service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:46.058741 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42c411-aa09-44d5-be02-3c7be0d5da8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:46.059365 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42c411-aa09-44d5-be02-3c7be0d5da8c service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:46.059636 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42c411-aa09-44d5-be02-3c7be0d5da8c service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:46.059901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42c411-aa09-44d5-be02-3c7be0d5da8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:46.061668 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aa42c411-aa09-44d5-be02-3c7be0d5da8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:46.076624 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42c411-aa09-44d5-be02-3c7be0d5da8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:46.078107 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42c411-aa09-44d5-be02-3c7be0d5da8c service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:46.089581 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4620/9202] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:54:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:54:47.754842 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e02ec-408b-45e8-8e84-19043fd4d346 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:47.770011 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:54:47.822740 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e02ec-408b-45e8-8e84-19043fd4d346 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:47.826900 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502739bb-9918-4273-8051-d8111099ffdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:47.827635 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502739bb-9918-4273-8051-d8111099ffdd service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:47.827976 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502739bb-9918-4273-8051-d8111099ffdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:47.828305 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502739bb-9918-4273-8051-d8111099ffdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:47.830181 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-502739bb-9918-4273-8051-d8111099ffdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:47.846199 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502739bb-9918-4273-8051-d8111099ffdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:47.847746 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502739bb-9918-4273-8051-d8111099ffdd service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:47.866206 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4583/9203] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:54:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:54:49.691436 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42c411-aa09-44d5-be02-3c7be0d5da8c service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:49.694141 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-aa42c411-aa09-44d5-be02-3c7be0d5da8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:49.706589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42c411-aa09-44d5-be02-3c7be0d5da8c service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:49.710424 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dffcd-2e9f-46d4-a249-41afc0335e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:49.711047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dffcd-2e9f-46d4-a249-41afc0335e40 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:49.711327 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dffcd-2e9f-46d4-a249-41afc0335e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:49.711595 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dffcd-2e9f-46d4-a249-41afc0335e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:49.713469 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4d0dffcd-2e9f-46d4-a249-41afc0335e40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:54:49.724099 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dffcd-2e9f-46d4-a249-41afc0335e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:49.725472 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dffcd-2e9f-46d4-a249-41afc0335e40 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:49.734325 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4621/9204] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:54:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:54:57.621936 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502739bb-9918-4273-8051-d8111099ffdd service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:54:57.631442 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502739bb-9918-4273-8051-d8111099ffdd service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:54:57.636074 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83698ff-46fe-4646-bcbe-3b9b2a07e6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:54:57.636685 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83698ff-46fe-4646-bcbe-3b9b2a07e6af service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:54:57.636955 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83698ff-46fe-4646-bcbe-3b9b2a07e6af service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:54:57.637192 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83698ff-46fe-4646-bcbe-3b9b2a07e6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:54:57.647136 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83698ff-46fe-4646-bcbe-3b9b2a07e6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:54:57.648588 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83698ff-46fe-4646-bcbe-3b9b2a07e6af service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:54:57.659088 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4584/9205] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:54:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:54:59.730584 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=23 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:55:07.654275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=27 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:55:56.776932 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dffcd-2e9f-46d4-a249-41afc0335e40 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:55:56.778598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-4d0dffcd-2e9f-46d4-a249-41afc0335e40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:55:56.850166 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dffcd-2e9f-46d4-a249-41afc0335e40 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:55:56.856225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2de59-9001-4dd8-bea2-eef4183129a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:55:56.856832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2de59-9001-4dd8-bea2-eef4183129a5 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:55:56.857109 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2de59-9001-4dd8-bea2-eef4183129a5 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:55:56.857381 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2de59-9001-4dd8-bea2-eef4183129a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:55:56.859283 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-32c2de59-9001-4dd8-bea2-eef4183129a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:55:56.870980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2de59-9001-4dd8-bea2-eef4183129a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:55:56.872567 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2de59-9001-4dd8-bea2-eef4183129a5 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:55:56.884538 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4622/9206] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:55:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:56:06.879226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=32 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:56:10.501743 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83698ff-46fe-4646-bcbe-3b9b2a07e6af service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:56:10.514122 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83698ff-46fe-4646-bcbe-3b9b2a07e6af service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:56:10.520282 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9c0ba-51f1-4477-bdc6-adb7d9146cb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:56:10.520890 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c0ba-51f1-4477-bdc6-adb7d9146cb3 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:56:10.521171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c0ba-51f1-4477-bdc6-adb7d9146cb3 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:56:10.521433 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b9c0ba-51f1-4477-bdc6-adb7d9146cb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:56:10.523230 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-70b9c0ba-51f1-4477-bdc6-adb7d9146cb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:56:10.548952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9c0ba-51f1-4477-bdc6-adb7d9146cb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:56:10.550646 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b9c0ba-51f1-4477-bdc6-adb7d9146cb3 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:56:10.561784 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4585/9207] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:56:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:56:20.557397 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=11 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:56:58.802358 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fb3a-1bf1-4116-9401-7b6006e1ee83 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:56:58.802913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fb3a-1bf1-4116-9401-7b6006e1ee83 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:56:58.802913 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48fb3a-1bf1-4116-9401-7b6006e1ee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:56:58.823607 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-3f48fb3a-1bf1-4116-9401-7b6006e1ee83 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:56:58.824805 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-3f48fb3a-1bf1-4116-9401-7b6006e1ee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:56:58.883672 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4623/9208] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:56:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:56:58.936979 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9c0ba-51f1-4477-bdc6-adb7d9146cb3 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:56:58.938561 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-70b9c0ba-51f1-4477-bdc6-adb7d9146cb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:56:59.020339 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b9c0ba-51f1-4477-bdc6-adb7d9146cb3 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:56:59.030134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b11fd-79e3-4faf-b0ff-ccb2b10e5063 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:56:59.030769 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b11fd-79e3-4faf-b0ff-ccb2b10e5063 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:56:59.031058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b11fd-79e3-4faf-b0ff-ccb2b10e5063 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:56:59.031383 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b11fd-79e3-4faf-b0ff-ccb2b10e5063 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:56:59.046195 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b11fd-79e3-4faf-b0ff-ccb2b10e5063 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:56:59.048440 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b11fd-79e3-4faf-b0ff-ccb2b10e5063 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:56:59.060661 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4586/9209] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:56:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:57:00.191795 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48fb3a-1bf1-4116-9401-7b6006e1ee83 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:57:00.207558 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48fb3a-1bf1-4116-9401-7b6006e1ee83 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:57:00.213474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553bc4b-ccb4-46f3-b431-2ee6b4ea59c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:57:00.214159 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553bc4b-ccb4-46f3-b431-2ee6b4ea59c6 service nova] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:57:00.214440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553bc4b-ccb4-46f3-b431-2ee6b4ea59c6 service nova] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:57:00.214710 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553bc4b-ccb4-46f3-b431-2ee6b4ea59c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:57:00.217440 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f553bc4b-ccb4-46f3-b431-2ee6b4ea59c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:57:00.235104 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553bc4b-ccb4-46f3-b431-2ee6b4ea59c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:57:00.236759 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f553bc4b-ccb4-46f3-b431-2ee6b4ea59c6 service nova] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:57:00.254845 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4624/9210] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:57:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:57:07.688815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443d4d8-2cd3-4870-a640-bbb669b9c3b0 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:57:07.689388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443d4d8-2cd3-4870-a640-bbb669b9c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:57:07.689388 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443d4d8-2cd3-4870-a640-bbb669b9c3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:57:07.710557 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-4443d4d8-2cd3-4870-a640-bbb669b9c3b0 None None] MFA Rules not processed for user `604f8666461945d48f18a96e6e2add98`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:57:07.712068 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-4443d4d8-2cd3-4870-a640-bbb669b9c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:57:07.719673 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4587/9211] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 05:57:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:57:08.473156 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553bc4b-ccb4-46f3-b431-2ee6b4ea59c6 service nova] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:57:08.474725 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f553bc4b-ccb4-46f3-b431-2ee6b4ea59c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:57:08.490064 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553bc4b-ccb4-46f3-b431-2ee6b4ea59c6 service nova] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:57:08.496048 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4191f79-e1d9-454a-86f4-212f05c2f8b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:57:08.496773 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4191f79-e1d9-454a-86f4-212f05c2f8b9 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:57:08.497118 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4191f79-e1d9-454a-86f4-212f05c2f8b9 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:57:08.497458 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4191f79-e1d9-454a-86f4-212f05c2f8b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:57:08.499331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-f4191f79-e1d9-454a-86f4-212f05c2f8b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:57:08.512333 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4191f79-e1d9-454a-86f4-212f05c2f8b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:57:08.514047 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4191f79-e1d9-454a-86f4-212f05c2f8b9 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:57:08.525931 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4625/9212] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:57:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:57:09.902993 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13852b14-6179-49c1-a46f-339f0b44c5f8 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:57:09.903520 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13852b14-6179-49c1-a46f-339f0b44c5f8 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:57:09.903757 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13852b14-6179-49c1-a46f-339f0b44c5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:57:09.923960 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-13852b14-6179-49c1-a46f-339f0b44c5f8 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:57:09.925262 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-13852b14-6179-49c1-a46f-339f0b44c5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:57:09.933372 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4588/9213] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:57:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:57:09.946427 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4191f79-e1d9-454a-86f4-212f05c2f8b9 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:57:09.958119 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4191f79-e1d9-454a-86f4-212f05c2f8b9 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:57:09.964012 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7f2fd-22c3-4cd6-9d20-e708ae9efd86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:57:09.965281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7f2fd-22c3-4cd6-9d20-e708ae9efd86 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:57:09.965559 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7f2fd-22c3-4cd6-9d20-e708ae9efd86 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:57:09.965816 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7f2fd-22c3-4cd6-9d20-e708ae9efd86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:57:09.975014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7f2fd-22c3-4cd6-9d20-e708ae9efd86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:57:09.976609 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7f2fd-22c3-4cd6-9d20-e708ae9efd86 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:57:09.985143 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4626/9214] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:57:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:57:19.918748 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=38 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:57:19.981925 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=43 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:57:55.482134 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13852b14-6179-49c1-a46f-339f0b44c5f8 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:57:55.496622 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13852b14-6179-49c1-a46f-339f0b44c5f8 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:57:55.501337 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce74fe-6825-404d-833f-435522263d85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:57:55.501984 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce74fe-6825-404d-833f-435522263d85 service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:57:55.502243 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce74fe-6825-404d-833f-435522263d85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:57:55.502506 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce74fe-6825-404d-833f-435522263d85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:57:55.504534 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-0fce74fe-6825-404d-833f-435522263d85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:57:55.529101 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce74fe-6825-404d-833f-435522263d85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:57:55.530632 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce74fe-6825-404d-833f-435522263d85 service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:57:55.538806 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4589/9215] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:57:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:58:05.535275 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=11 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:59:40.507625 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b815884-2ece-465a-a782-2a53cef9cc23 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:40.508163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b815884-2ece-465a-a782-2a53cef9cc23 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:40.508163 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b815884-2ece-465a-a782-2a53cef9cc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:40.580023 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-1b815884-2ece-465a-a782-2a53cef9cc23 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:59:40.581656 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1b815884-2ece-465a-a782-2a53cef9cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:59:40.610578 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4627/9216] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 05:59:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:59:40.650202 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce74fe-6825-404d-833f-435522263d85 service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:59:40.676251 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce74fe-6825-404d-833f-435522263d85 service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:59:40.682091 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02357c03-4c64-4feb-878c-4389c5f949b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:59:40.682726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02357c03-4c64-4feb-878c-4389c5f949b5 service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:40.683006 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02357c03-4c64-4feb-878c-4389c5f949b5 service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:40.683292 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02357c03-4c64-4feb-878c-4389c5f949b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:40.692582 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02357c03-4c64-4feb-878c-4389c5f949b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:59:40.694219 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02357c03-4c64-4feb-878c-4389c5f949b5 service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:59:40.702818 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4590/9217] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:59:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:59:44.937901 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b815884-2ece-465a-a782-2a53cef9cc23 None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:59:44.939386 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-1b815884-2ece-465a-a782-2a53cef9cc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:59:44.984080 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b815884-2ece-465a-a782-2a53cef9cc23 None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:59:44.988838 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2d1d2-8905-435d-999d-e2bacc15fff9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d31eed8c74549f8b8c6bb5aaa6bee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:59:44.989569 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2d1d2-8905-435d-999d-e2bacc15fff9 service glance] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:44.990362 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2d1d2-8905-435d-999d-e2bacc15fff9 service glance] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:44.990970 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2d1d2-8905-435d-999d-e2bacc15fff9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:45.000095 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2d1d2-8905-435d-999d-e2bacc15fff9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:59:45.001644 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2d1d2-8905-435d-999d-e2bacc15fff9 service glance] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:59:45.018084 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4628/9218] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:59:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:59:50.245913 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cccb2-4667-4889-ac60-057393d81a02 None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:50.246480 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cccb2-4667-4889-ac60-057393d81a02 None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:50.246620 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cccb2-4667-4889-ac60-057393d81a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:50.266987 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-b49cccb2-4667-4889-ac60-057393d81a02 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:59:50.268209 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b49cccb2-4667-4889-ac60-057393d81a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:59:50.277616 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4591/9219] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 05:59:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:59:50.293598 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2d1d2-8905-435d-999d-e2bacc15fff9 service glance] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:59:50.309554 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2d1d2-8905-435d-999d-e2bacc15fff9 service glance] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:59:50.314652 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d40d91-ec07-4b81-ae79-b5d4b65c98d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:59:50.315256 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d40d91-ec07-4b81-ae79-b5d4b65c98d5 service swift] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:50.315528 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d40d91-ec07-4b81-ae79-b5d4b65c98d5 service swift] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:50.315794 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d40d91-ec07-4b81-ae79-b5d4b65c98d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:50.324578 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d40d91-ec07-4b81-ae79-b5d4b65c98d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:59:50.326181 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d40d91-ec07-4b81-ae79-b5d4b65c98d5 service swift] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:59:50.333988 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4629/9220] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:59:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:59:51.564242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cccb2-4667-4889-ac60-057393d81a02 None None] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:59:51.565815 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-b49cccb2-4667-4889-ac60-057393d81a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:59:51.613317 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cccb2-4667-4889-ac60-057393d81a02 None None] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:59:51.620327 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf8ffe-c928-430f-9000-8a7bd070b986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:59:51.620677 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf8ffe-c928-430f-9000-8a7bd070b986 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:51.620961 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf8ffe-c928-430f-9000-8a7bd070b986 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:51.621242 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf8ffe-c928-430f-9000-8a7bd070b986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:51.623884 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-8dbf8ffe-c928-430f-9000-8a7bd070b986 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:59:51.638148 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf8ffe-c928-430f-9000-8a7bd070b986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:59:51.639797 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf8ffe-c928-430f-9000-8a7bd070b986 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:59:51.653201 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4592/9221] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:59:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:59:51.772845 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d40d91-ec07-4b81-ae79-b5d4b65c98d5 service swift] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:59:51.783009 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d40d91-ec07-4b81-ae79-b5d4b65c98d5 service swift] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:59:51.786611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba22442-1e95-4c83-9e42-92738acc37b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:59:51.787214 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba22442-1e95-4c83-9e42-92738acc37b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:51.787490 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba22442-1e95-4c83-9e42-92738acc37b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:51.787760 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba22442-1e95-4c83-9e42-92738acc37b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:51.798664 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba22442-1e95-4c83-9e42-92738acc37b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:59:51.800112 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba22442-1e95-4c83-9e42-92738acc37b5 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:59:51.811543 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4630/9222] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:59:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:59:54.026488 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf8ffe-c928-430f-9000-8a7bd070b986 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:59:54.038289 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf8ffe-c928-430f-9000-8a7bd070b986 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:59:54.044152 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ceffb-c1ea-43cd-8888-a92775a125f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3a99d39337841849b3e2efe48ebe53c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:59:54.044770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ceffb-c1ea-43cd-8888-a92775a125f4 service nova] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:54.045045 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ceffb-c1ea-43cd-8888-a92775a125f4 service nova] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:54.045312 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ceffb-c1ea-43cd-8888-a92775a125f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:54.047115 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6e4ceffb-c1ea-43cd-8888-a92775a125f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:59:54.059880 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ceffb-c1ea-43cd-8888-a92775a125f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:59:54.061494 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ceffb-c1ea-43cd-8888-a92775a125f4 service nova] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:59:54.073675 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4593/9223] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:59:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:59:55.335756 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4d98-880e-4073-9e66-b636fb4c1ef4 None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:55.336237 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4d98-880e-4073-9e66-b636fb4c1ef4 None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:55.336349 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d4d98-880e-4073-9e66-b636fb4c1ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:55.358695 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-880d4d98-880e-4073-9e66-b636fb4c1ef4 None None] MFA Rules not processed for user `d7c17b0543d14adda9784af0fd2082d5`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:59:55.359955 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-880d4d98-880e-4073-9e66-b636fb4c1ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:59:55.368679 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4631/9224] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 05:59:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:59:55.381109 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ceffb-c1ea-43cd-8888-a92775a125f4 service nova] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:59:55.402468 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ceffb-c1ea-43cd-8888-a92775a125f4 service nova] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:59:55.408210 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7abf4-d0de-4fba-b070-c08407a781df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9592051e6894c86a699ca2074a32079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:59:55.408821 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7abf4-d0de-4fba-b070-c08407a781df service swift] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:55.409095 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7abf4-d0de-4fba-b070-c08407a781df service swift] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:55.409358 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7abf4-d0de-4fba-b070-c08407a781df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:55.419566 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7abf4-d0de-4fba-b070-c08407a781df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:59:55.421201 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7abf4-d0de-4fba-b070-c08407a781df service swift] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:59:55.433508 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4594/9225] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 05:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 05:59:57.162597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364f19c-139c-49a6-93d5-45633d4b874a None None] REQUEST_METHOD: `POST` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:57.163146 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364f19c-139c-49a6-93d5-45633d4b874a None None] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:57.163591 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364f19c-139c-49a6-93d5-45633d4b874a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:57.234205 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.auth.core [None req-b364f19c-139c-49a6-93d5-45633d4b874a None None] MFA Rules not processed for user `e7fbaf173ad846c6a5cb818ea09c9197`. Rule list: `[]` (Enabled: `True`). {{(pid=82098) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 05:59:57.235615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-b364f19c-139c-49a6-93d5-45633d4b874a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 05:59:57.243729 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4632/9226] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Aug 30 05:59:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 05:59:57.250654 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7abf4-d0de-4fba-b070-c08407a781df service swift] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:59:57.255046 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364f19c-139c-49a6-93d5-45633d4b874a None None] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:59:57.261836 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7abf4-d0de-4fba-b070-c08407a781df service swift] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:59:57.264290 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364f19c-139c-49a6-93d5-45633d4b874a None None] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:59:57.266889 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b06646-13ce-4086-a248-56e47679ea7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:59:57.267767 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b06646-13ce-4086-a248-56e47679ea7e service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:57.268083 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf643f-01f7-44ac-aaf5-282094d544a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:59:57.268623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b06646-13ce-4086-a248-56e47679ea7e service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:57.268763 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf643f-01f7-44ac-aaf5-282094d544a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:57.268987 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf643f-01f7-44ac-aaf5-282094d544a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:57.269260 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf643f-01f7-44ac-aaf5-282094d544a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:57.269687 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b06646-13ce-4086-a248-56e47679ea7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:57.278232 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b06646-13ce-4086-a248-56e47679ea7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:59:57.279918 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b06646-13ce-4086-a248-56e47679ea7e service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:59:57.281519 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf643f-01f7-44ac-aaf5-282094d544a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:59:57.283014 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf643f-01f7-44ac-aaf5-282094d544a3 service neutron] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:59:57.288829 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4595/9227] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:59:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 05:59:57.296106 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4633/9228] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:59:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 05:59:59.844311 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b06646-13ce-4086-a248-56e47679ea7e service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 05:59:59.854171 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b06646-13ce-4086-a248-56e47679ea7e service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 05:59:59.859269 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18fedd-ca20-4a77-a1e1-ff1359c6962d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7fbaf173ad846c6a5cb818ea09c9197', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 05:59:59.859863 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18fedd-ca20-4a77-a1e1-ff1359c6962d service neutron] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 05:59:59.860138 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18fedd-ca20-4a77-a1e1-ff1359c6962d service neutron] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 05:59:59.860403 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18fedd-ca20-4a77-a1e1-ff1359c6962d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 05:59:59.940430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18fedd-ca20-4a77-a1e1-ff1359c6962d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 05:59:59.942438 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18fedd-ca20-4a77-a1e1-ff1359c6962d service neutron] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 05:59:59.952084 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4596/9229] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 05:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 06:00:02.943523 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf643f-01f7-44ac-aaf5-282094d544a3 service neutron] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 06:00:02.959708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf643f-01f7-44ac-aaf5-282094d544a3 service neutron] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 06:00:02.962870 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eb9c6-3022-426e-a45c-301ad8e4a96f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 06:00:02.963491 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb9c6-3022-426e-a45c-301ad8e4a96f service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:00:02.963766 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb9c6-3022-426e-a45c-301ad8e4a96f service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:00:02.964032 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074eb9c6-3022-426e-a45c-301ad8e4a96f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:00:02.965857 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-074eb9c6-3022-426e-a45c-301ad8e4a96f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 06:00:02.981285 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074eb9c6-3022-426e-a45c-301ad8e4a96f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 06:00:02.986869 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074eb9c6-3022-426e-a45c-301ad8e4a96f service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 06:00:02.999753 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4634/9230] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 06:00:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 06:00:06.366952 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18fedd-ca20-4a77-a1e1-ff1359c6962d service neutron] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 06:00:06.372604 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=77 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:00:06.378933 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18fedd-ca20-4a77-a1e1-ff1359c6962d service neutron] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 06:00:06.384378 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 06:00:06.385056 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:00:06.385356 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:00:06.385623 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] PATH_INFO: `/v3/users/604f8666461945d48f18a96e6e2add98` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:00:06.386971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=604f8666461945d48f18a96e6e2add98)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 06:00:06.389054 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 06:00:06.442523 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '604f8666461945d48f18a96e6e2add98'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:06.450770 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '604f8666461945d48f18a96e6e2add98'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:06.464599 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '604f8666461945d48f18a96e6e2add98'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:06.479024 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '604f8666461945d48f18a96e6e2add98'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:06.479822 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '604f8666461945d48f18a96e6e2add98'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:06.487114 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4597/9231] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 06:00:06 2022] DELETE /identity/v3/users/604f8666461945d48f18a96e6e2add98 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 06:00:06.679207 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eb9c6-3022-426e-a45c-301ad8e4a96f service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 06:00:06.690954 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074eb9c6-3022-426e-a45c-301ad8e4a96f service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 06:00:06.740942 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=100 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:00:06.756800 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 06:00:06.757443 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:00:06.757721 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:00:06.757994 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] PATH_INFO: `/v3/projects/82012f46260a467f892baa2952ca68ae` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:00:06.759226 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82012f46260a467f892baa2952ca68ae)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 06:00:06.761177 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 06:00:06.809562 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82012f46260a467f892baa2952ca68ae', 'request_id': 'req-008d760b-c5e4-44ec-b81f-0ae600d99d26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:06.815755 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82012f46260a467f892baa2952ca68ae', 'request_id': 'req-008d760b-c5e4-44ec-b81f-0ae600d99d26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:06.824648 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82012f46260a467f892baa2952ca68ae', 'request_id': 'req-008d760b-c5e4-44ec-b81f-0ae600d99d26'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:06.848981 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] The token cache is being invalidate because project 82012f46260a467f892baa2952ca68ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 06:00:06.849267 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:06.849992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:06.851590 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4635/9232] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 06:00:06 2022] DELETE /identity/v3/projects/82012f46260a467f892baa2952ca68ae => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 06:00:06.855867 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 06:00:06.857402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 06:00:06.871351 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eecfd3-3e9d-4caa-87f3-a43cde08d773 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 06:00:06.950814 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 06:00:06.951393 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:00:06.951796 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:00:06.952250 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] PATH_INFO: `/v3/users/b691d6f1c23843728b281541fcc958d2` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:00:06.953469 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b691d6f1c23843728b281541fcc958d2)` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 06:00:06.955439 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 06:00:07.016265 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b691d6f1c23843728b281541fcc958d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:07.024402 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b691d6f1c23843728b281541fcc958d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:07.038382 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b691d6f1c23843728b281541fcc958d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:07.041012 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:00:07.046926 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b691d6f1c23843728b281541fcc958d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:07.047789 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.notifications [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b691d6f1c23843728b281541fcc958d2'} {{(pid=82099) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:07.056629 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4598/9233] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 06:00:06 2022] DELETE /identity/v3/users/b691d6f1c23843728b281541fcc958d2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 06:00:07.243864 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 06:00:07.245449 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 06:00:07.259172 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d760b-c5e4-44ec-b81f-0ae600d99d26 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 06:00:07.329355 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad96c68450db4b7c8c97facc17fd8c89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3494f9474e30444f9b9f701899a3224a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 06:00:07.330073 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:00:07.330348 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:00:07.330615 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] PATH_INFO: `/v3/projects/dd7aaa28b62d4573900bc408cc7df44d` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:00:07.331790 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd7aaa28b62d4573900bc408cc7df44d)` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 06:00:07.333722 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 06:00:07.381729 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd7aaa28b62d4573900bc408cc7df44d', 'request_id': 'req-412b42fd-918d-4150-94d4-14e22c7692b8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:07.387829 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd7aaa28b62d4573900bc408cc7df44d', 'request_id': 'req-412b42fd-918d-4150-94d4-14e22c7692b8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:07.396474 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd7aaa28b62d4573900bc408cc7df44d', 'request_id': 'req-412b42fd-918d-4150-94d4-14e22c7692b8'} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:07.400476 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:00:07.408639 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] The token cache is being invalidate because project dd7aaa28b62d4573900bc408cc7df44d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82098) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 06:00:07.409281 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:07.410176 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.notifications [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82098) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 06:00:07.411800 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4636/9234] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 06:00:07 2022] DELETE /identity/v3/projects/dd7aaa28b62d4573900bc408cc7df44d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 06:00:17.053548 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:00:17.413304 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:01:00.779435 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 06:01:00.781058 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 06:01:00.873493 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b26224-8772-44d0-b91d-c4c0a9842064 admin admin] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 06:01:00.948829 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8555550-fd5d-4707-a254-86d1217a8c60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 06:01:00.949446 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8555550-fd5d-4707-a254-86d1217a8c60 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:01:00.949726 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8555550-fd5d-4707-a254-86d1217a8c60 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:01:00.950036 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8555550-fd5d-4707-a254-86d1217a8c60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:01:00.952377 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-a8555550-fd5d-4707-a254-86d1217a8c60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 06:01:00.964430 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8555550-fd5d-4707-a254-86d1217a8c60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 06:01:00.966088 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8555550-fd5d-4707-a254-86d1217a8c60 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 06:01:00.976651 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4599/9235] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 06:01:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 06:01:10.972592 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=62 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:01:17.463822 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 06:01:17.465420 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 06:01:17.481832 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b42fd-918d-4150-94d4-14e22c7692b8 admin admin] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 06:01:17.487529 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64d3c-3347-4e33-8d29-76d434971809 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 06:01:17.488541 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64d3c-3347-4e33-8d29-76d434971809 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:01:17.488815 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64d3c-3347-4e33-8d29-76d434971809 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:01:17.489088 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db64d3c-3347-4e33-8d29-76d434971809 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:01:17.490960 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.fernet_utils [None req-2db64d3c-3347-4e33-8d29-76d434971809 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82098) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 06:01:17.504053 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64d3c-3347-4e33-8d29-76d434971809 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 06:01:17.505663 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db64d3c-3347-4e33-8d29-76d434971809 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 06:01:17.516106 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4637/9236] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 06:01:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 06:01:27.512225 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:06:03.767850 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8555550-fd5d-4707-a254-86d1217a8c60 service placement] Authenticating user token {{(pid=82099) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 06:06:03.815019 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8555550-fd5d-4707-a254-86d1217a8c60 service placement] Validating token access rules against request {{(pid=82099) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 06:06:03.820999 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c42b89-df00-4c1a-a03e-6f3f145d8ff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82099) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 06:06:03.821795 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42b89-df00-4c1a-a03e-6f3f145d8ff6 service placement] REQUEST_METHOD: `GET` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:06:03.822245 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42b89-df00-4c1a-a03e-6f3f145d8ff6 service placement] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:06:03.822484 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c42b89-df00-4c1a-a03e-6f3f145d8ff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:06:03.832529 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c42b89-df00-4c1a-a03e-6f3f145d8ff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 06:06:03.834224 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c42b89-df00-4c1a-a03e-6f3f145d8ff6 service placement] RBAC: Authorization granted {{(pid=82099) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 06:06:03.845000 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4600/9237] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 06:06:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 06:06:13.840491 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=20 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:06:20.498041 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64d3c-3347-4e33-8d29-76d434971809 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 06:06:20.543589 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db64d3c-3347-4e33-8d29-76d434971809 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 06:06:20.549534 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baea78-94e7-459c-b389-52fcd52a8a35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 06:06:20.550323 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baea78-94e7-459c-b389-52fcd52a8a35 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:06:20.550597 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baea78-94e7-459c-b389-52fcd52a8a35 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:06:20.550875 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baea78-94e7-459c-b389-52fcd52a8a35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:06:20.560210 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baea78-94e7-459c-b389-52fcd52a8a35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 06:06:20.561814 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baea78-94e7-459c-b389-52fcd52a8a35 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 06:06:20.572753 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4638/9238] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 06:06:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 06:06:30.569017 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=20 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:08:21.426971 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461a700-3679-48a4-ab35-75afa869c6cd None None] REQUEST_METHOD: `POST` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:08:21.427615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461a700-3679-48a4-ab35-75afa869c6cd None None] SCRIPT_NAME: `/identity` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:08:21.427615 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461a700-3679-48a4-ab35-75afa869c6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82099) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:08:21.491368 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.auth.core [None req-6461a700-3679-48a4-ab35-75afa869c6cd None None] MFA Rules not processed for user `f8e4120107ff4ec1b1f3846a7f475ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=82099) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 06:08:21.493414 n-d-820368-36 devstack@keystone.service[82099]: DEBUG keystone.common.fernet_utils [None req-6461a700-3679-48a4-ab35-75afa869c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82099) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 06:08:21.513098 n-d-820368-36 devstack@keystone.service[82099]: [pid: 82099|app: 0|req: 4601/9239] 10.222.0.65 () {58 vars in 1015 bytes} [Tue Aug 30 06:08:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 06:08:21.527980 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baea78-94e7-459c-b389-52fcd52a8a35 service placement] Authenticating user token {{(pid=82098) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 06:08:21.540549 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baea78-94e7-459c-b389-52fcd52a8a35 service placement] Validating token access rules against request {{(pid=82098) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 06:08:21.545665 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a20dfc-8a2f-4758-b744-766ae70fa9d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e4120107ff4ec1b1f3846a7f475ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '52a1a3876cb4499182e40a4018f69912', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82098) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 06:08:21.546331 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20dfc-8a2f-4758-b744-766ae70fa9d2 service placement] REQUEST_METHOD: `GET` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 06:08:21.546611 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20dfc-8a2f-4758-b744-766ae70fa9d2 service placement] SCRIPT_NAME: `/identity` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 06:08:21.546880 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a20dfc-8a2f-4758-b744-766ae70fa9d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82098) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 06:08:21.556992 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a20dfc-8a2f-4758-b744-766ae70fa9d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 06:08:21.558708 n-d-820368-36 devstack@keystone.service[82098]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a20dfc-8a2f-4758-b744-766ae70fa9d2 service placement] RBAC: Authorization granted {{(pid=82098) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 06:08:21.571233 n-d-820368-36 devstack@keystone.service[82098]: [pid: 82098|app: 0|req: 4639/9240] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 06:08:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 06:08:31.502855 n-d-820368-36 devstack@keystone.service[82099]: DEBUG dbcounter [-] [82099] Writing DB stats keystone:SELECT=22 {{(pid=82099) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 06:08:31.566466 n-d-820368-36 devstack@keystone.service[82098]: DEBUG dbcounter [-] [82098] Writing DB stats keystone:SELECT=6 {{(pid=82098) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}